2024-03-27T09:44:13.986 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-27T09:44:13.987 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2024-03-27_05:27:11-fs-wip-rishabh-testing-20240326.131558-testing-default-smithi/7625753 --description fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/xfstests-dev} --verbose --name rishabh-2024-03-27_05:27:11-fs-wip-rishabh-testing-20240326.131558-testing-default-smithi -- /home/teuthworker/archive/rishabh-2024-03-27_05:27:11-fs-wip-rishabh-testing-20240326.131558-testing-default-smithi/7625753/orig.config.yaml 2024-03-27T09:44:14.033 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-27T09:44:14.117 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2024-03-27_05:27:11-fs-wip-rishabh-testing-20240326.131558-testing-default-smithi/7625753 branch: wip-rishabh-testing-20240326.131558 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/xfstests-dev} email: null first_in_suite: false job_id: '7625753' kernel: flavor: default kdb: true sha1: 1df0c7e8a2354c42d738e5454ba83ea7332deac2 last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: rishabh-2024-03-27_05:27:11-fs-wip-rishabh-testing-20240326.131558-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-rishabh-testing-20240326.131558 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability sha1: 155268c4e432a12433aa833f174f9fe3b1016ae0 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 155268c4e432a12433aa833f174f9fe3b1016ae0 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 subvolume_version: 2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-testing-20240326.131558 sha1: 155268c4e432a12433aa833f174f9fe3b1016ae0 owner: scheduled_rishabh@teuthology priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 6931 sha1: 155268c4e432a12433aa833f174f9fe3b1016ae0 sleep_before_teardown: 0 subset: 80/512 suite: fs suite_branch: wip-rishabh-testing-20240326.131558 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_155268c4e432a12433aa833f174f9fe3b1016ae0/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 155268c4e432a12433aa833f174f9fe3b1016ae0 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi057.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBG7KokvzCOi8Nbw+dh7uIJ1WZcMHNo/9cXZPtyo2o9dDBCShEhbm+6ZdkUig8qMpvw6Svrvbd75nS+iy0GC7eH4= smithi118.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNOxjBCdu8PZlUX2LDU4u3fdfWSbzvPjKPxXqdqEbcD9bnoPnMpSQKxUqM71fYf+lxpDh+hlkdejOhO2VG7zE2U= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - ceph-fuse: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.tests_from_xfstests_dev teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: e691533f9cbb33d85b2187bba20d7102f098636d timestamp: 2024-03-27_05:27:11 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-03-27T09:44:14.118 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_155268c4e432a12433aa833f174f9fe3b1016ae0/qa; will attempt to use it 2024-03-27T09:44:14.118 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_155268c4e432a12433aa833f174f9fe3b1016ae0/qa/tasks 2024-03-27T09:44:14.119 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-03-27T09:44:14.120 INFO:teuthology.task.internal:Checking packages... 2024-03-27T09:44:14.145 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '155268c4e432a12433aa833f174f9fe3b1016ae0' 2024-03-27T09:44:14.145 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-03-27T09:44:14.145 INFO:teuthology.packaging:ref: None 2024-03-27T09:44:14.145 INFO:teuthology.packaging:tag: None 2024-03-27T09:44:14.145 INFO:teuthology.packaging:branch: wip-rishabh-testing-20240326.131558 2024-03-27T09:44:14.145 INFO:teuthology.packaging:sha1: 155268c4e432a12433aa833f174f9fe3b1016ae0 2024-03-27T09:44:14.145 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-rishabh-testing-20240326.131558 2024-03-27T09:44:14.368 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2478.g155268c4 2024-03-27T09:44:14.370 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-03-27T09:44:14.376 INFO:teuthology.task.internal:no buildpackages task found 2024-03-27T09:44:14.376 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-03-27T09:44:14.383 INFO:teuthology.task.internal:Saving configuration 2024-03-27T09:44:14.403 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-03-27T09:44:14.409 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-27T09:44:14.428 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi057.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-03-27_05:27:11-fs-wip-rishabh-testing-20240326.131558-testing-default-smithi/7625753', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-27 09:38:23.504182', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBG7KokvzCOi8Nbw+dh7uIJ1WZcMHNo/9cXZPtyo2o9dDBCShEhbm+6ZdkUig8qMpvw6Svrvbd75nS+iy0GC7eH4='} 2024-03-27T09:44:14.445 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi118.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-03-27_05:27:11-fs-wip-rishabh-testing-20240326.131558-testing-default-smithi/7625753', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-27 09:38:23.502782', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNOxjBCdu8PZlUX2LDU4u3fdfWSbzvPjKPxXqdqEbcD9bnoPnMpSQKxUqM71fYf+lxpDh+hlkdejOhO2VG7zE2U='} 2024-03-27T09:44:14.445 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-03-27T09:44:14.451 INFO:teuthology.task.internal:roles: ubuntu@smithi057.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-03-27T09:44:14.451 INFO:teuthology.task.internal:roles: ubuntu@smithi118.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-03-27T09:44:14.451 INFO:teuthology.run_tasks:Running task console_log... 2024-03-27T09:44:14.515 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ff5efb4e160>, signals=[15]) 2024-03-27T09:44:14.516 INFO:teuthology.run_tasks:Running task internal.connect... 2024-03-27T09:44:14.522 INFO:teuthology.task.internal:Opening connections... 2024-03-27T09:44:14.522 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi057.front.sepia.ceph.com 2024-03-27T09:44:14.524 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-27T09:44:14.631 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi118.front.sepia.ceph.com 2024-03-27T09:44:14.632 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-27T09:44:14.721 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-03-27T09:44:14.728 DEBUG:teuthology.orchestra.run.smithi057:> uname -m 2024-03-27T09:44:14.746 INFO:teuthology.orchestra.run.smithi057.stdout:x86_64 2024-03-27T09:44:14.746 DEBUG:teuthology.orchestra.run.smithi057:> cat /etc/os-release 2024-03-27T09:44:14.804 INFO:teuthology.orchestra.run.smithi057.stdout:NAME="CentOS Stream" 2024-03-27T09:44:14.804 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION="9" 2024-03-27T09:44:14.805 INFO:teuthology.orchestra.run.smithi057.stdout:ID="centos" 2024-03-27T09:44:14.805 INFO:teuthology.orchestra.run.smithi057.stdout:ID_LIKE="rhel fedora" 2024-03-27T09:44:14.805 INFO:teuthology.orchestra.run.smithi057.stdout:VERSION_ID="9" 2024-03-27T09:44:14.805 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM_ID="platform:el9" 2024-03-27T09:44:14.805 INFO:teuthology.orchestra.run.smithi057.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-27T09:44:14.805 INFO:teuthology.orchestra.run.smithi057.stdout:ANSI_COLOR="0;31" 2024-03-27T09:44:14.805 INFO:teuthology.orchestra.run.smithi057.stdout:LOGO="fedora-logo-icon" 2024-03-27T09:44:14.805 INFO:teuthology.orchestra.run.smithi057.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-27T09:44:14.805 INFO:teuthology.orchestra.run.smithi057.stdout:HOME_URL="https://centos.org/" 2024-03-27T09:44:14.805 INFO:teuthology.orchestra.run.smithi057.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-27T09:44:14.805 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-27T09:44:14.805 INFO:teuthology.orchestra.run.smithi057.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-27T09:44:14.806 INFO:teuthology.lock.ops:Updating smithi057.front.sepia.ceph.com on lock server 2024-03-27T09:44:14.823 DEBUG:teuthology.orchestra.run.smithi118:> uname -m 2024-03-27T09:44:14.840 INFO:teuthology.orchestra.run.smithi118.stdout:x86_64 2024-03-27T09:44:14.841 DEBUG:teuthology.orchestra.run.smithi118:> cat /etc/os-release 2024-03-27T09:44:14.901 INFO:teuthology.orchestra.run.smithi118.stdout:NAME="CentOS Stream" 2024-03-27T09:44:14.901 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION="9" 2024-03-27T09:44:14.901 INFO:teuthology.orchestra.run.smithi118.stdout:ID="centos" 2024-03-27T09:44:14.901 INFO:teuthology.orchestra.run.smithi118.stdout:ID_LIKE="rhel fedora" 2024-03-27T09:44:14.901 INFO:teuthology.orchestra.run.smithi118.stdout:VERSION_ID="9" 2024-03-27T09:44:14.901 INFO:teuthology.orchestra.run.smithi118.stdout:PLATFORM_ID="platform:el9" 2024-03-27T09:44:14.901 INFO:teuthology.orchestra.run.smithi118.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-27T09:44:14.901 INFO:teuthology.orchestra.run.smithi118.stdout:ANSI_COLOR="0;31" 2024-03-27T09:44:14.902 INFO:teuthology.orchestra.run.smithi118.stdout:LOGO="fedora-logo-icon" 2024-03-27T09:44:14.902 INFO:teuthology.orchestra.run.smithi118.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-27T09:44:14.902 INFO:teuthology.orchestra.run.smithi118.stdout:HOME_URL="https://centos.org/" 2024-03-27T09:44:14.902 INFO:teuthology.orchestra.run.smithi118.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-27T09:44:14.902 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-27T09:44:14.902 INFO:teuthology.orchestra.run.smithi118.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-27T09:44:14.902 INFO:teuthology.lock.ops:Updating smithi118.front.sepia.ceph.com on lock server 2024-03-27T09:44:14.923 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-03-27T09:44:14.932 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-03-27T09:44:14.937 INFO:teuthology.task.internal:Checking for old test directory... 2024-03-27T09:44:14.937 DEBUG:teuthology.orchestra.run.smithi057:> test '!' -e /home/ubuntu/cephtest 2024-03-27T09:44:14.940 DEBUG:teuthology.orchestra.run.smithi118:> test '!' -e /home/ubuntu/cephtest 2024-03-27T09:44:14.959 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-03-27T09:44:14.967 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-03-27T09:44:14.967 DEBUG:teuthology.orchestra.run.smithi057:> test -z $(ls -A /var/lib/ceph) 2024-03-27T09:44:14.997 DEBUG:teuthology.orchestra.run.smithi118:> test -z $(ls -A /var/lib/ceph) 2024-03-27T09:44:15.109 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-03-27T09:44:15.165 INFO:teuthology.run_tasks:Running task kernel... 2024-03-27T09:44:15.230 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': True, 'sha1': '1df0c7e8a2354c42d738e5454ba83ea7332deac2'} 2024-03-27T09:44:15.230 INFO:teuthology.task.kernel:config {'mon.a': {'flavor': 'default', 'kdb': True, 'sha1': '1df0c7e8a2354c42d738e5454ba83ea7332deac2'}, 'mon.b': {'flavor': 'default', 'kdb': True, 'sha1': '1df0c7e8a2354c42d738e5454ba83ea7332deac2'}}, timeout 300 2024-03-27T09:44:15.230 DEBUG:teuthology.orchestra.run.smithi057:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-27T09:44:15.231 DEBUG:teuthology.orchestra.run.smithi118:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-27T09:44:15.246 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-27T09:44:15.248 DEBUG:teuthology.task.kernel:sha1 for mon.b is 1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-03-27T09:44:15.248 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "1df0c7e8a2354c42d738e5454ba83ea7332deac2"... 2024-03-27T09:44:15.248 DEBUG:teuthology.orchestra.run.smithi118:> uname -r 2024-03-27T09:44:15.248 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-27T09:44:15.249 DEBUG:teuthology.task.kernel:sha1 for mon.a is 1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-03-27T09:44:15.249 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "1df0c7e8a2354c42d738e5454ba83ea7332deac2"... 2024-03-27T09:44:15.249 DEBUG:teuthology.orchestra.run.smithi057:> uname -r 2024-03-27T09:44:15.306 INFO:teuthology.orchestra.run.smithi118.stdout:5.14.0-361.el9.x86_64 2024-03-27T09:44:15.306 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs 1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-03-27T09:44:15.306 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-03-27T09:44:15.307 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-03-27T09:44:15.311 INFO:teuthology.orchestra.run.smithi057.stdout:5.14.0-361.el9.x86_64 2024-03-27T09:44:15.311 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs 1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-03-27T09:44:15.311 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-03-27T09:44:15.311 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-03-27T09:44:15.452 DEBUG:teuthology.orchestra.run.smithi118:> sudo yum upgrade -y linux-firmware 2024-03-27T09:44:15.543 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum upgrade -y linux-firmware 2024-03-27T09:44:17.709 INFO:teuthology.orchestra.run.smithi057.stdout:CentOS-9 - AppStream 13 MB/s | 6.7 MB 00:00 2024-03-27T09:44:18.664 INFO:teuthology.orchestra.run.smithi118.stdout:CentOS-9 - AppStream 10 MB/s | 6.7 MB 00:00 2024-03-27T09:44:19.351 INFO:teuthology.orchestra.run.smithi057.stdout:CentOS-9 - BaseOS 4.2 MB/s | 2.0 MB 00:00 2024-03-27T09:44:20.181 INFO:teuthology.orchestra.run.smithi118.stdout:CentOS-9 - BaseOS 4.9 MB/s | 2.0 MB 00:00 2024-03-27T09:44:20.325 INFO:teuthology.orchestra.run.smithi057.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.0 MB 00:00 2024-03-27T09:44:25.743 INFO:teuthology.orchestra.run.smithi057.stdout:CentOS Stream 9 - AppStream 4.4 MB/s | 19 MB 00:04 2024-03-27T09:44:27.546 INFO:teuthology.orchestra.run.smithi118.stdout:CentOS Stream 9 - BaseOS 1.1 MB/s | 8.0 MB 00:07 2024-03-27T09:44:29.272 INFO:teuthology.orchestra.run.smithi118.stdout:CentOS Stream 9 - AppStream 28 MB/s | 19 MB 00:00 2024-03-27T09:44:34.781 INFO:teuthology.orchestra.run.smithi118.stdout:CentOS Stream 9 - CRB 3.0 MB/s | 6.1 MB 00:02 2024-03-27T09:44:36.215 INFO:teuthology.orchestra.run.smithi118.stdout:CentOS Stream 9 - Extras packages 53 kB/s | 16 kB 00:00 2024-03-27T09:44:37.058 INFO:teuthology.orchestra.run.smithi118.stdout:Extra Packages for Enterprise Linux 28 MB/s | 21 MB 00:00 2024-03-27T09:44:37.867 INFO:teuthology.orchestra.run.smithi057.stdout:CentOS Stream 9 - CRB 740 kB/s | 6.1 MB 00:08 2024-03-27T09:44:39.492 INFO:teuthology.orchestra.run.smithi057.stdout:CentOS Stream 9 - Extras packages 37 kB/s | 16 kB 00:00 2024-03-27T09:44:41.908 INFO:teuthology.orchestra.run.smithi118.stdout:lab-extras 34 kB/s | 1.7 kB 00:00 2024-03-27T09:44:42.385 INFO:teuthology.orchestra.run.smithi057.stdout:Extra Packages for Enterprise Linux 7.4 MB/s | 21 MB 00:02 2024-03-27T09:44:44.128 INFO:teuthology.orchestra.run.smithi118.stdout:Dependencies resolved. 2024-03-27T09:44:44.140 INFO:teuthology.orchestra.run.smithi118.stdout:================================================================================ 2024-03-27T09:44:44.140 INFO:teuthology.orchestra.run.smithi118.stdout: Package Arch Version Repository Size 2024-03-27T09:44:44.140 INFO:teuthology.orchestra.run.smithi118.stdout:================================================================================ 2024-03-27T09:44:44.140 INFO:teuthology.orchestra.run.smithi118.stdout:Upgrading: 2024-03-27T09:44:44.140 INFO:teuthology.orchestra.run.smithi118.stdout: linux-firmware noarch 20240219-143.el9 CentOS-BaseOS 375 M 2024-03-27T09:44:44.140 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-27T09:44:44.140 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction Summary 2024-03-27T09:44:44.140 INFO:teuthology.orchestra.run.smithi118.stdout:================================================================================ 2024-03-27T09:44:44.140 INFO:teuthology.orchestra.run.smithi118.stdout:Upgrade 1 Package 2024-03-27T09:44:44.140 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-27T09:44:44.141 INFO:teuthology.orchestra.run.smithi118.stdout:Total download size: 375 M 2024-03-27T09:44:44.141 INFO:teuthology.orchestra.run.smithi118.stdout:Downloading Packages: 2024-03-27T09:44:47.452 INFO:teuthology.orchestra.run.smithi057.stdout:lab-extras 21 kB/s | 1.7 kB 00:00 2024-03-27T09:44:49.781 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-03-27T09:44:49.795 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-03-27T09:44:49.795 INFO:teuthology.orchestra.run.smithi057.stdout: Package Arch Version Repository Size 2024-03-27T09:44:49.795 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-03-27T09:44:49.795 INFO:teuthology.orchestra.run.smithi057.stdout:Upgrading: 2024-03-27T09:44:49.795 INFO:teuthology.orchestra.run.smithi057.stdout: linux-firmware noarch 20240219-143.el9 CentOS-BaseOS 375 M 2024-03-27T09:44:49.795 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T09:44:49.795 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction Summary 2024-03-27T09:44:49.796 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-03-27T09:44:49.796 INFO:teuthology.orchestra.run.smithi057.stdout:Upgrade 1 Package 2024-03-27T09:44:49.796 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T09:44:49.796 INFO:teuthology.orchestra.run.smithi057.stdout:Total download size: 375 M 2024-03-27T09:44:49.796 INFO:teuthology.orchestra.run.smithi057.stdout:Downloading Packages: 2024-03-27T09:45:00.619 INFO:teuthology.orchestra.run.smithi057.stdout:linux-firmware-20240219-143.el9.noarch.rpm 35 MB/s | 375 MB 00:10 2024-03-27T09:45:00.620 INFO:teuthology.orchestra.run.smithi057.stdout:-------------------------------------------------------------------------------- 2024-03-27T09:45:00.621 INFO:teuthology.orchestra.run.smithi057.stdout:Total 35 MB/s | 375 MB 00:10 2024-03-27T09:45:00.621 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction check 2024-03-27T09:45:00.714 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction check succeeded. 2024-03-27T09:45:00.715 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction test 2024-03-27T09:45:03.237 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction test succeeded. 2024-03-27T09:45:03.238 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction 2024-03-27T09:45:05.165 INFO:teuthology.orchestra.run.smithi118.stdout:linux-firmware-20240219-143.el9.noarch.rpm 18 MB/s | 375 MB 00:21 2024-03-27T09:45:05.166 INFO:teuthology.orchestra.run.smithi118.stdout:-------------------------------------------------------------------------------- 2024-03-27T09:45:05.166 INFO:teuthology.orchestra.run.smithi118.stdout:Total 18 MB/s | 375 MB 00:21 2024-03-27T09:45:05.166 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction check 2024-03-27T09:45:05.266 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction check succeeded. 2024-03-27T09:45:05.266 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction test 2024-03-27T09:45:07.677 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction test succeeded. 2024-03-27T09:45:07.678 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction 2024-03-27T09:45:09.658 INFO:teuthology.orchestra.run.smithi057.stdout: Preparing : 1/1 2024-03-27T09:45:10.018 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : linux-firmware-20240219-143.el9.noarch 1/2 2024-03-27T09:45:10.104 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2024-03-27T09:45:11.270 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2024-03-27T09:45:11.270 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : linux-firmware-20240219-143.el9.noarch 1/2 2024-03-27T09:45:11.678 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2024-03-27T09:45:11.678 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T09:45:11.678 INFO:teuthology.orchestra.run.smithi057.stdout:Upgraded: 2024-03-27T09:45:11.678 INFO:teuthology.orchestra.run.smithi057.stdout: linux-firmware-20240219-143.el9.noarch 2024-03-27T09:45:11.678 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T09:45:11.678 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2024-03-27T09:45:11.970 INFO:teuthology.task.kernel:Downloading kernel 1df0c7e8a2354c42d738e5454ba83ea7332deac2 on mon.a... 2024-03-27T09:45:11.970 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-03-27T09:45:12.137 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/1df0c7e8a2354c42d738e5454ba83ea7332deac2/centos/9/flavors/default/x86_64/ 2024-03-27T09:45:12.138 DEBUG:teuthology.orchestra.run.smithi057:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.8.0_g1df0c7e8a235-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/1df0c7e8a2354c42d738e5454ba83ea7332deac2/centos/9/flavors/default/x86_64/ --input-file=- 2024-03-27T09:45:12.140 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi057.front.sepia.ceph.com to complete... 2024-03-27T09:45:14.026 INFO:teuthology.orchestra.run.smithi118.stdout: Preparing : 1/1 2024-03-27T09:45:14.283 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : linux-firmware-20240219-143.el9.noarch 1/2 2024-03-27T09:45:14.364 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2024-03-27T09:45:15.426 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2024-03-27T09:45:15.427 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : linux-firmware-20240219-143.el9.noarch 1/2 2024-03-27T09:45:15.805 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2024-03-27T09:45:15.805 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-27T09:45:15.805 INFO:teuthology.orchestra.run.smithi118.stdout:Upgraded: 2024-03-27T09:45:15.805 INFO:teuthology.orchestra.run.smithi118.stdout: linux-firmware-20240219-143.el9.noarch 2024-03-27T09:45:15.805 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-27T09:45:15.805 INFO:teuthology.orchestra.run.smithi118.stdout:Complete! 2024-03-27T09:45:16.148 INFO:teuthology.task.kernel:Downloading kernel 1df0c7e8a2354c42d738e5454ba83ea7332deac2 on mon.b... 2024-03-27T09:45:16.149 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-03-27T09:45:16.421 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/1df0c7e8a2354c42d738e5454ba83ea7332deac2/centos/9/flavors/default/x86_64/ 2024-03-27T09:45:16.421 DEBUG:teuthology.orchestra.run.smithi118:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.8.0_g1df0c7e8a235-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/1df0c7e8a2354c42d738e5454ba83ea7332deac2/centos/9/flavors/default/x86_64/ --input-file=- 2024-03-27T09:45:16.424 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi118.front.sepia.ceph.com to complete... 2024-03-27T09:45:33.408 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27 09:45:33 URL:https://3.chacra.ceph.com/r/kernel/testing/1df0c7e8a2354c42d738e5454ba83ea7332deac2/centos/9/flavors/default/x86_64/kernel-6.8.0_g1df0c7e8a235-1.x86_64.rpm [336317861/336317861] -> "/tmp/kernel.x86_64.rpm" [1] 2024-03-27T09:45:33.409 INFO:teuthology.orchestra.run.smithi118.stderr:FINISHED --2024-03-27 09:45:33-- 2024-03-27T09:45:33.409 INFO:teuthology.orchestra.run.smithi118.stderr:Total wall clock time: 17s 2024-03-27T09:45:33.409 INFO:teuthology.orchestra.run.smithi118.stderr:Downloaded: 1 files, 321M in 17s (19.3 MB/s) 2024-03-27T09:45:33.412 INFO:teuthology.task.kernel:Installing kernel 1df0c7e8a2354c42d738e5454ba83ea7332deac2 on mon.b... 2024-03-27T09:45:33.412 DEBUG:teuthology.orchestra.run.smithi118:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-03-27T09:45:35.358 INFO:teuthology.orchestra.run.smithi118.stdout:Verifying... ######################################## 2024-03-27T09:45:35.408 INFO:teuthology.orchestra.run.smithi118.stdout:Preparing... ######################################## 2024-03-27T09:45:35.488 INFO:teuthology.orchestra.run.smithi118.stdout:Updating / installing... 2024-03-27T09:45:43.021 INFO:teuthology.orchestra.run.smithi118.stdout:kernel-6.8.0_g1df0c7e8a235-1 ######################################## 2024-03-27T09:46:00.250 INFO:teuthology.orchestra.run.smithi118.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-03-27T09:46:06.042 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27 09:46:06 URL:https://3.chacra.ceph.com/r/kernel/testing/1df0c7e8a2354c42d738e5454ba83ea7332deac2/centos/9/flavors/default/x86_64/kernel-6.8.0_g1df0c7e8a235-1.x86_64.rpm [336317861/336317861] -> "/tmp/kernel.x86_64.rpm" [1] 2024-03-27T09:46:06.042 INFO:teuthology.orchestra.run.smithi057.stderr:FINISHED --2024-03-27 09:46:06-- 2024-03-27T09:46:06.042 INFO:teuthology.orchestra.run.smithi057.stderr:Total wall clock time: 54s 2024-03-27T09:46:06.043 INFO:teuthology.orchestra.run.smithi057.stderr:Downloaded: 1 files, 321M in 54s (5.99 MB/s) 2024-03-27T09:46:06.046 INFO:teuthology.task.kernel:Installing kernel 1df0c7e8a2354c42d738e5454ba83ea7332deac2 on mon.a... 2024-03-27T09:46:06.046 DEBUG:teuthology.orchestra.run.smithi057:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-03-27T09:46:08.083 INFO:teuthology.orchestra.run.smithi057.stdout:Verifying... ######################################## 2024-03-27T09:46:08.136 INFO:teuthology.orchestra.run.smithi057.stdout:Preparing... ######################################## 2024-03-27T09:46:08.220 INFO:teuthology.orchestra.run.smithi057.stdout:Updating / installing... 2024-03-27T09:46:16.070 INFO:teuthology.orchestra.run.smithi057.stdout:kernel-6.8.0_g1df0c7e8a235-1 ######################################## 2024-03-27T09:46:22.849 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi118.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-03-27T09:46:22.849 DEBUG:teuthology.orchestra.run.smithi118:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-03-27T09:46:22.933 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235 2024-03-27T09:46:22.934 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/System.map 2024-03-27T09:46:22.934 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/config 2024-03-27T09:46:22.934 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel 2024-03-27T09:46:22.934 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch 2024-03-27T09:46:22.934 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86 2024-03-27T09:46:22.935 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto 2024-03-27T09:46:22.935 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-03-27T09:46:22.935 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-03-27T09:46:22.935 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-03-27T09:46:22.935 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-03-27T09:46:22.935 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-03-27T09:46:22.936 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-03-27T09:46:22.936 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-03-27T09:46:22.936 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/crc32c-intel.ko 2024-03-27T09:46:22.936 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-03-27T09:46:22.936 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-03-27T09:46:22.936 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-03-27T09:46:22.937 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-03-27T09:46:22.937 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/serpent-avx2.ko 2024-03-27T09:46:22.937 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-03-27T09:46:22.937 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-03-27T09:46:22.937 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-03-27T09:46:22.937 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-03-27T09:46:22.937 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-03-27T09:46:22.938 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-03-27T09:46:22.938 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-03-27T09:46:22.938 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel 2024-03-27T09:46:22.938 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel/cpu 2024-03-27T09:46:22.938 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel/cpu/mce 2024-03-27T09:46:22.938 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-03-27T09:46:22.939 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm 2024-03-27T09:46:22.939 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm/kvm-amd.ko 2024-03-27T09:46:22.939 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm/kvm-intel.ko 2024-03-27T09:46:22.939 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm/kvm.ko 2024-03-27T09:46:22.939 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto 2024-03-27T09:46:22.939 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/ansi_cprng.ko 2024-03-27T09:46:22.939 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/anubis.ko 2024-03-27T09:46:22.940 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/arc4.ko 2024-03-27T09:46:22.940 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx 2024-03-27T09:46:22.940 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_memcpy.ko 2024-03-27T09:46:22.940 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_pq.ko 2024-03-27T09:46:22.940 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_raid6_recov.ko 2024-03-27T09:46:22.940 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_tx.ko 2024-03-27T09:46:22.940 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_xor.ko 2024-03-27T09:46:22.941 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/raid6test.ko 2024-03-27T09:46:22.941 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/authenc.ko 2024-03-27T09:46:22.941 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/authencesn.ko 2024-03-27T09:46:22.941 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/blake2b_generic.ko 2024-03-27T09:46:22.941 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/blowfish_common.ko 2024-03-27T09:46:22.941 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/blowfish_generic.ko 2024-03-27T09:46:22.942 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/camellia_generic.ko 2024-03-27T09:46:22.942 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cast5_generic.ko 2024-03-27T09:46:22.942 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cast6_generic.ko 2024-03-27T09:46:22.942 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cast_common.ko 2024-03-27T09:46:22.942 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/ccm.ko 2024-03-27T09:46:22.942 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cmac.ko 2024-03-27T09:46:22.943 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/crc32_generic.ko 2024-03-27T09:46:22.943 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/crypto_engine.ko 2024-03-27T09:46:22.943 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/crypto_user.ko 2024-03-27T09:46:22.943 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cts.ko 2024-03-27T09:46:22.943 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/des_generic.ko 2024-03-27T09:46:22.943 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/dh_generic.ko 2024-03-27T09:46:22.944 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/echainiv.ko 2024-03-27T09:46:22.944 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/essiv.ko 2024-03-27T09:46:22.944 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/fcrypt.ko 2024-03-27T09:46:22.944 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/khazad.ko 2024-03-27T09:46:22.944 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/lz4.ko 2024-03-27T09:46:22.944 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/lz4hc.ko 2024-03-27T09:46:22.945 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/md4.ko 2024-03-27T09:46:22.945 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/michael_mic.ko 2024-03-27T09:46:22.945 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/pcbc.ko 2024-03-27T09:46:22.945 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/pcrypt.ko 2024-03-27T09:46:22.945 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/rmd160.ko 2024-03-27T09:46:22.945 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/seed.ko 2024-03-27T09:46:22.945 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/serpent_generic.ko 2024-03-27T09:46:22.946 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/tcrypt.ko 2024-03-27T09:46:22.946 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/tea.ko 2024-03-27T09:46:22.946 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/twofish_common.ko 2024-03-27T09:46:22.946 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/twofish_generic.ko 2024-03-27T09:46:22.946 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/vmac.ko 2024-03-27T09:46:22.946 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/wp512.ko 2024-03-27T09:46:22.947 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/xcbc.ko 2024-03-27T09:46:22.947 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/xor.ko 2024-03-27T09:46:22.947 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/xxhash_generic.ko 2024-03-27T09:46:22.947 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers 2024-03-27T09:46:22.947 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi 2024-03-27T09:46:22.947 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/acpi_ipmi.ko 2024-03-27T09:46:22.948 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/acpi_pad.ko 2024-03-27T09:46:22.948 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/custom_method.ko 2024-03-27T09:46:22.948 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/ec_sys.ko 2024-03-27T09:46:22.948 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/platform_profile.ko 2024-03-27T09:46:22.948 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/sbs.ko 2024-03-27T09:46:22.948 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/sbshc.ko 2024-03-27T09:46:22.948 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/video.ko 2024-03-27T09:46:22.949 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata 2024-03-27T09:46:22.949 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/acard-ahci.ko 2024-03-27T09:46:22.949 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/ahci_platform.ko 2024-03-27T09:46:22.949 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/ata_generic.ko 2024-03-27T09:46:22.949 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/libahci_platform.ko 2024-03-27T09:46:22.949 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_acpi.ko 2024-03-27T09:46:22.950 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ali.ko 2024-03-27T09:46:22.950 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_amd.ko 2024-03-27T09:46:22.950 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_artop.ko 2024-03-27T09:46:22.950 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_atiixp.ko 2024-03-27T09:46:22.950 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_atp867x.ko 2024-03-27T09:46:22.950 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_cmd640.ko 2024-03-27T09:46:22.951 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_cmd64x.ko 2024-03-27T09:46:22.951 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_cypress.ko 2024-03-27T09:46:22.951 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_efar.ko 2024-03-27T09:46:22.951 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt366.ko 2024-03-27T09:46:22.951 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt37x.ko 2024-03-27T09:46:22.951 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt3x2n.ko 2024-03-27T09:46:22.951 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt3x3.ko 2024-03-27T09:46:22.952 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_it8213.ko 2024-03-27T09:46:22.952 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_it821x.ko 2024-03-27T09:46:22.952 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_jmicron.ko 2024-03-27T09:46:22.952 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_marvell.ko 2024-03-27T09:46:22.952 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_mpiix.ko 2024-03-27T09:46:22.952 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_netcell.ko 2024-03-27T09:46:22.952 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ninja32.ko 2024-03-27T09:46:22.953 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ns87410.ko 2024-03-27T09:46:22.953 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ns87415.ko 2024-03-27T09:46:22.953 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_oldpiix.ko 2024-03-27T09:46:22.953 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_opti.ko 2024-03-27T09:46:22.953 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_optidma.ko 2024-03-27T09:46:22.953 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_pcmcia.ko 2024-03-27T09:46:22.953 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_pdc2027x.ko 2024-03-27T09:46:22.954 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-03-27T09:46:22.954 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_piccolo.ko 2024-03-27T09:46:22.954 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_rdc.ko 2024-03-27T09:46:22.954 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sch.ko 2024-03-27T09:46:22.954 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_serverworks.ko 2024-03-27T09:46:22.954 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sil680.ko 2024-03-27T09:46:22.955 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sis.ko 2024-03-27T09:46:22.955 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sl82c105.ko 2024-03-27T09:46:22.955 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_triflex.ko 2024-03-27T09:46:22.955 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_via.ko 2024-03-27T09:46:22.955 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pdc_adma.ko 2024-03-27T09:46:22.955 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_inic162x.ko 2024-03-27T09:46:22.956 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_mv.ko 2024-03-27T09:46:22.956 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_nv.ko 2024-03-27T09:46:22.956 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_promise.ko 2024-03-27T09:46:22.956 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_qstor.ko 2024-03-27T09:46:22.956 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sil.ko 2024-03-27T09:46:22.956 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sil24.ko 2024-03-27T09:46:22.956 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sis.ko 2024-03-27T09:46:22.957 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_svw.ko 2024-03-27T09:46:22.957 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sx4.ko 2024-03-27T09:46:22.957 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_uli.ko 2024-03-27T09:46:22.957 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_via.ko 2024-03-27T09:46:22.957 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_vsc.ko 2024-03-27T09:46:22.957 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/auxdisplay 2024-03-27T09:46:22.958 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/auxdisplay/ks0108.ko 2024-03-27T09:46:22.958 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base 2024-03-27T09:46:22.958 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base/regmap 2024-03-27T09:46:22.958 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base/regmap/regmap-i2c.ko 2024-03-27T09:46:22.958 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base/regmap/regmap-mmio.ko 2024-03-27T09:46:22.958 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/bcma 2024-03-27T09:46:22.959 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/bcma/bcma.ko 2024-03-27T09:46:22.959 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block 2024-03-27T09:46:22.959 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/aoe 2024-03-27T09:46:22.959 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/aoe/aoe.ko 2024-03-27T09:46:22.959 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/brd.ko 2024-03-27T09:46:22.959 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/drbd 2024-03-27T09:46:22.959 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/drbd/drbd.ko 2024-03-27T09:46:22.960 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/floppy.ko 2024-03-27T09:46:22.960 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/loop.ko 2024-03-27T09:46:22.960 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/mtip32xx 2024-03-27T09:46:22.960 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-03-27T09:46:22.960 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/nbd.ko 2024-03-27T09:46:22.960 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/null_blk 2024-03-27T09:46:22.961 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/null_blk/null_blk.ko 2024-03-27T09:46:22.961 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/pktcdvd.ko 2024-03-27T09:46:22.961 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/rbd.ko 2024-03-27T09:46:22.961 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/virtio_blk.ko 2024-03-27T09:46:22.961 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/xen-blkback 2024-03-27T09:46:22.961 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-03-27T09:46:22.962 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/xen-blkfront.ko 2024-03-27T09:46:22.962 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/zram 2024-03-27T09:46:22.962 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/zram/zram.ko 2024-03-27T09:46:22.962 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char 2024-03-27T09:46:22.962 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hangcheck-timer.ko 2024-03-27T09:46:22.962 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random 2024-03-27T09:46:22.962 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/amd-rng.ko 2024-03-27T09:46:22.963 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/intel-rng.ko 2024-03-27T09:46:22.963 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-03-27T09:46:22.963 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/via-rng.ko 2024-03-27T09:46:22.963 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/virtio-rng.ko 2024-03-27T09:46:22.963 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi 2024-03-27T09:46:22.963 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-03-27T09:46:22.964 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-03-27T09:46:22.964 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-03-27T09:46:22.964 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_si.ko 2024-03-27T09:46:22.964 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-03-27T09:46:22.964 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-03-27T09:46:22.964 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/lp.ko 2024-03-27T09:46:22.965 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/mwave 2024-03-27T09:46:22.965 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/mwave/mwave.ko 2024-03-27T09:46:22.965 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ppdev.ko 2024-03-27T09:46:22.965 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tlclk.ko 2024-03-27T09:46:22.965 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm 2024-03-27T09:46:22.965 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm.ko 2024-03-27T09:46:22.965 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_atmel.ko 2024-03-27T09:46:22.966 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_infineon.ko 2024-03-27T09:46:22.966 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_nsc.ko 2024-03-27T09:46:22.966 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_tis.ko 2024-03-27T09:46:22.966 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-03-27T09:46:22.966 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/uv_mmtimer.ko 2024-03-27T09:46:22.966 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/virtio_console.ko 2024-03-27T09:46:22.967 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq 2024-03-27T09:46:22.967 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-03-27T09:46:22.967 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-03-27T09:46:22.967 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/p4-clockmod.ko 2024-03-27T09:46:22.967 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-03-27T09:46:22.967 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/powernow-k8.ko 2024-03-27T09:46:22.968 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/speedstep-lib.ko 2024-03-27T09:46:22.968 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto 2024-03-27T09:46:22.968 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/ccp 2024-03-27T09:46:22.968 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-03-27T09:46:22.968 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/ccp/ccp.ko 2024-03-27T09:46:22.968 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel 2024-03-27T09:46:22.968 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat 2024-03-27T09:46:22.969 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_common 2024-03-27T09:46:22.969 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-03-27T09:46:22.969 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-03-27T09:46:22.969 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-03-27T09:46:22.969 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/padlock-aes.ko 2024-03-27T09:46:22.969 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/padlock-sha.ko 2024-03-27T09:46:22.970 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/virtio 2024-03-27T09:46:22.970 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-03-27T09:46:22.970 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dca 2024-03-27T09:46:22.970 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dca/dca.ko 2024-03-27T09:46:22.970 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/devfreq 2024-03-27T09:46:22.970 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-03-27T09:46:22.970 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma 2024-03-27T09:46:22.971 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/dw 2024-03-27T09:46:22.971 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/dw/dw_dmac.ko 2024-03-27T09:46:22.971 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/ioat 2024-03-27T09:46:22.971 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/ioat/ioatdma.ko 2024-03-27T09:46:22.971 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac 2024-03-27T09:46:22.971 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/amd64_edac.ko 2024-03-27T09:46:22.972 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/e752x_edac.ko 2024-03-27T09:46:22.972 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/edac_mce_amd.ko 2024-03-27T09:46:22.972 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i3000_edac.ko 2024-03-27T09:46:22.972 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i3200_edac.ko 2024-03-27T09:46:22.972 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i5100_edac.ko 2024-03-27T09:46:22.972 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i5400_edac.ko 2024-03-27T09:46:22.972 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i7300_edac.ko 2024-03-27T09:46:22.973 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i7core_edac.ko 2024-03-27T09:46:22.973 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i82975x_edac.ko 2024-03-27T09:46:22.973 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/ie31200_edac.ko 2024-03-27T09:46:22.973 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/sb_edac.ko 2024-03-27T09:46:22.973 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/x38_edac.ko 2024-03-27T09:46:22.973 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/firmware 2024-03-27T09:46:22.974 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/firmware/edd.ko 2024-03-27T09:46:22.974 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/firmware/iscsi_ibft.ko 2024-03-27T09:46:22.974 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio 2024-03-27T09:46:22.974 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-ich.ko 2024-03-27T09:46:22.974 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-viperboard.ko 2024-03-27T09:46:22.974 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid 2024-03-27T09:46:22.975 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-appleir.ko 2024-03-27T09:46:22.975 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-aureal.ko 2024-03-27T09:46:22.975 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-axff.ko 2024-03-27T09:46:22.975 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-dr.ko 2024-03-27T09:46:22.975 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-elecom.ko 2024-03-27T09:46:22.975 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-elo.ko 2024-03-27T09:46:22.975 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-emsff.ko 2024-03-27T09:46:22.976 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-gaff.ko 2024-03-27T09:46:22.976 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-gt683r.ko 2024-03-27T09:46:22.976 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-gyration.ko 2024-03-27T09:46:22.976 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-holtek-kbd.ko 2024-03-27T09:46:22.976 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-holtek-mouse.ko 2024-03-27T09:46:22.976 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-holtekff.ko 2024-03-27T09:46:22.977 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-hyperv.ko 2024-03-27T09:46:22.977 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-icade.ko 2024-03-27T09:46:22.977 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-keytouch.ko 2024-03-27T09:46:22.977 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-kye.ko 2024-03-27T09:46:22.977 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-lcpower.ko 2024-03-27T09:46:22.977 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-led.ko 2024-03-27T09:46:22.977 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-lenovo.ko 2024-03-27T09:46:22.977 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-logitech-dj.ko 2024-03-27T09:46:22.977 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-03-27T09:46:22.978 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-multitouch.ko 2024-03-27T09:46:22.978 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-ortek.ko 2024-03-27T09:46:22.978 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-penmount.ko 2024-03-27T09:46:22.978 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-petalynx.ko 2024-03-27T09:46:22.978 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-picolcd.ko 2024-03-27T09:46:22.978 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-pl.ko 2024-03-27T09:46:22.978 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-plantronics.ko 2024-03-27T09:46:22.978 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-primax.ko 2024-03-27T09:46:22.978 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-rmi.ko 2024-03-27T09:46:22.978 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-arvo.ko 2024-03-27T09:46:22.978 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-common.ko 2024-03-27T09:46:22.978 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-isku.ko 2024-03-27T09:46:22.978 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-kone.ko 2024-03-27T09:46:22.978 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-03-27T09:46:22.979 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-konepure.ko 2024-03-27T09:46:22.979 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-03-27T09:46:22.979 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-lua.ko 2024-03-27T09:46:22.979 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-pyra.ko 2024-03-27T09:46:22.979 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-ryos.ko 2024-03-27T09:46:22.979 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-savu.ko 2024-03-27T09:46:22.979 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat.ko 2024-03-27T09:46:22.979 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-saitek.ko 2024-03-27T09:46:22.979 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-samsung.ko 2024-03-27T09:46:22.979 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sensor-hub.ko 2024-03-27T09:46:22.979 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sjoy.ko 2024-03-27T09:46:22.979 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sony.ko 2024-03-27T09:46:22.979 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-speedlink.ko 2024-03-27T09:46:22.979 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-steelseries.ko 2024-03-27T09:46:22.979 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sunplus.ko 2024-03-27T09:46:22.980 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-thrustmaster.ko 2024-03-27T09:46:22.981 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-tivo.ko 2024-03-27T09:46:22.981 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-tmff.ko 2024-03-27T09:46:22.981 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-topseed.ko 2024-03-27T09:46:22.981 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-twinhan.ko 2024-03-27T09:46:22.981 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-uclogic.ko 2024-03-27T09:46:22.981 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-waltop.ko 2024-03-27T09:46:22.981 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-wiimote.ko 2024-03-27T09:46:22.982 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-xinmo.ko 2024-03-27T09:46:22.982 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-zpff.ko 2024-03-27T09:46:22.982 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-zydacron.ko 2024-03-27T09:46:22.982 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/uhid.ko 2024-03-27T09:46:22.982 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/wacom.ko 2024-03-27T09:46:22.982 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv 2024-03-27T09:46:22.982 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv/hv_balloon.ko 2024-03-27T09:46:22.982 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv/hv_utils.ko 2024-03-27T09:46:22.982 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv/hv_vmbus.ko 2024-03-27T09:46:22.982 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon 2024-03-27T09:46:22.982 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/abituguru.ko 2024-03-27T09:46:22.982 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/abituguru3.ko 2024-03-27T09:46:22.982 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/acpi_power_meter.ko 2024-03-27T09:46:22.982 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ad7414.ko 2024-03-27T09:46:22.983 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ad7418.ko 2024-03-27T09:46:22.983 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adc128d818.ko 2024-03-27T09:46:22.983 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1025.ko 2024-03-27T09:46:22.983 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1026.ko 2024-03-27T09:46:22.983 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1029.ko 2024-03-27T09:46:22.983 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1031.ko 2024-03-27T09:46:22.983 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm9240.ko 2024-03-27T09:46:22.983 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ads7828.ko 2024-03-27T09:46:22.983 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7410.ko 2024-03-27T09:46:22.983 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7411.ko 2024-03-27T09:46:22.983 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7462.ko 2024-03-27T09:46:22.983 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7470.ko 2024-03-27T09:46:22.983 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7475.ko 2024-03-27T09:46:22.983 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7x10.ko 2024-03-27T09:46:22.984 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/amc6821.ko 2024-03-27T09:46:22.984 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/applesmc.ko 2024-03-27T09:46:22.984 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/asb100.ko 2024-03-27T09:46:22.984 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/asc7621.ko 2024-03-27T09:46:22.984 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/asus_atk0110.ko 2024-03-27T09:46:22.984 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/atxp1.ko 2024-03-27T09:46:22.984 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/coretemp.ko 2024-03-27T09:46:22.984 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-03-27T09:46:22.984 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/dme1737.ko 2024-03-27T09:46:22.984 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ds1621.ko 2024-03-27T09:46:22.984 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ds620.ko 2024-03-27T09:46:22.984 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/emc1403.ko 2024-03-27T09:46:22.984 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/emc6w201.ko 2024-03-27T09:46:22.984 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/f71805f.ko 2024-03-27T09:46:22.985 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/f71882fg.ko 2024-03-27T09:46:22.985 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/f75375s.ko 2024-03-27T09:46:22.985 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/fam15h_power.ko 2024-03-27T09:46:22.985 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/fschmd.ko 2024-03-27T09:46:22.985 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/g760a.ko 2024-03-27T09:46:22.985 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/g762.ko 2024-03-27T09:46:22.985 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/gl518sm.ko 2024-03-27T09:46:22.985 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/gl520sm.ko 2024-03-27T09:46:22.985 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/hwmon-vid.ko 2024-03-27T09:46:22.985 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/i5500_temp.ko 2024-03-27T09:46:22.985 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/i5k_amb.ko 2024-03-27T09:46:22.985 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ibmaem.ko 2024-03-27T09:46:22.985 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ibmpex.ko 2024-03-27T09:46:22.985 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ina209.ko 2024-03-27T09:46:22.986 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ina2xx.ko 2024-03-27T09:46:22.986 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/it87.ko 2024-03-27T09:46:22.986 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/k10temp.ko 2024-03-27T09:46:22.986 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/k8temp.ko 2024-03-27T09:46:22.986 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lineage-pem.ko 2024-03-27T09:46:22.986 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm63.ko 2024-03-27T09:46:22.986 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm73.ko 2024-03-27T09:46:22.986 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm75.ko 2024-03-27T09:46:22.986 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm77.ko 2024-03-27T09:46:22.986 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm78.ko 2024-03-27T09:46:22.986 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm80.ko 2024-03-27T09:46:22.986 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm83.ko 2024-03-27T09:46:22.986 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm85.ko 2024-03-27T09:46:22.986 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm87.ko 2024-03-27T09:46:22.987 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm90.ko 2024-03-27T09:46:22.987 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm92.ko 2024-03-27T09:46:22.987 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm93.ko 2024-03-27T09:46:22.987 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm95234.ko 2024-03-27T09:46:22.987 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm95241.ko 2024-03-27T09:46:22.987 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm95245.ko 2024-03-27T09:46:22.987 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc2945.ko 2024-03-27T09:46:22.987 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4151.ko 2024-03-27T09:46:22.987 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4215.ko 2024-03-27T09:46:22.987 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4222.ko 2024-03-27T09:46:22.987 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4245.ko 2024-03-27T09:46:22.987 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4260.ko 2024-03-27T09:46:22.987 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4261.ko 2024-03-27T09:46:22.987 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max16065.ko 2024-03-27T09:46:22.988 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max1619.ko 2024-03-27T09:46:22.988 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max1668.ko 2024-03-27T09:46:22.988 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max197.ko 2024-03-27T09:46:22.988 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max6639.ko 2024-03-27T09:46:22.988 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max6650.ko 2024-03-27T09:46:22.988 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max6697.ko 2024-03-27T09:46:22.988 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/mcp3021.ko 2024-03-27T09:46:22.988 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct6683.ko 2024-03-27T09:46:22.988 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct6775-core.ko 2024-03-27T09:46:22.988 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct6775.ko 2024-03-27T09:46:22.988 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct7802.ko 2024-03-27T09:46:22.988 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pc87360.ko 2024-03-27T09:46:22.988 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pc87427.ko 2024-03-27T09:46:22.988 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pcf8591.ko 2024-03-27T09:46:22.988 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus 2024-03-27T09:46:22.989 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-03-27T09:46:22.989 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-03-27T09:46:22.989 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-03-27T09:46:22.989 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/max16064.ko 2024-03-27T09:46:22.989 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/max34440.ko 2024-03-27T09:46:22.989 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/max8688.ko 2024-03-27T09:46:22.989 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-03-27T09:46:22.989 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-03-27T09:46:22.989 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-03-27T09:46:22.989 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-03-27T09:46:22.989 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-03-27T09:46:22.989 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-03-27T09:46:22.989 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/powr1220.ko 2024-03-27T09:46:22.989 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sch5627.ko 2024-03-27T09:46:22.989 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sch5636.ko 2024-03-27T09:46:22.990 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sch56xx-common.ko 2024-03-27T09:46:22.990 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sht15.ko 2024-03-27T09:46:22.990 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sht21.ko 2024-03-27T09:46:22.990 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/shtc1.ko 2024-03-27T09:46:22.990 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sis5595.ko 2024-03-27T09:46:22.990 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/smsc47b397.ko 2024-03-27T09:46:22.990 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/smsc47m1.ko 2024-03-27T09:46:22.990 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/smsc47m192.ko 2024-03-27T09:46:22.990 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/thmc50.ko 2024-03-27T09:46:22.990 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp102.ko 2024-03-27T09:46:22.990 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp103.ko 2024-03-27T09:46:22.990 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp401.ko 2024-03-27T09:46:22.990 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp421.ko 2024-03-27T09:46:22.990 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/via-cputemp.ko 2024-03-27T09:46:22.991 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/via686a.ko 2024-03-27T09:46:22.991 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/vt1211.ko 2024-03-27T09:46:22.991 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/vt8231.ko 2024-03-27T09:46:22.991 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83627ehf.ko 2024-03-27T09:46:22.991 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83627hf.ko 2024-03-27T09:46:22.991 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83781d.ko 2024-03-27T09:46:22.991 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83791d.ko 2024-03-27T09:46:22.991 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83792d.ko 2024-03-27T09:46:22.991 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83793.ko 2024-03-27T09:46:22.991 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83795.ko 2024-03-27T09:46:22.991 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83l785ts.ko 2024-03-27T09:46:22.991 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83l786ng.ko 2024-03-27T09:46:22.991 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c 2024-03-27T09:46:22.991 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/algos 2024-03-27T09:46:22.991 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-03-27T09:46:22.992 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-03-27T09:46:22.992 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses 2024-03-27T09:46:22.992 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-03-27T09:46:22.992 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-03-27T09:46:22.992 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-03-27T09:46:22.992 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-03-27T09:46:22.992 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-03-27T09:46:22.992 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-03-27T09:46:22.992 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-03-27T09:46:22.992 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-03-27T09:46:22.992 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-i801.ko 2024-03-27T09:46:22.992 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-isch.ko 2024-03-27T09:46:22.992 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-03-27T09:46:22.992 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-03-27T09:46:22.993 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-03-27T09:46:22.993 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-parport.ko 2024-03-27T09:46:22.993 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-03-27T09:46:22.993 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-03-27T09:46:22.993 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-03-27T09:46:22.993 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-03-27T09:46:22.993 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-03-27T09:46:22.993 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-03-27T09:46:22.993 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-via.ko 2024-03-27T09:46:22.993 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-03-27T09:46:22.993 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-03-27T09:46:22.993 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-dev.ko 2024-03-27T09:46:22.993 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-mux.ko 2024-03-27T09:46:22.993 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-03-27T09:46:22.993 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-smbus.ko 2024-03-27T09:46:22.994 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-stub.ko 2024-03-27T09:46:22.994 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband 2024-03-27T09:46:22.994 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core 2024-03-27T09:46:22.994 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_cm.ko 2024-03-27T09:46:22.994 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_core.ko 2024-03-27T09:46:22.994 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_umad.ko 2024-03-27T09:46:22.994 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-03-27T09:46:22.994 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/iw_cm.ko 2024-03-27T09:46:22.994 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/rdma_cm.ko 2024-03-27T09:46:22.994 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-03-27T09:46:22.994 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw 2024-03-27T09:46:22.994 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/cxgb4 2024-03-27T09:46:22.994 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-03-27T09:46:22.994 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx4 2024-03-27T09:46:22.995 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-03-27T09:46:22.995 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx5 2024-03-27T09:46:22.995 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-03-27T09:46:22.995 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mthca 2024-03-27T09:46:22.995 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-03-27T09:46:22.995 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp 2024-03-27T09:46:22.995 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/ipoib 2024-03-27T09:46:22.995 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-03-27T09:46:22.995 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/iser 2024-03-27T09:46:22.995 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-03-27T09:46:22.995 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/isert 2024-03-27T09:46:22.995 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-03-27T09:46:22.995 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srp 2024-03-27T09:46:22.995 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-03-27T09:46:22.995 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srpt 2024-03-27T09:46:22.996 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-03-27T09:46:22.996 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input 2024-03-27T09:46:22.996 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport 2024-03-27T09:46:22.996 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-03-27T09:46:22.996 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport/fm801-gp.ko 2024-03-27T09:46:22.996 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport/gameport.ko 2024-03-27T09:46:22.996 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/joydev.ko 2024-03-27T09:46:22.996 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard 2024-03-27T09:46:22.996 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard/gpio_keys.ko 2024-03-27T09:46:22.996 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse 2024-03-27T09:46:22.996 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/appletouch.ko 2024-03-27T09:46:22.996 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/bcm5974.ko 2024-03-27T09:46:22.996 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/cyapatp.ko 2024-03-27T09:46:22.996 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/elan_i2c.ko 2024-03-27T09:46:22.996 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/sermouse.ko 2024-03-27T09:46:22.997 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-03-27T09:46:22.997 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/synaptics_usb.ko 2024-03-27T09:46:22.997 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/vsxxxaa.ko 2024-03-27T09:46:22.997 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/rmi4 2024-03-27T09:46:22.997 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/rmi4/rmi_core.ko 2024-03-27T09:46:22.997 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio 2024-03-27T09:46:22.997 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/altera_ps2.ko 2024-03-27T09:46:22.997 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/arc_ps2.ko 2024-03-27T09:46:22.997 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-03-27T09:46:22.997 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/serio_raw.ko 2024-03-27T09:46:22.997 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/sparse-keymap.ko 2024-03-27T09:46:22.997 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds 2024-03-27T09:46:22.997 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-blinkm.ko 2024-03-27T09:46:22.997 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-lm3530.ko 2024-03-27T09:46:22.998 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-lp3944.ko 2024-03-27T09:46:22.998 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-ss4200.ko 2024-03-27T09:46:22.998 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger 2024-03-27T09:46:22.998 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-03-27T09:46:22.998 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-03-27T09:46:22.998 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-03-27T09:46:22.998 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-03-27T09:46:22.998 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-03-27T09:46:22.998 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-03-27T09:46:22.998 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-03-27T09:46:22.998 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-03-27T09:46:22.998 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-03-27T09:46:22.998 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md 2024-03-27T09:46:22.998 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/bcache 2024-03-27T09:46:22.999 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/bcache/bcache.ko 2024-03-27T09:46:22.999 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-bio-prison.ko 2024-03-27T09:46:22.999 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-cache-smq.ko 2024-03-27T09:46:22.999 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-cache.ko 2024-03-27T09:46:22.999 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-crypt.ko 2024-03-27T09:46:22.999 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-delay.ko 2024-03-27T09:46:22.999 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-flakey.ko 2024-03-27T09:46:22.999 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-log-userspace.ko 2024-03-27T09:46:22.999 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-multipath.ko 2024-03-27T09:46:22.999 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-queue-length.ko 2024-03-27T09:46:22.999 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-raid.ko 2024-03-27T09:46:22.999 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-round-robin.ko 2024-03-27T09:46:22.999 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-service-time.ko 2024-03-27T09:46:22.999 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-switch.ko 2024-03-27T09:46:23.000 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-thin-pool.ko 2024-03-27T09:46:23.000 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-verity.ko 2024-03-27T09:46:23.000 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/persistent-data 2024-03-27T09:46:23.000 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-03-27T09:46:23.000 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid0.ko 2024-03-27T09:46:23.000 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid1.ko 2024-03-27T09:46:23.000 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid10.ko 2024-03-27T09:46:23.000 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid456.ko 2024-03-27T09:46:23.000 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message 2024-03-27T09:46:23.000 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion 2024-03-27T09:46:23.000 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptbase.ko 2024-03-27T09:46:23.000 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptctl.ko 2024-03-27T09:46:23.000 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptfc.ko 2024-03-27T09:46:23.000 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptlan.ko 2024-03-27T09:46:23.000 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptsas.ko 2024-03-27T09:46:23.001 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptscsih.ko 2024-03-27T09:46:23.001 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptspi.ko 2024-03-27T09:46:23.001 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd 2024-03-27T09:46:23.001 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/lpc_ich.ko 2024-03-27T09:46:23.001 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/lpc_sch.ko 2024-03-27T09:46:23.001 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/mfd-core.ko 2024-03-27T09:46:23.001 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/sm501.ko 2024-03-27T09:46:23.001 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/viperboard.ko 2024-03-27T09:46:23.001 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/vx855.ko 2024-03-27T09:46:23.001 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/wl1273-core.ko 2024-03-27T09:46:23.001 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc 2024-03-27T09:46:23.001 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/altera-stapl 2024-03-27T09:46:23.001 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-03-27T09:46:23.001 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/apds9802als.ko 2024-03-27T09:46:23.002 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/apds990x.ko 2024-03-27T09:46:23.002 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/bh1770glc.ko 2024-03-27T09:46:23.002 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/cb710 2024-03-27T09:46:23.002 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/cb710/cb710.ko 2024-03-27T09:46:23.002 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom 2024-03-27T09:46:23.002 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom/at24.ko 2024-03-27T09:46:23.002 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-03-27T09:46:23.002 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom/max6875.ko 2024-03-27T09:46:23.002 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/enclosure.ko 2024-03-27T09:46:23.002 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/hpilo.ko 2024-03-27T09:46:23.002 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/isl29003.ko 2024-03-27T09:46:23.002 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/isl29020.ko 2024-03-27T09:46:23.002 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/lis3lv02d 2024-03-27T09:46:23.003 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-03-27T09:46:23.003 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-03-27T09:46:23.003 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei 2024-03-27T09:46:23.003 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei/mei-me.ko 2024-03-27T09:46:23.003 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei/mei-txe.ko 2024-03-27T09:46:23.003 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei/mei.ko 2024-03-27T09:46:23.003 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-gru 2024-03-27T09:46:23.003 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-gru/gru.ko 2024-03-27T09:46:23.003 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp 2024-03-27T09:46:23.003 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp/xp.ko 2024-03-27T09:46:23.003 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp/xpc.ko 2024-03-27T09:46:23.003 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-03-27T09:46:23.003 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/tifm_7xx1.ko 2024-03-27T09:46:23.003 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/tifm_core.ko 2024-03-27T09:46:23.003 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/tsl2550.ko 2024-03-27T09:46:23.004 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/vmw_balloon.ko 2024-03-27T09:46:23.004 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/vmw_vmci 2024-03-27T09:46:23.004 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-03-27T09:46:23.004 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net 2024-03-27T09:46:23.004 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/bonding 2024-03-27T09:46:23.004 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/bonding/bonding.ko 2024-03-27T09:46:23.004 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa 2024-03-27T09:46:23.004 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/b53 2024-03-27T09:46:23.004 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/b53/b53_common.ko 2024-03-27T09:46:23.004 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/bcm-sf2.ko 2024-03-27T09:46:23.004 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/mv88e6060.ko 2024-03-27T09:46:23.004 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/mv88e6xxx 2024-03-27T09:46:23.004 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-03-27T09:46:23.004 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dummy.ko 2024-03-27T09:46:23.004 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/eql.ko 2024-03-27T09:46:23.005 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet 2024-03-27T09:46:23.005 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com 2024-03-27T09:46:23.005 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-03-27T09:46:23.005 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-03-27T09:46:23.005 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-03-27T09:46:23.005 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-03-27T09:46:23.005 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390 2024-03-27T09:46:23.005 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/8390.ko 2024-03-27T09:46:23.005 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-03-27T09:46:23.005 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-03-27T09:46:23.005 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-03-27T09:46:23.005 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/adaptec 2024-03-27T09:46:23.005 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-03-27T09:46:23.005 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/agere 2024-03-27T09:46:23.005 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/agere/et131x.ko 2024-03-27T09:46:23.006 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/alteon 2024-03-27T09:46:23.006 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-03-27T09:46:23.006 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/altera 2024-03-27T09:46:23.006 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-03-27T09:46:23.006 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd 2024-03-27T09:46:23.006 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-03-27T09:46:23.006 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-03-27T09:46:23.006 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-03-27T09:46:23.006 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros 2024-03-27T09:46:23.006 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/alx 2024-03-27T09:46:23.006 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-03-27T09:46:23.006 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1c 2024-03-27T09:46:23.006 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-03-27T09:46:23.007 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1e 2024-03-27T09:46:23.007 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-03-27T09:46:23.007 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atlx 2024-03-27T09:46:23.007 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-03-27T09:46:23.007 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-03-27T09:46:23.007 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom 2024-03-27T09:46:23.007 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-03-27T09:46:23.007 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-03-27T09:46:23.007 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-03-27T09:46:23.007 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-03-27T09:46:23.008 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-03-27T09:46:23.008 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/genet 2024-03-27T09:46:23.008 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-03-27T09:46:23.008 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-03-27T09:46:23.008 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/brocade 2024-03-27T09:46:23.008 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/brocade/bna 2024-03-27T09:46:23.008 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-03-27T09:46:23.008 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio 2024-03-27T09:46:23.008 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb 2024-03-27T09:46:23.009 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-03-27T09:46:23.009 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-03-27T09:46:23.009 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-03-27T09:46:23.010 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-03-27T09:46:23.010 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-03-27T09:46:23.010 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-03-27T09:46:23.010 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-03-27T09:46:23.010 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-03-27T09:46:23.010 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-03-27T09:46:23.010 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/cisco 2024-03-27T09:46:23.010 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/cisco/enic 2024-03-27T09:46:23.010 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-03-27T09:46:23.010 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec 2024-03-27T09:46:23.010 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip 2024-03-27T09:46:23.010 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-03-27T09:46:23.010 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-03-27T09:46:23.011 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-03-27T09:46:23.011 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-03-27T09:46:23.011 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-03-27T09:46:23.011 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-03-27T09:46:23.011 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dlink 2024-03-27T09:46:23.011 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-03-27T09:46:23.011 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-03-27T09:46:23.011 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dnet.ko 2024-03-27T09:46:23.011 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/emulex 2024-03-27T09:46:23.011 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/emulex/benet 2024-03-27T09:46:23.011 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-03-27T09:46:23.011 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/ethoc.ko 2024-03-27T09:46:23.011 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/fealnx.ko 2024-03-27T09:46:23.011 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel 2024-03-27T09:46:23.012 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e100.ko 2024-03-27T09:46:23.012 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000 2024-03-27T09:46:23.012 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-03-27T09:46:23.012 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000e 2024-03-27T09:46:23.012 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-03-27T09:46:23.012 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/fm10k 2024-03-27T09:46:23.012 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-03-27T09:46:23.012 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/i40e 2024-03-27T09:46:23.012 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-03-27T09:46:23.012 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/iavf 2024-03-27T09:46:23.012 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-03-27T09:46:23.012 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igb 2024-03-27T09:46:23.012 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-03-27T09:46:23.012 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igbvf 2024-03-27T09:46:23.013 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-03-27T09:46:23.013 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbe 2024-03-27T09:46:23.013 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-03-27T09:46:23.013 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbevf 2024-03-27T09:46:23.013 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-03-27T09:46:23.013 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/jme.ko 2024-03-27T09:46:23.013 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell 2024-03-27T09:46:23.013 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-03-27T09:46:23.013 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell/skge.ko 2024-03-27T09:46:23.013 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-03-27T09:46:23.013 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox 2024-03-27T09:46:23.013 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx4 2024-03-27T09:46:23.013 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-03-27T09:46:23.013 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-03-27T09:46:23.014 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx5 2024-03-27T09:46:23.014 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-03-27T09:46:23.014 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-03-27T09:46:23.014 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/micrel 2024-03-27T09:46:23.014 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-03-27T09:46:23.014 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/myricom 2024-03-27T09:46:23.014 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/myricom/myri10ge 2024-03-27T09:46:23.014 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-03-27T09:46:23.014 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/natsemi 2024-03-27T09:46:23.014 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-03-27T09:46:23.014 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-03-27T09:46:23.014 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/neterion 2024-03-27T09:46:23.014 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-03-27T09:46:23.014 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/nvidia 2024-03-27T09:46:23.015 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-03-27T09:46:23.015 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/packetengines 2024-03-27T09:46:23.015 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-03-27T09:46:23.015 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-03-27T09:46:23.015 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic 2024-03-27T09:46:23.015 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/netxen 2024-03-27T09:46:23.015 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-03-27T09:46:23.015 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-03-27T09:46:23.015 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-03-27T09:46:23.015 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-03-27T09:46:23.015 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rdc 2024-03-27T09:46:23.015 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-03-27T09:46:23.015 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek 2024-03-27T09:46:23.015 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-03-27T09:46:23.016 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-03-27T09:46:23.016 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/atp.ko 2024-03-27T09:46:23.016 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-03-27T09:46:23.016 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rocker 2024-03-27T09:46:23.016 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-03-27T09:46:23.016 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sfc 2024-03-27T09:46:23.016 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-03-27T09:46:23.016 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/silan 2024-03-27T09:46:23.016 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-03-27T09:46:23.016 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sis 2024-03-27T09:46:23.016 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sis/sis190.ko 2024-03-27T09:46:23.016 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sis/sis900.ko 2024-03-27T09:46:23.016 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc 2024-03-27T09:46:23.017 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-03-27T09:46:23.017 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-03-27T09:46:23.017 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-03-27T09:46:23.017 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-03-27T09:46:23.017 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro 2024-03-27T09:46:23.017 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro/stmmac 2024-03-27T09:46:23.017 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-03-27T09:46:23.017 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-03-27T09:46:23.017 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun 2024-03-27T09:46:23.017 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/cassini.ko 2024-03-27T09:46:23.017 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/niu.ko 2024-03-27T09:46:23.017 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/sungem.ko 2024-03-27T09:46:23.017 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-03-27T09:46:23.017 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/tehuti 2024-03-27T09:46:23.018 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-03-27T09:46:23.018 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/ti 2024-03-27T09:46:23.018 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/ti/tlan.ko 2024-03-27T09:46:23.018 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/via 2024-03-27T09:46:23.018 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-03-27T09:46:23.018 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-03-27T09:46:23.018 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/wiznet 2024-03-27T09:46:23.018 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-03-27T09:46:23.018 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-03-27T09:46:23.018 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/xircom 2024-03-27T09:46:23.018 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-03-27T09:46:23.018 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/geneve.ko 2024-03-27T09:46:23.018 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/hyperv 2024-03-27T09:46:23.019 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-03-27T09:46:23.019 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ieee802154 2024-03-27T09:46:23.019 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ieee802154/fakelb.ko 2024-03-27T09:46:23.019 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ifb.ko 2024-03-27T09:46:23.019 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ipvlan 2024-03-27T09:46:23.019 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ipvlan/ipvlan.ko 2024-03-27T09:46:23.019 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/macvlan.ko 2024-03-27T09:46:23.019 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/macvtap.ko 2024-03-27T09:46:23.019 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio 2024-03-27T09:46:23.019 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio.ko 2024-03-27T09:46:23.019 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-03-27T09:46:23.019 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-03-27T09:46:23.019 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio/mdio-regmap.ko 2024-03-27T09:46:23.019 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mii.ko 2024-03-27T09:46:23.019 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/net_failover.ko 2024-03-27T09:46:23.020 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/netconsole.ko 2024-03-27T09:46:23.020 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/nlmon.ko 2024-03-27T09:46:23.020 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/pcs 2024-03-27T09:46:23.020 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/pcs/pcs-lynx.ko 2024-03-27T09:46:23.020 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-03-27T09:46:23.020 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy 2024-03-27T09:46:23.020 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/amd.ko 2024-03-27T09:46:23.020 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-03-27T09:46:23.020 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-03-27T09:46:23.020 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm7xxx.ko 2024-03-27T09:46:23.020 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm87xx.ko 2024-03-27T09:46:23.020 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/broadcom.ko 2024-03-27T09:46:23.020 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/cicada.ko 2024-03-27T09:46:23.020 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/davicom.ko 2024-03-27T09:46:23.020 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/dp83640.ko 2024-03-27T09:46:23.020 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/et1011c.ko 2024-03-27T09:46:23.021 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/icplus.ko 2024-03-27T09:46:23.021 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/lxt.ko 2024-03-27T09:46:23.021 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/marvell.ko 2024-03-27T09:46:23.021 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/micrel.ko 2024-03-27T09:46:23.021 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/national.ko 2024-03-27T09:46:23.021 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/phylink.ko 2024-03-27T09:46:23.021 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/qsemi.ko 2024-03-27T09:46:23.021 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/realtek.ko 2024-03-27T09:46:23.021 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/smsc.ko 2024-03-27T09:46:23.021 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/ste10Xp.ko 2024-03-27T09:46:23.021 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/vitesse.ko 2024-03-27T09:46:23.021 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp 2024-03-27T09:46:23.021 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/bsd_comp.ko 2024-03-27T09:46:23.021 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_async.ko 2024-03-27T09:46:23.021 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_deflate.ko 2024-03-27T09:46:23.022 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_generic.ko 2024-03-27T09:46:23.022 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_mppe.ko 2024-03-27T09:46:23.022 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_synctty.ko 2024-03-27T09:46:23.022 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/pppoe.ko 2024-03-27T09:46:23.022 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/pppox.ko 2024-03-27T09:46:23.022 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/pptp.ko 2024-03-27T09:46:23.022 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/slip 2024-03-27T09:46:23.022 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/slip/slhc.ko 2024-03-27T09:46:23.022 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/slip/slip.ko 2024-03-27T09:46:23.022 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/sungem_phy.ko 2024-03-27T09:46:23.022 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/tap.ko 2024-03-27T09:46:23.022 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team 2024-03-27T09:46:23.022 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team.ko 2024-03-27T09:46:23.022 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_activebackup.ko 2024-03-27T09:46:23.023 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_broadcast.ko 2024-03-27T09:46:23.023 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-03-27T09:46:23.023 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_random.ko 2024-03-27T09:46:23.023 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-03-27T09:46:23.023 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/tun.ko 2024-03-27T09:46:23.023 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/veth.ko 2024-03-27T09:46:23.023 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/virtio_net.ko 2024-03-27T09:46:23.023 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vmxnet3 2024-03-27T09:46:23.023 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-03-27T09:46:23.023 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vxlan 2024-03-27T09:46:23.023 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vxlan/vxlan.ko 2024-03-27T09:46:23.023 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/xen-netback 2024-03-27T09:46:23.023 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/xen-netback/xen-netback.ko 2024-03-27T09:46:23.023 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/xen-netfront.ko 2024-03-27T09:46:23.024 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ntb 2024-03-27T09:46:23.024 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ntb/ntb.ko 2024-03-27T09:46:23.024 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme 2024-03-27T09:46:23.024 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme/host 2024-03-27T09:46:23.024 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme/host/nvme-core.ko 2024-03-27T09:46:23.024 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme/host/nvme.ko 2024-03-27T09:46:23.024 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport 2024-03-27T09:46:23.024 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport.ko 2024-03-27T09:46:23.024 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport_cs.ko 2024-03-27T09:46:23.024 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport_pc.ko 2024-03-27T09:46:23.024 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport_serial.ko 2024-03-27T09:46:23.024 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci 2024-03-27T09:46:23.024 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/hotplug 2024-03-27T09:46:23.024 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-03-27T09:46:23.025 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/pcie 2024-03-27T09:46:23.025 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/pcie/aer_inject.ko 2024-03-27T09:46:23.025 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/xen-pcifront.ko 2024-03-27T09:46:23.025 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia 2024-03-27T09:46:23.025 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/i82092.ko 2024-03-27T09:46:23.025 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/pd6729.ko 2024-03-27T09:46:23.025 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/yenta_socket.ko 2024-03-27T09:46:23.025 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pinctrl 2024-03-27T09:46:23.025 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pinctrl/intel 2024-03-27T09:46:23.025 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-03-27T09:46:23.025 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform 2024-03-27T09:46:23.025 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86 2024-03-27T09:46:23.025 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/acer-wmi.ko 2024-03-27T09:46:23.025 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/acerhdf.ko 2024-03-27T09:46:23.025 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/apple-gmux.ko 2024-03-27T09:46:23.026 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/asus-laptop.ko 2024-03-27T09:46:23.026 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-03-27T09:46:23.026 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/asus-wmi.ko 2024-03-27T09:46:23.026 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/classmate-laptop.ko 2024-03-27T09:46:23.026 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-03-27T09:46:23.026 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-03-27T09:46:23.026 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-03-27T09:46:23.026 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-03-27T09:46:23.026 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/hdaps.ko 2024-03-27T09:46:23.026 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/intel 2024-03-27T09:46:23.026 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-03-27T09:46:23.026 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/intel_ips.ko 2024-03-27T09:46:23.026 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/msi-wmi.ko 2024-03-27T09:46:23.026 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/mxm-wmi.ko 2024-03-27T09:46:23.027 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-03-27T09:46:23.027 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/samsung-laptop.ko 2024-03-27T09:46:23.027 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/samsung-q10.ko 2024-03-27T09:46:23.027 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/topstar-laptop.ko 2024-03-27T09:46:23.027 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-03-27T09:46:23.027 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/toshiba_haps.ko 2024-03-27T09:46:23.027 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/wmi-bmof.ko 2024-03-27T09:46:23.027 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/wmi.ko 2024-03-27T09:46:23.027 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/powercap 2024-03-27T09:46:23.027 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/powercap/intel_rapl_common.ko 2024-03-27T09:46:23.027 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/powercap/intel_rapl_msr.ko 2024-03-27T09:46:23.027 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps 2024-03-27T09:46:23.027 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients 2024-03-27T09:46:23.027 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients/pps-gpio.ko 2024-03-27T09:46:23.027 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients/pps-ldisc.ko 2024-03-27T09:46:23.028 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients/pps_parport.ko 2024-03-27T09:46:23.028 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/pps_core.ko 2024-03-27T09:46:23.028 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ptp 2024-03-27T09:46:23.028 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ptp/ptp.ko 2024-03-27T09:46:23.028 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ptp/ptp_kvm.ko 2024-03-27T09:46:23.028 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc 2024-03-27T09:46:23.028 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-bq32k.ko 2024-03-27T09:46:23.028 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1286.ko 2024-03-27T09:46:23.028 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1307.ko 2024-03-27T09:46:23.028 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1374.ko 2024-03-27T09:46:23.028 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1511.ko 2024-03-27T09:46:23.028 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1553.ko 2024-03-27T09:46:23.028 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1672.ko 2024-03-27T09:46:23.028 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1742.ko 2024-03-27T09:46:23.028 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds2404.ko 2024-03-27T09:46:23.029 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds3232.ko 2024-03-27T09:46:23.029 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-em3027.ko 2024-03-27T09:46:23.029 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-fm3130.ko 2024-03-27T09:46:23.029 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-isl12022.ko 2024-03-27T09:46:23.029 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-isl1208.ko 2024-03-27T09:46:23.029 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-m41t80.ko 2024-03-27T09:46:23.029 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-m48t35.ko 2024-03-27T09:46:23.029 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-m48t59.ko 2024-03-27T09:46:23.029 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-max6900.ko 2024-03-27T09:46:23.029 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-msm6242.ko 2024-03-27T09:46:23.029 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf2127.ko 2024-03-27T09:46:23.029 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf85063.ko 2024-03-27T09:46:23.029 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf8523.ko 2024-03-27T09:46:23.029 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf8563.ko 2024-03-27T09:46:23.030 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf8583.ko 2024-03-27T09:46:23.030 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rp5c01.ko 2024-03-27T09:46:23.030 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rs5c372.ko 2024-03-27T09:46:23.030 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-03-27T09:46:23.030 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rx8025.ko 2024-03-27T09:46:23.030 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rx8581.ko 2024-03-27T09:46:23.030 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-03-27T09:46:23.030 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-x1205.ko 2024-03-27T09:46:23.030 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi 2024-03-27T09:46:23.030 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/3w-9xxx.ko 2024-03-27T09:46:23.030 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/3w-sas.ko 2024-03-27T09:46:23.030 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/3w-xxxx.ko 2024-03-27T09:46:23.030 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/BusLogic.ko 2024-03-27T09:46:23.030 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/a100u2w.ko 2024-03-27T09:46:23.031 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aacraid 2024-03-27T09:46:23.031 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aacraid/aacraid.ko 2024-03-27T09:46:23.031 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/advansys.ko 2024-03-27T09:46:23.031 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aic7xxx 2024-03-27T09:46:23.031 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-03-27T09:46:23.031 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-03-27T09:46:23.031 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/am53c974.ko 2024-03-27T09:46:23.031 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/arcmsr 2024-03-27T09:46:23.031 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-03-27T09:46:23.031 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/atp870u.ko 2024-03-27T09:46:23.031 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/be2iscsi 2024-03-27T09:46:23.031 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-03-27T09:46:23.031 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bfa 2024-03-27T09:46:23.031 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bfa/bfa.ko 2024-03-27T09:46:23.032 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2fc 2024-03-27T09:46:23.032 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-03-27T09:46:23.032 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2i 2024-03-27T09:46:23.032 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-03-27T09:46:23.032 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ch.ko 2024-03-27T09:46:23.032 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/csiostor 2024-03-27T09:46:23.032 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/csiostor/csiostor.ko 2024-03-27T09:46:23.032 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi 2024-03-27T09:46:23.032 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb3i 2024-03-27T09:46:23.032 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-03-27T09:46:23.032 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb4i 2024-03-27T09:46:23.032 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-03-27T09:46:23.032 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-03-27T09:46:23.032 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/dc395x.ko 2024-03-27T09:46:23.032 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler 2024-03-27T09:46:23.032 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-03-27T09:46:23.033 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-03-27T09:46:23.033 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-03-27T09:46:23.033 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-03-27T09:46:23.033 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/dmx3191d.ko 2024-03-27T09:46:23.033 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/esas2r 2024-03-27T09:46:23.033 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/esas2r/esas2r.ko 2024-03-27T09:46:23.033 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/esp_scsi.ko 2024-03-27T09:46:23.033 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fcoe 2024-03-27T09:46:23.033 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fcoe/fcoe.ko 2024-03-27T09:46:23.033 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-03-27T09:46:23.033 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fnic 2024-03-27T09:46:23.033 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fnic/fnic.ko 2024-03-27T09:46:23.033 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/hpsa.ko 2024-03-27T09:46:23.033 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/hptiop.ko 2024-03-27T09:46:23.033 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/hv_storvsc.ko 2024-03-27T09:46:23.034 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/initio.ko 2024-03-27T09:46:23.034 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ipr.ko 2024-03-27T09:46:23.034 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ips.ko 2024-03-27T09:46:23.034 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/isci 2024-03-27T09:46:23.034 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/isci/isci.ko 2024-03-27T09:46:23.034 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-03-27T09:46:23.034 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/iscsi_tcp.ko 2024-03-27T09:46:23.034 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libfc 2024-03-27T09:46:23.034 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libfc/libfc.ko 2024-03-27T09:46:23.034 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libiscsi.ko 2024-03-27T09:46:23.034 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libiscsi_tcp.ko 2024-03-27T09:46:23.034 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libsas 2024-03-27T09:46:23.034 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libsas/libsas.ko 2024-03-27T09:46:23.035 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/lpfc 2024-03-27T09:46:23.035 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/lpfc/lpfc.ko 2024-03-27T09:46:23.035 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid 2024-03-27T09:46:23.035 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid.ko 2024-03-27T09:46:23.035 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-03-27T09:46:23.035 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-03-27T09:46:23.035 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-03-27T09:46:23.035 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mpt3sas 2024-03-27T09:46:23.035 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-03-27T09:46:23.035 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mvsas 2024-03-27T09:46:23.035 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mvsas/mvsas.ko 2024-03-27T09:46:23.035 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mvumi.ko 2024-03-27T09:46:23.035 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pm8001 2024-03-27T09:46:23.035 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-03-27T09:46:23.035 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pmcraid.ko 2024-03-27T09:46:23.036 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla1280.ko 2024-03-27T09:46:23.036 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla2xxx 2024-03-27T09:46:23.036 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-03-27T09:46:23.036 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-03-27T09:46:23.036 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla4xxx 2024-03-27T09:46:23.036 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-03-27T09:46:23.036 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/raid_class.ko 2024-03-27T09:46:23.036 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_debug.ko 2024-03-27T09:46:23.036 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_fc.ko 2024-03-27T09:46:23.036 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-03-27T09:46:23.036 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_sas.ko 2024-03-27T09:46:23.036 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_spi.ko 2024-03-27T09:46:23.036 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_srp.ko 2024-03-27T09:46:23.036 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ses.ko 2024-03-27T09:46:23.036 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/st.ko 2024-03-27T09:46:23.037 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/stex.ko 2024-03-27T09:46:23.037 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/sym53c8xx_2 2024-03-27T09:46:23.037 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-03-27T09:46:23.037 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/virtio_scsi.ko 2024-03-27T09:46:23.037 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/vmw_pvscsi.ko 2024-03-27T09:46:23.037 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/wd719x.ko 2024-03-27T09:46:23.037 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ssb 2024-03-27T09:46:23.037 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ssb/ssb.ko 2024-03-27T09:46:23.037 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target 2024-03-27T09:46:23.037 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/iscsi 2024-03-27T09:46:23.037 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-03-27T09:46:23.037 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/loopback 2024-03-27T09:46:23.037 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/loopback/tcm_loop.ko 2024-03-27T09:46:23.037 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_file.ko 2024-03-27T09:46:23.038 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_iblock.ko 2024-03-27T09:46:23.038 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_mod.ko 2024-03-27T09:46:23.038 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_pscsi.ko 2024-03-27T09:46:23.038 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_user.ko 2024-03-27T09:46:23.038 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/tcm_fc 2024-03-27T09:46:23.038 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-03-27T09:46:23.038 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal 2024-03-27T09:46:23.038 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel 2024-03-27T09:46:23.038 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal 2024-03-27T09:46:23.038 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-03-27T09:46:23.038 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-03-27T09:46:23.038 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-03-27T09:46:23.038 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-03-27T09:46:23.038 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-03-27T09:46:23.039 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-03-27T09:46:23.039 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-03-27T09:46:23.039 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-03-27T09:46:23.039 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-03-27T09:46:23.039 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-03-27T09:46:23.039 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-03-27T09:46:23.039 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-03-27T09:46:23.039 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-03-27T09:46:23.039 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-03-27T09:46:23.039 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-03-27T09:46:23.039 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-03-27T09:46:23.039 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-03-27T09:46:23.039 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-03-27T09:46:23.039 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty 2024-03-27T09:46:23.040 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/ipwireless 2024-03-27T09:46:23.040 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-03-27T09:46:23.040 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/n_gsm.ko 2024-03-27T09:46:23.040 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/n_hdlc.ko 2024-03-27T09:46:23.040 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/nozomi.ko 2024-03-27T09:46:23.040 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial 2024-03-27T09:46:23.040 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/8250 2024-03-27T09:46:23.040 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-03-27T09:46:23.040 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/arc_uart.ko 2024-03-27T09:46:23.040 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/jsm 2024-03-27T09:46:23.040 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/jsm/jsm.ko 2024-03-27T09:46:23.040 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs 2024-03-27T09:46:23.040 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/core 2024-03-27T09:46:23.040 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/core/ufshcd-core.ko 2024-03-27T09:46:23.041 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/host 2024-03-27T09:46:23.041 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-03-27T09:46:23.041 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio 2024-03-27T09:46:23.041 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio.ko 2024-03-27T09:46:23.041 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_aec.ko 2024-03-27T09:46:23.041 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_cif.ko 2024-03-27T09:46:23.041 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_pci_generic.ko 2024-03-27T09:46:23.041 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_sercos3.ko 2024-03-27T09:46:23.041 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb 2024-03-27T09:46:23.041 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class 2024-03-27T09:46:23.041 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/cdc-acm.ko 2024-03-27T09:46:23.041 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/cdc-wdm.ko 2024-03-27T09:46:23.041 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/usblp.ko 2024-03-27T09:46:23.041 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/usbtmc.ko 2024-03-27T09:46:23.041 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/host 2024-03-27T09:46:23.042 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/host/sl811-hcd.ko 2024-03-27T09:46:23.042 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/image 2024-03-27T09:46:23.042 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/image/mdc800.ko 2024-03-27T09:46:23.042 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/image/microtek.ko 2024-03-27T09:46:23.042 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc 2024-03-27T09:46:23.042 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/adutux.ko 2024-03-27T09:46:23.042 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/appledisplay.ko 2024-03-27T09:46:23.042 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/emi26.ko 2024-03-27T09:46:23.042 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/emi62.ko 2024-03-27T09:46:23.042 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/ezusb.ko 2024-03-27T09:46:23.042 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/idmouse.ko 2024-03-27T09:46:23.042 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/iowarrior.ko 2024-03-27T09:46:23.042 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/isight_firmware.ko 2024-03-27T09:46:23.042 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/ldusb.ko 2024-03-27T09:46:23.042 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/legousbtower.ko 2024-03-27T09:46:23.043 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/sisusbvga 2024-03-27T09:46:23.043 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-03-27T09:46:23.043 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/trancevibrator.ko 2024-03-27T09:46:23.043 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/usb3503.ko 2024-03-27T09:46:23.043 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/usblcd.ko 2024-03-27T09:46:23.043 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/usbsevseg.ko 2024-03-27T09:46:23.043 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/uss720.ko 2024-03-27T09:46:23.043 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/yurex.ko 2024-03-27T09:46:23.043 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/phy 2024-03-27T09:46:23.043 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/phy/phy-generic.ko 2024-03-27T09:46:23.043 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial 2024-03-27T09:46:23.043 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/aircable.ko 2024-03-27T09:46:23.043 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ark3116.ko 2024-03-27T09:46:23.043 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/belkin_sa.ko 2024-03-27T09:46:23.043 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ch341.ko 2024-03-27T09:46:23.044 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/cp210x.ko 2024-03-27T09:46:23.044 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/cyberjack.ko 2024-03-27T09:46:23.044 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/cypress_m8.ko 2024-03-27T09:46:23.044 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/digi_acceleport.ko 2024-03-27T09:46:23.044 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/empeg.ko 2024-03-27T09:46:23.044 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ftdi_sio.ko 2024-03-27T09:46:23.044 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/garmin_gps.ko 2024-03-27T09:46:23.044 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/io_edgeport.ko 2024-03-27T09:46:23.044 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/io_ti.ko 2024-03-27T09:46:23.044 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ipaq.ko 2024-03-27T09:46:23.044 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ipw.ko 2024-03-27T09:46:23.044 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ir-usb.ko 2024-03-27T09:46:23.044 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-03-27T09:46:23.044 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/keyspan.ko 2024-03-27T09:46:23.045 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/keyspan_pda.ko 2024-03-27T09:46:23.045 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/kl5kusb105.ko 2024-03-27T09:46:23.045 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/kobil_sct.ko 2024-03-27T09:46:23.045 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/mct_u232.ko 2024-03-27T09:46:23.045 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/mos7720.ko 2024-03-27T09:46:23.045 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/mos7840.ko 2024-03-27T09:46:23.045 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/navman.ko 2024-03-27T09:46:23.045 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/omninet.ko 2024-03-27T09:46:23.045 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/opticon.ko 2024-03-27T09:46:23.045 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/option.ko 2024-03-27T09:46:23.045 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/oti6858.ko 2024-03-27T09:46:23.045 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/pl2303.ko 2024-03-27T09:46:23.045 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/qcaux.ko 2024-03-27T09:46:23.045 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/qcserial.ko 2024-03-27T09:46:23.046 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/quatech2.ko 2024-03-27T09:46:23.046 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/safe_serial.ko 2024-03-27T09:46:23.046 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/sierra.ko 2024-03-27T09:46:23.046 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/spcp8x5.ko 2024-03-27T09:46:23.046 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ssu100.ko 2024-03-27T09:46:23.046 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/symbolserial.ko 2024-03-27T09:46:23.046 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-03-27T09:46:23.046 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-03-27T09:46:23.046 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/usb_debug.ko 2024-03-27T09:46:23.046 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/usb_wwan.ko 2024-03-27T09:46:23.046 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/visor.ko 2024-03-27T09:46:23.046 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/whiteheat.ko 2024-03-27T09:46:23.046 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/xsens_mt.ko 2024-03-27T09:46:23.046 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage 2024-03-27T09:46:23.046 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/uas.ko 2024-03-27T09:46:23.047 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-alauda.ko 2024-03-27T09:46:23.047 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-cypress.ko 2024-03-27T09:46:23.047 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-datafab.ko 2024-03-27T09:46:23.047 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-03-27T09:46:23.047 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-freecom.ko 2024-03-27T09:46:23.047 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-isd200.ko 2024-03-27T09:46:23.047 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-03-27T09:46:23.047 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-karma.ko 2024-03-27T09:46:23.047 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-onetouch.ko 2024-03-27T09:46:23.047 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-realtek.ko 2024-03-27T09:46:23.047 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-sddr09.ko 2024-03-27T09:46:23.047 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-sddr55.ko 2024-03-27T09:46:23.047 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-usbat.ko 2024-03-27T09:46:23.047 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/usb-storage.ko 2024-03-27T09:46:23.047 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip 2024-03-27T09:46:23.048 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip/usbip-core.ko 2024-03-27T09:46:23.048 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip/usbip-host.ko 2024-03-27T09:46:23.048 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-03-27T09:46:23.048 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio 2024-03-27T09:46:23.048 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/pci 2024-03-27T09:46:23.048 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-03-27T09:46:23.048 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/pci/vfio-pci.ko 2024-03-27T09:46:23.048 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/vfio.ko 2024-03-27T09:46:23.048 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-03-27T09:46:23.048 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost 2024-03-27T09:46:23.048 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost.ko 2024-03-27T09:46:23.048 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost_iotlb.ko 2024-03-27T09:46:23.048 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost_net.ko 2024-03-27T09:46:23.048 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost_scsi.ko 2024-03-27T09:46:23.048 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video 2024-03-27T09:46:23.049 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight 2024-03-27T09:46:23.049 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/apple_bl.ko 2024-03-27T09:46:23.049 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/lcd.ko 2024-03-27T09:46:23.049 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/platform_lcd.ko 2024-03-27T09:46:23.049 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio 2024-03-27T09:46:23.049 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio.ko 2024-03-27T09:46:23.049 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_balloon.ko 2024-03-27T09:46:23.049 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_mmio.ko 2024-03-27T09:46:23.049 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_pci.ko 2024-03-27T09:46:23.049 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-03-27T09:46:23.049 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-03-27T09:46:23.049 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_ring.ko 2024-03-27T09:46:23.049 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1 2024-03-27T09:46:23.049 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/masters 2024-03-27T09:46:23.049 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/masters/ds2482.ko 2024-03-27T09:46:23.050 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/masters/ds2490.ko 2024-03-27T09:46:23.050 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves 2024-03-27T09:46:23.050 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-03-27T09:46:23.050 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-03-27T09:46:23.050 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-03-27T09:46:23.050 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-03-27T09:46:23.050 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-03-27T09:46:23.050 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-03-27T09:46:23.050 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-03-27T09:46:23.050 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-03-27T09:46:23.050 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-03-27T09:46:23.050 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_smem.ko 2024-03-27T09:46:23.050 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_therm.ko 2024-03-27T09:46:23.050 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/wire.ko 2024-03-27T09:46:23.051 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog 2024-03-27T09:46:23.051 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/alim1535_wdt.ko 2024-03-27T09:46:23.051 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/alim7101_wdt.ko 2024-03-27T09:46:23.051 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/f71808e_wdt.ko 2024-03-27T09:46:23.051 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/hpwdt.ko 2024-03-27T09:46:23.051 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/i6300esb.ko 2024-03-27T09:46:23.051 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-03-27T09:46:23.051 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/iTCO_wdt.ko 2024-03-27T09:46:23.051 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/ib700wdt.ko 2024-03-27T09:46:23.051 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/ibmasr.ko 2024-03-27T09:46:23.051 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-03-27T09:46:23.051 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/it8712f_wdt.ko 2024-03-27T09:46:23.051 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/it87_wdt.ko 2024-03-27T09:46:23.051 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/machzwd.ko 2024-03-27T09:46:23.051 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/nv_tco.ko 2024-03-27T09:46:23.051 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/pcwd_pci.ko 2024-03-27T09:46:23.052 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/pcwd_usb.ko 2024-03-27T09:46:23.052 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-03-27T09:46:23.052 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/sch311x_wdt.ko 2024-03-27T09:46:23.052 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/softdog.ko 2024-03-27T09:46:23.052 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/sp5100_tco.ko 2024-03-27T09:46:23.052 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/via_wdt.ko 2024-03-27T09:46:23.052 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-03-27T09:46:23.052 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/w83877f_wdt.ko 2024-03-27T09:46:23.052 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/w83977f_wdt.ko 2024-03-27T09:46:23.052 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/wdt_pci.ko 2024-03-27T09:46:23.052 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/xen_wdt.ko 2024-03-27T09:46:23.052 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen 2024-03-27T09:46:23.052 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-acpi-processor.ko 2024-03-27T09:46:23.052 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-evtchn.ko 2024-03-27T09:46:23.053 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-gntalloc.ko 2024-03-27T09:46:23.053 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-gntdev.ko 2024-03-27T09:46:23.053 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-pciback 2024-03-27T09:46:23.053 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-03-27T09:46:23.053 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-privcmd.ko 2024-03-27T09:46:23.053 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xenfs 2024-03-27T09:46:23.053 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xenfs/xenfs.ko 2024-03-27T09:46:23.053 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs 2024-03-27T09:46:23.053 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/9p 2024-03-27T09:46:23.053 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/9p/9p.ko 2024-03-27T09:46:23.053 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/affs 2024-03-27T09:46:23.053 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/affs/affs.ko 2024-03-27T09:46:23.053 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/befs 2024-03-27T09:46:23.053 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/befs/befs.ko 2024-03-27T09:46:23.053 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/binfmt_misc.ko 2024-03-27T09:46:23.054 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/btrfs 2024-03-27T09:46:23.054 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/btrfs/btrfs.ko 2024-03-27T09:46:23.054 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cachefiles 2024-03-27T09:46:23.054 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cachefiles/cachefiles.ko 2024-03-27T09:46:23.054 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ceph 2024-03-27T09:46:23.054 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ceph/ceph.ko 2024-03-27T09:46:23.054 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/coda 2024-03-27T09:46:23.054 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/coda/coda.ko 2024-03-27T09:46:23.054 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cramfs 2024-03-27T09:46:23.054 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cramfs/cramfs.ko 2024-03-27T09:46:23.054 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/dlm 2024-03-27T09:46:23.054 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/dlm/dlm.ko 2024-03-27T09:46:23.054 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ecryptfs 2024-03-27T09:46:23.054 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ecryptfs/ecryptfs.ko 2024-03-27T09:46:23.054 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/f2fs 2024-03-27T09:46:23.055 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/f2fs/f2fs.ko 2024-03-27T09:46:23.055 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat 2024-03-27T09:46:23.055 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat/fat.ko 2024-03-27T09:46:23.055 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat/msdos.ko 2024-03-27T09:46:23.055 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat/vfat.ko 2024-03-27T09:46:23.055 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fuse 2024-03-27T09:46:23.055 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fuse/cuse.ko 2024-03-27T09:46:23.055 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fuse/fuse.ko 2024-03-27T09:46:23.055 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/gfs2 2024-03-27T09:46:23.055 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/gfs2/gfs2.ko 2024-03-27T09:46:23.055 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfs 2024-03-27T09:46:23.055 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfs/hfs.ko 2024-03-27T09:46:23.055 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfsplus 2024-03-27T09:46:23.055 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfsplus/hfsplus.ko 2024-03-27T09:46:23.055 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/isofs 2024-03-27T09:46:23.056 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/isofs/isofs.ko 2024-03-27T09:46:23.056 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/jfs 2024-03-27T09:46:23.056 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/jfs/jfs.ko 2024-03-27T09:46:23.056 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/lockd 2024-03-27T09:46:23.056 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/lockd/lockd.ko 2024-03-27T09:46:23.056 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/minix 2024-03-27T09:46:23.056 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/minix/minix.ko 2024-03-27T09:46:23.056 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/netfs 2024-03-27T09:46:23.056 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/netfs/netfs.ko 2024-03-27T09:46:23.056 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs 2024-03-27T09:46:23.056 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/blocklayout 2024-03-27T09:46:23.056 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-03-27T09:46:23.056 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/filelayout 2024-03-27T09:46:23.056 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-03-27T09:46:23.056 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/flexfilelayout 2024-03-27T09:46:23.057 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-03-27T09:46:23.057 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/nfs.ko 2024-03-27T09:46:23.057 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/nfsv3.ko 2024-03-27T09:46:23.057 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/nfsv4.ko 2024-03-27T09:46:23.057 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs_common 2024-03-27T09:46:23.057 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs_common/grace.ko 2024-03-27T09:46:23.057 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs_common/nfs_acl.ko 2024-03-27T09:46:23.057 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfsd 2024-03-27T09:46:23.057 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfsd/nfsd.ko 2024-03-27T09:46:23.057 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nilfs2 2024-03-27T09:46:23.057 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nilfs2/nilfs2.ko 2024-03-27T09:46:23.057 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls 2024-03-27T09:46:23.057 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-celtic.ko 2024-03-27T09:46:23.057 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-centeuro.ko 2024-03-27T09:46:23.057 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-croatian.ko 2024-03-27T09:46:23.058 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-cyrillic.ko 2024-03-27T09:46:23.058 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-gaelic.ko 2024-03-27T09:46:23.058 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-greek.ko 2024-03-27T09:46:23.058 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-iceland.ko 2024-03-27T09:46:23.058 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-inuit.ko 2024-03-27T09:46:23.058 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-roman.ko 2024-03-27T09:46:23.058 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-romanian.ko 2024-03-27T09:46:23.058 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-turkish.ko 2024-03-27T09:46:23.058 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp1250.ko 2024-03-27T09:46:23.058 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp1251.ko 2024-03-27T09:46:23.058 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp1255.ko 2024-03-27T09:46:23.058 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp737.ko 2024-03-27T09:46:23.058 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp775.ko 2024-03-27T09:46:23.058 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp850.ko 2024-03-27T09:46:23.059 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp852.ko 2024-03-27T09:46:23.059 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp855.ko 2024-03-27T09:46:23.059 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp857.ko 2024-03-27T09:46:23.059 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp860.ko 2024-03-27T09:46:23.059 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp861.ko 2024-03-27T09:46:23.059 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp862.ko 2024-03-27T09:46:23.059 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp863.ko 2024-03-27T09:46:23.059 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp864.ko 2024-03-27T09:46:23.059 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp865.ko 2024-03-27T09:46:23.059 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp866.ko 2024-03-27T09:46:23.059 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp869.ko 2024-03-27T09:46:23.059 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp874.ko 2024-03-27T09:46:23.059 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp932.ko 2024-03-27T09:46:23.059 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp936.ko 2024-03-27T09:46:23.059 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp949.ko 2024-03-27T09:46:23.059 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp950.ko 2024-03-27T09:46:23.060 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_euc-jp.ko 2024-03-27T09:46:23.060 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-1.ko 2024-03-27T09:46:23.060 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-13.ko 2024-03-27T09:46:23.060 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-14.ko 2024-03-27T09:46:23.060 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-15.ko 2024-03-27T09:46:23.060 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-2.ko 2024-03-27T09:46:23.060 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-3.ko 2024-03-27T09:46:23.060 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-4.ko 2024-03-27T09:46:23.060 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-5.ko 2024-03-27T09:46:23.060 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-6.ko 2024-03-27T09:46:23.060 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-7.ko 2024-03-27T09:46:23.060 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-9.ko 2024-03-27T09:46:23.060 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_koi8-r.ko 2024-03-27T09:46:23.060 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_koi8-ru.ko 2024-03-27T09:46:23.060 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_koi8-u.ko 2024-03-27T09:46:23.061 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_ucs2_utils.ko 2024-03-27T09:46:23.061 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_utf8.ko 2024-03-27T09:46:23.061 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2 2024-03-27T09:46:23.061 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/cluster 2024-03-27T09:46:23.061 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-03-27T09:46:23.061 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlm 2024-03-27T09:46:23.061 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-03-27T09:46:23.061 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlmfs 2024-03-27T09:46:23.061 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-03-27T09:46:23.061 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2.ko 2024-03-27T09:46:23.061 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-03-27T09:46:23.061 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-03-27T09:46:23.061 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-03-27T09:46:23.061 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/overlayfs 2024-03-27T09:46:23.062 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/overlayfs/overlay.ko 2024-03-27T09:46:23.062 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/pstore 2024-03-27T09:46:23.062 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/pstore/ramoops.ko 2024-03-27T09:46:23.062 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/reiserfs 2024-03-27T09:46:23.062 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/reiserfs/reiserfs.ko 2024-03-27T09:46:23.062 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/romfs 2024-03-27T09:46:23.062 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/romfs/romfs.ko 2024-03-27T09:46:23.062 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb 2024-03-27T09:46:23.062 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/client 2024-03-27T09:46:23.062 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/client/cifs.ko 2024-03-27T09:46:23.062 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/common 2024-03-27T09:46:23.062 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/common/cifs_arc4.ko 2024-03-27T09:46:23.062 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/common/cifs_md4.ko 2024-03-27T09:46:23.062 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/squashfs 2024-03-27T09:46:23.063 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/squashfs/squashfs.ko 2024-03-27T09:46:23.063 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/sysv 2024-03-27T09:46:23.063 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/sysv/sysv.ko 2024-03-27T09:46:23.063 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/udf 2024-03-27T09:46:23.063 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/udf/udf.ko 2024-03-27T09:46:23.063 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ufs 2024-03-27T09:46:23.063 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ufs/ufs.ko 2024-03-27T09:46:23.063 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/xfs 2024-03-27T09:46:23.063 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/xfs/xfs.ko 2024-03-27T09:46:23.063 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel 2024-03-27T09:46:23.063 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/rcu 2024-03-27T09:46:23.063 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/rcu/rcutorture.ko 2024-03-27T09:46:23.063 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/torture.ko 2024-03-27T09:46:23.063 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/trace 2024-03-27T09:46:23.063 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-03-27T09:46:23.064 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib 2024-03-27T09:46:23.064 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/asn1_encoder.ko 2024-03-27T09:46:23.064 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crc-itu-t.ko 2024-03-27T09:46:23.064 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crc8.ko 2024-03-27T09:46:23.064 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crypto 2024-03-27T09:46:23.064 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crypto/libarc4.ko 2024-03-27T09:46:23.064 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crypto/libdes.ko 2024-03-27T09:46:23.064 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/libcrc32c.ko 2024-03-27T09:46:23.064 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lru_cache.ko 2024-03-27T09:46:23.064 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lz4 2024-03-27T09:46:23.064 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lz4/lz4_compress.ko 2024-03-27T09:46:23.064 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lz4/lz4hc_compress.ko 2024-03-27T09:46:23.064 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/math 2024-03-27T09:46:23.064 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/math/cordic.ko 2024-03-27T09:46:23.064 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/raid6 2024-03-27T09:46:23.065 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/raid6/raid6_pq.ko 2024-03-27T09:46:23.065 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/reed_solomon 2024-03-27T09:46:23.065 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/reed_solomon/reed_solomon.ko 2024-03-27T09:46:23.065 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/ts_bm.ko 2024-03-27T09:46:23.065 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/ts_fsm.ko 2024-03-27T09:46:23.065 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/ts_kmp.ko 2024-03-27T09:46:23.065 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/zstd 2024-03-27T09:46:23.065 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/zstd/zstd_compress.ko 2024-03-27T09:46:23.065 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/mm 2024-03-27T09:46:23.065 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/mm/hwpoison-inject.ko 2024-03-27T09:46:23.065 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net 2024-03-27T09:46:23.065 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan 2024-03-27T09:46:23.065 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/6lowpan.ko 2024-03-27T09:46:23.065 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_dest.ko 2024-03-27T09:46:23.066 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_fragment.ko 2024-03-27T09:46:23.066 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_hop.ko 2024-03-27T09:46:23.066 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_ipv6.ko 2024-03-27T09:46:23.066 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_mobility.ko 2024-03-27T09:46:23.066 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_routing.ko 2024-03-27T09:46:23.066 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_udp.ko 2024-03-27T09:46:23.066 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802 2024-03-27T09:46:23.066 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/garp.ko 2024-03-27T09:46:23.066 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/mrp.ko 2024-03-27T09:46:23.066 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/p8022.ko 2024-03-27T09:46:23.066 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/psnap.ko 2024-03-27T09:46:23.066 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/stp.ko 2024-03-27T09:46:23.066 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/8021q 2024-03-27T09:46:23.066 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/8021q/8021q.ko 2024-03-27T09:46:23.066 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p 2024-03-27T09:46:23.067 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet.ko 2024-03-27T09:46:23.067 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet_fd.ko 2024-03-27T09:46:23.067 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet_rdma.ko 2024-03-27T09:46:23.067 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet_virtio.ko 2024-03-27T09:46:23.067 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/batman-adv 2024-03-27T09:46:23.067 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/batman-adv/batman-adv.ko 2024-03-27T09:46:23.067 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge 2024-03-27T09:46:23.067 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/br_netfilter.ko 2024-03-27T09:46:23.067 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/bridge.ko 2024-03-27T09:46:23.067 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter 2024-03-27T09:46:23.067 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-03-27T09:46:23.067 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_among.ko 2024-03-27T09:46:23.067 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_arp.ko 2024-03-27T09:46:23.067 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-03-27T09:46:23.068 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-03-27T09:46:23.068 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_ip.ko 2024-03-27T09:46:23.068 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-03-27T09:46:23.068 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_limit.ko 2024-03-27T09:46:23.068 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_log.ko 2024-03-27T09:46:23.068 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_mark.ko 2024-03-27T09:46:23.068 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-03-27T09:46:23.068 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-03-27T09:46:23.068 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-03-27T09:46:23.068 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-03-27T09:46:23.068 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_snat.ko 2024-03-27T09:46:23.068 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_stp.ko 2024-03-27T09:46:23.068 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-03-27T09:46:23.068 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-03-27T09:46:23.068 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-03-27T09:46:23.069 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-03-27T09:46:23.069 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtables.ko 2024-03-27T09:46:23.069 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-03-27T09:46:23.069 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-03-27T09:46:23.069 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-03-27T09:46:23.069 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ceph 2024-03-27T09:46:23.069 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ceph/libceph.ko 2024-03-27T09:46:23.069 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/core 2024-03-27T09:46:23.069 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/core/failover.ko 2024-03-27T09:46:23.069 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/core/pktgen.ko 2024-03-27T09:46:23.069 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp 2024-03-27T09:46:23.069 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp.ko 2024-03-27T09:46:23.069 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp_diag.ko 2024-03-27T09:46:23.069 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp_ipv4.ko 2024-03-27T09:46:23.070 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp_ipv6.ko 2024-03-27T09:46:23.070 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dns_resolver 2024-03-27T09:46:23.070 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dns_resolver/dns_resolver.ko 2024-03-27T09:46:23.070 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa 2024-03-27T09:46:23.070 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/dsa_core.ko 2024-03-27T09:46:23.070 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_brcm.ko 2024-03-27T09:46:23.070 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_dsa.ko 2024-03-27T09:46:23.070 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_none.ko 2024-03-27T09:46:23.070 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_trailer.ko 2024-03-27T09:46:23.070 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154 2024-03-27T09:46:23.070 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/6lowpan 2024-03-27T09:46:23.070 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-03-27T09:46:23.070 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/ieee802154.ko 2024-03-27T09:46:23.070 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/ieee802154_socket.ko 2024-03-27T09:46:23.070 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4 2024-03-27T09:46:23.071 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ah4.ko 2024-03-27T09:46:23.071 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/esp4.ko 2024-03-27T09:46:23.071 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/fou.ko 2024-03-27T09:46:23.071 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/gre.ko 2024-03-27T09:46:23.071 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/inet_diag.ko 2024-03-27T09:46:23.071 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ip_gre.ko 2024-03-27T09:46:23.071 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ip_tunnel.ko 2024-03-27T09:46:23.071 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ip_vti.ko 2024-03-27T09:46:23.071 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ipcomp.ko 2024-03-27T09:46:23.071 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ipip.ko 2024-03-27T09:46:23.071 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter 2024-03-27T09:46:23.071 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/arp_tables.ko 2024-03-27T09:46:23.071 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-03-27T09:46:23.072 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-03-27T09:46:23.072 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-03-27T09:46:23.072 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-03-27T09:46:23.072 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-03-27T09:46:23.072 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-03-27T09:46:23.072 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-03-27T09:46:23.072 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-03-27T09:46:23.072 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-03-27T09:46:23.072 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_security.ko 2024-03-27T09:46:23.072 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-03-27T09:46:23.072 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-03-27T09:46:23.072 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-03-27T09:46:23.072 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-03-27T09:46:23.072 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-03-27T09:46:23.073 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-03-27T09:46:23.073 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-03-27T09:46:23.073 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-03-27T09:46:23.073 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-03-27T09:46:23.073 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-03-27T09:46:23.073 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_bic.ko 2024-03-27T09:46:23.073 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_dctcp.ko 2024-03-27T09:46:23.073 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_diag.ko 2024-03-27T09:46:23.073 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_highspeed.ko 2024-03-27T09:46:23.073 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_htcp.ko 2024-03-27T09:46:23.073 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_hybla.ko 2024-03-27T09:46:23.073 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_illinois.ko 2024-03-27T09:46:23.073 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_lp.ko 2024-03-27T09:46:23.073 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_scalable.ko 2024-03-27T09:46:23.074 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_vegas.ko 2024-03-27T09:46:23.074 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_veno.ko 2024-03-27T09:46:23.074 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_westwood.ko 2024-03-27T09:46:23.074 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_yeah.ko 2024-03-27T09:46:23.074 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tunnel4.ko 2024-03-27T09:46:23.074 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/udp_diag.ko 2024-03-27T09:46:23.074 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/udp_tunnel.ko 2024-03-27T09:46:23.074 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/xfrm4_tunnel.ko 2024-03-27T09:46:23.074 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6 2024-03-27T09:46:23.074 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ah6.ko 2024-03-27T09:46:23.074 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/esp6.ko 2024-03-27T09:46:23.074 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/fou6.ko 2024-03-27T09:46:23.074 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ip6_tunnel.ko 2024-03-27T09:46:23.075 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-03-27T09:46:23.075 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ip6_vti.ko 2024-03-27T09:46:23.075 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ipcomp6.ko 2024-03-27T09:46:23.075 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter 2024-03-27T09:46:23.075 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-03-27T09:46:23.075 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-03-27T09:46:23.075 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-03-27T09:46:23.075 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-03-27T09:46:23.075 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-03-27T09:46:23.075 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-03-27T09:46:23.075 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-03-27T09:46:23.075 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-03-27T09:46:23.075 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-03-27T09:46:23.075 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-03-27T09:46:23.076 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-03-27T09:46:23.076 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-03-27T09:46:23.076 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-03-27T09:46:23.076 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-03-27T09:46:23.076 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-03-27T09:46:23.076 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-03-27T09:46:23.076 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-03-27T09:46:23.076 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-03-27T09:46:23.076 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-03-27T09:46:23.076 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-03-27T09:46:23.076 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-03-27T09:46:23.076 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-03-27T09:46:23.076 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-03-27T09:46:23.076 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-03-27T09:46:23.077 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/sit.ko 2024-03-27T09:46:23.077 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/tunnel6.ko 2024-03-27T09:46:23.077 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/xfrm6_tunnel.ko 2024-03-27T09:46:23.077 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/key 2024-03-27T09:46:23.077 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/key/af_key.ko 2024-03-27T09:46:23.077 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp 2024-03-27T09:46:23.077 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_core.ko 2024-03-27T09:46:23.077 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_debugfs.ko 2024-03-27T09:46:23.077 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_eth.ko 2024-03-27T09:46:23.077 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_ip.ko 2024-03-27T09:46:23.077 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_ip6.ko 2024-03-27T09:46:23.077 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_netlink.ko 2024-03-27T09:46:23.077 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_ppp.ko 2024-03-27T09:46:23.077 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/llc 2024-03-27T09:46:23.078 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/llc/llc.ko 2024-03-27T09:46:23.078 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mac802154 2024-03-27T09:46:23.078 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mac802154/mac802154.ko 2024-03-27T09:46:23.078 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mpls 2024-03-27T09:46:23.078 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mpls/mpls_gso.ko 2024-03-27T09:46:23.078 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter 2024-03-27T09:46:23.078 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset 2024-03-27T09:46:23.078 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set.ko 2024-03-27T09:46:23.078 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-03-27T09:46:23.078 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-03-27T09:46:23.078 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-03-27T09:46:23.078 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-03-27T09:46:23.078 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-03-27T09:46:23.078 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-03-27T09:46:23.078 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-03-27T09:46:23.079 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-03-27T09:46:23.079 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-03-27T09:46:23.079 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-03-27T09:46:23.079 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-03-27T09:46:23.079 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-03-27T09:46:23.079 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-03-27T09:46:23.079 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-03-27T09:46:23.079 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-03-27T09:46:23.079 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs 2024-03-27T09:46:23.079 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs.ko 2024-03-27T09:46:23.079 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-03-27T09:46:23.079 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-03-27T09:46:23.079 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-03-27T09:46:23.079 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-03-27T09:46:23.080 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-03-27T09:46:23.080 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-03-27T09:46:23.080 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-03-27T09:46:23.080 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-03-27T09:46:23.080 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-03-27T09:46:23.080 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-03-27T09:46:23.080 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-03-27T09:46:23.080 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-03-27T09:46:23.080 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-03-27T09:46:23.080 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conncount.ko 2024-03-27T09:46:23.080 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack.ko 2024-03-27T09:46:23.080 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-03-27T09:46:23.080 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-03-27T09:46:23.080 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-03-27T09:46:23.080 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_h323.ko 2024-03-27T09:46:23.081 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_irc.ko 2024-03-27T09:46:23.081 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-03-27T09:46:23.081 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-03-27T09:46:23.081 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-03-27T09:46:23.081 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_sane.ko 2024-03-27T09:46:23.081 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_sip.ko 2024-03-27T09:46:23.081 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-03-27T09:46:23.081 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-03-27T09:46:23.081 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_dup_netdev.ko 2024-03-27T09:46:23.081 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_flow_table.ko 2024-03-27T09:46:23.081 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_flow_table_inet.ko 2024-03-27T09:46:23.081 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_log_syslog.ko 2024-03-27T09:46:23.081 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat.ko 2024-03-27T09:46:23.081 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_amanda.ko 2024-03-27T09:46:23.081 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_ftp.ko 2024-03-27T09:46:23.082 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_irc.ko 2024-03-27T09:46:23.082 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_sip.ko 2024-03-27T09:46:23.082 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_tftp.ko 2024-03-27T09:46:23.082 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_synproxy_core.ko 2024-03-27T09:46:23.082 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_tables.ko 2024-03-27T09:46:23.082 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink.ko 2024-03-27T09:46:23.082 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_acct.ko 2024-03-27T09:46:23.082 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_log.ko 2024-03-27T09:46:23.082 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_osf.ko 2024-03-27T09:46:23.082 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_queue.ko 2024-03-27T09:46:23.082 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_chain_nat.ko 2024-03-27T09:46:23.082 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_compat.ko 2024-03-27T09:46:23.082 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_ct.ko 2024-03-27T09:46:23.082 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_dup_netdev.ko 2024-03-27T09:46:23.083 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_fib.ko 2024-03-27T09:46:23.083 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_fwd_netdev.ko 2024-03-27T09:46:23.083 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_hash.ko 2024-03-27T09:46:23.083 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_limit.ko 2024-03-27T09:46:23.083 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_log.ko 2024-03-27T09:46:23.083 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_masq.ko 2024-03-27T09:46:23.083 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_nat.ko 2024-03-27T09:46:23.083 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_numgen.ko 2024-03-27T09:46:23.083 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_queue.ko 2024-03-27T09:46:23.083 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_quota.ko 2024-03-27T09:46:23.083 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_redir.ko 2024-03-27T09:46:23.083 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_reject.ko 2024-03-27T09:46:23.083 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_reject_inet.ko 2024-03-27T09:46:23.083 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_socket.ko 2024-03-27T09:46:23.084 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_tunnel.ko 2024-03-27T09:46:23.084 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_AUDIT.ko 2024-03-27T09:46:23.084 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CHECKSUM.ko 2024-03-27T09:46:23.084 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CLASSIFY.ko 2024-03-27T09:46:23.084 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-03-27T09:46:23.084 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CT.ko 2024-03-27T09:46:23.084 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_DSCP.ko 2024-03-27T09:46:23.084 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_HL.ko 2024-03-27T09:46:23.084 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_HMARK.ko 2024-03-27T09:46:23.084 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_IDLETIMER.ko 2024-03-27T09:46:23.084 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_LED.ko 2024-03-27T09:46:23.084 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_LOG.ko 2024-03-27T09:46:23.084 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_MASQUERADE.ko 2024-03-27T09:46:23.084 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_NETMAP.ko 2024-03-27T09:46:23.084 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_NFLOG.ko 2024-03-27T09:46:23.085 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_NFQUEUE.ko 2024-03-27T09:46:23.085 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_RATEEST.ko 2024-03-27T09:46:23.085 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_REDIRECT.ko 2024-03-27T09:46:23.085 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_SECMARK.ko 2024-03-27T09:46:23.085 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TCPMSS.ko 2024-03-27T09:46:23.085 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-03-27T09:46:23.085 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TEE.ko 2024-03-27T09:46:23.085 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TPROXY.ko 2024-03-27T09:46:23.085 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TRACE.ko 2024-03-27T09:46:23.085 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_addrtype.ko 2024-03-27T09:46:23.085 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_bpf.ko 2024-03-27T09:46:23.085 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_cgroup.ko 2024-03-27T09:46:23.085 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_cluster.ko 2024-03-27T09:46:23.085 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_comment.ko 2024-03-27T09:46:23.086 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connbytes.ko 2024-03-27T09:46:23.086 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connlabel.ko 2024-03-27T09:46:23.086 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connlimit.ko 2024-03-27T09:46:23.086 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connmark.ko 2024-03-27T09:46:23.086 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_conntrack.ko 2024-03-27T09:46:23.086 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_cpu.ko 2024-03-27T09:46:23.086 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_dccp.ko 2024-03-27T09:46:23.086 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_devgroup.ko 2024-03-27T09:46:23.086 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_dscp.ko 2024-03-27T09:46:23.086 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_ecn.ko 2024-03-27T09:46:23.086 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_esp.ko 2024-03-27T09:46:23.086 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_hashlimit.ko 2024-03-27T09:46:23.086 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_helper.ko 2024-03-27T09:46:23.086 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_hl.ko 2024-03-27T09:46:23.086 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_ipcomp.ko 2024-03-27T09:46:23.087 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_iprange.ko 2024-03-27T09:46:23.087 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_ipvs.ko 2024-03-27T09:46:23.087 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_l2tp.ko 2024-03-27T09:46:23.087 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_length.ko 2024-03-27T09:46:23.087 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_limit.ko 2024-03-27T09:46:23.087 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_mac.ko 2024-03-27T09:46:23.087 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_mark.ko 2024-03-27T09:46:23.087 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_multiport.ko 2024-03-27T09:46:23.087 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_nat.ko 2024-03-27T09:46:23.087 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_nfacct.ko 2024-03-27T09:46:23.087 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_osf.ko 2024-03-27T09:46:23.087 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_owner.ko 2024-03-27T09:46:23.087 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_physdev.ko 2024-03-27T09:46:23.087 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_pkttype.ko 2024-03-27T09:46:23.088 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_policy.ko 2024-03-27T09:46:23.088 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_quota.ko 2024-03-27T09:46:23.088 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_rateest.ko 2024-03-27T09:46:23.088 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_realm.ko 2024-03-27T09:46:23.088 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_recent.ko 2024-03-27T09:46:23.088 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_sctp.ko 2024-03-27T09:46:23.088 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_set.ko 2024-03-27T09:46:23.088 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_socket.ko 2024-03-27T09:46:23.088 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_state.ko 2024-03-27T09:46:23.088 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_statistic.ko 2024-03-27T09:46:23.088 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_string.ko 2024-03-27T09:46:23.088 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_tcpmss.ko 2024-03-27T09:46:23.088 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_time.ko 2024-03-27T09:46:23.088 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_u32.ko 2024-03-27T09:46:23.089 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netlink 2024-03-27T09:46:23.089 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netlink/netlink_diag.ko 2024-03-27T09:46:23.089 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/nsh 2024-03-27T09:46:23.089 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/nsh/nsh.ko 2024-03-27T09:46:23.089 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch 2024-03-27T09:46:23.089 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/openvswitch.ko 2024-03-27T09:46:23.089 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/vport-geneve.ko 2024-03-27T09:46:23.089 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/vport-gre.ko 2024-03-27T09:46:23.089 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/vport-vxlan.ko 2024-03-27T09:46:23.089 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/packet 2024-03-27T09:46:23.089 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/packet/af_packet_diag.ko 2024-03-27T09:46:23.089 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds 2024-03-27T09:46:23.089 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds/rds.ko 2024-03-27T09:46:23.089 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds/rds_rdma.ko 2024-03-27T09:46:23.089 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds/rds_tcp.ko 2024-03-27T09:46:23.090 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched 2024-03-27T09:46:23.090 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_csum.ko 2024-03-27T09:46:23.090 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_gact.ko 2024-03-27T09:46:23.090 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_mirred.ko 2024-03-27T09:46:23.090 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_nat.ko 2024-03-27T09:46:23.090 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_pedit.ko 2024-03-27T09:46:23.090 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_police.ko 2024-03-27T09:46:23.090 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_simple.ko 2024-03-27T09:46:23.090 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_skbedit.ko 2024-03-27T09:46:23.090 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_vlan.ko 2024-03-27T09:46:23.090 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_basic.ko 2024-03-27T09:46:23.090 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_bpf.ko 2024-03-27T09:46:23.090 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_flow.ko 2024-03-27T09:46:23.090 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_fw.ko 2024-03-27T09:46:23.091 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_route.ko 2024-03-27T09:46:23.091 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_u32.ko 2024-03-27T09:46:23.091 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_cmp.ko 2024-03-27T09:46:23.091 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_ipset.ko 2024-03-27T09:46:23.091 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_meta.ko 2024-03-27T09:46:23.091 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_nbyte.ko 2024-03-27T09:46:23.091 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_text.ko 2024-03-27T09:46:23.091 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_u32.ko 2024-03-27T09:46:23.091 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_choke.ko 2024-03-27T09:46:23.091 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_codel.ko 2024-03-27T09:46:23.091 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_drr.ko 2024-03-27T09:46:23.091 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_fq.ko 2024-03-27T09:46:23.091 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_gred.ko 2024-03-27T09:46:23.091 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_hfsc.ko 2024-03-27T09:46:23.091 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_hhf.ko 2024-03-27T09:46:23.091 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_htb.ko 2024-03-27T09:46:23.092 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_ingress.ko 2024-03-27T09:46:23.092 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_mqprio.ko 2024-03-27T09:46:23.092 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_mqprio_lib.ko 2024-03-27T09:46:23.092 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_multiq.ko 2024-03-27T09:46:23.092 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_netem.ko 2024-03-27T09:46:23.092 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_pie.ko 2024-03-27T09:46:23.092 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_plug.ko 2024-03-27T09:46:23.092 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_prio.ko 2024-03-27T09:46:23.092 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_qfq.ko 2024-03-27T09:46:23.092 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_red.ko 2024-03-27T09:46:23.092 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_sfb.ko 2024-03-27T09:46:23.092 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_sfq.ko 2024-03-27T09:46:23.092 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_tbf.ko 2024-03-27T09:46:23.092 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_teql.ko 2024-03-27T09:46:23.092 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sctp 2024-03-27T09:46:23.093 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sctp/sctp.ko 2024-03-27T09:46:23.093 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sctp/sctp_diag.ko 2024-03-27T09:46:23.093 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc 2024-03-27T09:46:23.093 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/auth_gss 2024-03-27T09:46:23.093 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-03-27T09:46:23.093 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-03-27T09:46:23.093 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/sunrpc.ko 2024-03-27T09:46:23.093 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/xprtrdma 2024-03-27T09:46:23.093 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-03-27T09:46:23.093 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/tipc 2024-03-27T09:46:23.093 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/tipc/diag.ko 2024-03-27T09:46:23.093 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/tipc/tipc.ko 2024-03-27T09:46:23.093 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/unix 2024-03-27T09:46:23.093 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/unix/unix_diag.ko 2024-03-27T09:46:23.093 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock 2024-03-27T09:46:23.094 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-03-27T09:46:23.094 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-03-27T09:46:23.094 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vsock.ko 2024-03-27T09:46:23.094 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vsock_diag.ko 2024-03-27T09:46:23.094 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vsock_loopback.ko 2024-03-27T09:46:23.094 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/xfrm 2024-03-27T09:46:23.094 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/xfrm/xfrm_ipcomp.ko 2024-03-27T09:46:23.094 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security 2024-03-27T09:46:23.094 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys 2024-03-27T09:46:23.094 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/encrypted-keys 2024-03-27T09:46:23.094 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-03-27T09:46:23.094 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/trusted-keys 2024-03-27T09:46:23.094 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/trusted-keys/trusted.ko 2024-03-27T09:46:23.094 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/virt 2024-03-27T09:46:23.095 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/virt/lib 2024-03-27T09:46:23.095 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/virt/lib/irqbypass.ko 2024-03-27T09:46:23.095 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.alias 2024-03-27T09:46:23.095 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.alias.bin 2024-03-27T09:46:23.095 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin 2024-03-27T09:46:23.095 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin.alias.bin 2024-03-27T09:46:23.095 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin.bin 2024-03-27T09:46:23.095 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin.modinfo 2024-03-27T09:46:23.095 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.dep 2024-03-27T09:46:23.095 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.dep.bin 2024-03-27T09:46:23.095 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.devname 2024-03-27T09:46:23.095 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.order 2024-03-27T09:46:23.095 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.softdep 2024-03-27T09:46:23.095 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.symbols 2024-03-27T09:46:23.096 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.symbols.bin 2024-03-27T09:46:23.096 INFO:teuthology.orchestra.run.smithi118.stdout:/lib/modules/6.8.0-g1df0c7e8a235/vmlinuz 2024-03-27T09:46:23.100 DEBUG:teuthology.task.kernel:get_image_version: 6.8.0-g1df0c7e8a235 2024-03-27T09:46:23.100 DEBUG:teuthology.orchestra.run.smithi118:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-03-27T09:46:23.125 INFO:teuthology.orchestra.run.smithi118.stdout:postinstall scriptlet (using /bin/sh): 2024-03-27T09:46:23.125 INFO:teuthology.orchestra.run.smithi118.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-03-27T09:46:23.125 INFO:teuthology.orchestra.run.smithi118.stdout: /usr/bin/kernel-install add 6.8.0-g1df0c7e8a235 /lib/modules/6.8.0-g1df0c7e8a235/vmlinuz 2024-03-27T09:46:23.125 INFO:teuthology.orchestra.run.smithi118.stdout:fi 2024-03-27T09:46:23.125 INFO:teuthology.orchestra.run.smithi118.stdout:for file in vmlinuz System.map config; do 2024-03-27T09:46:23.125 INFO:teuthology.orchestra.run.smithi118.stdout: if ! cmp --silent "/lib/modules/6.8.0-g1df0c7e8a235/${file}" "/boot/${file}-6.8.0-g1df0c7e8a235"; then 2024-03-27T09:46:23.125 INFO:teuthology.orchestra.run.smithi118.stdout: cp "/lib/modules/6.8.0-g1df0c7e8a235/${file}" "/boot/${file}-6.8.0-g1df0c7e8a235" 2024-03-27T09:46:23.125 INFO:teuthology.orchestra.run.smithi118.stdout: fi 2024-03-27T09:46:23.125 INFO:teuthology.orchestra.run.smithi118.stdout:done 2024-03-27T09:46:23.125 INFO:teuthology.orchestra.run.smithi118.stdout:preuninstall scriptlet (using /bin/sh): 2024-03-27T09:46:23.126 INFO:teuthology.orchestra.run.smithi118.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2024-03-27T09:46:23.126 INFO:teuthology.orchestra.run.smithi118.stdout:new-kernel-pkg --remove 6.8.0-g1df0c7e8a235 --rminitrd --initrdfile=/boot/initramfs-6.8.0-g1df0c7e8a235.img 2024-03-27T09:46:23.126 INFO:teuthology.orchestra.run.smithi118.stdout:elif [ -x /usr/bin/kernel-install ]; then 2024-03-27T09:46:23.126 INFO:teuthology.orchestra.run.smithi118.stdout:kernel-install remove 6.8.0-g1df0c7e8a235 2024-03-27T09:46:23.126 INFO:teuthology.orchestra.run.smithi118.stdout:fi 2024-03-27T09:46:23.126 INFO:teuthology.orchestra.run.smithi118.stdout:postuninstall scriptlet (using /bin/sh): 2024-03-27T09:46:23.126 INFO:teuthology.orchestra.run.smithi118.stdout:if [ -x /sbin/update-bootloader ]; then 2024-03-27T09:46:23.126 INFO:teuthology.orchestra.run.smithi118.stdout:/sbin/update-bootloader --remove 6.8.0-g1df0c7e8a235 2024-03-27T09:46:23.126 INFO:teuthology.orchestra.run.smithi118.stdout:fi 2024-03-27T09:46:23.127 DEBUG:teuthology.orchestra.run.smithi118:> sudo rpm -qi grub2-tools 2024-03-27T09:46:23.204 INFO:teuthology.orchestra.run.smithi118.stdout:Name : grub2-tools 2024-03-27T09:46:23.204 INFO:teuthology.orchestra.run.smithi118.stdout:Epoch : 1 2024-03-27T09:46:23.204 INFO:teuthology.orchestra.run.smithi118.stdout:Version : 2.06 2024-03-27T09:46:23.204 INFO:teuthology.orchestra.run.smithi118.stdout:Release : 68.el9 2024-03-27T09:46:23.204 INFO:teuthology.orchestra.run.smithi118.stdout:Architecture: x86_64 2024-03-27T09:46:23.204 INFO:teuthology.orchestra.run.smithi118.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-03-27T09:46:23.204 INFO:teuthology.orchestra.run.smithi118.stdout:Group : Unspecified 2024-03-27T09:46:23.205 INFO:teuthology.orchestra.run.smithi118.stdout:Size : 8264254 2024-03-27T09:46:23.205 INFO:teuthology.orchestra.run.smithi118.stdout:License : GPLv3+ 2024-03-27T09:46:23.205 INFO:teuthology.orchestra.run.smithi118.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-03-27T09:46:23.205 INFO:teuthology.orchestra.run.smithi118.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-03-27T09:46:23.205 INFO:teuthology.orchestra.run.smithi118.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-03-27T09:46:23.205 INFO:teuthology.orchestra.run.smithi118.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-03-27T09:46:23.205 INFO:teuthology.orchestra.run.smithi118.stdout:Packager : builder@centos.org 2024-03-27T09:46:23.205 INFO:teuthology.orchestra.run.smithi118.stdout:Vendor : CentOS 2024-03-27T09:46:23.205 INFO:teuthology.orchestra.run.smithi118.stdout:URL : http://www.gnu.org/software/grub/ 2024-03-27T09:46:23.205 INFO:teuthology.orchestra.run.smithi118.stdout:Summary : Support tools for GRUB. 2024-03-27T09:46:23.205 INFO:teuthology.orchestra.run.smithi118.stdout:Description : 2024-03-27T09:46:23.205 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-27T09:46:23.205 INFO:teuthology.orchestra.run.smithi118.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-03-27T09:46:23.205 INFO:teuthology.orchestra.run.smithi118.stdout:customizable bootloader with modular architecture. It supports a rich 2024-03-27T09:46:23.205 INFO:teuthology.orchestra.run.smithi118.stdout:variety of kernel formats, file systems, computer architectures and 2024-03-27T09:46:23.206 INFO:teuthology.orchestra.run.smithi118.stdout:hardware devices. 2024-03-27T09:46:23.206 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-27T09:46:23.206 INFO:teuthology.orchestra.run.smithi118.stdout:This subpackage provides tools for support of all platforms. 2024-03-27T09:46:23.207 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-03-27T09:46:23.207 INFO:teuthology.task.kernel:Updating grub on smithi118 to boot 6.8.0-g1df0c7e8a235 2024-03-27T09:46:23.207 DEBUG:teuthology.orchestra.run.smithi118:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-03-27T09:46:23.770 INFO:teuthology.orchestra.run.smithi118.stderr:Generating grub configuration file ... 2024-03-27T09:46:25.256 INFO:teuthology.orchestra.run.smithi118.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-03-27T09:46:25.289 INFO:teuthology.orchestra.run.smithi118.stderr:done 2024-03-27T09:46:25.291 DEBUG:teuthology.orchestra.run.smithi118:> mktemp 2024-03-27T09:46:25.306 INFO:teuthology.orchestra.run.smithi118.stdout:/tmp/tmp.YagOkZD7bl 2024-03-27T09:46:25.307 DEBUG:teuthology.orchestra.run.smithi118:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.YagOkZD7bl 2024-03-27T09:46:25.380 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 0666 /tmp/tmp.YagOkZD7bl 2024-03-27T09:46:25.520 DEBUG:teuthology.orchestra.remote:smithi118:/tmp/tmp.YagOkZD7bl is 6KB 2024-03-27T09:46:25.570 DEBUG:teuthology.orchestra.run.smithi118:> rm -fr /tmp/tmp.YagOkZD7bl 2024-03-27T09:46:25.584 DEBUG:teuthology.orchestra.run.smithi118:> sudo /bin/ls /boot/loader/entries || true 2024-03-27T09:46:25.649 INFO:teuthology.orchestra.run.smithi118.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-03-27T09:46:25.649 INFO:teuthology.orchestra.run.smithi118.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-03-27T09:46:25.649 INFO:teuthology.orchestra.run.smithi118.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-03-27T09:46:25.649 INFO:teuthology.orchestra.run.smithi118.stdout:15949e3c88704300882482eddfd7baae-6.8.0-g1df0c7e8a235.conf 2024-03-27T09:46:25.650 DEBUG:teuthology.orchestra.run.smithi118:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.8.0-g1df0c7e8a235 2024-03-27T09:46:25.796 DEBUG:teuthology.orchestra.run.smithi118:> sudo shutdown -r now 2024-03-27T09:46:30.592 INFO:teuthology.orchestra.run.smithi057.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-03-27T09:46:53.678 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi057.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-03-27T09:46:53.679 DEBUG:teuthology.orchestra.run.smithi057:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-03-27T09:46:53.757 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235 2024-03-27T09:46:53.757 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/System.map 2024-03-27T09:46:53.757 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/config 2024-03-27T09:46:53.757 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel 2024-03-27T09:46:53.757 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch 2024-03-27T09:46:53.757 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86 2024-03-27T09:46:53.758 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto 2024-03-27T09:46:53.758 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-03-27T09:46:53.758 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-03-27T09:46:53.758 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-03-27T09:46:53.758 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-03-27T09:46:53.758 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-03-27T09:46:53.758 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-03-27T09:46:53.758 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-03-27T09:46:53.758 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/crc32c-intel.ko 2024-03-27T09:46:53.758 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-03-27T09:46:53.758 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-03-27T09:46:53.759 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-03-27T09:46:53.759 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-03-27T09:46:53.759 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/serpent-avx2.ko 2024-03-27T09:46:53.759 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-03-27T09:46:53.759 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-03-27T09:46:53.759 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-03-27T09:46:53.759 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-03-27T09:46:53.759 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-03-27T09:46:53.759 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-03-27T09:46:53.759 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-03-27T09:46:53.759 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel 2024-03-27T09:46:53.759 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel/cpu 2024-03-27T09:46:53.759 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel/cpu/mce 2024-03-27T09:46:53.759 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-03-27T09:46:53.760 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm 2024-03-27T09:46:53.760 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm/kvm-amd.ko 2024-03-27T09:46:53.760 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm/kvm-intel.ko 2024-03-27T09:46:53.760 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm/kvm.ko 2024-03-27T09:46:53.760 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto 2024-03-27T09:46:53.760 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/ansi_cprng.ko 2024-03-27T09:46:53.760 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/anubis.ko 2024-03-27T09:46:53.760 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/arc4.ko 2024-03-27T09:46:53.760 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx 2024-03-27T09:46:53.760 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_memcpy.ko 2024-03-27T09:46:53.760 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_pq.ko 2024-03-27T09:46:53.760 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_raid6_recov.ko 2024-03-27T09:46:53.760 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_tx.ko 2024-03-27T09:46:53.760 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_xor.ko 2024-03-27T09:46:53.761 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/raid6test.ko 2024-03-27T09:46:53.761 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/authenc.ko 2024-03-27T09:46:53.761 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/authencesn.ko 2024-03-27T09:46:53.761 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/blake2b_generic.ko 2024-03-27T09:46:53.761 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/blowfish_common.ko 2024-03-27T09:46:53.761 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/blowfish_generic.ko 2024-03-27T09:46:53.761 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/camellia_generic.ko 2024-03-27T09:46:53.761 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cast5_generic.ko 2024-03-27T09:46:53.761 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cast6_generic.ko 2024-03-27T09:46:53.761 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cast_common.ko 2024-03-27T09:46:53.761 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/ccm.ko 2024-03-27T09:46:53.761 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cmac.ko 2024-03-27T09:46:53.761 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/crc32_generic.ko 2024-03-27T09:46:53.761 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/crypto_engine.ko 2024-03-27T09:46:53.762 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/crypto_user.ko 2024-03-27T09:46:53.762 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cts.ko 2024-03-27T09:46:53.762 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/des_generic.ko 2024-03-27T09:46:53.762 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/dh_generic.ko 2024-03-27T09:46:53.762 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/echainiv.ko 2024-03-27T09:46:53.762 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/essiv.ko 2024-03-27T09:46:53.762 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/fcrypt.ko 2024-03-27T09:46:53.762 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/khazad.ko 2024-03-27T09:46:53.762 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/lz4.ko 2024-03-27T09:46:53.762 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/lz4hc.ko 2024-03-27T09:46:53.762 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/md4.ko 2024-03-27T09:46:53.762 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/michael_mic.ko 2024-03-27T09:46:53.762 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/pcbc.ko 2024-03-27T09:46:53.763 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/pcrypt.ko 2024-03-27T09:46:53.763 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/rmd160.ko 2024-03-27T09:46:53.763 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/seed.ko 2024-03-27T09:46:53.763 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/serpent_generic.ko 2024-03-27T09:46:53.763 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/tcrypt.ko 2024-03-27T09:46:53.763 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/tea.ko 2024-03-27T09:46:53.763 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/twofish_common.ko 2024-03-27T09:46:53.763 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/twofish_generic.ko 2024-03-27T09:46:53.763 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/vmac.ko 2024-03-27T09:46:53.763 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/wp512.ko 2024-03-27T09:46:53.763 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/xcbc.ko 2024-03-27T09:46:53.763 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/xor.ko 2024-03-27T09:46:53.763 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/xxhash_generic.ko 2024-03-27T09:46:53.763 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers 2024-03-27T09:46:53.764 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi 2024-03-27T09:46:53.764 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/acpi_ipmi.ko 2024-03-27T09:46:53.764 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/acpi_pad.ko 2024-03-27T09:46:53.764 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/custom_method.ko 2024-03-27T09:46:53.764 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/ec_sys.ko 2024-03-27T09:46:53.764 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/platform_profile.ko 2024-03-27T09:46:53.764 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/sbs.ko 2024-03-27T09:46:53.764 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/sbshc.ko 2024-03-27T09:46:53.764 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/video.ko 2024-03-27T09:46:53.764 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata 2024-03-27T09:46:53.764 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/acard-ahci.ko 2024-03-27T09:46:53.764 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/ahci_platform.ko 2024-03-27T09:46:53.764 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/ata_generic.ko 2024-03-27T09:46:53.764 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/libahci_platform.ko 2024-03-27T09:46:53.765 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_acpi.ko 2024-03-27T09:46:53.765 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ali.ko 2024-03-27T09:46:53.765 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_amd.ko 2024-03-27T09:46:53.765 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_artop.ko 2024-03-27T09:46:53.765 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_atiixp.ko 2024-03-27T09:46:53.765 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_atp867x.ko 2024-03-27T09:46:53.765 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_cmd640.ko 2024-03-27T09:46:53.765 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_cmd64x.ko 2024-03-27T09:46:53.766 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_cypress.ko 2024-03-27T09:46:53.766 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_efar.ko 2024-03-27T09:46:53.766 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt366.ko 2024-03-27T09:46:53.766 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt37x.ko 2024-03-27T09:46:53.766 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt3x2n.ko 2024-03-27T09:46:53.766 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt3x3.ko 2024-03-27T09:46:53.766 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_it8213.ko 2024-03-27T09:46:53.766 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_it821x.ko 2024-03-27T09:46:53.766 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_jmicron.ko 2024-03-27T09:46:53.766 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_marvell.ko 2024-03-27T09:46:53.766 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_mpiix.ko 2024-03-27T09:46:53.766 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_netcell.ko 2024-03-27T09:46:53.766 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ninja32.ko 2024-03-27T09:46:53.766 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ns87410.ko 2024-03-27T09:46:53.767 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ns87415.ko 2024-03-27T09:46:53.767 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_oldpiix.ko 2024-03-27T09:46:53.767 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_opti.ko 2024-03-27T09:46:53.767 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_optidma.ko 2024-03-27T09:46:53.767 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_pcmcia.ko 2024-03-27T09:46:53.767 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_pdc2027x.ko 2024-03-27T09:46:53.767 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-03-27T09:46:53.767 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_piccolo.ko 2024-03-27T09:46:53.767 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_rdc.ko 2024-03-27T09:46:53.767 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sch.ko 2024-03-27T09:46:53.767 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_serverworks.ko 2024-03-27T09:46:53.767 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sil680.ko 2024-03-27T09:46:53.767 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sis.ko 2024-03-27T09:46:53.767 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sl82c105.ko 2024-03-27T09:46:53.768 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_triflex.ko 2024-03-27T09:46:53.768 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_via.ko 2024-03-27T09:46:53.768 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pdc_adma.ko 2024-03-27T09:46:53.768 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_inic162x.ko 2024-03-27T09:46:53.768 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_mv.ko 2024-03-27T09:46:53.768 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_nv.ko 2024-03-27T09:46:53.768 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_promise.ko 2024-03-27T09:46:53.768 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_qstor.ko 2024-03-27T09:46:53.768 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sil.ko 2024-03-27T09:46:53.768 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sil24.ko 2024-03-27T09:46:53.768 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sis.ko 2024-03-27T09:46:53.768 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_svw.ko 2024-03-27T09:46:53.768 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sx4.ko 2024-03-27T09:46:53.768 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_uli.ko 2024-03-27T09:46:53.768 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_via.ko 2024-03-27T09:46:53.769 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_vsc.ko 2024-03-27T09:46:53.769 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/auxdisplay 2024-03-27T09:46:53.769 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/auxdisplay/ks0108.ko 2024-03-27T09:46:53.769 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base 2024-03-27T09:46:53.769 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base/regmap 2024-03-27T09:46:53.769 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base/regmap/regmap-i2c.ko 2024-03-27T09:46:53.769 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base/regmap/regmap-mmio.ko 2024-03-27T09:46:53.769 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/bcma 2024-03-27T09:46:53.769 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/bcma/bcma.ko 2024-03-27T09:46:53.769 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block 2024-03-27T09:46:53.769 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/aoe 2024-03-27T09:46:53.769 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/aoe/aoe.ko 2024-03-27T09:46:53.770 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/brd.ko 2024-03-27T09:46:53.770 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/drbd 2024-03-27T09:46:53.770 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/drbd/drbd.ko 2024-03-27T09:46:53.770 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/floppy.ko 2024-03-27T09:46:53.770 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/loop.ko 2024-03-27T09:46:53.770 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/mtip32xx 2024-03-27T09:46:53.770 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-03-27T09:46:53.770 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/nbd.ko 2024-03-27T09:46:53.770 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/null_blk 2024-03-27T09:46:53.770 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/null_blk/null_blk.ko 2024-03-27T09:46:53.770 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/pktcdvd.ko 2024-03-27T09:46:53.770 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/rbd.ko 2024-03-27T09:46:53.770 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/virtio_blk.ko 2024-03-27T09:46:53.770 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/xen-blkback 2024-03-27T09:46:53.771 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-03-27T09:46:53.771 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/xen-blkfront.ko 2024-03-27T09:46:53.771 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/zram 2024-03-27T09:46:53.771 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/zram/zram.ko 2024-03-27T09:46:53.771 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char 2024-03-27T09:46:53.771 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hangcheck-timer.ko 2024-03-27T09:46:53.771 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random 2024-03-27T09:46:53.772 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/amd-rng.ko 2024-03-27T09:46:53.772 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/intel-rng.ko 2024-03-27T09:46:53.772 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-03-27T09:46:53.772 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/via-rng.ko 2024-03-27T09:46:53.772 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/virtio-rng.ko 2024-03-27T09:46:53.772 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi 2024-03-27T09:46:53.772 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-03-27T09:46:53.772 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-03-27T09:46:53.772 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-03-27T09:46:53.772 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_si.ko 2024-03-27T09:46:53.772 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-03-27T09:46:53.773 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-03-27T09:46:53.773 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/lp.ko 2024-03-27T09:46:53.773 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/mwave 2024-03-27T09:46:53.773 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/mwave/mwave.ko 2024-03-27T09:46:53.773 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ppdev.ko 2024-03-27T09:46:53.773 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tlclk.ko 2024-03-27T09:46:53.773 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm 2024-03-27T09:46:53.773 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm.ko 2024-03-27T09:46:53.773 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_atmel.ko 2024-03-27T09:46:53.773 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_infineon.ko 2024-03-27T09:46:53.773 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_nsc.ko 2024-03-27T09:46:53.773 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_tis.ko 2024-03-27T09:46:53.773 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-03-27T09:46:53.773 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/uv_mmtimer.ko 2024-03-27T09:46:53.774 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/virtio_console.ko 2024-03-27T09:46:53.774 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq 2024-03-27T09:46:53.774 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-03-27T09:46:53.774 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-03-27T09:46:53.774 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/p4-clockmod.ko 2024-03-27T09:46:53.774 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-03-27T09:46:53.774 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/powernow-k8.ko 2024-03-27T09:46:53.774 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/speedstep-lib.ko 2024-03-27T09:46:53.774 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto 2024-03-27T09:46:53.774 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/ccp 2024-03-27T09:46:53.774 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-03-27T09:46:53.774 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/ccp/ccp.ko 2024-03-27T09:46:53.774 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel 2024-03-27T09:46:53.774 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat 2024-03-27T09:46:53.775 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_common 2024-03-27T09:46:53.775 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-03-27T09:46:53.775 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-03-27T09:46:53.775 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-03-27T09:46:53.775 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/padlock-aes.ko 2024-03-27T09:46:53.775 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/padlock-sha.ko 2024-03-27T09:46:53.775 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/virtio 2024-03-27T09:46:53.775 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-03-27T09:46:53.775 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dca 2024-03-27T09:46:53.775 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dca/dca.ko 2024-03-27T09:46:53.775 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/devfreq 2024-03-27T09:46:53.775 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-03-27T09:46:53.775 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma 2024-03-27T09:46:53.776 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/dw 2024-03-27T09:46:53.776 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/dw/dw_dmac.ko 2024-03-27T09:46:53.776 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/ioat 2024-03-27T09:46:53.776 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/ioat/ioatdma.ko 2024-03-27T09:46:53.776 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac 2024-03-27T09:46:53.776 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/amd64_edac.ko 2024-03-27T09:46:53.776 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/e752x_edac.ko 2024-03-27T09:46:53.776 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/edac_mce_amd.ko 2024-03-27T09:46:53.776 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i3000_edac.ko 2024-03-27T09:46:53.776 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i3200_edac.ko 2024-03-27T09:46:53.776 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i5100_edac.ko 2024-03-27T09:46:53.777 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i5400_edac.ko 2024-03-27T09:46:53.777 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i7300_edac.ko 2024-03-27T09:46:53.777 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i7core_edac.ko 2024-03-27T09:46:53.777 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i82975x_edac.ko 2024-03-27T09:46:53.777 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/ie31200_edac.ko 2024-03-27T09:46:53.777 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/sb_edac.ko 2024-03-27T09:46:53.777 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/x38_edac.ko 2024-03-27T09:46:53.777 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/firmware 2024-03-27T09:46:53.777 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/firmware/edd.ko 2024-03-27T09:46:53.777 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/firmware/iscsi_ibft.ko 2024-03-27T09:46:53.777 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio 2024-03-27T09:46:53.777 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-ich.ko 2024-03-27T09:46:53.777 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-viperboard.ko 2024-03-27T09:46:53.778 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid 2024-03-27T09:46:53.778 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-appleir.ko 2024-03-27T09:46:53.778 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-aureal.ko 2024-03-27T09:46:53.778 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-axff.ko 2024-03-27T09:46:53.778 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-dr.ko 2024-03-27T09:46:53.778 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-elecom.ko 2024-03-27T09:46:53.778 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-elo.ko 2024-03-27T09:46:53.778 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-emsff.ko 2024-03-27T09:46:53.778 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-gaff.ko 2024-03-27T09:46:53.778 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-gt683r.ko 2024-03-27T09:46:53.778 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-gyration.ko 2024-03-27T09:46:53.778 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-holtek-kbd.ko 2024-03-27T09:46:53.778 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-holtek-mouse.ko 2024-03-27T09:46:53.779 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-holtekff.ko 2024-03-27T09:46:53.779 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-hyperv.ko 2024-03-27T09:46:53.779 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-icade.ko 2024-03-27T09:46:53.779 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-keytouch.ko 2024-03-27T09:46:53.779 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-kye.ko 2024-03-27T09:46:53.779 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-lcpower.ko 2024-03-27T09:46:53.779 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-led.ko 2024-03-27T09:46:53.779 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-lenovo.ko 2024-03-27T09:46:53.779 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-logitech-dj.ko 2024-03-27T09:46:53.779 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-03-27T09:46:53.779 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-multitouch.ko 2024-03-27T09:46:53.779 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-ortek.ko 2024-03-27T09:46:53.779 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-penmount.ko 2024-03-27T09:46:53.779 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-petalynx.ko 2024-03-27T09:46:53.779 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-picolcd.ko 2024-03-27T09:46:53.780 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-pl.ko 2024-03-27T09:46:53.780 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-plantronics.ko 2024-03-27T09:46:53.780 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-primax.ko 2024-03-27T09:46:53.780 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-rmi.ko 2024-03-27T09:46:53.780 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-arvo.ko 2024-03-27T09:46:53.780 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-common.ko 2024-03-27T09:46:53.780 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-isku.ko 2024-03-27T09:46:53.780 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-kone.ko 2024-03-27T09:46:53.780 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-03-27T09:46:53.780 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-konepure.ko 2024-03-27T09:46:53.780 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-03-27T09:46:53.780 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-lua.ko 2024-03-27T09:46:53.780 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-pyra.ko 2024-03-27T09:46:53.781 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-ryos.ko 2024-03-27T09:46:53.781 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-savu.ko 2024-03-27T09:46:53.781 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat.ko 2024-03-27T09:46:53.781 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-saitek.ko 2024-03-27T09:46:53.781 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-samsung.ko 2024-03-27T09:46:53.781 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sensor-hub.ko 2024-03-27T09:46:53.781 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sjoy.ko 2024-03-27T09:46:53.781 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sony.ko 2024-03-27T09:46:53.781 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-speedlink.ko 2024-03-27T09:46:53.782 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-steelseries.ko 2024-03-27T09:46:53.782 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sunplus.ko 2024-03-27T09:46:53.782 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-thrustmaster.ko 2024-03-27T09:46:53.782 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-tivo.ko 2024-03-27T09:46:53.782 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-tmff.ko 2024-03-27T09:46:53.782 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-topseed.ko 2024-03-27T09:46:53.782 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-twinhan.ko 2024-03-27T09:46:53.782 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-uclogic.ko 2024-03-27T09:46:53.782 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-waltop.ko 2024-03-27T09:46:53.782 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-wiimote.ko 2024-03-27T09:46:53.782 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-xinmo.ko 2024-03-27T09:46:53.782 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-zpff.ko 2024-03-27T09:46:53.782 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-zydacron.ko 2024-03-27T09:46:53.783 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/uhid.ko 2024-03-27T09:46:53.783 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/wacom.ko 2024-03-27T09:46:53.783 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv 2024-03-27T09:46:53.783 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv/hv_balloon.ko 2024-03-27T09:46:53.783 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv/hv_utils.ko 2024-03-27T09:46:53.783 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv/hv_vmbus.ko 2024-03-27T09:46:53.783 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon 2024-03-27T09:46:53.783 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/abituguru.ko 2024-03-27T09:46:53.783 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/abituguru3.ko 2024-03-27T09:46:53.783 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/acpi_power_meter.ko 2024-03-27T09:46:53.783 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ad7414.ko 2024-03-27T09:46:53.783 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ad7418.ko 2024-03-27T09:46:53.783 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adc128d818.ko 2024-03-27T09:46:53.783 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1025.ko 2024-03-27T09:46:53.784 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1026.ko 2024-03-27T09:46:53.784 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1029.ko 2024-03-27T09:46:53.784 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1031.ko 2024-03-27T09:46:53.784 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm9240.ko 2024-03-27T09:46:53.784 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ads7828.ko 2024-03-27T09:46:53.784 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7410.ko 2024-03-27T09:46:53.784 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7411.ko 2024-03-27T09:46:53.784 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7462.ko 2024-03-27T09:46:53.784 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7470.ko 2024-03-27T09:46:53.784 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7475.ko 2024-03-27T09:46:53.784 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7x10.ko 2024-03-27T09:46:53.784 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/amc6821.ko 2024-03-27T09:46:53.784 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/applesmc.ko 2024-03-27T09:46:53.785 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/asb100.ko 2024-03-27T09:46:53.785 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/asc7621.ko 2024-03-27T09:46:53.785 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/asus_atk0110.ko 2024-03-27T09:46:53.785 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/atxp1.ko 2024-03-27T09:46:53.785 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/coretemp.ko 2024-03-27T09:46:53.785 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-03-27T09:46:53.785 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/dme1737.ko 2024-03-27T09:46:53.785 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ds1621.ko 2024-03-27T09:46:53.785 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ds620.ko 2024-03-27T09:46:53.785 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/emc1403.ko 2024-03-27T09:46:53.786 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/emc6w201.ko 2024-03-27T09:46:53.786 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/f71805f.ko 2024-03-27T09:46:53.786 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/f71882fg.ko 2024-03-27T09:46:53.786 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/f75375s.ko 2024-03-27T09:46:53.786 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/fam15h_power.ko 2024-03-27T09:46:53.786 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/fschmd.ko 2024-03-27T09:46:53.786 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/g760a.ko 2024-03-27T09:46:53.787 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/g762.ko 2024-03-27T09:46:53.787 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/gl518sm.ko 2024-03-27T09:46:53.787 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/gl520sm.ko 2024-03-27T09:46:53.787 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/hwmon-vid.ko 2024-03-27T09:46:53.787 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/i5500_temp.ko 2024-03-27T09:46:53.787 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/i5k_amb.ko 2024-03-27T09:46:53.787 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ibmaem.ko 2024-03-27T09:46:53.787 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ibmpex.ko 2024-03-27T09:46:53.787 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ina209.ko 2024-03-27T09:46:53.787 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ina2xx.ko 2024-03-27T09:46:53.787 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/it87.ko 2024-03-27T09:46:53.787 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/k10temp.ko 2024-03-27T09:46:53.787 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/k8temp.ko 2024-03-27T09:46:53.788 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lineage-pem.ko 2024-03-27T09:46:53.788 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm63.ko 2024-03-27T09:46:53.788 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm73.ko 2024-03-27T09:46:53.788 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm75.ko 2024-03-27T09:46:53.788 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm77.ko 2024-03-27T09:46:53.788 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm78.ko 2024-03-27T09:46:53.788 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm80.ko 2024-03-27T09:46:53.788 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm83.ko 2024-03-27T09:46:53.788 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm85.ko 2024-03-27T09:46:53.788 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm87.ko 2024-03-27T09:46:53.788 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm90.ko 2024-03-27T09:46:53.788 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm92.ko 2024-03-27T09:46:53.788 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm93.ko 2024-03-27T09:46:53.788 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm95234.ko 2024-03-27T09:46:53.789 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm95241.ko 2024-03-27T09:46:53.789 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm95245.ko 2024-03-27T09:46:53.789 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc2945.ko 2024-03-27T09:46:53.789 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4151.ko 2024-03-27T09:46:53.789 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4215.ko 2024-03-27T09:46:53.789 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4222.ko 2024-03-27T09:46:53.789 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4245.ko 2024-03-27T09:46:53.789 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4260.ko 2024-03-27T09:46:53.789 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4261.ko 2024-03-27T09:46:53.789 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max16065.ko 2024-03-27T09:46:53.789 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max1619.ko 2024-03-27T09:46:53.789 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max1668.ko 2024-03-27T09:46:53.789 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max197.ko 2024-03-27T09:46:53.789 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max6639.ko 2024-03-27T09:46:53.789 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max6650.ko 2024-03-27T09:46:53.790 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max6697.ko 2024-03-27T09:46:53.790 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/mcp3021.ko 2024-03-27T09:46:53.790 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct6683.ko 2024-03-27T09:46:53.790 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct6775-core.ko 2024-03-27T09:46:53.790 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct6775.ko 2024-03-27T09:46:53.790 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct7802.ko 2024-03-27T09:46:53.790 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pc87360.ko 2024-03-27T09:46:53.790 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pc87427.ko 2024-03-27T09:46:53.790 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pcf8591.ko 2024-03-27T09:46:53.790 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus 2024-03-27T09:46:53.790 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-03-27T09:46:53.790 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-03-27T09:46:53.790 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-03-27T09:46:53.791 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/max16064.ko 2024-03-27T09:46:53.791 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/max34440.ko 2024-03-27T09:46:53.791 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/max8688.ko 2024-03-27T09:46:53.791 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-03-27T09:46:53.791 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-03-27T09:46:53.791 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-03-27T09:46:53.791 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-03-27T09:46:53.791 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-03-27T09:46:53.791 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-03-27T09:46:53.791 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/powr1220.ko 2024-03-27T09:46:53.791 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sch5627.ko 2024-03-27T09:46:53.791 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sch5636.ko 2024-03-27T09:46:53.791 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sch56xx-common.ko 2024-03-27T09:46:53.792 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sht15.ko 2024-03-27T09:46:53.792 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sht21.ko 2024-03-27T09:46:53.792 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/shtc1.ko 2024-03-27T09:46:53.792 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sis5595.ko 2024-03-27T09:46:53.792 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/smsc47b397.ko 2024-03-27T09:46:53.792 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/smsc47m1.ko 2024-03-27T09:46:53.792 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/smsc47m192.ko 2024-03-27T09:46:53.792 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/thmc50.ko 2024-03-27T09:46:53.792 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp102.ko 2024-03-27T09:46:53.792 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp103.ko 2024-03-27T09:46:53.792 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp401.ko 2024-03-27T09:46:53.792 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp421.ko 2024-03-27T09:46:53.792 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/via-cputemp.ko 2024-03-27T09:46:53.792 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/via686a.ko 2024-03-27T09:46:53.793 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/vt1211.ko 2024-03-27T09:46:53.793 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/vt8231.ko 2024-03-27T09:46:53.793 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83627ehf.ko 2024-03-27T09:46:53.793 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83627hf.ko 2024-03-27T09:46:53.793 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83781d.ko 2024-03-27T09:46:53.793 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83791d.ko 2024-03-27T09:46:53.793 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83792d.ko 2024-03-27T09:46:53.793 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83793.ko 2024-03-27T09:46:53.793 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83795.ko 2024-03-27T09:46:53.793 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83l785ts.ko 2024-03-27T09:46:53.793 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83l786ng.ko 2024-03-27T09:46:53.793 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c 2024-03-27T09:46:53.793 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/algos 2024-03-27T09:46:53.793 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-03-27T09:46:53.794 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-03-27T09:46:53.794 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses 2024-03-27T09:46:53.794 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-03-27T09:46:53.794 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-03-27T09:46:53.794 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-03-27T09:46:53.794 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-03-27T09:46:53.794 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-03-27T09:46:53.794 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-03-27T09:46:53.794 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-03-27T09:46:53.794 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-03-27T09:46:53.794 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-i801.ko 2024-03-27T09:46:53.794 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-isch.ko 2024-03-27T09:46:53.794 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-03-27T09:46:53.794 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-03-27T09:46:53.795 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-03-27T09:46:53.795 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-parport.ko 2024-03-27T09:46:53.795 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-03-27T09:46:53.795 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-03-27T09:46:53.795 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-03-27T09:46:53.795 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-03-27T09:46:53.795 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-03-27T09:46:53.795 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-03-27T09:46:53.795 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-via.ko 2024-03-27T09:46:53.795 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-03-27T09:46:53.795 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-03-27T09:46:53.795 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-dev.ko 2024-03-27T09:46:53.795 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-mux.ko 2024-03-27T09:46:53.795 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-03-27T09:46:53.796 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-smbus.ko 2024-03-27T09:46:53.796 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-stub.ko 2024-03-27T09:46:53.796 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband 2024-03-27T09:46:53.796 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core 2024-03-27T09:46:53.796 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_cm.ko 2024-03-27T09:46:53.796 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_core.ko 2024-03-27T09:46:53.796 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_umad.ko 2024-03-27T09:46:53.796 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-03-27T09:46:53.796 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/iw_cm.ko 2024-03-27T09:46:53.796 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/rdma_cm.ko 2024-03-27T09:46:53.796 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-03-27T09:46:53.796 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw 2024-03-27T09:46:53.796 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/cxgb4 2024-03-27T09:46:53.796 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-03-27T09:46:53.797 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx4 2024-03-27T09:46:53.797 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-03-27T09:46:53.797 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx5 2024-03-27T09:46:53.797 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-03-27T09:46:53.797 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mthca 2024-03-27T09:46:53.797 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-03-27T09:46:53.797 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp 2024-03-27T09:46:53.797 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/ipoib 2024-03-27T09:46:53.797 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-03-27T09:46:53.797 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/iser 2024-03-27T09:46:53.798 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-03-27T09:46:53.798 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/isert 2024-03-27T09:46:53.798 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-03-27T09:46:53.798 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srp 2024-03-27T09:46:53.798 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-03-27T09:46:53.798 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srpt 2024-03-27T09:46:53.798 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-03-27T09:46:53.798 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input 2024-03-27T09:46:53.798 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport 2024-03-27T09:46:53.798 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-03-27T09:46:53.798 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport/fm801-gp.ko 2024-03-27T09:46:53.798 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport/gameport.ko 2024-03-27T09:46:53.798 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/joydev.ko 2024-03-27T09:46:53.799 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard 2024-03-27T09:46:53.799 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard/gpio_keys.ko 2024-03-27T09:46:53.799 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse 2024-03-27T09:46:53.799 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/appletouch.ko 2024-03-27T09:46:53.799 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/bcm5974.ko 2024-03-27T09:46:53.799 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/cyapatp.ko 2024-03-27T09:46:53.799 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/elan_i2c.ko 2024-03-27T09:46:53.799 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/sermouse.ko 2024-03-27T09:46:53.799 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-03-27T09:46:53.799 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/synaptics_usb.ko 2024-03-27T09:46:53.799 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/vsxxxaa.ko 2024-03-27T09:46:53.799 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/rmi4 2024-03-27T09:46:53.800 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/rmi4/rmi_core.ko 2024-03-27T09:46:53.800 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio 2024-03-27T09:46:53.800 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/altera_ps2.ko 2024-03-27T09:46:53.800 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/arc_ps2.ko 2024-03-27T09:46:53.800 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-03-27T09:46:53.800 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/serio_raw.ko 2024-03-27T09:46:53.800 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/sparse-keymap.ko 2024-03-27T09:46:53.800 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds 2024-03-27T09:46:53.800 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-blinkm.ko 2024-03-27T09:46:53.800 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-lm3530.ko 2024-03-27T09:46:53.800 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-lp3944.ko 2024-03-27T09:46:53.800 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-ss4200.ko 2024-03-27T09:46:53.800 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger 2024-03-27T09:46:53.800 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-03-27T09:46:53.800 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-03-27T09:46:53.801 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-03-27T09:46:53.801 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-03-27T09:46:53.801 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-03-27T09:46:53.801 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-03-27T09:46:53.801 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-03-27T09:46:53.801 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-03-27T09:46:53.801 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-03-27T09:46:53.801 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md 2024-03-27T09:46:53.801 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/bcache 2024-03-27T09:46:53.801 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/bcache/bcache.ko 2024-03-27T09:46:53.801 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-bio-prison.ko 2024-03-27T09:46:53.801 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-cache-smq.ko 2024-03-27T09:46:53.801 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-cache.ko 2024-03-27T09:46:53.801 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-crypt.ko 2024-03-27T09:46:53.802 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-delay.ko 2024-03-27T09:46:53.802 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-flakey.ko 2024-03-27T09:46:53.802 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-log-userspace.ko 2024-03-27T09:46:53.802 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-multipath.ko 2024-03-27T09:46:53.802 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-queue-length.ko 2024-03-27T09:46:53.802 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-raid.ko 2024-03-27T09:46:53.802 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-round-robin.ko 2024-03-27T09:46:53.802 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-service-time.ko 2024-03-27T09:46:53.802 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-switch.ko 2024-03-27T09:46:53.802 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-thin-pool.ko 2024-03-27T09:46:53.802 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-verity.ko 2024-03-27T09:46:53.802 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/persistent-data 2024-03-27T09:46:53.802 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-03-27T09:46:53.803 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid0.ko 2024-03-27T09:46:53.803 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid1.ko 2024-03-27T09:46:53.803 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid10.ko 2024-03-27T09:46:53.803 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid456.ko 2024-03-27T09:46:53.803 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message 2024-03-27T09:46:53.803 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion 2024-03-27T09:46:53.803 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptbase.ko 2024-03-27T09:46:53.803 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptctl.ko 2024-03-27T09:46:53.803 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptfc.ko 2024-03-27T09:46:53.803 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptlan.ko 2024-03-27T09:46:53.803 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptsas.ko 2024-03-27T09:46:53.803 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptscsih.ko 2024-03-27T09:46:53.803 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptspi.ko 2024-03-27T09:46:53.803 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd 2024-03-27T09:46:53.803 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/lpc_ich.ko 2024-03-27T09:46:53.804 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/lpc_sch.ko 2024-03-27T09:46:53.804 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/mfd-core.ko 2024-03-27T09:46:53.804 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/sm501.ko 2024-03-27T09:46:53.804 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/viperboard.ko 2024-03-27T09:46:53.804 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/vx855.ko 2024-03-27T09:46:53.804 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/wl1273-core.ko 2024-03-27T09:46:53.804 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc 2024-03-27T09:46:53.804 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/altera-stapl 2024-03-27T09:46:53.804 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-03-27T09:46:53.804 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/apds9802als.ko 2024-03-27T09:46:53.804 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/apds990x.ko 2024-03-27T09:46:53.804 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/bh1770glc.ko 2024-03-27T09:46:53.804 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/cb710 2024-03-27T09:46:53.804 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/cb710/cb710.ko 2024-03-27T09:46:53.805 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom 2024-03-27T09:46:53.805 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom/at24.ko 2024-03-27T09:46:53.805 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-03-27T09:46:53.805 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom/max6875.ko 2024-03-27T09:46:53.805 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/enclosure.ko 2024-03-27T09:46:53.805 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/hpilo.ko 2024-03-27T09:46:53.805 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/isl29003.ko 2024-03-27T09:46:53.805 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/isl29020.ko 2024-03-27T09:46:53.805 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/lis3lv02d 2024-03-27T09:46:53.805 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-03-27T09:46:53.805 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-03-27T09:46:53.805 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei 2024-03-27T09:46:53.805 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei/mei-me.ko 2024-03-27T09:46:53.805 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei/mei-txe.ko 2024-03-27T09:46:53.806 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei/mei.ko 2024-03-27T09:46:53.806 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-gru 2024-03-27T09:46:53.806 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-gru/gru.ko 2024-03-27T09:46:53.806 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp 2024-03-27T09:46:53.806 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp/xp.ko 2024-03-27T09:46:53.806 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp/xpc.ko 2024-03-27T09:46:53.806 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-03-27T09:46:53.806 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/tifm_7xx1.ko 2024-03-27T09:46:53.806 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/tifm_core.ko 2024-03-27T09:46:53.806 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/tsl2550.ko 2024-03-27T09:46:53.807 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/vmw_balloon.ko 2024-03-27T09:46:53.807 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/vmw_vmci 2024-03-27T09:46:53.807 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-03-27T09:46:53.807 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net 2024-03-27T09:46:53.807 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/bonding 2024-03-27T09:46:53.807 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/bonding/bonding.ko 2024-03-27T09:46:53.808 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa 2024-03-27T09:46:53.808 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/b53 2024-03-27T09:46:53.808 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/b53/b53_common.ko 2024-03-27T09:46:53.808 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/bcm-sf2.ko 2024-03-27T09:46:53.808 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/mv88e6060.ko 2024-03-27T09:46:53.808 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/mv88e6xxx 2024-03-27T09:46:53.809 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-03-27T09:46:53.809 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dummy.ko 2024-03-27T09:46:53.809 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/eql.ko 2024-03-27T09:46:53.809 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet 2024-03-27T09:46:53.809 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com 2024-03-27T09:46:53.809 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-03-27T09:46:53.810 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-03-27T09:46:53.810 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-03-27T09:46:53.810 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-03-27T09:46:53.810 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390 2024-03-27T09:46:53.810 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/8390.ko 2024-03-27T09:46:53.810 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-03-27T09:46:53.811 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-03-27T09:46:53.811 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-03-27T09:46:53.811 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/adaptec 2024-03-27T09:46:53.811 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-03-27T09:46:53.811 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/agere 2024-03-27T09:46:53.811 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/agere/et131x.ko 2024-03-27T09:46:53.812 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/alteon 2024-03-27T09:46:53.812 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-03-27T09:46:53.812 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/altera 2024-03-27T09:46:53.812 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-03-27T09:46:53.812 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd 2024-03-27T09:46:53.812 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-03-27T09:46:53.813 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-03-27T09:46:53.813 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-03-27T09:46:53.813 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros 2024-03-27T09:46:53.813 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/alx 2024-03-27T09:46:53.813 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-03-27T09:46:53.813 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1c 2024-03-27T09:46:53.814 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-03-27T09:46:53.814 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1e 2024-03-27T09:46:53.814 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-03-27T09:46:53.814 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atlx 2024-03-27T09:46:53.814 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-03-27T09:46:53.815 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-03-27T09:46:53.815 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom 2024-03-27T09:46:53.815 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-03-27T09:46:53.815 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-03-27T09:46:53.815 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-03-27T09:46:53.815 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-03-27T09:46:53.816 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-03-27T09:46:53.816 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/genet 2024-03-27T09:46:53.816 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-03-27T09:46:53.816 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-03-27T09:46:53.816 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/brocade 2024-03-27T09:46:53.816 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/brocade/bna 2024-03-27T09:46:53.816 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-03-27T09:46:53.817 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio 2024-03-27T09:46:53.817 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb 2024-03-27T09:46:53.817 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-03-27T09:46:53.817 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-03-27T09:46:53.817 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-03-27T09:46:53.817 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-03-27T09:46:53.817 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-03-27T09:46:53.817 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-03-27T09:46:53.817 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-03-27T09:46:53.818 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-03-27T09:46:53.818 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-03-27T09:46:53.818 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/cisco 2024-03-27T09:46:53.818 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/cisco/enic 2024-03-27T09:46:53.818 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-03-27T09:46:53.818 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec 2024-03-27T09:46:53.818 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip 2024-03-27T09:46:53.818 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-03-27T09:46:53.818 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-03-27T09:46:53.818 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-03-27T09:46:53.818 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-03-27T09:46:53.818 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-03-27T09:46:53.818 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-03-27T09:46:53.818 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dlink 2024-03-27T09:46:53.819 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-03-27T09:46:53.819 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-03-27T09:46:53.819 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dnet.ko 2024-03-27T09:46:53.819 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/emulex 2024-03-27T09:46:53.819 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/emulex/benet 2024-03-27T09:46:53.819 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-03-27T09:46:53.819 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/ethoc.ko 2024-03-27T09:46:53.819 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/fealnx.ko 2024-03-27T09:46:53.819 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel 2024-03-27T09:46:53.819 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e100.ko 2024-03-27T09:46:53.819 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000 2024-03-27T09:46:53.819 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-03-27T09:46:53.819 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000e 2024-03-27T09:46:53.820 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-03-27T09:46:53.820 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/fm10k 2024-03-27T09:46:53.820 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-03-27T09:46:53.820 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/i40e 2024-03-27T09:46:53.820 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-03-27T09:46:53.820 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/iavf 2024-03-27T09:46:53.820 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-03-27T09:46:53.820 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igb 2024-03-27T09:46:53.820 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-03-27T09:46:53.820 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igbvf 2024-03-27T09:46:53.820 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-03-27T09:46:53.820 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbe 2024-03-27T09:46:53.820 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-03-27T09:46:53.820 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbevf 2024-03-27T09:46:53.820 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-03-27T09:46:53.821 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/jme.ko 2024-03-27T09:46:53.821 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell 2024-03-27T09:46:53.821 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-03-27T09:46:53.821 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell/skge.ko 2024-03-27T09:46:53.821 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-03-27T09:46:53.821 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox 2024-03-27T09:46:53.821 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx4 2024-03-27T09:46:53.821 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-03-27T09:46:53.821 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-03-27T09:46:53.821 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx5 2024-03-27T09:46:53.821 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-03-27T09:46:53.821 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-03-27T09:46:53.821 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/micrel 2024-03-27T09:46:53.821 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-03-27T09:46:53.821 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/myricom 2024-03-27T09:46:53.822 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/myricom/myri10ge 2024-03-27T09:46:53.822 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-03-27T09:46:53.822 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/natsemi 2024-03-27T09:46:53.822 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-03-27T09:46:53.822 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-03-27T09:46:53.822 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/neterion 2024-03-27T09:46:53.822 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-03-27T09:46:53.822 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/nvidia 2024-03-27T09:46:53.822 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-03-27T09:46:53.822 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/packetengines 2024-03-27T09:46:53.822 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-03-27T09:46:53.822 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-03-27T09:46:53.822 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic 2024-03-27T09:46:53.823 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/netxen 2024-03-27T09:46:53.823 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-03-27T09:46:53.823 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-03-27T09:46:53.823 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-03-27T09:46:53.823 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-03-27T09:46:53.823 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rdc 2024-03-27T09:46:53.823 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-03-27T09:46:53.823 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek 2024-03-27T09:46:53.823 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-03-27T09:46:53.823 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-03-27T09:46:53.823 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/atp.ko 2024-03-27T09:46:53.823 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-03-27T09:46:53.823 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rocker 2024-03-27T09:46:53.823 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-03-27T09:46:53.823 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sfc 2024-03-27T09:46:53.824 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-03-27T09:46:53.824 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/silan 2024-03-27T09:46:53.824 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-03-27T09:46:53.824 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sis 2024-03-27T09:46:53.824 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sis/sis190.ko 2024-03-27T09:46:53.824 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sis/sis900.ko 2024-03-27T09:46:53.824 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc 2024-03-27T09:46:53.824 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-03-27T09:46:53.824 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-03-27T09:46:53.824 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-03-27T09:46:53.824 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-03-27T09:46:53.824 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro 2024-03-27T09:46:53.824 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro/stmmac 2024-03-27T09:46:53.824 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-03-27T09:46:53.825 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-03-27T09:46:53.825 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun 2024-03-27T09:46:53.825 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/cassini.ko 2024-03-27T09:46:53.825 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/niu.ko 2024-03-27T09:46:53.825 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/sungem.ko 2024-03-27T09:46:53.825 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-03-27T09:46:53.825 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/tehuti 2024-03-27T09:46:53.825 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-03-27T09:46:53.825 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/ti 2024-03-27T09:46:53.825 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/ti/tlan.ko 2024-03-27T09:46:53.825 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/via 2024-03-27T09:46:53.825 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-03-27T09:46:53.825 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-03-27T09:46:53.825 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/wiznet 2024-03-27T09:46:53.825 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-03-27T09:46:53.826 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-03-27T09:46:53.826 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/xircom 2024-03-27T09:46:53.826 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-03-27T09:46:53.826 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/geneve.ko 2024-03-27T09:46:53.826 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/hyperv 2024-03-27T09:46:53.826 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-03-27T09:46:53.826 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ieee802154 2024-03-27T09:46:53.826 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ieee802154/fakelb.ko 2024-03-27T09:46:53.826 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ifb.ko 2024-03-27T09:46:53.826 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ipvlan 2024-03-27T09:46:53.826 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ipvlan/ipvlan.ko 2024-03-27T09:46:53.826 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/macvlan.ko 2024-03-27T09:46:53.826 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/macvtap.ko 2024-03-27T09:46:53.826 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio 2024-03-27T09:46:53.827 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio.ko 2024-03-27T09:46:53.827 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-03-27T09:46:53.827 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-03-27T09:46:53.827 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio/mdio-regmap.ko 2024-03-27T09:46:53.827 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mii.ko 2024-03-27T09:46:53.827 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/net_failover.ko 2024-03-27T09:46:53.827 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/netconsole.ko 2024-03-27T09:46:53.827 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/nlmon.ko 2024-03-27T09:46:53.827 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/pcs 2024-03-27T09:46:53.827 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/pcs/pcs-lynx.ko 2024-03-27T09:46:53.827 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-03-27T09:46:53.827 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy 2024-03-27T09:46:53.827 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/amd.ko 2024-03-27T09:46:53.827 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-03-27T09:46:53.827 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-03-27T09:46:53.828 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm7xxx.ko 2024-03-27T09:46:53.828 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm87xx.ko 2024-03-27T09:46:53.828 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/broadcom.ko 2024-03-27T09:46:53.828 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/cicada.ko 2024-03-27T09:46:53.828 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/davicom.ko 2024-03-27T09:46:53.828 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/dp83640.ko 2024-03-27T09:46:53.828 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/et1011c.ko 2024-03-27T09:46:53.828 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/icplus.ko 2024-03-27T09:46:53.828 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/lxt.ko 2024-03-27T09:46:53.828 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/marvell.ko 2024-03-27T09:46:53.828 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/micrel.ko 2024-03-27T09:46:53.828 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/national.ko 2024-03-27T09:46:53.828 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/phylink.ko 2024-03-27T09:46:53.828 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/qsemi.ko 2024-03-27T09:46:53.828 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/realtek.ko 2024-03-27T09:46:53.829 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/smsc.ko 2024-03-27T09:46:53.829 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/ste10Xp.ko 2024-03-27T09:46:53.829 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/vitesse.ko 2024-03-27T09:46:53.829 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp 2024-03-27T09:46:53.829 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/bsd_comp.ko 2024-03-27T09:46:53.829 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_async.ko 2024-03-27T09:46:53.829 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_deflate.ko 2024-03-27T09:46:53.829 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_generic.ko 2024-03-27T09:46:53.829 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_mppe.ko 2024-03-27T09:46:53.829 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_synctty.ko 2024-03-27T09:46:53.829 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/pppoe.ko 2024-03-27T09:46:53.829 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/pppox.ko 2024-03-27T09:46:53.829 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/pptp.ko 2024-03-27T09:46:53.829 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/slip 2024-03-27T09:46:53.829 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/slip/slhc.ko 2024-03-27T09:46:53.830 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/slip/slip.ko 2024-03-27T09:46:53.830 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/sungem_phy.ko 2024-03-27T09:46:53.830 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/tap.ko 2024-03-27T09:46:53.830 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team 2024-03-27T09:46:53.830 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team.ko 2024-03-27T09:46:53.830 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_activebackup.ko 2024-03-27T09:46:53.830 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_broadcast.ko 2024-03-27T09:46:53.830 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-03-27T09:46:53.830 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_random.ko 2024-03-27T09:46:53.830 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-03-27T09:46:53.830 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/tun.ko 2024-03-27T09:46:53.830 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/veth.ko 2024-03-27T09:46:53.830 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/virtio_net.ko 2024-03-27T09:46:53.830 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vmxnet3 2024-03-27T09:46:53.831 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-03-27T09:46:53.831 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vxlan 2024-03-27T09:46:53.831 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vxlan/vxlan.ko 2024-03-27T09:46:53.831 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/xen-netback 2024-03-27T09:46:53.831 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/xen-netback/xen-netback.ko 2024-03-27T09:46:53.831 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/xen-netfront.ko 2024-03-27T09:46:53.831 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ntb 2024-03-27T09:46:53.831 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ntb/ntb.ko 2024-03-27T09:46:53.831 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme 2024-03-27T09:46:53.831 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme/host 2024-03-27T09:46:53.831 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme/host/nvme-core.ko 2024-03-27T09:46:53.831 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme/host/nvme.ko 2024-03-27T09:46:53.831 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport 2024-03-27T09:46:53.831 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport.ko 2024-03-27T09:46:53.832 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport_cs.ko 2024-03-27T09:46:53.832 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport_pc.ko 2024-03-27T09:46:53.832 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport_serial.ko 2024-03-27T09:46:53.832 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci 2024-03-27T09:46:53.832 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/hotplug 2024-03-27T09:46:53.832 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-03-27T09:46:53.832 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/pcie 2024-03-27T09:46:53.832 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/pcie/aer_inject.ko 2024-03-27T09:46:53.832 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/xen-pcifront.ko 2024-03-27T09:46:53.832 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia 2024-03-27T09:46:53.832 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/i82092.ko 2024-03-27T09:46:53.832 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/pd6729.ko 2024-03-27T09:46:53.832 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/yenta_socket.ko 2024-03-27T09:46:53.832 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pinctrl 2024-03-27T09:46:53.832 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pinctrl/intel 2024-03-27T09:46:53.833 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-03-27T09:46:53.833 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform 2024-03-27T09:46:53.833 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86 2024-03-27T09:46:53.833 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/acer-wmi.ko 2024-03-27T09:46:53.833 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/acerhdf.ko 2024-03-27T09:46:53.833 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/apple-gmux.ko 2024-03-27T09:46:53.833 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/asus-laptop.ko 2024-03-27T09:46:53.833 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-03-27T09:46:53.833 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/asus-wmi.ko 2024-03-27T09:46:53.833 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/classmate-laptop.ko 2024-03-27T09:46:53.833 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-03-27T09:46:53.833 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-03-27T09:46:53.833 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-03-27T09:46:53.833 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-03-27T09:46:53.834 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/hdaps.ko 2024-03-27T09:46:53.834 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/intel 2024-03-27T09:46:53.834 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-03-27T09:46:53.834 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/intel_ips.ko 2024-03-27T09:46:53.834 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/msi-wmi.ko 2024-03-27T09:46:53.834 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/mxm-wmi.ko 2024-03-27T09:46:53.834 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-03-27T09:46:53.834 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/samsung-laptop.ko 2024-03-27T09:46:53.834 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/samsung-q10.ko 2024-03-27T09:46:53.834 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/topstar-laptop.ko 2024-03-27T09:46:53.834 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-03-27T09:46:53.834 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/toshiba_haps.ko 2024-03-27T09:46:53.834 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/wmi-bmof.ko 2024-03-27T09:46:53.834 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/wmi.ko 2024-03-27T09:46:53.834 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/powercap 2024-03-27T09:46:53.835 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/powercap/intel_rapl_common.ko 2024-03-27T09:46:53.835 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/powercap/intel_rapl_msr.ko 2024-03-27T09:46:53.835 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps 2024-03-27T09:46:53.835 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients 2024-03-27T09:46:53.835 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients/pps-gpio.ko 2024-03-27T09:46:53.835 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients/pps-ldisc.ko 2024-03-27T09:46:53.835 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients/pps_parport.ko 2024-03-27T09:46:53.835 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/pps_core.ko 2024-03-27T09:46:53.835 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ptp 2024-03-27T09:46:53.835 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ptp/ptp.ko 2024-03-27T09:46:53.835 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ptp/ptp_kvm.ko 2024-03-27T09:46:53.835 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc 2024-03-27T09:46:53.835 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-bq32k.ko 2024-03-27T09:46:53.835 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1286.ko 2024-03-27T09:46:53.835 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1307.ko 2024-03-27T09:46:53.836 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1374.ko 2024-03-27T09:46:53.836 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1511.ko 2024-03-27T09:46:53.836 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1553.ko 2024-03-27T09:46:53.836 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1672.ko 2024-03-27T09:46:53.836 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1742.ko 2024-03-27T09:46:53.836 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds2404.ko 2024-03-27T09:46:53.836 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds3232.ko 2024-03-27T09:46:53.836 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-em3027.ko 2024-03-27T09:46:53.836 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-fm3130.ko 2024-03-27T09:46:53.836 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-isl12022.ko 2024-03-27T09:46:53.836 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-isl1208.ko 2024-03-27T09:46:53.836 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-m41t80.ko 2024-03-27T09:46:53.836 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-m48t35.ko 2024-03-27T09:46:53.836 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-m48t59.ko 2024-03-27T09:46:53.836 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-max6900.ko 2024-03-27T09:46:53.837 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-msm6242.ko 2024-03-27T09:46:53.837 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf2127.ko 2024-03-27T09:46:53.837 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf85063.ko 2024-03-27T09:46:53.837 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf8523.ko 2024-03-27T09:46:53.837 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf8563.ko 2024-03-27T09:46:53.837 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf8583.ko 2024-03-27T09:46:53.837 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rp5c01.ko 2024-03-27T09:46:53.837 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rs5c372.ko 2024-03-27T09:46:53.837 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-03-27T09:46:53.837 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rx8025.ko 2024-03-27T09:46:53.837 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rx8581.ko 2024-03-27T09:46:53.837 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-03-27T09:46:53.837 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-x1205.ko 2024-03-27T09:46:53.837 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi 2024-03-27T09:46:53.837 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/3w-9xxx.ko 2024-03-27T09:46:53.838 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/3w-sas.ko 2024-03-27T09:46:53.838 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/3w-xxxx.ko 2024-03-27T09:46:53.838 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/BusLogic.ko 2024-03-27T09:46:53.838 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/a100u2w.ko 2024-03-27T09:46:53.838 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aacraid 2024-03-27T09:46:53.838 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aacraid/aacraid.ko 2024-03-27T09:46:53.838 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/advansys.ko 2024-03-27T09:46:53.838 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aic7xxx 2024-03-27T09:46:53.838 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-03-27T09:46:53.838 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-03-27T09:46:53.838 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/am53c974.ko 2024-03-27T09:46:53.838 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/arcmsr 2024-03-27T09:46:53.838 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-03-27T09:46:53.838 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/atp870u.ko 2024-03-27T09:46:53.839 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/be2iscsi 2024-03-27T09:46:53.839 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-03-27T09:46:53.839 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bfa 2024-03-27T09:46:53.839 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bfa/bfa.ko 2024-03-27T09:46:53.839 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2fc 2024-03-27T09:46:53.839 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-03-27T09:46:53.839 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2i 2024-03-27T09:46:53.839 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-03-27T09:46:53.839 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ch.ko 2024-03-27T09:46:53.839 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/csiostor 2024-03-27T09:46:53.839 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/csiostor/csiostor.ko 2024-03-27T09:46:53.839 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi 2024-03-27T09:46:53.839 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb3i 2024-03-27T09:46:53.839 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-03-27T09:46:53.839 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb4i 2024-03-27T09:46:53.840 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-03-27T09:46:53.840 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-03-27T09:46:53.840 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/dc395x.ko 2024-03-27T09:46:53.840 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler 2024-03-27T09:46:53.840 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-03-27T09:46:53.840 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-03-27T09:46:53.840 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-03-27T09:46:53.840 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-03-27T09:46:53.840 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/dmx3191d.ko 2024-03-27T09:46:53.840 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/esas2r 2024-03-27T09:46:53.840 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/esas2r/esas2r.ko 2024-03-27T09:46:53.840 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/esp_scsi.ko 2024-03-27T09:46:53.840 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fcoe 2024-03-27T09:46:53.840 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fcoe/fcoe.ko 2024-03-27T09:46:53.840 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-03-27T09:46:53.841 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fnic 2024-03-27T09:46:53.841 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fnic/fnic.ko 2024-03-27T09:46:53.841 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/hpsa.ko 2024-03-27T09:46:53.841 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/hptiop.ko 2024-03-27T09:46:53.841 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/hv_storvsc.ko 2024-03-27T09:46:53.841 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/initio.ko 2024-03-27T09:46:53.841 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ipr.ko 2024-03-27T09:46:53.841 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ips.ko 2024-03-27T09:46:53.841 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/isci 2024-03-27T09:46:53.841 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/isci/isci.ko 2024-03-27T09:46:53.841 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-03-27T09:46:53.841 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/iscsi_tcp.ko 2024-03-27T09:46:53.841 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libfc 2024-03-27T09:46:53.841 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libfc/libfc.ko 2024-03-27T09:46:53.841 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libiscsi.ko 2024-03-27T09:46:53.842 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libiscsi_tcp.ko 2024-03-27T09:46:53.842 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libsas 2024-03-27T09:46:53.842 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libsas/libsas.ko 2024-03-27T09:46:53.842 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/lpfc 2024-03-27T09:46:53.842 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/lpfc/lpfc.ko 2024-03-27T09:46:53.842 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid 2024-03-27T09:46:53.842 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid.ko 2024-03-27T09:46:53.842 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-03-27T09:46:53.842 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-03-27T09:46:53.842 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-03-27T09:46:53.842 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mpt3sas 2024-03-27T09:46:53.842 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-03-27T09:46:53.842 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mvsas 2024-03-27T09:46:53.842 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mvsas/mvsas.ko 2024-03-27T09:46:53.843 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mvumi.ko 2024-03-27T09:46:53.843 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pm8001 2024-03-27T09:46:53.843 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-03-27T09:46:53.843 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pmcraid.ko 2024-03-27T09:46:53.843 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla1280.ko 2024-03-27T09:46:53.843 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla2xxx 2024-03-27T09:46:53.843 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-03-27T09:46:53.843 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-03-27T09:46:53.843 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla4xxx 2024-03-27T09:46:53.843 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-03-27T09:46:53.843 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/raid_class.ko 2024-03-27T09:46:53.843 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_debug.ko 2024-03-27T09:46:53.843 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_fc.ko 2024-03-27T09:46:53.843 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-03-27T09:46:53.843 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_sas.ko 2024-03-27T09:46:53.844 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_spi.ko 2024-03-27T09:46:53.844 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_srp.ko 2024-03-27T09:46:53.844 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ses.ko 2024-03-27T09:46:53.844 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/st.ko 2024-03-27T09:46:53.844 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/stex.ko 2024-03-27T09:46:53.844 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/sym53c8xx_2 2024-03-27T09:46:53.844 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-03-27T09:46:53.844 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/virtio_scsi.ko 2024-03-27T09:46:53.844 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/vmw_pvscsi.ko 2024-03-27T09:46:53.844 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/wd719x.ko 2024-03-27T09:46:53.844 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ssb 2024-03-27T09:46:53.844 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ssb/ssb.ko 2024-03-27T09:46:53.844 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target 2024-03-27T09:46:53.845 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/iscsi 2024-03-27T09:46:53.845 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-03-27T09:46:53.845 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/loopback 2024-03-27T09:46:53.845 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/loopback/tcm_loop.ko 2024-03-27T09:46:53.845 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_file.ko 2024-03-27T09:46:53.845 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_iblock.ko 2024-03-27T09:46:53.845 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_mod.ko 2024-03-27T09:46:53.845 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_pscsi.ko 2024-03-27T09:46:53.845 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_user.ko 2024-03-27T09:46:53.845 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/tcm_fc 2024-03-27T09:46:53.845 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-03-27T09:46:53.845 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal 2024-03-27T09:46:53.845 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel 2024-03-27T09:46:53.845 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal 2024-03-27T09:46:53.845 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-03-27T09:46:53.846 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-03-27T09:46:53.846 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-03-27T09:46:53.846 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-03-27T09:46:53.846 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-03-27T09:46:53.846 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-03-27T09:46:53.846 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-03-27T09:46:53.846 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-03-27T09:46:53.846 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-03-27T09:46:53.846 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-03-27T09:46:53.846 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-03-27T09:46:53.846 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-03-27T09:46:53.846 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-03-27T09:46:53.846 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-03-27T09:46:53.846 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-03-27T09:46:53.847 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-03-27T09:46:53.847 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-03-27T09:46:53.847 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-03-27T09:46:53.847 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty 2024-03-27T09:46:53.847 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/ipwireless 2024-03-27T09:46:53.847 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-03-27T09:46:53.847 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/n_gsm.ko 2024-03-27T09:46:53.847 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/n_hdlc.ko 2024-03-27T09:46:53.847 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/nozomi.ko 2024-03-27T09:46:53.847 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial 2024-03-27T09:46:53.847 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/8250 2024-03-27T09:46:53.847 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-03-27T09:46:53.847 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/arc_uart.ko 2024-03-27T09:46:53.847 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/jsm 2024-03-27T09:46:53.847 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/jsm/jsm.ko 2024-03-27T09:46:53.848 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs 2024-03-27T09:46:53.848 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/core 2024-03-27T09:46:53.848 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/core/ufshcd-core.ko 2024-03-27T09:46:53.848 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/host 2024-03-27T09:46:53.848 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-03-27T09:46:53.848 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio 2024-03-27T09:46:53.848 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio.ko 2024-03-27T09:46:53.848 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_aec.ko 2024-03-27T09:46:53.848 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_cif.ko 2024-03-27T09:46:53.848 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_pci_generic.ko 2024-03-27T09:46:53.848 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_sercos3.ko 2024-03-27T09:46:53.848 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb 2024-03-27T09:46:53.848 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class 2024-03-27T09:46:53.848 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/cdc-acm.ko 2024-03-27T09:46:53.849 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/cdc-wdm.ko 2024-03-27T09:46:53.849 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/usblp.ko 2024-03-27T09:46:53.849 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/usbtmc.ko 2024-03-27T09:46:53.849 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/host 2024-03-27T09:46:53.849 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/host/sl811-hcd.ko 2024-03-27T09:46:53.849 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/image 2024-03-27T09:46:53.849 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/image/mdc800.ko 2024-03-27T09:46:53.849 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/image/microtek.ko 2024-03-27T09:46:53.849 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc 2024-03-27T09:46:53.849 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/adutux.ko 2024-03-27T09:46:53.849 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/appledisplay.ko 2024-03-27T09:46:53.849 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/emi26.ko 2024-03-27T09:46:53.849 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/emi62.ko 2024-03-27T09:46:53.849 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/ezusb.ko 2024-03-27T09:46:53.849 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/idmouse.ko 2024-03-27T09:46:53.849 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/iowarrior.ko 2024-03-27T09:46:53.850 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/isight_firmware.ko 2024-03-27T09:46:53.850 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/ldusb.ko 2024-03-27T09:46:53.850 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/legousbtower.ko 2024-03-27T09:46:53.850 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/sisusbvga 2024-03-27T09:46:53.850 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-03-27T09:46:53.850 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/trancevibrator.ko 2024-03-27T09:46:53.850 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/usb3503.ko 2024-03-27T09:46:53.850 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/usblcd.ko 2024-03-27T09:46:53.850 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/usbsevseg.ko 2024-03-27T09:46:53.850 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/uss720.ko 2024-03-27T09:46:53.850 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/yurex.ko 2024-03-27T09:46:53.850 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/phy 2024-03-27T09:46:53.850 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/phy/phy-generic.ko 2024-03-27T09:46:53.850 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial 2024-03-27T09:46:53.851 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/aircable.ko 2024-03-27T09:46:53.851 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ark3116.ko 2024-03-27T09:46:53.851 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/belkin_sa.ko 2024-03-27T09:46:53.851 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ch341.ko 2024-03-27T09:46:53.851 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/cp210x.ko 2024-03-27T09:46:53.851 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/cyberjack.ko 2024-03-27T09:46:53.851 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/cypress_m8.ko 2024-03-27T09:46:53.851 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/digi_acceleport.ko 2024-03-27T09:46:53.851 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/empeg.ko 2024-03-27T09:46:53.851 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ftdi_sio.ko 2024-03-27T09:46:53.851 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/garmin_gps.ko 2024-03-27T09:46:53.851 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/io_edgeport.ko 2024-03-27T09:46:53.851 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/io_ti.ko 2024-03-27T09:46:53.851 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ipaq.ko 2024-03-27T09:46:53.851 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ipw.ko 2024-03-27T09:46:53.852 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ir-usb.ko 2024-03-27T09:46:53.852 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-03-27T09:46:53.852 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/keyspan.ko 2024-03-27T09:46:53.852 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/keyspan_pda.ko 2024-03-27T09:46:53.852 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/kl5kusb105.ko 2024-03-27T09:46:53.852 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/kobil_sct.ko 2024-03-27T09:46:53.852 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/mct_u232.ko 2024-03-27T09:46:53.852 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/mos7720.ko 2024-03-27T09:46:53.852 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/mos7840.ko 2024-03-27T09:46:53.852 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/navman.ko 2024-03-27T09:46:53.852 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/omninet.ko 2024-03-27T09:46:53.852 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/opticon.ko 2024-03-27T09:46:53.852 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/option.ko 2024-03-27T09:46:53.852 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/oti6858.ko 2024-03-27T09:46:53.852 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/pl2303.ko 2024-03-27T09:46:53.853 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/qcaux.ko 2024-03-27T09:46:53.853 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/qcserial.ko 2024-03-27T09:46:53.853 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/quatech2.ko 2024-03-27T09:46:53.853 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/safe_serial.ko 2024-03-27T09:46:53.853 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/sierra.ko 2024-03-27T09:46:53.853 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/spcp8x5.ko 2024-03-27T09:46:53.853 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ssu100.ko 2024-03-27T09:46:53.853 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/symbolserial.ko 2024-03-27T09:46:53.853 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-03-27T09:46:53.853 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-03-27T09:46:53.853 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/usb_debug.ko 2024-03-27T09:46:53.853 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/usb_wwan.ko 2024-03-27T09:46:53.853 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/visor.ko 2024-03-27T09:46:53.853 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/whiteheat.ko 2024-03-27T09:46:53.853 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/xsens_mt.ko 2024-03-27T09:46:53.854 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage 2024-03-27T09:46:53.854 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/uas.ko 2024-03-27T09:46:53.854 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-alauda.ko 2024-03-27T09:46:53.854 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-cypress.ko 2024-03-27T09:46:53.854 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-datafab.ko 2024-03-27T09:46:53.854 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-03-27T09:46:53.854 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-freecom.ko 2024-03-27T09:46:53.854 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-isd200.ko 2024-03-27T09:46:53.854 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-03-27T09:46:53.854 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-karma.ko 2024-03-27T09:46:53.854 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-onetouch.ko 2024-03-27T09:46:53.854 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-realtek.ko 2024-03-27T09:46:53.854 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-sddr09.ko 2024-03-27T09:46:53.854 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-sddr55.ko 2024-03-27T09:46:53.855 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-usbat.ko 2024-03-27T09:46:53.855 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/usb-storage.ko 2024-03-27T09:46:53.855 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip 2024-03-27T09:46:53.855 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip/usbip-core.ko 2024-03-27T09:46:53.855 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip/usbip-host.ko 2024-03-27T09:46:53.855 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-03-27T09:46:53.855 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio 2024-03-27T09:46:53.855 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/pci 2024-03-27T09:46:53.855 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-03-27T09:46:53.855 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/pci/vfio-pci.ko 2024-03-27T09:46:53.855 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/vfio.ko 2024-03-27T09:46:53.855 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-03-27T09:46:53.855 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost 2024-03-27T09:46:53.855 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost.ko 2024-03-27T09:46:53.855 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost_iotlb.ko 2024-03-27T09:46:53.856 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost_net.ko 2024-03-27T09:46:53.856 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost_scsi.ko 2024-03-27T09:46:53.856 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video 2024-03-27T09:46:53.856 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight 2024-03-27T09:46:53.856 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/apple_bl.ko 2024-03-27T09:46:53.856 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/lcd.ko 2024-03-27T09:46:53.856 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/platform_lcd.ko 2024-03-27T09:46:53.856 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio 2024-03-27T09:46:53.856 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio.ko 2024-03-27T09:46:53.856 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_balloon.ko 2024-03-27T09:46:53.856 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_mmio.ko 2024-03-27T09:46:53.856 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_pci.ko 2024-03-27T09:46:53.856 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-03-27T09:46:53.856 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-03-27T09:46:53.856 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_ring.ko 2024-03-27T09:46:53.857 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1 2024-03-27T09:46:53.857 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/masters 2024-03-27T09:46:53.857 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/masters/ds2482.ko 2024-03-27T09:46:53.857 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/masters/ds2490.ko 2024-03-27T09:46:53.857 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves 2024-03-27T09:46:53.857 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-03-27T09:46:53.857 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-03-27T09:46:53.857 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-03-27T09:46:53.857 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-03-27T09:46:53.857 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-03-27T09:46:53.857 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-03-27T09:46:53.857 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-03-27T09:46:53.857 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-03-27T09:46:53.857 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-03-27T09:46:53.857 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_smem.ko 2024-03-27T09:46:53.857 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_therm.ko 2024-03-27T09:46:53.858 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/wire.ko 2024-03-27T09:46:53.858 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog 2024-03-27T09:46:53.858 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/alim1535_wdt.ko 2024-03-27T09:46:53.858 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/alim7101_wdt.ko 2024-03-27T09:46:53.858 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/f71808e_wdt.ko 2024-03-27T09:46:53.858 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/hpwdt.ko 2024-03-27T09:46:53.858 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/i6300esb.ko 2024-03-27T09:46:53.858 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-03-27T09:46:53.858 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/iTCO_wdt.ko 2024-03-27T09:46:53.858 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/ib700wdt.ko 2024-03-27T09:46:53.858 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/ibmasr.ko 2024-03-27T09:46:53.858 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-03-27T09:46:53.858 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/it8712f_wdt.ko 2024-03-27T09:46:53.858 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/it87_wdt.ko 2024-03-27T09:46:53.859 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/machzwd.ko 2024-03-27T09:46:53.859 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/nv_tco.ko 2024-03-27T09:46:53.859 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/pcwd_pci.ko 2024-03-27T09:46:53.859 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/pcwd_usb.ko 2024-03-27T09:46:53.859 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-03-27T09:46:53.859 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/sch311x_wdt.ko 2024-03-27T09:46:53.859 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/softdog.ko 2024-03-27T09:46:53.859 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/sp5100_tco.ko 2024-03-27T09:46:53.859 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/via_wdt.ko 2024-03-27T09:46:53.859 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-03-27T09:46:53.859 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/w83877f_wdt.ko 2024-03-27T09:46:53.859 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/w83977f_wdt.ko 2024-03-27T09:46:53.859 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/wdt_pci.ko 2024-03-27T09:46:53.859 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/xen_wdt.ko 2024-03-27T09:46:53.859 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen 2024-03-27T09:46:53.860 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-acpi-processor.ko 2024-03-27T09:46:53.860 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-evtchn.ko 2024-03-27T09:46:53.860 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-gntalloc.ko 2024-03-27T09:46:53.860 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-gntdev.ko 2024-03-27T09:46:53.860 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-pciback 2024-03-27T09:46:53.860 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-03-27T09:46:53.860 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-privcmd.ko 2024-03-27T09:46:53.860 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xenfs 2024-03-27T09:46:53.860 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xenfs/xenfs.ko 2024-03-27T09:46:53.860 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs 2024-03-27T09:46:53.860 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/9p 2024-03-27T09:46:53.860 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/9p/9p.ko 2024-03-27T09:46:53.860 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/affs 2024-03-27T09:46:53.860 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/affs/affs.ko 2024-03-27T09:46:53.860 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/befs 2024-03-27T09:46:53.861 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/befs/befs.ko 2024-03-27T09:46:53.861 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/binfmt_misc.ko 2024-03-27T09:46:53.861 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/btrfs 2024-03-27T09:46:53.861 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/btrfs/btrfs.ko 2024-03-27T09:46:53.861 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cachefiles 2024-03-27T09:46:53.861 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cachefiles/cachefiles.ko 2024-03-27T09:46:53.861 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ceph 2024-03-27T09:46:53.861 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ceph/ceph.ko 2024-03-27T09:46:53.861 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/coda 2024-03-27T09:46:53.861 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/coda/coda.ko 2024-03-27T09:46:53.861 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cramfs 2024-03-27T09:46:53.861 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cramfs/cramfs.ko 2024-03-27T09:46:53.861 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/dlm 2024-03-27T09:46:53.861 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/dlm/dlm.ko 2024-03-27T09:46:53.862 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ecryptfs 2024-03-27T09:46:53.862 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ecryptfs/ecryptfs.ko 2024-03-27T09:46:53.862 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/f2fs 2024-03-27T09:46:53.862 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/f2fs/f2fs.ko 2024-03-27T09:46:53.862 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat 2024-03-27T09:46:53.862 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat/fat.ko 2024-03-27T09:46:53.862 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat/msdos.ko 2024-03-27T09:46:53.862 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat/vfat.ko 2024-03-27T09:46:53.862 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fuse 2024-03-27T09:46:53.862 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fuse/cuse.ko 2024-03-27T09:46:53.862 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fuse/fuse.ko 2024-03-27T09:46:53.862 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/gfs2 2024-03-27T09:46:53.862 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/gfs2/gfs2.ko 2024-03-27T09:46:53.862 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfs 2024-03-27T09:46:53.863 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfs/hfs.ko 2024-03-27T09:46:53.863 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfsplus 2024-03-27T09:46:53.863 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfsplus/hfsplus.ko 2024-03-27T09:46:53.863 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/isofs 2024-03-27T09:46:53.863 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/isofs/isofs.ko 2024-03-27T09:46:53.863 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/jfs 2024-03-27T09:46:53.863 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/jfs/jfs.ko 2024-03-27T09:46:53.863 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/lockd 2024-03-27T09:46:53.863 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/lockd/lockd.ko 2024-03-27T09:46:53.863 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/minix 2024-03-27T09:46:53.863 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/minix/minix.ko 2024-03-27T09:46:53.863 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/netfs 2024-03-27T09:46:53.863 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/netfs/netfs.ko 2024-03-27T09:46:53.863 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs 2024-03-27T09:46:53.863 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/blocklayout 2024-03-27T09:46:53.864 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-03-27T09:46:53.864 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/filelayout 2024-03-27T09:46:53.864 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-03-27T09:46:53.864 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/flexfilelayout 2024-03-27T09:46:53.864 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-03-27T09:46:53.864 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/nfs.ko 2024-03-27T09:46:53.864 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/nfsv3.ko 2024-03-27T09:46:53.864 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/nfsv4.ko 2024-03-27T09:46:53.864 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs_common 2024-03-27T09:46:53.864 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs_common/grace.ko 2024-03-27T09:46:53.864 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs_common/nfs_acl.ko 2024-03-27T09:46:53.864 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfsd 2024-03-27T09:46:53.864 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfsd/nfsd.ko 2024-03-27T09:46:53.864 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nilfs2 2024-03-27T09:46:53.864 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nilfs2/nilfs2.ko 2024-03-27T09:46:53.865 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls 2024-03-27T09:46:53.865 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-celtic.ko 2024-03-27T09:46:53.865 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-centeuro.ko 2024-03-27T09:46:53.865 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-croatian.ko 2024-03-27T09:46:53.865 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-cyrillic.ko 2024-03-27T09:46:53.865 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-gaelic.ko 2024-03-27T09:46:53.865 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-greek.ko 2024-03-27T09:46:53.865 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-iceland.ko 2024-03-27T09:46:53.865 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-inuit.ko 2024-03-27T09:46:53.865 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-roman.ko 2024-03-27T09:46:53.865 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-romanian.ko 2024-03-27T09:46:53.865 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-turkish.ko 2024-03-27T09:46:53.865 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp1250.ko 2024-03-27T09:46:53.866 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp1251.ko 2024-03-27T09:46:53.866 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp1255.ko 2024-03-27T09:46:53.866 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp737.ko 2024-03-27T09:46:53.866 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp775.ko 2024-03-27T09:46:53.866 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp850.ko 2024-03-27T09:46:53.866 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp852.ko 2024-03-27T09:46:53.866 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp855.ko 2024-03-27T09:46:53.866 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp857.ko 2024-03-27T09:46:53.866 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp860.ko 2024-03-27T09:46:53.866 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp861.ko 2024-03-27T09:46:53.866 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp862.ko 2024-03-27T09:46:53.866 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp863.ko 2024-03-27T09:46:53.866 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp864.ko 2024-03-27T09:46:53.866 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp865.ko 2024-03-27T09:46:53.867 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp866.ko 2024-03-27T09:46:53.867 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp869.ko 2024-03-27T09:46:53.867 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp874.ko 2024-03-27T09:46:53.867 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp932.ko 2024-03-27T09:46:53.867 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp936.ko 2024-03-27T09:46:53.867 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp949.ko 2024-03-27T09:46:53.867 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp950.ko 2024-03-27T09:46:53.867 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_euc-jp.ko 2024-03-27T09:46:53.867 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-1.ko 2024-03-27T09:46:53.867 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-13.ko 2024-03-27T09:46:53.867 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-14.ko 2024-03-27T09:46:53.867 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-15.ko 2024-03-27T09:46:53.867 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-2.ko 2024-03-27T09:46:53.867 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-3.ko 2024-03-27T09:46:53.867 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-4.ko 2024-03-27T09:46:53.867 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-5.ko 2024-03-27T09:46:53.867 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-6.ko 2024-03-27T09:46:53.868 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-7.ko 2024-03-27T09:46:53.868 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-9.ko 2024-03-27T09:46:53.868 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_koi8-r.ko 2024-03-27T09:46:53.868 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_koi8-ru.ko 2024-03-27T09:46:53.868 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_koi8-u.ko 2024-03-27T09:46:53.868 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_ucs2_utils.ko 2024-03-27T09:46:53.868 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_utf8.ko 2024-03-27T09:46:53.868 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2 2024-03-27T09:46:53.868 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/cluster 2024-03-27T09:46:53.868 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-03-27T09:46:53.868 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlm 2024-03-27T09:46:53.868 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-03-27T09:46:53.868 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlmfs 2024-03-27T09:46:53.868 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-03-27T09:46:53.868 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2.ko 2024-03-27T09:46:53.868 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-03-27T09:46:53.869 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-03-27T09:46:53.869 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-03-27T09:46:53.869 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/overlayfs 2024-03-27T09:46:53.869 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/overlayfs/overlay.ko 2024-03-27T09:46:53.869 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/pstore 2024-03-27T09:46:53.869 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/pstore/ramoops.ko 2024-03-27T09:46:53.869 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/reiserfs 2024-03-27T09:46:53.869 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/reiserfs/reiserfs.ko 2024-03-27T09:46:53.869 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/romfs 2024-03-27T09:46:53.869 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/romfs/romfs.ko 2024-03-27T09:46:53.869 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb 2024-03-27T09:46:53.869 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/client 2024-03-27T09:46:53.869 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/client/cifs.ko 2024-03-27T09:46:53.869 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/common 2024-03-27T09:46:53.870 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/common/cifs_arc4.ko 2024-03-27T09:46:53.870 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/common/cifs_md4.ko 2024-03-27T09:46:53.870 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/squashfs 2024-03-27T09:46:53.870 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/squashfs/squashfs.ko 2024-03-27T09:46:53.870 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/sysv 2024-03-27T09:46:53.870 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/sysv/sysv.ko 2024-03-27T09:46:53.870 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/udf 2024-03-27T09:46:53.870 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/udf/udf.ko 2024-03-27T09:46:53.870 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ufs 2024-03-27T09:46:53.870 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ufs/ufs.ko 2024-03-27T09:46:53.870 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/xfs 2024-03-27T09:46:53.870 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/xfs/xfs.ko 2024-03-27T09:46:53.870 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel 2024-03-27T09:46:53.871 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/rcu 2024-03-27T09:46:53.871 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/rcu/rcutorture.ko 2024-03-27T09:46:53.871 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/torture.ko 2024-03-27T09:46:53.871 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/trace 2024-03-27T09:46:53.871 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-03-27T09:46:53.871 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib 2024-03-27T09:46:53.871 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/asn1_encoder.ko 2024-03-27T09:46:53.871 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crc-itu-t.ko 2024-03-27T09:46:53.871 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crc8.ko 2024-03-27T09:46:53.871 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crypto 2024-03-27T09:46:53.872 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crypto/libarc4.ko 2024-03-27T09:46:53.872 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crypto/libdes.ko 2024-03-27T09:46:53.872 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/libcrc32c.ko 2024-03-27T09:46:53.872 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lru_cache.ko 2024-03-27T09:46:53.872 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lz4 2024-03-27T09:46:53.872 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lz4/lz4_compress.ko 2024-03-27T09:46:53.872 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lz4/lz4hc_compress.ko 2024-03-27T09:46:53.872 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/math 2024-03-27T09:46:53.872 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/math/cordic.ko 2024-03-27T09:46:53.872 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/raid6 2024-03-27T09:46:53.872 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/raid6/raid6_pq.ko 2024-03-27T09:46:53.872 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/reed_solomon 2024-03-27T09:46:53.872 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/reed_solomon/reed_solomon.ko 2024-03-27T09:46:53.872 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/ts_bm.ko 2024-03-27T09:46:53.873 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/ts_fsm.ko 2024-03-27T09:46:53.873 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/ts_kmp.ko 2024-03-27T09:46:53.873 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/zstd 2024-03-27T09:46:53.873 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/zstd/zstd_compress.ko 2024-03-27T09:46:53.873 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/mm 2024-03-27T09:46:53.873 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/mm/hwpoison-inject.ko 2024-03-27T09:46:53.873 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net 2024-03-27T09:46:53.873 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan 2024-03-27T09:46:53.873 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/6lowpan.ko 2024-03-27T09:46:53.873 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_dest.ko 2024-03-27T09:46:53.873 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_fragment.ko 2024-03-27T09:46:53.873 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_hop.ko 2024-03-27T09:46:53.873 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_ipv6.ko 2024-03-27T09:46:53.873 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_mobility.ko 2024-03-27T09:46:53.874 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_routing.ko 2024-03-27T09:46:53.874 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_udp.ko 2024-03-27T09:46:53.874 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802 2024-03-27T09:46:53.874 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/garp.ko 2024-03-27T09:46:53.874 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/mrp.ko 2024-03-27T09:46:53.874 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/p8022.ko 2024-03-27T09:46:53.874 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/psnap.ko 2024-03-27T09:46:53.874 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/stp.ko 2024-03-27T09:46:53.874 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/8021q 2024-03-27T09:46:53.874 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/8021q/8021q.ko 2024-03-27T09:46:53.874 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p 2024-03-27T09:46:53.874 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet.ko 2024-03-27T09:46:53.874 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet_fd.ko 2024-03-27T09:46:53.874 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet_rdma.ko 2024-03-27T09:46:53.875 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet_virtio.ko 2024-03-27T09:46:53.875 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/batman-adv 2024-03-27T09:46:53.875 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/batman-adv/batman-adv.ko 2024-03-27T09:46:53.875 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge 2024-03-27T09:46:53.875 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/br_netfilter.ko 2024-03-27T09:46:53.875 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/bridge.ko 2024-03-27T09:46:53.875 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter 2024-03-27T09:46:53.875 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-03-27T09:46:53.875 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_among.ko 2024-03-27T09:46:53.875 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_arp.ko 2024-03-27T09:46:53.875 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-03-27T09:46:53.875 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-03-27T09:46:53.875 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_ip.ko 2024-03-27T09:46:53.875 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-03-27T09:46:53.876 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_limit.ko 2024-03-27T09:46:53.876 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_log.ko 2024-03-27T09:46:53.876 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_mark.ko 2024-03-27T09:46:53.876 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-03-27T09:46:53.876 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-03-27T09:46:53.876 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-03-27T09:46:53.876 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-03-27T09:46:53.876 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_snat.ko 2024-03-27T09:46:53.876 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_stp.ko 2024-03-27T09:46:53.876 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-03-27T09:46:53.876 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-03-27T09:46:53.876 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-03-27T09:46:53.876 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-03-27T09:46:53.876 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtables.ko 2024-03-27T09:46:53.876 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-03-27T09:46:53.876 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-03-27T09:46:53.877 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-03-27T09:46:53.877 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ceph 2024-03-27T09:46:53.877 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ceph/libceph.ko 2024-03-27T09:46:53.877 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/core 2024-03-27T09:46:53.877 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/core/failover.ko 2024-03-27T09:46:53.877 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/core/pktgen.ko 2024-03-27T09:46:53.877 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp 2024-03-27T09:46:53.877 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp.ko 2024-03-27T09:46:53.877 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp_diag.ko 2024-03-27T09:46:53.877 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp_ipv4.ko 2024-03-27T09:46:53.877 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp_ipv6.ko 2024-03-27T09:46:53.877 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dns_resolver 2024-03-27T09:46:53.877 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dns_resolver/dns_resolver.ko 2024-03-27T09:46:53.877 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa 2024-03-27T09:46:53.877 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/dsa_core.ko 2024-03-27T09:46:53.877 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_brcm.ko 2024-03-27T09:46:53.878 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_dsa.ko 2024-03-27T09:46:53.878 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_none.ko 2024-03-27T09:46:53.878 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_trailer.ko 2024-03-27T09:46:53.878 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154 2024-03-27T09:46:53.878 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/6lowpan 2024-03-27T09:46:53.878 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-03-27T09:46:53.878 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/ieee802154.ko 2024-03-27T09:46:53.878 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/ieee802154_socket.ko 2024-03-27T09:46:53.878 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4 2024-03-27T09:46:53.878 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ah4.ko 2024-03-27T09:46:53.878 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/esp4.ko 2024-03-27T09:46:53.878 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/fou.ko 2024-03-27T09:46:53.878 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/gre.ko 2024-03-27T09:46:53.878 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/inet_diag.ko 2024-03-27T09:46:53.879 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ip_gre.ko 2024-03-27T09:46:53.879 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ip_tunnel.ko 2024-03-27T09:46:53.879 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ip_vti.ko 2024-03-27T09:46:53.879 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ipcomp.ko 2024-03-27T09:46:53.879 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ipip.ko 2024-03-27T09:46:53.879 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter 2024-03-27T09:46:53.879 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/arp_tables.ko 2024-03-27T09:46:53.879 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-03-27T09:46:53.879 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-03-27T09:46:53.879 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-03-27T09:46:53.879 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-03-27T09:46:53.879 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-03-27T09:46:53.879 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-03-27T09:46:53.879 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-03-27T09:46:53.879 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-03-27T09:46:53.880 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-03-27T09:46:53.880 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_security.ko 2024-03-27T09:46:53.880 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-03-27T09:46:53.880 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-03-27T09:46:53.880 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-03-27T09:46:53.880 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-03-27T09:46:53.880 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-03-27T09:46:53.880 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-03-27T09:46:53.880 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-03-27T09:46:53.880 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-03-27T09:46:53.880 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-03-27T09:46:53.880 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-03-27T09:46:53.880 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_bic.ko 2024-03-27T09:46:53.880 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_dctcp.ko 2024-03-27T09:46:53.880 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_diag.ko 2024-03-27T09:46:53.880 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_highspeed.ko 2024-03-27T09:46:53.881 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_htcp.ko 2024-03-27T09:46:53.881 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_hybla.ko 2024-03-27T09:46:53.881 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_illinois.ko 2024-03-27T09:46:53.881 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_lp.ko 2024-03-27T09:46:53.881 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_scalable.ko 2024-03-27T09:46:53.881 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_vegas.ko 2024-03-27T09:46:53.881 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_veno.ko 2024-03-27T09:46:53.881 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_westwood.ko 2024-03-27T09:46:53.881 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_yeah.ko 2024-03-27T09:46:53.881 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tunnel4.ko 2024-03-27T09:46:53.881 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/udp_diag.ko 2024-03-27T09:46:53.881 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/udp_tunnel.ko 2024-03-27T09:46:53.881 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/xfrm4_tunnel.ko 2024-03-27T09:46:53.881 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6 2024-03-27T09:46:53.882 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ah6.ko 2024-03-27T09:46:53.882 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/esp6.ko 2024-03-27T09:46:53.882 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/fou6.ko 2024-03-27T09:46:53.882 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ip6_tunnel.ko 2024-03-27T09:46:53.882 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-03-27T09:46:53.882 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ip6_vti.ko 2024-03-27T09:46:53.882 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ipcomp6.ko 2024-03-27T09:46:53.882 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter 2024-03-27T09:46:53.882 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-03-27T09:46:53.882 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-03-27T09:46:53.882 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-03-27T09:46:53.882 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-03-27T09:46:53.882 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-03-27T09:46:53.882 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-03-27T09:46:53.882 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-03-27T09:46:53.883 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-03-27T09:46:53.883 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-03-27T09:46:53.883 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-03-27T09:46:53.883 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-03-27T09:46:53.883 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-03-27T09:46:53.883 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-03-27T09:46:53.883 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-03-27T09:46:53.883 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-03-27T09:46:53.883 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-03-27T09:46:53.883 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-03-27T09:46:53.883 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-03-27T09:46:53.883 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-03-27T09:46:53.883 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-03-27T09:46:53.883 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-03-27T09:46:53.884 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-03-27T09:46:53.884 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-03-27T09:46:53.884 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-03-27T09:46:53.884 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/sit.ko 2024-03-27T09:46:53.884 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/tunnel6.ko 2024-03-27T09:46:53.884 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/xfrm6_tunnel.ko 2024-03-27T09:46:53.884 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/key 2024-03-27T09:46:53.884 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/key/af_key.ko 2024-03-27T09:46:53.884 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp 2024-03-27T09:46:53.884 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_core.ko 2024-03-27T09:46:53.884 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_debugfs.ko 2024-03-27T09:46:53.884 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_eth.ko 2024-03-27T09:46:53.884 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_ip.ko 2024-03-27T09:46:53.884 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_ip6.ko 2024-03-27T09:46:53.884 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_netlink.ko 2024-03-27T09:46:53.885 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_ppp.ko 2024-03-27T09:46:53.885 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/llc 2024-03-27T09:46:53.885 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/llc/llc.ko 2024-03-27T09:46:53.885 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mac802154 2024-03-27T09:46:53.885 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mac802154/mac802154.ko 2024-03-27T09:46:53.885 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mpls 2024-03-27T09:46:53.885 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mpls/mpls_gso.ko 2024-03-27T09:46:53.885 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter 2024-03-27T09:46:53.885 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset 2024-03-27T09:46:53.885 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set.ko 2024-03-27T09:46:53.885 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-03-27T09:46:53.885 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-03-27T09:46:53.885 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-03-27T09:46:53.885 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-03-27T09:46:53.885 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-03-27T09:46:53.886 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-03-27T09:46:53.886 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-03-27T09:46:53.886 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-03-27T09:46:53.886 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-03-27T09:46:53.886 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-03-27T09:46:53.886 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-03-27T09:46:53.886 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-03-27T09:46:53.886 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-03-27T09:46:53.886 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-03-27T09:46:53.886 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-03-27T09:46:53.886 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs 2024-03-27T09:46:53.886 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs.ko 2024-03-27T09:46:53.886 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-03-27T09:46:53.886 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-03-27T09:46:53.887 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-03-27T09:46:53.887 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-03-27T09:46:53.887 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-03-27T09:46:53.887 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-03-27T09:46:53.887 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-03-27T09:46:53.887 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-03-27T09:46:53.887 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-03-27T09:46:53.887 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-03-27T09:46:53.887 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-03-27T09:46:53.887 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-03-27T09:46:53.887 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-03-27T09:46:53.887 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conncount.ko 2024-03-27T09:46:53.887 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack.ko 2024-03-27T09:46:53.887 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-03-27T09:46:53.887 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-03-27T09:46:53.888 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-03-27T09:46:53.888 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_h323.ko 2024-03-27T09:46:53.888 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_irc.ko 2024-03-27T09:46:53.888 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-03-27T09:46:53.889 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-03-27T09:46:53.889 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-03-27T09:46:53.889 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_sane.ko 2024-03-27T09:46:53.889 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_sip.ko 2024-03-27T09:46:53.889 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-03-27T09:46:53.890 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-03-27T09:46:53.890 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_dup_netdev.ko 2024-03-27T09:46:53.890 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_flow_table.ko 2024-03-27T09:46:53.890 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_flow_table_inet.ko 2024-03-27T09:46:53.890 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_log_syslog.ko 2024-03-27T09:46:53.890 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat.ko 2024-03-27T09:46:53.890 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_amanda.ko 2024-03-27T09:46:53.890 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_ftp.ko 2024-03-27T09:46:53.890 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_irc.ko 2024-03-27T09:46:53.890 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_sip.ko 2024-03-27T09:46:53.890 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_tftp.ko 2024-03-27T09:46:53.890 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_synproxy_core.ko 2024-03-27T09:46:53.890 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_tables.ko 2024-03-27T09:46:53.890 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink.ko 2024-03-27T09:46:53.891 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_acct.ko 2024-03-27T09:46:53.891 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_log.ko 2024-03-27T09:46:53.891 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_osf.ko 2024-03-27T09:46:53.891 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_queue.ko 2024-03-27T09:46:53.891 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_chain_nat.ko 2024-03-27T09:46:53.891 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_compat.ko 2024-03-27T09:46:53.891 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_ct.ko 2024-03-27T09:46:53.891 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_dup_netdev.ko 2024-03-27T09:46:53.891 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_fib.ko 2024-03-27T09:46:53.891 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_fwd_netdev.ko 2024-03-27T09:46:53.891 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_hash.ko 2024-03-27T09:46:53.891 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_limit.ko 2024-03-27T09:46:53.891 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_log.ko 2024-03-27T09:46:53.892 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_masq.ko 2024-03-27T09:46:53.892 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_nat.ko 2024-03-27T09:46:53.892 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_numgen.ko 2024-03-27T09:46:53.892 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_queue.ko 2024-03-27T09:46:53.892 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_quota.ko 2024-03-27T09:46:53.892 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_redir.ko 2024-03-27T09:46:53.892 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_reject.ko 2024-03-27T09:46:53.892 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_reject_inet.ko 2024-03-27T09:46:53.892 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_socket.ko 2024-03-27T09:46:53.892 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_tunnel.ko 2024-03-27T09:46:53.892 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_AUDIT.ko 2024-03-27T09:46:53.892 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CHECKSUM.ko 2024-03-27T09:46:53.892 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CLASSIFY.ko 2024-03-27T09:46:53.892 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-03-27T09:46:53.892 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CT.ko 2024-03-27T09:46:53.893 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_DSCP.ko 2024-03-27T09:46:53.893 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_HL.ko 2024-03-27T09:46:53.893 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_HMARK.ko 2024-03-27T09:46:53.893 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_IDLETIMER.ko 2024-03-27T09:46:53.893 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_LED.ko 2024-03-27T09:46:53.893 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_LOG.ko 2024-03-27T09:46:53.893 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_MASQUERADE.ko 2024-03-27T09:46:53.893 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_NETMAP.ko 2024-03-27T09:46:53.893 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_NFLOG.ko 2024-03-27T09:46:53.893 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_NFQUEUE.ko 2024-03-27T09:46:53.893 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_RATEEST.ko 2024-03-27T09:46:53.893 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_REDIRECT.ko 2024-03-27T09:46:53.893 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_SECMARK.ko 2024-03-27T09:46:53.893 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TCPMSS.ko 2024-03-27T09:46:53.894 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-03-27T09:46:53.894 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TEE.ko 2024-03-27T09:46:53.894 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TPROXY.ko 2024-03-27T09:46:53.894 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TRACE.ko 2024-03-27T09:46:53.894 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_addrtype.ko 2024-03-27T09:46:53.894 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_bpf.ko 2024-03-27T09:46:53.894 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_cgroup.ko 2024-03-27T09:46:53.894 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_cluster.ko 2024-03-27T09:46:53.894 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_comment.ko 2024-03-27T09:46:53.894 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connbytes.ko 2024-03-27T09:46:53.894 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connlabel.ko 2024-03-27T09:46:53.894 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connlimit.ko 2024-03-27T09:46:53.894 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connmark.ko 2024-03-27T09:46:53.894 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_conntrack.ko 2024-03-27T09:46:53.894 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_cpu.ko 2024-03-27T09:46:53.895 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_dccp.ko 2024-03-27T09:46:53.895 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_devgroup.ko 2024-03-27T09:46:53.895 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_dscp.ko 2024-03-27T09:46:53.895 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_ecn.ko 2024-03-27T09:46:53.895 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_esp.ko 2024-03-27T09:46:53.895 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_hashlimit.ko 2024-03-27T09:46:53.895 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_helper.ko 2024-03-27T09:46:53.895 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_hl.ko 2024-03-27T09:46:53.895 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_ipcomp.ko 2024-03-27T09:46:53.895 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_iprange.ko 2024-03-27T09:46:53.895 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_ipvs.ko 2024-03-27T09:46:53.895 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_l2tp.ko 2024-03-27T09:46:53.895 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_length.ko 2024-03-27T09:46:53.895 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_limit.ko 2024-03-27T09:46:53.896 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_mac.ko 2024-03-27T09:46:53.896 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_mark.ko 2024-03-27T09:46:53.896 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_multiport.ko 2024-03-27T09:46:53.896 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_nat.ko 2024-03-27T09:46:53.896 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_nfacct.ko 2024-03-27T09:46:53.896 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_osf.ko 2024-03-27T09:46:53.896 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_owner.ko 2024-03-27T09:46:53.896 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_physdev.ko 2024-03-27T09:46:53.896 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_pkttype.ko 2024-03-27T09:46:53.896 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_policy.ko 2024-03-27T09:46:53.896 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_quota.ko 2024-03-27T09:46:53.896 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_rateest.ko 2024-03-27T09:46:53.896 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_realm.ko 2024-03-27T09:46:53.896 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_recent.ko 2024-03-27T09:46:53.896 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_sctp.ko 2024-03-27T09:46:53.897 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_set.ko 2024-03-27T09:46:53.897 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_socket.ko 2024-03-27T09:46:53.897 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_state.ko 2024-03-27T09:46:53.897 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_statistic.ko 2024-03-27T09:46:53.897 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_string.ko 2024-03-27T09:46:53.897 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_tcpmss.ko 2024-03-27T09:46:53.897 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_time.ko 2024-03-27T09:46:53.897 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_u32.ko 2024-03-27T09:46:53.897 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netlink 2024-03-27T09:46:53.897 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netlink/netlink_diag.ko 2024-03-27T09:46:53.897 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/nsh 2024-03-27T09:46:53.897 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/nsh/nsh.ko 2024-03-27T09:46:53.897 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch 2024-03-27T09:46:53.897 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/openvswitch.ko 2024-03-27T09:46:53.898 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/vport-geneve.ko 2024-03-27T09:46:53.898 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/vport-gre.ko 2024-03-27T09:46:53.898 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/vport-vxlan.ko 2024-03-27T09:46:53.898 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/packet 2024-03-27T09:46:53.898 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/packet/af_packet_diag.ko 2024-03-27T09:46:53.898 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds 2024-03-27T09:46:53.898 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds/rds.ko 2024-03-27T09:46:53.898 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds/rds_rdma.ko 2024-03-27T09:46:53.898 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds/rds_tcp.ko 2024-03-27T09:46:53.898 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched 2024-03-27T09:46:53.898 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_csum.ko 2024-03-27T09:46:53.898 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_gact.ko 2024-03-27T09:46:53.898 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_mirred.ko 2024-03-27T09:46:53.898 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_nat.ko 2024-03-27T09:46:53.899 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_pedit.ko 2024-03-27T09:46:53.899 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_police.ko 2024-03-27T09:46:53.899 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_simple.ko 2024-03-27T09:46:53.899 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_skbedit.ko 2024-03-27T09:46:53.899 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_vlan.ko 2024-03-27T09:46:53.899 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_basic.ko 2024-03-27T09:46:53.899 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_bpf.ko 2024-03-27T09:46:53.899 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_flow.ko 2024-03-27T09:46:53.899 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_fw.ko 2024-03-27T09:46:53.899 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_route.ko 2024-03-27T09:46:53.899 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_u32.ko 2024-03-27T09:46:53.899 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_cmp.ko 2024-03-27T09:46:53.899 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_ipset.ko 2024-03-27T09:46:53.899 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_meta.ko 2024-03-27T09:46:53.899 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_nbyte.ko 2024-03-27T09:46:53.900 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_text.ko 2024-03-27T09:46:53.900 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_u32.ko 2024-03-27T09:46:53.900 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_choke.ko 2024-03-27T09:46:53.900 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_codel.ko 2024-03-27T09:46:53.900 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_drr.ko 2024-03-27T09:46:53.900 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_fq.ko 2024-03-27T09:46:53.900 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_gred.ko 2024-03-27T09:46:53.900 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_hfsc.ko 2024-03-27T09:46:53.900 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_hhf.ko 2024-03-27T09:46:53.900 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_htb.ko 2024-03-27T09:46:53.900 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_ingress.ko 2024-03-27T09:46:53.900 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_mqprio.ko 2024-03-27T09:46:53.900 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_mqprio_lib.ko 2024-03-27T09:46:53.900 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_multiq.ko 2024-03-27T09:46:53.900 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_netem.ko 2024-03-27T09:46:53.901 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_pie.ko 2024-03-27T09:46:53.901 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_plug.ko 2024-03-27T09:46:53.901 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_prio.ko 2024-03-27T09:46:53.901 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_qfq.ko 2024-03-27T09:46:53.901 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_red.ko 2024-03-27T09:46:53.901 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_sfb.ko 2024-03-27T09:46:53.901 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_sfq.ko 2024-03-27T09:46:53.901 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_tbf.ko 2024-03-27T09:46:53.901 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_teql.ko 2024-03-27T09:46:53.901 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sctp 2024-03-27T09:46:53.901 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sctp/sctp.ko 2024-03-27T09:46:53.901 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sctp/sctp_diag.ko 2024-03-27T09:46:53.901 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc 2024-03-27T09:46:53.901 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/auth_gss 2024-03-27T09:46:53.901 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-03-27T09:46:53.901 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-03-27T09:46:53.902 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/sunrpc.ko 2024-03-27T09:46:53.902 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/xprtrdma 2024-03-27T09:46:53.902 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-03-27T09:46:53.902 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/tipc 2024-03-27T09:46:53.902 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/tipc/diag.ko 2024-03-27T09:46:53.902 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/tipc/tipc.ko 2024-03-27T09:46:53.902 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/unix 2024-03-27T09:46:53.902 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/unix/unix_diag.ko 2024-03-27T09:46:53.902 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock 2024-03-27T09:46:53.902 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-03-27T09:46:53.902 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-03-27T09:46:53.902 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vsock.ko 2024-03-27T09:46:53.902 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vsock_diag.ko 2024-03-27T09:46:53.902 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vsock_loopback.ko 2024-03-27T09:46:53.903 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/xfrm 2024-03-27T09:46:53.903 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/xfrm/xfrm_ipcomp.ko 2024-03-27T09:46:53.903 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security 2024-03-27T09:46:53.903 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys 2024-03-27T09:46:53.903 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/encrypted-keys 2024-03-27T09:46:53.903 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-03-27T09:46:53.903 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/trusted-keys 2024-03-27T09:46:53.903 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/trusted-keys/trusted.ko 2024-03-27T09:46:53.903 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/virt 2024-03-27T09:46:53.903 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/virt/lib 2024-03-27T09:46:53.903 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/virt/lib/irqbypass.ko 2024-03-27T09:46:53.903 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.alias 2024-03-27T09:46:53.903 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.alias.bin 2024-03-27T09:46:53.903 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin 2024-03-27T09:46:53.903 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin.alias.bin 2024-03-27T09:46:53.904 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin.bin 2024-03-27T09:46:53.904 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin.modinfo 2024-03-27T09:46:53.904 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.dep 2024-03-27T09:46:53.904 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.dep.bin 2024-03-27T09:46:53.904 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.devname 2024-03-27T09:46:53.904 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.order 2024-03-27T09:46:53.904 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.softdep 2024-03-27T09:46:53.904 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.symbols 2024-03-27T09:46:53.904 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.symbols.bin 2024-03-27T09:46:53.904 INFO:teuthology.orchestra.run.smithi057.stdout:/lib/modules/6.8.0-g1df0c7e8a235/vmlinuz 2024-03-27T09:46:53.908 DEBUG:teuthology.task.kernel:get_image_version: 6.8.0-g1df0c7e8a235 2024-03-27T09:46:53.908 DEBUG:teuthology.orchestra.run.smithi057:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-03-27T09:46:53.930 INFO:teuthology.orchestra.run.smithi057.stdout:postinstall scriptlet (using /bin/sh): 2024-03-27T09:46:53.930 INFO:teuthology.orchestra.run.smithi057.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-03-27T09:46:53.930 INFO:teuthology.orchestra.run.smithi057.stdout: /usr/bin/kernel-install add 6.8.0-g1df0c7e8a235 /lib/modules/6.8.0-g1df0c7e8a235/vmlinuz 2024-03-27T09:46:53.930 INFO:teuthology.orchestra.run.smithi057.stdout:fi 2024-03-27T09:46:53.930 INFO:teuthology.orchestra.run.smithi057.stdout:for file in vmlinuz System.map config; do 2024-03-27T09:46:53.930 INFO:teuthology.orchestra.run.smithi057.stdout: if ! cmp --silent "/lib/modules/6.8.0-g1df0c7e8a235/${file}" "/boot/${file}-6.8.0-g1df0c7e8a235"; then 2024-03-27T09:46:53.931 INFO:teuthology.orchestra.run.smithi057.stdout: cp "/lib/modules/6.8.0-g1df0c7e8a235/${file}" "/boot/${file}-6.8.0-g1df0c7e8a235" 2024-03-27T09:46:53.931 INFO:teuthology.orchestra.run.smithi057.stdout: fi 2024-03-27T09:46:53.931 INFO:teuthology.orchestra.run.smithi057.stdout:done 2024-03-27T09:46:53.931 INFO:teuthology.orchestra.run.smithi057.stdout:preuninstall scriptlet (using /bin/sh): 2024-03-27T09:46:53.931 INFO:teuthology.orchestra.run.smithi057.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2024-03-27T09:46:53.931 INFO:teuthology.orchestra.run.smithi057.stdout:new-kernel-pkg --remove 6.8.0-g1df0c7e8a235 --rminitrd --initrdfile=/boot/initramfs-6.8.0-g1df0c7e8a235.img 2024-03-27T09:46:53.931 INFO:teuthology.orchestra.run.smithi057.stdout:elif [ -x /usr/bin/kernel-install ]; then 2024-03-27T09:46:53.931 INFO:teuthology.orchestra.run.smithi057.stdout:kernel-install remove 6.8.0-g1df0c7e8a235 2024-03-27T09:46:53.931 INFO:teuthology.orchestra.run.smithi057.stdout:fi 2024-03-27T09:46:53.931 INFO:teuthology.orchestra.run.smithi057.stdout:postuninstall scriptlet (using /bin/sh): 2024-03-27T09:46:53.931 INFO:teuthology.orchestra.run.smithi057.stdout:if [ -x /sbin/update-bootloader ]; then 2024-03-27T09:46:53.931 INFO:teuthology.orchestra.run.smithi057.stdout:/sbin/update-bootloader --remove 6.8.0-g1df0c7e8a235 2024-03-27T09:46:53.931 INFO:teuthology.orchestra.run.smithi057.stdout:fi 2024-03-27T09:46:53.932 DEBUG:teuthology.orchestra.run.smithi057:> sudo rpm -qi grub2-tools 2024-03-27T09:46:54.010 INFO:teuthology.orchestra.run.smithi057.stdout:Name : grub2-tools 2024-03-27T09:46:54.010 INFO:teuthology.orchestra.run.smithi057.stdout:Epoch : 1 2024-03-27T09:46:54.011 INFO:teuthology.orchestra.run.smithi057.stdout:Version : 2.06 2024-03-27T09:46:54.011 INFO:teuthology.orchestra.run.smithi057.stdout:Release : 68.el9 2024-03-27T09:46:54.011 INFO:teuthology.orchestra.run.smithi057.stdout:Architecture: x86_64 2024-03-27T09:46:54.011 INFO:teuthology.orchestra.run.smithi057.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-03-27T09:46:54.011 INFO:teuthology.orchestra.run.smithi057.stdout:Group : Unspecified 2024-03-27T09:46:54.011 INFO:teuthology.orchestra.run.smithi057.stdout:Size : 8264254 2024-03-27T09:46:54.011 INFO:teuthology.orchestra.run.smithi057.stdout:License : GPLv3+ 2024-03-27T09:46:54.011 INFO:teuthology.orchestra.run.smithi057.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-03-27T09:46:54.011 INFO:teuthology.orchestra.run.smithi057.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-03-27T09:46:54.011 INFO:teuthology.orchestra.run.smithi057.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-03-27T09:46:54.011 INFO:teuthology.orchestra.run.smithi057.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-03-27T09:46:54.011 INFO:teuthology.orchestra.run.smithi057.stdout:Packager : builder@centos.org 2024-03-27T09:46:54.011 INFO:teuthology.orchestra.run.smithi057.stdout:Vendor : CentOS 2024-03-27T09:46:54.011 INFO:teuthology.orchestra.run.smithi057.stdout:URL : http://www.gnu.org/software/grub/ 2024-03-27T09:46:54.011 INFO:teuthology.orchestra.run.smithi057.stdout:Summary : Support tools for GRUB. 2024-03-27T09:46:54.011 INFO:teuthology.orchestra.run.smithi057.stdout:Description : 2024-03-27T09:46:54.012 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T09:46:54.012 INFO:teuthology.orchestra.run.smithi057.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-03-27T09:46:54.012 INFO:teuthology.orchestra.run.smithi057.stdout:customizable bootloader with modular architecture. It supports a rich 2024-03-27T09:46:54.012 INFO:teuthology.orchestra.run.smithi057.stdout:variety of kernel formats, file systems, computer architectures and 2024-03-27T09:46:54.012 INFO:teuthology.orchestra.run.smithi057.stdout:hardware devices. 2024-03-27T09:46:54.012 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T09:46:54.012 INFO:teuthology.orchestra.run.smithi057.stdout:This subpackage provides tools for support of all platforms. 2024-03-27T09:46:54.013 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-03-27T09:46:54.013 INFO:teuthology.task.kernel:Updating grub on smithi057 to boot 6.8.0-g1df0c7e8a235 2024-03-27T09:46:54.013 DEBUG:teuthology.orchestra.run.smithi057:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-03-27T09:46:54.622 INFO:teuthology.orchestra.run.smithi057.stderr:Generating grub configuration file ... 2024-03-27T09:46:55.799 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-03-27T09:46:55.800 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi118.front.sepia.ceph.com' 2024-03-27T09:46:55.800 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-27T09:46:56.084 INFO:teuthology.orchestra.run.smithi057.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-03-27T09:46:56.114 INFO:teuthology.orchestra.run.smithi057.stderr:done 2024-03-27T09:46:56.117 DEBUG:teuthology.orchestra.run.smithi057:> mktemp 2024-03-27T09:46:56.132 INFO:teuthology.orchestra.run.smithi057.stdout:/tmp/tmp.A4DHSzMGoL 2024-03-27T09:46:56.132 DEBUG:teuthology.orchestra.run.smithi057:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.A4DHSzMGoL 2024-03-27T09:46:56.204 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 0666 /tmp/tmp.A4DHSzMGoL 2024-03-27T09:46:56.345 DEBUG:teuthology.orchestra.remote:smithi057:/tmp/tmp.A4DHSzMGoL is 6KB 2024-03-27T09:46:56.393 DEBUG:teuthology.orchestra.run.smithi057:> rm -fr /tmp/tmp.A4DHSzMGoL 2024-03-27T09:46:56.408 DEBUG:teuthology.orchestra.run.smithi057:> sudo /bin/ls /boot/loader/entries || true 2024-03-27T09:46:56.476 INFO:teuthology.orchestra.run.smithi057.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-03-27T09:46:56.476 INFO:teuthology.orchestra.run.smithi057.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-03-27T09:46:56.477 INFO:teuthology.orchestra.run.smithi057.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-03-27T09:46:56.477 INFO:teuthology.orchestra.run.smithi057.stdout:15949e3c88704300882482eddfd7baae-6.8.0-g1df0c7e8a235.conf 2024-03-27T09:46:56.478 DEBUG:teuthology.orchestra.run.smithi057:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.8.0-g1df0c7e8a235 2024-03-27T09:46:56.653 DEBUG:teuthology.orchestra.run.smithi057:> sudo shutdown -r now 2024-03-27T09:47:14.339 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.118 2024-03-27T09:47:23.348 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi118.front.sepia.ceph.com' 2024-03-27T09:47:23.349 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-27T09:47:26.434 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.118 2024-03-27T09:47:26.656 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-03-27T09:47:26.656 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com' 2024-03-27T09:47:26.657 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-27T09:47:38.446 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi118.front.sepia.ceph.com' 2024-03-27T09:47:38.448 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-27T09:47:41.506 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.118 2024-03-27T09:47:45.054 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.57 2024-03-27T09:47:54.062 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com' 2024-03-27T09:47:54.063 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-27T09:47:56.510 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi118.front.sepia.ceph.com' 2024-03-27T09:47:56.511 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-27T09:47:57.118 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.57 2024-03-27T09:48:09.130 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com' 2024-03-27T09:48:09.131 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-27T09:48:15.006 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.118 2024-03-27T09:48:33.022 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi118.front.sepia.ceph.com' 2024-03-27T09:48:33.023 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-27T09:48:33.464 DEBUG:teuthology.orchestra.run.smithi118:> true 2024-03-27T09:48:34.059 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi118.front.sepia.ceph.com' 2024-03-27T09:48:34.060 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.8.0-g1df0c7e8a235"... 2024-03-27T09:48:34.060 DEBUG:teuthology.orchestra.run.smithi118:> uname -r 2024-03-27T09:48:34.098 INFO:teuthology.orchestra.run.smithi118.stdout:6.8.0-g1df0c7e8a235 2024-03-27T09:48:34.098 DEBUG:teuthology.task.kernel:current kernel version is 6.8.0-g1df0c7e8a235 vs 6.8.0-g1df0c7e8a235 2024-03-27T09:48:34.098 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-27T09:48:34.098 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-03-27T09:48:35.099 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-03-27T09:48:35.100 DEBUG:teuthology.orchestra.run.smithi118:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-03-27T09:48:35.236 INFO:teuthology.orchestra.run.smithi118.stdout:ttyS1 2024-03-27T09:48:35.267 DEBUG:teuthology.parallel:result is None 2024-03-27T09:49:09.134 DEBUG:teuthology.orchestra.remote:timed out 2024-03-27T09:49:24.135 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com' 2024-03-27T09:49:24.137 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-27T09:49:24.586 DEBUG:teuthology.orchestra.run.smithi057:> true 2024-03-27T09:49:25.277 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi057.front.sepia.ceph.com' 2024-03-27T09:49:25.277 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.8.0-g1df0c7e8a235"... 2024-03-27T09:49:25.277 DEBUG:teuthology.orchestra.run.smithi057:> uname -r 2024-03-27T09:49:25.332 INFO:teuthology.orchestra.run.smithi057.stdout:6.8.0-g1df0c7e8a235 2024-03-27T09:49:25.332 DEBUG:teuthology.task.kernel:current kernel version is 6.8.0-g1df0c7e8a235 vs 6.8.0-g1df0c7e8a235 2024-03-27T09:49:25.332 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-27T09:49:25.332 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-03-27T09:49:26.333 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-03-27T09:49:26.334 DEBUG:teuthology.orchestra.run.smithi057:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-03-27T09:49:26.490 INFO:teuthology.orchestra.run.smithi057.stdout:ttyS1 2024-03-27T09:49:26.546 DEBUG:teuthology.parallel:result is None 2024-03-27T09:49:26.546 INFO:teuthology.run_tasks:Running task internal.base... 2024-03-27T09:49:26.558 INFO:teuthology.task.internal:Creating test directory... 2024-03-27T09:49:26.559 DEBUG:teuthology.orchestra.run.smithi057:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-27T09:49:26.566 DEBUG:teuthology.orchestra.run.smithi118:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-27T09:49:26.624 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-03-27T09:49:26.631 INFO:teuthology.run_tasks:Running task internal.archive... 2024-03-27T09:49:26.640 INFO:teuthology.task.internal:Creating archive directory... 2024-03-27T09:49:26.640 DEBUG:teuthology.orchestra.run.smithi057:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-27T09:49:26.645 DEBUG:teuthology.orchestra.run.smithi118:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-27T09:49:26.721 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-03-27T09:49:26.728 INFO:teuthology.task.internal:Enabling coredump saving... 2024-03-27T09:49:26.728 DEBUG:teuthology.orchestra.run.smithi057:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-27T09:49:26.735 DEBUG:teuthology.orchestra.run.smithi118:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-27T09:49:26.833 INFO:teuthology.orchestra.run.smithi057.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-27T09:49:26.851 INFO:teuthology.orchestra.run.smithi118.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-27T09:49:26.878 INFO:teuthology.orchestra.run.smithi057.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-27T09:49:26.894 INFO:teuthology.orchestra.run.smithi118.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-27T09:49:26.899 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-03-27T09:49:26.906 INFO:teuthology.task.internal:Configuring sudo... 2024-03-27T09:49:26.906 DEBUG:teuthology.orchestra.run.smithi057:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-27T09:49:26.913 DEBUG:teuthology.orchestra.run.smithi118:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-27T09:49:27.006 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-03-27T09:49:27.016 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-03-27T09:49:27.016 DEBUG:teuthology.orchestra.run.smithi057:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-27T09:49:27.024 DEBUG:teuthology.orchestra.run.smithi118:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-27T09:49:27.075 DEBUG:teuthology.orchestra.run.smithi057:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-27T09:49:27.159 DEBUG:teuthology.orchestra.run.smithi057:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-27T09:49:27.298 DEBUG:teuthology.orchestra.run.smithi057:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-27T09:49:27.381 DEBUG:teuthology.orchestra.run.smithi057:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-27T09:49:27.485 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-03-27T09:49:27.485 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-27T09:49:27.589 DEBUG:teuthology.orchestra.run.smithi118:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-27T09:49:27.675 DEBUG:teuthology.orchestra.run.smithi118:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-27T09:49:27.812 DEBUG:teuthology.orchestra.run.smithi118:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-27T09:49:27.897 DEBUG:teuthology.orchestra.run.smithi118:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-27T09:49:27.994 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-03-27T09:49:27.995 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-27T09:49:28.084 DEBUG:teuthology.orchestra.run.smithi057:> sudo service rsyslog restart 2024-03-27T09:49:28.092 DEBUG:teuthology.orchestra.run.smithi118:> sudo service rsyslog restart 2024-03-27T09:49:28.214 INFO:teuthology.orchestra.run.smithi057.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-27T09:49:28.252 INFO:teuthology.orchestra.run.smithi118.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-27T09:49:28.634 INFO:teuthology.run_tasks:Running task internal.timer... 2024-03-27T09:49:28.641 INFO:teuthology.task.internal:Starting timer... 2024-03-27T09:49:28.642 INFO:teuthology.run_tasks:Running task pcp... 2024-03-27T09:49:28.653 INFO:teuthology.run_tasks:Running task selinux... 2024-03-27T09:49:28.663 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-03-27T09:49:28.663 DEBUG:teuthology.orchestra.run.smithi057:> sudo service auditd rotate 2024-03-27T09:49:28.791 INFO:teuthology.orchestra.run.smithi057.stdout:Rotating logs: 2024-03-27T09:49:28.796 DEBUG:teuthology.orchestra.run.smithi118:> sudo service auditd rotate 2024-03-27T09:49:28.926 INFO:teuthology.orchestra.run.smithi118.stdout:Rotating logs: 2024-03-27T09:49:28.932 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-03-27T09:49:28.932 DEBUG:teuthology.orchestra.run.smithi057:> /usr/sbin/getenforce 2024-03-27T09:49:28.995 INFO:teuthology.orchestra.run.smithi057.stdout:Permissive 2024-03-27T09:49:28.995 DEBUG:teuthology.orchestra.run.smithi118:> /usr/sbin/getenforce 2024-03-27T09:49:29.046 INFO:teuthology.orchestra.run.smithi118.stdout:Permissive 2024-03-27T09:49:29.046 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi057.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi118.front.sepia.ceph.com': 'permissive'} 2024-03-27T09:49:29.046 DEBUG:teuthology.orchestra.run.smithi057:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-03-27T09:49:29.129 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-27T09:49:29.130 DEBUG:teuthology.orchestra.run.smithi118:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-03-27T09:49:29.220 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-27T09:49:29.220 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-03-27T09:49:29.221 DEBUG:teuthology.orchestra.run.smithi057:> sudo /usr/sbin/setenforce permissive 2024-03-27T09:49:29.317 DEBUG:teuthology.orchestra.run.smithi118:> sudo /usr/sbin/setenforce permissive 2024-03-27T09:49:29.408 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-03-27T09:49:29.421 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-03-27T09:49:29.443 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-03-27T09:49:29.444 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi057.front.sepia.ceph.com,smithi118.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-03-27T09:55:57.431 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi057.front.sepia.ceph.com'), Remote(name='ubuntu@smithi118.front.sepia.ceph.com')] 2024-03-27T09:55:57.432 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi057.front.sepia.ceph.com' 2024-03-27T09:55:57.433 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi057.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-27T09:55:57.574 DEBUG:teuthology.orchestra.run.smithi057:> true 2024-03-27T09:55:57.710 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi057.front.sepia.ceph.com' 2024-03-27T09:55:57.710 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi118.front.sepia.ceph.com' 2024-03-27T09:55:57.711 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi118.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-27T09:55:57.856 DEBUG:teuthology.orchestra.run.smithi118:> true 2024-03-27T09:55:58.009 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi118.front.sepia.ceph.com' 2024-03-27T09:55:58.009 INFO:teuthology.run_tasks:Running task clock... 2024-03-27T09:55:58.020 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-03-27T09:55:58.020 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-27T09:55:58.021 DEBUG:teuthology.orchestra.run.smithi057:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-27T09:55:58.028 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-27T09:55:58.028 DEBUG:teuthology.orchestra.run.smithi118:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-27T09:55:58.114 INFO:teuthology.orchestra.run.smithi057.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-27T09:55:58.125 INFO:teuthology.orchestra.run.smithi118.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-27T09:55:58.164 INFO:teuthology.orchestra.run.smithi057.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-27T09:55:58.177 INFO:teuthology.orchestra.run.smithi118.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-27T09:55:58.254 INFO:teuthology.orchestra.run.smithi057.stderr:sudo: ntpd: command not found 2024-03-27T09:55:58.267 INFO:teuthology.orchestra.run.smithi118.stderr:sudo: ntpd: command not found 2024-03-27T09:55:58.297 INFO:teuthology.orchestra.run.smithi057.stdout:506 Cannot talk to daemon 2024-03-27T09:55:58.307 INFO:teuthology.orchestra.run.smithi118.stdout:506 Cannot talk to daemon 2024-03-27T09:55:58.352 INFO:teuthology.orchestra.run.smithi057.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-27T09:55:58.356 INFO:teuthology.orchestra.run.smithi118.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-27T09:55:58.406 INFO:teuthology.orchestra.run.smithi118.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-27T09:55:58.409 INFO:teuthology.orchestra.run.smithi057.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-27T09:55:58.539 INFO:teuthology.orchestra.run.smithi118.stderr:bash: line 1: ntpq: command not found 2024-03-27T09:55:58.547 INFO:teuthology.orchestra.run.smithi057.stderr:bash: line 1: ntpq: command not found 2024-03-27T09:55:58.549 INFO:teuthology.orchestra.run.smithi118.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-27T09:55:58.549 INFO:teuthology.orchestra.run.smithi118.stdout:=============================================================================== 2024-03-27T09:55:58.549 INFO:teuthology.orchestra.run.smithi118.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-27T09:55:58.549 INFO:teuthology.orchestra.run.smithi118.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-27T09:55:58.549 INFO:teuthology.orchestra.run.smithi118.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-27T09:55:58.550 INFO:teuthology.orchestra.run.smithi118.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-27T09:55:58.556 INFO:teuthology.orchestra.run.smithi057.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-27T09:55:58.556 INFO:teuthology.orchestra.run.smithi057.stdout:=============================================================================== 2024-03-27T09:55:58.556 INFO:teuthology.orchestra.run.smithi057.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-27T09:55:58.556 INFO:teuthology.orchestra.run.smithi057.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-27T09:55:58.556 INFO:teuthology.orchestra.run.smithi057.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-27T09:55:58.556 INFO:teuthology.orchestra.run.smithi057.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-27T09:55:58.557 INFO:teuthology.run_tasks:Running task install... 2024-03-27T09:55:58.566 DEBUG:teuthology.task.install:project ceph 2024-03-27T09:55:58.566 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '155268c4e432a12433aa833f174f9fe3b1016ae0'}} 2024-03-27T09:55:58.566 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '155268c4e432a12433aa833f174f9fe3b1016ae0'} 2024-03-27T09:55:58.566 INFO:teuthology.task.install:Using flavor: default 2024-03-27T09:55:58.572 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-03-27T09:55:58.572 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-03-27T09:55:58.573 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '155268c4e432a12433aa833f174f9fe3b1016ae0', 'tag': None, 'wait_for_package': False} 2024-03-27T09:55:58.573 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=155268c4e432a12433aa833f174f9fe3b1016ae0 2024-03-27T09:55:58.575 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '155268c4e432a12433aa833f174f9fe3b1016ae0', 'tag': None, 'wait_for_package': False} 2024-03-27T09:55:58.575 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=155268c4e432a12433aa833f174f9fe3b1016ae0 2024-03-27T09:55:58.722 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240326.131558/155268c4e432a12433aa833f174f9fe3b1016ae0/centos/9/flavors/default/ 2024-03-27T09:55:58.722 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2478.g155268c4 2024-03-27T09:55:58.797 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240326.131558/155268c4e432a12433aa833f174f9fe3b1016ae0/centos/9/flavors/default/ 2024-03-27T09:55:58.797 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2478.g155268c4 2024-03-27T09:55:58.833 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240326.131558/155268c4e432a12433aa833f174f9fe3b1016ae0/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240326.131558/155268c4e432a12433aa833f174f9fe3b1016ae0/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240326.131558/155268c4e432a12433aa833f174f9fe3b1016ae0/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-27T09:55:58.834 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-03-27T09:55:58.834 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-27T09:55:58.904 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240326.131558/155268c4e432a12433aa833f174f9fe3b1016ae0/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240326.131558/155268c4e432a12433aa833f174f9fe3b1016ae0/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240326.131558/155268c4e432a12433aa833f174f9fe3b1016ae0/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-27T09:55:58.904 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-03-27T09:55:58.904 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-27T09:55:58.935 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-03-27T09:55:58.935 DEBUG:teuthology.orchestra.run.smithi118:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/155268c4e432a12433aa833f174f9fe3b1016ae0/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-27T09:55:59.014 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-03-27T09:55:59.014 DEBUG:teuthology.orchestra.run.smithi057:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/155268c4e432a12433aa833f174f9fe3b1016ae0/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-27T09:55:59.070 DEBUG:teuthology.orchestra.run.smithi118:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-27T09:55:59.160 DEBUG:teuthology.orchestra.run.smithi057:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-27T09:55:59.199 DEBUG:teuthology.orchestra.run.smithi118:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-27T09:55:59.286 INFO:teuthology.orchestra.run.smithi118.stdout:check_obsoletes = 1 2024-03-27T09:55:59.290 DEBUG:teuthology.orchestra.run.smithi118:> sudo yum clean all 2024-03-27T09:55:59.299 DEBUG:teuthology.orchestra.run.smithi057:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-27T09:55:59.394 INFO:teuthology.orchestra.run.smithi057.stdout:check_obsoletes = 1 2024-03-27T09:55:59.398 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum clean all 2024-03-27T09:55:59.647 INFO:teuthology.orchestra.run.smithi118.stdout:74 files removed 2024-03-27T09:55:59.685 DEBUG:teuthology.orchestra.run.smithi118:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-03-27T09:55:59.776 INFO:teuthology.orchestra.run.smithi057.stdout:74 files removed 2024-03-27T09:55:59.816 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-03-27T09:56:00.639 INFO:teuthology.orchestra.run.smithi118.stdout:ceph packages for x86_64 182 kB/s | 83 kB 00:00 2024-03-27T09:56:00.880 INFO:teuthology.orchestra.run.smithi057.stdout:ceph packages for x86_64 153 kB/s | 83 kB 00:00 2024-03-27T09:56:01.138 INFO:teuthology.orchestra.run.smithi118.stdout:ceph noarch packages 28 kB/s | 12 kB 00:00 2024-03-27T09:56:01.414 INFO:teuthology.orchestra.run.smithi057.stdout:ceph noarch packages 26 kB/s | 12 kB 00:00 2024-03-27T09:56:01.574 INFO:teuthology.orchestra.run.smithi118.stdout:ceph source packages 5.0 kB/s | 1.9 kB 00:00 2024-03-27T09:56:01.906 INFO:teuthology.orchestra.run.smithi057.stdout:ceph source packages 4.6 kB/s | 1.9 kB 00:00 2024-03-27T09:56:02.160 INFO:teuthology.orchestra.run.smithi118.stdout:CentOS-9 - AppStream 13 MB/s | 6.7 MB 00:00 2024-03-27T09:56:02.518 INFO:teuthology.orchestra.run.smithi057.stdout:CentOS-9 - AppStream 12 MB/s | 6.7 MB 00:00 2024-03-27T09:56:03.837 INFO:teuthology.orchestra.run.smithi118.stdout:CentOS-9 - BaseOS 4.8 MB/s | 2.0 MB 00:00 2024-03-27T09:56:04.252 INFO:teuthology.orchestra.run.smithi057.stdout:CentOS-9 - BaseOS 4.5 MB/s | 2.0 MB 00:00 2024-03-27T09:56:05.465 INFO:teuthology.orchestra.run.smithi057.stdout:CentOS Stream 9 - BaseOS 10 MB/s | 8.0 MB 00:00 2024-03-27T09:56:06.507 INFO:teuthology.orchestra.run.smithi118.stdout:CentOS Stream 9 - BaseOS 3.5 MB/s | 8.0 MB 00:02 2024-03-27T09:56:08.141 INFO:teuthology.orchestra.run.smithi057.stdout:CentOS Stream 9 - AppStream 13 MB/s | 19 MB 00:01 2024-03-27T09:56:08.500 INFO:teuthology.orchestra.run.smithi118.stdout:CentOS Stream 9 - AppStream 24 MB/s | 19 MB 00:00 2024-03-27T09:56:14.267 INFO:teuthology.orchestra.run.smithi057.stdout:CentOS Stream 9 - CRB 2.7 MB/s | 6.1 MB 00:02 2024-03-27T09:56:14.842 INFO:teuthology.orchestra.run.smithi118.stdout:CentOS Stream 9 - CRB 2.4 MB/s | 6.1 MB 00:02 2024-03-27T09:56:15.926 INFO:teuthology.orchestra.run.smithi057.stdout:CentOS Stream 9 - Extras packages 57 kB/s | 16 kB 00:00 2024-03-27T09:56:16.410 INFO:teuthology.orchestra.run.smithi118.stdout:CentOS Stream 9 - Extras packages 63 kB/s | 16 kB 00:00 2024-03-27T09:56:19.228 INFO:teuthology.orchestra.run.smithi057.stdout:Extra Packages for Enterprise Linux 6.6 MB/s | 21 MB 00:03 2024-03-27T09:56:20.362 INFO:teuthology.orchestra.run.smithi118.stdout:Extra Packages for Enterprise Linux 5.5 MB/s | 21 MB 00:03 2024-03-27T09:56:25.202 INFO:teuthology.orchestra.run.smithi057.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-03-27T09:56:26.128 INFO:teuthology.orchestra.run.smithi118.stdout:lab-extras 19 kB/s | 1.7 kB 00:00 2024-03-27T09:56:27.935 INFO:teuthology.orchestra.run.smithi057.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-27T09:56:27.937 INFO:teuthology.orchestra.run.smithi057.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-27T09:56:27.952 INFO:teuthology.orchestra.run.smithi057.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-03-27T09:56:27.954 INFO:teuthology.orchestra.run.smithi057.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-03-27T09:56:27.955 INFO:teuthology.orchestra.run.smithi057.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-03-27T09:56:27.956 INFO:teuthology.orchestra.run.smithi057.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-03-27T09:56:27.958 INFO:teuthology.orchestra.run.smithi057.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-03-27T09:56:27.961 INFO:teuthology.orchestra.run.smithi057.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-03-27T09:56:27.963 INFO:teuthology.orchestra.run.smithi057.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-03-27T09:56:28.056 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-03-27T09:56:28.074 INFO:teuthology.orchestra.run.smithi057.stdout:============================================================================================ 2024-03-27T09:56:28.075 INFO:teuthology.orchestra.run.smithi057.stdout: Package Arch Version Repository Size 2024-03-27T09:56:28.075 INFO:teuthology.orchestra.run.smithi057.stdout:============================================================================================ 2024-03-27T09:56:28.075 INFO:teuthology.orchestra.run.smithi057.stdout:Installing: 2024-03-27T09:56:28.075 INFO:teuthology.orchestra.run.smithi057.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-03-27T09:56:28.075 INFO:teuthology.orchestra.run.smithi057.stdout: ceph x86_64 2:19.0.0-2478.g155268c4.el9 ceph 6.6 k 2024-03-27T09:56:28.075 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-base x86_64 2:19.0.0-2478.g155268c4.el9 ceph 5.4 M 2024-03-27T09:56:28.075 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-fuse x86_64 2:19.0.0-2478.g155268c4.el9 ceph 890 k 2024-03-27T09:56:28.075 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2478.g155268c4.el9 ceph 145 k 2024-03-27T09:56:28.075 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr x86_64 2:19.0.0-2478.g155268c4.el9 ceph 1.5 M 2024-03-27T09:56:28.075 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2478.g155268c4.el9 ceph-noarch 141 k 2024-03-27T09:56:28.075 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2478.g155268c4.el9 ceph-noarch 3.5 M 2024-03-27T09:56:28.075 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2478.g155268c4.el9 ceph-noarch 7.4 M 2024-03-27T09:56:28.075 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-rook noarch 2:19.0.0-2478.g155268c4.el9 ceph-noarch 49 k 2024-03-27T09:56:28.076 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-radosgw x86_64 2:19.0.0-2478.g155268c4.el9 ceph 9.8 M 2024-03-27T09:56:28.076 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-test x86_64 2:19.0.0-2478.g155268c4.el9 ceph 48 M 2024-03-27T09:56:28.076 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-volume noarch 2:19.0.0-2478.g155268c4.el9 ceph-noarch 264 k 2024-03-27T09:56:28.076 INFO:teuthology.orchestra.run.smithi057.stdout: cephadm noarch 2:19.0.0-2478.g155268c4.el9 ceph-noarch 762 k 2024-03-27T09:56:28.076 INFO:teuthology.orchestra.run.smithi057.stdout: cephfs-mirror x86_64 2:19.0.0-2478.g155268c4.el9 ceph 221 k 2024-03-27T09:56:28.076 INFO:teuthology.orchestra.run.smithi057.stdout: cephfs-shell x86_64 2:19.0.0-2478.g155268c4.el9 ceph 27 k 2024-03-27T09:56:28.076 INFO:teuthology.orchestra.run.smithi057.stdout: cephfs-top noarch 2:19.0.0-2478.g155268c4.el9 ceph-noarch 18 k 2024-03-27T09:56:28.076 INFO:teuthology.orchestra.run.smithi057.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-03-27T09:56:28.076 INFO:teuthology.orchestra.run.smithi057.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-03-27T09:56:28.076 INFO:teuthology.orchestra.run.smithi057.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-03-27T09:56:28.076 INFO:teuthology.orchestra.run.smithi057.stdout: libcephfs-devel x86_64 2:19.0.0-2478.g155268c4.el9 ceph 32 k 2024-03-27T09:56:28.076 INFO:teuthology.orchestra.run.smithi057.stdout: libcephfs2 x86_64 2:19.0.0-2478.g155268c4.el9 ceph 746 k 2024-03-27T09:56:28.076 INFO:teuthology.orchestra.run.smithi057.stdout: librados-devel x86_64 2:19.0.0-2478.g155268c4.el9 ceph 127 k 2024-03-27T09:56:28.076 INFO:teuthology.orchestra.run.smithi057.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-03-27T09:56:28.076 INFO:teuthology.orchestra.run.smithi057.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-03-27T09:56:28.077 INFO:teuthology.orchestra.run.smithi057.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-03-27T09:56:28.077 INFO:teuthology.orchestra.run.smithi057.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-03-27T09:56:28.077 INFO:teuthology.orchestra.run.smithi057.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-03-27T09:56:28.077 INFO:teuthology.orchestra.run.smithi057.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-03-27T09:56:28.077 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cephfs x86_64 2:19.0.0-2478.g155268c4.el9 ceph 162 k 2024-03-27T09:56:28.077 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rados x86_64 2:19.0.0-2478.g155268c4.el9 ceph 320 k 2024-03-27T09:56:28.077 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rbd x86_64 2:19.0.0-2478.g155268c4.el9 ceph 298 k 2024-03-27T09:56:28.077 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rgw x86_64 2:19.0.0-2478.g155268c4.el9 ceph 99 k 2024-03-27T09:56:28.077 INFO:teuthology.orchestra.run.smithi057.stdout: rbd-fuse x86_64 2:19.0.0-2478.g155268c4.el9 ceph 85 k 2024-03-27T09:56:28.077 INFO:teuthology.orchestra.run.smithi057.stdout: rbd-mirror x86_64 2:19.0.0-2478.g155268c4.el9 ceph 3.1 M 2024-03-27T09:56:28.077 INFO:teuthology.orchestra.run.smithi057.stdout: rbd-nbd x86_64 2:19.0.0-2478.g155268c4.el9 ceph 170 k 2024-03-27T09:56:28.077 INFO:teuthology.orchestra.run.smithi057.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-03-27T09:56:28.077 INFO:teuthology.orchestra.run.smithi057.stdout:Upgrading: 2024-03-27T09:56:28.078 INFO:teuthology.orchestra.run.smithi057.stdout: NetworkManager x86_64 1:1.47.2-1.el9 baseos 2.3 M 2024-03-27T09:56:28.078 INFO:teuthology.orchestra.run.smithi057.stdout: NetworkManager-libnm x86_64 1:1.47.2-1.el9 baseos 1.8 M 2024-03-27T09:56:28.078 INFO:teuthology.orchestra.run.smithi057.stdout: NetworkManager-team x86_64 1:1.47.2-1.el9 baseos 42 k 2024-03-27T09:56:28.078 INFO:teuthology.orchestra.run.smithi057.stdout: NetworkManager-tui x86_64 1:1.47.2-1.el9 baseos 248 k 2024-03-27T09:56:28.078 INFO:teuthology.orchestra.run.smithi057.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-03-27T09:56:28.078 INFO:teuthology.orchestra.run.smithi057.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-03-27T09:56:28.078 INFO:teuthology.orchestra.run.smithi057.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-03-27T09:56:28.078 INFO:teuthology.orchestra.run.smithi057.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-03-27T09:56:28.078 INFO:teuthology.orchestra.run.smithi057.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-03-27T09:56:28.078 INFO:teuthology.orchestra.run.smithi057.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-03-27T09:56:28.078 INFO:teuthology.orchestra.run.smithi057.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-03-27T09:56:28.078 INFO:teuthology.orchestra.run.smithi057.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-03-27T09:56:28.078 INFO:teuthology.orchestra.run.smithi057.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-03-27T09:56:28.078 INFO:teuthology.orchestra.run.smithi057.stdout: librados2 x86_64 2:19.0.0-2478.g155268c4.el9 ceph 3.4 M 2024-03-27T09:56:28.079 INFO:teuthology.orchestra.run.smithi057.stdout: librbd1 x86_64 2:19.0.0-2478.g155268c4.el9 ceph 3.1 M 2024-03-27T09:56:28.079 INFO:teuthology.orchestra.run.smithi057.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-03-27T09:56:28.079 INFO:teuthology.orchestra.run.smithi057.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-03-27T09:56:28.079 INFO:teuthology.orchestra.run.smithi057.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-03-27T09:56:28.079 INFO:teuthology.orchestra.run.smithi057.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-03-27T09:56:28.079 INFO:teuthology.orchestra.run.smithi057.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-03-27T09:56:28.079 INFO:teuthology.orchestra.run.smithi057.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-03-27T09:56:28.079 INFO:teuthology.orchestra.run.smithi057.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-03-27T09:56:28.079 INFO:teuthology.orchestra.run.smithi057.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-03-27T09:56:28.079 INFO:teuthology.orchestra.run.smithi057.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-03-27T09:56:28.079 INFO:teuthology.orchestra.run.smithi057.stdout:Installing dependencies: 2024-03-27T09:56:28.079 INFO:teuthology.orchestra.run.smithi057.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-03-27T09:56:28.079 INFO:teuthology.orchestra.run.smithi057.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-03-27T09:56:28.079 INFO:teuthology.orchestra.run.smithi057.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-03-27T09:56:28.080 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-common x86_64 2:19.0.0-2478.g155268c4.el9 ceph 21 M 2024-03-27T09:56:28.080 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2478.g155268c4.el9 ceph-noarch 34 k 2024-03-27T09:56:28.080 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mds x86_64 2:19.0.0-2478.g155268c4.el9 ceph 2.4 M 2024-03-27T09:56:28.080 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2478.g155268c4.el9 ceph-noarch 249 k 2024-03-27T09:56:28.080 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mon x86_64 2:19.0.0-2478.g155268c4.el9 ceph 4.7 M 2024-03-27T09:56:28.080 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-osd x86_64 2:19.0.0-2478.g155268c4.el9 ceph 17 M 2024-03-27T09:56:28.080 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2478.g155268c4.el9 ceph-noarch 16 k 2024-03-27T09:56:28.080 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-selinux x86_64 2:19.0.0-2478.g155268c4.el9 ceph 25 k 2024-03-27T09:56:28.080 INFO:teuthology.orchestra.run.smithi057.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-03-27T09:56:28.080 INFO:teuthology.orchestra.run.smithi057.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-03-27T09:56:28.080 INFO:teuthology.orchestra.run.smithi057.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-03-27T09:56:28.080 INFO:teuthology.orchestra.run.smithi057.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-03-27T09:56:28.080 INFO:teuthology.orchestra.run.smithi057.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-03-27T09:56:28.081 INFO:teuthology.orchestra.run.smithi057.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-03-27T09:56:28.081 INFO:teuthology.orchestra.run.smithi057.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-03-27T09:56:28.081 INFO:teuthology.orchestra.run.smithi057.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-03-27T09:56:28.081 INFO:teuthology.orchestra.run.smithi057.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-03-27T09:56:28.081 INFO:teuthology.orchestra.run.smithi057.stdout: libcephsqlite x86_64 2:19.0.0-2478.g155268c4.el9 ceph 163 k 2024-03-27T09:56:28.081 INFO:teuthology.orchestra.run.smithi057.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-03-27T09:56:28.081 INFO:teuthology.orchestra.run.smithi057.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-03-27T09:56:28.081 INFO:teuthology.orchestra.run.smithi057.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-03-27T09:56:28.081 INFO:teuthology.orchestra.run.smithi057.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-03-27T09:56:28.081 INFO:teuthology.orchestra.run.smithi057.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-03-27T09:56:28.081 INFO:teuthology.orchestra.run.smithi057.stdout: libradosstriper1 x86_64 2:19.0.0-2478.g155268c4.el9 ceph 501 k 2024-03-27T09:56:28.081 INFO:teuthology.orchestra.run.smithi057.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-03-27T09:56:28.081 INFO:teuthology.orchestra.run.smithi057.stdout: librgw2 x86_64 2:19.0.0-2478.g155268c4.el9 ceph 5.1 M 2024-03-27T09:56:28.082 INFO:teuthology.orchestra.run.smithi057.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-03-27T09:56:28.082 INFO:teuthology.orchestra.run.smithi057.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-03-27T09:56:28.082 INFO:teuthology.orchestra.run.smithi057.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-03-27T09:56:28.082 INFO:teuthology.orchestra.run.smithi057.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-03-27T09:56:28.082 INFO:teuthology.orchestra.run.smithi057.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-03-27T09:56:28.082 INFO:teuthology.orchestra.run.smithi057.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-03-27T09:56:28.082 INFO:teuthology.orchestra.run.smithi057.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-03-27T09:56:28.082 INFO:teuthology.orchestra.run.smithi057.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-03-27T09:56:28.082 INFO:teuthology.orchestra.run.smithi057.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-03-27T09:56:28.082 INFO:teuthology.orchestra.run.smithi057.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-03-27T09:56:28.082 INFO:teuthology.orchestra.run.smithi057.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-03-27T09:56:28.082 INFO:teuthology.orchestra.run.smithi057.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-03-27T09:56:28.082 INFO:teuthology.orchestra.run.smithi057.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-03-27T09:56:28.082 INFO:teuthology.orchestra.run.smithi057.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-03-27T09:56:28.083 INFO:teuthology.orchestra.run.smithi057.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-03-27T09:56:28.083 INFO:teuthology.orchestra.run.smithi057.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-03-27T09:56:28.083 INFO:teuthology.orchestra.run.smithi057.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-03-27T09:56:28.083 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-03-27T09:56:28.083 INFO:teuthology.orchestra.run.smithi057.stdout: python3-ceph-argparse x86_64 2:19.0.0-2478.g155268c4.el9 ceph 45 k 2024-03-27T09:56:28.083 INFO:teuthology.orchestra.run.smithi057.stdout: python3-ceph-common x86_64 2:19.0.0-2478.g155268c4.el9 ceph 134 k 2024-03-27T09:56:28.083 INFO:teuthology.orchestra.run.smithi057.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-03-27T09:56:28.083 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-03-27T09:56:28.084 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-03-27T09:56:28.084 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-03-27T09:56:28.084 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-03-27T09:56:28.084 INFO:teuthology.orchestra.run.smithi057.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-03-27T09:56:28.084 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-03-27T09:56:28.084 INFO:teuthology.orchestra.run.smithi057.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-03-27T09:56:28.084 INFO:teuthology.orchestra.run.smithi057.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-03-27T09:56:28.084 INFO:teuthology.orchestra.run.smithi057.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-03-27T09:56:28.084 INFO:teuthology.orchestra.run.smithi057.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-03-27T09:56:28.084 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-03-27T09:56:28.084 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-03-27T09:56:28.084 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-03-27T09:56:28.084 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-03-27T09:56:28.085 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-03-27T09:56:28.085 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-03-27T09:56:28.085 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-03-27T09:56:28.085 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-03-27T09:56:28.085 INFO:teuthology.orchestra.run.smithi057.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-03-27T09:56:28.085 INFO:teuthology.orchestra.run.smithi057.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-03-27T09:56:28.085 INFO:teuthology.orchestra.run.smithi057.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-03-27T09:56:28.085 INFO:teuthology.orchestra.run.smithi057.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-03-27T09:56:28.085 INFO:teuthology.orchestra.run.smithi057.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-03-27T09:56:28.085 INFO:teuthology.orchestra.run.smithi057.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-03-27T09:56:28.085 INFO:teuthology.orchestra.run.smithi057.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-03-27T09:56:28.085 INFO:teuthology.orchestra.run.smithi057.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-03-27T09:56:28.085 INFO:teuthology.orchestra.run.smithi057.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-03-27T09:56:28.085 INFO:teuthology.orchestra.run.smithi057.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-03-27T09:56:28.086 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-03-27T09:56:28.086 INFO:teuthology.orchestra.run.smithi057.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-03-27T09:56:28.086 INFO:teuthology.orchestra.run.smithi057.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-03-27T09:56:28.086 INFO:teuthology.orchestra.run.smithi057.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-03-27T09:56:28.086 INFO:teuthology.orchestra.run.smithi057.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-03-27T09:56:28.086 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-03-27T09:56:28.086 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-03-27T09:56:28.086 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-03-27T09:56:28.086 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-03-27T09:56:28.086 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-03-27T09:56:28.086 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-03-27T09:56:28.086 INFO:teuthology.orchestra.run.smithi057.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-03-27T09:56:28.087 INFO:teuthology.orchestra.run.smithi057.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-03-27T09:56:28.087 INFO:teuthology.orchestra.run.smithi057.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-03-27T09:56:28.087 INFO:teuthology.orchestra.run.smithi057.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-03-27T09:56:28.087 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-03-27T09:56:28.087 INFO:teuthology.orchestra.run.smithi057.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-03-27T09:56:28.087 INFO:teuthology.orchestra.run.smithi057.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-03-27T09:56:28.087 INFO:teuthology.orchestra.run.smithi057.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-03-27T09:56:28.087 INFO:teuthology.orchestra.run.smithi057.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-03-27T09:56:28.087 INFO:teuthology.orchestra.run.smithi057.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-03-27T09:56:28.087 INFO:teuthology.orchestra.run.smithi057.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-03-27T09:56:28.087 INFO:teuthology.orchestra.run.smithi057.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-03-27T09:56:28.087 INFO:teuthology.orchestra.run.smithi057.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-03-27T09:56:28.087 INFO:teuthology.orchestra.run.smithi057.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-03-27T09:56:28.087 INFO:teuthology.orchestra.run.smithi057.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-03-27T09:56:28.088 INFO:teuthology.orchestra.run.smithi057.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-03-27T09:56:28.088 INFO:teuthology.orchestra.run.smithi057.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-03-27T09:56:28.088 INFO:teuthology.orchestra.run.smithi057.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-03-27T09:56:28.088 INFO:teuthology.orchestra.run.smithi057.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-03-27T09:56:28.088 INFO:teuthology.orchestra.run.smithi057.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-03-27T09:56:28.088 INFO:teuthology.orchestra.run.smithi057.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-03-27T09:56:28.088 INFO:teuthology.orchestra.run.smithi057.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-03-27T09:56:28.088 INFO:teuthology.orchestra.run.smithi057.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-03-27T09:56:28.088 INFO:teuthology.orchestra.run.smithi057.stdout:Installing weak dependencies: 2024-03-27T09:56:28.088 INFO:teuthology.orchestra.run.smithi057.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-03-27T09:56:28.088 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T09:56:28.088 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction Summary 2024-03-27T09:56:28.088 INFO:teuthology.orchestra.run.smithi057.stdout:============================================================================================ 2024-03-27T09:56:28.088 INFO:teuthology.orchestra.run.smithi057.stdout:Install 150 Packages 2024-03-27T09:56:28.088 INFO:teuthology.orchestra.run.smithi057.stdout:Upgrade 24 Packages 2024-03-27T09:56:28.089 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T09:56:28.089 INFO:teuthology.orchestra.run.smithi057.stdout:Total download size: 227 M 2024-03-27T09:56:28.089 INFO:teuthology.orchestra.run.smithi057.stdout:Downloading Packages: 2024-03-27T09:56:28.790 INFO:teuthology.orchestra.run.smithi118.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-27T09:56:28.792 INFO:teuthology.orchestra.run.smithi118.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-27T09:56:28.815 INFO:teuthology.orchestra.run.smithi118.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-03-27T09:56:28.817 INFO:teuthology.orchestra.run.smithi118.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-03-27T09:56:28.818 INFO:teuthology.orchestra.run.smithi118.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-03-27T09:56:28.819 INFO:teuthology.orchestra.run.smithi118.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-03-27T09:56:28.822 INFO:teuthology.orchestra.run.smithi118.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-03-27T09:56:28.826 INFO:teuthology.orchestra.run.smithi118.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-03-27T09:56:28.827 INFO:teuthology.orchestra.run.smithi118.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-03-27T09:56:28.916 INFO:teuthology.orchestra.run.smithi118.stdout:Dependencies resolved. 2024-03-27T09:56:28.939 INFO:teuthology.orchestra.run.smithi118.stdout:============================================================================================ 2024-03-27T09:56:28.940 INFO:teuthology.orchestra.run.smithi118.stdout: Package Arch Version Repository Size 2024-03-27T09:56:28.940 INFO:teuthology.orchestra.run.smithi118.stdout:============================================================================================ 2024-03-27T09:56:28.940 INFO:teuthology.orchestra.run.smithi118.stdout:Installing: 2024-03-27T09:56:28.940 INFO:teuthology.orchestra.run.smithi118.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-03-27T09:56:28.940 INFO:teuthology.orchestra.run.smithi118.stdout: ceph x86_64 2:19.0.0-2478.g155268c4.el9 ceph 6.6 k 2024-03-27T09:56:28.940 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-base x86_64 2:19.0.0-2478.g155268c4.el9 ceph 5.4 M 2024-03-27T09:56:28.940 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-fuse x86_64 2:19.0.0-2478.g155268c4.el9 ceph 890 k 2024-03-27T09:56:28.940 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2478.g155268c4.el9 ceph 145 k 2024-03-27T09:56:28.940 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr x86_64 2:19.0.0-2478.g155268c4.el9 ceph 1.5 M 2024-03-27T09:56:28.940 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2478.g155268c4.el9 ceph-noarch 141 k 2024-03-27T09:56:28.940 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2478.g155268c4.el9 ceph-noarch 3.5 M 2024-03-27T09:56:28.940 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2478.g155268c4.el9 ceph-noarch 7.4 M 2024-03-27T09:56:28.940 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-rook noarch 2:19.0.0-2478.g155268c4.el9 ceph-noarch 49 k 2024-03-27T09:56:28.940 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-radosgw x86_64 2:19.0.0-2478.g155268c4.el9 ceph 9.8 M 2024-03-27T09:56:28.941 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-test x86_64 2:19.0.0-2478.g155268c4.el9 ceph 48 M 2024-03-27T09:56:28.941 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-volume noarch 2:19.0.0-2478.g155268c4.el9 ceph-noarch 264 k 2024-03-27T09:56:28.941 INFO:teuthology.orchestra.run.smithi118.stdout: cephadm noarch 2:19.0.0-2478.g155268c4.el9 ceph-noarch 762 k 2024-03-27T09:56:28.941 INFO:teuthology.orchestra.run.smithi118.stdout: cephfs-mirror x86_64 2:19.0.0-2478.g155268c4.el9 ceph 221 k 2024-03-27T09:56:28.941 INFO:teuthology.orchestra.run.smithi118.stdout: cephfs-shell x86_64 2:19.0.0-2478.g155268c4.el9 ceph 27 k 2024-03-27T09:56:28.941 INFO:teuthology.orchestra.run.smithi118.stdout: cephfs-top noarch 2:19.0.0-2478.g155268c4.el9 ceph-noarch 18 k 2024-03-27T09:56:28.941 INFO:teuthology.orchestra.run.smithi118.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-03-27T09:56:28.941 INFO:teuthology.orchestra.run.smithi118.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-03-27T09:56:28.941 INFO:teuthology.orchestra.run.smithi118.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-03-27T09:56:28.941 INFO:teuthology.orchestra.run.smithi118.stdout: libcephfs-devel x86_64 2:19.0.0-2478.g155268c4.el9 ceph 32 k 2024-03-27T09:56:28.941 INFO:teuthology.orchestra.run.smithi118.stdout: libcephfs2 x86_64 2:19.0.0-2478.g155268c4.el9 ceph 746 k 2024-03-27T09:56:28.941 INFO:teuthology.orchestra.run.smithi118.stdout: librados-devel x86_64 2:19.0.0-2478.g155268c4.el9 ceph 127 k 2024-03-27T09:56:28.941 INFO:teuthology.orchestra.run.smithi118.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-03-27T09:56:28.941 INFO:teuthology.orchestra.run.smithi118.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-03-27T09:56:28.942 INFO:teuthology.orchestra.run.smithi118.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-03-27T09:56:28.942 INFO:teuthology.orchestra.run.smithi118.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-03-27T09:56:28.942 INFO:teuthology.orchestra.run.smithi118.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-03-27T09:56:28.942 INFO:teuthology.orchestra.run.smithi118.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-03-27T09:56:28.942 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cephfs x86_64 2:19.0.0-2478.g155268c4.el9 ceph 162 k 2024-03-27T09:56:28.942 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rados x86_64 2:19.0.0-2478.g155268c4.el9 ceph 320 k 2024-03-27T09:56:28.942 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rbd x86_64 2:19.0.0-2478.g155268c4.el9 ceph 298 k 2024-03-27T09:56:28.942 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rgw x86_64 2:19.0.0-2478.g155268c4.el9 ceph 99 k 2024-03-27T09:56:28.942 INFO:teuthology.orchestra.run.smithi118.stdout: rbd-fuse x86_64 2:19.0.0-2478.g155268c4.el9 ceph 85 k 2024-03-27T09:56:28.942 INFO:teuthology.orchestra.run.smithi118.stdout: rbd-mirror x86_64 2:19.0.0-2478.g155268c4.el9 ceph 3.1 M 2024-03-27T09:56:28.942 INFO:teuthology.orchestra.run.smithi118.stdout: rbd-nbd x86_64 2:19.0.0-2478.g155268c4.el9 ceph 170 k 2024-03-27T09:56:28.942 INFO:teuthology.orchestra.run.smithi118.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-03-27T09:56:28.942 INFO:teuthology.orchestra.run.smithi118.stdout:Upgrading: 2024-03-27T09:56:28.942 INFO:teuthology.orchestra.run.smithi118.stdout: NetworkManager x86_64 1:1.47.2-1.el9 baseos 2.3 M 2024-03-27T09:56:28.943 INFO:teuthology.orchestra.run.smithi118.stdout: NetworkManager-libnm x86_64 1:1.47.2-1.el9 baseos 1.8 M 2024-03-27T09:56:28.943 INFO:teuthology.orchestra.run.smithi118.stdout: NetworkManager-team x86_64 1:1.47.2-1.el9 baseos 42 k 2024-03-27T09:56:28.943 INFO:teuthology.orchestra.run.smithi118.stdout: NetworkManager-tui x86_64 1:1.47.2-1.el9 baseos 248 k 2024-03-27T09:56:28.943 INFO:teuthology.orchestra.run.smithi118.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-03-27T09:56:28.943 INFO:teuthology.orchestra.run.smithi118.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-03-27T09:56:28.943 INFO:teuthology.orchestra.run.smithi118.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-03-27T09:56:28.943 INFO:teuthology.orchestra.run.smithi118.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-03-27T09:56:28.943 INFO:teuthology.orchestra.run.smithi118.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-03-27T09:56:28.943 INFO:teuthology.orchestra.run.smithi118.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-03-27T09:56:28.943 INFO:teuthology.orchestra.run.smithi118.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-03-27T09:56:28.943 INFO:teuthology.orchestra.run.smithi118.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-03-27T09:56:28.943 INFO:teuthology.orchestra.run.smithi118.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-03-27T09:56:28.944 INFO:teuthology.orchestra.run.smithi118.stdout: librados2 x86_64 2:19.0.0-2478.g155268c4.el9 ceph 3.4 M 2024-03-27T09:56:28.944 INFO:teuthology.orchestra.run.smithi118.stdout: librbd1 x86_64 2:19.0.0-2478.g155268c4.el9 ceph 3.1 M 2024-03-27T09:56:28.944 INFO:teuthology.orchestra.run.smithi118.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-03-27T09:56:28.944 INFO:teuthology.orchestra.run.smithi118.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-03-27T09:56:28.944 INFO:teuthology.orchestra.run.smithi118.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-03-27T09:56:28.944 INFO:teuthology.orchestra.run.smithi118.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-03-27T09:56:28.944 INFO:teuthology.orchestra.run.smithi118.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-03-27T09:56:28.944 INFO:teuthology.orchestra.run.smithi118.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-03-27T09:56:28.944 INFO:teuthology.orchestra.run.smithi118.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-03-27T09:56:28.944 INFO:teuthology.orchestra.run.smithi118.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-03-27T09:56:28.944 INFO:teuthology.orchestra.run.smithi118.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-03-27T09:56:28.944 INFO:teuthology.orchestra.run.smithi118.stdout:Installing dependencies: 2024-03-27T09:56:28.944 INFO:teuthology.orchestra.run.smithi118.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-03-27T09:56:28.944 INFO:teuthology.orchestra.run.smithi118.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-03-27T09:56:28.945 INFO:teuthology.orchestra.run.smithi118.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-03-27T09:56:28.945 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-common x86_64 2:19.0.0-2478.g155268c4.el9 ceph 21 M 2024-03-27T09:56:28.945 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2478.g155268c4.el9 ceph-noarch 34 k 2024-03-27T09:56:28.945 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mds x86_64 2:19.0.0-2478.g155268c4.el9 ceph 2.4 M 2024-03-27T09:56:28.945 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2478.g155268c4.el9 ceph-noarch 249 k 2024-03-27T09:56:28.945 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mon x86_64 2:19.0.0-2478.g155268c4.el9 ceph 4.7 M 2024-03-27T09:56:28.945 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-osd x86_64 2:19.0.0-2478.g155268c4.el9 ceph 17 M 2024-03-27T09:56:28.945 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2478.g155268c4.el9 ceph-noarch 16 k 2024-03-27T09:56:28.945 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-selinux x86_64 2:19.0.0-2478.g155268c4.el9 ceph 25 k 2024-03-27T09:56:28.945 INFO:teuthology.orchestra.run.smithi118.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-03-27T09:56:28.945 INFO:teuthology.orchestra.run.smithi118.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-03-27T09:56:28.945 INFO:teuthology.orchestra.run.smithi118.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-03-27T09:56:28.945 INFO:teuthology.orchestra.run.smithi118.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-03-27T09:56:28.945 INFO:teuthology.orchestra.run.smithi118.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-03-27T09:56:28.945 INFO:teuthology.orchestra.run.smithi118.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-03-27T09:56:28.946 INFO:teuthology.orchestra.run.smithi118.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-03-27T09:56:28.946 INFO:teuthology.orchestra.run.smithi118.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-03-27T09:56:28.946 INFO:teuthology.orchestra.run.smithi118.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-03-27T09:56:28.946 INFO:teuthology.orchestra.run.smithi118.stdout: libcephsqlite x86_64 2:19.0.0-2478.g155268c4.el9 ceph 163 k 2024-03-27T09:56:28.946 INFO:teuthology.orchestra.run.smithi118.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-03-27T09:56:28.946 INFO:teuthology.orchestra.run.smithi118.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-03-27T09:56:28.946 INFO:teuthology.orchestra.run.smithi118.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-03-27T09:56:28.946 INFO:teuthology.orchestra.run.smithi118.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-03-27T09:56:28.946 INFO:teuthology.orchestra.run.smithi118.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-03-27T09:56:28.946 INFO:teuthology.orchestra.run.smithi118.stdout: libradosstriper1 x86_64 2:19.0.0-2478.g155268c4.el9 ceph 501 k 2024-03-27T09:56:28.946 INFO:teuthology.orchestra.run.smithi118.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-03-27T09:56:28.946 INFO:teuthology.orchestra.run.smithi118.stdout: librgw2 x86_64 2:19.0.0-2478.g155268c4.el9 ceph 5.1 M 2024-03-27T09:56:28.946 INFO:teuthology.orchestra.run.smithi118.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-03-27T09:56:28.946 INFO:teuthology.orchestra.run.smithi118.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-03-27T09:56:28.946 INFO:teuthology.orchestra.run.smithi118.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-03-27T09:56:28.947 INFO:teuthology.orchestra.run.smithi118.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-03-27T09:56:28.947 INFO:teuthology.orchestra.run.smithi118.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-03-27T09:56:28.947 INFO:teuthology.orchestra.run.smithi118.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-03-27T09:56:28.947 INFO:teuthology.orchestra.run.smithi118.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-03-27T09:56:28.947 INFO:teuthology.orchestra.run.smithi118.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-03-27T09:56:28.947 INFO:teuthology.orchestra.run.smithi118.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-03-27T09:56:28.947 INFO:teuthology.orchestra.run.smithi118.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-03-27T09:56:28.947 INFO:teuthology.orchestra.run.smithi118.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-03-27T09:56:28.947 INFO:teuthology.orchestra.run.smithi118.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-03-27T09:56:28.947 INFO:teuthology.orchestra.run.smithi118.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-03-27T09:56:28.947 INFO:teuthology.orchestra.run.smithi118.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-03-27T09:56:28.947 INFO:teuthology.orchestra.run.smithi118.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-03-27T09:56:28.947 INFO:teuthology.orchestra.run.smithi118.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-03-27T09:56:28.947 INFO:teuthology.orchestra.run.smithi118.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-03-27T09:56:28.947 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-03-27T09:56:28.948 INFO:teuthology.orchestra.run.smithi118.stdout: python3-ceph-argparse x86_64 2:19.0.0-2478.g155268c4.el9 ceph 45 k 2024-03-27T09:56:28.948 INFO:teuthology.orchestra.run.smithi118.stdout: python3-ceph-common x86_64 2:19.0.0-2478.g155268c4.el9 ceph 134 k 2024-03-27T09:56:28.948 INFO:teuthology.orchestra.run.smithi118.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-03-27T09:56:28.948 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-03-27T09:56:28.948 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-03-27T09:56:28.948 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-03-27T09:56:28.948 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-03-27T09:56:28.948 INFO:teuthology.orchestra.run.smithi118.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-03-27T09:56:28.948 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-03-27T09:56:28.948 INFO:teuthology.orchestra.run.smithi118.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-03-27T09:56:28.948 INFO:teuthology.orchestra.run.smithi118.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-03-27T09:56:28.948 INFO:teuthology.orchestra.run.smithi118.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-03-27T09:56:28.948 INFO:teuthology.orchestra.run.smithi118.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-03-27T09:56:28.948 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-03-27T09:56:28.948 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-03-27T09:56:28.949 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-03-27T09:56:28.949 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-03-27T09:56:28.949 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-03-27T09:56:28.949 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-03-27T09:56:28.949 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-03-27T09:56:28.949 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-03-27T09:56:28.949 INFO:teuthology.orchestra.run.smithi118.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-03-27T09:56:28.949 INFO:teuthology.orchestra.run.smithi118.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-03-27T09:56:28.949 INFO:teuthology.orchestra.run.smithi118.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-03-27T09:56:28.949 INFO:teuthology.orchestra.run.smithi118.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-03-27T09:56:28.949 INFO:teuthology.orchestra.run.smithi118.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-03-27T09:56:28.949 INFO:teuthology.orchestra.run.smithi118.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-03-27T09:56:28.949 INFO:teuthology.orchestra.run.smithi118.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-03-27T09:56:28.950 INFO:teuthology.orchestra.run.smithi118.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-03-27T09:56:28.950 INFO:teuthology.orchestra.run.smithi118.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-03-27T09:56:28.950 INFO:teuthology.orchestra.run.smithi118.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-03-27T09:56:28.950 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-03-27T09:56:28.950 INFO:teuthology.orchestra.run.smithi118.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-03-27T09:56:28.950 INFO:teuthology.orchestra.run.smithi118.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-03-27T09:56:28.950 INFO:teuthology.orchestra.run.smithi118.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-03-27T09:56:28.950 INFO:teuthology.orchestra.run.smithi118.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-03-27T09:56:28.950 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-03-27T09:56:28.950 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-03-27T09:56:28.950 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-03-27T09:56:28.951 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-03-27T09:56:28.951 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-03-27T09:56:28.951 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-03-27T09:56:28.951 INFO:teuthology.orchestra.run.smithi118.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-03-27T09:56:28.951 INFO:teuthology.orchestra.run.smithi118.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-03-27T09:56:28.951 INFO:teuthology.orchestra.run.smithi118.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-03-27T09:56:28.951 INFO:teuthology.orchestra.run.smithi118.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-03-27T09:56:28.951 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-03-27T09:56:28.951 INFO:teuthology.orchestra.run.smithi118.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-03-27T09:56:28.951 INFO:teuthology.orchestra.run.smithi118.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-03-27T09:56:28.951 INFO:teuthology.orchestra.run.smithi118.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-03-27T09:56:28.951 INFO:teuthology.orchestra.run.smithi118.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-03-27T09:56:28.951 INFO:teuthology.orchestra.run.smithi118.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-03-27T09:56:28.951 INFO:teuthology.orchestra.run.smithi118.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-03-27T09:56:28.951 INFO:teuthology.orchestra.run.smithi118.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-03-27T09:56:28.952 INFO:teuthology.orchestra.run.smithi118.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-03-27T09:56:28.952 INFO:teuthology.orchestra.run.smithi118.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-03-27T09:56:28.952 INFO:teuthology.orchestra.run.smithi118.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-03-27T09:56:28.952 INFO:teuthology.orchestra.run.smithi118.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-03-27T09:56:28.952 INFO:teuthology.orchestra.run.smithi118.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-03-27T09:56:28.952 INFO:teuthology.orchestra.run.smithi118.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-03-27T09:56:28.952 INFO:teuthology.orchestra.run.smithi118.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-03-27T09:56:28.952 INFO:teuthology.orchestra.run.smithi118.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-03-27T09:56:28.952 INFO:teuthology.orchestra.run.smithi118.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-03-27T09:56:28.952 INFO:teuthology.orchestra.run.smithi118.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-03-27T09:56:28.952 INFO:teuthology.orchestra.run.smithi118.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-03-27T09:56:28.952 INFO:teuthology.orchestra.run.smithi118.stdout:Installing weak dependencies: 2024-03-27T09:56:28.952 INFO:teuthology.orchestra.run.smithi118.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-03-27T09:56:28.952 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-27T09:56:28.953 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction Summary 2024-03-27T09:56:28.953 INFO:teuthology.orchestra.run.smithi118.stdout:============================================================================================ 2024-03-27T09:56:28.953 INFO:teuthology.orchestra.run.smithi118.stdout:Install 150 Packages 2024-03-27T09:56:28.953 INFO:teuthology.orchestra.run.smithi118.stdout:Upgrade 24 Packages 2024-03-27T09:56:28.953 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-27T09:56:28.953 INFO:teuthology.orchestra.run.smithi118.stdout:Total download size: 227 M 2024-03-27T09:56:28.953 INFO:teuthology.orchestra.run.smithi118.stdout:Downloading Packages: 2024-03-27T09:56:28.954 INFO:teuthology.orchestra.run.smithi057.stdout:(1/174): ceph-19.0.0-2478.g155268c4.el9.x86_64. 21 kB/s | 6.6 kB 00:00 2024-03-27T09:56:29.538 INFO:teuthology.orchestra.run.smithi057.stdout:(2/174): ceph-fuse-19.0.0-2478.g155268c4.el9.x8 1.5 MB/s | 890 kB 00:00 2024-03-27T09:56:29.687 INFO:teuthology.orchestra.run.smithi057.stdout:(3/174): ceph-immutable-object-cache-19.0.0-247 972 kB/s | 145 kB 00:00 2024-03-27T09:56:29.813 INFO:teuthology.orchestra.run.smithi118.stdout:(1/174): ceph-19.0.0-2478.g155268c4.el9.x86_64. 18 kB/s | 6.6 kB 00:00 2024-03-27T09:56:29.913 INFO:teuthology.orchestra.run.smithi057.stdout:(4/174): ceph-base-19.0.0-2478.g155268c4.el9.x8 4.2 MB/s | 5.4 MB 00:01 2024-03-27T09:56:30.188 INFO:teuthology.orchestra.run.smithi057.stdout:(5/174): ceph-mgr-19.0.0-2478.g155268c4.el9.x86 5.4 MB/s | 1.5 MB 00:00 2024-03-27T09:56:30.372 INFO:teuthology.orchestra.run.smithi118.stdout:(2/174): ceph-fuse-19.0.0-2478.g155268c4.el9.x8 1.6 MB/s | 890 kB 00:00 2024-03-27T09:56:30.497 INFO:teuthology.orchestra.run.smithi118.stdout:(3/174): ceph-immutable-object-cache-19.0.0-247 1.1 MB/s | 145 kB 00:00 2024-03-27T09:56:30.847 INFO:teuthology.orchestra.run.smithi057.stdout:(6/174): ceph-mds-19.0.0-2478.g155268c4.el9.x86 2.0 MB/s | 2.4 MB 00:01 2024-03-27T09:56:30.972 INFO:teuthology.orchestra.run.smithi057.stdout:(7/174): ceph-mon-19.0.0-2478.g155268c4.el9.x86 6.0 MB/s | 4.7 MB 00:00 2024-03-27T09:56:31.664 INFO:teuthology.orchestra.run.smithi118.stdout:(4/174): ceph-mds-19.0.0-2478.g155268c4.el9.x86 2.0 MB/s | 2.4 MB 00:01 2024-03-27T09:56:32.663 INFO:teuthology.orchestra.run.smithi118.stdout:(5/174): ceph-base-19.0.0-2478.g155268c4.el9.x8 1.7 MB/s | 5.4 MB 00:03 2024-03-27T09:56:32.730 INFO:teuthology.orchestra.run.smithi118.stdout:(6/174): ceph-mgr-19.0.0-2478.g155268c4.el9.x86 1.4 MB/s | 1.5 MB 00:01 2024-03-27T09:56:33.147 INFO:teuthology.orchestra.run.smithi057.stdout:(8/174): ceph-radosgw-19.0.0-2478.g155268c4.el9 4.5 MB/s | 9.8 MB 00:02 2024-03-27T09:56:33.272 INFO:teuthology.orchestra.run.smithi057.stdout:(9/174): ceph-selinux-19.0.0-2478.g155268c4.el9 203 kB/s | 25 kB 00:00 2024-03-27T09:56:34.214 INFO:teuthology.orchestra.run.smithi057.stdout:(10/174): ceph-osd-19.0.0-2478.g155268c4.el9.x8 5.0 MB/s | 17 MB 00:03 2024-03-27T09:56:34.331 INFO:teuthology.orchestra.run.smithi057.stdout:(11/174): cephfs-mirror-19.0.0-2478.g155268c4.e 1.9 MB/s | 221 kB 00:00 2024-03-27T09:56:34.407 INFO:teuthology.orchestra.run.smithi057.stdout:(12/174): cephfs-shell-19.0.0-2478.g155268c4.el 364 kB/s | 27 kB 00:00 2024-03-27T09:56:34.473 INFO:teuthology.orchestra.run.smithi057.stdout:(13/174): libcephfs-devel-19.0.0-2478.g155268c4 483 kB/s | 32 kB 00:00 2024-03-27T09:56:34.674 INFO:teuthology.orchestra.run.smithi057.stdout:(14/174): libcephfs2-19.0.0-2478.g155268c4.el9. 3.7 MB/s | 746 kB 00:00 2024-03-27T09:56:34.749 INFO:teuthology.orchestra.run.smithi057.stdout:(15/174): libcephsqlite-19.0.0-2478.g155268c4.e 2.1 MB/s | 163 kB 00:00 2024-03-27T09:56:34.833 INFO:teuthology.orchestra.run.smithi057.stdout:(16/174): librados-devel-19.0.0-2478.g155268c4. 1.5 MB/s | 127 kB 00:00 2024-03-27T09:56:34.975 INFO:teuthology.orchestra.run.smithi057.stdout:(17/174): libradosstriper1-19.0.0-2478.g155268c 3.5 MB/s | 501 kB 00:00 2024-03-27T09:56:35.292 INFO:teuthology.orchestra.run.smithi057.stdout:(18/174): ceph-common-19.0.0-2478.g155268c4.el9 3.1 MB/s | 21 MB 00:06 2024-03-27T09:56:35.367 INFO:teuthology.orchestra.run.smithi057.stdout:(19/174): python3-ceph-argparse-19.0.0-2478.g15 612 kB/s | 45 kB 00:00 2024-03-27T09:56:35.468 INFO:teuthology.orchestra.run.smithi057.stdout:(20/174): python3-ceph-common-19.0.0-2478.g1552 1.3 MB/s | 134 kB 00:00 2024-03-27T09:56:35.497 INFO:teuthology.orchestra.run.smithi118.stdout:(7/174): ceph-mon-19.0.0-2478.g155268c4.el9.x86 1.7 MB/s | 4.7 MB 00:02 2024-03-27T09:56:35.543 INFO:teuthology.orchestra.run.smithi057.stdout:(21/174): python3-cephfs-19.0.0-2478.g155268c4. 2.1 MB/s | 162 kB 00:00 2024-03-27T09:56:35.668 INFO:teuthology.orchestra.run.smithi057.stdout:(22/174): python3-rados-19.0.0-2478.g155268c4.e 2.5 MB/s | 320 kB 00:00 2024-03-27T09:56:35.793 INFO:teuthology.orchestra.run.smithi057.stdout:(23/174): python3-rbd-19.0.0-2478.g155268c4.el9 2.3 MB/s | 298 kB 00:00 2024-03-27T09:56:35.869 INFO:teuthology.orchestra.run.smithi057.stdout:(24/174): python3-rgw-19.0.0-2478.g155268c4.el9 1.3 MB/s | 99 kB 00:00 2024-03-27T09:56:35.986 INFO:teuthology.orchestra.run.smithi057.stdout:(25/174): librgw2-19.0.0-2478.g155268c4.el9.x86 5.1 MB/s | 5.1 MB 00:01 2024-03-27T09:56:36.011 INFO:teuthology.orchestra.run.smithi057.stdout:(26/174): rbd-fuse-19.0.0-2478.g155268c4.el9.x8 604 kB/s | 85 kB 00:00 2024-03-27T09:56:36.078 INFO:teuthology.orchestra.run.smithi057.stdout:(27/174): rbd-nbd-19.0.0-2478.g155268c4.el9.x86 2.5 MB/s | 170 kB 00:00 2024-03-27T09:56:36.145 INFO:teuthology.orchestra.run.smithi057.stdout:(28/174): ceph-grafana-dashboards-19.0.0-2478.g 517 kB/s | 34 kB 00:00 2024-03-27T09:56:36.220 INFO:teuthology.orchestra.run.smithi057.stdout:(29/174): ceph-mgr-cephadm-19.0.0-2478.g155268c 1.9 MB/s | 141 kB 00:00 2024-03-27T09:56:36.538 INFO:teuthology.orchestra.run.smithi057.stdout:(30/174): rbd-mirror-19.0.0-2478.g155268c4.el9. 5.6 MB/s | 3.1 MB 00:00 2024-03-27T09:56:37.238 INFO:teuthology.orchestra.run.smithi057.stdout:(31/174): ceph-mgr-dashboard-19.0.0-2478.g15526 3.5 MB/s | 3.5 MB 00:01 2024-03-27T09:56:37.430 INFO:teuthology.orchestra.run.smithi057.stdout:(32/174): ceph-mgr-modules-core-19.0.0-2478.g15 1.3 MB/s | 249 kB 00:00 2024-03-27T09:56:37.505 INFO:teuthology.orchestra.run.smithi057.stdout:(33/174): ceph-mgr-rook-19.0.0-2478.g155268c4.e 667 kB/s | 49 kB 00:00 2024-03-27T09:56:37.572 INFO:teuthology.orchestra.run.smithi057.stdout:(34/174): ceph-prometheus-alerts-19.0.0-2478.g1 250 kB/s | 16 kB 00:00 2024-03-27T09:56:37.680 INFO:teuthology.orchestra.run.smithi057.stdout:(35/174): ceph-volume-19.0.0-2478.g155268c4.el9 2.4 MB/s | 264 kB 00:00 2024-03-27T09:56:37.881 INFO:teuthology.orchestra.run.smithi057.stdout:(36/174): ceph-mgr-diskprediction-local-19.0.0- 5.5 MB/s | 7.4 MB 00:01 2024-03-27T09:56:37.923 INFO:teuthology.orchestra.run.smithi057.stdout:(37/174): cephadm-19.0.0-2478.g155268c4.el9.noa 3.1 MB/s | 762 kB 00:00 2024-03-27T09:56:37.948 INFO:teuthology.orchestra.run.smithi057.stdout:(38/174): cephfs-top-19.0.0-2478.g155268c4.el9. 275 kB/s | 18 kB 00:00 2024-03-27T09:56:38.165 INFO:teuthology.orchestra.run.smithi057.stdout:(39/174): automake-1.16.2-8.el9.noarch.rpm 2.7 MB/s | 662 kB 00:00 2024-03-27T09:56:38.207 INFO:teuthology.orchestra.run.smithi057.stdout:(40/174): boost-program-options-1.75.0-8.el9.x8 2.7 MB/s | 106 kB 00:00 2024-03-27T09:56:38.249 INFO:teuthology.orchestra.run.smithi057.stdout:(41/174): bison-3.7.4-5.el9.x86_64.rpm 3.0 MB/s | 920 kB 00:00 2024-03-27T09:56:38.283 INFO:teuthology.orchestra.run.smithi057.stdout:(42/174): flex-2.6.4-9.el9.x86_64.rpm 4.2 MB/s | 307 kB 00:00 2024-03-27T09:56:38.300 INFO:teuthology.orchestra.run.smithi057.stdout:(43/174): flexiblas-3.0.4-8.el9.x86_64.rpm 653 kB/s | 32 kB 00:00 2024-03-27T09:56:38.409 INFO:teuthology.orchestra.run.smithi057.stdout:(44/174): flexiblas-netlib-3.0.4-8.el9.x86_64.r 24 MB/s | 3.0 MB 00:00 2024-03-27T09:56:38.425 INFO:teuthology.orchestra.run.smithi057.stdout:(45/174): flexiblas-openblas-openmp-3.0.4-8.el9 158 kB/s | 17 kB 00:00 2024-03-27T09:56:38.451 INFO:teuthology.orchestra.run.smithi057.stdout:(46/174): libaio-devel-0.3.111-13.el9.x86_64.rp 425 kB/s | 10 kB 00:00 2024-03-27T09:56:38.476 INFO:teuthology.orchestra.run.smithi057.stdout:(47/174): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.2 MB/s | 159 kB 00:00 2024-03-27T09:56:38.489 INFO:teuthology.orchestra.run.smithi118.stdout:(8/174): ceph-common-19.0.0-2478.g155268c4.el9. 2.3 MB/s | 21 MB 00:09 2024-03-27T09:56:38.493 INFO:teuthology.orchestra.run.smithi057.stdout:(48/174): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.1 MB/s | 44 kB 00:00 2024-03-27T09:56:38.535 INFO:teuthology.orchestra.run.smithi057.stdout:(49/174): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 661 kB 00:00 2024-03-27T09:56:38.577 INFO:teuthology.orchestra.run.smithi057.stdout:(50/174): libtool-2.4.6-45.el9.x86_64.rpm 7.4 MB/s | 578 kB 00:00 2024-03-27T09:56:38.578 INFO:teuthology.orchestra.run.smithi118.stdout:(9/174): ceph-selinux-19.0.0-2478.g155268c4.el9 288 kB/s | 25 kB 00:00 2024-03-27T09:56:38.602 INFO:teuthology.orchestra.run.smithi057.stdout:(51/174): libzstd-devel-1.5.1-2.el9.x86_64.rpm 762 kB/s | 46 kB 00:00 2024-03-27T09:56:38.636 INFO:teuthology.orchestra.run.smithi057.stdout:(52/174): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.8 MB/s | 282 kB 00:00 2024-03-27T09:56:38.670 INFO:teuthology.orchestra.run.smithi057.stdout:(53/174): lua-5.4.4-4.el9.x86_64.rpm 2.9 MB/s | 187 kB 00:00 2024-03-27T09:56:38.703 INFO:teuthology.orchestra.run.smithi057.stdout:(54/174): oniguruma-6.9.6-1.el9.5.x86_64.rpm 3.3 MB/s | 217 kB 00:00 2024-03-27T09:56:38.720 INFO:teuthology.orchestra.run.smithi057.stdout:(55/174): openblas-0.3.21-2.el9.x86_64.rpm 721 kB/s | 34 kB 00:00 2024-03-27T09:56:38.854 INFO:teuthology.orchestra.run.smithi057.stdout:(56/174): openblas-openmp-0.3.21-2.el9.x86_64.r 32 MB/s | 4.7 MB 00:00 2024-03-27T09:56:38.905 INFO:teuthology.orchestra.run.smithi057.stdout:(57/174): protobuf-3.14.0-13.el9.x86_64.rpm 6.1 MB/s | 1.0 MB 00:00 2024-03-27T09:56:38.930 INFO:teuthology.orchestra.run.smithi057.stdout:(58/174): python3-attrs-20.3.0-7.el9.noarch.rpm 1.2 MB/s | 78 kB 00:00 2024-03-27T09:56:39.080 INFO:teuthology.orchestra.run.smithi057.stdout:(59/174): python3-babel-2.9.1-2.el9.noarch.rpm 33 MB/s | 5.8 MB 00:00 2024-03-27T09:56:39.105 INFO:teuthology.orchestra.run.smithi057.stdout:(60/174): python3-jsonpatch-1.21-16.el9.noarch. 153 kB/s | 24 kB 00:00 2024-03-27T09:56:39.147 INFO:teuthology.orchestra.run.smithi057.stdout:(61/174): python3-mako-1.1.4-6.el9.noarch.rpm 3.5 MB/s | 144 kB 00:00 2024-03-27T09:56:39.156 INFO:teuthology.orchestra.run.smithi118.stdout:(10/174): ceph-radosgw-19.0.0-2478.g155268c4.el 2.7 MB/s | 9.8 MB 00:03 2024-03-27T09:56:39.173 INFO:teuthology.orchestra.run.smithi057.stdout:(62/174): python3-jsonpointer-2.0-4.el9.noarch. 275 kB/s | 18 kB 00:00 2024-03-27T09:56:39.198 INFO:teuthology.orchestra.run.smithi057.stdout:(63/174): python3-markupsafe-1.1.1-12.el9.x86_6 632 kB/s | 32 kB 00:00 2024-03-27T09:56:39.306 INFO:teuthology.orchestra.run.smithi118.stdout:(11/174): cephfs-mirror-19.0.0-2478.g155268c4.e 1.4 MB/s | 221 kB 00:00 2024-03-27T09:56:39.348 INFO:teuthology.orchestra.run.smithi057.stdout:(64/174): python3-numpy-1.20.1-5.el9.x86_64.rpm 27 MB/s | 4.8 MB 00:00 2024-03-27T09:56:39.381 INFO:teuthology.orchestra.run.smithi118.stdout:(12/174): cephfs-shell-19.0.0-2478.g155268c4.el 364 kB/s | 27 kB 00:00 2024-03-27T09:56:39.382 INFO:teuthology.orchestra.run.smithi057.stdout:(65/174): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.3 MB/s | 217 kB 00:00 2024-03-27T09:56:39.416 INFO:teuthology.orchestra.run.smithi057.stdout:(66/174): python3-oauthlib-3.1.1-5.el9.noarch.r 2.6 MB/s | 174 kB 00:00 2024-03-27T09:56:39.433 INFO:teuthology.orchestra.run.smithi057.stdout:(67/174): python3-packaging-20.9-5.el9.noarch.r 1.4 MB/s | 69 kB 00:00 2024-03-27T09:56:39.448 INFO:teuthology.orchestra.run.smithi118.stdout:(13/174): libcephfs-devel-19.0.0-2478.g155268c4 483 kB/s | 32 kB 00:00 2024-03-27T09:56:39.458 INFO:teuthology.orchestra.run.smithi057.stdout:(68/174): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 41 kB 00:00 2024-03-27T09:56:39.492 INFO:teuthology.orchestra.run.smithi057.stdout:(69/174): python3-protobuf-3.14.0-13.el9.noarch 4.1 MB/s | 238 kB 00:00 2024-03-27T09:56:39.517 INFO:teuthology.orchestra.run.smithi057.stdout:(70/174): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.3 MB/s | 132 kB 00:00 2024-03-27T09:56:39.551 INFO:teuthology.orchestra.run.smithi057.stdout:(71/174): python3-pyasn1-modules-0.4.8-6.el9.no 3.6 MB/s | 211 kB 00:00 2024-03-27T09:56:39.576 INFO:teuthology.orchestra.run.smithi057.stdout:(72/174): python3-pytz-2021.1-5.el9.noarch.rpm 847 kB/s | 47 kB 00:00 2024-03-27T09:56:39.601 INFO:teuthology.orchestra.run.smithi057.stdout:(73/174): python3-requests-oauthlib-1.3.0-12.el 876 kB/s | 43 kB 00:00 2024-03-27T09:56:39.690 INFO:teuthology.orchestra.run.smithi118.stdout:(14/174): libcephfs2-19.0.0-2478.g155268c4.el9. 3.0 MB/s | 746 kB 00:00 2024-03-27T09:56:39.818 INFO:teuthology.orchestra.run.smithi057.stdout:(74/174): python3-toml-0.10.2-6.el9.noarch.rpm 192 kB/s | 39 kB 00:00 2024-03-27T09:56:39.974 INFO:teuthology.orchestra.run.smithi118.stdout:(15/174): ceph-osd-19.0.0-2478.g155268c4.el9.x8 2.3 MB/s | 17 MB 00:07 2024-03-27T09:56:40.002 INFO:teuthology.orchestra.run.smithi057.stdout:(75/174): python3-scipy-1.6.2-8.el9.x86_64.rpm 37 MB/s | 16 MB 00:00 2024-03-27T09:56:40.007 INFO:teuthology.orchestra.run.smithi118.stdout:(16/174): libcephsqlite-19.0.0-2478.g155268c4.e 517 kB/s | 163 kB 00:00 2024-03-27T09:56:40.053 INFO:teuthology.orchestra.run.smithi057.stdout:(76/174): python3-wcwidth-0.2.5-8.el9.noarch.rp 178 kB/s | 41 kB 00:00 2024-03-27T09:56:40.074 INFO:teuthology.orchestra.run.smithi118.stdout:(17/174): librados-devel-19.0.0-2478.g155268c4. 1.2 MB/s | 127 kB 00:00 2024-03-27T09:56:40.086 INFO:teuthology.orchestra.run.smithi057.stdout:(77/174): socat-1.7.4.1-5.el9.x86_64.rpm 3.6 MB/s | 300 kB 00:00 2024-03-27T09:56:40.103 INFO:teuthology.orchestra.run.smithi057.stdout:(78/174): uuid-1.6.2-55.el9.x86_64.rpm 1.2 MB/s | 56 kB 00:00 2024-03-27T09:56:40.120 INFO:teuthology.orchestra.run.smithi057.stdout:(79/174): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.9 MB/s | 63 kB 00:00 2024-03-27T09:56:40.191 INFO:teuthology.orchestra.run.smithi118.stdout:(18/174): libradosstriper1-19.0.0-2478.g155268c 2.7 MB/s | 501 kB 00:00 2024-03-27T09:56:40.245 INFO:teuthology.orchestra.run.smithi057.stdout:(80/174): zlib-devel-1.2.11-40.el9.x86_64.rpm 315 kB/s | 44 kB 00:00 2024-03-27T09:56:40.271 INFO:teuthology.orchestra.run.smithi057.stdout:(81/174): fuse-2.9.9-15.el9.x86_64.rpm 527 kB/s | 79 kB 00:00 2024-03-27T09:56:40.300 INFO:teuthology.orchestra.run.smithi118.stdout:(19/174): python3-ceph-argparse-19.0.0-2478.g15 418 kB/s | 45 kB 00:00 2024-03-27T09:56:40.305 INFO:teuthology.orchestra.run.smithi057.stdout:(82/174): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.1 MB/s | 241 kB 00:00 2024-03-27T09:56:40.355 INFO:teuthology.orchestra.run.smithi057.stdout:(83/174): python3-cryptography-36.0.1-4.el9.x86 14 MB/s | 1.1 MB 00:00 2024-03-27T09:56:40.367 INFO:teuthology.orchestra.run.smithi118.stdout:(20/174): python3-ceph-common-19.0.0-2478.g1552 2.0 MB/s | 134 kB 00:00 2024-03-27T09:56:40.380 INFO:teuthology.orchestra.run.smithi057.stdout:(84/174): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 103 kB 00:00 2024-03-27T09:56:40.397 INFO:teuthology.orchestra.run.smithi057.stdout:(85/174): python3-pycparser-2.20-6.el9.noarch.r 3.0 MB/s | 124 kB 00:00 2024-03-27T09:56:40.431 INFO:teuthology.orchestra.run.smithi057.stdout:(86/174): python3-urllib3-1.26.5-5.el9.noarch.r 3.8 MB/s | 187 kB 00:00 2024-03-27T09:56:40.434 INFO:teuthology.orchestra.run.smithi118.stdout:(21/174): python3-cephfs-19.0.0-2478.g155268c4. 2.4 MB/s | 162 kB 00:00 2024-03-27T09:56:40.545 INFO:teuthology.orchestra.run.smithi118.stdout:(22/174): python3-rados-19.0.0-2478.g155268c4.e 2.9 MB/s | 320 kB 00:00 2024-03-27T09:56:40.651 INFO:teuthology.orchestra.run.smithi118.stdout:(23/174): python3-rbd-19.0.0-2478.g155268c4.el9 2.7 MB/s | 298 kB 00:00 2024-03-27T09:56:40.718 INFO:teuthology.orchestra.run.smithi118.stdout:(24/174): python3-rgw-19.0.0-2478.g155268c4.el9 1.5 MB/s | 99 kB 00:00 2024-03-27T09:56:40.785 INFO:teuthology.orchestra.run.smithi118.stdout:(25/174): rbd-fuse-19.0.0-2478.g155268c4.el9.x8 1.3 MB/s | 85 kB 00:00 2024-03-27T09:56:41.298 INFO:teuthology.orchestra.run.smithi057.stdout:(87/174): jq-1.6-16.el9.x86_64.rpm 208 kB/s | 187 kB 00:00 2024-03-27T09:56:41.377 INFO:teuthology.orchestra.run.smithi118.stdout:(26/174): librgw2-19.0.0-2478.g155268c4.el9.x86 4.0 MB/s | 5.1 MB 00:01 2024-03-27T09:56:41.478 INFO:teuthology.orchestra.run.smithi118.stdout:(27/174): rbd-nbd-19.0.0-2478.g155268c4.el9.x86 1.7 MB/s | 170 kB 00:00 2024-03-27T09:56:41.545 INFO:teuthology.orchestra.run.smithi118.stdout:(28/174): ceph-grafana-dashboards-19.0.0-2478.g 515 kB/s | 34 kB 00:00 2024-03-27T09:56:41.612 INFO:teuthology.orchestra.run.smithi118.stdout:(29/174): ceph-mgr-cephadm-19.0.0-2478.g155268c 2.1 MB/s | 141 kB 00:00 2024-03-27T09:56:41.687 INFO:teuthology.orchestra.run.smithi118.stdout:(30/174): rbd-mirror-19.0.0-2478.g155268c4.el9. 3.4 MB/s | 3.1 MB 00:00 2024-03-27T09:56:42.390 INFO:teuthology.orchestra.run.smithi057.stdout:(88/174): ceph-test-19.0.0-2478.g155268c4.el9.x 5.2 MB/s | 48 MB 00:09 2024-03-27T09:56:42.432 INFO:teuthology.orchestra.run.smithi057.stdout:(89/174): libgfortran-11.4.1-3.el9.x86_64.rpm 402 kB/s | 803 kB 00:01 2024-03-27T09:56:42.487 INFO:teuthology.orchestra.run.smithi118.stdout:(31/174): ceph-mgr-dashboard-19.0.0-2478.g15526 4.0 MB/s | 3.5 MB 00:00 2024-03-27T09:56:42.524 INFO:teuthology.orchestra.run.smithi057.stdout:(90/174): elfutils-libelf-devel-0.190-2.el9.x86 237 kB/s | 21 kB 00:00 2024-03-27T09:56:42.582 INFO:teuthology.orchestra.run.smithi057.stdout:(91/174): libuuid-devel-2.37.4-18.el9.x86_64.rp 440 kB/s | 25 kB 00:00 2024-03-27T09:56:42.596 INFO:teuthology.orchestra.run.smithi118.stdout:(32/174): ceph-mgr-modules-core-19.0.0-2478.g15 2.3 MB/s | 249 kB 00:00 2024-03-27T09:56:42.663 INFO:teuthology.orchestra.run.smithi118.stdout:(33/174): ceph-mgr-rook-19.0.0-2478.g155268c4.e 746 kB/s | 49 kB 00:00 2024-03-27T09:56:42.716 INFO:teuthology.orchestra.run.smithi057.stdout:(92/174): libquadmath-11.4.1-3.el9.x86_64.rpm 138 kB/s | 195 kB 00:01 2024-03-27T09:56:42.730 INFO:teuthology.orchestra.run.smithi118.stdout:(34/174): ceph-prometheus-alerts-19.0.0-2478.g1 250 kB/s | 16 kB 00:00 2024-03-27T09:56:42.847 INFO:teuthology.orchestra.run.smithi118.stdout:(35/174): ceph-volume-19.0.0-2478.g155268c4.el9 2.2 MB/s | 264 kB 00:00 2024-03-27T09:56:43.097 INFO:teuthology.orchestra.run.smithi118.stdout:(36/174): cephadm-19.0.0-2478.g155268c4.el9.noa 3.0 MB/s | 762 kB 00:00 2024-03-27T09:56:43.125 INFO:teuthology.orchestra.run.smithi057.stdout:(93/174): postgresql-13.14-1.el9.x86_64.rpm 3.9 MB/s | 1.6 MB 00:00 2024-03-27T09:56:43.164 INFO:teuthology.orchestra.run.smithi118.stdout:(37/174): cephfs-top-19.0.0-2478.g155268c4.el9. 277 kB/s | 18 kB 00:00 2024-03-27T09:56:43.233 INFO:teuthology.orchestra.run.smithi057.stdout:(94/174): openssl-devel-3.0.7-27.el9.x86_64.rpm 6.4 MB/s | 4.1 MB 00:00 2024-03-27T09:56:43.267 INFO:teuthology.orchestra.run.smithi057.stdout:(95/174): python3-requests-2.25.1-8.el9.noarch. 143 kB/s | 125 kB 00:00 2024-03-27T09:56:43.300 INFO:teuthology.orchestra.run.smithi057.stdout:(96/174): postgresql-private-libs-13.14-1.el9.x 2.0 MB/s | 133 kB 00:00 2024-03-27T09:56:43.351 INFO:teuthology.orchestra.run.smithi057.stdout:(97/174): postgresql-contrib-13.14-1.el9.x86_64 4.0 MB/s | 911 kB 00:00 2024-03-27T09:56:43.364 INFO:teuthology.orchestra.run.smithi118.stdout:(38/174): automake-1.16.2-8.el9.noarch.rpm 3.2 MB/s | 662 kB 00:00 2024-03-27T09:56:43.385 INFO:teuthology.orchestra.run.smithi057.stdout:(98/174): python3-devel-3.9.17-2.el9.x86_64.rpm 2.9 MB/s | 245 kB 00:00 2024-03-27T09:56:43.418 INFO:teuthology.orchestra.run.smithi057.stdout:(99/174): python3-jinja2-2.11.3-5.el9.noarch.rp 3.7 MB/s | 248 kB 00:00 2024-03-27T09:56:43.423 INFO:teuthology.orchestra.run.smithi118.stdout:(39/174): bison-3.7.4-5.el9.x86_64.rpm 16 MB/s | 920 kB 00:00 2024-03-27T09:56:43.477 INFO:teuthology.orchestra.run.smithi057.stdout:(100/174): qatlib-service-24.02.0-1.el9.x86_64. 623 kB/s | 36 kB 00:00 2024-03-27T09:56:43.536 INFO:teuthology.orchestra.run.smithi057.stdout:(101/174): qatzip-libs-1.2.0-1.el9.x86_64.rpm 822 kB/s | 47 kB 00:00 2024-03-27T09:56:43.573 INFO:teuthology.orchestra.run.smithi118.stdout:(40/174): ceph-mgr-diskprediction-local-19.0.0- 3.9 MB/s | 7.4 MB 00:01 2024-03-27T09:56:43.594 INFO:teuthology.orchestra.run.smithi057.stdout:(102/174): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 1.6 MB/s | 94 kB 00:00 2024-03-27T09:56:43.598 INFO:teuthology.orchestra.run.smithi118.stdout:(41/174): boost-program-options-1.75.0-8.el9.x8 606 kB/s | 106 kB 00:00 2024-03-27T09:56:43.628 INFO:teuthology.orchestra.run.smithi057.stdout:(103/174): qatlib-24.02.0-1.el9.x86_64.rpm 912 kB/s | 221 kB 00:00 2024-03-27T09:56:43.632 INFO:teuthology.orchestra.run.smithi118.stdout:(42/174): flex-2.6.4-9.el9.x86_64.rpm 5.3 MB/s | 307 kB 00:00 2024-03-27T09:56:43.657 INFO:teuthology.orchestra.run.smithi118.stdout:(43/174): flexiblas-3.0.4-8.el9.x86_64.rpm 567 kB/s | 32 kB 00:00 2024-03-27T09:56:43.758 INFO:teuthology.orchestra.run.smithi118.stdout:(44/174): flexiblas-netlib-3.0.4-8.el9.x86_64.r 24 MB/s | 3.0 MB 00:00 2024-03-27T09:56:43.775 INFO:teuthology.orchestra.run.smithi118.stdout:(45/174): flexiblas-openblas-openmp-3.0.4-8.el9 171 kB/s | 17 kB 00:00 2024-03-27T09:56:43.800 INFO:teuthology.orchestra.run.smithi118.stdout:(46/174): libaio-devel-0.3.111-13.el9.x86_64.rp 422 kB/s | 10 kB 00:00 2024-03-27T09:56:43.825 INFO:teuthology.orchestra.run.smithi118.stdout:(47/174): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.2 MB/s | 159 kB 00:00 2024-03-27T09:56:43.850 INFO:teuthology.orchestra.run.smithi118.stdout:(48/174): librabbitmq-0.11.0-7.el9.x86_64.rpm 916 kB/s | 44 kB 00:00 2024-03-27T09:56:43.893 INFO:teuthology.orchestra.run.smithi118.stdout:(49/174): librdkafka-1.6.1-102.el9.x86_64.rpm 9.9 MB/s | 661 kB 00:00 2024-03-27T09:56:43.943 INFO:teuthology.orchestra.run.smithi118.stdout:(50/174): libtool-2.4.6-45.el9.x86_64.rpm 6.6 MB/s | 578 kB 00:00 2024-03-27T09:56:43.968 INFO:teuthology.orchestra.run.smithi118.stdout:(51/174): libzstd-devel-1.5.1-2.el9.x86_64.rpm 664 kB/s | 46 kB 00:00 2024-03-27T09:56:44.002 INFO:teuthology.orchestra.run.smithi118.stdout:(52/174): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.8 MB/s | 282 kB 00:00 2024-03-27T09:56:44.036 INFO:teuthology.orchestra.run.smithi118.stdout:(53/174): lua-5.4.4-4.el9.x86_64.rpm 2.9 MB/s | 187 kB 00:00 2024-03-27T09:56:44.069 INFO:teuthology.orchestra.run.smithi118.stdout:(54/174): oniguruma-6.9.6-1.el9.5.x86_64.rpm 3.3 MB/s | 217 kB 00:00 2024-03-27T09:56:44.086 INFO:teuthology.orchestra.run.smithi057.stdout:(104/174): lua-devel-5.4.4-4.el9.x86_64.rpm 45 kB/s | 22 kB 00:00 2024-03-27T09:56:44.103 INFO:teuthology.orchestra.run.smithi118.stdout:(55/174): openblas-0.3.21-2.el9.x86_64.rpm 532 kB/s | 34 kB 00:00 2024-03-27T09:56:44.245 INFO:teuthology.orchestra.run.smithi118.stdout:(56/174): openblas-openmp-0.3.21-2.el9.x86_64.r 27 MB/s | 4.7 MB 00:00 2024-03-27T09:56:44.287 INFO:teuthology.orchestra.run.smithi118.stdout:(57/174): protobuf-3.14.0-13.el9.x86_64.rpm 6.0 MB/s | 1.0 MB 00:00 2024-03-27T09:56:44.287 INFO:teuthology.orchestra.run.smithi057.stdout:(105/174): protobuf-compiler-3.14.0-13.el9.x86_ 1.3 MB/s | 863 kB 00:00 2024-03-27T09:56:44.354 INFO:teuthology.orchestra.run.smithi118.stdout:(58/174): python3-attrs-20.3.0-7.el9.noarch.rpm 1.2 MB/s | 78 kB 00:00 2024-03-27T09:56:44.496 INFO:teuthology.orchestra.run.smithi118.stdout:(59/174): python3-babel-2.9.1-2.el9.noarch.rpm 28 MB/s | 5.8 MB 00:00 2024-03-27T09:56:44.521 INFO:teuthology.orchestra.run.smithi118.stdout:(60/174): python3-jsonpatch-1.21-16.el9.noarch. 159 kB/s | 24 kB 00:00 2024-03-27T09:56:44.537 INFO:teuthology.orchestra.run.smithi057.stdout:(106/174): postgresql-server-13.14-1.el9.x86_64 4.6 MB/s | 5.8 MB 00:01 2024-03-27T09:56:44.554 INFO:teuthology.orchestra.run.smithi118.stdout:(61/174): python3-jsonpointer-2.0-4.el9.noarch. 562 kB/s | 18 kB 00:00 2024-03-27T09:56:44.581 INFO:teuthology.orchestra.run.smithi057.stdout:(107/174): abseil-cpp-20211102.0-3.el9.x86_64.r 1.1 MB/s | 548 kB 00:00 2024-03-27T09:56:44.582 INFO:teuthology.orchestra.run.smithi118.stdout:(62/174): python3-mako-1.1.4-6.el9.noarch.rpm 2.5 MB/s | 144 kB 00:00 2024-03-27T09:56:44.606 INFO:teuthology.orchestra.run.smithi118.stdout:(63/174): python3-markupsafe-1.1.1-12.el9.x86_6 652 kB/s | 32 kB 00:00 2024-03-27T09:56:44.713 INFO:teuthology.orchestra.run.smithi057.stdout:(108/174): gperftools-libs-2.9.1-2.el9.x86_64.r 728 kB/s | 309 kB 00:00 2024-03-27T09:56:44.730 INFO:teuthology.orchestra.run.smithi118.stdout:(64/174): python3-numpy-1.20.1-5.el9.x86_64.rpm 32 MB/s | 4.8 MB 00:00 2024-03-27T09:56:44.738 INFO:teuthology.orchestra.run.smithi057.stdout:(109/174): grpc-data-1.46.7-10.el9.noarch.rpm 97 kB/s | 19 kB 00:00 2024-03-27T09:56:44.764 INFO:teuthology.orchestra.run.smithi118.stdout:(65/174): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.5 MB/s | 217 kB 00:00 2024-03-27T09:56:44.789 INFO:teuthology.orchestra.run.smithi057.stdout:(110/174): libarrow-doc-9.0.0-10.el9.noarch.rpm 346 kB/s | 26 kB 00:00 2024-03-27T09:56:44.798 INFO:teuthology.orchestra.run.smithi118.stdout:(66/174): python3-oauthlib-3.1.1-5.el9.noarch.r 2.6 MB/s | 174 kB 00:00 2024-03-27T09:56:44.823 INFO:teuthology.orchestra.run.smithi118.stdout:(67/174): python3-packaging-20.9-5.el9.noarch.r 1.2 MB/s | 69 kB 00:00 2024-03-27T09:56:44.848 INFO:teuthology.orchestra.run.smithi118.stdout:(68/174): python3-prettytable-0.7.2-27.el9.noar 843 kB/s | 41 kB 00:00 2024-03-27T09:56:44.882 INFO:teuthology.orchestra.run.smithi118.stdout:(69/174): python3-protobuf-3.14.0-13.el9.noarch 4.1 MB/s | 238 kB 00:00 2024-03-27T09:56:44.915 INFO:teuthology.orchestra.run.smithi118.stdout:(70/174): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.0 MB/s | 132 kB 00:00 2024-03-27T09:56:44.947 INFO:teuthology.orchestra.run.smithi057.stdout:(111/174): libarrow-9.0.0-10.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2024-03-27T09:56:44.972 INFO:teuthology.orchestra.run.smithi057.stdout:(112/174): liboath-2.6.7-2.el9.x86_64.rpm 208 kB/s | 49 kB 00:00 2024-03-27T09:56:44.982 INFO:teuthology.orchestra.run.smithi118.stdout:(71/174): python3-pyasn1-modules-0.4.8-6.el9.no 2.1 MB/s | 211 kB 00:00 2024-03-27T09:56:44.997 INFO:teuthology.orchestra.run.smithi057.stdout:(113/174): libunwind-1.6.2-1.el9.x86_64.rpm 325 kB/s | 67 kB 00:00 2024-03-27T09:56:45.016 INFO:teuthology.orchestra.run.smithi118.stdout:(72/174): python3-pytz-2021.1-5.el9.noarch.rpm 483 kB/s | 47 kB 00:00 2024-03-27T09:56:45.022 INFO:teuthology.orchestra.run.smithi057.stdout:(114/174): luarocks-3.9.2-1.el9.noarch.rpm 2.0 MB/s | 151 kB 00:00 2024-03-27T09:56:45.042 INFO:teuthology.orchestra.run.smithi118.stdout:(73/174): python3-requests-oauthlib-1.3.0-12.el 740 kB/s | 43 kB 00:00 2024-03-27T09:56:45.098 INFO:teuthology.orchestra.run.smithi057.stdout:(115/174): python3-bcrypt-3.2.2-1.el9.x86_64.rp 582 kB/s | 43 kB 00:00 2024-03-27T09:56:45.181 INFO:teuthology.orchestra.run.smithi057.stdout:(116/174): python3-cachetools-4.2.4-1.el9.noarc 390 kB/s | 32 kB 00:00 2024-03-27T09:56:45.232 INFO:teuthology.orchestra.run.smithi057.stdout:(117/174): parquet-libs-9.0.0-10.el9.x86_64.rpm 3.5 MB/s | 838 kB 00:00 2024-03-27T09:56:45.257 INFO:teuthology.orchestra.run.smithi057.stdout:(118/174): python3-certifi-2021.10.8-2.el9.noar 201 kB/s | 15 kB 00:00 2024-03-27T09:56:45.391 INFO:teuthology.orchestra.run.smithi057.stdout:(119/174): python3-asyncssh-2.13.2-5.el9.noarch 1.4 MB/s | 548 kB 00:00 2024-03-27T09:56:45.425 INFO:teuthology.orchestra.run.smithi057.stdout:(120/174): python3-cheroot-8.6.0-4.el9.noarch.r 897 kB/s | 172 kB 00:00 2024-03-27T09:56:45.458 INFO:teuthology.orchestra.run.smithi057.stdout:(121/174): python3-cherrypy-18.6.1-2.el9.noarch 1.8 MB/s | 358 kB 00:00 2024-03-27T09:56:45.492 INFO:teuthology.orchestra.run.smithi057.stdout:(122/174): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.0 MB/s | 303 kB 00:00 2024-03-27T09:56:45.517 INFO:teuthology.orchestra.run.smithi057.stdout:(123/174): python3-colorama-0.4.4-12.el9.noarch 385 kB/s | 35 kB 00:00 2024-03-27T09:56:45.518 INFO:teuthology.orchestra.run.smithi118.stdout:(74/174): python3-scipy-1.6.2-8.el9.x86_64.rpm 31 MB/s | 16 MB 00:00 2024-03-27T09:56:45.542 INFO:teuthology.orchestra.run.smithi118.stdout:(75/174): python3-toml-0.10.2-6.el9.noarch.rpm 80 kB/s | 39 kB 00:00 2024-03-27T09:56:45.543 INFO:teuthology.orchestra.run.smithi057.stdout:(124/174): python3-google-auth-2.28.2-1.el9.noa 2.4 MB/s | 203 kB 00:00 2024-03-27T09:56:45.584 INFO:teuthology.orchestra.run.smithi118.stdout:(76/174): python3-wcwidth-0.2.5-8.el9.noarch.rp 1.0 MB/s | 41 kB 00:00 2024-03-27T09:56:45.601 INFO:teuthology.orchestra.run.smithi057.stdout:(125/174): python3-grpcio-tools-1.46.7-10.el9.x 1.7 MB/s | 144 kB 00:00 2024-03-27T09:56:45.626 INFO:teuthology.orchestra.run.smithi057.stdout:(126/174): python3-jaraco-8.2.1-3.el9.noarch.rp 129 kB/s | 11 kB 00:00 2024-03-27T09:56:45.634 INFO:teuthology.orchestra.run.smithi118.stdout:(77/174): socat-1.7.4.1-5.el9.x86_64.rpm 3.2 MB/s | 300 kB 00:00 2024-03-27T09:56:45.660 INFO:teuthology.orchestra.run.smithi118.stdout:(78/174): uuid-1.6.2-55.el9.x86_64.rpm 778 kB/s | 56 kB 00:00 2024-03-27T09:56:45.677 INFO:teuthology.orchestra.run.smithi057.stdout:(127/174): python3-jaraco-classes-3.2.1-5.el9.n 237 kB/s | 18 kB 00:00 2024-03-27T09:56:45.677 INFO:teuthology.orchestra.run.smithi118.stdout:(79/174): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 63 kB 00:00 2024-03-27T09:56:45.694 INFO:teuthology.orchestra.run.smithi118.stdout:(80/174): zlib-devel-1.2.11-40.el9.x86_64.rpm 1.3 MB/s | 44 kB 00:00 2024-03-27T09:56:45.702 INFO:teuthology.orchestra.run.smithi057.stdout:(128/174): python3-jaraco-collections-3.0.0-8.e 311 kB/s | 23 kB 00:00 2024-03-27T09:56:45.719 INFO:teuthology.orchestra.run.smithi118.stdout:(81/174): fuse-2.9.9-15.el9.x86_64.rpm 1.9 MB/s | 79 kB 00:00 2024-03-27T09:56:45.753 INFO:teuthology.orchestra.run.smithi118.stdout:(82/174): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.1 MB/s | 241 kB 00:00 2024-03-27T09:56:45.769 INFO:teuthology.orchestra.run.smithi057.stdout:(129/174): python3-grpcio-1.46.7-10.el9.x86_64. 7.4 MB/s | 2.0 MB 00:00 2024-03-27T09:56:45.794 INFO:teuthology.orchestra.run.smithi057.stdout:(130/174): python3-jaraco-functools-3.5.0-2.el9 168 kB/s | 19 kB 00:00 2024-03-27T09:56:45.803 INFO:teuthology.orchestra.run.smithi118.stdout:(83/174): python3-cryptography-36.0.1-4.el9.x86 14 MB/s | 1.1 MB 00:00 2024-03-27T09:56:45.819 INFO:teuthology.orchestra.run.smithi057.stdout:(131/174): python3-jaraco-text-3.2.0-6.el9.noar 169 kB/s | 20 kB 00:00 2024-03-27T09:56:45.829 INFO:teuthology.orchestra.run.smithi118.stdout:(84/174): python3-ply-3.11-14.el9.noarch.rpm 1.5 MB/s | 103 kB 00:00 2024-03-27T09:56:45.854 INFO:teuthology.orchestra.run.smithi118.stdout:(85/174): python3-pycparser-2.20-6.el9.noarch.r 2.5 MB/s | 124 kB 00:00 2024-03-27T09:56:45.870 INFO:teuthology.orchestra.run.smithi057.stdout:(132/174): python3-kubernetes-26.1.0-2.el9.noar 10 MB/s | 1.0 MB 00:00 2024-03-27T09:56:45.887 INFO:teuthology.orchestra.run.smithi118.stdout:(86/174): python3-urllib3-1.26.5-5.el9.noarch.r 3.2 MB/s | 187 kB 00:00 2024-03-27T09:56:45.892 INFO:teuthology.orchestra.run.smithi057.stdout:(133/174): python3-logutils-0.3.5-21.el9.noarch 646 kB/s | 46 kB 00:00 2024-03-27T09:56:45.918 INFO:teuthology.orchestra.run.smithi057.stdout:(134/174): python3-more-itertools-8.12.0-2.el9. 814 kB/s | 79 kB 00:00 2024-03-27T09:56:45.934 INFO:teuthology.orchestra.run.smithi057.stdout:(135/174): python3-natsort-7.1.1-5.el9.noarch.r 904 kB/s | 58 kB 00:00 2024-03-27T09:56:45.968 INFO:teuthology.orchestra.run.smithi057.stdout:(136/174): python3-pecan-1.4.2-3.el9.noarch.rpm 3.6 MB/s | 272 kB 00:00 2024-03-27T09:56:45.994 INFO:teuthology.orchestra.run.smithi057.stdout:(137/174): python3-portend-3.1.0-2.el9.noarch.r 217 kB/s | 16 kB 00:00 2024-03-27T09:56:46.019 INFO:teuthology.orchestra.run.smithi057.stdout:(138/174): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.0 MB/s | 90 kB 00:00 2024-03-27T09:56:46.045 INFO:teuthology.orchestra.run.smithi057.stdout:(139/174): python3-pyperclip-1.8.2-2.el9.noarch 374 kB/s | 28 kB 00:00 2024-03-27T09:56:46.070 INFO:teuthology.orchestra.run.smithi057.stdout:(140/174): python3-repoze-lru-0.7-16.el9.noarch 411 kB/s | 31 kB 00:00 2024-03-27T09:56:46.104 INFO:teuthology.orchestra.run.smithi057.stdout:(141/174): python3-routes-2.5.1-5.el9.noarch.rp 2.2 MB/s | 188 kB 00:00 2024-03-27T09:56:46.129 INFO:teuthology.orchestra.run.smithi057.stdout:(142/174): python3-rsa-4.9-2.el9.noarch.rpm 710 kB/s | 59 kB 00:00 2024-03-27T09:56:46.138 INFO:teuthology.orchestra.run.smithi118.stdout:(87/174): jq-1.6-16.el9.x86_64.rpm 665 kB/s | 187 kB 00:00 2024-03-27T09:56:46.184 INFO:teuthology.orchestra.run.smithi057.stdout:(143/174): python3-tempora-5.0.0-2.el9.noarch.r 316 kB/s | 36 kB 00:00 2024-03-27T09:56:46.213 INFO:teuthology.orchestra.run.smithi057.stdout:(144/174): python3-typing-extensions-4.4.0-2.el 471 kB/s | 51 kB 00:00 2024-03-27T09:56:46.246 INFO:teuthology.orchestra.run.smithi057.stdout:(145/174): python3-webob-1.8.7-6.el9.noarch.rpm 1.9 MB/s | 230 kB 00:00 2024-03-27T09:56:46.263 INFO:teuthology.orchestra.run.smithi118.stdout:(88/174): libquadmath-11.4.1-3.el9.x86_64.rpm 1.5 MB/s | 195 kB 00:00 2024-03-27T09:56:46.272 INFO:teuthology.orchestra.run.smithi057.stdout:(146/174): python3-websocket-client-1.2.3-2.el9 1.0 MB/s | 90 kB 00:00 2024-03-27T09:56:46.297 INFO:teuthology.orchestra.run.smithi118.stdout:(89/174): libgfortran-11.4.1-3.el9.x86_64.rpm 1.9 MB/s | 803 kB 00:00 2024-03-27T09:56:46.305 INFO:teuthology.orchestra.run.smithi057.stdout:(147/174): python3-werkzeug-2.0.3-3.el9.1.noarc 4.6 MB/s | 427 kB 00:00 2024-03-27T09:56:46.331 INFO:teuthology.orchestra.run.smithi057.stdout:(148/174): python3-zc-lockfile-2.0-10.el9.noarc 240 kB/s | 20 kB 00:00 2024-03-27T09:56:46.347 INFO:teuthology.orchestra.run.smithi118.stdout:(90/174): python3-requests-2.25.1-8.el9.noarch. 1.5 MB/s | 125 kB 00:00 2024-03-27T09:56:46.364 INFO:teuthology.orchestra.run.smithi057.stdout:(149/174): re2-20211101-3.el9.x86_64.rpm 2.0 MB/s | 192 kB 00:00 2024-03-27T09:56:46.431 INFO:teuthology.orchestra.run.smithi057.stdout:(150/174): thrift-0.15.0-2.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-03-27T09:56:46.456 INFO:teuthology.orchestra.run.smithi118.stdout:(91/174): elfutils-libelf-devel-0.190-2.el9.x86 136 kB/s | 21 kB 00:00 2024-03-27T09:56:46.481 INFO:teuthology.orchestra.run.smithi118.stdout:(92/174): libuuid-devel-2.37.4-18.el9.x86_64.rp 191 kB/s | 25 kB 00:00 2024-03-27T09:56:46.490 INFO:teuthology.orchestra.run.smithi057.stdout:(151/174): xfsdump-3.1.12-4.el9.x86_64.rpm 5.5 MB/s | 321 kB 00:00 2024-03-27T09:56:47.374 INFO:teuthology.orchestra.run.smithi057.stdout:(152/174): librbd1-19.0.0-2478.g155268c4.el9.x8 3.1 MB/s | 3.1 MB 00:01 2024-03-27T09:56:47.457 INFO:teuthology.orchestra.run.smithi057.stdout:(153/174): librados2-19.0.0-2478.g155268c4.el9. 3.0 MB/s | 3.4 MB 00:01 2024-03-27T09:56:47.465 INFO:teuthology.orchestra.run.smithi118.stdout:(93/174): ceph-test-19.0.0-2478.g155268c4.el9.x 5.4 MB/s | 48 MB 00:08 2024-03-27T09:56:47.948 INFO:teuthology.orchestra.run.smithi118.stdout:(94/174): postgresql-contrib-13.14-1.el9.x86_64 1.8 MB/s | 911 kB 00:00 2024-03-27T09:56:48.015 INFO:teuthology.orchestra.run.smithi118.stdout:(95/174): postgresql-private-libs-13.14-1.el9.x 2.0 MB/s | 133 kB 00:00 2024-03-27T09:56:48.266 INFO:teuthology.orchestra.run.smithi118.stdout:(96/174): postgresql-13.14-1.el9.x86_64.rpm 912 kB/s | 1.6 MB 00:01 2024-03-27T09:56:48.366 INFO:teuthology.orchestra.run.smithi057.stdout:(154/174): NetworkManager-team-1.47.2-1.el9.x86 46 kB/s | 42 kB 00:00 2024-03-27T09:56:48.458 INFO:teuthology.orchestra.run.smithi118.stdout:(97/174): python3-devel-3.9.17-2.el9.x86_64.rpm 1.3 MB/s | 245 kB 00:00 2024-03-27T09:56:48.708 INFO:teuthology.orchestra.run.smithi118.stdout:(98/174): python3-jinja2-2.11.3-5.el9.noarch.rp 995 kB/s | 248 kB 00:00 2024-03-27T09:56:48.858 INFO:teuthology.orchestra.run.smithi118.stdout:(99/174): qatlib-24.02.0-1.el9.x86_64.rpm 1.4 MB/s | 221 kB 00:00 2024-03-27T09:56:48.967 INFO:teuthology.orchestra.run.smithi118.stdout:(100/174): postgresql-server-13.14-1.el9.x86_64 6.1 MB/s | 5.8 MB 00:00 2024-03-27T09:56:48.992 INFO:teuthology.orchestra.run.smithi118.stdout:(101/174): qatlib-service-24.02.0-1.el9.x86_64. 270 kB/s | 36 kB 00:00 2024-03-27T09:56:49.017 INFO:teuthology.orchestra.run.smithi118.stdout:(102/174): qatzip-libs-1.2.0-1.el9.x86_64.rpm 960 kB/s | 47 kB 00:00 2024-03-27T09:56:49.101 INFO:teuthology.orchestra.run.smithi118.stdout:(103/174): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 865 kB/s | 94 kB 00:00 2024-03-27T09:56:49.135 INFO:teuthology.orchestra.run.smithi118.stdout:(104/174): lua-devel-5.4.4-4.el9.x86_64.rpm 191 kB/s | 22 kB 00:00 2024-03-27T09:56:49.335 INFO:teuthology.orchestra.run.smithi118.stdout:(105/174): protobuf-compiler-3.14.0-13.el9.x86_ 3.6 MB/s | 863 kB 00:00 2024-03-27T09:56:49.416 INFO:teuthology.orchestra.run.smithi057.stdout:(155/174): NetworkManager-tui-1.47.2-1.el9.x86_ 237 kB/s | 248 kB 00:01 2024-03-27T09:56:49.552 INFO:teuthology.orchestra.run.smithi118.stdout:(106/174): openssl-devel-3.0.7-27.el9.x86_64.rp 1.3 MB/s | 4.1 MB 00:03 2024-03-27T09:56:49.694 INFO:teuthology.orchestra.run.smithi118.stdout:(107/174): abseil-cpp-20211102.0-3.el9.x86_64.r 983 kB/s | 548 kB 00:00 2024-03-27T09:56:49.803 INFO:teuthology.orchestra.run.smithi118.stdout:(108/174): grpc-data-1.46.7-10.el9.noarch.rpm 79 kB/s | 19 kB 00:00 2024-03-27T09:56:49.844 INFO:teuthology.orchestra.run.smithi118.stdout:(109/174): gperftools-libs-2.9.1-2.el9.x86_64.r 608 kB/s | 309 kB 00:00 2024-03-27T09:56:49.878 INFO:teuthology.orchestra.run.smithi118.stdout:(110/174): libarrow-doc-9.0.0-10.el9.noarch.rpm 349 kB/s | 26 kB 00:00 2024-03-27T09:56:49.903 INFO:teuthology.orchestra.run.smithi118.stdout:(111/174): liboath-2.6.7-2.el9.x86_64.rpm 841 kB/s | 49 kB 00:00 2024-03-27T09:56:50.158 INFO:teuthology.orchestra.run.smithi057.stdout:(156/174): acl-2.3.1-4.el9.x86_64.rpm 96 kB/s | 71 kB 00:00 2024-03-27T09:56:50.162 INFO:teuthology.orchestra.run.smithi118.stdout:(112/174): luarocks-3.9.2-1.el9.noarch.rpm 586 kB/s | 151 kB 00:00 2024-03-27T09:56:50.179 INFO:teuthology.orchestra.run.smithi118.stdout:(113/174): libunwind-1.6.2-1.el9.x86_64.rpm 225 kB/s | 67 kB 00:00 2024-03-27T09:56:50.296 INFO:teuthology.orchestra.run.smithi118.stdout:(114/174): parquet-libs-9.0.0-10.el9.x86_64.rpm 6.2 MB/s | 838 kB 00:00 2024-03-27T09:56:50.363 INFO:teuthology.orchestra.run.smithi118.stdout:(115/174): python3-asyncssh-2.13.2-5.el9.noarch 2.9 MB/s | 548 kB 00:00 2024-03-27T09:56:50.388 INFO:teuthology.orchestra.run.smithi118.stdout:(116/174): python3-bcrypt-3.2.2-1.el9.x86_64.rp 477 kB/s | 43 kB 00:00 2024-03-27T09:56:50.422 INFO:teuthology.orchestra.run.smithi118.stdout:(117/174): python3-cachetools-4.2.4-1.el9.noarc 557 kB/s | 32 kB 00:00 2024-03-27T09:56:50.447 INFO:teuthology.orchestra.run.smithi118.stdout:(118/174): python3-certifi-2021.10.8-2.el9.noar 258 kB/s | 15 kB 00:00 2024-03-27T09:56:50.508 INFO:teuthology.orchestra.run.smithi057.stdout:(157/174): NetworkManager-1.47.2-1.el9.x86_64.r 588 kB/s | 2.3 MB 00:04 2024-03-27T09:56:50.547 INFO:teuthology.orchestra.run.smithi118.stdout:(119/174): libarrow-9.0.0-10.el9.x86_64.rpm 5.2 MB/s | 4.4 MB 00:00 2024-03-27T09:56:50.581 INFO:teuthology.orchestra.run.smithi118.stdout:(120/174): python3-cheroot-8.6.0-4.el9.noarch.r 1.1 MB/s | 172 kB 00:00 2024-03-27T09:56:50.692 INFO:teuthology.orchestra.run.smithi057.stdout:(158/174): NetworkManager-libnm-1.47.2-1.el9.x8 566 kB/s | 1.8 MB 00:03 2024-03-27T09:56:50.881 INFO:teuthology.orchestra.run.smithi118.stdout:(121/174): python3-cherrypy-18.6.1-2.el9.noarch 827 kB/s | 358 kB 00:00 2024-03-27T09:56:50.885 INFO:teuthology.orchestra.run.smithi057.stdout:(159/174): elfutils-debuginfod-client-0.190-2.e 50 kB/s | 36 kB 00:00 2024-03-27T09:56:50.914 INFO:teuthology.orchestra.run.smithi118.stdout:(122/174): python3-colorama-0.4.4-12.el9.noarch 106 kB/s | 35 kB 00:00 2024-03-27T09:56:50.947 INFO:teuthology.orchestra.run.smithi118.stdout:(123/174): python3-cmd2-2.4.2-2.el9.noarch.rpm 760 kB/s | 303 kB 00:00 2024-03-27T09:56:50.981 INFO:teuthology.orchestra.run.smithi118.stdout:(124/174): python3-google-auth-2.28.2-1.el9.noa 2.0 MB/s | 203 kB 00:00 2024-03-27T09:56:51.023 INFO:teuthology.orchestra.run.smithi118.stdout:(125/174): python3-grpcio-tools-1.46.7-10.el9.x 1.9 MB/s | 144 kB 00:00 2024-03-27T09:56:51.307 INFO:teuthology.orchestra.run.smithi118.stdout:(126/174): python3-jaraco-8.2.1-3.el9.noarch.rp 33 kB/s | 11 kB 00:00 2024-03-27T09:56:51.526 INFO:teuthology.orchestra.run.smithi057.stdout:(160/174): elfutils-libelf-0.190-2.el9.x86_64.r 189 kB/s | 192 kB 00:01 2024-03-27T09:56:51.551 INFO:teuthology.orchestra.run.smithi057.stdout:(161/174): libacl-2.3.1-4.el9.x86_64.rpm 35 kB/s | 23 kB 00:00 2024-03-27T09:56:51.699 INFO:teuthology.orchestra.run.smithi118.stdout:(127/174): python3-jaraco-classes-3.2.1-5.el9.n 26 kB/s | 18 kB 00:00 2024-03-27T09:56:51.899 INFO:teuthology.orchestra.run.smithi118.stdout:(128/174): python3-jaraco-collections-3.0.0-8.e 39 kB/s | 23 kB 00:00 2024-03-27T09:56:51.901 INFO:teuthology.orchestra.run.smithi057.stdout:(162/174): elfutils-libs-0.190-2.el9.x86_64.rpm 212 kB/s | 256 kB 00:01 2024-03-27T09:56:51.924 INFO:teuthology.orchestra.run.smithi118.stdout:(129/174): python3-jaraco-functools-3.5.0-2.el9 87 kB/s | 19 kB 00:00 2024-03-27T09:56:51.958 INFO:teuthology.orchestra.run.smithi118.stdout:(130/174): python3-jaraco-text-3.2.0-6.el9.noar 350 kB/s | 20 kB 00:00 2024-03-27T09:56:52.025 INFO:teuthology.orchestra.run.smithi118.stdout:(131/174): python3-grpcio-1.46.7-10.el9.x86_64. 1.8 MB/s | 2.0 MB 00:01 2024-03-27T09:56:52.050 INFO:teuthology.orchestra.run.smithi118.stdout:(132/174): python3-logutils-0.3.5-21.el9.noarch 507 kB/s | 46 kB 00:00 2024-03-27T09:56:52.109 INFO:teuthology.orchestra.run.smithi118.stdout:(133/174): python3-kubernetes-26.1.0-2.el9.noar 5.6 MB/s | 1.0 MB 00:00 2024-03-27T09:56:52.134 INFO:teuthology.orchestra.run.smithi118.stdout:(134/174): python3-natsort-7.1.1-5.el9.noarch.r 696 kB/s | 58 kB 00:00 2024-03-27T09:56:52.159 INFO:teuthology.orchestra.run.smithi118.stdout:(135/174): python3-more-itertools-8.12.0-2.el9. 591 kB/s | 79 kB 00:00 2024-03-27T09:56:52.201 INFO:teuthology.orchestra.run.smithi118.stdout:(136/174): python3-pecan-1.4.2-3.el9.noarch.rpm 2.9 MB/s | 272 kB 00:00 2024-03-27T09:56:52.227 INFO:teuthology.orchestra.run.smithi118.stdout:(137/174): python3-portend-3.1.0-2.el9.noarch.r 179 kB/s | 16 kB 00:00 2024-03-27T09:56:52.252 INFO:teuthology.orchestra.run.smithi118.stdout:(138/174): python3-pyOpenSSL-21.0.0-1.el9.noarc 983 kB/s | 90 kB 00:00 2024-03-27T09:56:52.277 INFO:teuthology.orchestra.run.smithi118.stdout:(139/174): python3-pyperclip-1.8.2-2.el9.noarch 378 kB/s | 28 kB 00:00 2024-03-27T09:56:52.303 INFO:teuthology.orchestra.run.smithi118.stdout:(140/174): python3-repoze-lru-0.7-16.el9.noarch 410 kB/s | 31 kB 00:00 2024-03-27T09:56:52.343 INFO:teuthology.orchestra.run.smithi057.stdout:(163/174): libblkid-2.37.4-18.el9.x86_64.rpm 133 kB/s | 108 kB 00:00 2024-03-27T09:56:52.361 INFO:teuthology.orchestra.run.smithi118.stdout:(141/174): python3-routes-2.5.1-5.el9.noarch.rp 1.7 MB/s | 188 kB 00:00 2024-03-27T09:56:52.387 INFO:teuthology.orchestra.run.smithi118.stdout:(142/174): python3-tempora-5.0.0-2.el9.noarch.r 431 kB/s | 36 kB 00:00 2024-03-27T09:56:52.412 INFO:teuthology.orchestra.run.smithi118.stdout:(143/174): python3-rsa-4.9-2.el9.noarch.rpm 443 kB/s | 59 kB 00:00 2024-03-27T09:56:52.437 INFO:teuthology.orchestra.run.smithi118.stdout:(144/174): python3-typing-extensions-4.4.0-2.el 682 kB/s | 51 kB 00:00 2024-03-27T09:56:52.461 INFO:teuthology.orchestra.run.smithi057.stdout:(164/174): libfdisk-2.37.4-18.el9.x86_64.rpm 170 kB/s | 155 kB 00:00 2024-03-27T09:56:52.470 INFO:teuthology.orchestra.run.smithi118.stdout:(145/174): python3-webob-1.8.7-6.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-03-27T09:56:52.496 INFO:teuthology.orchestra.run.smithi118.stdout:(146/174): python3-websocket-client-1.2.3-2.el9 1.0 MB/s | 90 kB 00:00 2024-03-27T09:56:52.538 INFO:teuthology.orchestra.run.smithi118.stdout:(147/174): python3-werkzeug-2.0.3-3.el9.1.noarc 4.2 MB/s | 427 kB 00:00 2024-03-27T09:56:52.563 INFO:teuthology.orchestra.run.smithi118.stdout:(148/174): python3-zc-lockfile-2.0-10.el9.noarc 217 kB/s | 20 kB 00:00 2024-03-27T09:56:52.597 INFO:teuthology.orchestra.run.smithi118.stdout:(149/174): re2-20211101-3.el9.x86_64.rpm 1.9 MB/s | 192 kB 00:00 2024-03-27T09:56:52.744 INFO:teuthology.orchestra.run.smithi057.stdout:(165/174): libmount-2.37.4-18.el9.x86_64.rpm 161 kB/s | 136 kB 00:00 2024-03-27T09:56:52.789 INFO:teuthology.orchestra.run.smithi118.stdout:(150/174): thrift-0.15.0-2.el9.x86_64.rpm 6.3 MB/s | 1.6 MB 00:00 2024-03-27T09:56:52.831 INFO:teuthology.orchestra.run.smithi118.stdout:(151/174): xfsdump-3.1.12-4.el9.x86_64.rpm 7.7 MB/s | 321 kB 00:00 2024-03-27T09:56:53.136 INFO:teuthology.orchestra.run.smithi057.stdout:(166/174): libsmartcols-2.37.4-18.el9.x86_64.rp 81 kB/s | 64 kB 00:00 2024-03-27T09:56:53.140 INFO:teuthology.orchestra.run.smithi118.stdout:(152/174): librados2-19.0.0-2478.g155268c4.el9. 5.9 MB/s | 3.4 MB 00:00 2024-03-27T09:56:53.161 INFO:teuthology.orchestra.run.smithi057.stdout:(167/174): libuuid-2.37.4-18.el9.x86_64.rpm 41 kB/s | 29 kB 00:00 2024-03-27T09:56:53.257 INFO:teuthology.orchestra.run.smithi118.stdout:(153/174): NetworkManager-1.47.2-1.el9.x86_64.r 5.4 MB/s | 2.3 MB 00:00 2024-03-27T09:56:53.423 INFO:teuthology.orchestra.run.smithi118.stdout:(154/174): librbd1-19.0.0-2478.g155268c4.el9.x8 3.8 MB/s | 3.1 MB 00:00 2024-03-27T09:56:53.507 INFO:teuthology.orchestra.run.smithi118.stdout:(155/174): NetworkManager-libnm-1.47.2-1.el9.x8 5.0 MB/s | 1.8 MB 00:00 2024-03-27T09:56:53.611 INFO:teuthology.orchestra.run.smithi118.stdout:(156/174): NetworkManager-team-1.47.2-1.el9.x86 119 kB/s | 42 kB 00:00 2024-03-27T09:56:53.658 INFO:teuthology.orchestra.run.smithi118.stdout:(157/174): acl-2.3.1-4.el9.x86_64.rpm 788 kB/s | 71 kB 00:00 2024-03-27T09:56:53.691 INFO:teuthology.orchestra.run.smithi118.stdout:(158/174): elfutils-debuginfod-client-0.190-2.e 472 kB/s | 36 kB 00:00 2024-03-27T09:56:53.742 INFO:teuthology.orchestra.run.smithi118.stdout:(159/174): NetworkManager-tui-1.47.2-1.el9.x86_ 789 kB/s | 248 kB 00:00 2024-03-27T09:56:53.775 INFO:teuthology.orchestra.run.smithi118.stdout:(160/174): elfutils-libelf-0.190-2.el9.x86_64.r 1.6 MB/s | 192 kB 00:00 2024-03-27T09:56:53.826 INFO:teuthology.orchestra.run.smithi118.stdout:(161/174): elfutils-libs-0.190-2.el9.x86_64.rpm 1.9 MB/s | 256 kB 00:00 2024-03-27T09:56:53.851 INFO:teuthology.orchestra.run.smithi118.stdout:(162/174): libacl-2.3.1-4.el9.x86_64.rpm 213 kB/s | 23 kB 00:00 2024-03-27T09:56:53.876 INFO:teuthology.orchestra.run.smithi118.stdout:(163/174): libblkid-2.37.4-18.el9.x86_64.rpm 1.1 MB/s | 108 kB 00:00 2024-03-27T09:56:53.910 INFO:teuthology.orchestra.run.smithi118.stdout:(164/174): libfdisk-2.37.4-18.el9.x86_64.rpm 1.8 MB/s | 155 kB 00:00 2024-03-27T09:56:53.943 INFO:teuthology.orchestra.run.smithi118.stdout:(165/174): libmount-2.37.4-18.el9.x86_64.rpm 1.4 MB/s | 136 kB 00:00 2024-03-27T09:56:53.969 INFO:teuthology.orchestra.run.smithi118.stdout:(166/174): libsmartcols-2.37.4-18.el9.x86_64.rp 700 kB/s | 64 kB 00:00 2024-03-27T09:56:53.994 INFO:teuthology.orchestra.run.smithi118.stdout:(167/174): libuuid-2.37.4-18.el9.x86_64.rpm 346 kB/s | 29 kB 00:00 2024-03-27T09:56:54.094 INFO:teuthology.orchestra.run.smithi118.stdout:(168/174): openssl-3.0.7-27.el9.x86_64.rpm 8.1 MB/s | 1.2 MB 00:00 2024-03-27T09:56:54.178 INFO:teuthology.orchestra.run.smithi118.stdout:(169/174): util-linux-core-2.37.4-18.el9.x86_64 5.5 MB/s | 465 kB 00:00 2024-03-27T09:56:54.258 INFO:teuthology.orchestra.run.smithi118.stdout:(170/174): openssl-libs-3.0.7-27.el9.x86_64.rpm 7.5 MB/s | 2.2 MB 00:00 2024-03-27T09:56:54.312 INFO:teuthology.orchestra.run.smithi118.stdout:(171/174): util-linux-user-2.37.4-18.el9.x86_64 234 kB/s | 31 kB 00:00 2024-03-27T09:56:54.371 INFO:teuthology.orchestra.run.smithi118.stdout:(172/174): util-linux-2.37.4-18.el9.x86_64.rpm 6.1 MB/s | 2.3 MB 00:00 2024-03-27T09:56:54.437 INFO:teuthology.orchestra.run.smithi118.stdout:(173/174): xfsprogs-6.3.0-1.el9.x86_64.rpm 6.0 MB/s | 1.1 MB 00:00 2024-03-27T09:56:54.479 INFO:teuthology.orchestra.run.smithi118.stdout:(174/174): libacl-devel-2.3.1-4.el9.x86_64.rpm 448 kB/s | 74 kB 00:00 2024-03-27T09:56:54.496 INFO:teuthology.orchestra.run.smithi118.stdout:-------------------------------------------------------------------------------- 2024-03-27T09:56:54.496 INFO:teuthology.orchestra.run.smithi118.stdout:Total 8.9 MB/s | 227 MB 00:25 2024-03-27T09:56:55.095 INFO:teuthology.orchestra.run.smithi057.stdout:(168/174): openssl-3.0.7-27.el9.x86_64.rpm 544 kB/s | 1.2 MB 00:02 2024-03-27T09:56:56.136 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction check 2024-03-27T09:56:56.436 INFO:teuthology.orchestra.run.smithi057.stdout:(169/174): util-linux-core-2.37.4-18.el9.x86_64 347 kB/s | 465 kB 00:01 2024-03-27T09:56:56.516 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction check succeeded. 2024-03-27T09:56:56.516 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction test 2024-03-27T09:56:56.595 INFO:teuthology.orchestra.run.smithi057.stdout:(170/174): openssl-libs-3.0.7-27.el9.x86_64.rpm 638 kB/s | 2.2 MB 00:03 2024-03-27T09:56:56.828 INFO:teuthology.orchestra.run.smithi057.stdout:(171/174): util-linux-2.37.4-18.el9.x86_64.rpm 638 kB/s | 2.3 MB 00:03 2024-03-27T09:56:56.995 INFO:teuthology.orchestra.run.smithi057.stdout:(172/174): libacl-devel-2.3.1-4.el9.x86_64.rpm 776 kB/s | 74 kB 00:00 2024-03-27T09:56:57.129 INFO:teuthology.orchestra.run.smithi057.stdout:(173/174): util-linux-user-2.37.4-18.el9.x86_64 45 kB/s | 31 kB 00:00 2024-03-27T09:56:58.704 INFO:teuthology.orchestra.run.smithi057.stdout:(174/174): xfsprogs-6.3.0-1.el9.x86_64.rpm 522 kB/s | 1.1 MB 00:02 2024-03-27T09:56:58.714 INFO:teuthology.orchestra.run.smithi057.stdout:-------------------------------------------------------------------------------- 2024-03-27T09:56:58.714 INFO:teuthology.orchestra.run.smithi057.stdout:Total 7.4 MB/s | 227 MB 00:30 2024-03-27T09:56:59.007 INFO:teuthology.orchestra.run.smithi118.stdout:Transaction test succeeded. 2024-03-27T09:56:59.008 INFO:teuthology.orchestra.run.smithi118.stdout:Running transaction 2024-03-27T09:57:00.405 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction check 2024-03-27T09:57:00.805 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction check succeeded. 2024-03-27T09:57:00.805 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction test 2024-03-27T09:57:03.404 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction test succeeded. 2024-03-27T09:57:03.404 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction 2024-03-27T09:57:06.462 INFO:teuthology.orchestra.run.smithi118.stdout: Preparing : 1/1 2024-03-27T09:57:06.576 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/198 2024-03-27T09:57:06.624 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/198 2024-03-27T09:57:06.662 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-27T09:57:06.706 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-27T09:57:06.797 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/198 2024-03-27T09:57:06.924 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/198 2024-03-27T09:57:06.990 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/198 2024-03-27T09:57:07.021 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/198 2024-03-27T09:57:07.116 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/198 2024-03-27T09:57:07.528 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/198 2024-03-27T09:57:07.603 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : librados2-2:19.0.0-2478.g155268c4.el9.x86_64 10/198 2024-03-27T09:57:07.756 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: librados2-2:19.0.0-2478.g155268c4.el9.x86_64 10/198 2024-03-27T09:57:07.779 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libcephfs2-2:19.0.0-2478.g155268c4.el9.x86_64 11/198 2024-03-27T09:57:07.899 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: libcephfs2-2:19.0.0-2478.g155268c4.el9.x86_64 11/198 2024-03-27T09:57:07.927 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-rados-2:19.0.0-2478.g155268c4.el9.x86_64 12/198 2024-03-27T09:57:07.988 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 13/198 2024-03-27T09:57:08.253 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 14/198 2024-03-27T09:57:08.301 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : postgresql-13.14-1.el9.x86_64 15/198 2024-03-27T09:57:08.326 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libcephsqlite-2:19.0.0-2478.g155268c4.el9.x86_64 16/198 2024-03-27T09:57:08.507 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2478.g155268c4.el9.x86_64 16/198 2024-03-27T09:57:08.552 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libradosstriper1-2:19.0.0-2478.g155268c4.el9.x86 17/198 2024-03-27T09:57:08.643 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2478.g155268c4.el9.x86 17/198 2024-03-27T09:57:08.930 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/198 2024-03-27T09:57:08.962 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-03-27T09:57:09.024 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-03-27T09:57:09.268 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 20/198 2024-03-27T09:57:09.321 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 20/198 2024-03-27T09:57:09.371 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/198 2024-03-27T09:57:09.691 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/198 2024-03-27T09:57:09.887 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : NetworkManager-libnm-1:1.47.2-1.el9.x86_64 23/198 2024-03-27T09:57:09.976 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.2-1.el9.x86_64 23/198 2024-03-27T09:57:10.161 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-27T09:57:10.223 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-27T09:57:10.606 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-27T09:57:10.771 INFO:teuthology.orchestra.run.smithi057.stdout: Preparing : 1/1 2024-03-27T09:57:10.787 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/198 2024-03-27T09:57:10.903 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/198 2024-03-27T09:57:10.930 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/198 2024-03-27T09:57:10.956 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/198 2024-03-27T09:57:10.988 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/198 2024-03-27T09:57:10.994 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-27T09:57:11.026 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/198 2024-03-27T09:57:11.040 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-27T09:57:11.089 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/198 2024-03-27T09:57:11.127 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/198 2024-03-27T09:57:11.207 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/198 2024-03-27T09:57:11.223 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/198 2024-03-27T09:57:11.279 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/198 2024-03-27T09:57:11.296 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 31/198 2024-03-27T09:57:11.310 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/198 2024-03-27T09:57:11.329 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 32/198 2024-03-27T09:57:11.396 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/198 2024-03-27T09:57:11.419 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/198 2024-03-27T09:57:11.459 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/198 2024-03-27T09:57:11.519 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/198 2024-03-27T09:57:11.564 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/198 2024-03-27T09:57:11.630 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : lua-5.4.4-4.el9.x86_64 37/198 2024-03-27T09:57:11.752 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 38/198 2024-03-27T09:57:11.792 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-ceph-common-2:19.0.0-2478.g155268c4.el9. 39/198 2024-03-27T09:57:11.818 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/198 2024-03-27T09:57:11.844 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-ceph-argparse-2:19.0.0-2478.g155268c4.el 40/198 2024-03-27T09:57:11.850 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : librados2-2:19.0.0-2478.g155268c4.el9.x86_64 10/198 2024-03-27T09:57:11.874 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-cephfs-2:19.0.0-2478.g155268c4.el9.x86_6 41/198 2024-03-27T09:57:11.988 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/198 2024-03-27T09:57:12.001 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: librados2-2:19.0.0-2478.g155268c4.el9.x86_64 10/198 2024-03-27T09:57:12.026 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libcephfs2-2:19.0.0-2478.g155268c4.el9.x86_64 11/198 2024-03-27T09:57:12.045 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/198 2024-03-27T09:57:12.144 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/198 2024-03-27T09:57:12.148 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: libcephfs2-2:19.0.0-2478.g155268c4.el9.x86_64 11/198 2024-03-27T09:57:12.184 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-rados-2:19.0.0-2478.g155268c4.el9.x86_64 12/198 2024-03-27T09:57:12.237 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 13/198 2024-03-27T09:57:12.314 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/198 2024-03-27T09:57:12.397 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/198 2024-03-27T09:57:12.536 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 14/198 2024-03-27T09:57:12.590 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : postgresql-13.14-1.el9.x86_64 15/198 2024-03-27T09:57:12.615 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libcephsqlite-2:19.0.0-2478.g155268c4.el9.x86_64 16/198 2024-03-27T09:57:12.790 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2478.g155268c4.el9.x86_64 16/198 2024-03-27T09:57:12.825 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libradosstriper1-2:19.0.0-2478.g155268c4.el9.x86 17/198 2024-03-27T09:57:12.899 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2478.g155268c4.el9.x86 17/198 2024-03-27T09:57:12.954 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/198 2024-03-27T09:57:12.987 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-03-27T09:57:13.049 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-03-27T09:57:13.075 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/198 2024-03-27T09:57:13.176 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/198 2024-03-27T09:57:13.285 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/198 2024-03-27T09:57:13.344 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 20/198 2024-03-27T09:57:13.345 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-27T09:57:13.372 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-27T09:57:13.387 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 20/198 2024-03-27T09:57:13.417 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 51/198 2024-03-27T09:57:13.428 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/198 2024-03-27T09:57:13.476 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 52/198 2024-03-27T09:57:13.551 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : librados-devel-2:19.0.0-2478.g155268c4.el9.x86_6 53/198 2024-03-27T09:57:13.594 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 54/198 2024-03-27T09:57:13.741 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/198 2024-03-27T09:57:13.912 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : NetworkManager-libnm-1:1.47.2-1.el9.x86_64 23/198 2024-03-27T09:57:13.996 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 55/198 2024-03-27T09:57:13.999 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.2-1.el9.x86_64 23/198 2024-03-27T09:57:14.209 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 56/198 2024-03-27T09:57:14.210 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-27T09:57:14.263 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-27T09:57:14.327 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 57/198 2024-03-27T09:57:14.390 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 58/198 2024-03-27T09:57:14.584 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 59/198 2024-03-27T09:57:14.630 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-27T09:57:14.640 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 60/198 2024-03-27T09:57:14.711 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 61/198 2024-03-27T09:57:14.795 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 62/198 2024-03-27T09:57:14.829 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/198 2024-03-27T09:57:14.839 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 63/198 2024-03-27T09:57:14.877 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 64/198 2024-03-27T09:57:14.943 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 65/198 2024-03-27T09:57:14.963 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/198 2024-03-27T09:57:14.987 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 66/198 2024-03-27T09:57:15.002 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/198 2024-03-27T09:57:15.031 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 67/198 2024-03-27T09:57:15.039 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/198 2024-03-27T09:57:15.085 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 68/198 2024-03-27T09:57:15.099 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/198 2024-03-27T09:57:15.212 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/198 2024-03-27T09:57:15.276 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 69/198 2024-03-27T09:57:15.290 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 31/198 2024-03-27T09:57:15.337 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 32/198 2024-03-27T09:57:15.343 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 70/198 2024-03-27T09:57:15.381 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 71/198 2024-03-27T09:57:15.442 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/198 2024-03-27T09:57:15.458 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 72/198 2024-03-27T09:57:15.491 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/198 2024-03-27T09:57:15.555 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/198 2024-03-27T09:57:15.597 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 73/198 2024-03-27T09:57:15.605 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/198 2024-03-27T09:57:15.644 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : lua-5.4.4-4.el9.x86_64 37/198 2024-03-27T09:57:15.646 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 74/198 2024-03-27T09:57:15.694 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 75/198 2024-03-27T09:57:15.730 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 76/198 2024-03-27T09:57:15.763 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 77/198 2024-03-27T09:57:15.766 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 38/198 2024-03-27T09:57:15.806 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-ceph-common-2:19.0.0-2478.g155268c4.el9. 39/198 2024-03-27T09:57:15.842 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-ceph-argparse-2:19.0.0-2478.g155268c4.el 40/198 2024-03-27T09:57:15.862 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-cephfs-2:19.0.0-2478.g155268c4.el9.x86_6 41/198 2024-03-27T09:57:15.908 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 78/198 2024-03-27T09:57:15.966 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/198 2024-03-27T09:57:16.049 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/198 2024-03-27T09:57:16.074 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 79/198 2024-03-27T09:57:16.152 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/198 2024-03-27T09:57:16.223 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 80/198 2024-03-27T09:57:16.298 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 81/198 2024-03-27T09:57:16.332 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/198 2024-03-27T09:57:16.361 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-ply-3.11-14.el9.noarch 82/198 2024-03-27T09:57:16.394 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/198 2024-03-27T09:57:16.435 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 83/198 2024-03-27T09:57:16.681 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 84/198 2024-03-27T09:57:17.014 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 85/198 2024-03-27T09:57:17.126 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/198 2024-03-27T09:57:17.207 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/198 2024-03-27T09:57:17.226 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/198 2024-03-27T09:57:17.256 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 87/198 2024-03-27T09:57:17.298 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 88/198 2024-03-27T09:57:17.336 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : fuse-2.9.9-15.el9.x86_64 89/198 2024-03-27T09:57:17.341 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/198 2024-03-27T09:57:17.388 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 90/198 2024-03-27T09:57:17.391 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-27T09:57:17.419 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-27T09:57:17.435 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 91/198 2024-03-27T09:57:17.475 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 51/198 2024-03-27T09:57:17.523 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : uuid-1.6.2-55.el9.x86_64 92/198 2024-03-27T09:57:17.540 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 52/198 2024-03-27T09:57:17.588 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 93/198 2024-03-27T09:57:17.592 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : librados-devel-2:19.0.0-2478.g155268c4.el9.x86_6 53/198 2024-03-27T09:57:17.633 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 94/198 2024-03-27T09:57:17.640 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 54/198 2024-03-27T09:57:17.760 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 95/198 2024-03-27T09:57:17.793 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 96/198 2024-03-27T09:57:17.829 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 97/198 2024-03-27T09:57:17.892 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 98/198 2024-03-27T09:57:17.933 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 99/198 2024-03-27T09:57:18.049 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 55/198 2024-03-27T09:57:18.076 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 100/198 2024-03-27T09:57:18.210 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 101/198 2024-03-27T09:57:18.230 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 56/198 2024-03-27T09:57:18.270 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 102/198 2024-03-27T09:57:18.306 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 103/198 2024-03-27T09:57:18.312 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 57/198 2024-03-27T09:57:18.361 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 104/198 2024-03-27T09:57:18.378 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 58/198 2024-03-27T09:57:18.510 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-packaging-20.9-5.el9.noarch 105/198 2024-03-27T09:57:18.588 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 106/198 2024-03-27T09:57:18.594 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 59/198 2024-03-27T09:57:18.649 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 60/198 2024-03-27T09:57:18.728 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 61/198 2024-03-27T09:57:18.825 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 62/198 2024-03-27T09:57:18.866 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 63/198 2024-03-27T09:57:18.897 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 64/198 2024-03-27T09:57:18.958 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 65/198 2024-03-27T09:57:18.996 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 66/198 2024-03-27T09:57:19.058 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 67/198 2024-03-27T09:57:19.126 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 68/198 2024-03-27T09:57:19.324 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 69/198 2024-03-27T09:57:19.378 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 70/198 2024-03-27T09:57:19.416 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 71/198 2024-03-27T09:57:19.474 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 72/198 2024-03-27T09:57:19.546 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 107/198 2024-03-27T09:57:19.597 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 108/198 2024-03-27T09:57:19.619 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 73/198 2024-03-27T09:57:19.630 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 109/198 2024-03-27T09:57:19.656 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 74/198 2024-03-27T09:57:19.686 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 110/198 2024-03-27T09:57:19.703 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 75/198 2024-03-27T09:57:19.738 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 76/198 2024-03-27T09:57:19.763 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 77/198 2024-03-27T09:57:19.797 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 111/198 2024-03-27T09:57:19.839 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 112/198 2024-03-27T09:57:19.951 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 78/198 2024-03-27T09:57:20.069 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : openblas-0.3.21-2.el9.x86_64 113/198 2024-03-27T09:57:20.103 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 114/198 2024-03-27T09:57:20.132 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 79/198 2024-03-27T09:57:20.195 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 115/198 2024-03-27T09:57:20.274 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 80/198 2024-03-27T09:57:20.323 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 81/198 2024-03-27T09:57:20.385 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-ply-3.11-14.el9.noarch 82/198 2024-03-27T09:57:20.460 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 83/198 2024-03-27T09:57:20.712 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 84/198 2024-03-27T09:57:20.760 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 85/198 2024-03-27T09:57:20.940 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/198 2024-03-27T09:57:20.988 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 87/198 2024-03-27T09:57:20.992 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 116/198 2024-03-27T09:57:21.028 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 88/198 2024-03-27T09:57:21.067 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : fuse-2.9.9-15.el9.x86_64 89/198 2024-03-27T09:57:21.094 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 90/198 2024-03-27T09:57:21.123 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 117/198 2024-03-27T09:57:21.145 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 91/198 2024-03-27T09:57:21.205 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : uuid-1.6.2-55.el9.x86_64 92/198 2024-03-27T09:57:21.272 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 93/198 2024-03-27T09:57:21.323 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 94/198 2024-03-27T09:57:21.465 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 95/198 2024-03-27T09:57:21.508 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 96/198 2024-03-27T09:57:21.543 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 97/198 2024-03-27T09:57:21.605 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 98/198 2024-03-27T09:57:21.638 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 99/198 2024-03-27T09:57:21.774 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 100/198 2024-03-27T09:57:21.891 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 101/198 2024-03-27T09:57:21.942 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 102/198 2024-03-27T09:57:21.977 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 103/198 2024-03-27T09:57:22.035 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 104/198 2024-03-27T09:57:22.176 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-packaging-20.9-5.el9.noarch 105/198 2024-03-27T09:57:22.245 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 106/198 2024-03-27T09:57:22.631 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 118/198 2024-03-27T09:57:22.734 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 119/198 2024-03-27T09:57:22.771 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 120/198 2024-03-27T09:57:22.802 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : jq-1.6-16.el9.x86_64 121/198 2024-03-27T09:57:22.842 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 122/198 2024-03-27T09:57:23.215 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 123/198 2024-03-27T09:57:23.239 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 107/198 2024-03-27T09:57:23.275 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : librbd1-2:19.0.0-2478.g155268c4.el9.x86_64 124/198 2024-03-27T09:57:23.292 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 108/198 2024-03-27T09:57:23.326 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 109/198 2024-03-27T09:57:23.382 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 110/198 2024-03-27T09:57:23.407 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: librbd1-2:19.0.0-2478.g155268c4.el9.x86_64 124/198 2024-03-27T09:57:23.440 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-rbd-2:19.0.0-2478.g155268c4.el9.x86_64 125/198 2024-03-27T09:57:23.496 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 126/198 2024-03-27T09:57:23.497 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 111/198 2024-03-27T09:57:23.543 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 112/198 2024-03-27T09:57:23.799 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : openblas-0.3.21-2.el9.x86_64 113/198 2024-03-27T09:57:23.831 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 114/198 2024-03-27T09:57:23.926 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 115/198 2024-03-27T09:57:24.049 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 127/198 2024-03-27T09:57:24.078 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : librgw2-2:19.0.0-2478.g155268c4.el9.x86_64 128/198 2024-03-27T09:57:24.170 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: librgw2-2:19.0.0-2478.g155268c4.el9.x86_64 128/198 2024-03-27T09:57:24.197 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : python3-rgw-2:19.0.0-2478.g155268c4.el9.x86_64 129/198 2024-03-27T09:57:24.769 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 116/198 2024-03-27T09:57:24.914 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 117/198 2024-03-27T09:57:26.529 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 118/198 2024-03-27T09:57:26.752 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 119/198 2024-03-27T09:57:26.791 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 120/198 2024-03-27T09:57:26.829 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : jq-1.6-16.el9.x86_64 121/198 2024-03-27T09:57:26.855 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-common-2:19.0.0-2478.g155268c4.el9.x86_64 130/198 2024-03-27T09:57:26.880 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 122/198 2024-03-27T09:57:26.911 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-common-2:19.0.0-2478.g155268c4.el9.x86_64 130/198 2024-03-27T09:57:27.291 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 123/198 2024-03-27T09:57:27.324 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : librbd1-2:19.0.0-2478.g155268c4.el9.x86_64 124/198 2024-03-27T09:57:27.454 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: librbd1-2:19.0.0-2478.g155268c4.el9.x86_64 124/198 2024-03-27T09:57:27.489 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-rbd-2:19.0.0-2478.g155268c4.el9.x86_64 125/198 2024-03-27T09:57:27.547 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 126/198 2024-03-27T09:57:27.554 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-common-2:19.0.0-2478.g155268c4.el9.x86_64 130/198 2024-03-27T09:57:27.598 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-base-2:19.0.0-2478.g155268c4.el9.x86_64 131/198 2024-03-27T09:57:27.762 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-base-2:19.0.0-2478.g155268c4.el9.x86_64 131/198 2024-03-27T09:57:27.762 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-03-27T09:57:27.762 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-03-27T09:57:27.762 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-27T09:57:27.815 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-selinux-2:19.0.0-2478.g155268c4.el9.x86_64 132/198 2024-03-27T09:57:28.095 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 127/198 2024-03-27T09:57:28.127 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : librgw2-2:19.0.0-2478.g155268c4.el9.x86_64 128/198 2024-03-27T09:57:28.227 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: librgw2-2:19.0.0-2478.g155268c4.el9.x86_64 128/198 2024-03-27T09:57:28.254 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : python3-rgw-2:19.0.0-2478.g155268c4.el9.x86_64 129/198 2024-03-27T09:57:30.911 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-common-2:19.0.0-2478.g155268c4.el9.x86_64 130/198 2024-03-27T09:57:30.952 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-common-2:19.0.0-2478.g155268c4.el9.x86_64 130/198 2024-03-27T09:57:31.609 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-common-2:19.0.0-2478.g155268c4.el9.x86_64 130/198 2024-03-27T09:57:31.664 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-base-2:19.0.0-2478.g155268c4.el9.x86_64 131/198 2024-03-27T09:57:31.842 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-base-2:19.0.0-2478.g155268c4.el9.x86_64 131/198 2024-03-27T09:57:31.843 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-03-27T09:57:31.843 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-03-27T09:57:31.843 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T09:57:31.889 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-selinux-2:19.0.0-2478.g155268c4.el9.x86_64 132/198 2024-03-27T09:57:41.840 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2478.g155268c4.el9.x86_64 132/198 2024-03-27T09:57:41.840 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /sys 2024-03-27T09:57:41.840 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /proc 2024-03-27T09:57:41.840 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /mnt 2024-03-27T09:57:41.841 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /var/tmp 2024-03-27T09:57:41.841 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /home 2024-03-27T09:57:41.841 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /root 2024-03-27T09:57:41.841 INFO:teuthology.orchestra.run.smithi118.stdout:skipping the directory /tmp 2024-03-27T09:57:41.841 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-27T09:57:42.058 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-volume-2:19.0.0-2478.g155268c4.el9.noarch 133/198 2024-03-27T09:57:42.103 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-volume-2:19.0.0-2478.g155268c4.el9.noarch 133/198 2024-03-27T09:57:42.103 INFO:teuthology.orchestra.run.smithi118.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-27T09:57:42.103 INFO:teuthology.orchestra.run.smithi118.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-03-27T09:57:42.103 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-27T09:57:43.710 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-osd-2:19.0.0-2478.g155268c4.el9.x86_64 134/198 2024-03-27T09:57:43.790 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-osd-2:19.0.0-2478.g155268c4.el9.x86_64 134/198 2024-03-27T09:57:43.790 INFO:teuthology.orchestra.run.smithi118.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-27T09:57:43.790 INFO:teuthology.orchestra.run.smithi118.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-03-27T09:57:43.791 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-27T09:57:43.791 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-27T09:57:43.791 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-27T09:57:44.061 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mds-2:19.0.0-2478.g155268c4.el9.x86_64 135/198 2024-03-27T09:57:44.129 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mds-2:19.0.0-2478.g155268c4.el9.x86_64 135/198 2024-03-27T09:57:44.129 INFO:teuthology.orchestra.run.smithi118.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-27T09:57:44.129 INFO:teuthology.orchestra.run.smithi118.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-03-27T09:57:44.129 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-27T09:57:44.129 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-27T09:57:44.130 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-27T09:57:44.611 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mon-2:19.0.0-2478.g155268c4.el9.x86_64 136/198 2024-03-27T09:57:44.680 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mon-2:19.0.0-2478.g155268c4.el9.x86_64 136/198 2024-03-27T09:57:44.680 INFO:teuthology.orchestra.run.smithi118.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-27T09:57:44.680 INFO:teuthology.orchestra.run.smithi118.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-03-27T09:57:44.680 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-27T09:57:44.680 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-27T09:57:44.680 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-27T09:57:44.797 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : automake-1.16.2-8.el9.noarch 137/198 2024-03-27T09:57:45.316 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2478.g155268c4.el9.x86_64 132/198 2024-03-27T09:57:45.316 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /sys 2024-03-27T09:57:45.316 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /proc 2024-03-27T09:57:45.316 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /mnt 2024-03-27T09:57:45.316 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /var/tmp 2024-03-27T09:57:45.316 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /home 2024-03-27T09:57:45.316 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /root 2024-03-27T09:57:45.316 INFO:teuthology.orchestra.run.smithi057.stdout:skipping the directory /tmp 2024-03-27T09:57:45.316 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T09:57:45.436 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: cephadm-2:19.0.0-2478.g155268c4.el9.noarch 138/198 2024-03-27T09:57:45.473 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : cephadm-2:19.0.0-2478.g155268c4.el9.noarch 138/198 2024-03-27T09:57:45.524 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2478.g155268c4.e 139/198 2024-03-27T09:57:45.524 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-volume-2:19.0.0-2478.g155268c4.el9.noarch 133/198 2024-03-27T09:57:45.569 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-volume-2:19.0.0-2478.g155268c4.el9.noarch 133/198 2024-03-27T09:57:45.569 INFO:teuthology.orchestra.run.smithi057.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-27T09:57:45.569 INFO:teuthology.orchestra.run.smithi057.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-03-27T09:57:45.569 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T09:57:45.625 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2478.g155268c4. 140/198 2024-03-27T09:57:45.652 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2478.g155268c4.el9.noa 141/198 2024-03-27T09:57:46.941 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2478.g155268c4.el9.noa 141/198 2024-03-27T09:57:46.988 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2478.g155268c4.el9.n 142/198 2024-03-27T09:57:47.252 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-osd-2:19.0.0-2478.g155268c4.el9.x86_64 134/198 2024-03-27T09:57:47.346 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-osd-2:19.0.0-2478.g155268c4.el9.x86_64 134/198 2024-03-27T09:57:47.346 INFO:teuthology.orchestra.run.smithi057.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-27T09:57:47.346 INFO:teuthology.orchestra.run.smithi057.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-03-27T09:57:47.346 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-27T09:57:47.346 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-27T09:57:47.346 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T09:57:47.619 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mds-2:19.0.0-2478.g155268c4.el9.x86_64 135/198 2024-03-27T09:57:47.690 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-mds-2:19.0.0-2478.g155268c4.el9.x86_64 135/198 2024-03-27T09:57:47.690 INFO:teuthology.orchestra.run.smithi057.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-27T09:57:47.690 INFO:teuthology.orchestra.run.smithi057.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-03-27T09:57:47.690 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-27T09:57:47.690 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-27T09:57:47.690 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T09:57:48.069 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2478.g155268c4.el9.n 142/198 2024-03-27T09:57:48.105 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2478.g155 143/198 2024-03-27T09:57:48.194 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mon-2:19.0.0-2478.g155268c4.el9.x86_64 136/198 2024-03-27T09:57:48.246 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2478.g155 143/198 2024-03-27T09:57:48.267 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-mon-2:19.0.0-2478.g155268c4.el9.x86_64 136/198 2024-03-27T09:57:48.267 INFO:teuthology.orchestra.run.smithi057.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-27T09:57:48.268 INFO:teuthology.orchestra.run.smithi057.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-03-27T09:57:48.268 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-27T09:57:48.268 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-27T09:57:48.268 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T09:57:48.388 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : automake-1.16.2-8.el9.noarch 137/198 2024-03-27T09:57:48.426 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2478.g155268c4.el 144/198 2024-03-27T09:57:48.467 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mgr-2:19.0.0-2478.g155268c4.el9.x86_64 145/198 2024-03-27T09:57:48.535 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2478.g155268c4.el9.x86_64 145/198 2024-03-27T09:57:48.535 INFO:teuthology.orchestra.run.smithi118.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-27T09:57:48.535 INFO:teuthology.orchestra.run.smithi118.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-03-27T09:57:48.536 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-27T09:57:48.536 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-27T09:57:48.536 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-27T09:57:48.618 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-mgr-rook-2:19.0.0-2478.g155268c4.el9.noarch 146/198 2024-03-27T09:57:48.657 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2478.g155268c4.el9.noarch 146/198 2024-03-27T09:57:48.754 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-2:19.0.0-2478.g155268c4.el9.x86_64 147/198 2024-03-27T09:57:49.014 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: cephadm-2:19.0.0-2478.g155268c4.el9.noarch 138/198 2024-03-27T09:57:49.047 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : cephadm-2:19.0.0-2478.g155268c4.el9.noarch 138/198 2024-03-27T09:57:49.122 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2478.g155268c4.e 139/198 2024-03-27T09:57:49.229 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2478.g155268c4. 140/198 2024-03-27T09:57:49.259 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2478.g155268c4.el9.noa 141/198 2024-03-27T09:57:49.728 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libtool-2.4.6-45.el9.x86_64 148/198 2024-03-27T09:57:49.795 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-radosgw-2:19.0.0-2478.g155268c4.el9.x86_64 149/198 2024-03-27T09:57:49.866 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2478.g155268c4.el9.x86_64 149/198 2024-03-27T09:57:49.866 INFO:teuthology.orchestra.run.smithi118.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-27T09:57:49.866 INFO:teuthology.orchestra.run.smithi118.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-03-27T09:57:49.867 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-27T09:57:49.867 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-27T09:57:49.867 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-27T09:57:49.929 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2478.g15526 150/198 2024-03-27T09:57:49.998 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2478.g15526 150/198 2024-03-27T09:57:49.998 INFO:teuthology.orchestra.run.smithi118.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-27T09:57:49.999 INFO:teuthology.orchestra.run.smithi118.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-03-27T09:57:49.999 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-27T09:57:50.097 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : cephfs-mirror-2:19.0.0-2478.g155268c4.el9.x86_64 151/198 2024-03-27T09:57:50.180 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2478.g155268c4.el9.x86_64 151/198 2024-03-27T09:57:50.181 INFO:teuthology.orchestra.run.smithi118.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-27T09:57:50.181 INFO:teuthology.orchestra.run.smithi118.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-03-27T09:57:50.181 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-27T09:57:50.181 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-27T09:57:50.181 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-27T09:57:50.581 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : rbd-mirror-2:19.0.0-2478.g155268c4.el9.x86_64 152/198 2024-03-27T09:57:50.605 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2478.g155268c4.el9.noa 141/198 2024-03-27T09:57:50.644 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2478.g155268c4.el9.n 142/198 2024-03-27T09:57:50.655 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2478.g155268c4.el9.x86_64 152/198 2024-03-27T09:57:50.655 INFO:teuthology.orchestra.run.smithi118.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-27T09:57:50.655 INFO:teuthology.orchestra.run.smithi118.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-03-27T09:57:50.655 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-27T09:57:50.655 INFO:teuthology.orchestra.run.smithi118.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-27T09:57:50.655 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-27T09:57:51.797 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2478.g155268c4.el9.n 142/198 2024-03-27T09:57:51.827 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2478.g155 143/198 2024-03-27T09:57:51.977 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2478.g155 143/198 2024-03-27T09:57:52.158 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2478.g155268c4.el 144/198 2024-03-27T09:57:52.188 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mgr-2:19.0.0-2478.g155268c4.el9.x86_64 145/198 2024-03-27T09:57:52.265 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2478.g155268c4.el9.x86_64 145/198 2024-03-27T09:57:52.265 INFO:teuthology.orchestra.run.smithi057.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-27T09:57:52.266 INFO:teuthology.orchestra.run.smithi057.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-03-27T09:57:52.266 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-27T09:57:52.266 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-27T09:57:52.266 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T09:57:52.330 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-mgr-rook-2:19.0.0-2478.g155268c4.el9.noarch 146/198 2024-03-27T09:57:52.370 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2478.g155268c4.el9.noarch 146/198 2024-03-27T09:57:52.439 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-2:19.0.0-2478.g155268c4.el9.x86_64 147/198 2024-03-27T09:57:53.448 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libtool-2.4.6-45.el9.x86_64 148/198 2024-03-27T09:57:53.482 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-radosgw-2:19.0.0-2478.g155268c4.el9.x86_64 149/198 2024-03-27T09:57:53.554 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2478.g155268c4.el9.x86_64 149/198 2024-03-27T09:57:53.554 INFO:teuthology.orchestra.run.smithi057.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-27T09:57:53.554 INFO:teuthology.orchestra.run.smithi057.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-03-27T09:57:53.555 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-27T09:57:53.555 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-27T09:57:53.555 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T09:57:53.599 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2478.g15526 150/198 2024-03-27T09:57:53.669 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2478.g15526 150/198 2024-03-27T09:57:53.669 INFO:teuthology.orchestra.run.smithi057.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-27T09:57:53.669 INFO:teuthology.orchestra.run.smithi057.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-03-27T09:57:53.669 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T09:57:53.741 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : cephfs-mirror-2:19.0.0-2478.g155268c4.el9.x86_64 151/198 2024-03-27T09:57:53.820 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2478.g155268c4.el9.x86_64 151/198 2024-03-27T09:57:53.821 INFO:teuthology.orchestra.run.smithi057.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-27T09:57:53.821 INFO:teuthology.orchestra.run.smithi057.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-03-27T09:57:53.821 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-27T09:57:53.821 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-27T09:57:53.821 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T09:57:54.225 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : rbd-mirror-2:19.0.0-2478.g155268c4.el9.x86_64 152/198 2024-03-27T09:57:54.297 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2478.g155268c4.el9.x86_64 152/198 2024-03-27T09:57:54.297 INFO:teuthology.orchestra.run.smithi057.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-27T09:57:54.297 INFO:teuthology.orchestra.run.smithi057.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-03-27T09:57:54.297 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-27T09:57:54.297 INFO:teuthology.orchestra.run.smithi057.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-27T09:57:54.298 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T09:57:55.453 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-test-2:19.0.0-2478.g155268c4.el9.x86_64 153/198 2024-03-27T09:57:55.498 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : rbd-fuse-2:19.0.0-2478.g155268c4.el9.x86_64 154/198 2024-03-27T09:57:55.534 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : rbd-nbd-2:19.0.0-2478.g155268c4.el9.x86_64 155/198 2024-03-27T09:57:55.573 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 156/198 2024-03-27T09:57:55.818 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : cephfs-shell-2:19.0.0-2478.g155268c4.el9.x86_64 157/198 2024-03-27T09:57:55.940 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 158/198 2024-03-27T09:57:55.996 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : ceph-fuse-2:19.0.0-2478.g155268c4.el9.x86_64 159/198 2024-03-27T09:57:56.048 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 160/198 2024-03-27T09:57:56.103 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 161/198 2024-03-27T09:57:56.148 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 162/198 2024-03-27T09:57:56.182 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libcephfs-devel-2:19.0.0-2478.g155268c4.el9.x86_ 163/198 2024-03-27T09:57:56.220 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 164/198 2024-03-27T09:57:56.304 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : NetworkManager-team-1:1.47.2-1.el9.x86_64 165/198 2024-03-27T09:57:56.397 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : NetworkManager-tui-1:1.47.2-1.el9.x86_64 166/198 2024-03-27T09:57:56.510 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 167/198 2024-03-27T09:57:56.547 INFO:teuthology.orchestra.run.smithi118.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 168/198 2024-03-27T09:57:57.403 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-03-27T09:57:57.453 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 169/198 2024-03-27T09:57:57.516 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-03-27T09:57:58.828 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : cephfs-top-2:19.0.0-2478.g155268c4.el9.noarch 170/198 2024-03-27T09:57:58.917 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 171/198 2024-03-27T09:57:58.979 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 172/198 2024-03-27T09:57:59.104 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : flex-2.6.4-9.el9.x86_64 173/198 2024-03-27T09:57:59.145 INFO:teuthology.orchestra.run.smithi118.stdout: Installing : bison-3.7.4-5.el9.x86_64 174/198 2024-03-27T09:57:59.178 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 175/198 2024-03-27T09:57:59.212 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 176/198 2024-03-27T09:57:59.254 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 177/198 2024-03-27T09:57:59.254 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-27T09:57:59.391 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-test-2:19.0.0-2478.g155268c4.el9.x86_64 153/198 2024-03-27T09:57:59.399 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-27T09:57:59.446 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : rbd-fuse-2:19.0.0-2478.g155268c4.el9.x86_64 154/198 2024-03-27T09:57:59.472 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 179/198 2024-03-27T09:57:59.472 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-27T09:57:59.480 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : rbd-nbd-2:19.0.0-2478.g155268c4.el9.x86_64 155/198 2024-03-27T09:57:59.518 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 156/198 2024-03-27T09:57:59.613 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-27T09:57:59.661 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 181/198 2024-03-27T09:57:59.712 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 182/198 2024-03-27T09:57:59.745 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 183/198 2024-03-27T09:57:59.777 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 184/198 2024-03-27T09:57:59.809 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : cephfs-shell-2:19.0.0-2478.g155268c4.el9.x86_64 157/198 2024-03-27T09:57:59.846 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 185/198 2024-03-27T09:57:59.923 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 186/198 2024-03-27T09:57:59.937 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 158/198 2024-03-27T09:57:59.974 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 187/198 2024-03-27T09:57:59.991 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : ceph-fuse-2:19.0.0-2478.g155268c4.el9.x86_64 159/198 2024-03-27T09:58:00.007 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 188/198 2024-03-27T09:58:00.041 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 189/198 2024-03-27T09:58:00.049 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 160/198 2024-03-27T09:58:00.074 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 190/198 2024-03-27T09:58:00.105 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 161/198 2024-03-27T09:58:00.125 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 191/198 2024-03-27T09:58:00.150 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 162/198 2024-03-27T09:58:00.162 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-27T09:58:00.162 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-27T09:58:00.185 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libcephfs-devel-2:19.0.0-2478.g155268c4.el9.x86_ 163/198 2024-03-27T09:58:00.230 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 164/198 2024-03-27T09:58:00.282 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : NetworkManager-team-1:1.47.2-1.el9.x86_64 165/198 2024-03-27T09:58:00.400 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : NetworkManager-tui-1:1.47.2-1.el9.x86_64 166/198 2024-03-27T09:58:00.500 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-27T09:58:00.500 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-27T09:58:00.512 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 167/198 2024-03-27T09:58:00.639 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-27T09:58:00.669 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 194/198 2024-03-27T09:58:00.725 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 195/198 2024-03-27T09:58:00.772 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 196/198 2024-03-27T09:58:00.812 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 197/198 2024-03-27T09:58:00.833 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 168/198 2024-03-27T09:58:00.930 INFO:teuthology.orchestra.run.smithi118.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-27T09:58:01.188 INFO:teuthology.orchestra.run.smithi118.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-27T09:58:01.188 INFO:teuthology.orchestra.run.smithi118.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-03-27T09:58:01.188 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-27T09:58:01.823 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-03-27T09:58:01.862 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 169/198 2024-03-27T09:58:01.917 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-03-27T09:58:03.305 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : cephfs-top-2:19.0.0-2478.g155268c4.el9.noarch 170/198 2024-03-27T09:58:03.431 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 171/198 2024-03-27T09:58:03.487 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 172/198 2024-03-27T09:58:03.610 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : flex-2.6.4-9.el9.x86_64 173/198 2024-03-27T09:58:03.644 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : bison-3.7.4-5.el9.x86_64 174/198 2024-03-27T09:58:03.677 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 175/198 2024-03-27T09:58:03.711 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 176/198 2024-03-27T09:58:03.751 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 177/198 2024-03-27T09:58:03.752 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-27T09:58:03.900 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-27T09:58:03.957 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 179/198 2024-03-27T09:58:03.957 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-27T09:58:04.094 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-27T09:58:04.140 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 181/198 2024-03-27T09:58:04.186 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 182/198 2024-03-27T09:58:04.227 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 183/198 2024-03-27T09:58:04.259 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 184/198 2024-03-27T09:58:04.327 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 185/198 2024-03-27T09:58:04.388 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 186/198 2024-03-27T09:58:04.459 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 187/198 2024-03-27T09:58:04.496 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 188/198 2024-03-27T09:58:04.530 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 189/198 2024-03-27T09:58:04.564 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 190/198 2024-03-27T09:58:04.597 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 191/198 2024-03-27T09:58:04.635 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-27T09:58:04.635 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-27T09:58:04.989 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-27T09:58:04.990 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-27T09:58:05.136 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-27T09:58:05.175 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 194/198 2024-03-27T09:58:05.227 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 195/198 2024-03-27T09:58:05.261 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 196/198 2024-03-27T09:58:05.301 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 197/198 2024-03-27T09:58:05.424 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-27T09:58:05.677 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-27T09:58:05.678 INFO:teuthology.orchestra.run.smithi057.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-03-27T09:58:05.678 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T09:58:07.479 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-2:19.0.0-2478.g155268c4.el9.x86_64 1/198 2024-03-27T09:58:07.479 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-base-2:19.0.0-2478.g155268c4.el9.x86_64 2/198 2024-03-27T09:58:07.479 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-common-2:19.0.0-2478.g155268c4.el9.x86_64 3/198 2024-03-27T09:58:07.479 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-fuse-2:19.0.0-2478.g155268c4.el9.x86_64 4/198 2024-03-27T09:58:07.479 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2478.g15526 5/198 2024-03-27T09:58:07.479 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mds-2:19.0.0-2478.g155268c4.el9.x86_64 6/198 2024-03-27T09:58:07.479 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mgr-2:19.0.0-2478.g155268c4.el9.x86_64 7/198 2024-03-27T09:58:07.480 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mon-2:19.0.0-2478.g155268c4.el9.x86_64 8/198 2024-03-27T09:58:07.480 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-osd-2:19.0.0-2478.g155268c4.el9.x86_64 9/198 2024-03-27T09:58:07.480 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-radosgw-2:19.0.0-2478.g155268c4.el9.x86_64 10/198 2024-03-27T09:58:07.480 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-selinux-2:19.0.0-2478.g155268c4.el9.x86_64 11/198 2024-03-27T09:58:07.480 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-test-2:19.0.0-2478.g155268c4.el9.x86_64 12/198 2024-03-27T09:58:07.480 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : cephfs-mirror-2:19.0.0-2478.g155268c4.el9.x86_64 13/198 2024-03-27T09:58:07.480 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : cephfs-shell-2:19.0.0-2478.g155268c4.el9.x86_64 14/198 2024-03-27T09:58:07.480 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libcephfs-devel-2:19.0.0-2478.g155268c4.el9.x86_ 15/198 2024-03-27T09:58:07.480 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libcephfs2-2:19.0.0-2478.g155268c4.el9.x86_64 16/198 2024-03-27T09:58:07.480 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libcephsqlite-2:19.0.0-2478.g155268c4.el9.x86_64 17/198 2024-03-27T09:58:07.480 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librados-devel-2:19.0.0-2478.g155268c4.el9.x86_6 18/198 2024-03-27T09:58:07.480 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libradosstriper1-2:19.0.0-2478.g155268c4.el9.x86 19/198 2024-03-27T09:58:07.480 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librgw2-2:19.0.0-2478.g155268c4.el9.x86_64 20/198 2024-03-27T09:58:07.481 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2478.g155268c4.el 21/198 2024-03-27T09:58:07.481 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-ceph-common-2:19.0.0-2478.g155268c4.el9. 22/198 2024-03-27T09:58:07.481 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-cephfs-2:19.0.0-2478.g155268c4.el9.x86_6 23/198 2024-03-27T09:58:07.481 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-rados-2:19.0.0-2478.g155268c4.el9.x86_64 24/198 2024-03-27T09:58:07.481 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-rbd-2:19.0.0-2478.g155268c4.el9.x86_64 25/198 2024-03-27T09:58:07.481 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-rgw-2:19.0.0-2478.g155268c4.el9.x86_64 26/198 2024-03-27T09:58:07.481 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : rbd-fuse-2:19.0.0-2478.g155268c4.el9.x86_64 27/198 2024-03-27T09:58:07.481 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : rbd-mirror-2:19.0.0-2478.g155268c4.el9.x86_64 28/198 2024-03-27T09:58:07.497 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : rbd-nbd-2:19.0.0-2478.g155268c4.el9.x86_64 29/198 2024-03-27T09:58:07.497 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2478.g155268c4. 30/198 2024-03-27T09:58:07.497 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2478.g155268c4.el9.noa 31/198 2024-03-27T09:58:07.497 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2478.g155268c4.el9.n 32/198 2024-03-27T09:58:07.497 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2478.g155 33/198 2024-03-27T09:58:07.497 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2478.g155268c4.el 34/198 2024-03-27T09:58:07.497 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2478.g155268c4.el9.noarch 35/198 2024-03-27T09:58:07.498 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2478.g155268c4.e 36/198 2024-03-27T09:58:07.498 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : ceph-volume-2:19.0.0-2478.g155268c4.el9.noarch 37/198 2024-03-27T09:58:07.498 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : cephadm-2:19.0.0-2478.g155268c4.el9.noarch 38/198 2024-03-27T09:58:07.498 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : cephfs-top-2:19.0.0-2478.g155268c4.el9.noarch 39/198 2024-03-27T09:58:07.498 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/198 2024-03-27T09:58:07.498 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/198 2024-03-27T09:58:07.498 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/198 2024-03-27T09:58:07.498 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/198 2024-03-27T09:58:07.498 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/198 2024-03-27T09:58:07.498 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/198 2024-03-27T09:58:07.498 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/198 2024-03-27T09:58:07.498 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 47/198 2024-03-27T09:58:07.498 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 48/198 2024-03-27T09:58:07.499 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 49/198 2024-03-27T09:58:07.499 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 50/198 2024-03-27T09:58:07.499 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 51/198 2024-03-27T09:58:07.499 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 52/198 2024-03-27T09:58:07.499 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 53/198 2024-03-27T09:58:07.499 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : lua-5.4.4-4.el9.x86_64 54/198 2024-03-27T09:58:07.499 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 55/198 2024-03-27T09:58:07.499 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 56/198 2024-03-27T09:58:07.499 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 57/198 2024-03-27T09:58:07.499 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 58/198 2024-03-27T09:58:07.499 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 59/198 2024-03-27T09:58:07.499 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 60/198 2024-03-27T09:58:07.499 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 61/198 2024-03-27T09:58:07.499 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 62/198 2024-03-27T09:58:07.500 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 63/198 2024-03-27T09:58:07.500 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 64/198 2024-03-27T09:58:07.500 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 65/198 2024-03-27T09:58:07.500 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 66/198 2024-03-27T09:58:07.500 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 67/198 2024-03-27T09:58:07.500 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 68/198 2024-03-27T09:58:07.500 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 69/198 2024-03-27T09:58:07.500 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 70/198 2024-03-27T09:58:07.500 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 71/198 2024-03-27T09:58:07.500 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 72/198 2024-03-27T09:58:07.500 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 73/198 2024-03-27T09:58:07.500 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 74/198 2024-03-27T09:58:07.501 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 75/198 2024-03-27T09:58:07.501 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 76/198 2024-03-27T09:58:07.501 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 77/198 2024-03-27T09:58:07.501 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 78/198 2024-03-27T09:58:07.501 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 79/198 2024-03-27T09:58:07.501 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 80/198 2024-03-27T09:58:07.501 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 81/198 2024-03-27T09:58:07.501 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 82/198 2024-03-27T09:58:07.501 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 83/198 2024-03-27T09:58:07.501 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 84/198 2024-03-27T09:58:07.501 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-ply-3.11-14.el9.noarch 85/198 2024-03-27T09:58:07.501 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 86/198 2024-03-27T09:58:07.501 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 87/198 2024-03-27T09:58:07.501 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : jq-1.6-16.el9.x86_64 88/198 2024-03-27T09:58:07.502 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 89/198 2024-03-27T09:58:07.502 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 90/198 2024-03-27T09:58:07.502 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 91/198 2024-03-27T09:58:07.502 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 92/198 2024-03-27T09:58:07.502 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 93/198 2024-03-27T09:58:07.502 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 94/198 2024-03-27T09:58:07.502 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : postgresql-13.14-1.el9.x86_64 95/198 2024-03-27T09:58:07.502 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 96/198 2024-03-27T09:58:07.502 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 97/198 2024-03-27T09:58:07.502 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 98/198 2024-03-27T09:58:07.502 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 99/198 2024-03-27T09:58:07.502 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 100/198 2024-03-27T09:58:07.502 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 101/198 2024-03-27T09:58:07.503 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 102/198 2024-03-27T09:58:07.503 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 103/198 2024-03-27T09:58:07.503 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 104/198 2024-03-27T09:58:07.503 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/198 2024-03-27T09:58:07.503 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/198 2024-03-27T09:58:07.503 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/198 2024-03-27T09:58:07.503 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/198 2024-03-27T09:58:07.503 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/198 2024-03-27T09:58:07.503 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/198 2024-03-27T09:58:07.503 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/198 2024-03-27T09:58:07.503 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/198 2024-03-27T09:58:07.503 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/198 2024-03-27T09:58:07.503 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/198 2024-03-27T09:58:07.503 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-03-27T09:58:07.503 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/198 2024-03-27T09:58:07.504 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/198 2024-03-27T09:58:07.504 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/198 2024-03-27T09:58:07.504 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/198 2024-03-27T09:58:07.504 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/198 2024-03-27T09:58:07.504 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/198 2024-03-27T09:58:07.504 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/198 2024-03-27T09:58:07.504 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/198 2024-03-27T09:58:07.504 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 124/198 2024-03-27T09:58:07.504 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/198 2024-03-27T09:58:07.504 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/198 2024-03-27T09:58:07.504 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/198 2024-03-27T09:58:07.504 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/198 2024-03-27T09:58:07.504 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/198 2024-03-27T09:58:07.504 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/198 2024-03-27T09:58:07.505 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/198 2024-03-27T09:58:07.505 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/198 2024-03-27T09:58:07.505 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/198 2024-03-27T09:58:07.505 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/198 2024-03-27T09:58:07.505 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/198 2024-03-27T09:58:07.505 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/198 2024-03-27T09:58:07.505 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/198 2024-03-27T09:58:07.505 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/198 2024-03-27T09:58:07.505 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/198 2024-03-27T09:58:07.505 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/198 2024-03-27T09:58:07.505 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/198 2024-03-27T09:58:07.505 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/198 2024-03-27T09:58:07.505 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/198 2024-03-27T09:58:07.505 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/198 2024-03-27T09:58:07.506 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/198 2024-03-27T09:58:07.506 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/198 2024-03-27T09:58:07.506 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/198 2024-03-27T09:58:07.506 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/198 2024-03-27T09:58:07.506 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/198 2024-03-27T09:58:07.506 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/198 2024-03-27T09:58:07.506 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librados2-2:19.0.0-2478.g155268c4.el9.x86_64 151/198 2024-03-27T09:58:07.506 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/198 2024-03-27T09:58:07.506 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librbd1-2:19.0.0-2478.g155268c4.el9.x86_64 153/198 2024-03-27T09:58:07.506 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/198 2024-03-27T09:58:07.506 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 155/198 2024-03-27T09:58:07.506 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 156/198 2024-03-27T09:58:07.506 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : NetworkManager-1:1.47.2-1.el9.x86_64 157/198 2024-03-27T09:58:07.506 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 158/198 2024-03-27T09:58:07.507 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : NetworkManager-libnm-1:1.47.2-1.el9.x86_64 159/198 2024-03-27T09:58:07.507 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 160/198 2024-03-27T09:58:07.507 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : NetworkManager-team-1:1.47.2-1.el9.x86_64 161/198 2024-03-27T09:58:07.507 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 162/198 2024-03-27T09:58:07.507 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : NetworkManager-tui-1:1.47.2-1.el9.x86_64 163/198 2024-03-27T09:58:07.507 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 164/198 2024-03-27T09:58:07.507 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : acl-2.3.1-4.el9.x86_64 165/198 2024-03-27T09:58:07.507 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : acl-2.3.1-3.el9.x86_64 166/198 2024-03-27T09:58:07.507 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 167/198 2024-03-27T09:58:07.507 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 168/198 2024-03-27T09:58:07.507 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 169/198 2024-03-27T09:58:07.507 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 170/198 2024-03-27T09:58:07.507 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 171/198 2024-03-27T09:58:07.507 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 172/198 2024-03-27T09:58:07.507 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 173/198 2024-03-27T09:58:07.508 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 174/198 2024-03-27T09:58:07.508 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 175/198 2024-03-27T09:58:07.508 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 176/198 2024-03-27T09:58:07.508 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 177/198 2024-03-27T09:58:07.508 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 178/198 2024-03-27T09:58:07.508 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 179/198 2024-03-27T09:58:07.508 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 180/198 2024-03-27T09:58:07.508 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 181/198 2024-03-27T09:58:07.508 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 182/198 2024-03-27T09:58:07.508 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 183/198 2024-03-27T09:58:07.508 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 184/198 2024-03-27T09:58:07.508 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 185/198 2024-03-27T09:58:07.508 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 186/198 2024-03-27T09:58:07.508 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 187/198 2024-03-27T09:58:07.509 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 188/198 2024-03-27T09:58:07.509 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 189/198 2024-03-27T09:58:07.509 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 190/198 2024-03-27T09:58:07.509 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 191/198 2024-03-27T09:58:07.509 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 192/198 2024-03-27T09:58:07.509 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 193/198 2024-03-27T09:58:07.509 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 194/198 2024-03-27T09:58:07.509 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 195/198 2024-03-27T09:58:07.509 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 196/198 2024-03-27T09:58:07.509 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 197/198 2024-03-27T09:58:10.174 INFO:teuthology.orchestra.run.smithi118.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 198/198 2024-03-27T09:58:10.175 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-27T09:58:10.175 INFO:teuthology.orchestra.run.smithi118.stdout:Upgraded: 2024-03-27T09:58:10.175 INFO:teuthology.orchestra.run.smithi118.stdout: NetworkManager-1:1.47.2-1.el9.x86_64 2024-03-27T09:58:10.175 INFO:teuthology.orchestra.run.smithi118.stdout: NetworkManager-libnm-1:1.47.2-1.el9.x86_64 2024-03-27T09:58:10.175 INFO:teuthology.orchestra.run.smithi118.stdout: NetworkManager-team-1:1.47.2-1.el9.x86_64 2024-03-27T09:58:10.175 INFO:teuthology.orchestra.run.smithi118.stdout: NetworkManager-tui-1:1.47.2-1.el9.x86_64 2024-03-27T09:58:10.175 INFO:teuthology.orchestra.run.smithi118.stdout: acl-2.3.1-4.el9.x86_64 2024-03-27T09:58:10.175 INFO:teuthology.orchestra.run.smithi118.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-03-27T09:58:10.175 INFO:teuthology.orchestra.run.smithi118.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-03-27T09:58:10.175 INFO:teuthology.orchestra.run.smithi118.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-03-27T09:58:10.176 INFO:teuthology.orchestra.run.smithi118.stdout: libacl-2.3.1-4.el9.x86_64 2024-03-27T09:58:10.176 INFO:teuthology.orchestra.run.smithi118.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-03-27T09:58:10.176 INFO:teuthology.orchestra.run.smithi118.stdout: libblkid-2.37.4-18.el9.x86_64 2024-03-27T09:58:10.176 INFO:teuthology.orchestra.run.smithi118.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-03-27T09:58:10.176 INFO:teuthology.orchestra.run.smithi118.stdout: libmount-2.37.4-18.el9.x86_64 2024-03-27T09:58:10.176 INFO:teuthology.orchestra.run.smithi118.stdout: librados2-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T09:58:10.176 INFO:teuthology.orchestra.run.smithi118.stdout: librbd1-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T09:58:10.176 INFO:teuthology.orchestra.run.smithi118.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-03-27T09:58:10.176 INFO:teuthology.orchestra.run.smithi118.stdout: libuuid-2.37.4-18.el9.x86_64 2024-03-27T09:58:10.176 INFO:teuthology.orchestra.run.smithi118.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-03-27T09:58:10.176 INFO:teuthology.orchestra.run.smithi118.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-03-27T09:58:10.177 INFO:teuthology.orchestra.run.smithi118.stdout: util-linux-2.37.4-18.el9.x86_64 2024-03-27T09:58:10.177 INFO:teuthology.orchestra.run.smithi118.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-03-27T09:58:10.177 INFO:teuthology.orchestra.run.smithi118.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-03-27T09:58:10.177 INFO:teuthology.orchestra.run.smithi118.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-03-27T09:58:10.177 INFO:teuthology.orchestra.run.smithi118.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-03-27T09:58:10.177 INFO:teuthology.orchestra.run.smithi118.stdout:Installed: 2024-03-27T09:58:10.177 INFO:teuthology.orchestra.run.smithi118.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-03-27T09:58:10.177 INFO:teuthology.orchestra.run.smithi118.stdout: automake-1.16.2-8.el9.noarch 2024-03-27T09:58:10.177 INFO:teuthology.orchestra.run.smithi118.stdout: bison-3.7.4-5.el9.x86_64 2024-03-27T09:58:10.177 INFO:teuthology.orchestra.run.smithi118.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-03-27T09:58:10.177 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T09:58:10.177 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-base-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T09:58:10.177 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-common-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T09:58:10.178 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-fuse-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T09:58:10.178 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-grafana-dashboards-2:19.0.0-2478.g155268c4.el9.noarch 2024-03-27T09:58:10.178 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-immutable-object-cache-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T09:58:10.178 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mds-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T09:58:10.178 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T09:58:10.178 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-cephadm-2:19.0.0-2478.g155268c4.el9.noarch 2024-03-27T09:58:10.178 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-dashboard-2:19.0.0-2478.g155268c4.el9.noarch 2024-03-27T09:58:10.178 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2478.g155268c4.el9.noarch 2024-03-27T09:58:10.178 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-modules-core-2:19.0.0-2478.g155268c4.el9.noarch 2024-03-27T09:58:10.178 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mgr-rook-2:19.0.0-2478.g155268c4.el9.noarch 2024-03-27T09:58:10.178 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-mon-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T09:58:10.178 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-osd-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T09:58:10.179 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-prometheus-alerts-2:19.0.0-2478.g155268c4.el9.noarch 2024-03-27T09:58:10.179 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-radosgw-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T09:58:10.179 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-selinux-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T09:58:10.179 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-test-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T09:58:10.179 INFO:teuthology.orchestra.run.smithi118.stdout: ceph-volume-2:19.0.0-2478.g155268c4.el9.noarch 2024-03-27T09:58:10.179 INFO:teuthology.orchestra.run.smithi118.stdout: cephadm-2:19.0.0-2478.g155268c4.el9.noarch 2024-03-27T09:58:10.179 INFO:teuthology.orchestra.run.smithi118.stdout: cephfs-mirror-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T09:58:10.179 INFO:teuthology.orchestra.run.smithi118.stdout: cephfs-shell-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T09:58:10.179 INFO:teuthology.orchestra.run.smithi118.stdout: cephfs-top-2:19.0.0-2478.g155268c4.el9.noarch 2024-03-27T09:58:10.179 INFO:teuthology.orchestra.run.smithi118.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-03-27T09:58:10.179 INFO:teuthology.orchestra.run.smithi118.stdout: flex-2.6.4-9.el9.x86_64 2024-03-27T09:58:10.179 INFO:teuthology.orchestra.run.smithi118.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-03-27T09:58:10.180 INFO:teuthology.orchestra.run.smithi118.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-03-27T09:58:10.180 INFO:teuthology.orchestra.run.smithi118.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-03-27T09:58:10.180 INFO:teuthology.orchestra.run.smithi118.stdout: fuse-2.9.9-15.el9.x86_64 2024-03-27T09:58:10.180 INFO:teuthology.orchestra.run.smithi118.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-03-27T09:58:10.180 INFO:teuthology.orchestra.run.smithi118.stdout: grpc-data-1.46.7-10.el9.noarch 2024-03-27T09:58:10.180 INFO:teuthology.orchestra.run.smithi118.stdout: jq-1.6-16.el9.x86_64 2024-03-27T09:58:10.180 INFO:teuthology.orchestra.run.smithi118.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-03-27T09:58:10.180 INFO:teuthology.orchestra.run.smithi118.stdout: libarrow-9.0.0-10.el9.x86_64 2024-03-27T09:58:10.180 INFO:teuthology.orchestra.run.smithi118.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-03-27T09:58:10.180 INFO:teuthology.orchestra.run.smithi118.stdout: libcephfs-devel-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T09:58:10.180 INFO:teuthology.orchestra.run.smithi118.stdout: libcephfs2-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T09:58:10.180 INFO:teuthology.orchestra.run.smithi118.stdout: libcephsqlite-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T09:58:10.181 INFO:teuthology.orchestra.run.smithi118.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-03-27T09:58:10.181 INFO:teuthology.orchestra.run.smithi118.stdout: liboath-2.6.7-2.el9.x86_64 2024-03-27T09:58:10.181 INFO:teuthology.orchestra.run.smithi118.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-03-27T09:58:10.181 INFO:teuthology.orchestra.run.smithi118.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-03-27T09:58:10.181 INFO:teuthology.orchestra.run.smithi118.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-03-27T09:58:10.181 INFO:teuthology.orchestra.run.smithi118.stdout: librados-devel-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T09:58:10.181 INFO:teuthology.orchestra.run.smithi118.stdout: libradosstriper1-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T09:58:10.181 INFO:teuthology.orchestra.run.smithi118.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-03-27T09:58:10.181 INFO:teuthology.orchestra.run.smithi118.stdout: librgw2-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T09:58:10.181 INFO:teuthology.orchestra.run.smithi118.stdout: libtool-2.4.6-45.el9.x86_64 2024-03-27T09:58:10.181 INFO:teuthology.orchestra.run.smithi118.stdout: libunwind-1.6.2-1.el9.x86_64 2024-03-27T09:58:10.181 INFO:teuthology.orchestra.run.smithi118.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-03-27T09:58:10.182 INFO:teuthology.orchestra.run.smithi118.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-03-27T09:58:10.182 INFO:teuthology.orchestra.run.smithi118.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-03-27T09:58:10.182 INFO:teuthology.orchestra.run.smithi118.stdout: lua-5.4.4-4.el9.x86_64 2024-03-27T09:58:10.182 INFO:teuthology.orchestra.run.smithi118.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-03-27T09:58:10.182 INFO:teuthology.orchestra.run.smithi118.stdout: luarocks-3.9.2-1.el9.noarch 2024-03-27T09:58:10.182 INFO:teuthology.orchestra.run.smithi118.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-03-27T09:58:10.182 INFO:teuthology.orchestra.run.smithi118.stdout: openblas-0.3.21-2.el9.x86_64 2024-03-27T09:58:10.182 INFO:teuthology.orchestra.run.smithi118.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-03-27T09:58:10.182 INFO:teuthology.orchestra.run.smithi118.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-03-27T09:58:10.182 INFO:teuthology.orchestra.run.smithi118.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-03-27T09:58:10.182 INFO:teuthology.orchestra.run.smithi118.stdout: postgresql-13.14-1.el9.x86_64 2024-03-27T09:58:10.183 INFO:teuthology.orchestra.run.smithi118.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-03-27T09:58:10.183 INFO:teuthology.orchestra.run.smithi118.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-03-27T09:58:10.183 INFO:teuthology.orchestra.run.smithi118.stdout: postgresql-server-13.14-1.el9.x86_64 2024-03-27T09:58:10.183 INFO:teuthology.orchestra.run.smithi118.stdout: protobuf-3.14.0-13.el9.x86_64 2024-03-27T09:58:10.183 INFO:teuthology.orchestra.run.smithi118.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-03-27T09:58:10.183 INFO:teuthology.orchestra.run.smithi118.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-03-27T09:58:10.183 INFO:teuthology.orchestra.run.smithi118.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-03-27T09:58:10.183 INFO:teuthology.orchestra.run.smithi118.stdout: python3-babel-2.9.1-2.el9.noarch 2024-03-27T09:58:10.183 INFO:teuthology.orchestra.run.smithi118.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-03-27T09:58:10.183 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-03-27T09:58:10.183 INFO:teuthology.orchestra.run.smithi118.stdout: python3-ceph-argparse-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T09:58:10.183 INFO:teuthology.orchestra.run.smithi118.stdout: python3-ceph-common-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T09:58:10.184 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cephfs-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T09:58:10.184 INFO:teuthology.orchestra.run.smithi118.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-03-27T09:58:10.184 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-03-27T09:58:10.184 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-03-27T09:58:10.184 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-03-27T09:58:10.184 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-03-27T09:58:10.184 INFO:teuthology.orchestra.run.smithi118.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-03-27T09:58:10.184 INFO:teuthology.orchestra.run.smithi118.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-03-27T09:58:10.184 INFO:teuthology.orchestra.run.smithi118.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-03-27T09:58:10.184 INFO:teuthology.orchestra.run.smithi118.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-03-27T09:58:10.184 INFO:teuthology.orchestra.run.smithi118.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-03-27T09:58:10.184 INFO:teuthology.orchestra.run.smithi118.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-03-27T09:58:10.184 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-03-27T09:58:10.185 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-03-27T09:58:10.185 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-03-27T09:58:10.185 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-03-27T09:58:10.185 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-03-27T09:58:10.185 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-03-27T09:58:10.185 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-03-27T09:58:10.185 INFO:teuthology.orchestra.run.smithi118.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-03-27T09:58:10.185 INFO:teuthology.orchestra.run.smithi118.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-03-27T09:58:10.185 INFO:teuthology.orchestra.run.smithi118.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-03-27T09:58:10.185 INFO:teuthology.orchestra.run.smithi118.stdout: python3-mako-1.1.4-6.el9.noarch 2024-03-27T09:58:10.185 INFO:teuthology.orchestra.run.smithi118.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-03-27T09:58:10.185 INFO:teuthology.orchestra.run.smithi118.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-03-27T09:58:10.186 INFO:teuthology.orchestra.run.smithi118.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-03-27T09:58:10.186 INFO:teuthology.orchestra.run.smithi118.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-03-27T09:58:10.186 INFO:teuthology.orchestra.run.smithi118.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-03-27T09:58:10.186 INFO:teuthology.orchestra.run.smithi118.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-03-27T09:58:10.186 INFO:teuthology.orchestra.run.smithi118.stdout: python3-packaging-20.9-5.el9.noarch 2024-03-27T09:58:10.186 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-03-27T09:58:10.186 INFO:teuthology.orchestra.run.smithi118.stdout: python3-ply-3.11-14.el9.noarch 2024-03-27T09:58:10.186 INFO:teuthology.orchestra.run.smithi118.stdout: python3-portend-3.1.0-2.el9.noarch 2024-03-27T09:58:10.186 INFO:teuthology.orchestra.run.smithi118.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-03-27T09:58:10.186 INFO:teuthology.orchestra.run.smithi118.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-03-27T09:58:10.187 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-03-27T09:58:10.187 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-03-27T09:58:10.187 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-03-27T09:58:10.187 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pycparser-2.20-6.el9.noarch 2024-03-27T09:58:10.187 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-03-27T09:58:10.187 INFO:teuthology.orchestra.run.smithi118.stdout: python3-pytz-2021.1-5.el9.noarch 2024-03-27T09:58:10.187 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rados-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T09:58:10.187 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rbd-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T09:58:10.187 INFO:teuthology.orchestra.run.smithi118.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-03-27T09:58:10.187 INFO:teuthology.orchestra.run.smithi118.stdout: python3-requests-2.25.1-8.el9.noarch 2024-03-27T09:58:10.187 INFO:teuthology.orchestra.run.smithi118.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-03-27T09:58:10.187 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rgw-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T09:58:10.188 INFO:teuthology.orchestra.run.smithi118.stdout: python3-routes-2.5.1-5.el9.noarch 2024-03-27T09:58:10.188 INFO:teuthology.orchestra.run.smithi118.stdout: python3-rsa-4.9-2.el9.noarch 2024-03-27T09:58:10.188 INFO:teuthology.orchestra.run.smithi118.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-03-27T09:58:10.188 INFO:teuthology.orchestra.run.smithi118.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-03-27T09:58:10.188 INFO:teuthology.orchestra.run.smithi118.stdout: python3-toml-0.10.2-6.el9.noarch 2024-03-27T09:58:10.188 INFO:teuthology.orchestra.run.smithi118.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-03-27T09:58:10.188 INFO:teuthology.orchestra.run.smithi118.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-03-27T09:58:10.188 INFO:teuthology.orchestra.run.smithi118.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-03-27T09:58:10.188 INFO:teuthology.orchestra.run.smithi118.stdout: python3-webob-1.8.7-6.el9.noarch 2024-03-27T09:58:10.188 INFO:teuthology.orchestra.run.smithi118.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-03-27T09:58:10.188 INFO:teuthology.orchestra.run.smithi118.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-03-27T09:58:10.188 INFO:teuthology.orchestra.run.smithi118.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-03-27T09:58:10.188 INFO:teuthology.orchestra.run.smithi118.stdout: qatlib-24.02.0-1.el9.x86_64 2024-03-27T09:58:10.189 INFO:teuthology.orchestra.run.smithi118.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-03-27T09:58:10.189 INFO:teuthology.orchestra.run.smithi118.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-03-27T09:58:10.189 INFO:teuthology.orchestra.run.smithi118.stdout: rbd-fuse-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T09:58:10.189 INFO:teuthology.orchestra.run.smithi118.stdout: rbd-mirror-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T09:58:10.189 INFO:teuthology.orchestra.run.smithi118.stdout: rbd-nbd-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T09:58:10.189 INFO:teuthology.orchestra.run.smithi118.stdout: re2-1:20211101-3.el9.x86_64 2024-03-27T09:58:10.189 INFO:teuthology.orchestra.run.smithi118.stdout: socat-1.7.4.1-5.el9.x86_64 2024-03-27T09:58:10.189 INFO:teuthology.orchestra.run.smithi118.stdout: thrift-0.15.0-2.el9.x86_64 2024-03-27T09:58:10.189 INFO:teuthology.orchestra.run.smithi118.stdout: uuid-1.6.2-55.el9.x86_64 2024-03-27T09:58:10.189 INFO:teuthology.orchestra.run.smithi118.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-03-27T09:58:10.189 INFO:teuthology.orchestra.run.smithi118.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-03-27T09:58:10.190 INFO:teuthology.orchestra.run.smithi118.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-03-27T09:58:10.190 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-27T09:58:10.190 INFO:teuthology.orchestra.run.smithi118.stdout:Complete! 2024-03-27T09:58:10.887 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-2:19.0.0-2478.g155268c4.el9.x86_64 1/198 2024-03-27T09:58:10.887 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-base-2:19.0.0-2478.g155268c4.el9.x86_64 2/198 2024-03-27T09:58:10.887 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-common-2:19.0.0-2478.g155268c4.el9.x86_64 3/198 2024-03-27T09:58:10.887 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-fuse-2:19.0.0-2478.g155268c4.el9.x86_64 4/198 2024-03-27T09:58:10.887 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2478.g15526 5/198 2024-03-27T09:58:10.887 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mds-2:19.0.0-2478.g155268c4.el9.x86_64 6/198 2024-03-27T09:58:10.887 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mgr-2:19.0.0-2478.g155268c4.el9.x86_64 7/198 2024-03-27T09:58:10.888 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mon-2:19.0.0-2478.g155268c4.el9.x86_64 8/198 2024-03-27T09:58:10.888 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-osd-2:19.0.0-2478.g155268c4.el9.x86_64 9/198 2024-03-27T09:58:10.888 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-radosgw-2:19.0.0-2478.g155268c4.el9.x86_64 10/198 2024-03-27T09:58:10.888 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-selinux-2:19.0.0-2478.g155268c4.el9.x86_64 11/198 2024-03-27T09:58:10.888 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-test-2:19.0.0-2478.g155268c4.el9.x86_64 12/198 2024-03-27T09:58:10.888 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : cephfs-mirror-2:19.0.0-2478.g155268c4.el9.x86_64 13/198 2024-03-27T09:58:10.888 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : cephfs-shell-2:19.0.0-2478.g155268c4.el9.x86_64 14/198 2024-03-27T09:58:10.888 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libcephfs-devel-2:19.0.0-2478.g155268c4.el9.x86_ 15/198 2024-03-27T09:58:10.888 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libcephfs2-2:19.0.0-2478.g155268c4.el9.x86_64 16/198 2024-03-27T09:58:10.888 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libcephsqlite-2:19.0.0-2478.g155268c4.el9.x86_64 17/198 2024-03-27T09:58:10.888 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librados-devel-2:19.0.0-2478.g155268c4.el9.x86_6 18/198 2024-03-27T09:58:10.888 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libradosstriper1-2:19.0.0-2478.g155268c4.el9.x86 19/198 2024-03-27T09:58:10.888 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librgw2-2:19.0.0-2478.g155268c4.el9.x86_64 20/198 2024-03-27T09:58:10.888 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2478.g155268c4.el 21/198 2024-03-27T09:58:10.889 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-ceph-common-2:19.0.0-2478.g155268c4.el9. 22/198 2024-03-27T09:58:10.889 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-cephfs-2:19.0.0-2478.g155268c4.el9.x86_6 23/198 2024-03-27T09:58:10.889 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-rados-2:19.0.0-2478.g155268c4.el9.x86_64 24/198 2024-03-27T09:58:10.889 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-rbd-2:19.0.0-2478.g155268c4.el9.x86_64 25/198 2024-03-27T09:58:10.889 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-rgw-2:19.0.0-2478.g155268c4.el9.x86_64 26/198 2024-03-27T09:58:10.889 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : rbd-fuse-2:19.0.0-2478.g155268c4.el9.x86_64 27/198 2024-03-27T09:58:10.902 DEBUG:teuthology.parallel:result is None 2024-03-27T09:58:10.909 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : rbd-mirror-2:19.0.0-2478.g155268c4.el9.x86_64 28/198 2024-03-27T09:58:10.909 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : rbd-nbd-2:19.0.0-2478.g155268c4.el9.x86_64 29/198 2024-03-27T09:58:10.909 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2478.g155268c4. 30/198 2024-03-27T09:58:10.909 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2478.g155268c4.el9.noa 31/198 2024-03-27T09:58:10.909 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2478.g155268c4.el9.n 32/198 2024-03-27T09:58:10.909 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2478.g155 33/198 2024-03-27T09:58:10.910 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2478.g155268c4.el 34/198 2024-03-27T09:58:10.910 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2478.g155268c4.el9.noarch 35/198 2024-03-27T09:58:10.910 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2478.g155268c4.e 36/198 2024-03-27T09:58:10.910 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : ceph-volume-2:19.0.0-2478.g155268c4.el9.noarch 37/198 2024-03-27T09:58:10.910 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : cephadm-2:19.0.0-2478.g155268c4.el9.noarch 38/198 2024-03-27T09:58:10.910 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : cephfs-top-2:19.0.0-2478.g155268c4.el9.noarch 39/198 2024-03-27T09:58:10.910 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/198 2024-03-27T09:58:10.910 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/198 2024-03-27T09:58:10.910 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/198 2024-03-27T09:58:10.910 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/198 2024-03-27T09:58:10.910 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/198 2024-03-27T09:58:10.910 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/198 2024-03-27T09:58:10.910 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/198 2024-03-27T09:58:10.910 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 47/198 2024-03-27T09:58:10.911 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 48/198 2024-03-27T09:58:10.911 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 49/198 2024-03-27T09:58:10.911 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 50/198 2024-03-27T09:58:10.911 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 51/198 2024-03-27T09:58:10.911 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 52/198 2024-03-27T09:58:10.911 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 53/198 2024-03-27T09:58:10.911 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : lua-5.4.4-4.el9.x86_64 54/198 2024-03-27T09:58:10.911 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 55/198 2024-03-27T09:58:10.911 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 56/198 2024-03-27T09:58:10.911 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 57/198 2024-03-27T09:58:10.911 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 58/198 2024-03-27T09:58:10.911 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 59/198 2024-03-27T09:58:10.911 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 60/198 2024-03-27T09:58:10.911 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 61/198 2024-03-27T09:58:10.912 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 62/198 2024-03-27T09:58:10.912 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 63/198 2024-03-27T09:58:10.912 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 64/198 2024-03-27T09:58:10.912 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 65/198 2024-03-27T09:58:10.912 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 66/198 2024-03-27T09:58:10.912 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 67/198 2024-03-27T09:58:10.912 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 68/198 2024-03-27T09:58:10.912 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 69/198 2024-03-27T09:58:10.912 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 70/198 2024-03-27T09:58:10.912 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 71/198 2024-03-27T09:58:10.912 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 72/198 2024-03-27T09:58:10.912 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 73/198 2024-03-27T09:58:10.912 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 74/198 2024-03-27T09:58:10.913 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 75/198 2024-03-27T09:58:10.913 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 76/198 2024-03-27T09:58:10.913 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 77/198 2024-03-27T09:58:10.913 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 78/198 2024-03-27T09:58:10.913 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 79/198 2024-03-27T09:58:10.913 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 80/198 2024-03-27T09:58:10.913 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 81/198 2024-03-27T09:58:10.913 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 82/198 2024-03-27T09:58:10.913 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 83/198 2024-03-27T09:58:10.913 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 84/198 2024-03-27T09:58:10.913 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-ply-3.11-14.el9.noarch 85/198 2024-03-27T09:58:10.913 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 86/198 2024-03-27T09:58:10.913 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 87/198 2024-03-27T09:58:10.913 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : jq-1.6-16.el9.x86_64 88/198 2024-03-27T09:58:10.914 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 89/198 2024-03-27T09:58:10.914 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 90/198 2024-03-27T09:58:10.914 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 91/198 2024-03-27T09:58:10.914 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 92/198 2024-03-27T09:58:10.914 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 93/198 2024-03-27T09:58:10.914 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 94/198 2024-03-27T09:58:10.914 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : postgresql-13.14-1.el9.x86_64 95/198 2024-03-27T09:58:10.914 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 96/198 2024-03-27T09:58:10.914 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 97/198 2024-03-27T09:58:10.914 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 98/198 2024-03-27T09:58:10.914 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 99/198 2024-03-27T09:58:10.914 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 100/198 2024-03-27T09:58:10.914 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 101/198 2024-03-27T09:58:10.914 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 102/198 2024-03-27T09:58:10.915 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 103/198 2024-03-27T09:58:10.915 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 104/198 2024-03-27T09:58:10.915 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/198 2024-03-27T09:58:10.915 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/198 2024-03-27T09:58:10.915 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/198 2024-03-27T09:58:10.915 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/198 2024-03-27T09:58:10.915 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/198 2024-03-27T09:58:10.915 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/198 2024-03-27T09:58:10.915 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/198 2024-03-27T09:58:10.915 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/198 2024-03-27T09:58:10.915 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/198 2024-03-27T09:58:10.915 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/198 2024-03-27T09:58:10.915 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-03-27T09:58:10.915 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/198 2024-03-27T09:58:10.916 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/198 2024-03-27T09:58:10.916 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/198 2024-03-27T09:58:10.916 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/198 2024-03-27T09:58:10.916 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/198 2024-03-27T09:58:10.916 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/198 2024-03-27T09:58:10.916 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/198 2024-03-27T09:58:10.916 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/198 2024-03-27T09:58:10.916 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 124/198 2024-03-27T09:58:10.916 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/198 2024-03-27T09:58:10.916 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/198 2024-03-27T09:58:10.916 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/198 2024-03-27T09:58:10.916 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/198 2024-03-27T09:58:10.916 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/198 2024-03-27T09:58:10.916 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/198 2024-03-27T09:58:10.917 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/198 2024-03-27T09:58:10.917 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/198 2024-03-27T09:58:10.917 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/198 2024-03-27T09:58:10.917 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/198 2024-03-27T09:58:10.917 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/198 2024-03-27T09:58:10.917 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/198 2024-03-27T09:58:10.917 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/198 2024-03-27T09:58:10.917 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/198 2024-03-27T09:58:10.917 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/198 2024-03-27T09:58:10.917 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/198 2024-03-27T09:58:10.917 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/198 2024-03-27T09:58:10.917 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/198 2024-03-27T09:58:10.917 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/198 2024-03-27T09:58:10.918 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/198 2024-03-27T09:58:10.918 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/198 2024-03-27T09:58:10.918 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/198 2024-03-27T09:58:10.918 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/198 2024-03-27T09:58:10.918 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/198 2024-03-27T09:58:10.918 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/198 2024-03-27T09:58:10.918 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/198 2024-03-27T09:58:10.918 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librados2-2:19.0.0-2478.g155268c4.el9.x86_64 151/198 2024-03-27T09:58:10.918 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/198 2024-03-27T09:58:10.918 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librbd1-2:19.0.0-2478.g155268c4.el9.x86_64 153/198 2024-03-27T09:58:10.918 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/198 2024-03-27T09:58:10.918 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 155/198 2024-03-27T09:58:10.918 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 156/198 2024-03-27T09:58:10.919 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : NetworkManager-1:1.47.2-1.el9.x86_64 157/198 2024-03-27T09:58:10.919 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 158/198 2024-03-27T09:58:10.919 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : NetworkManager-libnm-1:1.47.2-1.el9.x86_64 159/198 2024-03-27T09:58:10.919 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 160/198 2024-03-27T09:58:10.919 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : NetworkManager-team-1:1.47.2-1.el9.x86_64 161/198 2024-03-27T09:58:10.919 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 162/198 2024-03-27T09:58:10.919 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : NetworkManager-tui-1:1.47.2-1.el9.x86_64 163/198 2024-03-27T09:58:10.919 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 164/198 2024-03-27T09:58:10.919 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : acl-2.3.1-4.el9.x86_64 165/198 2024-03-27T09:58:10.919 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : acl-2.3.1-3.el9.x86_64 166/198 2024-03-27T09:58:10.919 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 167/198 2024-03-27T09:58:10.919 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 168/198 2024-03-27T09:58:10.919 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 169/198 2024-03-27T09:58:10.920 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 170/198 2024-03-27T09:58:10.920 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 171/198 2024-03-27T09:58:10.920 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 172/198 2024-03-27T09:58:10.920 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 173/198 2024-03-27T09:58:10.920 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 174/198 2024-03-27T09:58:10.920 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 175/198 2024-03-27T09:58:10.920 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 176/198 2024-03-27T09:58:10.920 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 177/198 2024-03-27T09:58:10.920 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 178/198 2024-03-27T09:58:10.920 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 179/198 2024-03-27T09:58:10.920 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 180/198 2024-03-27T09:58:10.920 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 181/198 2024-03-27T09:58:10.920 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 182/198 2024-03-27T09:58:10.920 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 183/198 2024-03-27T09:58:10.920 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 184/198 2024-03-27T09:58:10.921 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 185/198 2024-03-27T09:58:10.921 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 186/198 2024-03-27T09:58:10.921 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 187/198 2024-03-27T09:58:10.921 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 188/198 2024-03-27T09:58:10.921 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 189/198 2024-03-27T09:58:10.921 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 190/198 2024-03-27T09:58:10.921 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 191/198 2024-03-27T09:58:10.921 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 192/198 2024-03-27T09:58:10.921 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 193/198 2024-03-27T09:58:10.921 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 194/198 2024-03-27T09:58:10.921 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 195/198 2024-03-27T09:58:10.921 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 196/198 2024-03-27T09:58:10.921 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 197/198 2024-03-27T09:58:13.356 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 198/198 2024-03-27T09:58:13.357 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T09:58:13.357 INFO:teuthology.orchestra.run.smithi057.stdout:Upgraded: 2024-03-27T09:58:13.357 INFO:teuthology.orchestra.run.smithi057.stdout: NetworkManager-1:1.47.2-1.el9.x86_64 2024-03-27T09:58:13.357 INFO:teuthology.orchestra.run.smithi057.stdout: NetworkManager-libnm-1:1.47.2-1.el9.x86_64 2024-03-27T09:58:13.357 INFO:teuthology.orchestra.run.smithi057.stdout: NetworkManager-team-1:1.47.2-1.el9.x86_64 2024-03-27T09:58:13.357 INFO:teuthology.orchestra.run.smithi057.stdout: NetworkManager-tui-1:1.47.2-1.el9.x86_64 2024-03-27T09:58:13.357 INFO:teuthology.orchestra.run.smithi057.stdout: acl-2.3.1-4.el9.x86_64 2024-03-27T09:58:13.357 INFO:teuthology.orchestra.run.smithi057.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-03-27T09:58:13.357 INFO:teuthology.orchestra.run.smithi057.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-03-27T09:58:13.357 INFO:teuthology.orchestra.run.smithi057.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-03-27T09:58:13.358 INFO:teuthology.orchestra.run.smithi057.stdout: libacl-2.3.1-4.el9.x86_64 2024-03-27T09:58:13.358 INFO:teuthology.orchestra.run.smithi057.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-03-27T09:58:13.358 INFO:teuthology.orchestra.run.smithi057.stdout: libblkid-2.37.4-18.el9.x86_64 2024-03-27T09:58:13.358 INFO:teuthology.orchestra.run.smithi057.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-03-27T09:58:13.358 INFO:teuthology.orchestra.run.smithi057.stdout: libmount-2.37.4-18.el9.x86_64 2024-03-27T09:58:13.358 INFO:teuthology.orchestra.run.smithi057.stdout: librados2-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T09:58:13.358 INFO:teuthology.orchestra.run.smithi057.stdout: librbd1-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T09:58:13.358 INFO:teuthology.orchestra.run.smithi057.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-03-27T09:58:13.358 INFO:teuthology.orchestra.run.smithi057.stdout: libuuid-2.37.4-18.el9.x86_64 2024-03-27T09:58:13.358 INFO:teuthology.orchestra.run.smithi057.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-03-27T09:58:13.358 INFO:teuthology.orchestra.run.smithi057.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-03-27T09:58:13.358 INFO:teuthology.orchestra.run.smithi057.stdout: util-linux-2.37.4-18.el9.x86_64 2024-03-27T09:58:13.358 INFO:teuthology.orchestra.run.smithi057.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-03-27T09:58:13.359 INFO:teuthology.orchestra.run.smithi057.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-03-27T09:58:13.359 INFO:teuthology.orchestra.run.smithi057.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-03-27T09:58:13.359 INFO:teuthology.orchestra.run.smithi057.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-03-27T09:58:13.359 INFO:teuthology.orchestra.run.smithi057.stdout:Installed: 2024-03-27T09:58:13.359 INFO:teuthology.orchestra.run.smithi057.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-03-27T09:58:13.359 INFO:teuthology.orchestra.run.smithi057.stdout: automake-1.16.2-8.el9.noarch 2024-03-27T09:58:13.359 INFO:teuthology.orchestra.run.smithi057.stdout: bison-3.7.4-5.el9.x86_64 2024-03-27T09:58:13.359 INFO:teuthology.orchestra.run.smithi057.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-03-27T09:58:13.359 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T09:58:13.359 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-base-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T09:58:13.359 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-common-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T09:58:13.360 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-fuse-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T09:58:13.360 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-grafana-dashboards-2:19.0.0-2478.g155268c4.el9.noarch 2024-03-27T09:58:13.360 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-immutable-object-cache-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T09:58:13.360 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mds-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T09:58:13.360 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T09:58:13.360 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-cephadm-2:19.0.0-2478.g155268c4.el9.noarch 2024-03-27T09:58:13.360 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-dashboard-2:19.0.0-2478.g155268c4.el9.noarch 2024-03-27T09:58:13.360 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2478.g155268c4.el9.noarch 2024-03-27T09:58:13.360 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-modules-core-2:19.0.0-2478.g155268c4.el9.noarch 2024-03-27T09:58:13.360 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mgr-rook-2:19.0.0-2478.g155268c4.el9.noarch 2024-03-27T09:58:13.360 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-mon-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T09:58:13.360 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-osd-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T09:58:13.360 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-prometheus-alerts-2:19.0.0-2478.g155268c4.el9.noarch 2024-03-27T09:58:13.361 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-radosgw-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T09:58:13.361 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-selinux-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T09:58:13.361 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-test-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T09:58:13.361 INFO:teuthology.orchestra.run.smithi057.stdout: ceph-volume-2:19.0.0-2478.g155268c4.el9.noarch 2024-03-27T09:58:13.361 INFO:teuthology.orchestra.run.smithi057.stdout: cephadm-2:19.0.0-2478.g155268c4.el9.noarch 2024-03-27T09:58:13.361 INFO:teuthology.orchestra.run.smithi057.stdout: cephfs-mirror-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T09:58:13.361 INFO:teuthology.orchestra.run.smithi057.stdout: cephfs-shell-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T09:58:13.361 INFO:teuthology.orchestra.run.smithi057.stdout: cephfs-top-2:19.0.0-2478.g155268c4.el9.noarch 2024-03-27T09:58:13.361 INFO:teuthology.orchestra.run.smithi057.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-03-27T09:58:13.361 INFO:teuthology.orchestra.run.smithi057.stdout: flex-2.6.4-9.el9.x86_64 2024-03-27T09:58:13.361 INFO:teuthology.orchestra.run.smithi057.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-03-27T09:58:13.361 INFO:teuthology.orchestra.run.smithi057.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-03-27T09:58:13.361 INFO:teuthology.orchestra.run.smithi057.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-03-27T09:58:13.361 INFO:teuthology.orchestra.run.smithi057.stdout: fuse-2.9.9-15.el9.x86_64 2024-03-27T09:58:13.362 INFO:teuthology.orchestra.run.smithi057.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-03-27T09:58:13.362 INFO:teuthology.orchestra.run.smithi057.stdout: grpc-data-1.46.7-10.el9.noarch 2024-03-27T09:58:13.362 INFO:teuthology.orchestra.run.smithi057.stdout: jq-1.6-16.el9.x86_64 2024-03-27T09:58:13.362 INFO:teuthology.orchestra.run.smithi057.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-03-27T09:58:13.362 INFO:teuthology.orchestra.run.smithi057.stdout: libarrow-9.0.0-10.el9.x86_64 2024-03-27T09:58:13.362 INFO:teuthology.orchestra.run.smithi057.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-03-27T09:58:13.362 INFO:teuthology.orchestra.run.smithi057.stdout: libcephfs-devel-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T09:58:13.362 INFO:teuthology.orchestra.run.smithi057.stdout: libcephfs2-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T09:58:13.362 INFO:teuthology.orchestra.run.smithi057.stdout: libcephsqlite-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T09:58:13.362 INFO:teuthology.orchestra.run.smithi057.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-03-27T09:58:13.362 INFO:teuthology.orchestra.run.smithi057.stdout: liboath-2.6.7-2.el9.x86_64 2024-03-27T09:58:13.362 INFO:teuthology.orchestra.run.smithi057.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-03-27T09:58:13.362 INFO:teuthology.orchestra.run.smithi057.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-03-27T09:58:13.363 INFO:teuthology.orchestra.run.smithi057.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-03-27T09:58:13.363 INFO:teuthology.orchestra.run.smithi057.stdout: librados-devel-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T09:58:13.363 INFO:teuthology.orchestra.run.smithi057.stdout: libradosstriper1-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T09:58:13.363 INFO:teuthology.orchestra.run.smithi057.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-03-27T09:58:13.363 INFO:teuthology.orchestra.run.smithi057.stdout: librgw2-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T09:58:13.363 INFO:teuthology.orchestra.run.smithi057.stdout: libtool-2.4.6-45.el9.x86_64 2024-03-27T09:58:13.363 INFO:teuthology.orchestra.run.smithi057.stdout: libunwind-1.6.2-1.el9.x86_64 2024-03-27T09:58:13.363 INFO:teuthology.orchestra.run.smithi057.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-03-27T09:58:13.363 INFO:teuthology.orchestra.run.smithi057.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-03-27T09:58:13.363 INFO:teuthology.orchestra.run.smithi057.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-03-27T09:58:13.363 INFO:teuthology.orchestra.run.smithi057.stdout: lua-5.4.4-4.el9.x86_64 2024-03-27T09:58:13.363 INFO:teuthology.orchestra.run.smithi057.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-03-27T09:58:13.363 INFO:teuthology.orchestra.run.smithi057.stdout: luarocks-3.9.2-1.el9.noarch 2024-03-27T09:58:13.363 INFO:teuthology.orchestra.run.smithi057.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-03-27T09:58:13.363 INFO:teuthology.orchestra.run.smithi057.stdout: openblas-0.3.21-2.el9.x86_64 2024-03-27T09:58:13.364 INFO:teuthology.orchestra.run.smithi057.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-03-27T09:58:13.364 INFO:teuthology.orchestra.run.smithi057.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-03-27T09:58:13.364 INFO:teuthology.orchestra.run.smithi057.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-03-27T09:58:13.364 INFO:teuthology.orchestra.run.smithi057.stdout: postgresql-13.14-1.el9.x86_64 2024-03-27T09:58:13.364 INFO:teuthology.orchestra.run.smithi057.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-03-27T09:58:13.364 INFO:teuthology.orchestra.run.smithi057.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-03-27T09:58:13.364 INFO:teuthology.orchestra.run.smithi057.stdout: postgresql-server-13.14-1.el9.x86_64 2024-03-27T09:58:13.364 INFO:teuthology.orchestra.run.smithi057.stdout: protobuf-3.14.0-13.el9.x86_64 2024-03-27T09:58:13.364 INFO:teuthology.orchestra.run.smithi057.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-03-27T09:58:13.364 INFO:teuthology.orchestra.run.smithi057.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-03-27T09:58:13.364 INFO:teuthology.orchestra.run.smithi057.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-03-27T09:58:13.364 INFO:teuthology.orchestra.run.smithi057.stdout: python3-babel-2.9.1-2.el9.noarch 2024-03-27T09:58:13.364 INFO:teuthology.orchestra.run.smithi057.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-03-27T09:58:13.364 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-03-27T09:58:13.365 INFO:teuthology.orchestra.run.smithi057.stdout: python3-ceph-argparse-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T09:58:13.365 INFO:teuthology.orchestra.run.smithi057.stdout: python3-ceph-common-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T09:58:13.365 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cephfs-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T09:58:13.365 INFO:teuthology.orchestra.run.smithi057.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-03-27T09:58:13.365 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-03-27T09:58:13.365 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-03-27T09:58:13.365 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-03-27T09:58:13.366 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-03-27T09:58:13.366 INFO:teuthology.orchestra.run.smithi057.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-03-27T09:58:13.366 INFO:teuthology.orchestra.run.smithi057.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-03-27T09:58:13.366 INFO:teuthology.orchestra.run.smithi057.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-03-27T09:58:13.366 INFO:teuthology.orchestra.run.smithi057.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-03-27T09:58:13.366 INFO:teuthology.orchestra.run.smithi057.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-03-27T09:58:13.366 INFO:teuthology.orchestra.run.smithi057.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-03-27T09:58:13.366 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-03-27T09:58:13.366 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-03-27T09:58:13.366 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-03-27T09:58:13.366 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-03-27T09:58:13.366 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-03-27T09:58:13.366 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-03-27T09:58:13.366 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-03-27T09:58:13.367 INFO:teuthology.orchestra.run.smithi057.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-03-27T09:58:13.367 INFO:teuthology.orchestra.run.smithi057.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-03-27T09:58:13.367 INFO:teuthology.orchestra.run.smithi057.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-03-27T09:58:13.367 INFO:teuthology.orchestra.run.smithi057.stdout: python3-mako-1.1.4-6.el9.noarch 2024-03-27T09:58:13.367 INFO:teuthology.orchestra.run.smithi057.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-03-27T09:58:13.367 INFO:teuthology.orchestra.run.smithi057.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-03-27T09:58:13.367 INFO:teuthology.orchestra.run.smithi057.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-03-27T09:58:13.367 INFO:teuthology.orchestra.run.smithi057.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-03-27T09:58:13.367 INFO:teuthology.orchestra.run.smithi057.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-03-27T09:58:13.367 INFO:teuthology.orchestra.run.smithi057.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-03-27T09:58:13.367 INFO:teuthology.orchestra.run.smithi057.stdout: python3-packaging-20.9-5.el9.noarch 2024-03-27T09:58:13.367 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-03-27T09:58:13.367 INFO:teuthology.orchestra.run.smithi057.stdout: python3-ply-3.11-14.el9.noarch 2024-03-27T09:58:13.368 INFO:teuthology.orchestra.run.smithi057.stdout: python3-portend-3.1.0-2.el9.noarch 2024-03-27T09:58:13.368 INFO:teuthology.orchestra.run.smithi057.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-03-27T09:58:13.368 INFO:teuthology.orchestra.run.smithi057.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-03-27T09:58:13.368 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-03-27T09:58:13.368 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-03-27T09:58:13.368 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-03-27T09:58:13.368 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pycparser-2.20-6.el9.noarch 2024-03-27T09:58:13.368 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-03-27T09:58:13.368 INFO:teuthology.orchestra.run.smithi057.stdout: python3-pytz-2021.1-5.el9.noarch 2024-03-27T09:58:13.368 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rados-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T09:58:13.368 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rbd-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T09:58:13.368 INFO:teuthology.orchestra.run.smithi057.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-03-27T09:58:13.369 INFO:teuthology.orchestra.run.smithi057.stdout: python3-requests-2.25.1-8.el9.noarch 2024-03-27T09:58:13.369 INFO:teuthology.orchestra.run.smithi057.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-03-27T09:58:13.369 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rgw-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T09:58:13.369 INFO:teuthology.orchestra.run.smithi057.stdout: python3-routes-2.5.1-5.el9.noarch 2024-03-27T09:58:13.369 INFO:teuthology.orchestra.run.smithi057.stdout: python3-rsa-4.9-2.el9.noarch 2024-03-27T09:58:13.369 INFO:teuthology.orchestra.run.smithi057.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-03-27T09:58:13.369 INFO:teuthology.orchestra.run.smithi057.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-03-27T09:58:13.369 INFO:teuthology.orchestra.run.smithi057.stdout: python3-toml-0.10.2-6.el9.noarch 2024-03-27T09:58:13.369 INFO:teuthology.orchestra.run.smithi057.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-03-27T09:58:13.369 INFO:teuthology.orchestra.run.smithi057.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-03-27T09:58:13.369 INFO:teuthology.orchestra.run.smithi057.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-03-27T09:58:13.369 INFO:teuthology.orchestra.run.smithi057.stdout: python3-webob-1.8.7-6.el9.noarch 2024-03-27T09:58:13.369 INFO:teuthology.orchestra.run.smithi057.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-03-27T09:58:13.370 INFO:teuthology.orchestra.run.smithi057.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-03-27T09:58:13.370 INFO:teuthology.orchestra.run.smithi057.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-03-27T09:58:13.370 INFO:teuthology.orchestra.run.smithi057.stdout: qatlib-24.02.0-1.el9.x86_64 2024-03-27T09:58:13.370 INFO:teuthology.orchestra.run.smithi057.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-03-27T09:58:13.370 INFO:teuthology.orchestra.run.smithi057.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-03-27T09:58:13.370 INFO:teuthology.orchestra.run.smithi057.stdout: rbd-fuse-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T09:58:13.370 INFO:teuthology.orchestra.run.smithi057.stdout: rbd-mirror-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T09:58:13.370 INFO:teuthology.orchestra.run.smithi057.stdout: rbd-nbd-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T09:58:13.370 INFO:teuthology.orchestra.run.smithi057.stdout: re2-1:20211101-3.el9.x86_64 2024-03-27T09:58:13.370 INFO:teuthology.orchestra.run.smithi057.stdout: socat-1.7.4.1-5.el9.x86_64 2024-03-27T09:58:13.370 INFO:teuthology.orchestra.run.smithi057.stdout: thrift-0.15.0-2.el9.x86_64 2024-03-27T09:58:13.370 INFO:teuthology.orchestra.run.smithi057.stdout: uuid-1.6.2-55.el9.x86_64 2024-03-27T09:58:13.370 INFO:teuthology.orchestra.run.smithi057.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-03-27T09:58:13.370 INFO:teuthology.orchestra.run.smithi057.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-03-27T09:58:13.371 INFO:teuthology.orchestra.run.smithi057.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-03-27T09:58:13.371 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T09:58:13.371 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2024-03-27T09:58:14.066 DEBUG:teuthology.parallel:result is None 2024-03-27T09:58:14.067 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=155268c4e432a12433aa833f174f9fe3b1016ae0 2024-03-27T09:58:14.211 DEBUG:teuthology.orchestra.run.smithi057:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-27T09:58:14.269 INFO:teuthology.orchestra.run.smithi057.stdout:19.0.0-2478.g155268c4.el9 2024-03-27T09:58:14.269 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2478.g155268c4.el9 2024-03-27T09:58:14.269 INFO:teuthology.task.install:The correct ceph version 19.0.0-2478.g155268c4 is installed. 2024-03-27T09:58:14.271 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=155268c4e432a12433aa833f174f9fe3b1016ae0 2024-03-27T09:58:14.486 DEBUG:teuthology.orchestra.run.smithi118:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-27T09:58:14.545 INFO:teuthology.orchestra.run.smithi118.stdout:19.0.0-2478.g155268c4.el9 2024-03-27T09:58:14.545 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2478.g155268c4.el9 2024-03-27T09:58:14.545 INFO:teuthology.task.install:The correct ceph version 19.0.0-2478.g155268c4 is installed. 2024-03-27T09:58:14.547 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-03-27T09:58:14.548 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-03-27T09:58:14.548 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-27T09:58:14.628 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-03-27T09:58:14.628 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-27T09:58:14.705 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-03-27T09:58:14.705 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-03-27T09:58:14.705 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/usr/bin/daemon-helper 2024-03-27T09:58:14.783 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-27T09:58:14.902 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-03-27T09:58:14.902 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/usr/bin/daemon-helper 2024-03-27T09:58:14.996 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-27T09:58:15.135 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-03-27T09:58:15.135 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-03-27T09:58:15.135 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-27T09:58:15.213 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-27T09:58:15.337 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-03-27T09:58:15.337 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-27T09:58:15.435 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-27T09:58:15.562 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-03-27T09:58:15.563 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-03-27T09:58:15.563 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/usr/bin/stdin-killer 2024-03-27T09:58:15.639 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-27T09:58:15.753 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-03-27T09:58:15.753 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/usr/bin/stdin-killer 2024-03-27T09:58:15.847 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-27T09:58:15.941 INFO:teuthology.run_tasks:Running task ceph... 2024-03-27T09:58:16.027 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-03-27T09:58:16.027 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 777 /var/log/ceph 2024-03-27T09:58:16.032 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 777 /var/log/ceph 2024-03-27T09:58:16.124 INFO:tasks.ceph:Disabling ceph logrotate... 2024-03-27T09:58:16.124 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm -f -- /etc/logrotate.d/ceph 2024-03-27T09:58:16.128 DEBUG:teuthology.orchestra.run.smithi118:> sudo rm -f -- /etc/logrotate.d/ceph 2024-03-27T09:58:16.220 INFO:tasks.ceph:Creating extra log directories... 2024-03-27T09:58:16.221 DEBUG:teuthology.orchestra.run.smithi057:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-03-27T09:58:16.225 DEBUG:teuthology.orchestra.run.smithi118:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-03-27T09:58:16.328 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-03-27T09:58:16.328 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-03-27T09:58:16.328 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-03-27T09:58:16.328 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-03-27T09:58:16.328 DEBUG:teuthology.orchestra.run.smithi057:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-03-27T09:58:16.371 DEBUG:teuthology.orchestra.run.smithi057:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-03-27T09:58:16.591 DEBUG:teuthology.orchestra.run.smithi057:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-03-27T09:58:16.667 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-03-27T09:58:16.667 DEBUG:teuthology.orchestra.run.smithi118:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-03-27T09:58:16.722 DEBUG:teuthology.orchestra.run.smithi118:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-03-27T09:58:16.984 DEBUG:teuthology.orchestra.run.smithi118:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-03-27T09:58:17.086 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-03-27T09:58:17.086 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-03-27T09:58:17.086 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2024-03-27_05:27:11-fs-wip-rishabh-testing-20240326.131558-testing-default-smithi/7625753', 'branch': 'wip-rishabh-testing-20240326.131558', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/xfstests-dev}', 'email': None, 'first_in_suite': False, 'job_id': '7625753', 'kernel': {'flavor': 'default', 'kdb': True, 'sha1': '1df0c7e8a2354c42d738e5454ba83ea7332deac2'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'rishabh-2024-03-27_05:27:11-fs-wip-rishabh-testing-20240326.131558-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-rishabh-testing-20240326.131558'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'sha1': '155268c4e432a12433aa833f174f9fe3b1016ae0'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '155268c4e432a12433aa833f174f9fe3b1016ae0'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'subvolume_version': 2, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rishabh-testing-20240326.131558', 'sha1': '155268c4e432a12433aa833f174f9fe3b1016ae0'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 75, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 6931, 'sha1': '155268c4e432a12433aa833f174f9fe3b1016ae0', 'sleep_before_teardown': 0, 'subset': '80/512', 'suite': 'fs', 'suite_branch': 'wip-rishabh-testing-20240326.131558', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_155268c4e432a12433aa833f174f9fe3b1016ae0/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '155268c4e432a12433aa833f174f9fe3b1016ae0', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi057.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBG7KokvzCOi8Nbw+dh7uIJ1WZcMHNo/9cXZPtyo2o9dDBCShEhbm+6ZdkUig8qMpvw6Svrvbd75nS+iy0GC7eH4=', 'smithi118.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNOxjBCdu8PZlUX2LDU4u3fdfWSbzvPjKPxXqdqEbcD9bnoPnMpSQKxUqM71fYf+lxpDh+hlkdejOhO2VG7zE2U='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'flavor': 'default', 'kdb': True, 'sha1': '1df0c7e8a2354c42d738e5454ba83ea7332deac2'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '155268c4e432a12433aa833f174f9fe3b1016ae0'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'sha1': '155268c4e432a12433aa833f174f9fe3b1016ae0', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'ceph-fuse': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.tests_from_xfstests_dev']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': 'e691533f9cbb33d85b2187bba20d7102f098636d', 'timestamp': '2024-03-27_05:27:11', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-03-27T09:58:17.087 DEBUG:teuthology.orchestra.run.smithi057:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-03-27T09:58:17.093 DEBUG:teuthology.orchestra.run.smithi118:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-03-27T09:58:17.143 DEBUG:teuthology.orchestra.run.smithi057:> sudo install -d -m0777 -- /var/run/ceph 2024-03-27T09:58:17.178 DEBUG:teuthology.orchestra.run.smithi118:> sudo install -d -m0777 -- /var/run/ceph 2024-03-27T09:58:17.274 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-03-27T09:58:17.275 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/scratch_devs of=/dev/stdout 2024-03-27T09:58:17.315 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-27T09:58:17.315 DEBUG:teuthology.orchestra.run.smithi057:> stat /dev/vg_nvme/lv_1 2024-03-27T09:58:17.395 INFO:teuthology.orchestra.run.smithi057.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-27T09:58:17.395 INFO:teuthology.orchestra.run.smithi057.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-27T09:58:17.395 INFO:teuthology.orchestra.run.smithi057.stdout:Device: 5h/5d Inode: 631 Links: 1 2024-03-27T09:58:17.395 INFO:teuthology.orchestra.run.smithi057.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-27T09:58:17.395 INFO:teuthology.orchestra.run.smithi057.stdout:Context: system_u:object_r:device_t:s0 2024-03-27T09:58:17.395 INFO:teuthology.orchestra.run.smithi057.stdout:Access: 2024-03-27 09:58:06.149722444 +0000 2024-03-27T09:58:17.395 INFO:teuthology.orchestra.run.smithi057.stdout:Modify: 2024-03-27 09:55:05.011348921 +0000 2024-03-27T09:58:17.395 INFO:teuthology.orchestra.run.smithi057.stdout:Change: 2024-03-27 09:55:05.011348921 +0000 2024-03-27T09:58:17.395 INFO:teuthology.orchestra.run.smithi057.stdout: Birth: 2024-03-27 09:55:05.011348921 +0000 2024-03-27T09:58:17.396 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-27T09:58:17.508 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records in 2024-03-27T09:58:17.508 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records out 2024-03-27T09:58:17.508 INFO:teuthology.orchestra.run.smithi057.stderr:512 bytes copied, 0.000437191 s, 1.2 MB/s 2024-03-27T09:58:17.511 DEBUG:teuthology.orchestra.run.smithi057:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-27T09:58:17.550 DEBUG:teuthology.orchestra.run.smithi057:> stat /dev/vg_nvme/lv_2 2024-03-27T09:58:17.648 INFO:teuthology.orchestra.run.smithi057.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-27T09:58:17.648 INFO:teuthology.orchestra.run.smithi057.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-27T09:58:17.648 INFO:teuthology.orchestra.run.smithi057.stdout:Device: 5h/5d Inode: 652 Links: 1 2024-03-27T09:58:17.648 INFO:teuthology.orchestra.run.smithi057.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-27T09:58:17.648 INFO:teuthology.orchestra.run.smithi057.stdout:Context: system_u:object_r:device_t:s0 2024-03-27T09:58:17.648 INFO:teuthology.orchestra.run.smithi057.stdout:Access: 2024-03-27 09:58:06.149722444 +0000 2024-03-27T09:58:17.648 INFO:teuthology.orchestra.run.smithi057.stdout:Modify: 2024-03-27 09:55:05.596339895 +0000 2024-03-27T09:58:17.648 INFO:teuthology.orchestra.run.smithi057.stdout:Change: 2024-03-27 09:55:05.596339895 +0000 2024-03-27T09:58:17.648 INFO:teuthology.orchestra.run.smithi057.stdout: Birth: 2024-03-27 09:55:05.596339895 +0000 2024-03-27T09:58:17.649 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-27T09:58:17.718 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records in 2024-03-27T09:58:17.718 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records out 2024-03-27T09:58:17.718 INFO:teuthology.orchestra.run.smithi057.stderr:512 bytes copied, 0.000306105 s, 1.7 MB/s 2024-03-27T09:58:17.721 DEBUG:teuthology.orchestra.run.smithi057:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-27T09:58:17.764 DEBUG:teuthology.orchestra.run.smithi057:> stat /dev/vg_nvme/lv_3 2024-03-27T09:58:17.846 INFO:teuthology.orchestra.run.smithi057.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-27T09:58:17.846 INFO:teuthology.orchestra.run.smithi057.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-27T09:58:17.846 INFO:teuthology.orchestra.run.smithi057.stdout:Device: 5h/5d Inode: 670 Links: 1 2024-03-27T09:58:17.846 INFO:teuthology.orchestra.run.smithi057.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-27T09:58:17.846 INFO:teuthology.orchestra.run.smithi057.stdout:Context: system_u:object_r:device_t:s0 2024-03-27T09:58:17.846 INFO:teuthology.orchestra.run.smithi057.stdout:Access: 2024-03-27 09:58:06.150722429 +0000 2024-03-27T09:58:17.846 INFO:teuthology.orchestra.run.smithi057.stdout:Modify: 2024-03-27 09:55:06.174330976 +0000 2024-03-27T09:58:17.846 INFO:teuthology.orchestra.run.smithi057.stdout:Change: 2024-03-27 09:55:06.174330976 +0000 2024-03-27T09:58:17.846 INFO:teuthology.orchestra.run.smithi057.stdout: Birth: 2024-03-27 09:55:06.174330976 +0000 2024-03-27T09:58:17.847 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-27T09:58:17.954 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records in 2024-03-27T09:58:17.954 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records out 2024-03-27T09:58:17.954 INFO:teuthology.orchestra.run.smithi057.stderr:512 bytes copied, 0.000334398 s, 1.5 MB/s 2024-03-27T09:58:17.957 DEBUG:teuthology.orchestra.run.smithi057:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-27T09:58:18.000 DEBUG:teuthology.orchestra.run.smithi057:> stat /dev/vg_nvme/lv_4 2024-03-27T09:58:18.082 INFO:teuthology.orchestra.run.smithi057.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-27T09:58:18.082 INFO:teuthology.orchestra.run.smithi057.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-27T09:58:18.082 INFO:teuthology.orchestra.run.smithi057.stdout:Device: 5h/5d Inode: 690 Links: 1 2024-03-27T09:58:18.082 INFO:teuthology.orchestra.run.smithi057.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-27T09:58:18.082 INFO:teuthology.orchestra.run.smithi057.stdout:Context: system_u:object_r:device_t:s0 2024-03-27T09:58:18.082 INFO:teuthology.orchestra.run.smithi057.stdout:Access: 2024-03-27 09:58:06.151722413 +0000 2024-03-27T09:58:18.082 INFO:teuthology.orchestra.run.smithi057.stdout:Modify: 2024-03-27 09:55:06.737322288 +0000 2024-03-27T09:58:18.082 INFO:teuthology.orchestra.run.smithi057.stdout:Change: 2024-03-27 09:55:06.737322288 +0000 2024-03-27T09:58:18.082 INFO:teuthology.orchestra.run.smithi057.stdout: Birth: 2024-03-27 09:55:06.737322288 +0000 2024-03-27T09:58:18.083 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-27T09:58:18.195 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records in 2024-03-27T09:58:18.195 INFO:teuthology.orchestra.run.smithi057.stderr:1+0 records out 2024-03-27T09:58:18.195 INFO:teuthology.orchestra.run.smithi057.stderr:512 bytes copied, 0.000312156 s, 1.6 MB/s 2024-03-27T09:58:18.198 DEBUG:teuthology.orchestra.run.smithi057:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-27T09:58:18.241 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-27T09:58:18.241 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-03-27T09:58:18.241 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/scratch_devs of=/dev/stdout 2024-03-27T09:58:18.298 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-27T09:58:18.298 DEBUG:teuthology.orchestra.run.smithi118:> stat /dev/vg_nvme/lv_1 2024-03-27T09:58:18.351 INFO:teuthology.orchestra.run.smithi118.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-27T09:58:18.351 INFO:teuthology.orchestra.run.smithi118.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-27T09:58:18.351 INFO:teuthology.orchestra.run.smithi118.stdout:Device: 5h/5d Inode: 633 Links: 1 2024-03-27T09:58:18.351 INFO:teuthology.orchestra.run.smithi118.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-27T09:58:18.351 INFO:teuthology.orchestra.run.smithi118.stdout:Context: system_u:object_r:device_t:s0 2024-03-27T09:58:18.352 INFO:teuthology.orchestra.run.smithi118.stdout:Access: 2024-03-27 09:58:01.682639362 +0000 2024-03-27T09:58:18.352 INFO:teuthology.orchestra.run.smithi118.stdout:Modify: 2024-03-27 09:55:04.970573813 +0000 2024-03-27T09:58:18.352 INFO:teuthology.orchestra.run.smithi118.stdout:Change: 2024-03-27 09:55:04.970573813 +0000 2024-03-27T09:58:18.352 INFO:teuthology.orchestra.run.smithi118.stdout: Birth: 2024-03-27 09:55:04.970573813 +0000 2024-03-27T09:58:18.352 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-27T09:58:18.436 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records in 2024-03-27T09:58:18.436 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records out 2024-03-27T09:58:18.436 INFO:teuthology.orchestra.run.smithi118.stderr:512 bytes copied, 0.00022297 s, 2.3 MB/s 2024-03-27T09:58:18.439 DEBUG:teuthology.orchestra.run.smithi118:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-27T09:58:18.492 DEBUG:teuthology.orchestra.run.smithi118:> stat /dev/vg_nvme/lv_2 2024-03-27T09:58:18.544 INFO:teuthology.orchestra.run.smithi118.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-27T09:58:18.544 INFO:teuthology.orchestra.run.smithi118.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-27T09:58:18.544 INFO:teuthology.orchestra.run.smithi118.stdout:Device: 5h/5d Inode: 653 Links: 1 2024-03-27T09:58:18.544 INFO:teuthology.orchestra.run.smithi118.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-27T09:58:18.544 INFO:teuthology.orchestra.run.smithi118.stdout:Context: system_u:object_r:device_t:s0 2024-03-27T09:58:18.544 INFO:teuthology.orchestra.run.smithi118.stdout:Access: 2024-03-27 09:58:01.682639362 +0000 2024-03-27T09:58:18.544 INFO:teuthology.orchestra.run.smithi118.stdout:Modify: 2024-03-27 09:55:05.593560306 +0000 2024-03-27T09:58:18.545 INFO:teuthology.orchestra.run.smithi118.stdout:Change: 2024-03-27 09:55:05.593560306 +0000 2024-03-27T09:58:18.545 INFO:teuthology.orchestra.run.smithi118.stdout: Birth: 2024-03-27 09:55:05.593560306 +0000 2024-03-27T09:58:18.545 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-27T09:58:18.628 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records in 2024-03-27T09:58:18.628 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records out 2024-03-27T09:58:18.628 INFO:teuthology.orchestra.run.smithi118.stderr:512 bytes copied, 0.000205297 s, 2.5 MB/s 2024-03-27T09:58:18.632 DEBUG:teuthology.orchestra.run.smithi118:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-27T09:58:18.688 DEBUG:teuthology.orchestra.run.smithi118:> stat /dev/vg_nvme/lv_3 2024-03-27T09:58:18.738 INFO:teuthology.orchestra.run.smithi118.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-27T09:58:18.739 INFO:teuthology.orchestra.run.smithi118.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-27T09:58:18.739 INFO:teuthology.orchestra.run.smithi118.stdout:Device: 5h/5d Inode: 670 Links: 1 2024-03-27T09:58:18.739 INFO:teuthology.orchestra.run.smithi118.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-27T09:58:18.739 INFO:teuthology.orchestra.run.smithi118.stdout:Context: system_u:object_r:device_t:s0 2024-03-27T09:58:18.739 INFO:teuthology.orchestra.run.smithi118.stdout:Access: 2024-03-27 09:58:01.683639340 +0000 2024-03-27T09:58:18.739 INFO:teuthology.orchestra.run.smithi118.stdout:Modify: 2024-03-27 09:55:06.136548533 +0000 2024-03-27T09:58:18.739 INFO:teuthology.orchestra.run.smithi118.stdout:Change: 2024-03-27 09:55:06.136548533 +0000 2024-03-27T09:58:18.739 INFO:teuthology.orchestra.run.smithi118.stdout: Birth: 2024-03-27 09:55:06.136548533 +0000 2024-03-27T09:58:18.739 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-27T09:58:18.827 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records in 2024-03-27T09:58:18.827 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records out 2024-03-27T09:58:18.827 INFO:teuthology.orchestra.run.smithi118.stderr:512 bytes copied, 0.000238108 s, 2.2 MB/s 2024-03-27T09:58:18.832 DEBUG:teuthology.orchestra.run.smithi118:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-27T09:58:18.889 DEBUG:teuthology.orchestra.run.smithi118:> stat /dev/vg_nvme/lv_4 2024-03-27T09:58:18.935 INFO:teuthology.orchestra.run.smithi118.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-27T09:58:18.935 INFO:teuthology.orchestra.run.smithi118.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-27T09:58:18.935 INFO:teuthology.orchestra.run.smithi118.stdout:Device: 5h/5d Inode: 690 Links: 1 2024-03-27T09:58:18.935 INFO:teuthology.orchestra.run.smithi118.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-27T09:58:18.935 INFO:teuthology.orchestra.run.smithi118.stdout:Context: system_u:object_r:device_t:s0 2024-03-27T09:58:18.935 INFO:teuthology.orchestra.run.smithi118.stdout:Access: 2024-03-27 09:58:01.684639319 +0000 2024-03-27T09:58:18.935 INFO:teuthology.orchestra.run.smithi118.stdout:Modify: 2024-03-27 09:55:06.732535611 +0000 2024-03-27T09:58:18.936 INFO:teuthology.orchestra.run.smithi118.stdout:Change: 2024-03-27 09:55:06.732535611 +0000 2024-03-27T09:58:18.936 INFO:teuthology.orchestra.run.smithi118.stdout: Birth: 2024-03-27 09:55:06.732535611 +0000 2024-03-27T09:58:18.936 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-27T09:58:19.065 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records in 2024-03-27T09:58:19.065 INFO:teuthology.orchestra.run.smithi118.stderr:1+0 records out 2024-03-27T09:58:19.066 INFO:teuthology.orchestra.run.smithi118.stderr:512 bytes copied, 0.000241949 s, 2.1 MB/s 2024-03-27T09:58:19.069 DEBUG:teuthology.orchestra.run.smithi118:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-27T09:58:19.130 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-27T09:58:19.130 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi057.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi118.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-03-27T09:58:19.130 INFO:tasks.ceph:Generating config... 2024-03-27T09:58:19.131 INFO:tasks.ceph:[client] client mount timeout = 600 2024-03-27T09:58:19.131 INFO:tasks.ceph:[client] debug client = 20 2024-03-27T09:58:19.131 INFO:tasks.ceph:[client] debug ms = 1 2024-03-27T09:58:19.131 INFO:tasks.ceph:[client] pid file = 2024-03-27T09:58:19.131 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-03-27T09:58:19.131 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-03-27T09:58:19.132 INFO:tasks.ceph:[mds] debug mds = 20 2024-03-27T09:58:19.132 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-03-27T09:58:19.132 INFO:tasks.ceph:[mds] debug ms = 1 2024-03-27T09:58:19.132 INFO:tasks.ceph:[mds] mds debug frag = True 2024-03-27T09:58:19.132 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-03-27T09:58:19.132 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-03-27T09:58:19.132 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-03-27T09:58:19.132 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-03-27T09:58:19.132 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-03-27T09:58:19.132 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-03-27T09:58:19.132 INFO:tasks.ceph:[mgr] debug client = 20 2024-03-27T09:58:19.132 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-03-27T09:58:19.132 INFO:tasks.ceph:[mgr] debug ms = 1 2024-03-27T09:58:19.132 INFO:tasks.ceph:[mon] debug mon = 20 2024-03-27T09:58:19.132 INFO:tasks.ceph:[mon] debug ms = 1 2024-03-27T09:58:19.132 INFO:tasks.ceph:[mon] debug paxos = 20 2024-03-27T09:58:19.133 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-03-27T09:58:19.133 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-03-27T09:58:19.133 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-03-27T09:58:19.133 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-03-27T09:58:19.133 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-03-27T09:58:19.133 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-03-27T09:58:19.133 INFO:tasks.ceph:[osd] debug ms = 1 2024-03-27T09:58:19.133 INFO:tasks.ceph:[osd] debug osd = 20 2024-03-27T09:58:19.133 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-03-27T09:58:19.133 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-03-27T09:58:19.133 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-03-27T09:58:19.133 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-03-27T09:58:19.133 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-03-27T09:58:19.133 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-03-27T09:58:19.133 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-03-27T09:58:19.134 INFO:tasks.ceph:Setting up mon.a... 2024-03-27T09:58:19.134 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-03-27T09:58:19.287 INFO:teuthology.orchestra.run.smithi057.stdout:creating /etc/ceph/ceph.keyring 2024-03-27T09:58:19.296 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-03-27T09:58:19.450 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-27T09:58:19.538 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.57'), ('mon.b', '172.21.15.118'), ('mon.c', '[v2:172.21.15.118:3301,v1:172.21.15.118:6790]')] 2024-03-27T09:58:19.542 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.57,172.21.15.118,[v2:172.21.15.118:3301,v1:172.21.15.118:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-03-27T09:58:19.543 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-03-27T09:58:19.543 DEBUG:teuthology.orchestra.run.smithi057:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-03-27T09:58:19.594 DEBUG:teuthology.orchestra.run.smithi057:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.57 --add b 172.21.15.118 --addv c '[v2:172.21.15.118:3301,v1:172.21.15.118:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-03-27T09:58:19.749 INFO:teuthology.orchestra.run.smithi057.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-03-27T09:58:19.749 INFO:teuthology.orchestra.run.smithi057.stdout:monmaptool: generated fsid 7ac43f86-2c16-4a97-98fb-715d3cebc75c 2024-03-27T09:58:19.749 INFO:teuthology.orchestra.run.smithi057.stdout:setting min_mon_release = quincy 2024-03-27T09:58:19.749 INFO:teuthology.orchestra.run.smithi057.stdout:epoch 0 2024-03-27T09:58:19.749 INFO:teuthology.orchestra.run.smithi057.stdout:fsid 7ac43f86-2c16-4a97-98fb-715d3cebc75c 2024-03-27T09:58:19.749 INFO:teuthology.orchestra.run.smithi057.stdout:last_changed 2024-03-27T09:58:19.759263+0000 2024-03-27T09:58:19.749 INFO:teuthology.orchestra.run.smithi057.stdout:created 2024-03-27T09:58:19.759263+0000 2024-03-27T09:58:19.749 INFO:teuthology.orchestra.run.smithi057.stdout:min_mon_release 17 (quincy) 2024-03-27T09:58:19.749 INFO:teuthology.orchestra.run.smithi057.stdout:election_strategy: 1 2024-03-27T09:58:19.749 INFO:teuthology.orchestra.run.smithi057.stdout:0: [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] mon.a 2024-03-27T09:58:19.750 INFO:teuthology.orchestra.run.smithi057.stdout:1: [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] mon.b 2024-03-27T09:58:19.750 INFO:teuthology.orchestra.run.smithi057.stdout:2: [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] mon.c 2024-03-27T09:58:19.750 INFO:teuthology.orchestra.run.smithi057.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-03-27T09:58:19.752 DEBUG:teuthology.orchestra.run.smithi057:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-03-27T09:58:19.804 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 7ac43f86-2c16-4a97-98fb-715d3cebc75c... 2024-03-27T09:58:19.805 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-03-27T09:58:19.810 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-03-27T09:58:19.984 INFO:teuthology.orchestra.run.smithi118.stdout:[global] 2024-03-27T09:58:19.984 INFO:teuthology.orchestra.run.smithi118.stdout: chdir = "" 2024-03-27T09:58:19.984 INFO:teuthology.orchestra.run.smithi118.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-03-27T09:58:19.984 INFO:teuthology.orchestra.run.smithi118.stdout: auth supported = cephx 2024-03-27T09:58:19.984 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-27T09:58:19.984 INFO:teuthology.orchestra.run.smithi118.stdout: filestore xattr use omap = true 2024-03-27T09:58:19.984 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-27T09:58:19.984 INFO:teuthology.orchestra.run.smithi118.stdout: mon clock drift allowed = 1.000 2024-03-27T09:58:19.984 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-27T09:58:19.985 INFO:teuthology.orchestra.run.smithi118.stdout: osd crush chooseleaf type = 0 2024-03-27T09:58:19.985 INFO:teuthology.orchestra.run.smithi118.stdout: auth debug = true 2024-03-27T09:58:19.985 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-27T09:58:19.985 INFO:teuthology.orchestra.run.smithi118.stdout: ms die on old message = true 2024-03-27T09:58:19.985 INFO:teuthology.orchestra.run.smithi118.stdout: ms die on bug = true 2024-03-27T09:58:19.985 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-27T09:58:19.985 INFO:teuthology.orchestra.run.smithi118.stdout: mon max pg per osd = 10000 # >= luminous 2024-03-27T09:58:19.985 INFO:teuthology.orchestra.run.smithi118.stdout: mon pg warn max object skew = 0 2024-03-27T09:58:19.985 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-27T09:58:19.985 INFO:teuthology.orchestra.run.smithi118.stdout: # disable pg_autoscaler by default for new pools 2024-03-27T09:58:19.985 INFO:teuthology.orchestra.run.smithi118.stdout: osd_pool_default_pg_autoscale_mode = off 2024-03-27T09:58:19.985 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-27T09:58:19.985 INFO:teuthology.orchestra.run.smithi118.stdout: osd pool default size = 2 2024-03-27T09:58:19.985 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-27T09:58:19.985 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd allow primary affinity = true 2024-03-27T09:58:19.986 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd allow pg remap = true 2024-03-27T09:58:19.986 INFO:teuthology.orchestra.run.smithi118.stdout: mon warn on legacy crush tunables = false 2024-03-27T09:58:19.986 INFO:teuthology.orchestra.run.smithi118.stdout: mon warn on crush straw calc version zero = false 2024-03-27T09:58:19.986 INFO:teuthology.orchestra.run.smithi118.stdout: mon warn on no sortbitwise = false 2024-03-27T09:58:19.986 INFO:teuthology.orchestra.run.smithi118.stdout: mon warn on osd down out interval zero = false 2024-03-27T09:58:19.986 INFO:teuthology.orchestra.run.smithi118.stdout: mon warn on too few osds = false 2024-03-27T09:58:19.986 INFO:teuthology.orchestra.run.smithi118.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-03-27T09:58:19.986 INFO:teuthology.orchestra.run.smithi118.stdout: mon_warn_on_pool_no_redundancy = false 2024-03-27T09:58:19.986 INFO:teuthology.orchestra.run.smithi118.stdout: mon_allow_pool_size_one = true 2024-03-27T09:58:19.986 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-27T09:58:19.986 INFO:teuthology.orchestra.run.smithi118.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-03-27T09:58:19.986 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-27T09:58:19.986 INFO:teuthology.orchestra.run.smithi118.stdout: osd default data pool replay window = 5 2024-03-27T09:58:19.986 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-27T09:58:19.986 INFO:teuthology.orchestra.run.smithi118.stdout: mon allow pool delete = true 2024-03-27T09:58:19.987 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-27T09:58:19.987 INFO:teuthology.orchestra.run.smithi118.stdout: mon cluster log file level = debug 2024-03-27T09:58:19.987 INFO:teuthology.orchestra.run.smithi118.stdout: debug asserts on shutdown = true 2024-03-27T09:58:19.987 INFO:teuthology.orchestra.run.smithi118.stdout: mon health detail to clog = false 2024-03-27T09:58:19.987 INFO:teuthology.orchestra.run.smithi118.stdout: mon host = "172.21.15.57,172.21.15.118,[v2:172.21.15.118:3301,v1:172.21.15.118:6790]" 2024-03-27T09:58:19.987 INFO:teuthology.orchestra.run.smithi118.stdout: fsid = 7ac43f86-2c16-4a97-98fb-715d3cebc75c 2024-03-27T09:58:19.987 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-27T09:58:19.987 INFO:teuthology.orchestra.run.smithi118.stdout:[osd] 2024-03-27T09:58:19.987 INFO:teuthology.orchestra.run.smithi118.stdout: osd journal size = 100 2024-03-27T09:58:19.987 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-27T09:58:19.987 INFO:teuthology.orchestra.run.smithi118.stdout: osd scrub load threshold = 5.0 2024-03-27T09:58:19.987 INFO:teuthology.orchestra.run.smithi118.stdout: osd scrub max interval = 600 2024-03-27T09:58:19.987 INFO:teuthology.orchestra.run.smithi118.stdout: osd mclock profile = high_recovery_ops 2024-03-27T09:58:19.987 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-27T09:58:19.987 INFO:teuthology.orchestra.run.smithi118.stdout: osd recover clone overlap = true 2024-03-27T09:58:19.988 INFO:teuthology.orchestra.run.smithi118.stdout: osd recovery max chunk = 1048576 2024-03-27T09:58:19.988 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-27T09:58:19.988 INFO:teuthology.orchestra.run.smithi118.stdout: osd debug shutdown = true 2024-03-27T09:58:19.988 INFO:teuthology.orchestra.run.smithi118.stdout: osd debug op order = true 2024-03-27T09:58:19.988 INFO:teuthology.orchestra.run.smithi118.stdout: osd debug verify stray on activate = true 2024-03-27T09:58:19.988 INFO:teuthology.orchestra.run.smithi118.stdout: osd debug trim objects = true 2024-03-27T09:58:19.988 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-27T09:58:19.988 INFO:teuthology.orchestra.run.smithi118.stdout: osd open classes on start = true 2024-03-27T09:58:19.988 INFO:teuthology.orchestra.run.smithi118.stdout: osd debug pg log writeout = true 2024-03-27T09:58:19.988 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-27T09:58:19.988 INFO:teuthology.orchestra.run.smithi118.stdout: osd deep scrub update digest min age = 30 2024-03-27T09:58:19.988 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-27T09:58:19.988 INFO:teuthology.orchestra.run.smithi118.stdout: osd map max advance = 10 2024-03-27T09:58:19.988 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-27T09:58:19.988 INFO:teuthology.orchestra.run.smithi118.stdout: journal zero on create = true 2024-03-27T09:58:19.988 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-27T09:58:19.989 INFO:teuthology.orchestra.run.smithi118.stdout: filestore ondisk finisher threads = 3 2024-03-27T09:58:19.989 INFO:teuthology.orchestra.run.smithi118.stdout: filestore apply finisher threads = 3 2024-03-27T09:58:19.989 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-27T09:58:19.989 INFO:teuthology.orchestra.run.smithi118.stdout: bdev debug aio = true 2024-03-27T09:58:19.989 INFO:teuthology.orchestra.run.smithi118.stdout: osd debug misdirected ops = true 2024-03-27T09:58:19.989 INFO:teuthology.orchestra.run.smithi118.stdout: bluestore block size = 96636764160 2024-03-27T09:58:19.989 INFO:teuthology.orchestra.run.smithi118.stdout: bluestore fsck on mount = True 2024-03-27T09:58:19.989 INFO:teuthology.orchestra.run.smithi118.stdout: debug bluefs = 20 2024-03-27T09:58:19.989 INFO:teuthology.orchestra.run.smithi118.stdout: debug bluestore = 20 2024-03-27T09:58:19.989 INFO:teuthology.orchestra.run.smithi118.stdout: debug ms = 1 2024-03-27T09:58:19.989 INFO:teuthology.orchestra.run.smithi118.stdout: debug osd = 20 2024-03-27T09:58:19.989 INFO:teuthology.orchestra.run.smithi118.stdout: debug rocksdb = 10 2024-03-27T09:58:19.989 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd backfillfull_ratio = 0.85 2024-03-27T09:58:19.989 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd full ratio = 0.9 2024-03-27T09:58:19.989 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd nearfull ratio = 0.8 2024-03-27T09:58:19.990 INFO:teuthology.orchestra.run.smithi118.stdout: osd failsafe full ratio = 0.95 2024-03-27T09:58:19.990 INFO:teuthology.orchestra.run.smithi118.stdout: osd objectstore = bluestore 2024-03-27T09:58:19.990 INFO:teuthology.orchestra.run.smithi118.stdout: osd op complaint time = 180 2024-03-27T09:58:19.990 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-27T09:58:19.990 INFO:teuthology.orchestra.run.smithi118.stdout:[mgr] 2024-03-27T09:58:19.990 INFO:teuthology.orchestra.run.smithi118.stdout: debug ms = 1 2024-03-27T09:58:19.990 INFO:teuthology.orchestra.run.smithi118.stdout: debug mgr = 20 2024-03-27T09:58:19.990 INFO:teuthology.orchestra.run.smithi118.stdout: debug mon = 20 2024-03-27T09:58:19.990 INFO:teuthology.orchestra.run.smithi118.stdout: debug auth = 20 2024-03-27T09:58:19.990 INFO:teuthology.orchestra.run.smithi118.stdout: mon reweight min pgs per osd = 4 2024-03-27T09:58:19.990 INFO:teuthology.orchestra.run.smithi118.stdout: mon reweight min bytes per osd = 10 2024-03-27T09:58:19.990 INFO:teuthology.orchestra.run.smithi118.stdout: mgr/telemetry/nag = false 2024-03-27T09:58:19.990 INFO:teuthology.orchestra.run.smithi118.stdout: debug client = 20 2024-03-27T09:58:19.990 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-27T09:58:19.990 INFO:teuthology.orchestra.run.smithi118.stdout:[mon] 2024-03-27T09:58:19.991 INFO:teuthology.orchestra.run.smithi118.stdout: debug ms = 1 2024-03-27T09:58:19.991 INFO:teuthology.orchestra.run.smithi118.stdout: debug mon = 20 2024-03-27T09:58:19.991 INFO:teuthology.orchestra.run.smithi118.stdout: debug paxos = 20 2024-03-27T09:58:19.991 INFO:teuthology.orchestra.run.smithi118.stdout: debug auth = 20 2024-03-27T09:58:19.991 INFO:teuthology.orchestra.run.smithi118.stdout: mon data avail warn = 5 2024-03-27T09:58:19.991 INFO:teuthology.orchestra.run.smithi118.stdout: mon mgr mkfs grace = 240 2024-03-27T09:58:19.991 INFO:teuthology.orchestra.run.smithi118.stdout: mon reweight min pgs per osd = 4 2024-03-27T09:58:19.991 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd reporter subtree level = osd 2024-03-27T09:58:19.991 INFO:teuthology.orchestra.run.smithi118.stdout: mon osd prime pg temp = true 2024-03-27T09:58:19.991 INFO:teuthology.orchestra.run.smithi118.stdout: mon reweight min bytes per osd = 10 2024-03-27T09:58:19.991 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-27T09:58:19.991 INFO:teuthology.orchestra.run.smithi118.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-03-27T09:58:19.991 INFO:teuthology.orchestra.run.smithi118.stdout: auth mon ticket ttl = 660 # 11m 2024-03-27T09:58:19.991 INFO:teuthology.orchestra.run.smithi118.stdout: auth service ticket ttl = 240 # 4m 2024-03-27T09:58:19.991 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-27T09:58:19.992 INFO:teuthology.orchestra.run.smithi118.stdout: # don't complain about insecure global_id in the test suite 2024-03-27T09:58:19.992 INFO:teuthology.orchestra.run.smithi118.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-03-27T09:58:19.992 INFO:teuthology.orchestra.run.smithi118.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-03-27T09:58:19.992 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-27T09:58:19.992 INFO:teuthology.orchestra.run.smithi118.stdout: # 1m isn't quite enough 2024-03-27T09:58:19.992 INFO:teuthology.orchestra.run.smithi118.stdout: mon_down_mkfs_grace = 2m 2024-03-27T09:58:19.992 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-27T09:58:19.992 INFO:teuthology.orchestra.run.smithi118.stdout: mon_warn_on_filestore_osds = false 2024-03-27T09:58:19.992 INFO:teuthology.orchestra.run.smithi118.stdout: mon down mkfs grace = 300 2024-03-27T09:58:19.992 INFO:teuthology.orchestra.run.smithi118.stdout: mon op complaint time = 120 2024-03-27T09:58:19.992 INFO:teuthology.orchestra.run.smithi118.stdout: 2024-03-27T09:58:19.992 INFO:teuthology.orchestra.run.smithi118.stdout:[client] 2024-03-27T09:58:19.993 INFO:teuthology.orchestra.run.smithi118.stdout: rgw cache enabled = true 2024-03-27T09:58:19.993 INFO:teuthology.orchestra.run.smithi118.stdout: rgw enable ops log = true 2024-03-27T09:58:19.993 INFO:teuthology.orchestra.run.smithi118.stdout: rgw enable usage log = true 2024-03-27T09:58:19.993 INFO:teuthology.orchestra.run.smithi118.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-03-27T09:58:19.993 INFO:teuthology.orchestra.run.smithi118.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-03-27T09:58:19.993 INFO:teuthology.orchestra.run.smithi118.stdout: client mount timeout = 600 2024-03-27T09:58:19.993 INFO:teuthology.orchestra.run.smithi118.stdout: debug client = 20 2024-03-27T09:58:19.993 INFO:teuthology.orchestra.run.smithi118.stdout: debug ms = 1 2024-03-27T09:58:19.993 INFO:teuthology.orchestra.run.smithi118.stdout: pid file = "" 2024-03-27T09:58:19.993 INFO:teuthology.orchestra.run.smithi118.stdout: rados mon op timeout = 900 2024-03-27T09:58:19.993 INFO:teuthology.orchestra.run.smithi118.stdout: rados osd op timeout = 900 2024-03-27T09:58:19.993 INFO:teuthology.orchestra.run.smithi118.stdout:[mon.a] 2024-03-27T09:58:19.993 INFO:teuthology.orchestra.run.smithi118.stdout:[mon.b] 2024-03-27T09:58:19.993 INFO:teuthology.orchestra.run.smithi118.stdout:[mon.c] 2024-03-27T09:58:19.993 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.a] 2024-03-27T09:58:19.994 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.c] 2024-03-27T09:58:19.994 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.b] 2024-03-27T09:58:19.994 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.d] 2024-03-27T09:58:19.994 INFO:teuthology.orchestra.run.smithi118.stdout:[mds] 2024-03-27T09:58:19.994 INFO:teuthology.orchestra.run.smithi118.stdout: debug mds = 20 2024-03-27T09:58:19.994 INFO:teuthology.orchestra.run.smithi118.stdout: debug mds balancer = 20 2024-03-27T09:58:19.994 INFO:teuthology.orchestra.run.smithi118.stdout: debug ms = 1 2024-03-27T09:58:19.994 INFO:teuthology.orchestra.run.smithi118.stdout: mds debug frag = True 2024-03-27T09:58:19.994 INFO:teuthology.orchestra.run.smithi118.stdout: mds debug scatterstat = True 2024-03-27T09:58:19.994 INFO:teuthology.orchestra.run.smithi118.stdout: mds op complaint time = 180 2024-03-27T09:58:19.994 INFO:teuthology.orchestra.run.smithi118.stdout: mds verify scatter = True 2024-03-27T09:58:19.994 INFO:teuthology.orchestra.run.smithi118.stdout: osd op complaint time = 180 2024-03-27T09:58:19.994 INFO:teuthology.orchestra.run.smithi118.stdout: rados mon op timeout = 900 2024-03-27T09:58:19.994 INFO:teuthology.orchestra.run.smithi118.stdout: rados osd op timeout = 900 2024-03-27T09:58:19.995 INFO:teuthology.orchestra.run.smithi057.stdout:[global] 2024-03-27T09:58:19.995 INFO:teuthology.orchestra.run.smithi057.stdout: chdir = "" 2024-03-27T09:58:19.995 INFO:teuthology.orchestra.run.smithi057.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-03-27T09:58:19.995 INFO:teuthology.orchestra.run.smithi057.stdout: auth supported = cephx 2024-03-27T09:58:19.995 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T09:58:19.995 INFO:teuthology.orchestra.run.smithi057.stdout: filestore xattr use omap = true 2024-03-27T09:58:19.995 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T09:58:19.995 INFO:teuthology.orchestra.run.smithi057.stdout: mon clock drift allowed = 1.000 2024-03-27T09:58:19.995 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T09:58:19.996 INFO:teuthology.orchestra.run.smithi057.stdout: osd crush chooseleaf type = 0 2024-03-27T09:58:19.996 INFO:teuthology.orchestra.run.smithi057.stdout: auth debug = true 2024-03-27T09:58:19.996 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T09:58:19.996 INFO:teuthology.orchestra.run.smithi057.stdout: ms die on old message = true 2024-03-27T09:58:19.996 INFO:teuthology.orchestra.run.smithi057.stdout: ms die on bug = true 2024-03-27T09:58:19.996 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T09:58:19.996 INFO:teuthology.orchestra.run.smithi057.stdout: mon max pg per osd = 10000 # >= luminous 2024-03-27T09:58:19.996 INFO:teuthology.orchestra.run.smithi057.stdout: mon pg warn max object skew = 0 2024-03-27T09:58:19.996 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T09:58:19.996 INFO:teuthology.orchestra.run.smithi057.stdout: # disable pg_autoscaler by default for new pools 2024-03-27T09:58:19.996 INFO:teuthology.orchestra.run.smithi057.stdout: osd_pool_default_pg_autoscale_mode = off 2024-03-27T09:58:19.996 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T09:58:19.996 INFO:teuthology.orchestra.run.smithi057.stdout: osd pool default size = 2 2024-03-27T09:58:19.996 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T09:58:19.996 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd allow primary affinity = true 2024-03-27T09:58:19.997 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd allow pg remap = true 2024-03-27T09:58:19.997 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on legacy crush tunables = false 2024-03-27T09:58:19.997 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on crush straw calc version zero = false 2024-03-27T09:58:19.997 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on no sortbitwise = false 2024-03-27T09:58:19.997 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on osd down out interval zero = false 2024-03-27T09:58:19.997 INFO:teuthology.orchestra.run.smithi057.stdout: mon warn on too few osds = false 2024-03-27T09:58:19.997 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-03-27T09:58:19.997 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_pool_no_redundancy = false 2024-03-27T09:58:19.997 INFO:teuthology.orchestra.run.smithi057.stdout: mon_allow_pool_size_one = true 2024-03-27T09:58:19.997 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T09:58:19.997 INFO:teuthology.orchestra.run.smithi057.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-03-27T09:58:19.997 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T09:58:19.997 INFO:teuthology.orchestra.run.smithi057.stdout: osd default data pool replay window = 5 2024-03-27T09:58:19.997 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T09:58:19.997 INFO:teuthology.orchestra.run.smithi057.stdout: mon allow pool delete = true 2024-03-27T09:58:19.998 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T09:58:19.998 INFO:teuthology.orchestra.run.smithi057.stdout: mon cluster log file level = debug 2024-03-27T09:58:19.998 INFO:teuthology.orchestra.run.smithi057.stdout: debug asserts on shutdown = true 2024-03-27T09:58:19.998 INFO:teuthology.orchestra.run.smithi057.stdout: mon health detail to clog = false 2024-03-27T09:58:19.998 INFO:teuthology.orchestra.run.smithi057.stdout: mon host = "172.21.15.57,172.21.15.118,[v2:172.21.15.118:3301,v1:172.21.15.118:6790]" 2024-03-27T09:58:19.998 INFO:teuthology.orchestra.run.smithi057.stdout: fsid = 7ac43f86-2c16-4a97-98fb-715d3cebc75c 2024-03-27T09:58:19.998 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T09:58:19.998 INFO:teuthology.orchestra.run.smithi057.stdout:[osd] 2024-03-27T09:58:19.998 INFO:teuthology.orchestra.run.smithi057.stdout: osd journal size = 100 2024-03-27T09:58:19.998 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T09:58:19.998 INFO:teuthology.orchestra.run.smithi057.stdout: osd scrub load threshold = 5.0 2024-03-27T09:58:19.998 INFO:teuthology.orchestra.run.smithi057.stdout: osd scrub max interval = 600 2024-03-27T09:58:19.998 INFO:teuthology.orchestra.run.smithi057.stdout: osd mclock profile = high_recovery_ops 2024-03-27T09:58:19.998 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T09:58:19.998 INFO:teuthology.orchestra.run.smithi057.stdout: osd recover clone overlap = true 2024-03-27T09:58:19.999 INFO:teuthology.orchestra.run.smithi057.stdout: osd recovery max chunk = 1048576 2024-03-27T09:58:19.999 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T09:58:19.999 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug shutdown = true 2024-03-27T09:58:19.999 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug op order = true 2024-03-27T09:58:19.999 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug verify stray on activate = true 2024-03-27T09:58:19.999 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug trim objects = true 2024-03-27T09:58:19.999 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T09:58:19.999 INFO:teuthology.orchestra.run.smithi057.stdout: osd open classes on start = true 2024-03-27T09:58:19.999 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug pg log writeout = true 2024-03-27T09:58:19.999 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T09:58:19.999 INFO:teuthology.orchestra.run.smithi057.stdout: osd deep scrub update digest min age = 30 2024-03-27T09:58:19.999 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T09:58:19.999 INFO:teuthology.orchestra.run.smithi057.stdout: osd map max advance = 10 2024-03-27T09:58:19.999 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T09:58:19.999 INFO:teuthology.orchestra.run.smithi057.stdout: journal zero on create = true 2024-03-27T09:58:20.000 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T09:58:20.000 INFO:teuthology.orchestra.run.smithi057.stdout: filestore ondisk finisher threads = 3 2024-03-27T09:58:20.000 INFO:teuthology.orchestra.run.smithi057.stdout: filestore apply finisher threads = 3 2024-03-27T09:58:20.000 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T09:58:20.000 INFO:teuthology.orchestra.run.smithi057.stdout: bdev debug aio = true 2024-03-27T09:58:20.000 INFO:teuthology.orchestra.run.smithi057.stdout: osd debug misdirected ops = true 2024-03-27T09:58:20.000 INFO:teuthology.orchestra.run.smithi057.stdout: bluestore block size = 96636764160 2024-03-27T09:58:20.000 INFO:teuthology.orchestra.run.smithi057.stdout: bluestore fsck on mount = True 2024-03-27T09:58:20.000 INFO:teuthology.orchestra.run.smithi057.stdout: debug bluefs = 20 2024-03-27T09:58:20.000 INFO:teuthology.orchestra.run.smithi057.stdout: debug bluestore = 20 2024-03-27T09:58:20.000 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2024-03-27T09:58:20.000 INFO:teuthology.orchestra.run.smithi057.stdout: debug osd = 20 2024-03-27T09:58:20.000 INFO:teuthology.orchestra.run.smithi057.stdout: debug rocksdb = 10 2024-03-27T09:58:20.000 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd backfillfull_ratio = 0.85 2024-03-27T09:58:20.000 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd full ratio = 0.9 2024-03-27T09:58:20.001 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd nearfull ratio = 0.8 2024-03-27T09:58:20.001 INFO:teuthology.orchestra.run.smithi057.stdout: osd failsafe full ratio = 0.95 2024-03-27T09:58:20.001 INFO:teuthology.orchestra.run.smithi057.stdout: osd objectstore = bluestore 2024-03-27T09:58:20.001 INFO:teuthology.orchestra.run.smithi057.stdout: osd op complaint time = 180 2024-03-27T09:58:20.001 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T09:58:20.001 INFO:teuthology.orchestra.run.smithi057.stdout:[mgr] 2024-03-27T09:58:20.001 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2024-03-27T09:58:20.001 INFO:teuthology.orchestra.run.smithi057.stdout: debug mgr = 20 2024-03-27T09:58:20.001 INFO:teuthology.orchestra.run.smithi057.stdout: debug mon = 20 2024-03-27T09:58:20.001 INFO:teuthology.orchestra.run.smithi057.stdout: debug auth = 20 2024-03-27T09:58:20.001 INFO:teuthology.orchestra.run.smithi057.stdout: mon reweight min pgs per osd = 4 2024-03-27T09:58:20.001 INFO:teuthology.orchestra.run.smithi057.stdout: mon reweight min bytes per osd = 10 2024-03-27T09:58:20.001 INFO:teuthology.orchestra.run.smithi057.stdout: mgr/telemetry/nag = false 2024-03-27T09:58:20.001 INFO:teuthology.orchestra.run.smithi057.stdout: debug client = 20 2024-03-27T09:58:20.002 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T09:58:20.002 INFO:teuthology.orchestra.run.smithi057.stdout:[mon] 2024-03-27T09:58:20.002 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2024-03-27T09:58:20.002 INFO:teuthology.orchestra.run.smithi057.stdout: debug mon = 20 2024-03-27T09:58:20.002 INFO:teuthology.orchestra.run.smithi057.stdout: debug paxos = 20 2024-03-27T09:58:20.002 INFO:teuthology.orchestra.run.smithi057.stdout: debug auth = 20 2024-03-27T09:58:20.002 INFO:teuthology.orchestra.run.smithi057.stdout: mon data avail warn = 5 2024-03-27T09:58:20.002 INFO:teuthology.orchestra.run.smithi057.stdout: mon mgr mkfs grace = 240 2024-03-27T09:58:20.002 INFO:teuthology.orchestra.run.smithi057.stdout: mon reweight min pgs per osd = 4 2024-03-27T09:58:20.002 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd reporter subtree level = osd 2024-03-27T09:58:20.002 INFO:teuthology.orchestra.run.smithi057.stdout: mon osd prime pg temp = true 2024-03-27T09:58:20.002 INFO:teuthology.orchestra.run.smithi057.stdout: mon reweight min bytes per osd = 10 2024-03-27T09:58:20.002 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T09:58:20.002 INFO:teuthology.orchestra.run.smithi057.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-03-27T09:58:20.002 INFO:teuthology.orchestra.run.smithi057.stdout: auth mon ticket ttl = 660 # 11m 2024-03-27T09:58:20.003 INFO:teuthology.orchestra.run.smithi057.stdout: auth service ticket ttl = 240 # 4m 2024-03-27T09:58:20.003 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T09:58:20.003 INFO:teuthology.orchestra.run.smithi057.stdout: # don't complain about insecure global_id in the test suite 2024-03-27T09:58:20.003 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-03-27T09:58:20.003 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-03-27T09:58:20.003 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T09:58:20.003 INFO:teuthology.orchestra.run.smithi057.stdout: # 1m isn't quite enough 2024-03-27T09:58:20.003 INFO:teuthology.orchestra.run.smithi057.stdout: mon_down_mkfs_grace = 2m 2024-03-27T09:58:20.003 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T09:58:20.003 INFO:teuthology.orchestra.run.smithi057.stdout: mon_warn_on_filestore_osds = false 2024-03-27T09:58:20.003 INFO:teuthology.orchestra.run.smithi057.stdout: mon down mkfs grace = 300 2024-03-27T09:58:20.003 INFO:teuthology.orchestra.run.smithi057.stdout: mon op complaint time = 120 2024-03-27T09:58:20.003 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T09:58:20.003 INFO:teuthology.orchestra.run.smithi057.stdout:[client] 2024-03-27T09:58:20.003 INFO:teuthology.orchestra.run.smithi057.stdout: rgw cache enabled = true 2024-03-27T09:58:20.003 INFO:teuthology.orchestra.run.smithi057.stdout: rgw enable ops log = true 2024-03-27T09:58:20.004 INFO:teuthology.orchestra.run.smithi057.stdout: rgw enable usage log = true 2024-03-27T09:58:20.004 INFO:teuthology.orchestra.run.smithi057.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-03-27T09:58:20.004 INFO:teuthology.orchestra.run.smithi057.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-03-27T09:58:20.004 INFO:teuthology.orchestra.run.smithi057.stdout: client mount timeout = 600 2024-03-27T09:58:20.004 INFO:teuthology.orchestra.run.smithi057.stdout: debug client = 20 2024-03-27T09:58:20.004 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2024-03-27T09:58:20.004 INFO:teuthology.orchestra.run.smithi057.stdout: pid file = "" 2024-03-27T09:58:20.004 INFO:teuthology.orchestra.run.smithi057.stdout: rados mon op timeout = 900 2024-03-27T09:58:20.004 INFO:teuthology.orchestra.run.smithi057.stdout: rados osd op timeout = 900 2024-03-27T09:58:20.004 INFO:teuthology.orchestra.run.smithi057.stdout:[mon.a] 2024-03-27T09:58:20.004 INFO:teuthology.orchestra.run.smithi057.stdout:[mon.b] 2024-03-27T09:58:20.004 INFO:teuthology.orchestra.run.smithi057.stdout:[mon.c] 2024-03-27T09:58:20.004 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.a] 2024-03-27T09:58:20.004 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.c] 2024-03-27T09:58:20.004 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.b] 2024-03-27T09:58:20.004 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.d] 2024-03-27T09:58:20.005 INFO:teuthology.orchestra.run.smithi057.stdout:[mds] 2024-03-27T09:58:20.005 INFO:teuthology.orchestra.run.smithi057.stdout: debug mds = 20 2024-03-27T09:58:20.005 INFO:teuthology.orchestra.run.smithi057.stdout: debug mds balancer = 20 2024-03-27T09:58:20.005 INFO:teuthology.orchestra.run.smithi057.stdout: debug ms = 1 2024-03-27T09:58:20.005 INFO:teuthology.orchestra.run.smithi057.stdout: mds debug frag = True 2024-03-27T09:58:20.005 INFO:teuthology.orchestra.run.smithi057.stdout: mds debug scatterstat = True 2024-03-27T09:58:20.005 INFO:teuthology.orchestra.run.smithi057.stdout: mds op complaint time = 180 2024-03-27T09:58:20.005 INFO:teuthology.orchestra.run.smithi057.stdout: mds verify scatter = True 2024-03-27T09:58:20.005 INFO:teuthology.orchestra.run.smithi057.stdout: osd op complaint time = 180 2024-03-27T09:58:20.005 INFO:teuthology.orchestra.run.smithi057.stdout: rados mon op timeout = 900 2024-03-27T09:58:20.005 INFO:teuthology.orchestra.run.smithi057.stdout: rados osd op timeout = 900 2024-03-27T09:58:20.033 INFO:tasks.ceph:Creating admin key on mon.a... 2024-03-27T09:58:20.034 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-03-27T09:58:20.181 INFO:tasks.ceph:Copying monmap to all nodes... 2024-03-27T09:58:20.181 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-03-27T09:58:20.182 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-03-27T09:58:20.231 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-03-27T09:58:20.232 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-03-27T09:58:20.279 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi057.front.sepia.ceph.com 2024-03-27T09:58:20.280 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-03-27T09:58:20.280 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/etc/ceph/ceph.keyring 2024-03-27T09:58:20.280 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-27T09:58:20.487 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-03-27T09:58:20.487 DEBUG:teuthology.orchestra.run.smithi057:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-03-27T09:58:20.584 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi118.front.sepia.ceph.com 2024-03-27T09:58:20.584 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-03-27T09:58:20.584 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd of=/etc/ceph/ceph.keyring 2024-03-27T09:58:20.585 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-27T09:58:20.735 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-03-27T09:58:20.736 DEBUG:teuthology.orchestra.run.smithi118:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-03-27T09:58:20.831 INFO:tasks.ceph:Setting up mon nodes... 2024-03-27T09:58:20.831 INFO:tasks.ceph:Setting up mgr nodes... 2024-03-27T09:58:20.831 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-03-27T09:58:21.034 INFO:teuthology.orchestra.run.smithi057.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-03-27T09:58:21.044 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-03-27T09:58:21.274 INFO:teuthology.orchestra.run.smithi118.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-03-27T09:58:21.286 INFO:tasks.ceph:Setting up mds nodes... 2024-03-27T09:58:21.286 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-03-27T09:58:21.471 INFO:teuthology.orchestra.run.smithi057.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-03-27T09:58:21.481 DEBUG:teuthology.orchestra.run.smithi057:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-03-27T09:58:21.576 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-03-27T09:58:21.765 INFO:teuthology.orchestra.run.smithi057.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-03-27T09:58:21.775 DEBUG:teuthology.orchestra.run.smithi057:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-03-27T09:58:21.870 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-03-27T09:58:22.056 INFO:teuthology.orchestra.run.smithi118.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-03-27T09:58:22.065 DEBUG:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-03-27T09:58:22.157 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-03-27T09:58:22.332 INFO:teuthology.orchestra.run.smithi118.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-03-27T09:58:22.341 DEBUG:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-03-27T09:58:22.435 INFO:tasks.ceph_client:Setting up client nodes... 2024-03-27T09:58:22.435 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-03-27T09:58:22.574 INFO:teuthology.orchestra.run.smithi057.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-03-27T09:58:22.634 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-03-27T09:58:22.769 INFO:teuthology.orchestra.run.smithi057.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-03-27T09:58:22.833 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-03-27T09:58:22.960 INFO:teuthology.orchestra.run.smithi118.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-03-27T09:58:23.022 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-03-27T09:58:23.149 INFO:teuthology.orchestra.run.smithi118.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-03-27T09:58:23.205 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-03-27T09:58:23.205 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi057.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi118.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-03-27T09:58:23.205 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-03-27T09:58:23.312 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-27T09:58:23.312 INFO:tasks.ceph:role: osd.0 2024-03-27T09:58:23.312 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi057.front.sepia.ceph.com 2024-03-27T09:58:23.313 DEBUG:teuthology.orchestra.run.smithi057:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-03-27T09:58:23.435 INFO:teuthology.orchestra.run.smithi057.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-03-27T09:58:23.435 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-27T09:58:23.435 INFO:teuthology.orchestra.run.smithi057.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-27T09:58:23.435 INFO:teuthology.orchestra.run.smithi057.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-27T09:58:23.435 INFO:teuthology.orchestra.run.smithi057.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-27T09:58:23.435 INFO:teuthology.orchestra.run.smithi057.stdout: = sunit=0 swidth=0 blks 2024-03-27T09:58:23.435 INFO:teuthology.orchestra.run.smithi057.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-27T09:58:23.436 INFO:teuthology.orchestra.run.smithi057.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-27T09:58:23.436 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-27T09:58:23.436 INFO:teuthology.orchestra.run.smithi057.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-27T09:58:24.760 INFO:teuthology.orchestra.run.smithi057.stdout:Discarding blocks...Done. 2024-03-27T09:58:24.767 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi057.front.sepia.ceph.com -o noatime 2024-03-27T09:58:24.767 DEBUG:teuthology.orchestra.run.smithi057:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-03-27T09:58:24.888 DEBUG:teuthology.orchestra.run.smithi057:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-03-27T09:58:24.977 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-03-27T09:58:25.088 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-27T09:58:25.089 INFO:tasks.ceph:role: osd.1 2024-03-27T09:58:25.089 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi057.front.sepia.ceph.com 2024-03-27T09:58:25.089 DEBUG:teuthology.orchestra.run.smithi057:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-03-27T09:58:25.210 INFO:teuthology.orchestra.run.smithi057.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-03-27T09:58:25.210 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-27T09:58:25.210 INFO:teuthology.orchestra.run.smithi057.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-27T09:58:25.210 INFO:teuthology.orchestra.run.smithi057.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-27T09:58:25.210 INFO:teuthology.orchestra.run.smithi057.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-27T09:58:25.210 INFO:teuthology.orchestra.run.smithi057.stdout: = sunit=0 swidth=0 blks 2024-03-27T09:58:25.210 INFO:teuthology.orchestra.run.smithi057.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-27T09:58:25.211 INFO:teuthology.orchestra.run.smithi057.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-27T09:58:25.211 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-27T09:58:25.211 INFO:teuthology.orchestra.run.smithi057.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-27T09:58:26.530 INFO:teuthology.orchestra.run.smithi057.stdout:Discarding blocks...Done. 2024-03-27T09:58:26.537 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi057.front.sepia.ceph.com -o noatime 2024-03-27T09:58:26.537 DEBUG:teuthology.orchestra.run.smithi057:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-03-27T09:58:26.646 DEBUG:teuthology.orchestra.run.smithi057:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-03-27T09:58:26.723 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-03-27T09:58:26.797 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-27T09:58:26.797 INFO:tasks.ceph:role: osd.2 2024-03-27T09:58:26.797 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi057.front.sepia.ceph.com 2024-03-27T09:58:26.797 DEBUG:teuthology.orchestra.run.smithi057:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-03-27T09:58:26.911 INFO:teuthology.orchestra.run.smithi057.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-03-27T09:58:26.911 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-27T09:58:26.911 INFO:teuthology.orchestra.run.smithi057.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-27T09:58:26.911 INFO:teuthology.orchestra.run.smithi057.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-27T09:58:26.911 INFO:teuthology.orchestra.run.smithi057.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-27T09:58:26.911 INFO:teuthology.orchestra.run.smithi057.stdout: = sunit=0 swidth=0 blks 2024-03-27T09:58:26.911 INFO:teuthology.orchestra.run.smithi057.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-27T09:58:26.911 INFO:teuthology.orchestra.run.smithi057.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-27T09:58:26.911 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-27T09:58:26.911 INFO:teuthology.orchestra.run.smithi057.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-27T09:58:28.234 INFO:teuthology.orchestra.run.smithi057.stdout:Discarding blocks...Done. 2024-03-27T09:58:28.241 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi057.front.sepia.ceph.com -o noatime 2024-03-27T09:58:28.241 DEBUG:teuthology.orchestra.run.smithi057:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-03-27T09:58:28.364 DEBUG:teuthology.orchestra.run.smithi057:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-03-27T09:58:28.452 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-03-27T09:58:28.550 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-27T09:58:28.550 INFO:tasks.ceph:role: osd.3 2024-03-27T09:58:28.550 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi057.front.sepia.ceph.com 2024-03-27T09:58:28.550 DEBUG:teuthology.orchestra.run.smithi057:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-03-27T09:58:28.676 INFO:teuthology.orchestra.run.smithi057.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-03-27T09:58:28.676 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-27T09:58:28.676 INFO:teuthology.orchestra.run.smithi057.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-27T09:58:28.676 INFO:teuthology.orchestra.run.smithi057.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-27T09:58:28.677 INFO:teuthology.orchestra.run.smithi057.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-27T09:58:28.677 INFO:teuthology.orchestra.run.smithi057.stdout: = sunit=0 swidth=0 blks 2024-03-27T09:58:28.677 INFO:teuthology.orchestra.run.smithi057.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-27T09:58:28.677 INFO:teuthology.orchestra.run.smithi057.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-27T09:58:28.677 INFO:teuthology.orchestra.run.smithi057.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-27T09:58:28.677 INFO:teuthology.orchestra.run.smithi057.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-27T09:58:29.994 INFO:teuthology.orchestra.run.smithi057.stdout:Discarding blocks...Done. 2024-03-27T09:58:30.001 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi057.front.sepia.ceph.com -o noatime 2024-03-27T09:58:30.001 DEBUG:teuthology.orchestra.run.smithi057:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-03-27T09:58:30.127 DEBUG:teuthology.orchestra.run.smithi057:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-03-27T09:58:30.218 DEBUG:teuthology.orchestra.run.smithi057:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-27T09:58:30.381 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:58:30.390+0000 7f410b813640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-03-27T09:58:30.381 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:58:30.390+0000 7f410b813640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-03-27T09:58:30.381 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:58:30.390+0000 7f410b813640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-27T09:58:30.381 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:58:30.391+0000 7f410b813640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-27T09:58:30.381 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:58:30.391+0000 7f410b813640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-27T09:58:30.385 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:58:30.394+0000 7f410b813640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-03-27T09:58:33.579 DEBUG:teuthology.orchestra.run.smithi057:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-03-27T09:58:33.682 DEBUG:teuthology.orchestra.run.smithi057:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-27T09:58:33.828 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:58:33.838+0000 7f8754a8b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-03-27T09:58:33.829 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:58:33.839+0000 7f8754a8b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-03-27T09:58:33.829 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:58:33.839+0000 7f8754a8b640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-27T09:58:33.829 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:58:33.839+0000 7f8754a8b640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-27T09:58:33.829 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:58:33.839+0000 7f8754a8b640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-27T09:58:33.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:58:33.842+0000 7f8754a8b640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-03-27T09:58:36.783 DEBUG:teuthology.orchestra.run.smithi057:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-03-27T09:58:36.876 DEBUG:teuthology.orchestra.run.smithi057:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-27T09:58:37.023 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:58:37.033+0000 7fe0267f8640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-03-27T09:58:37.023 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:58:37.033+0000 7fe0267f8640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-03-27T09:58:37.023 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:58:37.033+0000 7fe0267f8640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-27T09:58:37.023 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:58:37.033+0000 7fe0267f8640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-27T09:58:37.023 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:58:37.033+0000 7fe0267f8640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-27T09:58:37.025 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:58:37.036+0000 7fe0267f8640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-03-27T09:58:40.209 DEBUG:teuthology.orchestra.run.smithi057:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-03-27T09:58:40.313 DEBUG:teuthology.orchestra.run.smithi057:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-27T09:58:40.455 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:58:40.465+0000 7fb13e814640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-03-27T09:58:40.456 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:58:40.465+0000 7fb13e814640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-03-27T09:58:40.456 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:58:40.465+0000 7fb13e814640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-27T09:58:40.456 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:58:40.465+0000 7fb13e814640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-27T09:58:40.456 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:58:40.465+0000 7fb13e814640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-27T09:58:40.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:58:40.468+0000 7fb13e814640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-03-27T09:58:43.660 DEBUG:teuthology.orchestra.run.smithi057:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-03-27T09:58:43.762 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-03-27T09:58:43.864 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-27T09:58:43.864 INFO:tasks.ceph:role: osd.4 2024-03-27T09:58:43.864 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi118.front.sepia.ceph.com 2024-03-27T09:58:43.864 DEBUG:teuthology.orchestra.run.smithi118:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-03-27T09:58:43.956 INFO:teuthology.orchestra.run.smithi118.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-03-27T09:58:43.956 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-27T09:58:43.956 INFO:teuthology.orchestra.run.smithi118.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-27T09:58:43.956 INFO:teuthology.orchestra.run.smithi118.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-27T09:58:43.956 INFO:teuthology.orchestra.run.smithi118.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-27T09:58:43.956 INFO:teuthology.orchestra.run.smithi118.stdout: = sunit=0 swidth=0 blks 2024-03-27T09:58:43.956 INFO:teuthology.orchestra.run.smithi118.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-27T09:58:43.956 INFO:teuthology.orchestra.run.smithi118.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-27T09:58:43.956 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-27T09:58:43.956 INFO:teuthology.orchestra.run.smithi118.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-27T09:58:43.989 INFO:teuthology.orchestra.run.smithi118.stdout:Discarding blocks...Done. 2024-03-27T09:58:43.994 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi118.front.sepia.ceph.com -o noatime 2024-03-27T09:58:43.995 DEBUG:teuthology.orchestra.run.smithi118:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-03-27T09:58:44.102 DEBUG:teuthology.orchestra.run.smithi118:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-03-27T09:58:44.189 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-03-27T09:58:44.273 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-27T09:58:44.274 INFO:tasks.ceph:role: osd.5 2024-03-27T09:58:44.274 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi118.front.sepia.ceph.com 2024-03-27T09:58:44.274 DEBUG:teuthology.orchestra.run.smithi118:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-03-27T09:58:44.361 INFO:teuthology.orchestra.run.smithi118.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-03-27T09:58:44.362 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-27T09:58:44.362 INFO:teuthology.orchestra.run.smithi118.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-27T09:58:44.362 INFO:teuthology.orchestra.run.smithi118.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-27T09:58:44.362 INFO:teuthology.orchestra.run.smithi118.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-27T09:58:44.362 INFO:teuthology.orchestra.run.smithi118.stdout: = sunit=0 swidth=0 blks 2024-03-27T09:58:44.362 INFO:teuthology.orchestra.run.smithi118.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-27T09:58:44.362 INFO:teuthology.orchestra.run.smithi118.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-27T09:58:44.362 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-27T09:58:44.362 INFO:teuthology.orchestra.run.smithi118.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-27T09:58:44.395 INFO:teuthology.orchestra.run.smithi118.stdout:Discarding blocks...Done. 2024-03-27T09:58:44.401 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi118.front.sepia.ceph.com -o noatime 2024-03-27T09:58:44.401 DEBUG:teuthology.orchestra.run.smithi118:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-03-27T09:58:44.508 DEBUG:teuthology.orchestra.run.smithi118:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-03-27T09:58:44.590 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-03-27T09:58:44.668 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-27T09:58:44.668 INFO:tasks.ceph:role: osd.6 2024-03-27T09:58:44.668 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi118.front.sepia.ceph.com 2024-03-27T09:58:44.668 DEBUG:teuthology.orchestra.run.smithi118:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-03-27T09:58:44.753 INFO:teuthology.orchestra.run.smithi118.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-03-27T09:58:44.753 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-27T09:58:44.754 INFO:teuthology.orchestra.run.smithi118.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-27T09:58:44.754 INFO:teuthology.orchestra.run.smithi118.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-27T09:58:44.754 INFO:teuthology.orchestra.run.smithi118.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-27T09:58:44.754 INFO:teuthology.orchestra.run.smithi118.stdout: = sunit=0 swidth=0 blks 2024-03-27T09:58:44.754 INFO:teuthology.orchestra.run.smithi118.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-27T09:58:44.754 INFO:teuthology.orchestra.run.smithi118.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-27T09:58:44.754 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-27T09:58:44.754 INFO:teuthology.orchestra.run.smithi118.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-27T09:58:44.788 INFO:teuthology.orchestra.run.smithi118.stdout:Discarding blocks...Done. 2024-03-27T09:58:44.793 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi118.front.sepia.ceph.com -o noatime 2024-03-27T09:58:44.793 DEBUG:teuthology.orchestra.run.smithi118:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-03-27T09:58:44.903 DEBUG:teuthology.orchestra.run.smithi118:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-03-27T09:58:44.979 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-03-27T09:58:45.068 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-27T09:58:45.068 INFO:tasks.ceph:role: osd.7 2024-03-27T09:58:45.068 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi118.front.sepia.ceph.com 2024-03-27T09:58:45.068 DEBUG:teuthology.orchestra.run.smithi118:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-03-27T09:58:45.158 INFO:teuthology.orchestra.run.smithi118.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-03-27T09:58:45.158 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-27T09:58:45.158 INFO:teuthology.orchestra.run.smithi118.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-27T09:58:45.158 INFO:teuthology.orchestra.run.smithi118.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-27T09:58:45.158 INFO:teuthology.orchestra.run.smithi118.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-27T09:58:45.158 INFO:teuthology.orchestra.run.smithi118.stdout: = sunit=0 swidth=0 blks 2024-03-27T09:58:45.159 INFO:teuthology.orchestra.run.smithi118.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-27T09:58:45.159 INFO:teuthology.orchestra.run.smithi118.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-27T09:58:45.159 INFO:teuthology.orchestra.run.smithi118.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-27T09:58:45.159 INFO:teuthology.orchestra.run.smithi118.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-27T09:58:45.191 INFO:teuthology.orchestra.run.smithi118.stdout:Discarding blocks...Done. 2024-03-27T09:58:45.197 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi118.front.sepia.ceph.com -o noatime 2024-03-27T09:58:45.198 DEBUG:teuthology.orchestra.run.smithi118:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-03-27T09:58:45.305 DEBUG:teuthology.orchestra.run.smithi118:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-03-27T09:58:45.383 DEBUG:teuthology.orchestra.run.smithi118:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-27T09:58:45.533 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:58:45.542+0000 7fba76c11640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-03-27T09:58:45.533 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:58:45.543+0000 7fba76c11640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-03-27T09:58:45.533 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:58:45.543+0000 7fba76c11640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-27T09:58:45.534 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:58:45.543+0000 7fba76c11640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-27T09:58:45.534 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:58:45.543+0000 7fba76c11640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-27T09:58:45.537 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:58:45.546+0000 7fba76c11640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-03-27T09:58:47.089 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T09:58:47.097 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T09:58:48.462 DEBUG:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-03-27T09:58:48.559 DEBUG:teuthology.orchestra.run.smithi118:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-27T09:58:48.695 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:58:48.705+0000 7fd9210f9640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-03-27T09:58:48.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:58:48.706+0000 7fd9210f9640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-03-27T09:58:48.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:58:48.706+0000 7fd9210f9640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-27T09:58:48.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:58:48.706+0000 7fd9210f9640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-27T09:58:48.696 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:58:48.706+0000 7fd9210f9640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-27T09:58:48.698 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:58:48.708+0000 7fd9210f9640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-03-27T09:58:51.874 DEBUG:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-03-27T09:58:51.970 DEBUG:teuthology.orchestra.run.smithi118:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-27T09:58:52.107 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:58:52.117+0000 7f193d604640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-03-27T09:58:52.108 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:58:52.118+0000 7f193d604640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-03-27T09:58:52.108 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:58:52.118+0000 7f193d604640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-27T09:58:52.108 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:58:52.118+0000 7f193d604640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-27T09:58:52.108 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:58:52.118+0000 7f193d604640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-27T09:58:52.110 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:58:52.120+0000 7f193d604640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-03-27T09:58:55.035 DEBUG:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-03-27T09:58:55.133 DEBUG:teuthology.orchestra.run.smithi118:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-27T09:58:55.272 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:58:55.281+0000 7fddbb4f5640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-03-27T09:58:55.272 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:58:55.281+0000 7fddbb4f5640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-03-27T09:58:55.272 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:58:55.281+0000 7fddbb4f5640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-27T09:58:55.272 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:58:55.281+0000 7fddbb4f5640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-27T09:58:55.272 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:58:55.281+0000 7fddbb4f5640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-27T09:58:55.273 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:58:55.284+0000 7fddbb4f5640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-03-27T09:58:58.194 DEBUG:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-03-27T09:58:58.291 INFO:tasks.ceph:Reading keys from all nodes... 2024-03-27T09:58:58.291 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-03-27T09:58:58.292 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-03-27T09:58:58.393 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-03-27T09:58:58.393 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-03-27T09:58:58.491 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-03-27T09:58:58.491 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-03-27T09:58:58.577 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-03-27T09:58:58.577 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-03-27T09:58:58.675 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-03-27T09:58:58.675 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-03-27T09:58:58.772 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-03-27T09:58:58.772 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-03-27T09:58:58.866 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-03-27T09:58:58.866 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-03-27T09:58:58.969 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-03-27T09:58:58.969 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-03-27T09:58:59.066 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-03-27T09:58:59.066 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-03-27T09:58:59.161 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-03-27T09:58:59.161 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-03-27T09:58:59.255 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-03-27T09:58:59.255 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-03-27T09:58:59.348 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-03-27T09:58:59.348 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-03-27T09:58:59.440 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-03-27T09:58:59.440 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-03-27T09:58:59.532 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-03-27T09:58:59.532 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-03-27T09:58:59.627 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-03-27T09:58:59.627 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-03-27T09:58:59.687 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-03-27T09:58:59.687 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-03-27T09:58:59.744 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-03-27T09:58:59.744 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-03-27T09:58:59.801 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-03-27T09:58:59.801 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-03-27T09:58:59.851 INFO:tasks.ceph:Adding keys to all mons... 2024-03-27T09:58:59.851 DEBUG:teuthology.orchestra.run.smithi057:> sudo tee -a /etc/ceph/ceph.keyring 2024-03-27T09:58:59.859 DEBUG:teuthology.orchestra.run.smithi118:> sudo tee -a /etc/ceph/ceph.keyring 2024-03-27T09:58:59.950 INFO:teuthology.orchestra.run.smithi057.stdout:[mgr.y] 2024-03-27T09:58:59.950 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQC97QNmUHKjAhAACmO/ZpBl/wFmQu91OMg5Vg== 2024-03-27T09:58:59.950 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.a] 2024-03-27T09:58:59.951 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQC97QNm1UjAHBAAM8YkW/+bFTakcW1kKXBU+w== 2024-03-27T09:58:59.951 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.c] 2024-03-27T09:58:59.951 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQC97QNm1FJDLhAANmYE6RPQZJj259837Wvbbg== 2024-03-27T09:58:59.951 INFO:teuthology.orchestra.run.smithi057.stdout:[osd.0] 2024-03-27T09:58:59.951 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQDG7QNmgzVUFxAAqHn/Eiu9z8dlUQQE6QJG0Q== 2024-03-27T09:58:59.951 INFO:teuthology.orchestra.run.smithi057.stdout:[osd.1] 2024-03-27T09:58:59.951 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQDJ7QNmyGcDMhAAExVMrJEpgSQYdexRiny27A== 2024-03-27T09:58:59.951 INFO:teuthology.orchestra.run.smithi057.stdout:[osd.2] 2024-03-27T09:58:59.951 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQDN7QNmJMb/ARAAweNIzEFo93f4kXLABJdBLg== 2024-03-27T09:58:59.951 INFO:teuthology.orchestra.run.smithi057.stdout:[osd.3] 2024-03-27T09:58:59.951 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQDQ7QNmogzCGxAABb5ed1hkOPilbImgieF/zw== 2024-03-27T09:58:59.951 INFO:teuthology.orchestra.run.smithi057.stdout:[mgr.x] 2024-03-27T09:58:59.951 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQC97QNm2V3+EBAASy4uJOAHidIFQV4TqMKshQ== 2024-03-27T09:58:59.951 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.b] 2024-03-27T09:58:59.951 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQC+7QNmrH74AxAATqJERncRRZ/yOIxIm4G0PA== 2024-03-27T09:58:59.952 INFO:teuthology.orchestra.run.smithi057.stdout:[mds.d] 2024-03-27T09:58:59.952 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQC+7QNmXshqFBAA0mWCMkVTr0RkfVWsBa76hw== 2024-03-27T09:58:59.952 INFO:teuthology.orchestra.run.smithi057.stdout:[osd.4] 2024-03-27T09:58:59.952 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQDV7QNmLL9qIBAA9Ku2Dj+std9SY009kfIX3w== 2024-03-27T09:58:59.952 INFO:teuthology.orchestra.run.smithi057.stdout:[osd.5] 2024-03-27T09:58:59.952 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQDY7QNmxu4cKhAATTznqCyjgxXx1CEhgv57Lw== 2024-03-27T09:58:59.952 INFO:teuthology.orchestra.run.smithi057.stdout:[osd.6] 2024-03-27T09:58:59.952 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQDc7QNmQbYQBxAAScmF4t9D5TmfzZs0AJ9zxw== 2024-03-27T09:58:59.952 INFO:teuthology.orchestra.run.smithi057.stdout:[osd.7] 2024-03-27T09:58:59.952 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQDf7QNmjh7WEBAAelu6kQpFXAFC6zkTCnuD3g== 2024-03-27T09:58:59.952 INFO:teuthology.orchestra.run.smithi057.stdout:[client.0] 2024-03-27T09:58:59.952 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQC+7QNmRLHcIhAAr+U/Y0Vnin6pDQmxi8Dc+g== 2024-03-27T09:58:59.952 INFO:teuthology.orchestra.run.smithi057.stdout:[client.2] 2024-03-27T09:58:59.952 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQC+7QNmnfZ8LhAAipIvyfiVbh5jCuSMdF75ug== 2024-03-27T09:58:59.952 INFO:teuthology.orchestra.run.smithi057.stdout:[client.1] 2024-03-27T09:58:59.953 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQC+7QNmqbnXORAAlFtXuvc02QPow/MTuYe9Ag== 2024-03-27T09:58:59.953 INFO:teuthology.orchestra.run.smithi057.stdout:[client.3] 2024-03-27T09:58:59.953 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQC/7QNmwo2FCRAAhH8bFuvkHmgxXyVQ5YL4NQ== 2024-03-27T09:58:59.953 INFO:teuthology.orchestra.run.smithi118.stdout:[mgr.y] 2024-03-27T09:58:59.953 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQC97QNmUHKjAhAACmO/ZpBl/wFmQu91OMg5Vg== 2024-03-27T09:58:59.953 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.a] 2024-03-27T09:58:59.953 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQC97QNm1UjAHBAAM8YkW/+bFTakcW1kKXBU+w== 2024-03-27T09:58:59.953 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.c] 2024-03-27T09:58:59.953 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQC97QNm1FJDLhAANmYE6RPQZJj259837Wvbbg== 2024-03-27T09:58:59.954 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.0] 2024-03-27T09:58:59.954 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQDG7QNmgzVUFxAAqHn/Eiu9z8dlUQQE6QJG0Q== 2024-03-27T09:58:59.954 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.1] 2024-03-27T09:58:59.954 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQDJ7QNmyGcDMhAAExVMrJEpgSQYdexRiny27A== 2024-03-27T09:58:59.954 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.2] 2024-03-27T09:58:59.954 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQDN7QNmJMb/ARAAweNIzEFo93f4kXLABJdBLg== 2024-03-27T09:58:59.954 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.3] 2024-03-27T09:58:59.954 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQDQ7QNmogzCGxAABb5ed1hkOPilbImgieF/zw== 2024-03-27T09:58:59.954 INFO:teuthology.orchestra.run.smithi118.stdout:[mgr.x] 2024-03-27T09:58:59.954 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQC97QNm2V3+EBAASy4uJOAHidIFQV4TqMKshQ== 2024-03-27T09:58:59.954 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.b] 2024-03-27T09:58:59.954 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQC+7QNmrH74AxAATqJERncRRZ/yOIxIm4G0PA== 2024-03-27T09:58:59.954 INFO:teuthology.orchestra.run.smithi118.stdout:[mds.d] 2024-03-27T09:58:59.955 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQC+7QNmXshqFBAA0mWCMkVTr0RkfVWsBa76hw== 2024-03-27T09:58:59.955 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.4] 2024-03-27T09:58:59.955 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQDV7QNmLL9qIBAA9Ku2Dj+std9SY009kfIX3w== 2024-03-27T09:58:59.955 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.5] 2024-03-27T09:58:59.955 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQDY7QNmxu4cKhAATTznqCyjgxXx1CEhgv57Lw== 2024-03-27T09:58:59.955 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.6] 2024-03-27T09:58:59.955 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQDc7QNmQbYQBxAAScmF4t9D5TmfzZs0AJ9zxw== 2024-03-27T09:58:59.955 INFO:teuthology.orchestra.run.smithi118.stdout:[osd.7] 2024-03-27T09:58:59.955 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQDf7QNmjh7WEBAAelu6kQpFXAFC6zkTCnuD3g== 2024-03-27T09:58:59.955 INFO:teuthology.orchestra.run.smithi118.stdout:[client.0] 2024-03-27T09:58:59.955 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQC+7QNmRLHcIhAAr+U/Y0Vnin6pDQmxi8Dc+g== 2024-03-27T09:58:59.955 INFO:teuthology.orchestra.run.smithi118.stdout:[client.2] 2024-03-27T09:58:59.955 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQC+7QNmnfZ8LhAAipIvyfiVbh5jCuSMdF75ug== 2024-03-27T09:58:59.955 INFO:teuthology.orchestra.run.smithi118.stdout:[client.1] 2024-03-27T09:58:59.956 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQC+7QNmqbnXORAAlFtXuvc02QPow/MTuYe9Ag== 2024-03-27T09:58:59.956 INFO:teuthology.orchestra.run.smithi118.stdout:[client.3] 2024-03-27T09:58:59.956 INFO:teuthology.orchestra.run.smithi118.stdout: key = AQC/7QNmwo2FCRAAhH8bFuvkHmgxXyVQ5YL4NQ== 2024-03-27T09:58:59.957 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-27T09:58:59.965 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-27T09:59:00.113 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-27T09:59:00.119 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-27T09:59:00.266 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-27T09:59:00.274 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-27T09:59:00.424 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-27T09:59:00.431 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-27T09:59:00.571 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-27T09:59:00.578 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-27T09:59:00.727 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-27T09:59:00.734 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-27T09:59:00.873 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-27T09:59:00.879 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-27T09:59:01.026 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-27T09:59:01.033 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-27T09:59:01.177 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-27T09:59:01.184 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-27T09:59:01.329 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-27T09:59:01.333 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-27T09:59:01.476 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-27T09:59:01.482 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-27T09:59:01.623 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-27T09:59:01.629 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-27T09:59:01.771 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-27T09:59:01.776 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-27T09:59:01.924 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-27T09:59:01.930 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-27T09:59:02.078 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-27T09:59:02.083 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-27T09:59:02.226 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-27T09:59:02.234 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-27T09:59:02.377 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-27T09:59:02.385 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-27T09:59:02.532 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-27T09:59:02.537 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-27T09:59:02.682 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-03-27T09:59:02.682 DEBUG:teuthology.orchestra.run.smithi057:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-03-27T09:59:02.769 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-27T09:59:02.944 DEBUG:teuthology.orchestra.run.smithi057:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-03-27T09:59:03.037 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-03-27T09:59:03.135 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-27T09:59:03.291 DEBUG:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-03-27T09:59:03.377 DEBUG:teuthology.orchestra.run.smithi118:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-03-27T09:59:03.473 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-27T09:59:03.630 DEBUG:teuthology.orchestra.run.smithi118:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-03-27T09:59:03.716 DEBUG:teuthology.orchestra.run.smithi057:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-03-27T09:59:03.724 DEBUG:teuthology.orchestra.run.smithi118:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-03-27T09:59:03.777 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-03-27T09:59:03.778 INFO:tasks.ceph.mon.a:Restarting daemon 2024-03-27T09:59:03.778 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-03-27T09:59:03.783 INFO:tasks.ceph.mon.a:Started 2024-03-27T09:59:03.783 INFO:tasks.ceph.mon.b:Restarting daemon 2024-03-27T09:59:03.783 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-03-27T09:59:03.789 INFO:tasks.ceph.mon.b:Started 2024-03-27T09:59:03.790 INFO:tasks.ceph.mon.c:Restarting daemon 2024-03-27T09:59:03.790 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-03-27T09:59:03.796 INFO:tasks.ceph.mon.c:Started 2024-03-27T09:59:03.796 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-03-27T09:59:03.796 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-03-27T09:59:03.797 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-03-27T09:59:03.802 INFO:tasks.ceph.mgr.y:Started 2024-03-27T09:59:03.802 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-03-27T09:59:03.802 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-03-27T09:59:03.807 INFO:tasks.ceph.mgr.x:Started 2024-03-27T09:59:03.807 INFO:tasks.ceph:Setting crush tunables to default 2024-03-27T09:59:03.807 DEBUG:teuthology.orchestra.run.smithi057:> sudo ceph --cluster ceph osd crush tunables default 2024-03-27T09:59:03.991 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:04.000+0000 7fae7de00640 1 Processor -- start 2024-03-27T09:59:03.991 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:04.000+0000 7fae7de00640 1 -- start start 2024-03-27T09:59:03.992 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:04.002+0000 7fae7de00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fae7806cf20 0x7fae78169010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:03.992 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:04.002+0000 7fae7de00640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae780cfe40 con 0x7fae78161950 2024-03-27T09:59:03.993 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:04.002+0000 7fae7de00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae78161d30 con 0x7fae780d3770 2024-03-27T09:59:03.993 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:04.002+0000 7fae7de00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fae780d0f10 con 0x7fae7806cf20 2024-03-27T09:59:03.993 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:04.002+0000 7fae7ca00640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fae78161950 0x7fae780ceb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:39354/0 (socket says 172.21.15.57:39354) 2024-03-27T09:59:03.993 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:04.002+0000 7fae7ca00640 1 -- 172.21.15.57:0/2014240622 learned_addr learned my addr 172.21.15.57:0/2014240622 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T09:59:03.993 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:04.002+0000 7fae7d400640 1 --2- 172.21.15.57:0/2014240622 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fae7806cf20 0x7fae78169010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:03.993 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:04.003+0000 7fae7d400640 1 -- 172.21.15.57:0/2014240622 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fae7806cf20 msgr2=0x7fae78169010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-03-27T09:59:03.994 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:04.003+0000 7fae7d400640 1 -- 172.21.15.57:0/2014240622 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fae7806cf20 msgr2=0x7fae78169010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-27T09:59:03.994 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:04.003+0000 7fae7d400640 1 --2- 172.21.15.57:0/2014240622 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fae7806cf20 0x7fae78169010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-27T09:59:03.994 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:04.003+0000 7fae7d400640 1 --2- 172.21.15.57:0/2014240622 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fae7806cf20 0x7fae78169010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-27T09:59:04.040 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:04.049+0000 7fae77400640 1 -- 172.21.15.57:0/2014240622 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1012326491 0 0) 0x7fae78161d30 con 0x7fae780d3770 2024-03-27T09:59:04.041 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:04.049+0000 7fae77400640 1 -- 172.21.15.57:0/2014240622 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fae60003520 con 0x7fae780d3770 2024-03-27T09:59:04.041 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:04.049+0000 7fae77400640 1 -- 172.21.15.57:0/2014240622 <== mon.1 v1:172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3578072189 0 0) 0x7fae60003520 con 0x7fae780d3770 2024-03-27T09:59:04.041 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:04.049+0000 7fae77400640 1 -- 172.21.15.57:0/2014240622 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fae7806cf20 msgr2=0x7fae78169010 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-27T09:59:04.041 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:04.049+0000 7fae77400640 1 --2- 172.21.15.57:0/2014240622 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fae7806cf20 0x7fae78169010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:04.041 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:04.049+0000 7fae77400640 1 -- 172.21.15.57:0/2014240622 >> v1:172.21.15.57:6789/0 conn(0x7fae78161950 legacy=0x7fae780ceb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:04.041 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:04.050+0000 7fae77400640 1 -- 172.21.15.57:0/2014240622 --> v1:172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae780d11f0 con 0x7fae780d3770 2024-03-27T09:59:04.041 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:04.050+0000 7fae77400640 1 -- 172.21.15.57:0/2014240622 <== mon.1 v1:172.21.15.118:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4227751516 0 0) 0x7fae64001670 con 0x7fae780d3770 2024-03-27T09:59:04.041 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:04.050+0000 7fae77400640 1 -- 172.21.15.57:0/2014240622 >> v1:172.21.15.118:6789/0 conn(0x7fae780d3770 legacy=0x7fae780cf210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:04.041 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:04.050+0000 7fae77400640 1 --2- 172.21.15.57:0/2014240622 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fae600039b0 0x7fae60003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:04.041 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:04.050+0000 7fae77400640 1 --2- 172.21.15.57:0/2014240622 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fae7806cf20 0x7fae60004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:04.041 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:04.050+0000 7fae77400640 1 --2- 172.21.15.57:0/2014240622 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fae60004d40 0x7fae600051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:04.041 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:04.050+0000 7fae77400640 1 -- 172.21.15.57:0/2014240622 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fae780d0f10 con 0x7fae60004d40 2024-03-27T09:59:04.041 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:04.050+0000 7fae77400640 1 -- 172.21.15.57:0/2014240622 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fae6000baa0 con 0x7fae600039b0 2024-03-27T09:59:04.041 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:04.050+0000 7fae77400640 1 -- 172.21.15.57:0/2014240622 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fae6000bca0 con 0x7fae7806cf20 2024-03-27T09:59:04.042 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:04.050+0000 7fae7ca00640 1 --2- 172.21.15.57:0/2014240622 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fae600039b0 0x7fae60003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:04.042 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:04.051+0000 7fae7d400640 1 --2- 172.21.15.57:0/2014240622 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fae60004d40 0x7fae600051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:04.042 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:04.051+0000 7fae77e00640 1 --2- 172.21.15.57:0/2014240622 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fae7806cf20 0x7fae60004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:04.042 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:04.051+0000 7fae7d400640 1 -- 172.21.15.57:0/2014240622 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fae7806cf20 msgr2=0x7fae60004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T09:59:04.043 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:04.051+0000 7fae7d400640 1 --2- 172.21.15.57:0/2014240622 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fae7806cf20 0x7fae60004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:04.043 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:04.051+0000 7fae7d400640 1 -- 172.21.15.57:0/2014240622 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fae600039b0 msgr2=0x7fae60003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T09:59:04.043 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:04.051+0000 7fae7d400640 1 --2- 172.21.15.57:0/2014240622 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fae600039b0 0x7fae60003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:04.043 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:04.051+0000 7fae7d400640 1 -- 172.21.15.57:0/2014240622 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae60003520 con 0x7fae60004d40 2024-03-27T09:59:04.043 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:04.053+0000 7fae7d400640 1 --2- 172.21.15.57:0/2014240622 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fae60004d40 0x7fae600051c0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fae70009610 tx=0x7fae60005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7763a97b828af2e8 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:04.044 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:04.053+0000 7fae77400640 1 -- 172.21.15.57:0/2014240622 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae70039070 con 0x7fae60004d40 2024-03-27T09:59:04.044 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:04.053+0000 7fae77400640 1 -- 172.21.15.57:0/2014240622 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae7002cc70 con 0x7fae60004d40 2024-03-27T09:59:04.044 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:04.053+0000 7fae77400640 1 -- 172.21.15.57:0/2014240622 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae70009bd0 con 0x7fae60004d40 2024-03-27T09:59:04.045 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:04.054+0000 7fae7de00640 1 -- 172.21.15.57:0/2014240622 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fae60004d40 msgr2=0x7fae600051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:04.045 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:04.054+0000 7fae7de00640 1 --2- 172.21.15.57:0/2014240622 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fae60004d40 0x7fae600051c0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fae70009610 tx=0x7fae60005830 comp rx=0 tx=0).stop 2024-03-27T09:59:04.045 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:04.054+0000 7fae7d400640 1 -- 172.21.15.57:0/2014240622 reap_dead start 2024-03-27T09:59:04.045 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:04.054+0000 7fae7de00640 1 -- 172.21.15.57:0/2014240622 shutdown_connections 2024-03-27T09:59:04.045 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:04.054+0000 7fae7de00640 1 -- 172.21.15.57:0/2014240622 >> 172.21.15.57:0/2014240622 conn(0x7fae780d3fc0 msgr2=0x7fae780d43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:04.045 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:04.054+0000 7fae7de00640 1 -- 172.21.15.57:0/2014240622 shutdown_connections 2024-03-27T09:59:04.045 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:04.054+0000 7fae7de00640 1 -- 172.21.15.57:0/2014240622 wait complete. 2024-03-27T09:59:04.053 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:04.056+0000 7fae7de00640 1 Processor -- start 2024-03-27T09:59:04.053 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:04.057+0000 7fae7de00640 1 -- start start 2024-03-27T09:59:04.053 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:04.058+0000 7fae7de00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fae60004d40 0x7fae78150c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:04.053 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:04.058+0000 7fae7de00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fae7815ea70 0x7fae780cc3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:04.053 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:04.058+0000 7fae7de00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fae7815eef0 0x7fae7814f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:04.053 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:04.058+0000 7fae7de00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fae780d2240 con 0x7fae60004d40 2024-03-27T09:59:04.053 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:04.058+0000 7fae7de00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fae780d1f60 con 0x7fae7815ea70 2024-03-27T09:59:04.053 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:04.058+0000 7fae7de00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fae780cf920 con 0x7fae7815eef0 2024-03-27T09:59:04.053 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:04.058+0000 7fae77e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fae7815ea70 0x7fae780cc3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:04.053 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:04.058+0000 7fae7ca00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fae60004d40 0x7fae78150c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:04.053 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:04.058+0000 7fae7ca00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fae60004d40 0x7fae78150c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55110/0 (socket says 172.21.15.57:55110) 2024-03-27T09:59:04.053 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:04.058+0000 7fae77e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fae7815ea70 0x7fae780cc3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.57:48288/0 (socket says 172.21.15.57:48288) 2024-03-27T09:59:04.054 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:04.058+0000 7fae7ca00640 1 -- 172.21.15.57:0/3454401204 learned_addr learned my addr 172.21.15.57:0/3454401204 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T09:59:04.054 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:04.058+0000 7fae7d400640 1 --2- 172.21.15.57:0/3454401204 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fae7815eef0 0x7fae7814f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:04.054 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:04.059+0000 7fae7ca00640 1 -- 172.21.15.57:0/3454401204 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fae7815eef0 msgr2=0x7fae7814f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:04.054 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:04.059+0000 7fae7ca00640 1 --2- 172.21.15.57:0/3454401204 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fae7815eef0 0x7fae7814f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:04.054 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:04.059+0000 7fae7ca00640 1 -- 172.21.15.57:0/3454401204 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fae7815ea70 msgr2=0x7fae780cc3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:04.054 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:04.059+0000 7fae7ca00640 1 --2- 172.21.15.57:0/3454401204 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fae7815ea70 0x7fae780cc3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:04.054 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:04.059+0000 7fae7ca00640 1 -- 172.21.15.57:0/3454401204 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae78151180 con 0x7fae60004d40 2024-03-27T09:59:04.054 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:04.059+0000 7fae7ca00640 1 --2- 172.21.15.57:0/3454401204 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fae60004d40 0x7fae78150c40 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fae6c001430 tx=0x7fae6c0018f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:04.054 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:04.059+0000 7fae74c00640 1 -- 172.21.15.57:0/3454401204 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae6c00f660 con 0x7fae60004d40 2024-03-27T09:59:04.054 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:04.059+0000 7fae74c00640 1 -- 172.21.15.57:0/3454401204 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae6c018070 con 0x7fae60004d40 2024-03-27T09:59:04.054 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:04.059+0000 7fae74c00640 1 -- 172.21.15.57:0/3454401204 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae6c00fa40 con 0x7fae60004d40 2024-03-27T09:59:04.054 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:04.060+0000 7fae7de00640 1 -- 172.21.15.57:0/3454401204 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae7814e640 con 0x7fae60004d40 2024-03-27T09:59:04.054 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:04.060+0000 7fae7de00640 1 -- 172.21.15.57:0/3454401204 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae7814ec00 con 0x7fae60004d40 2024-03-27T09:59:04.054 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:04.060+0000 7fae74c00640 1 -- 172.21.15.57:0/3454401204 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fae6c00fbe0 con 0x7fae60004d40 2024-03-27T09:59:04.054 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:04.060+0000 7fae74c00640 1 -- 172.21.15.57:0/3454401204 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fae6c013430 con 0x7fae60004d40 2024-03-27T09:59:04.055 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:04.061+0000 7fae7de00640 1 -- 172.21.15.57:0/3454401204 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae78068540 con 0x7fae60004d40 2024-03-27T09:59:04.055 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:04.064+0000 7fae74c00640 1 -- 172.21.15.57:0/3454401204 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fae6c01d460 con 0x7fae60004d40 2024-03-27T09:59:04.129 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:04.138+0000 7fae7de00640 1 -- 172.21.15.57:0/3454401204 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fae780cfee0 con 0x7fae60004d40 2024-03-27T09:59:04.135 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:04.145+0000 7fae74c00640 1 -- 172.21.15.57:0/3454401204 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7fae6c01d640 con 0x7fae60004d40 2024-03-27T09:59:04.135 INFO:teuthology.orchestra.run.smithi057.stderr:adjusted tunables profile to default 2024-03-27T09:59:04.137 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:04.146+0000 7fae7de00640 1 -- 172.21.15.57:0/3454401204 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fae60004d40 msgr2=0x7fae78150c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:04.137 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:04.146+0000 7fae7de00640 1 --2- 172.21.15.57:0/3454401204 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fae60004d40 0x7fae78150c40 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fae6c001430 tx=0x7fae6c0018f0 comp rx=0 tx=0).stop 2024-03-27T09:59:04.137 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:04.146+0000 7fae7de00640 1 -- 172.21.15.57:0/3454401204 shutdown_connections 2024-03-27T09:59:04.137 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:04.146+0000 7fae7de00640 1 --2- 172.21.15.57:0/3454401204 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fae7815eef0 0x7fae7814f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:04.137 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:04.146+0000 7fae7de00640 1 --2- 172.21.15.57:0/3454401204 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fae7815ea70 0x7fae780cc3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:04.137 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:04.146+0000 7fae7de00640 1 --2- 172.21.15.57:0/3454401204 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fae60004d40 0x7fae78150c40 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:04.137 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:04.146+0000 7fae7de00640 1 -- 172.21.15.57:0/3454401204 >> 172.21.15.57:0/3454401204 conn(0x7fae780d3fc0 msgr2=0x7fae78160250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:04.137 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:04.146+0000 7fae7de00640 1 -- 172.21.15.57:0/3454401204 shutdown_connections 2024-03-27T09:59:04.137 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:04.146+0000 7fae7de00640 1 -- 172.21.15.57:0/3454401204 wait complete. 2024-03-27T09:59:04.154 INFO:tasks.ceph:check_enable_crimson: False 2024-03-27T09:59:04.155 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-03-27T09:59:04.155 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-03-27T09:59:04.155 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-03-27T09:59:04.238 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-03-27T09:59:04.238 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-03-27T09:59:04.370 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-03-27T09:59:04.370 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-03-27T09:59:04.451 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-03-27T09:59:04.451 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-03-27T09:59:04.586 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-03-27T09:59:04.586 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-03-27T09:59:04.667 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-03-27T09:59:04.667 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-03-27T09:59:04.667 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-03-27T09:59:04.676+0000 7f26d2616040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-27T09:59:04.736 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-03-27T09:59:04.745+0000 7f26d2616040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-27T09:59:04.794 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-03-27T09:59:04.794 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-03-27T09:59:04.804 INFO:tasks.ceph.mgr.x.smithi118.stderr:2024-03-27T09:59:04.815+0000 7fc2fb02b040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-27T09:59:04.870 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-03-27T09:59:04.870 DEBUG:teuthology.orchestra.run.smithi118:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-03-27T09:59:04.874 INFO:tasks.ceph.mgr.x.smithi118.stderr:2024-03-27T09:59:04.884+0000 7fc2fb02b040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-27T09:59:04.954 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph osd new 47b44362-7302-4f2a-b735-582c6c3850cf 0 2024-03-27T09:59:05.184 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.194+0000 7f02afc00640 1 Processor -- start 2024-03-27T09:59:05.184 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.194+0000 7f02afc00640 1 -- start start 2024-03-27T09:59:05.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.195+0000 7f02afc00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f02a8072680 0x7f02a80711b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:05.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.195+0000 7f02afc00640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02a80ae520 con 0x7f02a815b3b0 2024-03-27T09:59:05.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.195+0000 7f02afc00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02a80ae800 con 0x7f02a815afd0 2024-03-27T09:59:05.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.196+0000 7f02afc00640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f02a80aeae0 con 0x7f02a8072680 2024-03-27T09:59:05.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.196+0000 7f02ad200640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f02a815afd0 0x7f02a8071f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:54890/0 (socket says 172.21.15.118:54890) 2024-03-27T09:59:05.186 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.196+0000 7f02ad200640 1 -- 172.21.15.118:0/2730707288 learned_addr learned my addr 172.21.15.118:0/2730707288 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-03-27T09:59:05.189 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.196+0000 7f02a7e00640 1 --2- 172.21.15.118:0/2730707288 >> v2:172.21.15.57:3300/0 conn(0x7f02a8072680 0x7f02a80711b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:05.189 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.196+0000 7f02a7400640 1 -- 172.21.15.118:0/2730707288 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 64619640 0 0) 0x7f02a80ae800 con 0x7f02a815afd0 2024-03-27T09:59:05.189 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.196+0000 7f02a7400640 1 -- 172.21.15.118:0/2730707288 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0290003520 con 0x7f02a815afd0 2024-03-27T09:59:05.189 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.196+0000 7f02a7400640 1 -- 172.21.15.118:0/2730707288 <== mon.1 v1:172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3281554273 0 0) 0x7f0290003520 con 0x7f02a815afd0 2024-03-27T09:59:05.189 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.197+0000 7f02a7400640 1 -- 172.21.15.118:0/2730707288 >> v2:172.21.15.57:3300/0 conn(0x7f02a8072680 msgr2=0x7f02a80711b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T09:59:05.189 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.197+0000 7f02a7400640 1 --2- 172.21.15.118:0/2730707288 >> v2:172.21.15.57:3300/0 conn(0x7f02a8072680 0x7f02a80711b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:05.189 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.197+0000 7f02a7400640 1 -- 172.21.15.118:0/2730707288 >> v1:172.21.15.57:6789/0 conn(0x7f02a815b3b0 legacy=0x7f02a80b2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:05.189 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.197+0000 7f02a7400640 1 -- 172.21.15.118:0/2730707288 --> v1:172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02a80aedc0 con 0x7f02a815afd0 2024-03-27T09:59:05.189 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.197+0000 7f02a7400640 1 -- 172.21.15.118:0/2730707288 <== mon.1 v1:172.21.15.118:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4227751516 0 0) 0x7f029c001670 con 0x7f02a815afd0 2024-03-27T09:59:05.189 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.197+0000 7f02a7400640 1 -- 172.21.15.118:0/2730707288 >> v1:172.21.15.118:6789/0 conn(0x7f02a815afd0 legacy=0x7f02a8071f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:05.189 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.197+0000 7f02a7400640 1 --2- 172.21.15.118:0/2730707288 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0290003a00 0x7f0290003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:05.189 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.197+0000 7f02a7400640 1 --2- 172.21.15.118:0/2730707288 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0290004800 0x7f0290004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:05.190 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.197+0000 7f02a7400640 1 --2- 172.21.15.118:0/2730707288 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02900051c0 0x7f029000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:05.190 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.197+0000 7f02a7400640 1 -- 172.21.15.118:0/2730707288 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f02a80aeae0 con 0x7f0290003a00 2024-03-27T09:59:05.190 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.197+0000 7f02a7400640 1 -- 172.21.15.118:0/2730707288 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f029000c0a0 con 0x7f02900051c0 2024-03-27T09:59:05.190 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.197+0000 7f02a7400640 1 -- 172.21.15.118:0/2730707288 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f029000c2a0 con 0x7f0290004800 2024-03-27T09:59:05.190 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.197+0000 7f02a7e00640 1 --2- 172.21.15.118:0/2730707288 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0290004800 0x7f0290004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:05.190 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.197+0000 7f02adc00640 1 --2- 172.21.15.118:0/2730707288 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02900051c0 0x7f029000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:05.190 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.197+0000 7f02ad200640 1 --2- 172.21.15.118:0/2730707288 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0290003a00 0x7f0290003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:05.190 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.197+0000 7f02a7e00640 1 -- 172.21.15.118:0/2730707288 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02900051c0 msgr2=0x7f029000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T09:59:05.190 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.197+0000 7f02a7e00640 1 --2- 172.21.15.118:0/2730707288 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02900051c0 0x7f029000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:05.190 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.197+0000 7f02a7e00640 1 -- 172.21.15.118:0/2730707288 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0290003a00 msgr2=0x7f0290003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T09:59:05.190 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.197+0000 7f02a7e00640 1 --2- 172.21.15.118:0/2730707288 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0290003a00 0x7f0290003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:05.190 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.197+0000 7f02a7e00640 1 -- 172.21.15.118:0/2730707288 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0290003520 con 0x7f0290004800 2024-03-27T09:59:05.190 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.198+0000 7f02adc00640 1 -- 172.21.15.118:0/2730707288 reap_dead start 2024-03-27T09:59:05.190 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.199+0000 7f02a7e00640 1 --2- 172.21.15.118:0/2730707288 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0290004800 0x7f0290004c80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0294009a90 tx=0x7f0290005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6268289f3ee6c825 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:05.191 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.199+0000 7f02a7400640 1 -- 172.21.15.118:0/2730707288 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0294039070 con 0x7f0290004800 2024-03-27T09:59:05.191 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.199+0000 7f02a7400640 1 -- 172.21.15.118:0/2730707288 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f029402c680 con 0x7f0290004800 2024-03-27T09:59:05.191 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.199+0000 7f02a7400640 1 -- 172.21.15.118:0/2730707288 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0294009690 con 0x7f0290004800 2024-03-27T09:59:05.191 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.199+0000 7f02afc00640 1 -- 172.21.15.118:0/2730707288 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0290004800 msgr2=0x7f0290004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:05.192 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.199+0000 7f02afc00640 1 --2- 172.21.15.118:0/2730707288 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0290004800 0x7f0290004c80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0294009a90 tx=0x7f0290005830 comp rx=0 tx=0).stop 2024-03-27T09:59:05.192 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.200+0000 7f02afc00640 1 -- 172.21.15.118:0/2730707288 shutdown_connections 2024-03-27T09:59:05.192 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.200+0000 7f02afc00640 1 --2- 172.21.15.118:0/2730707288 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0290004800 0x7f0290004c80 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:05.192 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.200+0000 7f02afc00640 1 -- 172.21.15.118:0/2730707288 >> 172.21.15.118:0/2730707288 conn(0x7f02a80b18a0 msgr2=0x7f02a80b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:05.192 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.200+0000 7f02afc00640 1 -- 172.21.15.118:0/2730707288 shutdown_connections 2024-03-27T09:59:05.192 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.200+0000 7f02afc00640 1 -- 172.21.15.118:0/2730707288 wait complete. 2024-03-27T09:59:05.192 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.201+0000 7f02afc00640 1 Processor -- start 2024-03-27T09:59:05.192 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.202+0000 7f02afc00640 1 -- start start 2024-03-27T09:59:05.194 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.202+0000 7f02afc00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0290004800 0x7f02a809d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:05.194 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.202+0000 7f02afc00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f02a809ba80 0x7f02a80af520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:05.194 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.202+0000 7f02afc00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02a814d540 0x7f02a814d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:05.194 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.202+0000 7f02afc00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f02a8072300 con 0x7f02a809ba80 2024-03-27T09:59:05.194 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.202+0000 7f02afc00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f02a8072180 con 0x7f02a814d540 2024-03-27T09:59:05.194 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.202+0000 7f02afc00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f02a8072480 con 0x7f0290004800 2024-03-27T09:59:05.194 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.203+0000 7f02ad200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0290004800 0x7f02a809d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:05.194 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.203+0000 7f02ad200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0290004800 0x7f02a809d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.118:47822/0 (socket says 172.21.15.118:47822) 2024-03-27T09:59:05.195 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.203+0000 7f02ad200640 1 -- 172.21.15.118:0/2466593587 learned_addr learned my addr 172.21.15.118:0/2466593587 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-27T09:59:05.195 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.203+0000 7f02adc00640 1 --2- 172.21.15.118:0/2466593587 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02a814d540 0x7f02a814d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:05.195 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.203+0000 7f02a7e00640 1 --2- 172.21.15.118:0/2466593587 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f02a809ba80 0x7f02a80af520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:05.195 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.203+0000 7f02ad200640 1 -- 172.21.15.118:0/2466593587 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02a814d540 msgr2=0x7f02a814d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:05.195 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.203+0000 7f02ad200640 1 --2- 172.21.15.118:0/2466593587 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02a814d540 0x7f02a814d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:05.195 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.203+0000 7f02ad200640 1 -- 172.21.15.118:0/2466593587 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f02a809ba80 msgr2=0x7f02a80af520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:05.195 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.203+0000 7f02ad200640 1 --2- 172.21.15.118:0/2466593587 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f02a809ba80 0x7f02a80af520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:05.195 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.203+0000 7f02ad200640 1 -- 172.21.15.118:0/2466593587 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02a809bfb0 con 0x7f0290004800 2024-03-27T09:59:05.195 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.203+0000 7f02ad200640 1 --2- 172.21.15.118:0/2466593587 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0290004800 0x7f02a809d820 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f029c00e780 tx=0x7f029c00eb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:05.195 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.204+0000 7f02a4c00640 1 -- 172.21.15.118:0/2466593587 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f029c00c660 con 0x7f0290004800 2024-03-27T09:59:05.195 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.204+0000 7f02a4c00640 1 -- 172.21.15.118:0/2466593587 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f029c018070 con 0x7f0290004800 2024-03-27T09:59:05.195 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.204+0000 7f02afc00640 1 -- 172.21.15.118:0/2466593587 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02a809c290 con 0x7f0290004800 2024-03-27T09:59:05.195 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.204+0000 7f02a4c00640 1 -- 172.21.15.118:0/2466593587 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f029c00ca40 con 0x7f0290004800 2024-03-27T09:59:05.195 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.204+0000 7f02afc00640 1 -- 172.21.15.118:0/2466593587 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f02a809c850 con 0x7f0290004800 2024-03-27T09:59:05.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.204+0000 7f02a4c00640 1 -- 172.21.15.118:0/2466593587 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f029c013420 con 0x7f0290004800 2024-03-27T09:59:05.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.204+0000 7f02a4c00640 1 -- 172.21.15.118:0/2466593587 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f029c01c6e0 con 0x7f0290004800 2024-03-27T09:59:05.196 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.205+0000 7f02afc00640 1 -- 172.21.15.118:0/2466593587 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02a8068540 con 0x7f0290004800 2024-03-27T09:59:05.197 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.208+0000 7f02a4c00640 1 -- 172.21.15.118:0/2466593587 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f029c0138f0 con 0x7f0290004800 2024-03-27T09:59:05.278 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.287+0000 7f02afc00640 1 -- 172.21.15.118:0/2466593587 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "osd new", "uuid": "47b44362-7302-4f2a-b735-582c6c3850cf", "id": 0} v 0) -- 0x7f02a806d9f0 con 0x7f0290004800 2024-03-27T09:59:05.285 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.295+0000 7f02a4c00640 1 -- 172.21.15.118:0/2466593587 <== mon.2 v2:172.21.15.118:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "47b44362-7302-4f2a-b735-582c6c3850cf", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f029c013ad0 con 0x7f0290004800 2024-03-27T09:59:05.285 INFO:teuthology.orchestra.run.smithi118.stdout:0 2024-03-27T09:59:05.287 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.296+0000 7f02afc00640 1 -- 172.21.15.118:0/2466593587 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0290004800 msgr2=0x7f02a809d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:05.287 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.296+0000 7f02afc00640 1 --2- 172.21.15.118:0/2466593587 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0290004800 0x7f02a809d820 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f029c00e780 tx=0x7f029c00eb80 comp rx=0 tx=0).stop 2024-03-27T09:59:05.287 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.296+0000 7f02afc00640 1 -- 172.21.15.118:0/2466593587 shutdown_connections 2024-03-27T09:59:05.287 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.296+0000 7f02afc00640 1 --2- 172.21.15.118:0/2466593587 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02a814d540 0x7f02a814d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:05.287 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.296+0000 7f02afc00640 1 --2- 172.21.15.118:0/2466593587 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f02a809ba80 0x7f02a80af520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:05.287 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.296+0000 7f02afc00640 1 --2- 172.21.15.118:0/2466593587 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0290004800 0x7f02a809d820 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:05.287 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.296+0000 7f02afc00640 1 -- 172.21.15.118:0/2466593587 >> 172.21.15.118:0/2466593587 conn(0x7f02a80b18a0 msgr2=0x7f02a806e1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:05.287 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.297+0000 7f02afc00640 1 -- 172.21.15.118:0/2466593587 shutdown_connections 2024-03-27T09:59:05.287 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.297+0000 7f02afc00640 1 -- 172.21.15.118:0/2466593587 wait complete. 2024-03-27T09:59:05.304 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph osd new feaf96f0-9431-4188-9a09-da505b40e934 1 2024-03-27T09:59:05.363 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-03-27T09:59:05.373+0000 7f26d2616040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-27T09:59:05.430 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-03-27T09:59:05.440+0000 7f26d2616040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-27T09:59:05.485 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-03-27T09:59:05.495+0000 7f26d2616040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-27T09:59:05.494 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.504+0000 7f0e2e200640 1 Processor -- start 2024-03-27T09:59:05.494 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.505+0000 7f0e2e200640 1 -- start start 2024-03-27T09:59:05.496 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.506+0000 7f0e2e200640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0e280d4b30 0x7f0e280d0770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:05.497 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.506+0000 7f0e2e200640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e280cfcd0 con 0x7f0e280d0cb0 2024-03-27T09:59:05.497 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.506+0000 7f0e2e200640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e280cffa0 con 0x7f0e280b52b0 2024-03-27T09:59:05.497 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.506+0000 7f0e2e200640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f0e280c8390 con 0x7f0e280d4b30 2024-03-27T09:59:05.497 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.506+0000 7f0e2ce00640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f0e280b52b0 0x7f0e280cf5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:54904/0 (socket says 172.21.15.118:54904) 2024-03-27T09:59:05.497 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.506+0000 7f0e2ce00640 1 -- 172.21.15.118:0/127472758 learned_addr learned my addr 172.21.15.118:0/127472758 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-03-27T09:59:05.497 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.507+0000 7f0e27e00640 1 --2- 172.21.15.118:0/127472758 >> v2:172.21.15.57:3300/0 conn(0x7f0e280d4b30 0x7f0e280d0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:05.497 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.507+0000 7f0e27400640 1 -- 172.21.15.118:0/127472758 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 790729591 0 0) 0x7f0e280cffa0 con 0x7f0e280b52b0 2024-03-27T09:59:05.497 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.507+0000 7f0e27400640 1 -- 172.21.15.118:0/127472758 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0e10003520 con 0x7f0e280b52b0 2024-03-27T09:59:05.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.507+0000 7f0e27400640 1 -- 172.21.15.118:0/127472758 <== mon.1 v1:172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2256548170 0 0) 0x7f0e10003520 con 0x7f0e280b52b0 2024-03-27T09:59:05.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.507+0000 7f0e27400640 1 -- 172.21.15.118:0/127472758 >> v2:172.21.15.57:3300/0 conn(0x7f0e280d4b30 msgr2=0x7f0e280d0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T09:59:05.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.507+0000 7f0e27400640 1 --2- 172.21.15.118:0/127472758 >> v2:172.21.15.57:3300/0 conn(0x7f0e280d4b30 0x7f0e280d0770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:05.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.507+0000 7f0e27400640 1 -- 172.21.15.118:0/127472758 >> v1:172.21.15.57:6789/0 conn(0x7f0e280d0cb0 legacy=0x7f0e2815db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:05.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.507+0000 7f0e27400640 1 -- 172.21.15.118:0/127472758 --> v1:172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e280c7a60 con 0x7f0e280b52b0 2024-03-27T09:59:05.499 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.507+0000 7f0e27400640 1 -- 172.21.15.118:0/127472758 <== mon.1 v1:172.21.15.118:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4227751516 0 0) 0x7f0e1c001670 con 0x7f0e280b52b0 2024-03-27T09:59:05.500 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.507+0000 7f0e27400640 1 -- 172.21.15.118:0/127472758 >> v1:172.21.15.118:6789/0 conn(0x7f0e280b52b0 legacy=0x7f0e280cf5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:05.500 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.507+0000 7f0e27400640 1 --2- 172.21.15.118:0/127472758 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0e100039b0 0x7f0e10003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:05.500 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.507+0000 7f0e27400640 1 --2- 172.21.15.118:0/127472758 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0e10004800 0x7f0e10004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:05.500 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.507+0000 7f0e27400640 1 --2- 172.21.15.118:0/127472758 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0e100051c0 0x7f0e1000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:05.500 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.507+0000 7f0e27400640 1 -- 172.21.15.118:0/127472758 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f0e280c8390 con 0x7f0e10004800 2024-03-27T09:59:05.500 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.507+0000 7f0e27400640 1 -- 172.21.15.118:0/127472758 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f0e1000c160 con 0x7f0e100051c0 2024-03-27T09:59:05.500 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.507+0000 7f0e27400640 1 -- 172.21.15.118:0/127472758 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f0e1000c360 con 0x7f0e100039b0 2024-03-27T09:59:05.500 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.507+0000 7f0e2ce00640 1 --2- 172.21.15.118:0/127472758 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0e100039b0 0x7f0e10003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:05.500 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.508+0000 7f0e2d800640 1 --2- 172.21.15.118:0/127472758 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0e100051c0 0x7f0e1000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:05.500 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.508+0000 7f0e27e00640 1 --2- 172.21.15.118:0/127472758 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0e10004800 0x7f0e10004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:05.500 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.508+0000 7f0e2ce00640 1 -- 172.21.15.118:0/127472758 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0e100051c0 msgr2=0x7f0e1000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T09:59:05.500 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.508+0000 7f0e2ce00640 1 --2- 172.21.15.118:0/127472758 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0e100051c0 0x7f0e1000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:05.500 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.508+0000 7f0e2ce00640 1 -- 172.21.15.118:0/127472758 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0e10004800 msgr2=0x7f0e10004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T09:59:05.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.508+0000 7f0e2ce00640 1 --2- 172.21.15.118:0/127472758 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0e10004800 0x7f0e10004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:05.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.508+0000 7f0e2ce00640 1 -- 172.21.15.118:0/127472758 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e10003520 con 0x7f0e100039b0 2024-03-27T09:59:05.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.508+0000 7f0e2d800640 1 -- 172.21.15.118:0/127472758 reap_dead start 2024-03-27T09:59:05.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.509+0000 7f0e2ce00640 1 --2- 172.21.15.118:0/127472758 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0e100039b0 0x7f0e10003dd0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c00c210 tx=0x7f0e10005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23d9e2ff5c24c2c8 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:05.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.509+0000 7f0e27400640 1 -- 172.21.15.118:0/127472758 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e1c007d30 con 0x7f0e100039b0 2024-03-27T09:59:05.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.509+0000 7f0e27400640 1 -- 172.21.15.118:0/127472758 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e1c030070 con 0x7f0e100039b0 2024-03-27T09:59:05.501 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.509+0000 7f0e27400640 1 -- 172.21.15.118:0/127472758 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e1c005d70 con 0x7f0e100039b0 2024-03-27T09:59:05.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.510+0000 7f0e2e200640 1 -- 172.21.15.118:0/127472758 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0e100039b0 msgr2=0x7f0e10003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:05.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.510+0000 7f0e2e200640 1 --2- 172.21.15.118:0/127472758 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0e100039b0 0x7f0e10003dd0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c00c210 tx=0x7f0e10005830 comp rx=0 tx=0).stop 2024-03-27T09:59:05.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.510+0000 7f0e2e200640 1 -- 172.21.15.118:0/127472758 shutdown_connections 2024-03-27T09:59:05.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.510+0000 7f0e2e200640 1 --2- 172.21.15.118:0/127472758 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0e100039b0 0x7f0e10003dd0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:05.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.510+0000 7f0e2e200640 1 -- 172.21.15.118:0/127472758 >> 172.21.15.118:0/127472758 conn(0x7f0e280d3f10 msgr2=0x7f0e280d4320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:05.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.510+0000 7f0e2e200640 1 -- 172.21.15.118:0/127472758 shutdown_connections 2024-03-27T09:59:05.502 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.510+0000 7f0e2e200640 1 -- 172.21.15.118:0/127472758 wait complete. 2024-03-27T09:59:05.503 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.512+0000 7f0e2e200640 1 Processor -- start 2024-03-27T09:59:05.503 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.513+0000 7f0e2e200640 1 -- start start 2024-03-27T09:59:05.505 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.514+0000 7f0e2e200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0e100039b0 0x7f0e281e74e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:05.506 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.514+0000 7f0e2e200640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0e281e7a20 0x7f0e280b7b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:05.506 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.514+0000 7f0e2e200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0e280b80c0 0x7f0e281f31e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:05.506 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.514+0000 7f0e2e200640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f0e280b5690 con 0x7f0e281e7a20 2024-03-27T09:59:05.506 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.514+0000 7f0e2e200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f0e280c8020 con 0x7f0e280b80c0 2024-03-27T09:59:05.506 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.514+0000 7f0e2e200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f0e280b5810 con 0x7f0e100039b0 2024-03-27T09:59:05.506 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.514+0000 7f0e2ce00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0e100039b0 0x7f0e281e74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:05.506 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.514+0000 7f0e2ce00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0e100039b0 0x7f0e281e74e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.118:47842/0 (socket says 172.21.15.118:47842) 2024-03-27T09:59:05.506 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.514+0000 7f0e2ce00640 1 -- 172.21.15.118:0/1594912465 learned_addr learned my addr 172.21.15.118:0/1594912465 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-27T09:59:05.506 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.514+0000 7f0e2d800640 1 --2- 172.21.15.118:0/1594912465 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0e280b80c0 0x7f0e281f31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:05.506 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.514+0000 7f0e27e00640 1 --2- 172.21.15.118:0/1594912465 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0e281e7a20 0x7f0e280b7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:05.506 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.515+0000 7f0e2ce00640 1 -- 172.21.15.118:0/1594912465 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0e280b80c0 msgr2=0x7f0e281f31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:05.506 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.515+0000 7f0e2ce00640 1 --2- 172.21.15.118:0/1594912465 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0e280b80c0 0x7f0e281f31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:05.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.515+0000 7f0e2ce00640 1 -- 172.21.15.118:0/1594912465 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0e281e7a20 msgr2=0x7f0e280b7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:05.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.515+0000 7f0e2ce00640 1 --2- 172.21.15.118:0/1594912465 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0e281e7a20 0x7f0e280b7b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:05.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.515+0000 7f0e2ce00640 1 -- 172.21.15.118:0/1594912465 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e281f82c0 con 0x7f0e100039b0 2024-03-27T09:59:05.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.515+0000 7f0e2ce00640 1 --2- 172.21.15.118:0/1594912465 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0e100039b0 0x7f0e281e74e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c00c210 tx=0x7f0e1c02e070 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:05.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.515+0000 7f0e24c00640 1 -- 172.21.15.118:0/1594912465 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e1c004bf0 con 0x7f0e100039b0 2024-03-27T09:59:05.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.515+0000 7f0e24c00640 1 -- 172.21.15.118:0/1594912465 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e1c004d90 con 0x7f0e100039b0 2024-03-27T09:59:05.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.515+0000 7f0e2e200640 1 -- 172.21.15.118:0/1594912465 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e281f7500 con 0x7f0e100039b0 2024-03-27T09:59:05.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.515+0000 7f0e24c00640 1 -- 172.21.15.118:0/1594912465 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e1c007270 con 0x7f0e100039b0 2024-03-27T09:59:05.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.515+0000 7f0e2e200640 1 -- 172.21.15.118:0/1594912465 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e281f7ac0 con 0x7f0e100039b0 2024-03-27T09:59:05.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.516+0000 7f0e24c00640 1 -- 172.21.15.118:0/1594912465 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0e1c048020 con 0x7f0e100039b0 2024-03-27T09:59:05.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.516+0000 7f0e24c00640 1 -- 172.21.15.118:0/1594912465 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f0e1c0417e0 con 0x7f0e100039b0 2024-03-27T09:59:05.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.517+0000 7f0e2e200640 1 -- 172.21.15.118:0/1594912465 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e28068c50 con 0x7f0e100039b0 2024-03-27T09:59:05.509 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.519+0000 7f0e24c00640 1 -- 172.21.15.118:0/1594912465 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f0e1c04f020 con 0x7f0e100039b0 2024-03-27T09:59:05.526 INFO:tasks.ceph.mgr.x.smithi118.stderr:2024-03-27T09:59:05.536+0000 7fc2fb02b040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-27T09:59:05.551 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-03-27T09:59:05.561+0000 7f26d2616040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-27T09:59:05.588 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.598+0000 7f0e2e200640 1 -- 172.21.15.118:0/1594912465 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "osd new", "uuid": "feaf96f0-9431-4188-9a09-da505b40e934", "id": 1} v 0) -- 0x7f0e280b84a0 con 0x7f0e100039b0 2024-03-27T09:59:05.591 INFO:tasks.ceph.mgr.x.smithi118.stderr:2024-03-27T09:59:05.602+0000 7fc2fb02b040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-27T09:59:05.595 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.605+0000 7f0e24c00640 1 -- 172.21.15.118:0/1594912465 <== mon.2 v2:172.21.15.118:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "feaf96f0-9431-4188-9a09-da505b40e934", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f0e1c035ce0 con 0x7f0e100039b0 2024-03-27T09:59:05.595 INFO:teuthology.orchestra.run.smithi118.stdout:1 2024-03-27T09:59:05.596 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.606+0000 7f0e2e200640 1 -- 172.21.15.118:0/1594912465 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0e100039b0 msgr2=0x7f0e281e74e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:05.596 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.606+0000 7f0e2e200640 1 --2- 172.21.15.118:0/1594912465 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0e100039b0 0x7f0e281e74e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c00c210 tx=0x7f0e1c02e070 comp rx=0 tx=0).stop 2024-03-27T09:59:05.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.606+0000 7f0e2e200640 1 -- 172.21.15.118:0/1594912465 shutdown_connections 2024-03-27T09:59:05.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.606+0000 7f0e2e200640 1 --2- 172.21.15.118:0/1594912465 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0e280b80c0 0x7f0e281f31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:05.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.606+0000 7f0e2e200640 1 --2- 172.21.15.118:0/1594912465 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0e281e7a20 0x7f0e280b7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:05.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.606+0000 7f0e2e200640 1 --2- 172.21.15.118:0/1594912465 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0e100039b0 0x7f0e281e74e0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:05.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.606+0000 7f0e2e200640 1 -- 172.21.15.118:0/1594912465 >> 172.21.15.118:0/1594912465 conn(0x7f0e280d3f10 msgr2=0x7f0e2806c690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:05.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.606+0000 7f0e2e200640 1 -- 172.21.15.118:0/1594912465 shutdown_connections 2024-03-27T09:59:05.597 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.606+0000 7f0e2e200640 1 -- 172.21.15.118:0/1594912465 wait complete. 2024-03-27T09:59:05.604 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-03-27T09:59:05.614+0000 7f26d2616040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-27T09:59:05.615 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph osd new 21e406e6-cfbc-4fe7-a816-e2420487c95d 2 2024-03-27T09:59:05.646 INFO:tasks.ceph.mgr.x.smithi118.stderr:2024-03-27T09:59:05.656+0000 7fc2fb02b040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-27T09:59:05.728 INFO:tasks.ceph.mgr.x.smithi118.stderr:2024-03-27T09:59:05.737+0000 7fc2fb02b040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-27T09:59:05.742 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-03-27T09:59:05.752+0000 7f26d2616040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-27T09:59:05.780 INFO:tasks.ceph.mgr.x.smithi118.stderr:2024-03-27T09:59:05.790+0000 7fc2fb02b040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-27T09:59:05.801 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.810+0000 7fbad9600640 1 Processor -- start 2024-03-27T09:59:05.801 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.811+0000 7fbad9600640 1 -- start start 2024-03-27T09:59:05.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.812+0000 7fbad9600640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbad406b7b0 0x7fbad40ce970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:05.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.812+0000 7fbad9600640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fbad40c3ea0 0x7fbad406f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:05.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.812+0000 7fbad9600640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbad40ceeb0 con 0x7fbad406bb90 2024-03-27T09:59:05.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.812+0000 7fbad9600640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7fbad40d0300 con 0x7fbad406b7b0 2024-03-27T09:59:05.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.812+0000 7fbad9600640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7fbad4072f70 con 0x7fbad40c3ea0 2024-03-27T09:59:05.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.812+0000 7fbad2000640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fbad40c3ea0 0x7fbad406f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:05.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.812+0000 7fbad2000640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fbad40c3ea0 0x7fbad406f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57562/0 (socket says 172.21.15.118:57562) 2024-03-27T09:59:05.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.812+0000 7fbad2000640 1 -- 172.21.15.118:0/813179853 learned_addr learned my addr 172.21.15.118:0/813179853 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-27T09:59:05.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.812+0000 7fbad2a00640 1 --2- 172.21.15.118:0/813179853 >> v2:172.21.15.57:3300/0 conn(0x7fbad406b7b0 0x7fbad40ce970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:05.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.812+0000 7fbad2000640 1 -- 172.21.15.118:0/813179853 >> v2:172.21.15.57:3300/0 conn(0x7fbad406b7b0 msgr2=0x7fbad40ce970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T09:59:05.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.812+0000 7fbad2000640 1 --2- 172.21.15.118:0/813179853 >> v2:172.21.15.57:3300/0 conn(0x7fbad406b7b0 0x7fbad40ce970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:05.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.812+0000 7fbad2000640 1 -- 172.21.15.118:0/813179853 >> v1:172.21.15.57:6789/0 conn(0x7fbad406bb90 legacy=0x7fbad406fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T09:59:05.803 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.813+0000 7fbad2000640 1 -- 172.21.15.118:0/813179853 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbad4073250 con 0x7fbad40c3ea0 2024-03-27T09:59:05.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.813+0000 7fbad2000640 1 --2- 172.21.15.118:0/813179853 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbad40c3ea0 0x7fbad406f730 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fbad40cb380 tx=0x7fbac402bf80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=932b90dbd5bad619 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:05.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.814+0000 7fbad1600640 1 -- 172.21.15.118:0/813179853 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbac402cb20 con 0x7fbad40c3ea0 2024-03-27T09:59:05.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.814+0000 7fbad1600640 1 -- 172.21.15.118:0/813179853 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbac402ccc0 con 0x7fbad40c3ea0 2024-03-27T09:59:05.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.814+0000 7fbad1600640 1 -- 172.21.15.118:0/813179853 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbac4034610 con 0x7fbad40c3ea0 2024-03-27T09:59:05.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.814+0000 7fbad9600640 1 -- 172.21.15.118:0/813179853 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbad40c3ea0 msgr2=0x7fbad406f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:05.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.814+0000 7fbad9600640 1 --2- 172.21.15.118:0/813179853 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbad40c3ea0 0x7fbad406f730 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fbad40cb380 tx=0x7fbac402bf80 comp rx=0 tx=0).stop 2024-03-27T09:59:05.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.815+0000 7fbad9600640 1 -- 172.21.15.118:0/813179853 shutdown_connections 2024-03-27T09:59:05.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.815+0000 7fbad9600640 1 --2- 172.21.15.118:0/813179853 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbad40c3ea0 0x7fbad406f730 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:05.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.815+0000 7fbad9600640 1 --2- 172.21.15.118:0/813179853 >> v2:172.21.15.57:3300/0 conn(0x7fbad406b7b0 0x7fbad40ce970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:05.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.815+0000 7fbad9600640 1 -- 172.21.15.118:0/813179853 >> 172.21.15.118:0/813179853 conn(0x7fbad40b2990 msgr2=0x7fbad40b2d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:05.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.815+0000 7fbad9600640 1 -- 172.21.15.118:0/813179853 shutdown_connections 2024-03-27T09:59:05.805 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.815+0000 7fbad9600640 1 -- 172.21.15.118:0/813179853 wait complete. 2024-03-27T09:59:05.806 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.816+0000 7fbad9600640 1 Processor -- start 2024-03-27T09:59:05.806 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.816+0000 7fbad9600640 1 -- start start 2024-03-27T09:59:05.809 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.817+0000 7fbad9600640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbad406b7b0 0x7fbad41599e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:05.809 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.817+0000 7fbad9600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbad406bb90 0x7fbad4162e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:05.809 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.817+0000 7fbad9600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbad40c3ea0 0x7fbad40c6850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:05.809 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.817+0000 7fbad9600640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fbad40cd460 con 0x7fbad406b7b0 2024-03-27T09:59:05.809 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.817+0000 7fbad9600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fbad40d0880 con 0x7fbad40c3ea0 2024-03-27T09:59:05.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.817+0000 7fbad9600640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fbad40cd5e0 con 0x7fbad406bb90 2024-03-27T09:59:05.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.818+0000 7fbad2000640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbad406bb90 0x7fbad4162e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:05.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.818+0000 7fbad3400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbad40c3ea0 0x7fbad40c6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:05.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.818+0000 7fbad2000640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbad406bb90 0x7fbad4162e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.118:47858/0 (socket says 172.21.15.118:47858) 2024-03-27T09:59:05.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.818+0000 7fbad2000640 1 -- 172.21.15.118:0/108551319 learned_addr learned my addr 172.21.15.118:0/108551319 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-27T09:59:05.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.818+0000 7fbad2a00640 1 --2- 172.21.15.118:0/108551319 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbad406b7b0 0x7fbad41599e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:05.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.818+0000 7fbad2000640 1 -- 172.21.15.118:0/108551319 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbad40c3ea0 msgr2=0x7fbad40c6850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:05.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.818+0000 7fbad2000640 1 --2- 172.21.15.118:0/108551319 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbad40c3ea0 0x7fbad40c6850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:05.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.818+0000 7fbad2000640 1 -- 172.21.15.118:0/108551319 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbad406b7b0 msgr2=0x7fbad41599e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:05.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.818+0000 7fbad2000640 1 --2- 172.21.15.118:0/108551319 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbad406b7b0 0x7fbad41599e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:05.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.818+0000 7fbad2000640 1 -- 172.21.15.118:0/108551319 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbad4163350 con 0x7fbad406bb90 2024-03-27T09:59:05.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.818+0000 7fbad2a00640 1 --2- 172.21.15.118:0/108551319 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbad406b7b0 0x7fbad41599e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T09:59:05.810 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.818+0000 7fbad2000640 1 --2- 172.21.15.118:0/108551319 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbad406bb90 0x7fbad4162e10 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fbac4000f80 tx=0x7fbac4004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:05.811 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.819+0000 7fbacaa00640 1 -- 172.21.15.118:0/108551319 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbac4044020 con 0x7fbad406bb90 2024-03-27T09:59:05.811 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.819+0000 7fbacaa00640 1 -- 172.21.15.118:0/108551319 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbac40406b0 con 0x7fbad406bb90 2024-03-27T09:59:05.811 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.819+0000 7fbad9600640 1 -- 172.21.15.118:0/108551319 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbad41656f0 con 0x7fbad406bb90 2024-03-27T09:59:05.811 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.819+0000 7fbacaa00640 1 -- 172.21.15.118:0/108551319 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbac4009510 con 0x7fbad406bb90 2024-03-27T09:59:05.811 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.819+0000 7fbad9600640 1 -- 172.21.15.118:0/108551319 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fbad4165c90 con 0x7fbad406bb90 2024-03-27T09:59:05.811 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.819+0000 7fbacaa00640 1 -- 172.21.15.118:0/108551319 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fbac4047020 con 0x7fbad406bb90 2024-03-27T09:59:05.811 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.819+0000 7fbacaa00640 1 -- 172.21.15.118:0/108551319 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7fbac4004490 con 0x7fbad406bb90 2024-03-27T09:59:05.811 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.820+0000 7fbad9600640 1 -- 172.21.15.118:0/108551319 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbad4068c50 con 0x7fbad406bb90 2024-03-27T09:59:05.812 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.823+0000 7fbacaa00640 1 -- 172.21.15.118:0/108551319 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fbac404e070 con 0x7fbad406bb90 2024-03-27T09:59:05.826 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-03-27T09:59:05.836+0000 7f26d2616040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-27T09:59:05.883 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-03-27T09:59:05.893+0000 7f26d2616040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-27T09:59:05.892 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.902+0000 7fbad9600640 1 -- 172.21.15.118:0/108551319 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "osd new", "uuid": "21e406e6-cfbc-4fe7-a816-e2420487c95d", "id": 2} v 0) -- 0x7fbad40ccea0 con 0x7fbad406bb90 2024-03-27T09:59:05.901 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.911+0000 7fbacaa00640 1 -- 172.21.15.118:0/108551319 <== mon.2 v2:172.21.15.118:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "21e406e6-cfbc-4fe7-a816-e2420487c95d", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7fbac4004770 con 0x7fbad406bb90 2024-03-27T09:59:05.901 INFO:teuthology.orchestra.run.smithi118.stdout:2 2024-03-27T09:59:05.902 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.912+0000 7fbad9600640 1 -- 172.21.15.118:0/108551319 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbad406bb90 msgr2=0x7fbad4162e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:05.902 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.912+0000 7fbad9600640 1 --2- 172.21.15.118:0/108551319 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbad406bb90 0x7fbad4162e10 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fbac4000f80 tx=0x7fbac4004a40 comp rx=0 tx=0).stop 2024-03-27T09:59:05.903 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.912+0000 7fbad9600640 1 -- 172.21.15.118:0/108551319 shutdown_connections 2024-03-27T09:59:05.903 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.912+0000 7fbad9600640 1 --2- 172.21.15.118:0/108551319 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbad40c3ea0 0x7fbad40c6850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:05.903 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.912+0000 7fbad9600640 1 --2- 172.21.15.118:0/108551319 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbad406bb90 0x7fbad4162e10 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:05.903 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.912+0000 7fbad9600640 1 --2- 172.21.15.118:0/108551319 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbad406b7b0 0x7fbad41599e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:05.903 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.912+0000 7fbad9600640 1 -- 172.21.15.118:0/108551319 >> 172.21.15.118:0/108551319 conn(0x7fbad40b2990 msgr2=0x7fbad40ade00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:05.903 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.912+0000 7fbad9600640 1 -- 172.21.15.118:0/108551319 shutdown_connections 2024-03-27T09:59:05.903 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:05.912+0000 7fbad9600640 1 -- 172.21.15.118:0/108551319 wait complete. 2024-03-27T09:59:05.918 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph osd new a389af1d-76c4-4dfc-b215-f983f4931257 3 2024-03-27T09:59:05.919 INFO:tasks.ceph.mgr.x.smithi118.stderr:2024-03-27T09:59:05.928+0000 7fc2fb02b040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-27T09:59:05.947 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-03-27T09:59:05.957+0000 7f26d2616040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-27T09:59:06.003 INFO:tasks.ceph.mgr.x.smithi118.stderr:2024-03-27T09:59:06.013+0000 7fc2fb02b040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-27T09:59:06.005 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-03-27T09:59:06.015+0000 7f26d2616040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-27T09:59:06.061 INFO:tasks.ceph.mgr.x.smithi118.stderr:2024-03-27T09:59:06.071+0000 7fc2fb02b040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-27T09:59:06.097 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.107+0000 7f1b2ae00640 1 Processor -- start 2024-03-27T09:59:06.097 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.107+0000 7f1b2ae00640 1 -- start start 2024-03-27T09:59:06.099 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.108+0000 7f1b2ae00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f1b2415e4a0 0x7f1b240b4550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:06.099 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.108+0000 7f1b2ae00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1b24162f60 0x7f1b240cc590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:06.099 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.108+0000 7f1b2ae00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1b240ccad0 0x7f1b240d0c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:06.099 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.108+0000 7f1b2ae00640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f1b2406d5e0 con 0x7f1b24162f60 2024-03-27T09:59:06.099 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.108+0000 7f1b2ae00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f1b2406d8c0 con 0x7f1b2415e4a0 2024-03-27T09:59:06.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.108+0000 7f1b2ae00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f1b240d0420 con 0x7f1b240ccad0 2024-03-27T09:59:06.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.109+0000 7f1b23e00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f1b2415e4a0 0x7f1b240b4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:06.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.109+0000 7f1b23e00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f1b2415e4a0 0x7f1b240b4550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57576/0 (socket says 172.21.15.118:57576) 2024-03-27T09:59:06.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.109+0000 7f1b23e00640 1 -- 172.21.15.118:0/963795034 learned_addr learned my addr 172.21.15.118:0/963795034 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-27T09:59:06.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.109+0000 7f1b28e00640 1 --2- 172.21.15.118:0/963795034 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1b240ccad0 0x7f1b240d0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:06.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.109+0000 7f1b23400640 1 --2- 172.21.15.118:0/963795034 >> v2:172.21.15.57:3300/0 conn(0x7f1b24162f60 0x7f1b240cc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:06.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.109+0000 7f1b23e00640 1 -- 172.21.15.118:0/963795034 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1b240ccad0 msgr2=0x7f1b240d0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T09:59:06.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.109+0000 7f1b23e00640 1 --2- 172.21.15.118:0/963795034 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1b240ccad0 0x7f1b240d0c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:06.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.109+0000 7f1b23e00640 1 -- 172.21.15.118:0/963795034 >> v2:172.21.15.57:3300/0 conn(0x7f1b24162f60 msgr2=0x7f1b240cc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T09:59:06.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.109+0000 7f1b23e00640 1 --2- 172.21.15.118:0/963795034 >> v2:172.21.15.57:3300/0 conn(0x7f1b24162f60 0x7f1b240cc590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:06.100 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.109+0000 7f1b23e00640 1 -- 172.21.15.118:0/963795034 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b240d0700 con 0x7f1b2415e4a0 2024-03-27T09:59:06.101 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.110+0000 7f1b23e00640 1 --2- 172.21.15.118:0/963795034 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1b2415e4a0 0x7f1b240b4550 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1b24072a80 tx=0x7f1b1402b900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5983254ffc052f6 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:06.101 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.110+0000 7f1b22a00640 1 -- 172.21.15.118:0/963795034 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b14035020 con 0x7f1b2415e4a0 2024-03-27T09:59:06.101 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.110+0000 7f1b22a00640 1 -- 172.21.15.118:0/963795034 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b1402d040 con 0x7f1b2415e4a0 2024-03-27T09:59:06.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.110+0000 7f1b22a00640 1 -- 172.21.15.118:0/963795034 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b14031a80 con 0x7f1b2415e4a0 2024-03-27T09:59:06.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.111+0000 7f1b2ae00640 1 -- 172.21.15.118:0/963795034 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1b2415e4a0 msgr2=0x7f1b240b4550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:06.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.111+0000 7f1b2ae00640 1 --2- 172.21.15.118:0/963795034 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1b2415e4a0 0x7f1b240b4550 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1b24072a80 tx=0x7f1b1402b900 comp rx=0 tx=0).stop 2024-03-27T09:59:06.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.111+0000 7f1b2ae00640 1 -- 172.21.15.118:0/963795034 shutdown_connections 2024-03-27T09:59:06.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.111+0000 7f1b2ae00640 1 --2- 172.21.15.118:0/963795034 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1b240ccad0 0x7f1b240d0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:06.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.111+0000 7f1b2ae00640 1 --2- 172.21.15.118:0/963795034 >> v2:172.21.15.57:3300/0 conn(0x7f1b24162f60 0x7f1b240cc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:06.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.111+0000 7f1b2ae00640 1 --2- 172.21.15.118:0/963795034 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1b2415e4a0 0x7f1b240b4550 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:06.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.111+0000 7f1b2ae00640 1 -- 172.21.15.118:0/963795034 >> 172.21.15.118:0/963795034 conn(0x7f1b240b3a30 msgr2=0x7f1b240b3e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:06.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.111+0000 7f1b2ae00640 1 -- 172.21.15.118:0/963795034 shutdown_connections 2024-03-27T09:59:06.102 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.111+0000 7f1b2ae00640 1 -- 172.21.15.118:0/963795034 wait complete. 2024-03-27T09:59:06.103 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.113+0000 7f1b2ae00640 1 Processor -- start 2024-03-27T09:59:06.103 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.113+0000 7f1b2ae00640 1 -- start start 2024-03-27T09:59:06.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.114+0000 7f1b2ae00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1b240ccad0 0x7f1b24162360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:06.104 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.114+0000 7f1b2ae00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1b2415e4a0 0x7f1b2415fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:06.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.114+0000 7f1b2ae00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b24162f60 0x7f1b2415afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:06.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.114+0000 7f1b2ae00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f1b2415e880 con 0x7f1b24162f60 2024-03-27T09:59:06.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.114+0000 7f1b2ae00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f1b2406d270 con 0x7f1b2415e4a0 2024-03-27T09:59:06.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.114+0000 7f1b2ae00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f1b2415ea00 con 0x7f1b240ccad0 2024-03-27T09:59:06.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.114+0000 7f1b23400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1b2415e4a0 0x7f1b2415fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:06.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.114+0000 7f1b23400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1b2415e4a0 0x7f1b2415fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57580/0 (socket says 172.21.15.118:57580) 2024-03-27T09:59:06.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.114+0000 7f1b23400640 1 -- 172.21.15.118:0/3997461731 learned_addr learned my addr 172.21.15.118:0/3997461731 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-27T09:59:06.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.114+0000 7f1b23e00640 1 --2- 172.21.15.118:0/3997461731 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1b240ccad0 0x7f1b24162360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:06.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.114+0000 7f1b28e00640 1 --2- 172.21.15.118:0/3997461731 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b24162f60 0x7f1b2415afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:06.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.114+0000 7f1b23400640 1 -- 172.21.15.118:0/3997461731 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1b240ccad0 msgr2=0x7f1b24162360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:06.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.114+0000 7f1b23400640 1 --2- 172.21.15.118:0/3997461731 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1b240ccad0 0x7f1b24162360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:06.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.115+0000 7f1b23400640 1 -- 172.21.15.118:0/3997461731 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b24162f60 msgr2=0x7f1b2415afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:06.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.115+0000 7f1b23400640 1 --2- 172.21.15.118:0/3997461731 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b24162f60 0x7f1b2415afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:06.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.115+0000 7f1b23400640 1 -- 172.21.15.118:0/3997461731 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b241f47d0 con 0x7f1b2415e4a0 2024-03-27T09:59:06.107 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.115+0000 7f1b23400640 1 --2- 172.21.15.118:0/3997461731 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1b2415e4a0 0x7f1b2415fe50 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f1b1000d5f0 tx=0x7f1b1000dab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:06.107 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.115+0000 7f1b1be00640 1 -- 172.21.15.118:0/3997461731 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b100125f0 con 0x7f1b2415e4a0 2024-03-27T09:59:06.107 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.115+0000 7f1b1be00640 1 -- 172.21.15.118:0/3997461731 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b10019070 con 0x7f1b2415e4a0 2024-03-27T09:59:06.107 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.115+0000 7f1b1be00640 1 -- 172.21.15.118:0/3997461731 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b100129d0 con 0x7f1b2415e4a0 2024-03-27T09:59:06.107 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.115+0000 7f1b2ae00640 1 -- 172.21.15.118:0/3997461731 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b24162c90 con 0x7f1b2415e4a0 2024-03-27T09:59:06.107 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.115+0000 7f1b2ae00640 1 -- 172.21.15.118:0/3997461731 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b240ca750 con 0x7f1b2415e4a0 2024-03-27T09:59:06.107 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.116+0000 7f1b1be00640 1 -- 172.21.15.118:0/3997461731 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1b10012b70 con 0x7f1b2415e4a0 2024-03-27T09:59:06.108 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.116+0000 7f1b1be00640 1 -- 172.21.15.118:0/3997461731 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f1b1001e8f0 con 0x7f1b2415e4a0 2024-03-27T09:59:06.108 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.116+0000 7f1b2ae00640 1 -- 172.21.15.118:0/3997461731 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b24068c50 con 0x7f1b2415e4a0 2024-03-27T09:59:06.109 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.119+0000 7f1b1be00640 1 -- 172.21.15.118:0/3997461731 <== mon.1 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f1b1001eb80 con 0x7f1b2415e4a0 2024-03-27T09:59:06.125 INFO:tasks.ceph.mgr.x.smithi118.stderr:2024-03-27T09:59:06.136+0000 7fc2fb02b040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-27T09:59:06.183 INFO:tasks.ceph.mgr.x.smithi118.stderr:2024-03-27T09:59:06.193+0000 7fc2fb02b040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-27T09:59:06.189 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.199+0000 7f1b2ae00640 1 -- 172.21.15.118:0/3997461731 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a389af1d-76c4-4dfc-b215-f983f4931257", "id": 3} v 0) -- 0x7f1b240b3440 con 0x7f1b2415e4a0 2024-03-27T09:59:06.199 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.209+0000 7f1b1be00640 1 -- 172.21.15.118:0/3997461731 <== mon.1 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a389af1d-76c4-4dfc-b215-f983f4931257", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f1b1001e460 con 0x7f1b2415e4a0 2024-03-27T09:59:06.200 INFO:teuthology.orchestra.run.smithi118.stdout:3 2024-03-27T09:59:06.201 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.210+0000 7f1b2ae00640 1 -- 172.21.15.118:0/3997461731 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1b2415e4a0 msgr2=0x7f1b2415fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:06.201 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.210+0000 7f1b2ae00640 1 --2- 172.21.15.118:0/3997461731 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1b2415e4a0 0x7f1b2415fe50 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f1b1000d5f0 tx=0x7f1b1000dab0 comp rx=0 tx=0).stop 2024-03-27T09:59:06.201 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.210+0000 7f1b2ae00640 1 -- 172.21.15.118:0/3997461731 shutdown_connections 2024-03-27T09:59:06.201 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.210+0000 7f1b2ae00640 1 --2- 172.21.15.118:0/3997461731 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b24162f60 0x7f1b2415afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:06.201 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.210+0000 7f1b2ae00640 1 --2- 172.21.15.118:0/3997461731 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1b2415e4a0 0x7f1b2415fe50 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:06.201 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.210+0000 7f1b2ae00640 1 --2- 172.21.15.118:0/3997461731 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1b240ccad0 0x7f1b24162360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:06.201 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.211+0000 7f1b2ae00640 1 -- 172.21.15.118:0/3997461731 >> 172.21.15.118:0/3997461731 conn(0x7f1b240b3a30 msgr2=0x7f1b2406f860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:06.201 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.211+0000 7f1b2ae00640 1 -- 172.21.15.118:0/3997461731 shutdown_connections 2024-03-27T09:59:06.201 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.211+0000 7f1b2ae00640 1 -- 172.21.15.118:0/3997461731 wait complete. 2024-03-27T09:59:06.217 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph osd new e9b05dca-557a-43ee-b43f-9ce5b7d28304 4 2024-03-27T09:59:06.401 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.411+0000 7f4ca7200640 1 Processor -- start 2024-03-27T09:59:06.402 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.412+0000 7f4ca7200640 1 -- start start 2024-03-27T09:59:06.403 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.413+0000 7f4ca7200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4ca80d3770 0x7f4ca80cf210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:06.403 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.413+0000 7f4ca7200640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ca80cfe40 con 0x7f4ca80cf750 2024-03-27T09:59:06.403 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.413+0000 7f4ca7200640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ca8161d30 con 0x7f4ca8161950 2024-03-27T09:59:06.403 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.413+0000 7f4ca7200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f4ca80d0f10 con 0x7f4ca80d3770 2024-03-27T09:59:06.403 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.413+0000 7f4ca5400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4ca80d3770 0x7f4ca80cf210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:06.403 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.413+0000 7f4ca5e00640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f4ca8161950 0x7f4ca80ceb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:54916/0 (socket says 172.21.15.118:54916) 2024-03-27T09:59:06.403 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.413+0000 7f4ca5e00640 1 -- 172.21.15.118:0/558515267 learned_addr learned my addr 172.21.15.118:0/558515267 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-03-27T09:59:06.404 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.414+0000 7f4ca5400640 1 -- 172.21.15.118:0/558515267 >> v1:172.21.15.118:6789/0 conn(0x7f4ca8161950 legacy=0x7f4ca80ceb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:06.404 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.414+0000 7f4ca5400640 1 -- 172.21.15.118:0/558515267 >> v1:172.21.15.57:6789/0 conn(0x7f4ca80cf750 legacy=0x7f4ca806bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T09:59:06.404 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.414+0000 7f4ca4a00640 1 -- 172.21.15.118:0/558515267 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 610198195 0 0) 0x7f4ca8161d30 con 0x7f4ca8161950 2024-03-27T09:59:06.404 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.414+0000 7f4ca5400640 1 -- 172.21.15.118:0/558515267 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ca80d11f0 con 0x7f4ca80d3770 2024-03-27T09:59:06.405 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.415+0000 7f4ca5400640 1 --2- 172.21.15.118:0/558515267 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4ca80d3770 0x7f4ca80cf210 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f4c940097d0 tx=0x7f4c9402b9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3538f4f087ce98e9 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:06.405 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.415+0000 7f4ca4a00640 1 -- 172.21.15.118:0/558515267 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c94034070 con 0x7f4ca80d3770 2024-03-27T09:59:06.405 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.415+0000 7f4ca4a00640 1 -- 172.21.15.118:0/558515267 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c94030880 con 0x7f4ca80d3770 2024-03-27T09:59:06.405 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.415+0000 7f4ca4a00640 1 -- 172.21.15.118:0/558515267 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c94030c50 con 0x7f4ca80d3770 2024-03-27T09:59:06.406 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.416+0000 7f4ca7200640 1 -- 172.21.15.118:0/558515267 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4ca80d3770 msgr2=0x7f4ca80cf210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:06.406 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.416+0000 7f4ca7200640 1 --2- 172.21.15.118:0/558515267 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4ca80d3770 0x7f4ca80cf210 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f4c940097d0 tx=0x7f4c9402b9c0 comp rx=0 tx=0).stop 2024-03-27T09:59:06.406 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.416+0000 7f4ca7200640 1 -- 172.21.15.118:0/558515267 shutdown_connections 2024-03-27T09:59:06.406 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.416+0000 7f4ca7200640 1 --2- 172.21.15.118:0/558515267 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4ca80d3770 0x7f4ca80cf210 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:06.407 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.416+0000 7f4ca7200640 1 -- 172.21.15.118:0/558515267 >> 172.21.15.118:0/558515267 conn(0x7f4ca80d3fc0 msgr2=0x7f4ca80d43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:06.407 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.416+0000 7f4ca7200640 1 -- 172.21.15.118:0/558515267 shutdown_connections 2024-03-27T09:59:06.407 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.416+0000 7f4ca7200640 1 -- 172.21.15.118:0/558515267 wait complete. 2024-03-27T09:59:06.407 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.417+0000 7f4ca7200640 1 Processor -- start 2024-03-27T09:59:06.407 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.418+0000 7f4ca7200640 1 -- start start 2024-03-27T09:59:06.410 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.418+0000 7f4ca7200640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4ca80cf750 0x7f4ca8152440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:06.411 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.418+0000 7f4ca7200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4ca80d3770 0x7f4ca80b1a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:06.411 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.418+0000 7f4ca7200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4ca8161950 0x7f4ca80b1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:06.411 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.418+0000 7f4ca7200640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f4ca80d2240 con 0x7f4ca80cf750 2024-03-27T09:59:06.411 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.418+0000 7f4ca7200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f4ca80d1f60 con 0x7f4ca8161950 2024-03-27T09:59:06.411 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.418+0000 7f4ca7200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f4ca80d17b0 con 0x7f4ca80d3770 2024-03-27T09:59:06.411 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.419+0000 7f4ca5400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4ca80d3770 0x7f4ca80b1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:06.411 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.419+0000 7f4ca5400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4ca80d3770 0x7f4ca80b1a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.118:47894/0 (socket says 172.21.15.118:47894) 2024-03-27T09:59:06.411 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.419+0000 7f4ca5400640 1 -- 172.21.15.118:0/11948696 learned_addr learned my addr 172.21.15.118:0/11948696 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-27T09:59:06.411 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.419+0000 7f4ca6800640 1 --2- 172.21.15.118:0/11948696 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4ca8161950 0x7f4ca80b1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:06.411 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.419+0000 7f4ca5e00640 1 --2- 172.21.15.118:0/11948696 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4ca80cf750 0x7f4ca8152440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:06.411 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.419+0000 7f4ca5400640 1 -- 172.21.15.118:0/11948696 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4ca8161950 msgr2=0x7f4ca80b1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:06.411 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.419+0000 7f4ca5400640 1 --2- 172.21.15.118:0/11948696 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4ca8161950 0x7f4ca80b1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:06.412 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.419+0000 7f4ca5400640 1 -- 172.21.15.118:0/11948696 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4ca80cf750 msgr2=0x7f4ca8152440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:06.412 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.419+0000 7f4ca5400640 1 --2- 172.21.15.118:0/11948696 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4ca80cf750 0x7f4ca8152440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:06.412 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.419+0000 7f4ca5400640 1 -- 172.21.15.118:0/11948696 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ca8152980 con 0x7f4ca80d3770 2024-03-27T09:59:06.412 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.420+0000 7f4ca5400640 1 --2- 172.21.15.118:0/11948696 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4ca80d3770 0x7f4ca80b1a80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4c940098f0 tx=0x7f4c940046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:06.412 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.420+0000 7f4c9e000640 1 -- 172.21.15.118:0/11948696 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c94034040 con 0x7f4ca80d3770 2024-03-27T09:59:06.412 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.420+0000 7f4c9e000640 1 -- 172.21.15.118:0/11948696 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c94039cf0 con 0x7f4ca80d3770 2024-03-27T09:59:06.412 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.420+0000 7f4ca7200640 1 -- 172.21.15.118:0/11948696 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ca80b25f0 con 0x7f4ca80d3770 2024-03-27T09:59:06.412 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.420+0000 7f4c9e000640 1 -- 172.21.15.118:0/11948696 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c94042630 con 0x7f4ca80d3770 2024-03-27T09:59:06.412 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.420+0000 7f4ca7200640 1 -- 172.21.15.118:0/11948696 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ca80cc280 con 0x7f4ca80d3770 2024-03-27T09:59:06.412 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.420+0000 7f4c9e000640 1 -- 172.21.15.118:0/11948696 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4c94037070 con 0x7f4ca80d3770 2024-03-27T09:59:06.412 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.420+0000 7f4c9e000640 1 -- 172.21.15.118:0/11948696 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f4c94030740 con 0x7f4ca80d3770 2024-03-27T09:59:06.413 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.421+0000 7f4ca7200640 1 -- 172.21.15.118:0/11948696 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ca8068540 con 0x7f4ca80d3770 2024-03-27T09:59:06.413 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.423+0000 7f4c9e000640 1 -- 172.21.15.118:0/11948696 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f4ca8152980 con 0x7f4ca80d3770 2024-03-27T09:59:06.481 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-03-27T09:59:06.490+0000 7f26d2616040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-27T09:59:06.492 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.502+0000 7f4ca7200640 1 -- 172.21.15.118:0/11948696 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "osd new", "uuid": "e9b05dca-557a-43ee-b43f-9ce5b7d28304", "id": 4} v 0) -- 0x7f4ca815e800 con 0x7f4ca80d3770 2024-03-27T09:59:06.504 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.514+0000 7f4c9e000640 1 -- 172.21.15.118:0/11948696 <== mon.2 v2:172.21.15.118:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e9b05dca-557a-43ee-b43f-9ce5b7d28304", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f4c940427d0 con 0x7f4ca80d3770 2024-03-27T09:59:06.504 INFO:teuthology.orchestra.run.smithi118.stdout:4 2024-03-27T09:59:06.506 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.516+0000 7f4ca7200640 1 -- 172.21.15.118:0/11948696 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4ca80d3770 msgr2=0x7f4ca80b1a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:06.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.516+0000 7f4ca7200640 1 --2- 172.21.15.118:0/11948696 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4ca80d3770 0x7f4ca80b1a80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4c940098f0 tx=0x7f4c940046c0 comp rx=0 tx=0).stop 2024-03-27T09:59:06.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.516+0000 7f4ca7200640 1 -- 172.21.15.118:0/11948696 shutdown_connections 2024-03-27T09:59:06.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.516+0000 7f4ca7200640 1 --2- 172.21.15.118:0/11948696 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4ca8161950 0x7f4ca80b1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:06.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.516+0000 7f4ca7200640 1 --2- 172.21.15.118:0/11948696 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4ca80d3770 0x7f4ca80b1a80 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:06.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.516+0000 7f4ca7200640 1 --2- 172.21.15.118:0/11948696 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4ca80cf750 0x7f4ca8152440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:06.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.516+0000 7f4ca7200640 1 -- 172.21.15.118:0/11948696 >> 172.21.15.118:0/11948696 conn(0x7f4ca80d3fc0 msgr2=0x7f4ca815ff50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:06.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.516+0000 7f4ca7200640 1 -- 172.21.15.118:0/11948696 shutdown_connections 2024-03-27T09:59:06.507 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.516+0000 7f4ca7200640 1 -- 172.21.15.118:0/11948696 wait complete. 2024-03-27T09:59:06.523 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph osd new d968177d-44ff-499a-b00a-b147ed879253 5 2024-03-27T09:59:06.650 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-03-27T09:59:06.660+0000 7f26d2616040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-27T09:59:06.658 INFO:tasks.ceph.mgr.x.smithi118.stderr:2024-03-27T09:59:06.667+0000 7fc2fb02b040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-27T09:59:06.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.720+0000 7f2765600640 1 Processor -- start 2024-03-27T09:59:06.711 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.721+0000 7f2765600640 1 -- start start 2024-03-27T09:59:06.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.722+0000 7f2765600640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f27600b52b0 0x7f27600cf5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:06.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.722+0000 7f2765600640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f27600d4b30 0x7f27600d0770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:06.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.722+0000 7f2765600640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27600cffa0 con 0x7f27600cfb00 2024-03-27T09:59:06.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.722+0000 7f2765600640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f27600c8390 con 0x7f27600b52b0 2024-03-27T09:59:06.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.722+0000 7f2765600640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f27600c7a60 con 0x7f27600d4b30 2024-03-27T09:59:06.713 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.722+0000 7f2757e00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f27600d4b30 0x7f27600d0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:06.714 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.722+0000 7f2757e00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f27600d4b30 0x7f27600d0770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:57608/0 (socket says 172.21.15.118:57608) 2024-03-27T09:59:06.714 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.722+0000 7f2757e00640 1 -- 172.21.15.118:0/752707708 learned_addr learned my addr 172.21.15.118:0/752707708 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-27T09:59:06.714 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.723+0000 7f275fe00640 1 --2- 172.21.15.118:0/752707708 >> v2:172.21.15.57:3300/0 conn(0x7f27600b52b0 0x7f27600cf5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:06.714 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.723+0000 7f2757e00640 1 -- 172.21.15.118:0/752707708 >> v2:172.21.15.57:3300/0 conn(0x7f27600b52b0 msgr2=0x7f27600cf5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T09:59:06.714 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.723+0000 7f2757e00640 1 --2- 172.21.15.118:0/752707708 >> v2:172.21.15.57:3300/0 conn(0x7f27600b52b0 0x7f27600cf5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:06.714 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.723+0000 7f2757e00640 1 -- 172.21.15.118:0/752707708 >> v1:172.21.15.57:6789/0 conn(0x7f27600cfb00 legacy=0x7f276015db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T09:59:06.714 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.723+0000 7f2757e00640 1 -- 172.21.15.118:0/752707708 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27600c7d40 con 0x7f27600d4b30 2024-03-27T09:59:06.715 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.724+0000 7f2757e00640 1 --2- 172.21.15.118:0/752707708 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f27600d4b30 0x7f27600d0770 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f27600d03d0 tx=0x7f274802b880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=493514bbd2f54263 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:06.715 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.724+0000 7f275f400640 1 -- 172.21.15.118:0/752707708 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f274802e070 con 0x7f27600d4b30 2024-03-27T09:59:06.715 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.724+0000 7f275f400640 1 -- 172.21.15.118:0/752707708 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2748037070 con 0x7f27600d4b30 2024-03-27T09:59:06.715 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.724+0000 7f275f400640 1 -- 172.21.15.118:0/752707708 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2748031a00 con 0x7f27600d4b30 2024-03-27T09:59:06.715 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.725+0000 7f2765600640 1 -- 172.21.15.118:0/752707708 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f27600d4b30 msgr2=0x7f27600d0770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:06.715 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.725+0000 7f2765600640 1 --2- 172.21.15.118:0/752707708 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f27600d4b30 0x7f27600d0770 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f27600d03d0 tx=0x7f274802b880 comp rx=0 tx=0).stop 2024-03-27T09:59:06.716 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.725+0000 7f2765600640 1 -- 172.21.15.118:0/752707708 shutdown_connections 2024-03-27T09:59:06.716 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.725+0000 7f2765600640 1 --2- 172.21.15.118:0/752707708 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f27600d4b30 0x7f27600d0770 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:06.716 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.725+0000 7f2765600640 1 --2- 172.21.15.118:0/752707708 >> v2:172.21.15.57:3300/0 conn(0x7f27600b52b0 0x7f27600cf5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:06.716 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.725+0000 7f2765600640 1 -- 172.21.15.118:0/752707708 >> 172.21.15.118:0/752707708 conn(0x7f27600d3f10 msgr2=0x7f27600d4320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:06.716 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.725+0000 7f2765600640 1 -- 172.21.15.118:0/752707708 shutdown_connections 2024-03-27T09:59:06.716 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.725+0000 7f2765600640 1 -- 172.21.15.118:0/752707708 wait complete. 2024-03-27T09:59:06.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.727+0000 7f2765600640 1 Processor -- start 2024-03-27T09:59:06.717 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.727+0000 7f2765600640 1 -- start start 2024-03-27T09:59:06.719 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.728+0000 7f2765600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f27600b52b0 0x7f27601e0000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:06.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.728+0000 7f2765600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f27600cfb00 0x7f27600b8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:06.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.728+0000 7f2765600640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f27600d4b30 0x7f27601e3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:06.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.728+0000 7f2765600640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f27600b5810 con 0x7f27600d4b30 2024-03-27T09:59:06.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.728+0000 7f2765600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f27600b5690 con 0x7f27600cfb00 2024-03-27T09:59:06.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.728+0000 7f2765600640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f27600d0cb0 con 0x7f27600b52b0 2024-03-27T09:59:06.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.728+0000 7f275fe00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f27600b52b0 0x7f27601e0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:06.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.728+0000 7f2757e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f27600cfb00 0x7f27600b8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:06.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.728+0000 7f275fe00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f27600b52b0 0x7f27601e0000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.118:47900/0 (socket says 172.21.15.118:47900) 2024-03-27T09:59:06.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.728+0000 7f275fe00640 1 -- 172.21.15.118:0/1526462193 learned_addr learned my addr 172.21.15.118:0/1526462193 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-27T09:59:06.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.728+0000 7f2764c00640 1 --2- 172.21.15.118:0/1526462193 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f27600d4b30 0x7f27601e3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:06.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.729+0000 7f2757e00640 1 -- 172.21.15.118:0/1526462193 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f27600b52b0 msgr2=0x7f27601e0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:06.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.729+0000 7f2757e00640 1 --2- 172.21.15.118:0/1526462193 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f27600b52b0 0x7f27601e0000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:06.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.729+0000 7f2757e00640 1 -- 172.21.15.118:0/1526462193 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f27600d4b30 msgr2=0x7f27601e3360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:06.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.729+0000 7f2757e00640 1 --2- 172.21.15.118:0/1526462193 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f27600d4b30 0x7f27601e3360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:06.720 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.729+0000 7f2757e00640 1 -- 172.21.15.118:0/1526462193 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27600b8350 con 0x7f27600cfb00 2024-03-27T09:59:06.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.729+0000 7f275fe00640 1 --2- 172.21.15.118:0/1526462193 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f27600b52b0 0x7f27601e0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T09:59:06.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.729+0000 7f2757e00640 1 --2- 172.21.15.118:0/1526462193 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f27600cfb00 0x7f27600b8cb0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f2748033000 tx=0x7f27480046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:06.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.729+0000 7f275cc00640 1 -- 172.21.15.118:0/1526462193 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2748032880 con 0x7f27600cfb00 2024-03-27T09:59:06.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.729+0000 7f275cc00640 1 -- 172.21.15.118:0/1526462193 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2748032a60 con 0x7f27600cfb00 2024-03-27T09:59:06.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.729+0000 7f275cc00640 1 -- 172.21.15.118:0/1526462193 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2748032e50 con 0x7f27600cfb00 2024-03-27T09:59:06.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.729+0000 7f2765600640 1 -- 172.21.15.118:0/1526462193 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27601e69b0 con 0x7f27600cfb00 2024-03-27T09:59:06.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.729+0000 7f2765600640 1 -- 172.21.15.118:0/1526462193 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27601e6f70 con 0x7f27600cfb00 2024-03-27T09:59:06.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.730+0000 7f275cc00640 1 -- 172.21.15.118:0/1526462193 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f27480453f0 con 0x7f27600cfb00 2024-03-27T09:59:06.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.730+0000 7f275cc00640 1 -- 172.21.15.118:0/1526462193 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f2748045c60 con 0x7f27600cfb00 2024-03-27T09:59:06.721 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.731+0000 7f2765600640 1 -- 172.21.15.118:0/1526462193 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2760068c50 con 0x7f27600cfb00 2024-03-27T09:59:06.723 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.733+0000 7f275cc00640 1 -- 172.21.15.118:0/1526462193 <== mon.1 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f2748040070 con 0x7f27600cfb00 2024-03-27T09:59:06.781 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-03-27T09:59:06.791+0000 7f26d2616040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-27T09:59:06.802 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.812+0000 7f2765600640 1 -- 172.21.15.118:0/1526462193 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d968177d-44ff-499a-b00a-b147ed879253", "id": 5} v 0) -- 0x7f27601e8ed0 con 0x7f27600cfb00 2024-03-27T09:59:06.809 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.819+0000 7f275cc00640 1 -- 172.21.15.118:0/1526462193 <== mon.1 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d968177d-44ff-499a-b00a-b147ed879253", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f27480456e0 con 0x7f27600cfb00 2024-03-27T09:59:06.809 INFO:teuthology.orchestra.run.smithi118.stdout:5 2024-03-27T09:59:06.811 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.820+0000 7f2765600640 1 -- 172.21.15.118:0/1526462193 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f27600cfb00 msgr2=0x7f27600b8cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:06.811 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.820+0000 7f2765600640 1 --2- 172.21.15.118:0/1526462193 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f27600cfb00 0x7f27600b8cb0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f2748033000 tx=0x7f27480046c0 comp rx=0 tx=0).stop 2024-03-27T09:59:06.811 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.821+0000 7f2765600640 1 -- 172.21.15.118:0/1526462193 shutdown_connections 2024-03-27T09:59:06.811 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.821+0000 7f2765600640 1 --2- 172.21.15.118:0/1526462193 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f27600d4b30 0x7f27601e3360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:06.811 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.821+0000 7f2765600640 1 --2- 172.21.15.118:0/1526462193 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f27600cfb00 0x7f27600b8cb0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:06.811 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.821+0000 7f2765600640 1 --2- 172.21.15.118:0/1526462193 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f27600b52b0 0x7f27601e0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:06.811 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.821+0000 7f2765600640 1 -- 172.21.15.118:0/1526462193 >> 172.21.15.118:0/1526462193 conn(0x7f27600d3f10 msgr2=0x7f27601e5450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:06.812 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.821+0000 7f2765600640 1 -- 172.21.15.118:0/1526462193 shutdown_connections 2024-03-27T09:59:06.812 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:06.821+0000 7f2765600640 1 -- 172.21.15.118:0/1526462193 wait complete. 2024-03-27T09:59:06.827 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph osd new e8f98052-e6ad-4cfe-a4a9-0b17a434d54e 6 2024-03-27T09:59:06.827 INFO:tasks.ceph.mgr.x.smithi118.stderr:2024-03-27T09:59:06.837+0000 7fc2fb02b040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-27T09:59:06.838 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-03-27T09:59:06.848+0000 7f26d2616040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-27T09:59:06.972 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-03-27T09:59:06.981+0000 7f26d2616040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-27T09:59:06.984 INFO:tasks.ceph.mgr.x.smithi118.stderr:2024-03-27T09:59:06.994+0000 7fc2fb02b040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-27T09:59:07.013 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.023+0000 7f40d5600640 1 Processor -- start 2024-03-27T09:59:07.013 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.023+0000 7f40d5600640 1 -- start start 2024-03-27T09:59:07.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.025+0000 7f40d5600640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f40d00b52b0 0x7f40d00cf5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:07.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.025+0000 7f40d5600640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f40d00cfb00 0x7f40d015db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:07.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.025+0000 7f40d5600640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40d00cffa0 con 0x7f40d00d4b30 2024-03-27T09:59:07.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.025+0000 7f40d5600640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f40d00c8390 con 0x7f40d00b52b0 2024-03-27T09:59:07.015 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.025+0000 7f40d5600640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f40d00c7a60 con 0x7f40d00cfb00 2024-03-27T09:59:07.016 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.025+0000 7f40d4c00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f40d00cfb00 0x7f40d015db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:07.016 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.025+0000 7f40d4c00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f40d00cfb00 0x7f40d015db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:39788/0 (socket says 172.21.15.118:39788) 2024-03-27T09:59:07.016 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.025+0000 7f40d4c00640 1 -- 172.21.15.118:0/1866377704 learned_addr learned my addr 172.21.15.118:0/1866377704 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-27T09:59:07.016 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.025+0000 7f40cfe00640 1 --2- 172.21.15.118:0/1866377704 >> v2:172.21.15.57:3300/0 conn(0x7f40d00b52b0 0x7f40d00cf5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:07.016 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.026+0000 7f40d4c00640 1 -- 172.21.15.118:0/1866377704 >> v2:172.21.15.57:3300/0 conn(0x7f40d00b52b0 msgr2=0x7f40d00cf5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T09:59:07.016 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.026+0000 7f40d4c00640 1 --2- 172.21.15.118:0/1866377704 >> v2:172.21.15.57:3300/0 conn(0x7f40d00b52b0 0x7f40d00cf5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:07.017 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.026+0000 7f40d4c00640 1 -- 172.21.15.118:0/1866377704 >> v1:172.21.15.118:6789/0 conn(0x7f40d00d4b30 legacy=0x7f40d00d0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:07.017 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.026+0000 7f40d4c00640 1 -- 172.21.15.118:0/1866377704 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40d00c7d40 con 0x7f40d00cfb00 2024-03-27T09:59:07.018 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.027+0000 7f40d4c00640 1 --2- 172.21.15.118:0/1866377704 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f40d00cfb00 0x7f40d015db60 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f40d006bde0 tx=0x7f40c802bee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1220cae2057772e server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:07.018 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.027+0000 7f40cea00640 1 -- 172.21.15.118:0/1866377704 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40c802ca80 con 0x7f40d00cfb00 2024-03-27T09:59:07.018 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.027+0000 7f40cea00640 1 -- 172.21.15.118:0/1866377704 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40c802cc20 con 0x7f40d00cfb00 2024-03-27T09:59:07.018 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.027+0000 7f40cea00640 1 -- 172.21.15.118:0/1866377704 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40c80343f0 con 0x7f40d00cfb00 2024-03-27T09:59:07.018 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.028+0000 7f40d5600640 1 -- 172.21.15.118:0/1866377704 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f40d00cfb00 msgr2=0x7f40d015db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:07.018 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.028+0000 7f40d5600640 1 --2- 172.21.15.118:0/1866377704 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f40d00cfb00 0x7f40d015db60 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f40d006bde0 tx=0x7f40c802bee0 comp rx=0 tx=0).stop 2024-03-27T09:59:07.018 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.028+0000 7f40d5600640 1 -- 172.21.15.118:0/1866377704 shutdown_connections 2024-03-27T09:59:07.018 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.028+0000 7f40d5600640 1 --2- 172.21.15.118:0/1866377704 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f40d00cfb00 0x7f40d015db60 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:07.018 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.028+0000 7f40d5600640 1 --2- 172.21.15.118:0/1866377704 >> v2:172.21.15.57:3300/0 conn(0x7f40d00b52b0 0x7f40d00cf5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:07.018 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.028+0000 7f40d5600640 1 -- 172.21.15.118:0/1866377704 >> 172.21.15.118:0/1866377704 conn(0x7f40d00d3f10 msgr2=0x7f40d00d4320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:07.018 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.028+0000 7f40d5600640 1 -- 172.21.15.118:0/1866377704 shutdown_connections 2024-03-27T09:59:07.019 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.028+0000 7f40d5600640 1 -- 172.21.15.118:0/1866377704 wait complete. 2024-03-27T09:59:07.019 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.030+0000 7f40d5600640 1 Processor -- start 2024-03-27T09:59:07.020 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.030+0000 7f40d5600640 1 -- start start 2024-03-27T09:59:07.021 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.030+0000 7f40d5600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f40d00b52b0 0x7f40d00b1c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:07.021 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.030+0000 7f40d5600640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f40d00cfb00 0x7f40d01d7430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:07.021 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.031+0000 7f40d5600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f40d00d4b30 0x7f40d01f72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:07.022 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.031+0000 7f40d5600640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f40d00b5810 con 0x7f40d00cfb00 2024-03-27T09:59:07.022 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.031+0000 7f40d5600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f40d00b5690 con 0x7f40d00b52b0 2024-03-27T09:59:07.022 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.031+0000 7f40d5600640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f40d00d0e80 con 0x7f40d00d4b30 2024-03-27T09:59:07.022 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.031+0000 7f40cfe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f40d00b52b0 0x7f40d00b1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:07.022 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.031+0000 7f40d4c00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f40d00d4b30 0x7f40d01f72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:07.022 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.031+0000 7f40cfe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f40d00b52b0 0x7f40d00b1c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.118:39798/0 (socket says 172.21.15.118:39798) 2024-03-27T09:59:07.022 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.031+0000 7f40cfe00640 1 -- 172.21.15.118:0/74016301 learned_addr learned my addr 172.21.15.118:0/74016301 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-27T09:59:07.022 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.031+0000 7f40cf400640 1 --2- 172.21.15.118:0/74016301 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f40d00cfb00 0x7f40d01d7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:07.022 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.031+0000 7f40d4c00640 1 -- 172.21.15.118:0/74016301 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f40d00b52b0 msgr2=0x7f40d00b1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:07.022 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.031+0000 7f40d4c00640 1 --2- 172.21.15.118:0/74016301 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f40d00b52b0 0x7f40d00b1c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:07.022 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.031+0000 7f40d4c00640 1 -- 172.21.15.118:0/74016301 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f40d00cfb00 msgr2=0x7f40d01d7430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:07.022 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.031+0000 7f40d4c00640 1 --2- 172.21.15.118:0/74016301 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f40d00cfb00 0x7f40d01d7430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:07.022 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.031+0000 7f40d4c00640 1 -- 172.21.15.118:0/74016301 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40d01f7c70 con 0x7f40d00d4b30 2024-03-27T09:59:07.023 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.031+0000 7f40cfe00640 1 --2- 172.21.15.118:0/74016301 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f40d00b52b0 0x7f40d00b1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T09:59:07.023 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.032+0000 7f40d4c00640 1 --2- 172.21.15.118:0/74016301 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f40d00d4b30 0x7f40d01f72b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f40d00c8510 tx=0x7f40c8004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:07.024 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.032+0000 7f40c7e00640 1 -- 172.21.15.118:0/74016301 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40c8043020 con 0x7f40d00d4b30 2024-03-27T09:59:07.024 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.032+0000 7f40c7e00640 1 -- 172.21.15.118:0/74016301 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40c803e450 con 0x7f40d00d4b30 2024-03-27T09:59:07.024 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.032+0000 7f40d5600640 1 -- 172.21.15.118:0/74016301 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40d01f7f50 con 0x7f40d00d4b30 2024-03-27T09:59:07.024 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.032+0000 7f40c7e00640 1 -- 172.21.15.118:0/74016301 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40c8009510 con 0x7f40d00d4b30 2024-03-27T09:59:07.024 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.032+0000 7f40d5600640 1 -- 172.21.15.118:0/74016301 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f40d01d7970 con 0x7f40d00d4b30 2024-03-27T09:59:07.024 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.032+0000 7f40c7e00640 1 -- 172.21.15.118:0/74016301 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f40c8046020 con 0x7f40d00d4b30 2024-03-27T09:59:07.024 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.032+0000 7f40c7e00640 1 -- 172.21.15.118:0/74016301 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f40c802ca90 con 0x7f40d00d4b30 2024-03-27T09:59:07.024 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.033+0000 7f40d5600640 1 -- 172.21.15.118:0/74016301 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40d0068c50 con 0x7f40d00d4b30 2024-03-27T09:59:07.025 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.035+0000 7f40c7e00640 1 -- 172.21.15.118:0/74016301 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f40c804d030 con 0x7f40d00d4b30 2024-03-27T09:59:07.042 INFO:tasks.ceph.mgr.x.smithi118.stderr:2024-03-27T09:59:07.052+0000 7fc2fb02b040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-27T09:59:07.100 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-03-27T09:59:07.099+0000 7f26d2616040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-27T09:59:07.105 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.115+0000 7f40d5600640 1 -- 172.21.15.118:0/74016301 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "osd new", "uuid": "e8f98052-e6ad-4cfe-a4a9-0b17a434d54e", "id": 6} v 0) -- 0x7f40d00d2220 con 0x7f40d00d4b30 2024-03-27T09:59:07.114 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.124+0000 7f40c7e00640 1 -- 172.21.15.118:0/74016301 <== mon.2 v2:172.21.15.118:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e8f98052-e6ad-4cfe-a4a9-0b17a434d54e", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f40c803e840 con 0x7f40d00d4b30 2024-03-27T09:59:07.114 INFO:teuthology.orchestra.run.smithi118.stdout:6 2024-03-27T09:59:07.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.125+0000 7f40d5600640 1 -- 172.21.15.118:0/74016301 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f40d00d4b30 msgr2=0x7f40d01f72b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:07.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.125+0000 7f40d5600640 1 --2- 172.21.15.118:0/74016301 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f40d00d4b30 0x7f40d01f72b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f40d00c8510 tx=0x7f40c8004a40 comp rx=0 tx=0).stop 2024-03-27T09:59:07.115 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.125+0000 7f40d5600640 1 -- 172.21.15.118:0/74016301 shutdown_connections 2024-03-27T09:59:07.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.125+0000 7f40d5600640 1 --2- 172.21.15.118:0/74016301 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f40d00d4b30 0x7f40d01f72b0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:07.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.125+0000 7f40d5600640 1 --2- 172.21.15.118:0/74016301 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f40d00cfb00 0x7f40d01d7430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:07.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.125+0000 7f40d5600640 1 --2- 172.21.15.118:0/74016301 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f40d00b52b0 0x7f40d00b1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:07.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.125+0000 7f40d5600640 1 -- 172.21.15.118:0/74016301 >> 172.21.15.118:0/74016301 conn(0x7f40d00d3f10 msgr2=0x7f40d00c9e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:07.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.125+0000 7f40d5600640 1 -- 172.21.15.118:0/74016301 shutdown_connections 2024-03-27T09:59:07.116 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.125+0000 7f40d5600640 1 -- 172.21.15.118:0/74016301 wait complete. 2024-03-27T09:59:07.131 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --cluster ceph osd new eccff987-8e51-4a63-845a-cf0a3196d7fd 7 2024-03-27T09:59:07.177 INFO:tasks.ceph.mgr.x.smithi118.stderr:2024-03-27T09:59:07.187+0000 7fc2fb02b040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-27T09:59:07.276 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-03-27T09:59:07.285+0000 7f26d2616040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-27T09:59:07.294 INFO:tasks.ceph.mgr.x.smithi118.stderr:2024-03-27T09:59:07.304+0000 7fc2fb02b040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-27T09:59:07.318 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.328+0000 7f184ea00640 1 Processor -- start 2024-03-27T09:59:07.319 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.328+0000 7f184ea00640 1 -- start start 2024-03-27T09:59:07.321 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.330+0000 7f184ea00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f184806b540 0x7f184806fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:07.321 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.330+0000 7f184ea00640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18480ce830 con 0x7f184806f670 2024-03-27T09:59:07.321 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.330+0000 7f184ea00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18481628d0 con 0x7f18480d17c0 2024-03-27T09:59:07.321 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.330+0000 7f184ea00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f1848072780 con 0x7f184806b540 2024-03-27T09:59:07.321 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.330+0000 7f184d600640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f184806b540 0x7f184806fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:07.321 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.330+0000 7f184e000640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f18480d17c0 0x7f1848072070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.118:56128/0 (socket says 172.21.15.118:56128) 2024-03-27T09:59:07.322 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.330+0000 7f184e000640 1 -- 172.21.15.118:0/3570015648 learned_addr learned my addr 172.21.15.118:0/3570015648 (peer_addr_for_me v1:172.21.15.118:0/0) 2024-03-27T09:59:07.322 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.330+0000 7f184d600640 1 -- 172.21.15.118:0/3570015648 >> v1:172.21.15.118:6789/0 conn(0x7f18480d17c0 legacy=0x7f1848072070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:07.322 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.330+0000 7f184d600640 1 -- 172.21.15.118:0/3570015648 >> v1:172.21.15.57:6789/0 conn(0x7f184806f670 legacy=0x7f184806b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T09:59:07.322 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.330+0000 7f184d600640 1 -- 172.21.15.118:0/3570015648 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18480ceaf0 con 0x7f184806b540 2024-03-27T09:59:07.324 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.331+0000 7f184d600640 1 --2- 172.21.15.118:0/3570015648 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f184806b540 0x7f184806fa80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f183c0097a0 tx=0x7f183c02b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=80f94b7059ac6e36 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:07.324 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.332+0000 7f1847e00640 1 -- 172.21.15.118:0/3570015648 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f183c0315a0 con 0x7f184806b540 2024-03-27T09:59:07.324 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.332+0000 7f1847e00640 1 -- 172.21.15.118:0/3570015648 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f183c037070 con 0x7f184806b540 2024-03-27T09:59:07.325 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.332+0000 7f1847e00640 1 -- 172.21.15.118:0/3570015648 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f183c031960 con 0x7f184806b540 2024-03-27T09:59:07.325 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.332+0000 7f184ea00640 1 -- 172.21.15.118:0/3570015648 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f184806b540 msgr2=0x7f184806fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:07.325 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.332+0000 7f184ea00640 1 --2- 172.21.15.118:0/3570015648 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f184806b540 0x7f184806fa80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f183c0097a0 tx=0x7f183c02b840 comp rx=0 tx=0).stop 2024-03-27T09:59:07.325 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.332+0000 7f184ea00640 1 -- 172.21.15.118:0/3570015648 shutdown_connections 2024-03-27T09:59:07.325 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.332+0000 7f184ea00640 1 --2- 172.21.15.118:0/3570015648 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f184806b540 0x7f184806fa80 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:07.325 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.333+0000 7f184ea00640 1 -- 172.21.15.118:0/3570015648 >> 172.21.15.118:0/3570015648 conn(0x7f18480d0bc0 msgr2=0x7f18480d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:07.325 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.333+0000 7f184ea00640 1 -- 172.21.15.118:0/3570015648 shutdown_connections 2024-03-27T09:59:07.325 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.333+0000 7f184ea00640 1 -- 172.21.15.118:0/3570015648 wait complete. 2024-03-27T09:59:07.325 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.334+0000 7f184ea00640 1 Processor -- start 2024-03-27T09:59:07.325 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.334+0000 7f184ea00640 1 -- start start 2024-03-27T09:59:07.329 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.335+0000 7f184ea00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f184806b540 0x7f184815b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:07.329 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.335+0000 7f184ea00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f18480d17c0 0x7f18480b5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:07.329 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.335+0000 7f184ea00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f18480b5f80 0x7f18481e8060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:07.329 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.335+0000 7f184ea00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f18480ccb10 con 0x7f184806b540 2024-03-27T09:59:07.330 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.335+0000 7f184ea00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f18480cedd0 con 0x7f18480b5f80 2024-03-27T09:59:07.330 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.335+0000 7f184ea00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f18480ccc90 con 0x7f18480d17c0 2024-03-27T09:59:07.330 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.335+0000 7f184cc00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f18480d17c0 0x7f18480b5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:07.330 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.335+0000 7f184e000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f18480b5f80 0x7f18481e8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:07.330 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.335+0000 7f184cc00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f18480d17c0 0x7f18480b5a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.118:43318/0 (socket says 172.21.15.118:43318) 2024-03-27T09:59:07.330 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.335+0000 7f184cc00640 1 -- 172.21.15.118:0/4039602428 learned_addr learned my addr 172.21.15.118:0/4039602428 (peer_addr_for_me v2:172.21.15.118:0/0) 2024-03-27T09:59:07.330 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.336+0000 7f184d600640 1 --2- 172.21.15.118:0/4039602428 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f184806b540 0x7f184815b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:07.330 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.336+0000 7f184e000640 1 -- 172.21.15.118:0/4039602428 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f18480d17c0 msgr2=0x7f18480b5a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:07.330 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.336+0000 7f184e000640 1 --2- 172.21.15.118:0/4039602428 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f18480d17c0 0x7f18480b5a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:07.331 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.336+0000 7f184e000640 1 -- 172.21.15.118:0/4039602428 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f184806b540 msgr2=0x7f184815b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:07.331 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.336+0000 7f184e000640 1 --2- 172.21.15.118:0/4039602428 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f184806b540 0x7f184815b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:07.331 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.336+0000 7f184e000640 1 -- 172.21.15.118:0/4039602428 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18480b4f30 con 0x7f18480b5f80 2024-03-27T09:59:07.331 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.336+0000 7f184d600640 1 --2- 172.21.15.118:0/4039602428 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f184806b540 0x7f184815b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T09:59:07.331 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.336+0000 7f184e000640 1 --2- 172.21.15.118:0/4039602428 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f18480b5f80 0x7f18481e8060 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f184000caa0 tx=0x7f184000cf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:07.331 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.336+0000 7f1845600640 1 -- 172.21.15.118:0/4039602428 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1840017070 con 0x7f18480b5f80 2024-03-27T09:59:07.331 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.336+0000 7f1845600640 1 -- 172.21.15.118:0/4039602428 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f184000ac00 con 0x7f18480b5f80 2024-03-27T09:59:07.331 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.336+0000 7f1845600640 1 -- 172.21.15.118:0/4039602428 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1840012400 con 0x7f18480b5f80 2024-03-27T09:59:07.331 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.336+0000 7f184ea00640 1 -- 172.21.15.118:0/4039602428 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18480b43b0 con 0x7f18480b5f80 2024-03-27T09:59:07.332 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.337+0000 7f184ea00640 1 -- 172.21.15.118:0/4039602428 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18480b4970 con 0x7f18480b5f80 2024-03-27T09:59:07.332 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.337+0000 7f1845600640 1 -- 172.21.15.118:0/4039602428 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f184001a070 con 0x7f18480b5f80 2024-03-27T09:59:07.332 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.337+0000 7f1845600640 1 -- 172.21.15.118:0/4039602428 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f18400125a0 con 0x7f18480b5f80 2024-03-27T09:59:07.332 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.338+0000 7f184ea00640 1 -- 172.21.15.118:0/4039602428 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1848068c50 con 0x7f18480b5f80 2024-03-27T09:59:07.332 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-03-27T09:59:07.338+0000 7f26d2616040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-27T09:59:07.332 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.340+0000 7f1845600640 1 -- 172.21.15.118:0/4039602428 <== mon.1 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f18400128c0 con 0x7f18480b5f80 2024-03-27T09:59:07.409 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.418+0000 7f184ea00640 1 -- 172.21.15.118:0/4039602428 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd new", "uuid": "eccff987-8e51-4a63-845a-cf0a3196d7fd", "id": 7} v 0) -- 0x7f18480732c0 con 0x7f18480b5f80 2024-03-27T09:59:07.415 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.425+0000 7f1845600640 1 -- 172.21.15.118:0/4039602428 <== mon.1 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "eccff987-8e51-4a63-845a-cf0a3196d7fd", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f1840012aa0 con 0x7f18480b5f80 2024-03-27T09:59:07.415 INFO:teuthology.orchestra.run.smithi118.stdout:7 2024-03-27T09:59:07.416 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.426+0000 7f184ea00640 1 -- 172.21.15.118:0/4039602428 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f18480b5f80 msgr2=0x7f18481e8060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:07.417 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.426+0000 7f184ea00640 1 --2- 172.21.15.118:0/4039602428 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f18480b5f80 0x7f18481e8060 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f184000caa0 tx=0x7f184000cf60 comp rx=0 tx=0).stop 2024-03-27T09:59:07.417 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.426+0000 7f184ea00640 1 -- 172.21.15.118:0/4039602428 shutdown_connections 2024-03-27T09:59:07.417 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.426+0000 7f184ea00640 1 --2- 172.21.15.118:0/4039602428 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f18480b5f80 0x7f18481e8060 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:07.417 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.426+0000 7f184ea00640 1 --2- 172.21.15.118:0/4039602428 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f18480d17c0 0x7f18480b5a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:07.417 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.426+0000 7f184ea00640 1 --2- 172.21.15.118:0/4039602428 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f184806b540 0x7f184815b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:07.417 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.426+0000 7f184ea00640 1 -- 172.21.15.118:0/4039602428 >> 172.21.15.118:0/4039602428 conn(0x7f18480d0bc0 msgr2=0x7f18480ad8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:07.417 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.426+0000 7f184ea00640 1 -- 172.21.15.118:0/4039602428 shutdown_connections 2024-03-27T09:59:07.417 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T09:59:07.426+0000 7f184ea00640 1 -- 172.21.15.118:0/4039602428 wait complete. 2024-03-27T09:59:07.433 INFO:tasks.ceph.osd.0:Restarting daemon 2024-03-27T09:59:07.433 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-03-27T09:59:07.441 INFO:tasks.ceph.osd.0:Started 2024-03-27T09:59:07.441 INFO:tasks.ceph.osd.1:Restarting daemon 2024-03-27T09:59:07.441 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-03-27T09:59:07.451 INFO:tasks.ceph.osd.1:Started 2024-03-27T09:59:07.451 INFO:tasks.ceph.osd.2:Restarting daemon 2024-03-27T09:59:07.451 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-03-27T09:59:07.458 INFO:tasks.ceph.osd.2:Started 2024-03-27T09:59:07.458 INFO:tasks.ceph.osd.3:Restarting daemon 2024-03-27T09:59:07.458 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-03-27T09:59:07.463 INFO:tasks.ceph.osd.3:Started 2024-03-27T09:59:07.464 INFO:tasks.ceph.osd.4:Restarting daemon 2024-03-27T09:59:07.464 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-03-27T09:59:07.470 INFO:tasks.ceph.osd.4:Started 2024-03-27T09:59:07.470 INFO:tasks.ceph.osd.5:Restarting daemon 2024-03-27T09:59:07.470 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-03-27T09:59:07.475 INFO:tasks.ceph.osd.5:Started 2024-03-27T09:59:07.476 INFO:tasks.ceph.osd.6:Restarting daemon 2024-03-27T09:59:07.476 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-03-27T09:59:07.480 INFO:tasks.ceph.osd.6:Started 2024-03-27T09:59:07.480 INFO:tasks.ceph.osd.7:Restarting daemon 2024-03-27T09:59:07.480 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-03-27T09:59:07.486 INFO:tasks.ceph.osd.7:Started 2024-03-27T09:59:07.486 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-27T09:59:07.486 INFO:tasks.ceph.mgr.x.smithi118.stderr:2024-03-27T09:59:07.492+0000 7fc2fb02b040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-27T09:59:07.532 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-03-27T09:59:07.542+0000 7f26d2616040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-27T09:59:07.542 INFO:tasks.ceph.mgr.x.smithi118.stderr:2024-03-27T09:59:07.552+0000 7fc2fb02b040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-27T09:59:07.699 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:07.708+0000 7ff502400640 1 Processor -- start 2024-03-27T09:59:07.699 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:07.708+0000 7ff502400640 1 -- start start 2024-03-27T09:59:07.701 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:07.709+0000 7ff502400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff4fc15e2b0 0x7ff4fc06ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:07.701 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:07.710+0000 7ff502400640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4fc162a30 con 0x7ff4fc06f120 2024-03-27T09:59:07.701 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:07.710+0000 7ff502400640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4fc0b3780 con 0x7ff4fc15ded0 2024-03-27T09:59:07.701 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:07.710+0000 7ff502400640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7ff4fc162d10 con 0x7ff4fc15e2b0 2024-03-27T09:59:07.701 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:07.710+0000 7ff4fbe00640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7ff4fc06f120 0x7ff4fc161d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:39392/0 (socket says 172.21.15.57:39392) 2024-03-27T09:59:07.701 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:07.710+0000 7ff4f3e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff4fc15e2b0 0x7ff4fc06ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:07.701 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:07.710+0000 7ff4fbe00640 1 -- 172.21.15.57:0/815392644 learned_addr learned my addr 172.21.15.57:0/815392644 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T09:59:07.701 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:07.710+0000 7ff4fb400640 1 --1- 172.21.15.57:0/815392644 >> v1:172.21.15.118:6789/0 conn(0x7ff4fc15ded0 0x7ff4fc0b4260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.57:51640/0 (socket says 172.21.15.57:51640) 2024-03-27T09:59:07.701 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:07.710+0000 7ff4faa00640 1 -- 172.21.15.57:0/815392644 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2432240415 0 0) 0x7ff4fc0b3780 con 0x7ff4fc15ded0 2024-03-27T09:59:07.701 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:07.710+0000 7ff4f3e00640 1 -- 172.21.15.57:0/815392644 >> v1:172.21.15.118:6789/0 conn(0x7ff4fc15ded0 legacy=0x7ff4fc0b4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:07.701 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:07.710+0000 7ff4f3e00640 1 -- 172.21.15.57:0/815392644 >> v1:172.21.15.57:6789/0 conn(0x7ff4fc06f120 legacy=0x7ff4fc161d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:07.702 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:07.710+0000 7ff4f3e00640 1 -- 172.21.15.57:0/815392644 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4fc0b3a60 con 0x7ff4fc15e2b0 2024-03-27T09:59:07.702 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:07.711+0000 7ff4f3e00640 1 --2- 172.21.15.57:0/815392644 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff4fc15e2b0 0x7ff4fc06ebe0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff4e40097d0 tx=0x7ff4e402b770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=44034a3f57f2ff92 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:07.702 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:07.712+0000 7ff4faa00640 1 -- 172.21.15.57:0/815392644 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4e4037070 con 0x7ff4fc15e2b0 2024-03-27T09:59:07.702 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:07.712+0000 7ff4faa00640 1 -- 172.21.15.57:0/815392644 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4e4030710 con 0x7ff4fc15e2b0 2024-03-27T09:59:07.702 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:07.712+0000 7ff4faa00640 1 -- 172.21.15.57:0/815392644 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4e4030ae0 con 0x7ff4fc15e2b0 2024-03-27T09:59:07.703 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:07.712+0000 7ff502400640 1 -- 172.21.15.57:0/815392644 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff4fc15e2b0 msgr2=0x7ff4fc06ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:07.703 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:07.712+0000 7ff502400640 1 --2- 172.21.15.57:0/815392644 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff4fc15e2b0 0x7ff4fc06ebe0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff4e40097d0 tx=0x7ff4e402b770 comp rx=0 tx=0).stop 2024-03-27T09:59:07.703 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:07.712+0000 7ff502400640 1 -- 172.21.15.57:0/815392644 shutdown_connections 2024-03-27T09:59:07.703 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:07.712+0000 7ff502400640 1 --2- 172.21.15.57:0/815392644 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff4fc15e2b0 0x7ff4fc06ebe0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:07.703 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:07.712+0000 7ff502400640 1 -- 172.21.15.57:0/815392644 >> 172.21.15.57:0/815392644 conn(0x7ff4fc0b1c60 msgr2=0x7ff4fc0b2070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:07.703 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:07.712+0000 7ff502400640 1 -- 172.21.15.57:0/815392644 shutdown_connections 2024-03-27T09:59:07.704 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:07.712+0000 7ff502400640 1 -- 172.21.15.57:0/815392644 wait complete. 2024-03-27T09:59:07.704 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:07.714+0000 7ff502400640 1 Processor -- start 2024-03-27T09:59:07.704 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:07.714+0000 7ff502400640 1 -- start start 2024-03-27T09:59:07.707 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:07.715+0000 7ff502400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff4fc06f120 0x7ff4fc14faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:07.707 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:07.715+0000 7ff502400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff4fc15ded0 0x7ff4fc150030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:07.707 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:07.715+0000 7ff502400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff4fc15e2b0 0x7ff4fc15e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:07.707 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:07.715+0000 7ff502400640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7ff4fc162810 con 0x7ff4fc15ded0 2024-03-27T09:59:07.707 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:07.715+0000 7ff502400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7ff4fc162690 con 0x7ff4fc15e2b0 2024-03-27T09:59:07.707 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:07.715+0000 7ff502400640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7ff4fc0b3dd0 con 0x7ff4fc06f120 2024-03-27T09:59:07.708 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:07.715+0000 7ff4f3e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff4fc15ded0 0x7ff4fc150030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:07.708 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:07.715+0000 7ff4fb400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff4fc06f120 0x7ff4fc14faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:07.708 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:07.715+0000 7ff4f3e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff4fc15ded0 0x7ff4fc150030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55124/0 (socket says 172.21.15.57:55124) 2024-03-27T09:59:07.708 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:07.715+0000 7ff4f3e00640 1 -- 172.21.15.57:0/1946920534 learned_addr learned my addr 172.21.15.57:0/1946920534 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T09:59:07.708 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:07.715+0000 7ff4fbe00640 1 --2- 172.21.15.57:0/1946920534 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff4fc15e2b0 0x7ff4fc15e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:07.708 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:07.716+0000 7ff4fb400640 1 -- 172.21.15.57:0/1946920534 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff4fc15e2b0 msgr2=0x7ff4fc15e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:07.708 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:07.716+0000 7ff4fb400640 1 --2- 172.21.15.57:0/1946920534 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff4fc15e2b0 0x7ff4fc15e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:07.708 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:07.716+0000 7ff4fb400640 1 -- 172.21.15.57:0/1946920534 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff4fc15ded0 msgr2=0x7ff4fc150030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:07.708 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:07.716+0000 7ff4fb400640 1 --2- 172.21.15.57:0/1946920534 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff4fc15ded0 0x7ff4fc150030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:07.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:07.716+0000 7ff4fb400640 1 -- 172.21.15.57:0/1946920534 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4fc0cc080 con 0x7ff4fc06f120 2024-03-27T09:59:07.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:07.716+0000 7ff4f3e00640 1 --2- 172.21.15.57:0/1946920534 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff4fc15ded0 0x7ff4fc150030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T09:59:07.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:07.716+0000 7ff4fb400640 1 --2- 172.21.15.57:0/1946920534 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff4fc06f120 0x7ff4fc14faf0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec00c410 tx=0x7ff4ec00c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:07.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:07.716+0000 7ff4f3400640 1 -- 172.21.15.57:0/1946920534 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4ec0074e0 con 0x7ff4fc06f120 2024-03-27T09:59:07.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:07.716+0000 7ff4f3400640 1 -- 172.21.15.57:0/1946920534 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4ec0047e0 con 0x7ff4fc06f120 2024-03-27T09:59:07.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:07.716+0000 7ff4f3400640 1 -- 172.21.15.57:0/1946920534 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4ec004bd0 con 0x7ff4fc06f120 2024-03-27T09:59:07.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:07.716+0000 7ff502400640 1 -- 172.21.15.57:0/1946920534 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4fc0cc340 con 0x7ff4fc06f120 2024-03-27T09:59:07.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:07.717+0000 7ff502400640 1 -- 172.21.15.57:0/1946920534 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4fc0cc900 con 0x7ff4fc06f120 2024-03-27T09:59:07.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:07.717+0000 7ff4f3400640 1 -- 172.21.15.57:0/1946920534 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff4ec011070 con 0x7ff4fc06f120 2024-03-27T09:59:07.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:07.717+0000 7ff4f3400640 1 -- 172.21.15.57:0/1946920534 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7ff4ec004d70 con 0x7ff4fc06f120 2024-03-27T09:59:07.710 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:07.718+0000 7ff502400640 1 -- 172.21.15.57:0/1946920534 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4fc068620 con 0x7ff4fc06f120 2024-03-27T09:59:07.710 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:07.720+0000 7ff4f3400640 1 -- 172.21.15.57:0/1946920534 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7ff4ec01d3f0 con 0x7ff4fc06f120 2024-03-27T09:59:07.754 INFO:tasks.ceph.mgr.x.smithi118.stderr:2024-03-27T09:59:07.764+0000 7fc2fb02b040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-27T09:59:07.777 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:07.787+0000 7ff502400640 1 -- 172.21.15.57:0/1946920534 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff4fc0b4390 con 0x7ff4fc06f120 2024-03-27T09:59:07.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:07.789+0000 7ff4f3400640 1 -- 172.21.15.57:0/1946920534 <== mon.2 v2:172.21.15.118:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7ff4ec01d5d0 con 0x7ff4fc06f120 2024-03-27T09:59:07.779 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T09:59:07.779 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":10,"fsid":"7ac43f86-2c16-4a97-98fb-715d3cebc75c","created":"2024-03-27T09:59:04.033417+0000","modified":"2024-03-27T09:59:07.421690+0000","last_up_change":"0.000000","last_in_change":"2024-03-27T09:59:07.421690+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"47b44362-7302-4f2a-b735-582c6c3850cf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"feaf96f0-9431-4188-9a09-da505b40e934","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"21e406e6-cfbc-4fe7-a816-e2420487c95d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"a389af1d-76c4-4dfc-b215-f983f4931257","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"e9b05dca-557a-43ee-b43f-9ce5b7d28304","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d968177d-44ff-499a-b00a-b147ed879253","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"e8f98052-e6ad-4cfe-a4a9-0b17a434d54e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"eccff987-8e51-4a63-845a-cf0a3196d7fd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-27T09:59:07.781 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:07.790+0000 7ff502400640 1 -- 172.21.15.57:0/1946920534 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff4fc06f120 msgr2=0x7ff4fc14faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:07.781 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:07.790+0000 7ff502400640 1 --2- 172.21.15.57:0/1946920534 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff4fc06f120 0x7ff4fc14faf0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec00c410 tx=0x7ff4ec00c8d0 comp rx=0 tx=0).stop 2024-03-27T09:59:07.781 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:07.790+0000 7ff502400640 1 -- 172.21.15.57:0/1946920534 shutdown_connections 2024-03-27T09:59:07.781 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:07.790+0000 7ff502400640 1 --2- 172.21.15.57:0/1946920534 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff4fc15e2b0 0x7ff4fc15e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:07.781 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:07.790+0000 7ff502400640 1 --2- 172.21.15.57:0/1946920534 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff4fc15ded0 0x7ff4fc150030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:07.781 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:07.790+0000 7ff502400640 1 --2- 172.21.15.57:0/1946920534 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff4fc06f120 0x7ff4fc14faf0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:07.781 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:07.790+0000 7ff502400640 1 -- 172.21.15.57:0/1946920534 >> 172.21.15.57:0/1946920534 conn(0x7ff4fc0b1c60 msgr2=0x7ff4fc071ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:07.781 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:07.790+0000 7ff502400640 1 -- 172.21.15.57:0/1946920534 shutdown_connections 2024-03-27T09:59:07.781 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:07.790+0000 7ff502400640 1 -- 172.21.15.57:0/1946920534 wait complete. 2024-03-27T09:59:07.796 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-03-27T09:59:07.796 INFO:tasks.ceph:Waiting for OSDs to come up 2024-03-27T09:59:08.139 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-03-27T09:59:08.148+0000 7f622fa24640 -1 Falling back to public interface 2024-03-27T09:59:08.158 INFO:tasks.ceph.osd.6.smithi118.stderr:2024-03-27T09:59:08.168+0000 7efe986f9640 -1 Falling back to public interface 2024-03-27T09:59:08.163 INFO:tasks.ceph.osd.1.smithi057.stderr:2024-03-27T09:59:08.173+0000 7f8206a1d640 -1 Falling back to public interface 2024-03-27T09:59:08.174 INFO:tasks.ceph.osd.7.smithi118.stderr:2024-03-27T09:59:08.184+0000 7fdba3f1b640 -1 Falling back to public interface 2024-03-27T09:59:08.175 INFO:tasks.ceph.osd.2.smithi057.stderr:2024-03-27T09:59:08.185+0000 7f1384c0e640 -1 Falling back to public interface 2024-03-27T09:59:08.191 INFO:tasks.ceph.osd.3.smithi057.stderr:2024-03-27T09:59:08.201+0000 7f00a3a0d640 -1 Falling back to public interface 2024-03-27T09:59:08.197 INFO:tasks.ceph.osd.5.smithi118.stderr:2024-03-27T09:59:08.207+0000 7fa84ff6f640 -1 Falling back to public interface 2024-03-27T09:59:08.201 INFO:tasks.ceph.osd.4.smithi118.stderr:2024-03-27T09:59:08.211+0000 7f373b411640 -1 Falling back to public interface 2024-03-27T09:59:08.602 DEBUG:teuthology.orchestra.run.smithi057:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-27T09:59:08.632 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-03-27T09:59:08.641+0000 7f26d2616040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-27T09:59:08.765 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:08.774+0000 7fce7de00640 1 Processor -- start 2024-03-27T09:59:08.765 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:08.775+0000 7fce7de00640 1 -- start start 2024-03-27T09:59:08.768 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:08.776+0000 7fce7de00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fce780b9b70 0x7fce780ceeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:08.768 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:08.776+0000 7fce7de00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fce780d3bc0 0x7fce780cf3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:08.768 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:08.777+0000 7fce7de00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce780d2b20 con 0x7fce7815e4d0 2024-03-27T09:59:08.768 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:08.777+0000 7fce7de00640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7fce780d3730 con 0x7fce780b9b70 2024-03-27T09:59:08.768 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:08.777+0000 7fce7de00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fce780d2e00 con 0x7fce780d3bc0 2024-03-27T09:59:08.768 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:08.777+0000 7fce6fe00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fce780b9b70 0x7fce780ceeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:08.768 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:08.777+0000 7fce6fe00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fce780b9b70 0x7fce780ceeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55132/0 (socket says 172.21.15.57:55132) 2024-03-27T09:59:08.769 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:08.777+0000 7fce6fe00640 1 -- 172.21.15.57:0/2980813138 learned_addr learned my addr 172.21.15.57:0/2980813138 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T09:59:08.769 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:08.777+0000 7fce77400640 1 --2- 172.21.15.57:0/2980813138 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fce780d3bc0 0x7fce780cf3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:08.769 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:08.777+0000 7fce6fe00640 1 -- 172.21.15.57:0/2980813138 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fce780d3bc0 msgr2=0x7fce780cf3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T09:59:08.769 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:08.777+0000 7fce6fe00640 1 --2- 172.21.15.57:0/2980813138 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fce780d3bc0 0x7fce780cf3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:08.769 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:08.777+0000 7fce6fe00640 1 -- 172.21.15.57:0/2980813138 >> v1:172.21.15.118:6789/0 conn(0x7fce7815e4d0 legacy=0x7fce780d22d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:08.769 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:08.777+0000 7fce6fe00640 1 -- 172.21.15.57:0/2980813138 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce780d30e0 con 0x7fce780b9b70 2024-03-27T09:59:08.770 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:08.778+0000 7fce6fe00640 1 --2- 172.21.15.57:0/2980813138 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fce780b9b70 0x7fce780ceeb0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fce60009870 tx=0x7fce6002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b5d80a561dc901f server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:08.770 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:08.779+0000 7fce76000640 1 -- 172.21.15.57:0/2980813138 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce60034070 con 0x7fce780b9b70 2024-03-27T09:59:08.770 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:08.779+0000 7fce76000640 1 -- 172.21.15.57:0/2980813138 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce60030840 con 0x7fce780b9b70 2024-03-27T09:59:08.770 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:08.779+0000 7fce76000640 1 -- 172.21.15.57:0/2980813138 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce60030c10 con 0x7fce780b9b70 2024-03-27T09:59:08.770 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:08.779+0000 7fce7de00640 1 -- 172.21.15.57:0/2980813138 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fce780b9b70 msgr2=0x7fce780ceeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:08.770 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:08.779+0000 7fce7de00640 1 --2- 172.21.15.57:0/2980813138 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fce780b9b70 0x7fce780ceeb0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fce60009870 tx=0x7fce6002b980 comp rx=0 tx=0).stop 2024-03-27T09:59:08.771 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:08.780+0000 7fce7de00640 1 -- 172.21.15.57:0/2980813138 shutdown_connections 2024-03-27T09:59:08.771 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:08.780+0000 7fce7de00640 1 --2- 172.21.15.57:0/2980813138 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fce780d3bc0 0x7fce780cf3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:08.771 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:08.780+0000 7fce7de00640 1 --2- 172.21.15.57:0/2980813138 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fce780b9b70 0x7fce780ceeb0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:08.771 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:08.780+0000 7fce7de00640 1 -- 172.21.15.57:0/2980813138 >> 172.21.15.57:0/2980813138 conn(0x7fce780b6320 msgr2=0x7fce780d41e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:08.771 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:08.780+0000 7fce7de00640 1 -- 172.21.15.57:0/2980813138 shutdown_connections 2024-03-27T09:59:08.771 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:08.780+0000 7fce7de00640 1 -- 172.21.15.57:0/2980813138 wait complete. 2024-03-27T09:59:08.771 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:08.781+0000 7fce7de00640 1 Processor -- start 2024-03-27T09:59:08.772 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:08.781+0000 7fce7de00640 1 -- start start 2024-03-27T09:59:08.774 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:08.782+0000 7fce7de00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce780b9b70 0x7fce781f8450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:08.774 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:08.782+0000 7fce7de00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fce780d3bc0 0x7fce7815f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:08.774 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:08.782+0000 7fce7de00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fce7815e4d0 0x7fce780cd6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:08.774 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:08.782+0000 7fce7de00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fce780b7500 con 0x7fce780d3bc0 2024-03-27T09:59:08.774 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:08.782+0000 7fce7de00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fce780b7380 con 0x7fce780b9b70 2024-03-27T09:59:08.774 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:08.782+0000 7fce7de00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fce780b7680 con 0x7fce7815e4d0 2024-03-27T09:59:08.774 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:08.783+0000 7fce6fe00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fce780d3bc0 0x7fce7815f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:08.775 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:08.783+0000 7fce6fe00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fce780d3bc0 0x7fce7815f240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55136/0 (socket says 172.21.15.57:55136) 2024-03-27T09:59:08.775 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:08.783+0000 7fce6fe00640 1 -- 172.21.15.57:0/2164762549 learned_addr learned my addr 172.21.15.57:0/2164762549 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T09:59:08.775 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:08.783+0000 7fce76a00640 1 --2- 172.21.15.57:0/2164762549 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce780b9b70 0x7fce781f8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:08.775 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:08.783+0000 7fce6fe00640 1 -- 172.21.15.57:0/2164762549 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fce7815e4d0 msgr2=0x7fce780cd6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:08.775 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:08.783+0000 7fce6fe00640 1 --2- 172.21.15.57:0/2164762549 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fce7815e4d0 0x7fce780cd6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:08.775 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:08.783+0000 7fce6fe00640 1 -- 172.21.15.57:0/2164762549 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce780b9b70 msgr2=0x7fce781f8450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:08.775 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:08.783+0000 7fce6fe00640 1 --2- 172.21.15.57:0/2164762549 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce780b9b70 0x7fce781f8450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:08.775 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:08.783+0000 7fce6fe00640 1 -- 172.21.15.57:0/2164762549 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce7815f970 con 0x7fce780d3bc0 2024-03-27T09:59:08.775 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:08.783+0000 7fce6fe00640 1 --2- 172.21.15.57:0/2164762549 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fce780d3bc0 0x7fce7815f240 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fce60000c00 tx=0x7fce60004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:08.775 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:08.784+0000 7fce6f400640 1 -- 172.21.15.57:0/2164762549 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce60048070 con 0x7fce780d3bc0 2024-03-27T09:59:08.775 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:08.784+0000 7fce6f400640 1 -- 172.21.15.57:0/2164762549 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce60030640 con 0x7fce780d3bc0 2024-03-27T09:59:08.775 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:08.784+0000 7fce6f400640 1 -- 172.21.15.57:0/2164762549 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce60034040 con 0x7fce780d3bc0 2024-03-27T09:59:08.775 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:08.784+0000 7fce7de00640 1 -- 172.21.15.57:0/2164762549 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce7815fc50 con 0x7fce780d3bc0 2024-03-27T09:59:08.775 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:08.784+0000 7fce7de00640 1 -- 172.21.15.57:0/2164762549 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce780cdc30 con 0x7fce780d3bc0 2024-03-27T09:59:08.776 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:08.784+0000 7fce6f400640 1 -- 172.21.15.57:0/2164762549 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fce60037070 con 0x7fce780d3bc0 2024-03-27T09:59:08.776 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:08.784+0000 7fce6f400640 1 -- 172.21.15.57:0/2164762549 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fce60043640 con 0x7fce780d3bc0 2024-03-27T09:59:08.776 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:08.785+0000 7fce7de00640 1 -- 172.21.15.57:0/2164762549 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce78068e70 con 0x7fce780d3bc0 2024-03-27T09:59:08.778 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:08.788+0000 7fce6f400640 1 -- 172.21.15.57:0/2164762549 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fce60051020 con 0x7fce780d3bc0 2024-03-27T09:59:08.825 INFO:tasks.ceph.mgr.x.smithi118.stderr:2024-03-27T09:59:08.834+0000 7fc2fb02b040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-27T09:59:08.843 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:08.852+0000 7fce7de00640 1 -- 172.21.15.57:0/2164762549 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fce78067870 con 0x7fce780d3bc0 2024-03-27T09:59:08.844 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:08.854+0000 7fce6f400640 1 -- 172.21.15.57:0/2164762549 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fce600307f0 con 0x7fce780d3bc0 2024-03-27T09:59:08.844 INFO:teuthology.misc.health.smithi057.stdout: 2024-03-27T09:59:08.844 INFO:teuthology.misc.health.smithi057.stdout:{"epoch":10,"fsid":"7ac43f86-2c16-4a97-98fb-715d3cebc75c","created":"2024-03-27T09:59:04.033417+0000","modified":"2024-03-27T09:59:07.421690+0000","last_up_change":"0.000000","last_in_change":"2024-03-27T09:59:07.421690+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"47b44362-7302-4f2a-b735-582c6c3850cf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"feaf96f0-9431-4188-9a09-da505b40e934","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"21e406e6-cfbc-4fe7-a816-e2420487c95d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"a389af1d-76c4-4dfc-b215-f983f4931257","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"e9b05dca-557a-43ee-b43f-9ce5b7d28304","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d968177d-44ff-499a-b00a-b147ed879253","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"e8f98052-e6ad-4cfe-a4a9-0b17a434d54e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"eccff987-8e51-4a63-845a-cf0a3196d7fd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-27T09:59:08.846 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:08.855+0000 7fce7de00640 1 -- 172.21.15.57:0/2164762549 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fce780d3bc0 msgr2=0x7fce7815f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:08.846 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:08.855+0000 7fce7de00640 1 --2- 172.21.15.57:0/2164762549 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fce780d3bc0 0x7fce7815f240 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fce60000c00 tx=0x7fce60004730 comp rx=0 tx=0).stop 2024-03-27T09:59:08.846 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:08.855+0000 7fce7de00640 1 -- 172.21.15.57:0/2164762549 shutdown_connections 2024-03-27T09:59:08.846 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:08.855+0000 7fce7de00640 1 --2- 172.21.15.57:0/2164762549 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fce7815e4d0 0x7fce780cd6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:08.846 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:08.855+0000 7fce7de00640 1 --2- 172.21.15.57:0/2164762549 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fce780d3bc0 0x7fce7815f240 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:08.846 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:08.855+0000 7fce7de00640 1 --2- 172.21.15.57:0/2164762549 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fce780b9b70 0x7fce781f8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:08.846 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:08.855+0000 7fce7de00640 1 -- 172.21.15.57:0/2164762549 >> 172.21.15.57:0/2164762549 conn(0x7fce780b6320 msgr2=0x7fce780d2260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:08.846 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:08.855+0000 7fce7de00640 1 -- 172.21.15.57:0/2164762549 shutdown_connections 2024-03-27T09:59:08.846 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:08.855+0000 7fce7de00640 1 -- 172.21.15.57:0/2164762549 wait complete. 2024-03-27T09:59:08.858 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-03-27T09:59:08.973 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-03-27T09:59:08.982+0000 7f26d2616040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-27T09:59:09.039 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-03-27T09:59:09.048+0000 7f26d2616040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-27T09:59:09.138 INFO:tasks.ceph.mgr.x.smithi118.stderr:2024-03-27T09:59:09.148+0000 7fc2fb02b040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-27T09:59:09.176 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-03-27T09:59:09.186+0000 7f26d2616040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-27T09:59:09.201 INFO:tasks.ceph.mgr.x.smithi118.stderr:2024-03-27T09:59:09.211+0000 7fc2fb02b040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-27T09:59:09.339 INFO:tasks.ceph.mgr.x.smithi118.stderr:2024-03-27T09:59:09.349+0000 7fc2fb02b040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-27T09:59:10.224 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-03-27T09:59:10.234+0000 7f2672a00640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-03-27T09:59:10.225 INFO:tasks.ceph.mgr.y.smithi057.stderr:2024-03-27T09:59:10.235+0000 7f2672a00640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-03-27T09:59:11.668 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-03-27T09:59:11.677+0000 7f622fa24640 -1 osd.0 0 log_to_monitors true 2024-03-27T09:59:11.708 INFO:tasks.ceph.osd.7.smithi118.stderr:2024-03-27T09:59:11.718+0000 7fdba3f1b640 -1 osd.7 0 log_to_monitors true 2024-03-27T09:59:11.732 INFO:tasks.ceph.osd.1.smithi057.stderr:2024-03-27T09:59:11.741+0000 7f8206a1d640 -1 osd.1 0 log_to_monitors true 2024-03-27T09:59:11.751 INFO:tasks.ceph.osd.2.smithi057.stderr:2024-03-27T09:59:11.761+0000 7f1384c0e640 -1 osd.2 0 log_to_monitors true 2024-03-27T09:59:11.754 INFO:tasks.ceph.osd.4.smithi118.stderr:2024-03-27T09:59:11.764+0000 7f373b411640 -1 osd.4 0 log_to_monitors true 2024-03-27T09:59:11.774 INFO:tasks.ceph.osd.3.smithi057.stderr:2024-03-27T09:59:11.784+0000 7f00a3a0d640 -1 osd.3 0 log_to_monitors true 2024-03-27T09:59:11.784 INFO:tasks.ceph.osd.5.smithi118.stderr:2024-03-27T09:59:11.794+0000 7fa84ff6f640 -1 osd.5 0 log_to_monitors true 2024-03-27T09:59:11.965 INFO:tasks.ceph.osd.6.smithi118.stderr:2024-03-27T09:59:11.975+0000 7efe986f9640 -1 osd.6 0 log_to_monitors true 2024-03-27T09:59:14.908 INFO:tasks.ceph.osd.5.smithi118.stderr:2024-03-27T09:59:14.916+0000 7fa84ae00640 -1 osd.5 0 waiting for initial osdmap 2024-03-27T09:59:14.920 INFO:tasks.ceph.osd.5.smithi118.stderr:2024-03-27T09:59:14.930+0000 7fa840e00640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-27T09:59:14.924 INFO:tasks.ceph.osd.7.smithi118.stderr:2024-03-27T09:59:14.934+0000 7fdb9f800640 -1 osd.7 0 waiting for initial osdmap 2024-03-27T09:59:14.936 INFO:tasks.ceph.osd.7.smithi118.stderr:2024-03-27T09:59:14.946+0000 7fdb94e00640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-27T09:59:14.944 INFO:tasks.ceph.osd.4.smithi118.stderr:2024-03-27T09:59:14.955+0000 7f3736200640 -1 osd.4 0 waiting for initial osdmap 2024-03-27T09:59:14.945 INFO:tasks.ceph.osd.6.smithi118.stderr:2024-03-27T09:59:14.956+0000 7efe94000640 -1 osd.6 0 waiting for initial osdmap 2024-03-27T09:59:14.951 INFO:tasks.ceph.osd.4.smithi118.stderr:2024-03-27T09:59:14.961+0000 7f372c200640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-27T09:59:14.951 INFO:tasks.ceph.osd.6.smithi118.stderr:2024-03-27T09:59:14.962+0000 7efe89600640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-27T09:59:15.665 DEBUG:teuthology.orchestra.run.smithi057:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-27T09:59:15.897 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:15.904+0000 7f0cc2e00640 1 Processor -- start 2024-03-27T09:59:15.897 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:15.904+0000 7f0cc2e00640 1 -- start start 2024-03-27T09:59:15.897 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:15.907+0000 7f0cc2e00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0cbc0b37f0 0x7f0cbc161f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:15.897 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:15.907+0000 7f0cc2e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0cbc0cf9b0 0x7f0cbc164470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:15.898 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:15.907+0000 7f0cbbe00640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f0cbc071cd0 0x7f0cbc0720b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.57:46170/0 (socket says 172.21.15.57:46170) 2024-03-27T09:59:15.900 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:15.910+0000 7f0cbb400640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0cbc0b37f0 0x7f0cbc161f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:15.900 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:15.910+0000 7f0cbb400640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0cbc0b37f0 0x7f0cbc161f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55466/0 (socket says 172.21.15.57:55466) 2024-03-27T09:59:15.901 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:15.910+0000 7f0cbbe00640 1 -- 172.21.15.57:0/1246766940 learned_addr learned my addr 172.21.15.57:0/1246766940 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T09:59:15.901 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:15.910+0000 7f0cc2e00640 1 -- 172.21.15.57:0/1246766940 --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0cbc0b3c80 con 0x7f0cbc071cd0 2024-03-27T09:59:15.901 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:15.910+0000 7f0cc2e00640 1 -- 172.21.15.57:0/1246766940 --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f0cbc06d490 con 0x7f0cbc0b37f0 2024-03-27T09:59:15.901 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:15.910+0000 7f0cc2e00640 1 -- 172.21.15.57:0/1246766940 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f0cbc06da50 con 0x7f0cbc0cf9b0 2024-03-27T09:59:15.905 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:15.911+0000 7f0cc0e00640 1 --2- 172.21.15.57:0/1246766940 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0cbc0cf9b0 0x7f0cbc164470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:15.905 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:15.912+0000 7f0cc0e00640 1 -- 172.21.15.57:0/1246766940 >> v2:172.21.15.57:3300/0 conn(0x7f0cbc0b37f0 msgr2=0x7f0cbc161f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T09:59:15.905 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:15.914+0000 7f0cc0e00640 1 --2- 172.21.15.57:0/1246766940 >> v2:172.21.15.57:3300/0 conn(0x7f0cbc0b37f0 0x7f0cbc161f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:15.905 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:15.915+0000 7f0cbaa00640 1 -- 172.21.15.57:0/1246766940 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 574647916 0 0) 0x7f0cbc0b3c80 con 0x7f0cbc071cd0 2024-03-27T09:59:15.907 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:15.914+0000 7f0cc0e00640 1 -- 172.21.15.57:0/1246766940 >> v1:172.21.15.118:6789/0 conn(0x7f0cbc071cd0 legacy=0x7f0cbc0720b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:15.907 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:15.915+0000 7f0cc0e00640 1 -- 172.21.15.57:0/1246766940 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cbc0b3f60 con 0x7f0cbc0cf9b0 2024-03-27T09:59:15.907 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:15.915+0000 7f0cbb400640 1 --2- 172.21.15.57:0/1246766940 >> v2:172.21.15.57:3300/0 conn(0x7f0cbc0b37f0 0x7f0cbc161f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T09:59:15.907 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:15.917+0000 7f0cc0e00640 1 --2- 172.21.15.57:0/1246766940 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0cbc0cf9b0 0x7f0cbc164470 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0ca400f9b0 tx=0x7f0ca402fcc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=169e61e795e21c45 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:15.908 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:15.918+0000 7f0cbaa00640 1 -- 172.21.15.57:0/1246766940 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ca403d070 con 0x7f0cbc0cf9b0 2024-03-27T09:59:15.909 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:15.919+0000 7f0cbaa00640 1 -- 172.21.15.57:0/1246766940 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ca4030a70 con 0x7f0cbc0cf9b0 2024-03-27T09:59:15.910 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:15.919+0000 7f0cbaa00640 1 -- 172.21.15.57:0/1246766940 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ca4030e40 con 0x7f0cbc0cf9b0 2024-03-27T09:59:15.910 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:15.920+0000 7f0cc2e00640 1 -- 172.21.15.57:0/1246766940 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0cbc0cf9b0 msgr2=0x7f0cbc164470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:15.910 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:15.920+0000 7f0cc2e00640 1 --2- 172.21.15.57:0/1246766940 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0cbc0cf9b0 0x7f0cbc164470 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0ca400f9b0 tx=0x7f0ca402fcc0 comp rx=0 tx=0).stop 2024-03-27T09:59:15.911 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:15.920+0000 7f0cc2e00640 1 -- 172.21.15.57:0/1246766940 shutdown_connections 2024-03-27T09:59:15.911 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:15.921+0000 7f0cc2e00640 1 --2- 172.21.15.57:0/1246766940 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0cbc0cf9b0 0x7f0cbc164470 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:15.911 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:15.921+0000 7f0cc2e00640 1 --2- 172.21.15.57:0/1246766940 >> v2:172.21.15.57:3300/0 conn(0x7f0cbc0b37f0 0x7f0cbc161f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:15.911 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:15.921+0000 7f0cc2e00640 1 -- 172.21.15.57:0/1246766940 >> 172.21.15.57:0/1246766940 conn(0x7f0cbc06b570 msgr2=0x7f0cbc06b980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:15.912 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:15.921+0000 7f0cc2e00640 1 -- 172.21.15.57:0/1246766940 shutdown_connections 2024-03-27T09:59:15.912 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:15.921+0000 7f0cc2e00640 1 -- 172.21.15.57:0/1246766940 wait complete. 2024-03-27T09:59:15.918 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:15.928+0000 7f0cc2e00640 1 Processor -- start 2024-03-27T09:59:15.918 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:15.928+0000 7f0cc2e00640 1 -- start start 2024-03-27T09:59:15.920 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:15.930+0000 7f0cc2e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0cbc071cd0 0x7f0cbc14ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:15.921 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:15.931+0000 7f0cc2e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0cbc0cf9b0 0x7f0cbc156df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:15.922 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:15.931+0000 7f0cc2e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0cbc157330 0x7f0cbc1590f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:15.922 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:15.931+0000 7f0cc2e00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f0cbc06f570 con 0x7f0cbc157330 2024-03-27T09:59:15.922 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:15.931+0000 7f0cc2e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f0cbc06f3f0 con 0x7f0cbc0cf9b0 2024-03-27T09:59:15.922 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:15.931+0000 7f0cc2e00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f0cbc0cc970 con 0x7f0cbc071cd0 2024-03-27T09:59:15.922 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:15.932+0000 7f0cbbe00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0cbc071cd0 0x7f0cbc14ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:15.922 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:15.932+0000 7f0cbbe00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0cbc071cd0 0x7f0cbc14ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.57:43026/0 (socket says 172.21.15.57:43026) 2024-03-27T09:59:15.922 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:15.932+0000 7f0cbbe00640 1 -- 172.21.15.57:0/1765964176 learned_addr learned my addr 172.21.15.57:0/1765964176 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T09:59:15.922 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:15.932+0000 7f0cc0e00640 1 --2- 172.21.15.57:0/1765964176 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0cbc157330 0x7f0cbc1590f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:15.923 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:15.932+0000 7f0cbb400640 1 --2- 172.21.15.57:0/1765964176 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0cbc0cf9b0 0x7f0cbc156df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:15.923 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:15.932+0000 7f0cc0e00640 1 -- 172.21.15.57:0/1765964176 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0cbc071cd0 msgr2=0x7f0cbc14ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:15.924 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:15.932+0000 7f0cc0e00640 1 --2- 172.21.15.57:0/1765964176 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0cbc071cd0 0x7f0cbc14ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:15.925 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:15.934+0000 7f0cc0e00640 1 -- 172.21.15.57:0/1765964176 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0cbc0cf9b0 msgr2=0x7f0cbc156df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:15.925 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:15.934+0000 7f0cc0e00640 1 --2- 172.21.15.57:0/1765964176 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0cbc0cf9b0 0x7f0cbc156df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:15.926 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:15.934+0000 7f0cc0e00640 1 -- 172.21.15.57:0/1765964176 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cbc151090 con 0x7f0cbc157330 2024-03-27T09:59:15.926 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:15.934+0000 7f0cbb400640 1 --2- 172.21.15.57:0/1765964176 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0cbc0cf9b0 0x7f0cbc156df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T09:59:15.926 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:15.935+0000 7f0cc0e00640 1 --2- 172.21.15.57:0/1765964176 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0cbc157330 0x7f0cbc1590f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0ca4037000 tx=0x7f0ca40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:15.926 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:15.935+0000 7f0cb3e00640 1 -- 172.21.15.57:0/1765964176 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ca403d030 con 0x7f0cbc157330 2024-03-27T09:59:15.926 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:15.935+0000 7f0cb3e00640 1 -- 172.21.15.57:0/1765964176 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ca4030870 con 0x7f0cbc157330 2024-03-27T09:59:15.926 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:15.935+0000 7f0cb3e00640 1 -- 172.21.15.57:0/1765964176 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ca4041670 con 0x7f0cbc157330 2024-03-27T09:59:15.929 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:15.938+0000 7f0cc2e00640 1 -- 172.21.15.57:0/1765964176 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cbc159cf0 con 0x7f0cbc157330 2024-03-27T09:59:15.929 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:15.938+0000 7f0cc2e00640 1 -- 172.21.15.57:0/1765964176 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cbc15bda0 con 0x7f0cbc157330 2024-03-27T09:59:15.935 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:15.945+0000 7f0cc2e00640 1 -- 172.21.15.57:0/1765964176 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0cbc15bbc0 con 0x7f0cbc157330 2024-03-27T09:59:15.939 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:15.947+0000 7f0cb3e00640 1 -- 172.21.15.57:0/1765964176 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 4) ==== 90800+0+0 (secure 0 0 0) 0x7f0ca4048060 con 0x7f0cbc157330 2024-03-27T09:59:15.939 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:15.948+0000 7f0cb3e00640 1 --2- 172.21.15.57:0/1765964176 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f0c9806c4f0 0x7f0c9806e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:15.939 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:15.948+0000 7f0cb3e00640 1 -- 172.21.15.57:0/1765964176 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 3351+0+0 (secure 0 0 0) 0x7f0ca40ac1b0 con 0x7f0cbc157330 2024-03-27T09:59:15.939 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:15.949+0000 7f0cbbe00640 1 --2- 172.21.15.57:0/1765964176 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f0c9806c4f0 0x7f0c9806e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:15.941 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:15.951+0000 7f0cbbe00640 1 --2- 172.21.15.57:0/1765964176 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f0c9806c4f0 0x7f0c9806e9b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0cac000f60 tx=0x7f0cac007ea0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:15.952 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:15.961+0000 7f0cb3e00640 1 -- 172.21.15.57:0/1765964176 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f0cbc15bbc0 con 0x7f0cbc157330 2024-03-27T09:59:15.961 INFO:tasks.ceph.osd.1.smithi057.stderr:2024-03-27T09:59:15.971+0000 7f8201200640 -1 osd.1 0 waiting for initial osdmap 2024-03-27T09:59:15.966 INFO:tasks.ceph.osd.2.smithi057.stderr:2024-03-27T09:59:15.976+0000 7f137f400640 -1 osd.2 0 waiting for initial osdmap 2024-03-27T09:59:15.973 INFO:tasks.ceph.osd.1.smithi057.stderr:2024-03-27T09:59:15.983+0000 7f81f7200640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-27T09:59:15.983 INFO:tasks.ceph.osd.2.smithi057.stderr:2024-03-27T09:59:15.992+0000 7f1375400640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-27T09:59:15.993 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-03-27T09:59:16.003+0000 7f622a400640 -1 osd.0 0 waiting for initial osdmap 2024-03-27T09:59:16.004 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-03-27T09:59:16.014+0000 7f6220400640 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-27T09:59:16.028 INFO:tasks.ceph.osd.3.smithi057.stderr:2024-03-27T09:59:16.038+0000 7f009e200640 -1 osd.3 0 waiting for initial osdmap 2024-03-27T09:59:16.034 INFO:tasks.ceph.osd.3.smithi057.stderr:2024-03-27T09:59:16.044+0000 7f0094200640 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-27T09:59:16.164 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:16.174+0000 7f0cc2e00640 1 -- 172.21.15.57:0/1765964176 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0cbc068e70 con 0x7f0cbc157330 2024-03-27T09:59:16.165 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:16.175+0000 7f0cb3e00640 1 -- 172.21.15.57:0/1765964176 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) ==== 74+0+9013 (secure 0 0 0) 0x7f0ca407b1c0 con 0x7f0cbc157330 2024-03-27T09:59:16.166 INFO:teuthology.misc.health.smithi057.stdout: 2024-03-27T09:59:16.166 INFO:teuthology.misc.health.smithi057.stdout:{"epoch":13,"fsid":"7ac43f86-2c16-4a97-98fb-715d3cebc75c","created":"2024-03-27T09:59:04.033417+0000","modified":"2024-03-27T09:59:15.924782+0000","last_up_change":"2024-03-27T09:59:15.924782+0000","last_in_change":"2024-03-27T09:59:07.421690+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"47b44362-7302-4f2a-b735-582c6c3850cf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"feaf96f0-9431-4188-9a09-da505b40e934","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"21e406e6-cfbc-4fe7-a816-e2420487c95d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"a389af1d-76c4-4dfc-b215-f983f4931257","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"e9b05dca-557a-43ee-b43f-9ce5b7d28304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6823","nonce":108719401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6827","nonce":108719401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6831","nonce":108719401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6829","nonce":108719401}]},"public_addr":"172.21.15.118:6823/108719401","cluster_addr":"172.21.15.118:6827/108719401","heartbeat_back_addr":"172.21.15.118:6831/108719401","heartbeat_front_addr":"172.21.15.118:6829/108719401","state":["exists","up"]},{"osd":5,"uuid":"d968177d-44ff-499a-b00a-b147ed879253","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6817","nonce":2704605866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6819","nonce":2704605866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6826","nonce":2704605866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6822","nonce":2704605866}]},"public_addr":"172.21.15.118:6817/2704605866","cluster_addr":"172.21.15.118:6819/2704605866","heartbeat_back_addr":"172.21.15.118:6826/2704605866","heartbeat_front_addr":"172.21.15.118:6822/2704605866","state":["exists","up"]},{"osd":6,"uuid":"e8f98052-e6ad-4cfe-a4a9-0b17a434d54e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6801","nonce":1963659095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6803","nonce":1963659095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6807","nonce":1963659095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6805","nonce":1963659095}]},"public_addr":"172.21.15.118:6801/1963659095","cluster_addr":"172.21.15.118:6803/1963659095","heartbeat_back_addr":"172.21.15.118:6807/1963659095","heartbeat_front_addr":"172.21.15.118:6805/1963659095","state":["exists","up"]},{"osd":7,"uuid":"eccff987-8e51-4a63-845a-cf0a3196d7fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6809","nonce":1955879596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6811","nonce":1955879596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6815","nonce":1955879596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6813","nonce":1955879596}]},"public_addr":"172.21.15.118:6809/1955879596","cluster_addr":"172.21.15.118:6811/1955879596","heartbeat_back_addr":"172.21.15.118:6815/1955879596","heartbeat_front_addr":"172.21.15.118:6813/1955879596","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-27T09:59:16.168 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:16.177+0000 7f0cc2e00640 1 -- 172.21.15.57:0/1765964176 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f0c9806c4f0 msgr2=0x7f0c9806e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:16.168 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:16.177+0000 7f0cc2e00640 1 --2- 172.21.15.57:0/1765964176 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f0c9806c4f0 0x7f0c9806e9b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0cac000f60 tx=0x7f0cac007ea0 comp rx=0 tx=0).stop 2024-03-27T09:59:16.168 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:16.177+0000 7f0cc2e00640 1 -- 172.21.15.57:0/1765964176 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0cbc157330 msgr2=0x7f0cbc1590f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:16.168 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:16.177+0000 7f0cc2e00640 1 --2- 172.21.15.57:0/1765964176 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0cbc157330 0x7f0cbc1590f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0ca4037000 tx=0x7f0ca40046c0 comp rx=0 tx=0).stop 2024-03-27T09:59:16.168 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:16.178+0000 7f0cc2e00640 1 -- 172.21.15.57:0/1765964176 shutdown_connections 2024-03-27T09:59:16.169 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:16.178+0000 7f0cc2e00640 1 --2- 172.21.15.57:0/1765964176 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0cbc157330 0x7f0cbc1590f0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:16.169 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:16.178+0000 7f0cc2e00640 1 --2- 172.21.15.57:0/1765964176 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f0c9806c4f0 0x7f0c9806e9b0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:16.169 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:16.178+0000 7f0cc2e00640 1 --2- 172.21.15.57:0/1765964176 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0cbc0cf9b0 0x7f0cbc156df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:16.169 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:16.178+0000 7f0cc2e00640 1 --2- 172.21.15.57:0/1765964176 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0cbc071cd0 0x7f0cbc14ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:16.169 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:16.178+0000 7f0cc2e00640 1 -- 172.21.15.57:0/1765964176 >> 172.21.15.57:0/1765964176 conn(0x7f0cbc06b570 msgr2=0x7f0cbc0b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:16.169 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:16.178+0000 7f0cc2e00640 1 -- 172.21.15.57:0/1765964176 shutdown_connections 2024-03-27T09:59:16.169 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:16.178+0000 7f0cc2e00640 1 -- 172.21.15.57:0/1765964176 wait complete. 2024-03-27T09:59:16.181 DEBUG:teuthology.misc:4 of 8 OSDs are up 2024-03-27T09:59:17.242 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T09:59:17.248 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T09:59:22.988 DEBUG:teuthology.orchestra.run.smithi057:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-27T09:59:23.182 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:23.191+0000 7fe0db200640 1 Processor -- start 2024-03-27T09:59:23.182 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:23.192+0000 7fe0db200640 1 -- start start 2024-03-27T09:59:23.184 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:23.193+0000 7fe0db200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe0dc0b9c50 0x7fe0dc0cec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:23.184 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:23.193+0000 7fe0db200640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0dc0b7300 con 0x7fe0dc15e140 2024-03-27T09:59:23.184 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:23.194+0000 7fe0db200640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0dc0d3380 con 0x7fe0dc0cf1d0 2024-03-27T09:59:23.184 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:23.194+0000 7fe0db200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fe0dc0cf600 con 0x7fe0dc0b9c50 2024-03-27T09:59:23.184 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:23.194+0000 7fe0d9e00640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fe0dc15e140 0x7fe0dc0d2af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:48006/0 (socket says 172.21.15.57:48006) 2024-03-27T09:59:23.184 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:23.194+0000 7fe0d9e00640 1 -- 172.21.15.57:0/3956153700 learned_addr learned my addr 172.21.15.57:0/3956153700 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T09:59:23.185 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:23.194+0000 7fe0d8a00640 1 -- 172.21.15.57:0/3956153700 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 778463697 0 0) 0x7fe0dc0b7300 con 0x7fe0dc15e140 2024-03-27T09:59:23.185 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:23.194+0000 7fe0d9400640 1 --2- 172.21.15.57:0/3956153700 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe0dc0b9c50 0x7fe0dc0cec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:23.185 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:23.194+0000 7fe0d8a00640 1 -- 172.21.15.57:0/3956153700 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe0c0003520 con 0x7fe0dc15e140 2024-03-27T09:59:23.186 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:23.195+0000 7fe0d8a00640 1 -- 172.21.15.57:0/3956153700 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1745174500 0 0) 0x7fe0dc0d3380 con 0x7fe0dc0cf1d0 2024-03-27T09:59:23.186 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:23.195+0000 7fe0d8a00640 1 -- 172.21.15.57:0/3956153700 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe0dc0b7300 con 0x7fe0dc0cf1d0 2024-03-27T09:59:23.186 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:23.195+0000 7fe0d9400640 1 -- 172.21.15.57:0/3956153700 >> v1:172.21.15.118:6789/0 conn(0x7fe0dc0cf1d0 legacy=0x7fe0dc0b77b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:23.186 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:23.195+0000 7fe0d9400640 1 -- 172.21.15.57:0/3956153700 >> v1:172.21.15.57:6789/0 conn(0x7fe0dc15e140 legacy=0x7fe0dc0d2af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:23.186 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:23.195+0000 7fe0d8a00640 1 -- 172.21.15.57:0/3956153700 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 187064744 0 0) 0x7fe0c0003520 con 0x7fe0dc15e140 2024-03-27T09:59:23.186 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:23.195+0000 7fe0d9400640 1 -- 172.21.15.57:0/3956153700 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0dc0d3660 con 0x7fe0dc0b9c50 2024-03-27T09:59:23.186 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:23.196+0000 7fe0d9400640 1 --2- 172.21.15.57:0/3956153700 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe0dc0b9c50 0x7fe0dc0cec90 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fe0c80097d0 tx=0x7fe0c802b800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5520658e2f827e8 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:23.187 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:23.197+0000 7fe0d8a00640 1 -- 172.21.15.57:0/3956153700 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0c8037070 con 0x7fe0dc0b9c50 2024-03-27T09:59:23.187 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:23.197+0000 7fe0d8a00640 1 -- 172.21.15.57:0/3956153700 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0c8030510 con 0x7fe0dc0b9c50 2024-03-27T09:59:23.187 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:23.197+0000 7fe0d8a00640 1 -- 172.21.15.57:0/3956153700 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0cc001670 con 0x7fe0dc0b9c50 2024-03-27T09:59:23.188 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:23.197+0000 7fe0db200640 1 -- 172.21.15.57:0/3956153700 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe0dc0b9c50 msgr2=0x7fe0dc0cec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:23.188 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:23.197+0000 7fe0db200640 1 --2- 172.21.15.57:0/3956153700 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe0dc0b9c50 0x7fe0dc0cec90 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fe0c80097d0 tx=0x7fe0c802b800 comp rx=0 tx=0).stop 2024-03-27T09:59:23.188 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:23.198+0000 7fe0db200640 1 -- 172.21.15.57:0/3956153700 shutdown_connections 2024-03-27T09:59:23.188 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:23.198+0000 7fe0db200640 1 --2- 172.21.15.57:0/3956153700 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe0dc0b9c50 0x7fe0dc0cec90 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:23.188 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:23.198+0000 7fe0db200640 1 -- 172.21.15.57:0/3956153700 >> 172.21.15.57:0/3956153700 conn(0x7fe0dc0d0a40 msgr2=0x7fe0dc0d0e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:23.188 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:23.198+0000 7fe0db200640 1 -- 172.21.15.57:0/3956153700 shutdown_connections 2024-03-27T09:59:23.188 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:23.198+0000 7fe0db200640 1 -- 172.21.15.57:0/3956153700 wait complete. 2024-03-27T09:59:23.190 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:23.199+0000 7fe0db200640 1 Processor -- start 2024-03-27T09:59:23.190 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:23.200+0000 7fe0db200640 1 -- start start 2024-03-27T09:59:23.192 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:23.200+0000 7fe0db200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe0dc0b9c50 0x7fe0dc0cc910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:23.192 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:23.200+0000 7fe0db200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe0dc0cf1d0 0x7fe0dc0c6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:23.192 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:23.201+0000 7fe0db200640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe0dc15e140 0x7fe0dc0cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:23.192 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:23.201+0000 7fe0db200640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fe0dc15e520 con 0x7fe0dc15e140 2024-03-27T09:59:23.192 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:23.201+0000 7fe0db200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fe0dc0d3c20 con 0x7fe0dc0b9c50 2024-03-27T09:59:23.192 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:23.201+0000 7fe0db200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fe0dc0cc480 con 0x7fe0dc0cf1d0 2024-03-27T09:59:23.192 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:23.201+0000 7fe0da800640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe0dc15e140 0x7fe0dc0cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:23.192 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:23.201+0000 7fe0da800640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe0dc15e140 0x7fe0dc0cd8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56046/0 (socket says 172.21.15.57:56046) 2024-03-27T09:59:23.192 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:23.201+0000 7fe0da800640 1 -- 172.21.15.57:0/3929710993 learned_addr learned my addr 172.21.15.57:0/3929710993 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T09:59:23.192 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:23.201+0000 7fe0d9e00640 1 --2- 172.21.15.57:0/3929710993 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe0dc0b9c50 0x7fe0dc0cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:23.192 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:23.201+0000 7fe0d9400640 1 --2- 172.21.15.57:0/3929710993 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe0dc0cf1d0 0x7fe0dc0c6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:23.192 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:23.201+0000 7fe0da800640 1 -- 172.21.15.57:0/3929710993 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe0dc0cf1d0 msgr2=0x7fe0dc0c6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:23.193 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:23.201+0000 7fe0da800640 1 --2- 172.21.15.57:0/3929710993 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe0dc0cf1d0 0x7fe0dc0c6ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:23.193 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:23.201+0000 7fe0da800640 1 -- 172.21.15.57:0/3929710993 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe0dc0b9c50 msgr2=0x7fe0dc0cc910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:23.193 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:23.201+0000 7fe0da800640 1 --2- 172.21.15.57:0/3929710993 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe0dc0b9c50 0x7fe0dc0cc910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:23.193 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:23.201+0000 7fe0da800640 1 -- 172.21.15.57:0/3929710993 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0dc0cce50 con 0x7fe0dc15e140 2024-03-27T09:59:23.193 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:23.201+0000 7fe0d9e00640 1 --2- 172.21.15.57:0/3929710993 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe0dc0b9c50 0x7fe0dc0cc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T09:59:23.193 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:23.202+0000 7fe0da800640 1 --2- 172.21.15.57:0/3929710993 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe0dc15e140 0x7fe0dc0cd8c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe0d400c7a0 tx=0x7fe0d400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:23.194 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:23.202+0000 7fe0d2000640 1 -- 172.21.15.57:0/3929710993 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0d4003b70 con 0x7fe0dc15e140 2024-03-27T09:59:23.194 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:23.202+0000 7fe0d2000640 1 -- 172.21.15.57:0/3929710993 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0d4003d30 con 0x7fe0dc15e140 2024-03-27T09:59:23.194 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:23.202+0000 7fe0d2000640 1 -- 172.21.15.57:0/3929710993 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0d400aa90 con 0x7fe0dc15e140 2024-03-27T09:59:23.194 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:23.202+0000 7fe0db200640 1 -- 172.21.15.57:0/3929710993 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0dc0cb870 con 0x7fe0dc15e140 2024-03-27T09:59:23.194 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:23.202+0000 7fe0db200640 1 -- 172.21.15.57:0/3929710993 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0dc0cbe30 con 0x7fe0dc15e140 2024-03-27T09:59:23.194 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:23.203+0000 7fe0db200640 1 -- 172.21.15.57:0/3929710993 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0dc0756c0 con 0x7fe0dc15e140 2024-03-27T09:59:23.195 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:23.204+0000 7fe0d2000640 1 -- 172.21.15.57:0/3929710993 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fe0d400ac30 con 0x7fe0dc15e140 2024-03-27T09:59:23.195 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:23.205+0000 7fe0d2000640 1 --2- 172.21.15.57:0/3929710993 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fe0bc06c530 0x7fe0bc06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:23.196 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:23.205+0000 7fe0d2000640 1 -- 172.21.15.57:0/3929710993 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fe0d408b2e0 con 0x7fe0dc15e140 2024-03-27T09:59:23.196 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:23.205+0000 7fe0d9e00640 1 --2- 172.21.15.57:0/3929710993 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fe0bc06c530 0x7fe0bc06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:23.196 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:23.206+0000 7fe0d9e00640 1 --2- 172.21.15.57:0/3929710993 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fe0bc06c530 0x7fe0bc06e9f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc0017e0 tx=0x7fe0cc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:23.201 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:23.211+0000 7fe0d2000640 1 -- 172.21.15.57:0/3929710993 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7fe0d4059c40 con 0x7fe0dc15e140 2024-03-27T09:59:23.407 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:23.417+0000 7fe0db200640 1 -- 172.21.15.57:0/3929710993 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe0dc0d1cd0 con 0x7fe0dc15e140 2024-03-27T09:59:23.409 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:23.419+0000 7fe0d2000640 1 -- 172.21.15.57:0/3929710993 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12872 (secure 0 0 0) 0x7fe0d4059540 con 0x7fe0dc15e140 2024-03-27T09:59:23.410 INFO:teuthology.misc.health.smithi057.stdout: 2024-03-27T09:59:23.410 INFO:teuthology.misc.health.smithi057.stdout:{"epoch":17,"fsid":"7ac43f86-2c16-4a97-98fb-715d3cebc75c","created":"2024-03-27T09:59:04.033417+0000","modified":"2024-03-27T09:59:19.998666+0000","last_up_change":"2024-03-27T09:59:16.969624+0000","last_in_change":"2024-03-27T09:59:07.421690+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-27T09:59:17.253008+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"47b44362-7302-4f2a-b735-582c6c3850cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6801","nonce":2020036298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6803","nonce":2020036298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6807","nonce":2020036298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6805","nonce":2020036298}]},"public_addr":"172.21.15.57:6801/2020036298","cluster_addr":"172.21.15.57:6803/2020036298","heartbeat_back_addr":"172.21.15.57:6807/2020036298","heartbeat_front_addr":"172.21.15.57:6805/2020036298","state":["exists","up"]},{"osd":1,"uuid":"feaf96f0-9431-4188-9a09-da505b40e934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6809","nonce":3190929242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6811","nonce":3190929242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6815","nonce":3190929242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6813","nonce":3190929242}]},"public_addr":"172.21.15.57:6809/3190929242","cluster_addr":"172.21.15.57:6811/3190929242","heartbeat_back_addr":"172.21.15.57:6815/3190929242","heartbeat_front_addr":"172.21.15.57:6813/3190929242","state":["exists","up"]},{"osd":2,"uuid":"21e406e6-cfbc-4fe7-a816-e2420487c95d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6817","nonce":4065849973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6819","nonce":4065849973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6823","nonce":4065849973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6821","nonce":4065849973}]},"public_addr":"172.21.15.57:6817/4065849973","cluster_addr":"172.21.15.57:6819/4065849973","heartbeat_back_addr":"172.21.15.57:6823/4065849973","heartbeat_front_addr":"172.21.15.57:6821/4065849973","state":["exists","up"]},{"osd":3,"uuid":"a389af1d-76c4-4dfc-b215-f983f4931257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6825","nonce":158084809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6827","nonce":158084809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6831","nonce":158084809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6829","nonce":158084809}]},"public_addr":"172.21.15.57:6825/158084809","cluster_addr":"172.21.15.57:6827/158084809","heartbeat_back_addr":"172.21.15.57:6831/158084809","heartbeat_front_addr":"172.21.15.57:6829/158084809","state":["exists","up"]},{"osd":4,"uuid":"e9b05dca-557a-43ee-b43f-9ce5b7d28304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6823","nonce":108719401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6827","nonce":108719401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6831","nonce":108719401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6829","nonce":108719401}]},"public_addr":"172.21.15.118:6823/108719401","cluster_addr":"172.21.15.118:6827/108719401","heartbeat_back_addr":"172.21.15.118:6831/108719401","heartbeat_front_addr":"172.21.15.118:6829/108719401","state":["exists","up"]},{"osd":5,"uuid":"d968177d-44ff-499a-b00a-b147ed879253","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6817","nonce":2704605866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6819","nonce":2704605866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6826","nonce":2704605866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6822","nonce":2704605866}]},"public_addr":"172.21.15.118:6817/2704605866","cluster_addr":"172.21.15.118:6819/2704605866","heartbeat_back_addr":"172.21.15.118:6826/2704605866","heartbeat_front_addr":"172.21.15.118:6822/2704605866","state":["exists","up"]},{"osd":6,"uuid":"e8f98052-e6ad-4cfe-a4a9-0b17a434d54e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6801","nonce":1963659095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6803","nonce":1963659095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6807","nonce":1963659095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6805","nonce":1963659095}]},"public_addr":"172.21.15.118:6801/1963659095","cluster_addr":"172.21.15.118:6803/1963659095","heartbeat_back_addr":"172.21.15.118:6807/1963659095","heartbeat_front_addr":"172.21.15.118:6805/1963659095","state":["exists","up"]},{"osd":7,"uuid":"eccff987-8e51-4a63-845a-cf0a3196d7fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6809","nonce":1955879596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6811","nonce":1955879596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6815","nonce":1955879596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6813","nonce":1955879596}]},"public_addr":"172.21.15.118:6809/1955879596","cluster_addr":"172.21.15.118:6811/1955879596","heartbeat_back_addr":"172.21.15.118:6815/1955879596","heartbeat_front_addr":"172.21.15.118:6813/1955879596","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.721258+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.696610+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.777895+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.806769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.743259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.845687+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:13.020165+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.722294+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-27T09:59:23.413 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:23.422+0000 7fe0db200640 1 -- 172.21.15.57:0/3929710993 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fe0bc06c530 msgr2=0x7fe0bc06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:23.413 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:23.422+0000 7fe0db200640 1 --2- 172.21.15.57:0/3929710993 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fe0bc06c530 0x7fe0bc06e9f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc0017e0 tx=0x7fe0cc009040 comp rx=0 tx=0).stop 2024-03-27T09:59:23.413 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:23.422+0000 7fe0db200640 1 -- 172.21.15.57:0/3929710993 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe0dc15e140 msgr2=0x7fe0dc0cd8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:23.413 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:23.422+0000 7fe0db200640 1 --2- 172.21.15.57:0/3929710993 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe0dc15e140 0x7fe0dc0cd8c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe0d400c7a0 tx=0x7fe0d400cc60 comp rx=0 tx=0).stop 2024-03-27T09:59:23.413 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:23.422+0000 7fe0db200640 1 -- 172.21.15.57:0/3929710993 shutdown_connections 2024-03-27T09:59:23.413 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:23.422+0000 7fe0db200640 1 --2- 172.21.15.57:0/3929710993 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe0dc15e140 0x7fe0dc0cd8c0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:23.413 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:23.422+0000 7fe0db200640 1 --2- 172.21.15.57:0/3929710993 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe0dc0cf1d0 0x7fe0dc0c6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:23.413 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:23.422+0000 7fe0db200640 1 --2- 172.21.15.57:0/3929710993 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fe0bc06c530 0x7fe0bc06e9f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:23.413 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:23.422+0000 7fe0db200640 1 --2- 172.21.15.57:0/3929710993 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe0dc0b9c50 0x7fe0dc0cc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:23.413 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:23.422+0000 7fe0db200640 1 -- 172.21.15.57:0/3929710993 >> 172.21.15.57:0/3929710993 conn(0x7fe0dc0d0a40 msgr2=0x7fe0dc0b61e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:23.413 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:23.422+0000 7fe0db200640 1 -- 172.21.15.57:0/3929710993 shutdown_connections 2024-03-27T09:59:23.413 INFO:teuthology.misc.health.smithi057.stderr:2024-03-27T09:59:23.422+0000 7fe0db200640 1 -- 172.21.15.57:0/3929710993 wait complete. 2024-03-27T09:59:23.430 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-03-27T09:59:23.430 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-03-27T09:59:23.430 INFO:tasks.ceph.mds.a:Restarting daemon 2024-03-27T09:59:23.430 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-03-27T09:59:23.438 INFO:tasks.ceph.mds.a:Started 2024-03-27T09:59:23.438 INFO:tasks.ceph.mds.c:Restarting daemon 2024-03-27T09:59:23.438 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-03-27T09:59:23.445 INFO:tasks.ceph.mds.c:Started 2024-03-27T09:59:23.445 INFO:tasks.ceph.mds.b:Restarting daemon 2024-03-27T09:59:23.445 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-03-27T09:59:23.452 INFO:tasks.ceph.mds.b:Started 2024-03-27T09:59:23.452 INFO:tasks.ceph.mds.d:Restarting daemon 2024-03-27T09:59:23.452 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-03-27T09:59:23.460 INFO:tasks.ceph.mds.d:Started 2024-03-27T09:59:23.460 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-03-27T09:59:23.460 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-27T09:59:23.591 INFO:tasks.ceph.mds.a.smithi057.stdout:starting mds.a at 2024-03-27T09:59:23.591 INFO:tasks.ceph.mds.c.smithi057.stdout:starting mds.c at 2024-03-27T09:59:23.592 INFO:tasks.ceph.mds.c.smithi057.stderr:2024-03-27T09:59:23.602+0000 7fd327c00640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2024-03-27T09:59:23.618 INFO:tasks.ceph.mds.b.smithi118.stdout:starting mds.b at 2024-03-27T09:59:23.618 INFO:tasks.ceph.mds.d.smithi118.stdout:starting mds.d at 2024-03-27T09:59:23.647 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:23.657+0000 7f96be600640 1 Processor -- start 2024-03-27T09:59:23.647 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:23.657+0000 7f96be600640 1 -- start start 2024-03-27T09:59:23.649 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:23.658+0000 7f96be600640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f96b815c120 0x7f96b80d0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:23.649 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:23.658+0000 7f96be600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f96b80d2450 0x7f96b80b0b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:23.649 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:23.658+0000 7f96be600640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96b80cfc10 con 0x7f96b80b2910 2024-03-27T09:59:23.649 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:23.658+0000 7f96be600640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f96b80cfef0 con 0x7f96b815c120 2024-03-27T09:59:23.649 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:23.658+0000 7f96be600640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f96b80d01d0 con 0x7f96b80d2450 2024-03-27T09:59:23.649 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:23.658+0000 7f96b7400640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f96b815c120 0x7f96b80d0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:23.649 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:23.659+0000 7f96b7400640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f96b815c120 0x7f96b80d0cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56076/0 (socket says 172.21.15.57:56076) 2024-03-27T09:59:23.649 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:23.659+0000 7f96b7400640 1 -- 172.21.15.57:0/3663213200 learned_addr learned my addr 172.21.15.57:0/3663213200 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T09:59:23.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:23.659+0000 7f96b7e00640 1 --2- 172.21.15.57:0/3663213200 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f96b80d2450 0x7f96b80b0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:23.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:23.659+0000 7f96b7400640 1 -- 172.21.15.57:0/3663213200 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f96b80d2450 msgr2=0x7f96b80b0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T09:59:23.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:23.659+0000 7f96b7400640 1 --2- 172.21.15.57:0/3663213200 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f96b80d2450 0x7f96b80b0b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:23.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:23.659+0000 7f96b7400640 1 -- 172.21.15.57:0/3663213200 >> v1:172.21.15.118:6789/0 conn(0x7f96b80b2910 legacy=0x7f96b80d1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T09:59:23.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:23.659+0000 7f96b7400640 1 -- 172.21.15.57:0/3663213200 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96b80d04b0 con 0x7f96b815c120 2024-03-27T09:59:23.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:23.659+0000 7f96b7e00640 1 --2- 172.21.15.57:0/3663213200 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f96b80d2450 0x7f96b80b0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T09:59:23.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:23.660+0000 7f96b7400640 1 --2- 172.21.15.57:0/3663213200 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f96b815c120 0x7f96b80d0cb0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f96a8009870 tx=0x7f96a802b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea612434f59f58df server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:23.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:23.660+0000 7f96b6000640 1 -- 172.21.15.57:0/3663213200 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96a80317c0 con 0x7f96b815c120 2024-03-27T09:59:23.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:23.660+0000 7f96b6000640 1 -- 172.21.15.57:0/3663213200 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96a8037070 con 0x7f96b815c120 2024-03-27T09:59:23.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:23.660+0000 7f96b6000640 1 -- 172.21.15.57:0/3663213200 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96a8031b80 con 0x7f96b815c120 2024-03-27T09:59:23.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:23.661+0000 7f96be600640 1 -- 172.21.15.57:0/3663213200 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f96b815c120 msgr2=0x7f96b80d0cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:23.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:23.661+0000 7f96be600640 1 --2- 172.21.15.57:0/3663213200 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f96b815c120 0x7f96b80d0cb0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f96a8009870 tx=0x7f96a802b860 comp rx=0 tx=0).stop 2024-03-27T09:59:23.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:23.661+0000 7f96be600640 1 -- 172.21.15.57:0/3663213200 shutdown_connections 2024-03-27T09:59:23.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:23.661+0000 7f96be600640 1 --2- 172.21.15.57:0/3663213200 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f96b80d2450 0x7f96b80b0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:23.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:23.661+0000 7f96be600640 1 --2- 172.21.15.57:0/3663213200 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f96b815c120 0x7f96b80d0cb0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:23.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:23.661+0000 7f96be600640 1 -- 172.21.15.57:0/3663213200 >> 172.21.15.57:0/3663213200 conn(0x7f96b809aa30 msgr2=0x7f96b809ae40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:23.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:23.661+0000 7f96be600640 1 -- 172.21.15.57:0/3663213200 shutdown_connections 2024-03-27T09:59:23.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:23.661+0000 7f96be600640 1 -- 172.21.15.57:0/3663213200 wait complete. 2024-03-27T09:59:23.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:23.663+0000 7f96be600640 1 Processor -- start 2024-03-27T09:59:23.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:23.663+0000 7f96be600640 1 -- start start 2024-03-27T09:59:23.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:23.664+0000 7f96be600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f96b80b2910 0x7f96b81f5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:23.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:23.664+0000 7f96be600640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f96b80d2450 0x7f96b80c7b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:23.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:23.664+0000 7f96be600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f96b815c120 0x7f96b80c8050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:23.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:23.664+0000 7f96be600640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f96b80cebc0 con 0x7f96b80d2450 2024-03-27T09:59:23.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:23.664+0000 7f96be600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f96b80cea40 con 0x7f96b815c120 2024-03-27T09:59:23.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:23.664+0000 7f96be600640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f96b815c500 con 0x7f96b80b2910 2024-03-27T09:59:23.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:23.664+0000 7f96b6a00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f96b80d2450 0x7f96b80c7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:23.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:23.664+0000 7f96b7400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f96b80b2910 0x7f96b81f5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:23.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:23.664+0000 7f96b6a00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f96b80d2450 0x7f96b80c7b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56084/0 (socket says 172.21.15.57:56084) 2024-03-27T09:59:23.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:23.664+0000 7f96b6a00640 1 -- 172.21.15.57:0/2122320994 learned_addr learned my addr 172.21.15.57:0/2122320994 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T09:59:23.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:23.664+0000 7f96b7e00640 1 --2- 172.21.15.57:0/2122320994 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f96b815c120 0x7f96b80c8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:23.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:23.664+0000 7f96b6a00640 1 -- 172.21.15.57:0/2122320994 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f96b80b2910 msgr2=0x7f96b81f5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:23.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:23.664+0000 7f96b6a00640 1 --2- 172.21.15.57:0/2122320994 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f96b80b2910 0x7f96b81f5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:23.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:23.664+0000 7f96b6a00640 1 -- 172.21.15.57:0/2122320994 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f96b815c120 msgr2=0x7f96b80c8050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:23.656 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:23.664+0000 7f96b6a00640 1 --2- 172.21.15.57:0/2122320994 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f96b815c120 0x7f96b80c8050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:23.656 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:23.664+0000 7f96b6a00640 1 -- 172.21.15.57:0/2122320994 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96b80b5750 con 0x7f96b80d2450 2024-03-27T09:59:23.657 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:23.665+0000 7f96b6a00640 1 --2- 172.21.15.57:0/2122320994 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f96b80d2450 0x7f96b80c7b10 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f96a400c430 tx=0x7f96a400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:23.657 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:23.665+0000 7f96af400640 1 -- 172.21.15.57:0/2122320994 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96a4011790 con 0x7f96b80d2450 2024-03-27T09:59:23.657 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:23.665+0000 7f96af400640 1 -- 172.21.15.57:0/2122320994 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96a4017070 con 0x7f96b80d2450 2024-03-27T09:59:23.657 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:23.665+0000 7f96af400640 1 -- 172.21.15.57:0/2122320994 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96a4011bb0 con 0x7f96b80d2450 2024-03-27T09:59:23.657 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:23.665+0000 7f96be600640 1 -- 172.21.15.57:0/2122320994 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96b80b5a30 con 0x7f96b80d2450 2024-03-27T09:59:23.657 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:23.665+0000 7f96be600640 1 -- 172.21.15.57:0/2122320994 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96b80b5ff0 con 0x7f96b80d2450 2024-03-27T09:59:23.657 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:23.666+0000 7f96be600640 1 -- 172.21.15.57:0/2122320994 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96b8068620 con 0x7f96b80d2450 2024-03-27T09:59:23.658 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:23.667+0000 7f96af400640 1 -- 172.21.15.57:0/2122320994 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f96a401c460 con 0x7f96b80d2450 2024-03-27T09:59:23.658 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:23.668+0000 7f96af400640 1 --2- 172.21.15.57:0/2122320994 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f969806c580 0x7f969806ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:23.659 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:23.668+0000 7f96af400640 1 -- 172.21.15.57:0/2122320994 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f96a408b110 con 0x7f96b80d2450 2024-03-27T09:59:23.659 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:23.668+0000 7f96b7400640 1 --2- 172.21.15.57:0/2122320994 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f969806c580 0x7f969806ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:23.659 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:23.669+0000 7f96b7400640 1 --2- 172.21.15.57:0/2122320994 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f969806c580 0x7f969806ea40 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f96a8036000 tx=0x7f96a803d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:23.663 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:23.673+0000 7f96af400640 1 -- 172.21.15.57:0/2122320994 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f96a4059410 con 0x7f96b80d2450 2024-03-27T09:59:23.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:23.874+0000 7f96be600640 1 -- 172.21.15.57:0/2122320994 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f96b806ffa0 con 0x7f96b80d2450 2024-03-27T09:59:23.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:23.876+0000 7f96af400640 1 -- 172.21.15.57:0/2122320994 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12872 (secure 0 0 0) 0x7f96a405d710 con 0x7f96b80d2450 2024-03-27T09:59:23.867 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T09:59:23.867 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":17,"fsid":"7ac43f86-2c16-4a97-98fb-715d3cebc75c","created":"2024-03-27T09:59:04.033417+0000","modified":"2024-03-27T09:59:19.998666+0000","last_up_change":"2024-03-27T09:59:16.969624+0000","last_in_change":"2024-03-27T09:59:07.421690+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-27T09:59:17.253008+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"47b44362-7302-4f2a-b735-582c6c3850cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6801","nonce":2020036298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6803","nonce":2020036298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6807","nonce":2020036298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6805","nonce":2020036298}]},"public_addr":"172.21.15.57:6801/2020036298","cluster_addr":"172.21.15.57:6803/2020036298","heartbeat_back_addr":"172.21.15.57:6807/2020036298","heartbeat_front_addr":"172.21.15.57:6805/2020036298","state":["exists","up"]},{"osd":1,"uuid":"feaf96f0-9431-4188-9a09-da505b40e934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6809","nonce":3190929242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6811","nonce":3190929242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6815","nonce":3190929242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6813","nonce":3190929242}]},"public_addr":"172.21.15.57:6809/3190929242","cluster_addr":"172.21.15.57:6811/3190929242","heartbeat_back_addr":"172.21.15.57:6815/3190929242","heartbeat_front_addr":"172.21.15.57:6813/3190929242","state":["exists","up"]},{"osd":2,"uuid":"21e406e6-cfbc-4fe7-a816-e2420487c95d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6817","nonce":4065849973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6819","nonce":4065849973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6823","nonce":4065849973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6821","nonce":4065849973}]},"public_addr":"172.21.15.57:6817/4065849973","cluster_addr":"172.21.15.57:6819/4065849973","heartbeat_back_addr":"172.21.15.57:6823/4065849973","heartbeat_front_addr":"172.21.15.57:6821/4065849973","state":["exists","up"]},{"osd":3,"uuid":"a389af1d-76c4-4dfc-b215-f983f4931257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6825","nonce":158084809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6827","nonce":158084809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6831","nonce":158084809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6829","nonce":158084809}]},"public_addr":"172.21.15.57:6825/158084809","cluster_addr":"172.21.15.57:6827/158084809","heartbeat_back_addr":"172.21.15.57:6831/158084809","heartbeat_front_addr":"172.21.15.57:6829/158084809","state":["exists","up"]},{"osd":4,"uuid":"e9b05dca-557a-43ee-b43f-9ce5b7d28304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6823","nonce":108719401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6827","nonce":108719401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6831","nonce":108719401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6829","nonce":108719401}]},"public_addr":"172.21.15.118:6823/108719401","cluster_addr":"172.21.15.118:6827/108719401","heartbeat_back_addr":"172.21.15.118:6831/108719401","heartbeat_front_addr":"172.21.15.118:6829/108719401","state":["exists","up"]},{"osd":5,"uuid":"d968177d-44ff-499a-b00a-b147ed879253","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6817","nonce":2704605866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6819","nonce":2704605866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6826","nonce":2704605866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6822","nonce":2704605866}]},"public_addr":"172.21.15.118:6817/2704605866","cluster_addr":"172.21.15.118:6819/2704605866","heartbeat_back_addr":"172.21.15.118:6826/2704605866","heartbeat_front_addr":"172.21.15.118:6822/2704605866","state":["exists","up"]},{"osd":6,"uuid":"e8f98052-e6ad-4cfe-a4a9-0b17a434d54e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6801","nonce":1963659095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6803","nonce":1963659095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6807","nonce":1963659095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6805","nonce":1963659095}]},"public_addr":"172.21.15.118:6801/1963659095","cluster_addr":"172.21.15.118:6803/1963659095","heartbeat_back_addr":"172.21.15.118:6807/1963659095","heartbeat_front_addr":"172.21.15.118:6805/1963659095","state":["exists","up"]},{"osd":7,"uuid":"eccff987-8e51-4a63-845a-cf0a3196d7fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6809","nonce":1955879596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6811","nonce":1955879596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6815","nonce":1955879596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6813","nonce":1955879596}]},"public_addr":"172.21.15.118:6809/1955879596","cluster_addr":"172.21.15.118:6811/1955879596","heartbeat_back_addr":"172.21.15.118:6815/1955879596","heartbeat_front_addr":"172.21.15.118:6813/1955879596","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.721258+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.696610+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.777895+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.806769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.743259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.845687+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:13.020165+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.722294+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-27T09:59:23.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:23.879+0000 7f96be600640 1 -- 172.21.15.57:0/2122320994 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f969806c580 msgr2=0x7f969806ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:23.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:23.879+0000 7f96be600640 1 --2- 172.21.15.57:0/2122320994 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f969806c580 0x7f969806ea40 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f96a8036000 tx=0x7f96a803d040 comp rx=0 tx=0).stop 2024-03-27T09:59:23.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:23.879+0000 7f96be600640 1 -- 172.21.15.57:0/2122320994 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f96b80d2450 msgr2=0x7f96b80c7b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:23.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:23.879+0000 7f96be600640 1 --2- 172.21.15.57:0/2122320994 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f96b80d2450 0x7f96b80c7b10 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f96a400c430 tx=0x7f96a400c8f0 comp rx=0 tx=0).stop 2024-03-27T09:59:23.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:23.879+0000 7f96be600640 1 -- 172.21.15.57:0/2122320994 shutdown_connections 2024-03-27T09:59:23.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:23.879+0000 7f96be600640 1 --2- 172.21.15.57:0/2122320994 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f969806c580 0x7f969806ea40 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:23.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:23.879+0000 7f96be600640 1 --2- 172.21.15.57:0/2122320994 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f96b815c120 0x7f96b80c8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:23.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:23.879+0000 7f96be600640 1 --2- 172.21.15.57:0/2122320994 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f96b80d2450 0x7f96b80c7b10 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:23.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:23.879+0000 7f96be600640 1 --2- 172.21.15.57:0/2122320994 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f96b80b2910 0x7f96b81f5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:23.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:23.879+0000 7f96be600640 1 -- 172.21.15.57:0/2122320994 >> 172.21.15.57:0/2122320994 conn(0x7f96b809aa30 msgr2=0x7f96b80b0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:23.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:23.879+0000 7f96be600640 1 -- 172.21.15.57:0/2122320994 shutdown_connections 2024-03-27T09:59:23.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:23.879+0000 7f96be600640 1 -- 172.21.15.57:0/2122320994 wait complete. 2024-03-27T09:59:23.888 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-27T09:59:17.253008+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-27T09:59:23.888 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-27T09:59:24.107 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.116+0000 7f4f07200640 1 Processor -- start 2024-03-27T09:59:24.107 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.116+0000 7f4f07200640 1 -- start start 2024-03-27T09:59:24.109 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.118+0000 7f4f07200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4f000d3770 0x7f4f000cf210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:24.109 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.118+0000 7f4f07200640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f4f000cf750 0x7f4f0006bf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:24.109 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.118+0000 7f4f07200640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f000cfe40 con 0x7f4f00161950 2024-03-27T09:59:24.109 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.118+0000 7f4f07200640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f4f00161d30 con 0x7f4f000cf750 2024-03-27T09:59:24.109 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.118+0000 7f4f07200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f4f000d0f10 con 0x7f4f000d3770 2024-03-27T09:59:24.109 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.118+0000 7f4f05e00640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f4f00161950 0x7f4f000ceb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:48032/0 (socket says 172.21.15.57:48032) 2024-03-27T09:59:24.109 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.118+0000 7f4f05e00640 1 -- 172.21.15.57:0/2998620235 learned_addr learned my addr 172.21.15.57:0/2998620235 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T09:59:24.109 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.118+0000 7f4f05400640 1 --2- 172.21.15.57:0/2998620235 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4f000d3770 0x7f4f000cf210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:24.109 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.119+0000 7f4f06800640 1 --2- 172.21.15.57:0/2998620235 >> v2:172.21.15.118:3300/0 conn(0x7f4f000cf750 0x7f4f0006bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:24.109 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.119+0000 7f4f04a00640 1 -- 172.21.15.57:0/2998620235 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3852565760 0 0) 0x7f4f000cfe40 con 0x7f4f00161950 2024-03-27T09:59:24.110 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.119+0000 7f4f04a00640 1 -- 172.21.15.57:0/2998620235 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ee8003520 con 0x7f4f00161950 2024-03-27T09:59:24.112 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.119+0000 7f4f04a00640 1 -- 172.21.15.57:0/2998620235 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4102293323 0 0) 0x7f4ee8003520 con 0x7f4f00161950 2024-03-27T09:59:24.112 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.119+0000 7f4f04a00640 1 -- 172.21.15.57:0/2998620235 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4f000d3770 msgr2=0x7f4f000cf210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T09:59:24.112 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.119+0000 7f4f04a00640 1 --2- 172.21.15.57:0/2998620235 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4f000d3770 0x7f4f000cf210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:24.112 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.119+0000 7f4f04a00640 1 -- 172.21.15.57:0/2998620235 >> v2:172.21.15.118:3300/0 conn(0x7f4f000cf750 msgr2=0x7f4f0006bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T09:59:24.112 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.119+0000 7f4f04a00640 1 --2- 172.21.15.57:0/2998620235 >> v2:172.21.15.118:3300/0 conn(0x7f4f000cf750 0x7f4f0006bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:24.112 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.119+0000 7f4f04a00640 1 -- 172.21.15.57:0/2998620235 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f000d11f0 con 0x7f4f00161950 2024-03-27T09:59:24.112 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.119+0000 7f4f04a00640 1 -- 172.21.15.57:0/2998620235 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4227751516 0 0) 0x7f4ef4001670 con 0x7f4f00161950 2024-03-27T09:59:24.112 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.119+0000 7f4f04a00640 1 -- 172.21.15.57:0/2998620235 >> v1:172.21.15.57:6789/0 conn(0x7f4f00161950 legacy=0x7f4f000ceb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:24.112 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.119+0000 7f4f04a00640 1 --2- 172.21.15.57:0/2998620235 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4f000d3770 0x7f4ee80039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:24.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.119+0000 7f4f04a00640 1 --2- 172.21.15.57:0/2998620235 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4ee8003f30 0x7f4ee8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:24.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.119+0000 7f4f04a00640 1 --2- 172.21.15.57:0/2998620235 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4ee8004d40 0x7f4ee80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:24.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.119+0000 7f4f04a00640 1 -- 172.21.15.57:0/2998620235 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f4f00161d30 con 0x7f4ee8004d40 2024-03-27T09:59:24.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.119+0000 7f4f04a00640 1 -- 172.21.15.57:0/2998620235 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f4f000d0f10 con 0x7f4ee8003f30 2024-03-27T09:59:24.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.119+0000 7f4f04a00640 1 -- 172.21.15.57:0/2998620235 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f4ee800b9f0 con 0x7f4f000d3770 2024-03-27T09:59:24.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.120+0000 7f4f06800640 1 --2- 172.21.15.57:0/2998620235 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4ee8004d40 0x7f4ee80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:24.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.120+0000 7f4f05e00640 1 --2- 172.21.15.57:0/2998620235 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4f000d3770 0x7f4ee80039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:24.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.120+0000 7f4f05400640 1 --2- 172.21.15.57:0/2998620235 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4ee8003f30 0x7f4ee8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:24.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.120+0000 7f4f06800640 1 -- 172.21.15.57:0/2998620235 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4f000d3770 msgr2=0x7f4ee80039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T09:59:24.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.120+0000 7f4f06800640 1 --2- 172.21.15.57:0/2998620235 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4f000d3770 0x7f4ee80039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:24.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.120+0000 7f4f06800640 1 -- 172.21.15.57:0/2998620235 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4ee8003f30 msgr2=0x7f4ee8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T09:59:24.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.120+0000 7f4f06800640 1 --2- 172.21.15.57:0/2998620235 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4ee8003f30 0x7f4ee8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:24.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.120+0000 7f4f06800640 1 -- 172.21.15.57:0/2998620235 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ee8003520 con 0x7f4ee8004d40 2024-03-27T09:59:24.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.121+0000 7f4f06800640 1 --2- 172.21.15.57:0/2998620235 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4ee8004d40 0x7f4ee80051c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4efc009fc0 tx=0x7f4ee8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=856eb1af36ee3dff server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:24.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.121+0000 7f4f04a00640 1 -- 172.21.15.57:0/2998620235 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4efc039070 con 0x7f4ee8004d40 2024-03-27T09:59:24.114 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.121+0000 7f4f04a00640 1 -- 172.21.15.57:0/2998620235 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4efc02cc60 con 0x7f4ee8004d40 2024-03-27T09:59:24.114 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.121+0000 7f4f04a00640 1 -- 172.21.15.57:0/2998620235 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4efc009c10 con 0x7f4ee8004d40 2024-03-27T09:59:24.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.122+0000 7f4f07200640 1 -- 172.21.15.57:0/2998620235 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4ee8004d40 msgr2=0x7f4ee80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:24.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.122+0000 7f4f07200640 1 --2- 172.21.15.57:0/2998620235 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4ee8004d40 0x7f4ee80051c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4efc009fc0 tx=0x7f4ee8005830 comp rx=0 tx=0).stop 2024-03-27T09:59:24.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.122+0000 7f4f06800640 1 -- 172.21.15.57:0/2998620235 reap_dead start 2024-03-27T09:59:24.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.122+0000 7f4f07200640 1 -- 172.21.15.57:0/2998620235 shutdown_connections 2024-03-27T09:59:24.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.122+0000 7f4f07200640 1 -- 172.21.15.57:0/2998620235 >> 172.21.15.57:0/2998620235 conn(0x7f4f000d3fc0 msgr2=0x7f4f000d43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:24.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.122+0000 7f4f07200640 1 -- 172.21.15.57:0/2998620235 shutdown_connections 2024-03-27T09:59:24.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.122+0000 7f4f07200640 1 -- 172.21.15.57:0/2998620235 wait complete. 2024-03-27T09:59:24.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.124+0000 7f4f07200640 1 Processor -- start 2024-03-27T09:59:24.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.124+0000 7f4f07200640 1 -- start start 2024-03-27T09:59:24.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.125+0000 7f4f07200640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4f00158b80 0x7f4f000c8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:24.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.125+0000 7f4f07200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4f00159330 0x7f4f0015b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:24.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.125+0000 7f4f07200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4f0015bd10 0x7f4f0015a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:24.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.125+0000 7f4f07200640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f4f000d2240 con 0x7f4f00158b80 2024-03-27T09:59:24.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.125+0000 7f4f07200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f4f000d1f60 con 0x7f4f0015bd10 2024-03-27T09:59:24.117 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.125+0000 7f4f07200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f4f000d17b0 con 0x7f4f00159330 2024-03-27T09:59:24.117 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.125+0000 7f4f05e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4f00158b80 0x7f4f000c8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:24.117 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.125+0000 7f4f05e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4f00158b80 0x7f4f000c8bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56100/0 (socket says 172.21.15.57:56100) 2024-03-27T09:59:24.117 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.125+0000 7f4f05e00640 1 -- 172.21.15.57:0/3164620851 learned_addr learned my addr 172.21.15.57:0/3164620851 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T09:59:24.117 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.125+0000 7f4f06800640 1 --2- 172.21.15.57:0/3164620851 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4f0015bd10 0x7f4f0015a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:24.117 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.125+0000 7f4f05e00640 1 -- 172.21.15.57:0/3164620851 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4f00159330 msgr2=0x7f4f0015b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:24.117 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.125+0000 7f4f05400640 1 --2- 172.21.15.57:0/3164620851 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4f00159330 0x7f4f0015b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:24.117 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.126+0000 7f4f05e00640 1 --2- 172.21.15.57:0/3164620851 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4f00159330 0x7f4f0015b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:24.117 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.126+0000 7f4f05e00640 1 -- 172.21.15.57:0/3164620851 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4f0015bd10 msgr2=0x7f4f0015a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:24.117 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.126+0000 7f4f05e00640 1 --2- 172.21.15.57:0/3164620851 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4f0015bd10 0x7f4f0015a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:24.117 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.126+0000 7f4f05e00640 1 -- 172.21.15.57:0/3164620851 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f000c91f0 con 0x7f4f00158b80 2024-03-27T09:59:24.117 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.126+0000 7f4f06800640 1 --2- 172.21.15.57:0/3164620851 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4f0015bd10 0x7f4f0015a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T09:59:24.117 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.126+0000 7f4f05e00640 1 --2- 172.21.15.57:0/3164620851 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4f00158b80 0x7f4f000c8bf0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4ef4004840 tx=0x7f4ef400ef80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:24.118 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.126+0000 7f4efa000640 1 -- 172.21.15.57:0/3164620851 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ef400c990 con 0x7f4f00158b80 2024-03-27T09:59:24.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.126+0000 7f4efa000640 1 -- 172.21.15.57:0/3164620851 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ef4018070 con 0x7f4f00158b80 2024-03-27T09:59:24.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.126+0000 7f4efa000640 1 -- 172.21.15.57:0/3164620851 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ef400cd90 con 0x7f4f00158b80 2024-03-27T09:59:24.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.126+0000 7f4f07200640 1 -- 172.21.15.57:0/3164620851 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f000c94d0 con 0x7f4f00158b80 2024-03-27T09:59:24.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.126+0000 7f4f07200640 1 -- 172.21.15.57:0/3164620851 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f000c9a90 con 0x7f4f00158b80 2024-03-27T09:59:24.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.127+0000 7f4f07200640 1 -- 172.21.15.57:0/3164620851 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f00068540 con 0x7f4f00158b80 2024-03-27T09:59:24.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.128+0000 7f4efa000640 1 -- 172.21.15.57:0/3164620851 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f4ef401d460 con 0x7f4f00158b80 2024-03-27T09:59:24.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.130+0000 7f4efa000640 1 --2- 172.21.15.57:0/3164620851 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f4ee406c560 0x7f4ee406ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:24.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.130+0000 7f4efa000640 1 -- 172.21.15.57:0/3164620851 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f4ef408b420 con 0x7f4f00158b80 2024-03-27T09:59:24.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.130+0000 7f4f05400640 1 --2- 172.21.15.57:0/3164620851 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f4ee406c560 0x7f4ee406ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:24.121 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.131+0000 7f4f05400640 1 --2- 172.21.15.57:0/3164620851 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f4ee406c560 0x7f4ee406ea20 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4f0015b1e0 tx=0x7f4ef0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:24.125 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.135+0000 7f4efa000640 1 -- 172.21.15.57:0/3164620851 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f4ef4059d80 con 0x7f4f00158b80 2024-03-27T09:59:24.326 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.336+0000 7f4f07200640 1 -- 172.21.15.57:0/3164620851 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f4f000b0c90 con 0x7f4f00158b80 2024-03-27T09:59:24.327 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.337+0000 7f4efa000640 1 -- 172.21.15.57:0/3164620851 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) ==== 93+0+10 (secure 0 0 0) 0x7f4ef4059680 con 0x7f4f00158b80 2024-03-27T09:59:24.327 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2024-03-27T09:59:24.330 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.339+0000 7f4f07200640 1 -- 172.21.15.57:0/3164620851 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f4ee406c560 msgr2=0x7f4ee406ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:24.330 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.339+0000 7f4f07200640 1 --2- 172.21.15.57:0/3164620851 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f4ee406c560 0x7f4ee406ea20 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4f0015b1e0 tx=0x7f4ef0008040 comp rx=0 tx=0).stop 2024-03-27T09:59:24.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.339+0000 7f4f07200640 1 -- 172.21.15.57:0/3164620851 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4f00158b80 msgr2=0x7f4f000c8bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:24.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.339+0000 7f4f07200640 1 --2- 172.21.15.57:0/3164620851 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4f00158b80 0x7f4f000c8bf0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4ef4004840 tx=0x7f4ef400ef80 comp rx=0 tx=0).stop 2024-03-27T09:59:24.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.340+0000 7f4f07200640 1 -- 172.21.15.57:0/3164620851 shutdown_connections 2024-03-27T09:59:24.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.340+0000 7f4f07200640 1 --2- 172.21.15.57:0/3164620851 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f4ee406c560 0x7f4ee406ea20 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:24.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.340+0000 7f4f07200640 1 --2- 172.21.15.57:0/3164620851 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4f0015bd10 0x7f4f0015a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:24.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.340+0000 7f4f07200640 1 --2- 172.21.15.57:0/3164620851 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4f00159330 0x7f4f0015b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:24.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.340+0000 7f4f07200640 1 --2- 172.21.15.57:0/3164620851 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4f00158b80 0x7f4f000c8bf0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:24.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.340+0000 7f4f07200640 1 -- 172.21.15.57:0/3164620851 >> 172.21.15.57:0/3164620851 conn(0x7f4f000d3fc0 msgr2=0x7f4f0015eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:24.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.340+0000 7f4f07200640 1 -- 172.21.15.57:0/3164620851 shutdown_connections 2024-03-27T09:59:24.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.340+0000 7f4f07200640 1 -- 172.21.15.57:0/3164620851 wait complete. 2024-03-27T09:59:24.349 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-27T09:59:24.561 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.571+0000 7f8993200640 1 Processor -- start 2024-03-27T09:59:24.561 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.571+0000 7f8993200640 1 -- start start 2024-03-27T09:59:24.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.572+0000 7f8993200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f89940d0930 0x7f89940d23a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:24.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.572+0000 7f8993200640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89940aed20 con 0x7f899415bf50 2024-03-27T09:59:24.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.573+0000 7f8993200640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89940aef90 con 0x7f89940ae8d0 2024-03-27T09:59:24.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.573+0000 7f8993200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f89940cfd70 con 0x7f89940d0930 2024-03-27T09:59:24.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.573+0000 7f8991e00640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f899415bf50 0x7f89940d0220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:48048/0 (socket says 172.21.15.57:48048) 2024-03-27T09:59:24.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.573+0000 7f8991e00640 1 -- 172.21.15.57:0/1125947175 learned_addr learned my addr 172.21.15.57:0/1125947175 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T09:59:24.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.573+0000 7f8991400640 1 --2- 172.21.15.57:0/1125947175 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f89940d0930 0x7f89940d23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:24.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.573+0000 7f8990a00640 1 -- 172.21.15.57:0/1125947175 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 934662047 0 0) 0x7f89940aed20 con 0x7f899415bf50 2024-03-27T09:59:24.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.573+0000 7f8990a00640 1 -- 172.21.15.57:0/1125947175 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8978003520 con 0x7f899415bf50 2024-03-27T09:59:24.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.574+0000 7f8990a00640 1 -- 172.21.15.57:0/1125947175 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 11199533 0 0) 0x7f8978003520 con 0x7f899415bf50 2024-03-27T09:59:24.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.574+0000 7f8990a00640 1 -- 172.21.15.57:0/1125947175 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f89940d0930 msgr2=0x7f89940d23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T09:59:24.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.574+0000 7f8990a00640 1 --2- 172.21.15.57:0/1125947175 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f89940d0930 0x7f89940d23a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:24.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.574+0000 7f8990a00640 1 -- 172.21.15.57:0/1125947175 >> v1:172.21.15.118:6789/0 conn(0x7f89940ae8d0 legacy=0x7f89940b0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:24.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.574+0000 7f8990a00640 1 -- 172.21.15.57:0/1125947175 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89940af270 con 0x7f899415bf50 2024-03-27T09:59:24.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.574+0000 7f8990a00640 1 -- 172.21.15.57:0/1125947175 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4227751516 0 0) 0x7f8984001670 con 0x7f899415bf50 2024-03-27T09:59:24.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.574+0000 7f8990a00640 1 -- 172.21.15.57:0/1125947175 >> v1:172.21.15.57:6789/0 conn(0x7f899415bf50 legacy=0x7f89940d0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:24.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.574+0000 7f8990a00640 1 --2- 172.21.15.57:0/1125947175 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f89780039e0 0x7f8978003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:24.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.574+0000 7f8990a00640 1 --2- 172.21.15.57:0/1125947175 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f89940d0930 0x7f8978004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:24.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.574+0000 7f8990a00640 1 --2- 172.21.15.57:0/1125947175 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8978004d40 0x7f89780051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:24.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.574+0000 7f8990a00640 1 -- 172.21.15.57:0/1125947175 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f897800bb00 con 0x7f89780039e0 2024-03-27T09:59:24.567 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.574+0000 7f8990a00640 1 -- 172.21.15.57:0/1125947175 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f897800bcb0 con 0x7f8978004d40 2024-03-27T09:59:24.567 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.574+0000 7f8990a00640 1 -- 172.21.15.57:0/1125947175 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f897800beb0 con 0x7f89940d0930 2024-03-27T09:59:24.567 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.574+0000 7f8991e00640 1 --2- 172.21.15.57:0/1125947175 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f89780039e0 0x7f8978003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:24.567 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.575+0000 7f8991400640 1 --2- 172.21.15.57:0/1125947175 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f89940d0930 0x7f8978004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:24.567 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.575+0000 7f8992800640 1 --2- 172.21.15.57:0/1125947175 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8978004d40 0x7f89780051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:24.567 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.575+0000 7f8991e00640 1 -- 172.21.15.57:0/1125947175 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f89940d0930 msgr2=0x7f8978004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T09:59:24.567 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.575+0000 7f8991e00640 1 --2- 172.21.15.57:0/1125947175 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f89940d0930 0x7f8978004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:24.567 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.575+0000 7f8991e00640 1 -- 172.21.15.57:0/1125947175 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8978004d40 msgr2=0x7f89780051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T09:59:24.567 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.575+0000 7f8991e00640 1 --2- 172.21.15.57:0/1125947175 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8978004d40 0x7f89780051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:24.567 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.575+0000 7f8991e00640 1 -- 172.21.15.57:0/1125947175 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8978003520 con 0x7f89780039e0 2024-03-27T09:59:24.568 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.576+0000 7f8991e00640 1 --2- 172.21.15.57:0/1125947175 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f89780039e0 0x7f8978003e00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8984001eb0 tx=0x7f8978005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3669d5e7e3431bd server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:24.568 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.577+0000 7f8990a00640 1 -- 172.21.15.57:0/1125947175 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8984007d30 con 0x7f89780039e0 2024-03-27T09:59:24.568 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.577+0000 7f8990a00640 1 -- 172.21.15.57:0/1125947175 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8984030070 con 0x7f89780039e0 2024-03-27T09:59:24.568 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.577+0000 7f8990a00640 1 -- 172.21.15.57:0/1125947175 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8984005d30 con 0x7f89780039e0 2024-03-27T09:59:24.568 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.577+0000 7f8993200640 1 -- 172.21.15.57:0/1125947175 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f89780039e0 msgr2=0x7f8978003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:24.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.577+0000 7f8993200640 1 --2- 172.21.15.57:0/1125947175 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f89780039e0 0x7f8978003e00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8984001eb0 tx=0x7f8978005830 comp rx=0 tx=0).stop 2024-03-27T09:59:24.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.577+0000 7f8992800640 1 -- 172.21.15.57:0/1125947175 reap_dead start 2024-03-27T09:59:24.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.577+0000 7f8993200640 1 -- 172.21.15.57:0/1125947175 shutdown_connections 2024-03-27T09:59:24.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.577+0000 7f8993200640 1 -- 172.21.15.57:0/1125947175 >> 172.21.15.57:0/1125947175 conn(0x7f899409aa30 msgr2=0x7f899409ae40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:24.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.578+0000 7f8993200640 1 -- 172.21.15.57:0/1125947175 shutdown_connections 2024-03-27T09:59:24.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.578+0000 7f8993200640 1 -- 172.21.15.57:0/1125947175 wait complete. 2024-03-27T09:59:24.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.579+0000 7f8993200640 1 Processor -- start 2024-03-27T09:59:24.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.579+0000 7f8993200640 1 -- start start 2024-03-27T09:59:24.571 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.580+0000 7f8993200640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f89780039e0 0x7f8994152450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:24.571 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.580+0000 7f8993200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f89940cd630 0x7f89940d19c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:24.571 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.580+0000 7f8993200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f89940cdab0 0x7f89940d1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:24.571 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.580+0000 7f8993200640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f89940afb10 con 0x7f89780039e0 2024-03-27T09:59:24.571 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.580+0000 7f8993200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f89940af830 con 0x7f89940cdab0 2024-03-27T09:59:24.571 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.580+0000 7f8993200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f899415c330 con 0x7f89940cd630 2024-03-27T09:59:24.572 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.581+0000 7f8991e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f89780039e0 0x7f8994152450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:24.572 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.581+0000 7f8991e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f89780039e0 0x7f8994152450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56118/0 (socket says 172.21.15.57:56118) 2024-03-27T09:59:24.572 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.581+0000 7f8991e00640 1 -- 172.21.15.57:0/2929208514 learned_addr learned my addr 172.21.15.57:0/2929208514 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T09:59:24.572 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.581+0000 7f8991e00640 1 -- 172.21.15.57:0/2929208514 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f89940cd630 msgr2=0x7f89940d19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:24.572 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.581+0000 7f8991e00640 1 --2- 172.21.15.57:0/2929208514 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f89940cd630 0x7f89940d19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:24.572 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.581+0000 7f8992800640 1 --2- 172.21.15.57:0/2929208514 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f89940cdab0 0x7f89940d1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:24.572 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.581+0000 7f8991e00640 1 -- 172.21.15.57:0/2929208514 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f89940cdab0 msgr2=0x7f89940d1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:24.572 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.581+0000 7f8991e00640 1 --2- 172.21.15.57:0/2929208514 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f89940cdab0 0x7f89940d1f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:24.572 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.581+0000 7f8991e00640 1 -- 172.21.15.57:0/2929208514 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89940b4b00 con 0x7f89780039e0 2024-03-27T09:59:24.572 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.581+0000 7f8991e00640 1 --2- 172.21.15.57:0/2929208514 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f89780039e0 0x7f8994152450 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8984001970 tx=0x7f8984001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:24.573 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.581+0000 7f898a000640 1 -- 172.21.15.57:0/2929208514 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8984045070 con 0x7f89780039e0 2024-03-27T09:59:24.573 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.582+0000 7f898a000640 1 -- 172.21.15.57:0/2929208514 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8984000ed0 con 0x7f89780039e0 2024-03-27T09:59:24.573 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.582+0000 7f898a000640 1 -- 172.21.15.57:0/2929208514 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8984004df0 con 0x7f89780039e0 2024-03-27T09:59:24.573 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.582+0000 7f8993200640 1 -- 172.21.15.57:0/2929208514 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f899415d960 con 0x7f89780039e0 2024-03-27T09:59:24.573 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.582+0000 7f8993200640 1 -- 172.21.15.57:0/2929208514 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f899415df20 con 0x7f89780039e0 2024-03-27T09:59:24.573 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.583+0000 7f8993200640 1 -- 172.21.15.57:0/2929208514 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8994068c50 con 0x7f89780039e0 2024-03-27T09:59:24.574 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.584+0000 7f898a000640 1 -- 172.21.15.57:0/2929208514 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f8984007070 con 0x7f89780039e0 2024-03-27T09:59:24.575 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.585+0000 7f898a000640 1 --2- 172.21.15.57:0/2929208514 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f897006c560 0x7f897006ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:24.575 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.585+0000 7f898a000640 1 -- 172.21.15.57:0/2929208514 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f89840ac400 con 0x7f89780039e0 2024-03-27T09:59:24.575 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.585+0000 7f8991400640 1 --2- 172.21.15.57:0/2929208514 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f897006c560 0x7f897006ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:24.575 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.586+0000 7f8991400640 1 --2- 172.21.15.57:0/2929208514 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f897006c560 0x7f897006ea20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f899415ed00 tx=0x7f897c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:24.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.589+0000 7f898a000640 1 -- 172.21.15.57:0/2929208514 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f898407a790 con 0x7f89780039e0 2024-03-27T09:59:24.822 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.832+0000 7f8993200640 1 -- 172.21.15.57:0/2929208514 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f89940cfbf0 con 0x7f89780039e0 2024-03-27T09:59:24.823 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.833+0000 7f898a000640 1 -- 172.21.15.57:0/2929208514 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3870 (secure 0 0 0) 0x7f898407ea90 con 0x7f89780039e0 2024-03-27T09:59:24.824 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T09:59:24.824 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/1178943431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1178943431},{"type":"v1","addr":"172.21.15.118:6834","nonce":1178943431}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6836/1248533620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6835","nonce":1248533620},{"type":"v1","addr":"172.21.15.57:6836","nonce":1248533620}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6837/4133386889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":4133386889},{"type":"v1","addr":"172.21.15.57:6837","nonce":4133386889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4282,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/1823694233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":1823694233},{"type":"v1","addr":"172.21.15.118:6835","nonce":1823694233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-03-27T09:59:24.824 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 3 2024-03-27T09:59:24.826 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.836+0000 7f8993200640 1 -- 172.21.15.57:0/2929208514 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f897006c560 msgr2=0x7f897006ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:24.826 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.836+0000 7f8993200640 1 --2- 172.21.15.57:0/2929208514 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f897006c560 0x7f897006ea20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f899415ed00 tx=0x7f897c008040 comp rx=0 tx=0).stop 2024-03-27T09:59:24.826 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.836+0000 7f8993200640 1 -- 172.21.15.57:0/2929208514 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f89780039e0 msgr2=0x7f8994152450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:24.827 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.836+0000 7f8993200640 1 --2- 172.21.15.57:0/2929208514 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f89780039e0 0x7f8994152450 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8984001970 tx=0x7f8984001a40 comp rx=0 tx=0).stop 2024-03-27T09:59:24.827 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.836+0000 7f8993200640 1 -- 172.21.15.57:0/2929208514 shutdown_connections 2024-03-27T09:59:24.827 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.836+0000 7f8993200640 1 --2- 172.21.15.57:0/2929208514 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f897006c560 0x7f897006ea20 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:24.827 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.836+0000 7f8993200640 1 --2- 172.21.15.57:0/2929208514 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f89940cdab0 0x7f89940d1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:24.827 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.836+0000 7f8993200640 1 --2- 172.21.15.57:0/2929208514 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f89940cd630 0x7f89940d19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:24.827 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.836+0000 7f8993200640 1 --2- 172.21.15.57:0/2929208514 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f89780039e0 0x7f8994152450 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:24.827 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.836+0000 7f8993200640 1 -- 172.21.15.57:0/2929208514 >> 172.21.15.57:0/2929208514 conn(0x7f899409aa30 msgr2=0x7f899415aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:24.827 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.836+0000 7f8993200640 1 -- 172.21.15.57:0/2929208514 shutdown_connections 2024-03-27T09:59:24.827 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:24.836+0000 7f8993200640 1 -- 172.21.15.57:0/2929208514 wait complete. 2024-03-27T09:59:24.843 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-27T09:59:25.061 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.071+0000 7fc711600640 1 Processor -- start 2024-03-27T09:59:25.062 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.071+0000 7fc711600640 1 -- start start 2024-03-27T09:59:25.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.073+0000 7fc711600640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fc70c1455a0 0x7fc70c071010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:25.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.073+0000 7fc711600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc70c071550 0x7fc70c06dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:25.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.073+0000 7fc711600640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc70c0cf570 con 0x7fc70c0cecd0 2024-03-27T09:59:25.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.073+0000 7fc711600640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7fc70c06f2d0 con 0x7fc70c1455a0 2024-03-27T09:59:25.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.073+0000 7fc711600640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fc70c15d400 con 0x7fc70c071550 2024-03-27T09:59:25.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.073+0000 7fc710c00640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fc70c0cecd0 0x7fc70c15fa10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:48054/0 (socket says 172.21.15.57:48054) 2024-03-27T09:59:25.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.073+0000 7fc710c00640 1 -- 172.21.15.57:0/854595035 learned_addr learned my addr 172.21.15.57:0/854595035 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T09:59:25.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.074+0000 7fc70b400640 1 --2- 172.21.15.57:0/854595035 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc70c071550 0x7fc70c06dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:25.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.074+0000 7fc70be00640 1 --2- 172.21.15.57:0/854595035 >> v2:172.21.15.118:3300/0 conn(0x7fc70c1455a0 0x7fc70c071010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:25.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.074+0000 7fc70aa00640 1 -- 172.21.15.57:0/854595035 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3750141715 0 0) 0x7fc70c0cf570 con 0x7fc70c0cecd0 2024-03-27T09:59:25.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.074+0000 7fc70aa00640 1 -- 172.21.15.57:0/854595035 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc6f0003520 con 0x7fc70c0cecd0 2024-03-27T09:59:25.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.074+0000 7fc70aa00640 1 -- 172.21.15.57:0/854595035 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3680304364 0 0) 0x7fc6f0003520 con 0x7fc70c0cecd0 2024-03-27T09:59:25.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.074+0000 7fc70aa00640 1 -- 172.21.15.57:0/854595035 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc70c071550 msgr2=0x7fc70c06dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T09:59:25.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.074+0000 7fc70aa00640 1 --2- 172.21.15.57:0/854595035 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc70c071550 0x7fc70c06dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:25.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.074+0000 7fc70aa00640 1 -- 172.21.15.57:0/854595035 >> v2:172.21.15.118:3300/0 conn(0x7fc70c1455a0 msgr2=0x7fc70c071010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T09:59:25.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.074+0000 7fc70aa00640 1 --2- 172.21.15.57:0/854595035 >> v2:172.21.15.118:3300/0 conn(0x7fc70c1455a0 0x7fc70c071010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:25.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.074+0000 7fc70aa00640 1 -- 172.21.15.57:0/854595035 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc70c0cf290 con 0x7fc70c0cecd0 2024-03-27T09:59:25.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.074+0000 7fc70aa00640 1 -- 172.21.15.57:0/854595035 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4227751516 0 0) 0x7fc7040019f0 con 0x7fc70c0cecd0 2024-03-27T09:59:25.071 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.074+0000 7fc70aa00640 1 -- 172.21.15.57:0/854595035 >> v1:172.21.15.57:6789/0 conn(0x7fc70c0cecd0 legacy=0x7fc70c15fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:25.071 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.074+0000 7fc70aa00640 1 --2- 172.21.15.57:0/854595035 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc6f00039b0 0x7fc6f0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:25.071 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.074+0000 7fc70aa00640 1 --2- 172.21.15.57:0/854595035 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc6f0004800 0x7fc6f0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:25.071 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.074+0000 7fc70aa00640 1 --2- 172.21.15.57:0/854595035 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc70c071550 0x7fc6f00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:25.071 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.074+0000 7fc70aa00640 1 -- 172.21.15.57:0/854595035 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fc70c06f2d0 con 0x7fc6f00039b0 2024-03-27T09:59:25.071 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.074+0000 7fc70aa00640 1 -- 172.21.15.57:0/854595035 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fc70c15d400 con 0x7fc6f0004800 2024-03-27T09:59:25.071 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.074+0000 7fc70aa00640 1 -- 172.21.15.57:0/854595035 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fc6f000b9c0 con 0x7fc70c071550 2024-03-27T09:59:25.071 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.074+0000 7fc70be00640 1 --2- 172.21.15.57:0/854595035 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc6f00039b0 0x7fc6f0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:25.071 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.075+0000 7fc70b400640 1 --2- 172.21.15.57:0/854595035 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc6f0004800 0x7fc6f0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:25.071 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.075+0000 7fc70be00640 1 -- 172.21.15.57:0/854595035 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc70c071550 msgr2=0x7fc6f00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T09:59:25.071 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.075+0000 7fc70be00640 1 --2- 172.21.15.57:0/854595035 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc70c071550 0x7fc6f00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:25.071 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.075+0000 7fc70be00640 1 -- 172.21.15.57:0/854595035 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc6f0004800 msgr2=0x7fc6f0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T09:59:25.071 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.075+0000 7fc70be00640 1 --2- 172.21.15.57:0/854595035 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc6f0004800 0x7fc6f0004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:25.071 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.075+0000 7fc70be00640 1 -- 172.21.15.57:0/854595035 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6f0003520 con 0x7fc6f00039b0 2024-03-27T09:59:25.072 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.076+0000 7fc70be00640 1 --2- 172.21.15.57:0/854595035 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc6f00039b0 0x7fc6f0003dd0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc009ac0 tx=0x7fc6f0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49e75b2140838cf1 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:25.072 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.076+0000 7fc70aa00640 1 -- 172.21.15.57:0/854595035 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6fc039070 con 0x7fc6f00039b0 2024-03-27T09:59:25.072 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.076+0000 7fc70aa00640 1 -- 172.21.15.57:0/854595035 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6fc02c710 con 0x7fc6f00039b0 2024-03-27T09:59:25.072 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.076+0000 7fc70aa00640 1 -- 172.21.15.57:0/854595035 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6fc009690 con 0x7fc6f00039b0 2024-03-27T09:59:25.072 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.076+0000 7fc711600640 1 -- 172.21.15.57:0/854595035 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc6f00039b0 msgr2=0x7fc6f0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:25.072 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.076+0000 7fc711600640 1 --2- 172.21.15.57:0/854595035 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc6f00039b0 0x7fc6f0003dd0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc009ac0 tx=0x7fc6f0005830 comp rx=0 tx=0).stop 2024-03-27T09:59:25.072 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.077+0000 7fc710c00640 1 -- 172.21.15.57:0/854595035 reap_dead start 2024-03-27T09:59:25.072 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.077+0000 7fc711600640 1 -- 172.21.15.57:0/854595035 shutdown_connections 2024-03-27T09:59:25.072 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.077+0000 7fc711600640 1 -- 172.21.15.57:0/854595035 >> 172.21.15.57:0/854595035 conn(0x7fc70c0b1770 msgr2=0x7fc70c0b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:25.072 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.077+0000 7fc711600640 1 -- 172.21.15.57:0/854595035 shutdown_connections 2024-03-27T09:59:25.072 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.077+0000 7fc711600640 1 -- 172.21.15.57:0/854595035 wait complete. 2024-03-27T09:59:25.072 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.078+0000 7fc711600640 1 Processor -- start 2024-03-27T09:59:25.072 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.079+0000 7fc711600640 1 -- start start 2024-03-27T09:59:25.074 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.079+0000 7fc711600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc6f00039b0 0x7fc70c1535b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:25.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.079+0000 7fc711600640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc70c15d5c0 0x7fc70c15da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:25.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.080+0000 7fc711600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc70c1583a0 0x7fc70c158850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:25.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.080+0000 7fc711600640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fc70c06d8c0 con 0x7fc70c15d5c0 2024-03-27T09:59:25.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.080+0000 7fc711600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fc70c06d5e0 con 0x7fc6f00039b0 2024-03-27T09:59:25.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.080+0000 7fc711600640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fc70c145980 con 0x7fc70c1583a0 2024-03-27T09:59:25.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.080+0000 7fc70b400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc70c15d5c0 0x7fc70c15da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:25.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.080+0000 7fc70b400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc70c15d5c0 0x7fc70c15da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56140/0 (socket says 172.21.15.57:56140) 2024-03-27T09:59:25.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.080+0000 7fc70b400640 1 -- 172.21.15.57:0/453972631 learned_addr learned my addr 172.21.15.57:0/453972631 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T09:59:25.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.080+0000 7fc70be00640 1 --2- 172.21.15.57:0/453972631 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc6f00039b0 0x7fc70c1535b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:25.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.080+0000 7fc710c00640 1 --2- 172.21.15.57:0/453972631 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc70c1583a0 0x7fc70c158850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:25.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.080+0000 7fc70b400640 1 -- 172.21.15.57:0/453972631 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc70c1583a0 msgr2=0x7fc70c158850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:25.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.080+0000 7fc70b400640 1 --2- 172.21.15.57:0/453972631 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc70c1583a0 0x7fc70c158850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:25.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.080+0000 7fc70b400640 1 -- 172.21.15.57:0/453972631 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc6f00039b0 msgr2=0x7fc70c1535b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:25.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.080+0000 7fc70b400640 1 --2- 172.21.15.57:0/453972631 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc6f00039b0 0x7fc70c1535b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:25.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.080+0000 7fc70b400640 1 -- 172.21.15.57:0/453972631 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc70c142620 con 0x7fc70c15d5c0 2024-03-27T09:59:25.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.081+0000 7fc70b400640 1 --2- 172.21.15.57:0/453972631 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc70c15d5c0 0x7fc70c15da40 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc6f8010890 tx=0x7fc6f8010d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:25.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.081+0000 7fc703e00640 1 -- 172.21.15.57:0/453972631 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6f800f040 con 0x7fc70c15d5c0 2024-03-27T09:59:25.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.081+0000 7fc703e00640 1 -- 172.21.15.57:0/453972631 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6f800eb60 con 0x7fc70c15d5c0 2024-03-27T09:59:25.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.081+0000 7fc711600640 1 -- 172.21.15.57:0/453972631 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc70c142900 con 0x7fc70c15d5c0 2024-03-27T09:59:25.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.081+0000 7fc703e00640 1 -- 172.21.15.57:0/453972631 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6f801c400 con 0x7fc70c15d5c0 2024-03-27T09:59:25.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.081+0000 7fc711600640 1 -- 172.21.15.57:0/453972631 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc70c142ec0 con 0x7fc70c15d5c0 2024-03-27T09:59:25.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.082+0000 7fc711600640 1 -- 172.21.15.57:0/453972631 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc70c068540 con 0x7fc70c15d5c0 2024-03-27T09:59:25.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.083+0000 7fc703e00640 1 -- 172.21.15.57:0/453972631 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fc6f801c5a0 con 0x7fc70c15d5c0 2024-03-27T09:59:25.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.084+0000 7fc703e00640 1 --2- 172.21.15.57:0/453972631 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fc6ec06c530 0x7fc6ec06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:25.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.084+0000 7fc703e00640 1 -- 172.21.15.57:0/453972631 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fc6f808ba90 con 0x7fc70c15d5c0 2024-03-27T09:59:25.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.084+0000 7fc70be00640 1 --2- 172.21.15.57:0/453972631 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fc6ec06c530 0x7fc6ec06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:25.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.085+0000 7fc70be00640 1 --2- 172.21.15.57:0/453972631 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fc6ec06c530 0x7fc6ec06e9f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc036000 tx=0x7fc6fc030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:25.078 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.088+0000 7fc703e00640 1 -- 172.21.15.57:0/453972631 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7fc6f8018030 con 0x7fc70c15d5c0 2024-03-27T09:59:25.274 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.284+0000 7fc711600640 1 -- 172.21.15.57:0/453972631 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc70c13e630 con 0x7fc70c15d5c0 2024-03-27T09:59:25.276 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.286+0000 7fc703e00640 1 -- 172.21.15.57:0/453972631 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12872 (secure 0 0 0) 0x7fc6f805a360 con 0x7fc70c15d5c0 2024-03-27T09:59:25.276 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T09:59:25.276 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":17,"fsid":"7ac43f86-2c16-4a97-98fb-715d3cebc75c","created":"2024-03-27T09:59:04.033417+0000","modified":"2024-03-27T09:59:19.998666+0000","last_up_change":"2024-03-27T09:59:16.969624+0000","last_in_change":"2024-03-27T09:59:07.421690+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-27T09:59:17.253008+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"47b44362-7302-4f2a-b735-582c6c3850cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6801","nonce":2020036298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6803","nonce":2020036298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6807","nonce":2020036298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6805","nonce":2020036298}]},"public_addr":"172.21.15.57:6801/2020036298","cluster_addr":"172.21.15.57:6803/2020036298","heartbeat_back_addr":"172.21.15.57:6807/2020036298","heartbeat_front_addr":"172.21.15.57:6805/2020036298","state":["exists","up"]},{"osd":1,"uuid":"feaf96f0-9431-4188-9a09-da505b40e934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6809","nonce":3190929242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6811","nonce":3190929242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6815","nonce":3190929242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6813","nonce":3190929242}]},"public_addr":"172.21.15.57:6809/3190929242","cluster_addr":"172.21.15.57:6811/3190929242","heartbeat_back_addr":"172.21.15.57:6815/3190929242","heartbeat_front_addr":"172.21.15.57:6813/3190929242","state":["exists","up"]},{"osd":2,"uuid":"21e406e6-cfbc-4fe7-a816-e2420487c95d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6817","nonce":4065849973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6819","nonce":4065849973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6823","nonce":4065849973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6821","nonce":4065849973}]},"public_addr":"172.21.15.57:6817/4065849973","cluster_addr":"172.21.15.57:6819/4065849973","heartbeat_back_addr":"172.21.15.57:6823/4065849973","heartbeat_front_addr":"172.21.15.57:6821/4065849973","state":["exists","up"]},{"osd":3,"uuid":"a389af1d-76c4-4dfc-b215-f983f4931257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6825","nonce":158084809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6827","nonce":158084809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6831","nonce":158084809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6829","nonce":158084809}]},"public_addr":"172.21.15.57:6825/158084809","cluster_addr":"172.21.15.57:6827/158084809","heartbeat_back_addr":"172.21.15.57:6831/158084809","heartbeat_front_addr":"172.21.15.57:6829/158084809","state":["exists","up"]},{"osd":4,"uuid":"e9b05dca-557a-43ee-b43f-9ce5b7d28304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6823","nonce":108719401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6827","nonce":108719401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6831","nonce":108719401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6829","nonce":108719401}]},"public_addr":"172.21.15.118:6823/108719401","cluster_addr":"172.21.15.118:6827/108719401","heartbeat_back_addr":"172.21.15.118:6831/108719401","heartbeat_front_addr":"172.21.15.118:6829/108719401","state":["exists","up"]},{"osd":5,"uuid":"d968177d-44ff-499a-b00a-b147ed879253","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6817","nonce":2704605866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6819","nonce":2704605866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6826","nonce":2704605866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6822","nonce":2704605866}]},"public_addr":"172.21.15.118:6817/2704605866","cluster_addr":"172.21.15.118:6819/2704605866","heartbeat_back_addr":"172.21.15.118:6826/2704605866","heartbeat_front_addr":"172.21.15.118:6822/2704605866","state":["exists","up"]},{"osd":6,"uuid":"e8f98052-e6ad-4cfe-a4a9-0b17a434d54e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6801","nonce":1963659095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6803","nonce":1963659095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6807","nonce":1963659095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6805","nonce":1963659095}]},"public_addr":"172.21.15.118:6801/1963659095","cluster_addr":"172.21.15.118:6803/1963659095","heartbeat_back_addr":"172.21.15.118:6807/1963659095","heartbeat_front_addr":"172.21.15.118:6805/1963659095","state":["exists","up"]},{"osd":7,"uuid":"eccff987-8e51-4a63-845a-cf0a3196d7fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6809","nonce":1955879596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6811","nonce":1955879596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6815","nonce":1955879596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6813","nonce":1955879596}]},"public_addr":"172.21.15.118:6809/1955879596","cluster_addr":"172.21.15.118:6811/1955879596","heartbeat_back_addr":"172.21.15.118:6815/1955879596","heartbeat_front_addr":"172.21.15.118:6813/1955879596","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.721258+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.696610+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.777895+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.806769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.743259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.845687+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:13.020165+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.722294+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-27T09:59:25.279 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.288+0000 7fc711600640 1 -- 172.21.15.57:0/453972631 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fc6ec06c530 msgr2=0x7fc6ec06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:25.279 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.288+0000 7fc711600640 1 --2- 172.21.15.57:0/453972631 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fc6ec06c530 0x7fc6ec06e9f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc036000 tx=0x7fc6fc030000 comp rx=0 tx=0).stop 2024-03-27T09:59:25.279 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.288+0000 7fc711600640 1 -- 172.21.15.57:0/453972631 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc70c15d5c0 msgr2=0x7fc70c15da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:25.279 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.288+0000 7fc711600640 1 --2- 172.21.15.57:0/453972631 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc70c15d5c0 0x7fc70c15da40 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc6f8010890 tx=0x7fc6f8010d50 comp rx=0 tx=0).stop 2024-03-27T09:59:25.279 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.288+0000 7fc711600640 1 -- 172.21.15.57:0/453972631 shutdown_connections 2024-03-27T09:59:25.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.288+0000 7fc711600640 1 --2- 172.21.15.57:0/453972631 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc70c1583a0 0x7fc70c158850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:25.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.288+0000 7fc711600640 1 --2- 172.21.15.57:0/453972631 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc70c15d5c0 0x7fc70c15da40 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:25.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.288+0000 7fc711600640 1 --2- 172.21.15.57:0/453972631 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fc6ec06c530 0x7fc6ec06e9f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:25.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.288+0000 7fc711600640 1 --2- 172.21.15.57:0/453972631 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc6f00039b0 0x7fc70c1535b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:25.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.288+0000 7fc711600640 1 -- 172.21.15.57:0/453972631 >> 172.21.15.57:0/453972631 conn(0x7fc70c0b1770 msgr2=0x7fc70c0b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:25.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.289+0000 7fc711600640 1 -- 172.21.15.57:0/453972631 shutdown_connections 2024-03-27T09:59:25.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.289+0000 7fc711600640 1 -- 172.21.15.57:0/453972631 wait complete. 2024-03-27T09:59:25.297 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-27T09:59:17.253008+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-27T09:59:25.297 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-27T09:59:25.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.512+0000 7f6ec3200640 1 Processor -- start 2024-03-27T09:59:25.504 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.513+0000 7f6ec3200640 1 -- start start 2024-03-27T09:59:25.514 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.514+0000 7f6ec3200640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f6ec41458e0 0x7f6ec406d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:25.514 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.514+0000 7f6ec3200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6ec415fa90 0x7f6ec415fef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:25.515 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.514+0000 7f6ec3200640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ec40ca330 con 0x7f6ec40cb0f0 2024-03-27T09:59:25.515 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.514+0000 7f6ec3200640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f6ec4160430 con 0x7f6ec41458e0 2024-03-27T09:59:25.515 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.514+0000 7f6ec3200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f6ec40ca610 con 0x7f6ec415fa90 2024-03-27T09:59:25.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.515+0000 7f6ec2800640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f6ec40cb0f0 0x7f6ec40cb540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:48068/0 (socket says 172.21.15.57:48068) 2024-03-27T09:59:25.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.515+0000 7f6ec2800640 1 -- 172.21.15.57:0/3307300025 learned_addr learned my addr 172.21.15.57:0/3307300025 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T09:59:25.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.515+0000 7f6ebbe00640 1 --2- 172.21.15.57:0/3307300025 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6ec415fa90 0x7f6ec415fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:25.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.515+0000 7f6ec1e00640 1 --2- 172.21.15.57:0/3307300025 >> v2:172.21.15.118:3300/0 conn(0x7f6ec41458e0 0x7f6ec406d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:25.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.515+0000 7f6ec1400640 1 -- 172.21.15.57:0/3307300025 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 967946162 0 0) 0x7f6ec40ca330 con 0x7f6ec40cb0f0 2024-03-27T09:59:25.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.515+0000 7f6ec1400640 1 -- 172.21.15.57:0/3307300025 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ea8003520 con 0x7f6ec40cb0f0 2024-03-27T09:59:25.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.515+0000 7f6ec1400640 1 -- 172.21.15.57:0/3307300025 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3409039473 0 0) 0x7f6ea8003520 con 0x7f6ec40cb0f0 2024-03-27T09:59:25.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.515+0000 7f6ec1400640 1 -- 172.21.15.57:0/3307300025 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6ec415fa90 msgr2=0x7f6ec415fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T09:59:25.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.515+0000 7f6ec1400640 1 --2- 172.21.15.57:0/3307300025 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6ec415fa90 0x7f6ec415fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:25.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.515+0000 7f6ec1400640 1 -- 172.21.15.57:0/3307300025 >> v2:172.21.15.118:3300/0 conn(0x7f6ec41458e0 msgr2=0x7f6ec406d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T09:59:25.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.515+0000 7f6ec1400640 1 --2- 172.21.15.57:0/3307300025 >> v2:172.21.15.118:3300/0 conn(0x7f6ec41458e0 0x7f6ec406d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:25.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.516+0000 7f6ec1400640 1 -- 172.21.15.57:0/3307300025 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ec40ca8f0 con 0x7f6ec40cb0f0 2024-03-27T09:59:25.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.516+0000 7f6ec1400640 1 -- 172.21.15.57:0/3307300025 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4227751516 0 0) 0x7f6ebc0019f0 con 0x7f6ec40cb0f0 2024-03-27T09:59:25.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.516+0000 7f6ec1400640 1 -- 172.21.15.57:0/3307300025 >> v1:172.21.15.57:6789/0 conn(0x7f6ec40cb0f0 legacy=0x7f6ec40cb540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:25.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.516+0000 7f6ec1400640 1 --2- 172.21.15.57:0/3307300025 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6ec415fa90 0x7f6ea80039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:25.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.516+0000 7f6ec1400640 1 --2- 172.21.15.57:0/3307300025 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ea8003fe0 0x7f6ea8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:25.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.516+0000 7f6ec1400640 1 --2- 172.21.15.57:0/3307300025 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6ea8004d40 0x7f6ea80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:25.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.516+0000 7f6ec1400640 1 -- 172.21.15.57:0/3307300025 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f6ec40ca610 con 0x7f6ea8004d40 2024-03-27T09:59:25.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.516+0000 7f6ec1400640 1 -- 172.21.15.57:0/3307300025 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f6ea800b9f0 con 0x7f6ea8003fe0 2024-03-27T09:59:25.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.516+0000 7f6ec1400640 1 -- 172.21.15.57:0/3307300025 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f6ea800bbf0 con 0x7f6ec415fa90 2024-03-27T09:59:25.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.516+0000 7f6ec2800640 1 --2- 172.21.15.57:0/3307300025 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6ea8004d40 0x7f6ea80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:25.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.516+0000 7f6ec1e00640 1 --2- 172.21.15.57:0/3307300025 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6ec415fa90 0x7f6ea80039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:25.519 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.516+0000 7f6ec2800640 1 -- 172.21.15.57:0/3307300025 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6ec415fa90 msgr2=0x7f6ea80039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T09:59:25.519 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.516+0000 7f6ec2800640 1 --2- 172.21.15.57:0/3307300025 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6ec415fa90 0x7f6ea80039b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:25.519 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.516+0000 7f6ec2800640 1 -- 172.21.15.57:0/3307300025 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ea8003fe0 msgr2=0x7f6ea8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T09:59:25.519 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.516+0000 7f6ec2800640 1 --2- 172.21.15.57:0/3307300025 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ea8003fe0 0x7f6ea8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:25.519 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.516+0000 7f6ec2800640 1 -- 172.21.15.57:0/3307300025 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ec40ca8f0 con 0x7f6ea8004d40 2024-03-27T09:59:25.519 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.517+0000 7f6ec2800640 1 --2- 172.21.15.57:0/3307300025 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6ea8004d40 0x7f6ea80051c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc00a9c0 tx=0x7f6ea8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5b029f32a668272 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:25.519 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.518+0000 7f6ec1400640 1 -- 172.21.15.57:0/3307300025 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ebc00a5c0 con 0x7f6ea8004d40 2024-03-27T09:59:25.519 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.518+0000 7f6ec1400640 1 -- 172.21.15.57:0/3307300025 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ebc034650 con 0x7f6ea8004d40 2024-03-27T09:59:25.519 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.518+0000 7f6ec1400640 1 -- 172.21.15.57:0/3307300025 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ebc034a40 con 0x7f6ea8004d40 2024-03-27T09:59:25.520 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.518+0000 7f6ec3200640 1 -- 172.21.15.57:0/3307300025 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6ea8004d40 msgr2=0x7f6ea80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:25.520 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.518+0000 7f6ec3200640 1 --2- 172.21.15.57:0/3307300025 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6ea8004d40 0x7f6ea80051c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc00a9c0 tx=0x7f6ea8005830 comp rx=0 tx=0).stop 2024-03-27T09:59:25.520 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.518+0000 7f6ec2800640 1 -- 172.21.15.57:0/3307300025 reap_dead start 2024-03-27T09:59:25.520 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.518+0000 7f6ec3200640 1 -- 172.21.15.57:0/3307300025 shutdown_connections 2024-03-27T09:59:25.520 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.518+0000 7f6ec3200640 1 -- 172.21.15.57:0/3307300025 >> 172.21.15.57:0/3307300025 conn(0x7f6ec40cfb40 msgr2=0x7f6ec40cff20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:25.520 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.518+0000 7f6ec3200640 1 -- 172.21.15.57:0/3307300025 shutdown_connections 2024-03-27T09:59:25.520 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.518+0000 7f6ec3200640 1 -- 172.21.15.57:0/3307300025 wait complete. 2024-03-27T09:59:25.520 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.520+0000 7f6ec3200640 1 Processor -- start 2024-03-27T09:59:25.520 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.520+0000 7f6ec3200640 1 -- start start 2024-03-27T09:59:25.520 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.521+0000 7f6ec3200640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6ea8004d40 0x7f6ec40b5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:25.520 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.521+0000 7f6ec3200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6ec406e790 0x7f6ec406ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:25.520 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.521+0000 7f6ec3200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ec40ad8a0 0x7f6ec40add20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:25.520 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.521+0000 7f6ec3200640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f6ec415fef0 con 0x7f6ea8004d40 2024-03-27T09:59:25.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.521+0000 7f6ec3200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f6ec40cbc50 con 0x7f6ec40ad8a0 2024-03-27T09:59:25.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.521+0000 7f6ec3200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f6ec4160070 con 0x7f6ec406e790 2024-03-27T09:59:25.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.522+0000 7f6ec1e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6ea8004d40 0x7f6ec40b5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:25.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.522+0000 7f6ec1e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6ea8004d40 0x7f6ec40b5100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56148/0 (socket says 172.21.15.57:56148) 2024-03-27T09:59:25.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.522+0000 7f6ec1e00640 1 -- 172.21.15.57:0/4168102282 learned_addr learned my addr 172.21.15.57:0/4168102282 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T09:59:25.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.522+0000 7f6ec1e00640 1 -- 172.21.15.57:0/4168102282 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6ec406e790 msgr2=0x7f6ec406ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:25.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.522+0000 7f6ec1e00640 1 --2- 172.21.15.57:0/4168102282 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6ec406e790 0x7f6ec406ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:25.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.522+0000 7f6ec1e00640 1 -- 172.21.15.57:0/4168102282 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ec40ad8a0 msgr2=0x7f6ec40add20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:25.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.522+0000 7f6ec1e00640 1 --2- 172.21.15.57:0/4168102282 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ec40ad8a0 0x7f6ec40add20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:25.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.522+0000 7f6ec1e00640 1 -- 172.21.15.57:0/4168102282 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ec40b5640 con 0x7f6ea8004d40 2024-03-27T09:59:25.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.522+0000 7f6ec1e00640 1 --2- 172.21.15.57:0/4168102282 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6ea8004d40 0x7f6ec40b5100 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6eb400e7e0 tx=0x7f6eb400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:25.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.523+0000 7f6eba000640 1 -- 172.21.15.57:0/4168102282 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eb4017070 con 0x7f6ea8004d40 2024-03-27T09:59:25.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.523+0000 7f6eba000640 1 -- 172.21.15.57:0/4168102282 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6eb400c5f0 con 0x7f6ea8004d40 2024-03-27T09:59:25.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.523+0000 7f6eba000640 1 -- 172.21.15.57:0/4168102282 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eb400f040 con 0x7f6ea8004d40 2024-03-27T09:59:25.522 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.523+0000 7f6ec3200640 1 -- 172.21.15.57:0/4168102282 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ec40b3c70 con 0x7f6ea8004d40 2024-03-27T09:59:25.522 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.523+0000 7f6ec3200640 1 -- 172.21.15.57:0/4168102282 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ec40b4230 con 0x7f6ea8004d40 2024-03-27T09:59:25.522 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.524+0000 7f6ec3200640 1 -- 172.21.15.57:0/4168102282 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ec406f150 con 0x7f6ea8004d40 2024-03-27T09:59:25.523 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.525+0000 7f6eba000640 1 -- 172.21.15.57:0/4168102282 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f6eb401a070 con 0x7f6ea8004d40 2024-03-27T09:59:25.523 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.526+0000 7f6eba000640 1 --2- 172.21.15.57:0/4168102282 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f6ea006c530 0x7f6ea006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:25.523 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.526+0000 7f6eba000640 1 -- 172.21.15.57:0/4168102282 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f6eb408ae50 con 0x7f6ea8004d40 2024-03-27T09:59:25.523 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.526+0000 7f6ebbe00640 1 --2- 172.21.15.57:0/4168102282 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f6ea006c530 0x7f6ea006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:25.523 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.527+0000 7f6ebbe00640 1 --2- 172.21.15.57:0/4168102282 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f6ea006c530 0x7f6ea006e9f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6ec413a4e0 tx=0x7f6eac008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:25.523 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.530+0000 7f6eba000640 1 -- 172.21.15.57:0/4168102282 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f6eb40597b0 con 0x7f6ea8004d40 2024-03-27T09:59:25.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.732+0000 7f6ec3200640 1 -- 172.21.15.57:0/4168102282 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f6ec4068540 con 0x7f6ea8004d40 2024-03-27T09:59:25.724 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.733+0000 7f6eba000640 1 -- 172.21.15.57:0/4168102282 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) ==== 93+0+10 (secure 0 0 0) 0x7f6eb40590b0 con 0x7f6ea8004d40 2024-03-27T09:59:25.724 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2024-03-27T09:59:25.726 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.736+0000 7f6ec3200640 1 -- 172.21.15.57:0/4168102282 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f6ea006c530 msgr2=0x7f6ea006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:25.726 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.736+0000 7f6ec3200640 1 --2- 172.21.15.57:0/4168102282 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f6ea006c530 0x7f6ea006e9f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6ec413a4e0 tx=0x7f6eac008040 comp rx=0 tx=0).stop 2024-03-27T09:59:25.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.736+0000 7f6ec3200640 1 -- 172.21.15.57:0/4168102282 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6ea8004d40 msgr2=0x7f6ec40b5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:25.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.736+0000 7f6ec3200640 1 --2- 172.21.15.57:0/4168102282 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6ea8004d40 0x7f6ec40b5100 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6eb400e7e0 tx=0x7f6eb400eca0 comp rx=0 tx=0).stop 2024-03-27T09:59:25.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.736+0000 7f6ec3200640 1 -- 172.21.15.57:0/4168102282 shutdown_connections 2024-03-27T09:59:25.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.736+0000 7f6ec3200640 1 --2- 172.21.15.57:0/4168102282 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f6ea006c530 0x7f6ea006e9f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:25.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.736+0000 7f6ec3200640 1 --2- 172.21.15.57:0/4168102282 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ec40ad8a0 0x7f6ec40add20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:25.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.736+0000 7f6ec3200640 1 --2- 172.21.15.57:0/4168102282 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6ec406e790 0x7f6ec406ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:25.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.736+0000 7f6ec3200640 1 --2- 172.21.15.57:0/4168102282 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6ea8004d40 0x7f6ec40b5100 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:25.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.736+0000 7f6ec3200640 1 -- 172.21.15.57:0/4168102282 >> 172.21.15.57:0/4168102282 conn(0x7f6ec40cfb40 msgr2=0x7f6ec41408a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:25.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.736+0000 7f6ec3200640 1 -- 172.21.15.57:0/4168102282 shutdown_connections 2024-03-27T09:59:25.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.736+0000 7f6ec3200640 1 -- 172.21.15.57:0/4168102282 wait complete. 2024-03-27T09:59:25.746 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-03-27T09:59:25.969 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.978+0000 7fa8b4a00640 1 Processor -- start 2024-03-27T09:59:25.969 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.979+0000 7fa8b4a00640 1 -- start start 2024-03-27T09:59:25.971 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.980+0000 7fa8b4a00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fa8b00d0690 0x7fa8b00723c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:25.971 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.980+0000 7fa8b4a00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa8b00b4350 0x7fa8b00cd820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:25.971 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.980+0000 7fa8b4a00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8b00cd060 con 0x7fa8b0144760 2024-03-27T09:59:25.971 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.980+0000 7fa8b4a00640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7fa8b0073360 con 0x7fa8b00b4350 2024-03-27T09:59:25.971 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.980+0000 7fa8b4a00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7fa8b0144b40 con 0x7fa8b00d0690 2024-03-27T09:59:25.971 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.980+0000 7fa8af200640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa8b00b4350 0x7fa8b00cd820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:25.971 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.980+0000 7fa8af200640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa8b00b4350 0x7fa8b00cd820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56158/0 (socket says 172.21.15.57:56158) 2024-03-27T09:59:25.971 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.980+0000 7fa8af200640 1 -- 172.21.15.57:0/542145747 learned_addr learned my addr 172.21.15.57:0/542145747 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T09:59:25.971 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.980+0000 7fa8a5e00640 1 --2- 172.21.15.57:0/542145747 >> v2:172.21.15.118:3300/0 conn(0x7fa8b00d0690 0x7fa8b00723c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:25.972 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.981+0000 7fa8af200640 1 -- 172.21.15.57:0/542145747 >> v2:172.21.15.118:3300/0 conn(0x7fa8b00d0690 msgr2=0x7fa8b00723c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T09:59:25.972 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.981+0000 7fa8af200640 1 --2- 172.21.15.57:0/542145747 >> v2:172.21.15.118:3300/0 conn(0x7fa8b00d0690 0x7fa8b00723c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:25.972 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.981+0000 7fa8af200640 1 -- 172.21.15.57:0/542145747 >> v1:172.21.15.118:6789/0 conn(0x7fa8b0144760 legacy=0x7fa8b00cff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:25.972 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.981+0000 7fa8af200640 1 -- 172.21.15.57:0/542145747 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8b00b4780 con 0x7fa8b00b4350 2024-03-27T09:59:25.972 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.982+0000 7fa8af200640 1 --2- 172.21.15.57:0/542145747 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8b00b4350 0x7fa8b00cd820 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa8b0070e60 tx=0x7fa8a802bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca9849097d68598c server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:25.972 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.982+0000 7fa8ade00640 1 -- 172.21.15.57:0/542145747 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8a802cb20 con 0x7fa8b00b4350 2024-03-27T09:59:25.972 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.982+0000 7fa8ade00640 1 -- 172.21.15.57:0/542145747 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8a802ccc0 con 0x7fa8b00b4350 2024-03-27T09:59:25.972 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.982+0000 7fa8ade00640 1 -- 172.21.15.57:0/542145747 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8a8034610 con 0x7fa8b00b4350 2024-03-27T09:59:25.973 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.983+0000 7fa8b4a00640 1 -- 172.21.15.57:0/542145747 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8b00b4350 msgr2=0x7fa8b00cd820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:25.973 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.983+0000 7fa8b4a00640 1 --2- 172.21.15.57:0/542145747 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8b00b4350 0x7fa8b00cd820 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa8b0070e60 tx=0x7fa8a802bf80 comp rx=0 tx=0).stop 2024-03-27T09:59:25.974 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.983+0000 7fa8b4a00640 1 -- 172.21.15.57:0/542145747 shutdown_connections 2024-03-27T09:59:25.974 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.983+0000 7fa8b4a00640 1 --2- 172.21.15.57:0/542145747 >> v2:172.21.15.118:3300/0 conn(0x7fa8b00d0690 0x7fa8b00723c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:25.974 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.983+0000 7fa8b4a00640 1 --2- 172.21.15.57:0/542145747 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8b00b4350 0x7fa8b00cd820 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:25.974 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.983+0000 7fa8b4a00640 1 -- 172.21.15.57:0/542145747 >> 172.21.15.57:0/542145747 conn(0x7fa8b006b990 msgr2=0x7fa8b006bda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:25.974 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.983+0000 7fa8b4a00640 1 -- 172.21.15.57:0/542145747 shutdown_connections 2024-03-27T09:59:25.974 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.983+0000 7fa8b4a00640 1 -- 172.21.15.57:0/542145747 wait complete. 2024-03-27T09:59:25.975 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.985+0000 7fa8b4a00640 1 Processor -- start 2024-03-27T09:59:25.975 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.985+0000 7fa8b4a00640 1 -- start start 2024-03-27T09:59:25.977 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.986+0000 7fa8b4a00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8b00b4350 0x7fa8b01f3520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:25.977 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.986+0000 7fa8b4a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa8b00d0690 0x7fa8b013d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:25.977 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.986+0000 7fa8b4a00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa8b0144760 0x7fa8b015dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:25.977 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.986+0000 7fa8b4a00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fa8b0073080 con 0x7fa8b00b4350 2024-03-27T09:59:25.977 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.986+0000 7fa8b4a00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fa8b0072da0 con 0x7fa8b00d0690 2024-03-27T09:59:25.977 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.986+0000 7fa8b4a00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fa8b00cd300 con 0x7fa8b0144760 2024-03-27T09:59:25.978 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.986+0000 7fa8ae800640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8b00b4350 0x7fa8b01f3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:25.978 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.986+0000 7fa8ae800640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8b00b4350 0x7fa8b01f3520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56166/0 (socket says 172.21.15.57:56166) 2024-03-27T09:59:25.978 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.986+0000 7fa8ae800640 1 -- 172.21.15.57:0/2277568240 learned_addr learned my addr 172.21.15.57:0/2277568240 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T09:59:25.978 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.986+0000 7fa8ae800640 1 -- 172.21.15.57:0/2277568240 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa8b0144760 msgr2=0x7fa8b015dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:25.978 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.986+0000 7fa8ae800640 1 --2- 172.21.15.57:0/2277568240 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa8b0144760 0x7fa8b015dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:25.978 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.986+0000 7fa8ae800640 1 -- 172.21.15.57:0/2277568240 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa8b00d0690 msgr2=0x7fa8b013d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:25.978 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.986+0000 7fa8ae800640 1 --2- 172.21.15.57:0/2277568240 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa8b00d0690 0x7fa8b013d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:25.978 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.986+0000 7fa8ae800640 1 -- 172.21.15.57:0/2277568240 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8b013e0a0 con 0x7fa8b00b4350 2024-03-27T09:59:25.978 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.987+0000 7fa8ae800640 1 --2- 172.21.15.57:0/2277568240 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8b00b4350 0x7fa8b01f3520 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa8a000c370 tx=0x7fa8a000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:25.978 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.987+0000 7fa8a7400640 1 -- 172.21.15.57:0/2277568240 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8a0017070 con 0x7fa8b00b4350 2024-03-27T09:59:25.978 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.987+0000 7fa8a7400640 1 -- 172.21.15.57:0/2277568240 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8a00052f0 con 0x7fa8b00b4350 2024-03-27T09:59:25.978 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.987+0000 7fa8a7400640 1 -- 172.21.15.57:0/2277568240 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8a0003850 con 0x7fa8b00b4350 2024-03-27T09:59:25.978 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.987+0000 7fa8b4a00640 1 -- 172.21.15.57:0/2277568240 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8b013e380 con 0x7fa8b00b4350 2024-03-27T09:59:25.979 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.987+0000 7fa8b4a00640 1 -- 172.21.15.57:0/2277568240 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8b015b9f0 con 0x7fa8b00b4350 2024-03-27T09:59:25.979 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.988+0000 7fa8b4a00640 1 -- 172.21.15.57:0/2277568240 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8b0068540 con 0x7fa8b00b4350 2024-03-27T09:59:25.979 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.989+0000 7fa8a7400640 1 -- 172.21.15.57:0/2277568240 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fa8a001a070 con 0x7fa8b00b4350 2024-03-27T09:59:25.980 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.990+0000 7fa8a7400640 1 --2- 172.21.15.57:0/2277568240 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fa88c06c530 0x7fa88c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:25.980 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.990+0000 7fa8a7400640 1 -- 172.21.15.57:0/2277568240 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fa8a008a6f0 con 0x7fa8b00b4350 2024-03-27T09:59:25.981 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.991+0000 7fa8a5e00640 1 --2- 172.21.15.57:0/2277568240 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fa88c06c530 0x7fa88c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:25.981 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.991+0000 7fa8a5e00640 1 --2- 172.21.15.57:0/2277568240 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fa88c06c530 0x7fa88c06e9f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa8b015db90 tx=0x7fa898008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:25.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:25.995+0000 7fa8a7400640 1 -- 172.21.15.57:0/2277568240 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7fa8a0058fc0 con 0x7fa8b00b4350 2024-03-27T09:59:26.190 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:26.200+0000 7fa8b4a00640 1 -- 172.21.15.57:0/2277568240 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fa8b00cd670 con 0x7fa8b00b4350 2024-03-27T09:59:26.191 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:26.201+0000 7fa8a7400640 1 -- 172.21.15.57:0/2277568240 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) ==== 84+0+65 (secure 0 0 0) 0x7fa8a00588c0 con 0x7fa8b00b4350 2024-03-27T09:59:26.191 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T09:59:26.191 INFO:teuthology.orchestra.run.smithi057.stdout:[ 2024-03-27T09:59:26.191 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-03-27T09:59:26.191 INFO:teuthology.orchestra.run.smithi057.stdout: "poolnum": 1, 2024-03-27T09:59:26.191 INFO:teuthology.orchestra.run.smithi057.stdout: "poolname": ".mgr" 2024-03-27T09:59:26.191 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-03-27T09:59:26.191 INFO:teuthology.orchestra.run.smithi057.stdout:] 2024-03-27T09:59:26.194 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:26.203+0000 7fa8b4a00640 1 -- 172.21.15.57:0/2277568240 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fa88c06c530 msgr2=0x7fa88c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:26.194 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:26.203+0000 7fa8b4a00640 1 --2- 172.21.15.57:0/2277568240 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fa88c06c530 0x7fa88c06e9f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa8b015db90 tx=0x7fa898008040 comp rx=0 tx=0).stop 2024-03-27T09:59:26.194 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:26.203+0000 7fa8b4a00640 1 -- 172.21.15.57:0/2277568240 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8b00b4350 msgr2=0x7fa8b01f3520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:26.194 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:26.203+0000 7fa8b4a00640 1 --2- 172.21.15.57:0/2277568240 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8b00b4350 0x7fa8b01f3520 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa8a000c370 tx=0x7fa8a000c830 comp rx=0 tx=0).stop 2024-03-27T09:59:26.194 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:26.203+0000 7fa8b4a00640 1 -- 172.21.15.57:0/2277568240 shutdown_connections 2024-03-27T09:59:26.194 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:26.203+0000 7fa8b4a00640 1 --2- 172.21.15.57:0/2277568240 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa8b0144760 0x7fa8b015dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:26.194 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:26.203+0000 7fa8b4a00640 1 --2- 172.21.15.57:0/2277568240 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fa88c06c530 0x7fa88c06e9f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:26.194 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:26.203+0000 7fa8b4a00640 1 --2- 172.21.15.57:0/2277568240 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa8b00d0690 0x7fa8b013d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:26.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:26.203+0000 7fa8b4a00640 1 --2- 172.21.15.57:0/2277568240 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa8b00b4350 0x7fa8b01f3520 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:26.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:26.203+0000 7fa8b4a00640 1 -- 172.21.15.57:0/2277568240 >> 172.21.15.57:0/2277568240 conn(0x7fa8b006b990 msgr2=0x7fa8b00b2ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:26.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:26.203+0000 7fa8b4a00640 1 -- 172.21.15.57:0/2277568240 shutdown_connections 2024-03-27T09:59:26.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:26.204+0000 7fa8b4a00640 1 -- 172.21.15.57:0/2277568240 wait complete. 2024-03-27T09:59:26.213 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-03-27T09:59:26.213 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-03-27T09:59:26.445 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:26.454+0000 7f1d53c00640 1 Processor -- start 2024-03-27T09:59:26.445 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:26.455+0000 7f1d53c00640 1 -- start start 2024-03-27T09:59:26.446 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:26.456+0000 7f1d53c00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1d4c0d2260 0x7f1d4c0b5500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:26.447 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:26.456+0000 7f1d53c00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1d4c0d2640 0x7f1d4c15e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:26.447 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:26.456+0000 7f1d53c00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d4c0d2fb0 con 0x7f1d4c0d2aa0 2024-03-27T09:59:26.447 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:26.456+0000 7f1d53c00640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f1d4c0d3290 con 0x7f1d4c0d2640 2024-03-27T09:59:26.447 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:26.456+0000 7f1d53c00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f1d4c0b5a40 con 0x7f1d4c0d2260 2024-03-27T09:59:26.447 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:26.456+0000 7f1d4be00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1d4c0d2640 0x7f1d4c15e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:26.447 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:26.456+0000 7f1d4be00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1d4c0d2640 0x7f1d4c15e290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56182/0 (socket says 172.21.15.57:56182) 2024-03-27T09:59:26.447 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:26.456+0000 7f1d4be00640 1 -- 172.21.15.57:0/1794061441 learned_addr learned my addr 172.21.15.57:0/1794061441 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T09:59:26.447 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:26.457+0000 7f1d4be00640 1 -- 172.21.15.57:0/1794061441 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1d4c0d2260 msgr2=0x7f1d4c0b5500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T09:59:26.447 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:26.457+0000 7f1d4be00640 1 --2- 172.21.15.57:0/1794061441 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1d4c0d2260 0x7f1d4c0b5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:26.447 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:26.457+0000 7f1d4be00640 1 -- 172.21.15.57:0/1794061441 >> v1:172.21.15.118:6789/0 conn(0x7f1d4c0d2aa0 legacy=0x7f1d4c0d07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T09:59:26.447 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:26.457+0000 7f1d4be00640 1 -- 172.21.15.57:0/1794061441 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d4c0cfb10 con 0x7f1d4c0d2640 2024-03-27T09:59:26.448 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:26.458+0000 7f1d4be00640 1 --2- 172.21.15.57:0/1794061441 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1d4c0d2640 0x7f1d4c15e290 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1d34009e50 tx=0x7f1d3402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd8e24d787f4c303 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:26.448 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:26.458+0000 7f1d4b400640 1 -- 172.21.15.57:0/1794061441 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d3402ca70 con 0x7f1d4c0d2640 2024-03-27T09:59:26.448 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:26.458+0000 7f1d4b400640 1 -- 172.21.15.57:0/1794061441 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d3402cc10 con 0x7f1d4c0d2640 2024-03-27T09:59:26.448 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:26.458+0000 7f1d4b400640 1 -- 172.21.15.57:0/1794061441 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d340343f0 con 0x7f1d4c0d2640 2024-03-27T09:59:26.449 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:26.458+0000 7f1d53c00640 1 -- 172.21.15.57:0/1794061441 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1d4c0d2640 msgr2=0x7f1d4c15e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:26.449 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:26.458+0000 7f1d53c00640 1 --2- 172.21.15.57:0/1794061441 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1d4c0d2640 0x7f1d4c15e290 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1d34009e50 tx=0x7f1d3402bed0 comp rx=0 tx=0).stop 2024-03-27T09:59:26.449 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:26.459+0000 7f1d53c00640 1 -- 172.21.15.57:0/1794061441 shutdown_connections 2024-03-27T09:59:26.449 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:26.459+0000 7f1d53c00640 1 --2- 172.21.15.57:0/1794061441 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1d4c0d2640 0x7f1d4c15e290 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:26.450 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:26.459+0000 7f1d53c00640 1 --2- 172.21.15.57:0/1794061441 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1d4c0d2260 0x7f1d4c0b5500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:26.450 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:26.459+0000 7f1d53c00640 1 -- 172.21.15.57:0/1794061441 >> 172.21.15.57:0/1794061441 conn(0x7f1d4c0d40f0 msgr2=0x7f1d4c0d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:26.450 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:26.459+0000 7f1d53c00640 1 -- 172.21.15.57:0/1794061441 shutdown_connections 2024-03-27T09:59:26.450 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:26.459+0000 7f1d53c00640 1 -- 172.21.15.57:0/1794061441 wait complete. 2024-03-27T09:59:26.451 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:26.460+0000 7f1d53c00640 1 Processor -- start 2024-03-27T09:59:26.451 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:26.461+0000 7f1d53c00640 1 -- start start 2024-03-27T09:59:26.453 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:26.462+0000 7f1d53c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d4c0d2260 0x7f1d4c1599a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:26.454 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:26.462+0000 7f1d53c00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1d4c0d2640 0x7f1d4c0c9840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:26.454 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:26.462+0000 7f1d53c00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1d4c0d2aa0 0x7f1d4c160c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:26.454 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:26.462+0000 7f1d53c00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f1d4c0d0160 con 0x7f1d4c0d2aa0 2024-03-27T09:59:26.454 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:26.462+0000 7f1d53c00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f1d4c0cf8c0 con 0x7f1d4c0d2260 2024-03-27T09:59:26.454 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:26.462+0000 7f1d53c00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f1d4c0b3430 con 0x7f1d4c0d2640 2024-03-27T09:59:26.454 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:26.462+0000 7f1d51c00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1d4c0d2aa0 0x7f1d4c160c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:26.454 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:26.462+0000 7f1d51c00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1d4c0d2aa0 0x7f1d4c160c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56184/0 (socket says 172.21.15.57:56184) 2024-03-27T09:59:26.454 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:26.462+0000 7f1d51c00640 1 -- 172.21.15.57:0/3978926533 learned_addr learned my addr 172.21.15.57:0/3978926533 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T09:59:26.454 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:26.462+0000 7f1d51200640 1 --2- 172.21.15.57:0/3978926533 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d4c0d2260 0x7f1d4c1599a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:26.454 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:26.462+0000 7f1d4be00640 1 --2- 172.21.15.57:0/3978926533 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1d4c0d2640 0x7f1d4c0c9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:26.454 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:26.462+0000 7f1d51c00640 1 -- 172.21.15.57:0/3978926533 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1d4c0d2640 msgr2=0x7f1d4c0c9840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:26.455 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:26.462+0000 7f1d51c00640 1 --2- 172.21.15.57:0/3978926533 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1d4c0d2640 0x7f1d4c0c9840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:26.455 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:26.462+0000 7f1d51c00640 1 -- 172.21.15.57:0/3978926533 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d4c0d2260 msgr2=0x7f1d4c1599a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:26.455 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:26.462+0000 7f1d51c00640 1 --2- 172.21.15.57:0/3978926533 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d4c0d2260 0x7f1d4c1599a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:26.455 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:26.462+0000 7f1d51c00640 1 -- 172.21.15.57:0/3978926533 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d4c1f7ed0 con 0x7f1d4c0d2aa0 2024-03-27T09:59:26.455 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:26.462+0000 7f1d4be00640 1 --2- 172.21.15.57:0/3978926533 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1d4c0d2640 0x7f1d4c0c9840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T09:59:26.455 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:26.463+0000 7f1d51c00640 1 --2- 172.21.15.57:0/3978926533 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1d4c0d2aa0 0x7f1d4c160c90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1d4400c390 tx=0x7f1d4400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:26.455 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:26.463+0000 7f1d48c00640 1 -- 172.21.15.57:0/3978926533 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d44017070 con 0x7f1d4c0d2aa0 2024-03-27T09:59:26.455 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:26.463+0000 7f1d48c00640 1 -- 172.21.15.57:0/3978926533 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d440035f0 con 0x7f1d4c0d2aa0 2024-03-27T09:59:26.455 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:26.463+0000 7f1d48c00640 1 -- 172.21.15.57:0/3978926533 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d440039e0 con 0x7f1d4c0d2aa0 2024-03-27T09:59:26.455 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:26.463+0000 7f1d53c00640 1 -- 172.21.15.57:0/3978926533 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d4c1f81b0 con 0x7f1d4c0d2aa0 2024-03-27T09:59:26.455 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:26.463+0000 7f1d53c00640 1 -- 172.21.15.57:0/3978926533 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d4c1f8770 con 0x7f1d4c0d2aa0 2024-03-27T09:59:26.456 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:26.464+0000 7f1d53c00640 1 -- 172.21.15.57:0/3978926533 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d4c0b4800 con 0x7f1d4c0d2aa0 2024-03-27T09:59:26.456 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:26.465+0000 7f1d48c00640 1 -- 172.21.15.57:0/3978926533 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f1d4401a070 con 0x7f1d4c0d2aa0 2024-03-27T09:59:26.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:26.466+0000 7f1d48c00640 1 --2- 172.21.15.57:0/3978926533 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f1d2806c530 0x7f1d2806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:26.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:26.466+0000 7f1d48c00640 1 -- 172.21.15.57:0/3978926533 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f1d4408a8d0 con 0x7f1d4c0d2aa0 2024-03-27T09:59:26.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:26.467+0000 7f1d51200640 1 --2- 172.21.15.57:0/3978926533 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f1d2806c530 0x7f1d2806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:26.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:26.467+0000 7f1d51200640 1 --2- 172.21.15.57:0/3978926533 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f1d2806c530 0x7f1d2806e9f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c00b810 tx=0x7f1d3c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:26.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:26.471+0000 7f1d48c00640 1 -- 172.21.15.57:0/3978926533 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f1d4c0b4800 con 0x7f1d4c0d2aa0 2024-03-27T09:59:26.665 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:26.675+0000 7f1d53c00640 1 -- 172.21.15.57:0/3978926533 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f1d4c068620 con 0x7f1d4c0d2aa0 2024-03-27T09:59:27.065 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:27.074+0000 7f1d48c00640 1 -- 172.21.15.57:0/3978926533 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) ==== 138+0+0 (secure 0 0 0) 0x7f1d44059110 con 0x7f1d4c0d2aa0 2024-03-27T09:59:27.065 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_metadata' created 2024-03-27T09:59:27.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:27.079+0000 7f1d53c00640 1 -- 172.21.15.57:0/3978926533 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f1d2806c530 msgr2=0x7f1d2806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:27.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:27.079+0000 7f1d53c00640 1 --2- 172.21.15.57:0/3978926533 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f1d2806c530 0x7f1d2806e9f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c00b810 tx=0x7f1d3c008040 comp rx=0 tx=0).stop 2024-03-27T09:59:27.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:27.079+0000 7f1d53c00640 1 -- 172.21.15.57:0/3978926533 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1d4c0d2aa0 msgr2=0x7f1d4c160c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:27.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:27.079+0000 7f1d53c00640 1 --2- 172.21.15.57:0/3978926533 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1d4c0d2aa0 0x7f1d4c160c90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f1d4400c390 tx=0x7f1d4400c850 comp rx=0 tx=0).stop 2024-03-27T09:59:27.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:27.080+0000 7f1d53c00640 1 -- 172.21.15.57:0/3978926533 shutdown_connections 2024-03-27T09:59:27.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:27.080+0000 7f1d53c00640 1 --2- 172.21.15.57:0/3978926533 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1d4c0d2aa0 0x7f1d4c160c90 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:27.071 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:27.080+0000 7f1d53c00640 1 --2- 172.21.15.57:0/3978926533 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1d4c0d2640 0x7f1d4c0c9840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:27.071 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:27.080+0000 7f1d53c00640 1 --2- 172.21.15.57:0/3978926533 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f1d2806c530 0x7f1d2806e9f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:27.071 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:27.080+0000 7f1d53c00640 1 --2- 172.21.15.57:0/3978926533 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d4c0d2260 0x7f1d4c1599a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:27.071 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:27.080+0000 7f1d53c00640 1 -- 172.21.15.57:0/3978926533 >> 172.21.15.57:0/3978926533 conn(0x7f1d4c0d40f0 msgr2=0x7f1d4c06d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:27.071 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:27.080+0000 7f1d53c00640 1 -- 172.21.15.57:0/3978926533 shutdown_connections 2024-03-27T09:59:27.071 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:27.080+0000 7f1d53c00640 1 -- 172.21.15.57:0/3978926533 wait complete. 2024-03-27T09:59:27.098 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-03-27T09:59:27.311 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:27.320+0000 7f6906600640 1 Processor -- start 2024-03-27T09:59:27.311 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:27.320+0000 7f6906600640 1 -- start start 2024-03-27T09:59:27.312 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:27.322+0000 7f6906600640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f69001616c0 0x7f69000b0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:27.312 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:27.322+0000 7f6906600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f69000b1330 0x7f69000b2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:27.312 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:27.322+0000 7f6906600640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6900161aa0 con 0x7f69000b58d0 2024-03-27T09:59:27.312 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:27.322+0000 7f6906600640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f69000b17d0 con 0x7f69001616c0 2024-03-27T09:59:27.313 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:27.322+0000 7f6906600640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f69000b1ab0 con 0x7f69000b1330 2024-03-27T09:59:27.313 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:27.322+0000 7f6905200640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f69001616c0 0x7f69000b0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:27.313 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:27.322+0000 7f6905200640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f69001616c0 0x7f69000b0df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56190/0 (socket says 172.21.15.57:56190) 2024-03-27T09:59:27.313 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:27.322+0000 7f6905200640 1 -- 172.21.15.57:0/2805923911 learned_addr learned my addr 172.21.15.57:0/2805923911 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T09:59:27.313 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:27.322+0000 7f6905c00640 1 --2- 172.21.15.57:0/2805923911 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f69000b1330 0x7f69000b2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:27.313 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:27.323+0000 7f6905200640 1 -- 172.21.15.57:0/2805923911 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f69000b1330 msgr2=0x7f69000b2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T09:59:27.314 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:27.323+0000 7f6905200640 1 --2- 172.21.15.57:0/2805923911 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f69000b1330 0x7f69000b2870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:27.314 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:27.323+0000 7f6905200640 1 -- 172.21.15.57:0/2805923911 >> v1:172.21.15.118:6789/0 conn(0x7f69000b58d0 legacy=0x7f69000d4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T09:59:27.314 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:27.323+0000 7f6905200640 1 -- 172.21.15.57:0/2805923911 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69000b1d90 con 0x7f69001616c0 2024-03-27T09:59:27.314 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:27.324+0000 7f6905200640 1 --2- 172.21.15.57:0/2805923911 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69001616c0 0x7f69000b0df0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f68f4009870 tx=0x7f68f402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ddc548700f2365d server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:27.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:27.324+0000 7f68ff400640 1 -- 172.21.15.57:0/2805923911 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68f4035020 con 0x7f69001616c0 2024-03-27T09:59:27.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:27.324+0000 7f68ff400640 1 -- 172.21.15.57:0/2805923911 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68f4031640 con 0x7f69001616c0 2024-03-27T09:59:27.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:27.324+0000 7f68ff400640 1 -- 172.21.15.57:0/2805923911 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68f402d040 con 0x7f69001616c0 2024-03-27T09:59:27.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:27.325+0000 7f6906600640 1 -- 172.21.15.57:0/2805923911 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69001616c0 msgr2=0x7f69000b0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:27.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:27.325+0000 7f6906600640 1 --2- 172.21.15.57:0/2805923911 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69001616c0 0x7f69000b0df0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f68f4009870 tx=0x7f68f402b8f0 comp rx=0 tx=0).stop 2024-03-27T09:59:27.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:27.325+0000 7f6906600640 1 -- 172.21.15.57:0/2805923911 shutdown_connections 2024-03-27T09:59:27.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:27.325+0000 7f6906600640 1 --2- 172.21.15.57:0/2805923911 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f69000b1330 0x7f69000b2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:27.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:27.325+0000 7f6906600640 1 --2- 172.21.15.57:0/2805923911 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69001616c0 0x7f69000b0df0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:27.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:27.325+0000 7f6906600640 1 -- 172.21.15.57:0/2805923911 >> 172.21.15.57:0/2805923911 conn(0x7f690008dbe0 msgr2=0x7f690009d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:27.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:27.325+0000 7f6906600640 1 -- 172.21.15.57:0/2805923911 shutdown_connections 2024-03-27T09:59:27.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:27.325+0000 7f6906600640 1 -- 172.21.15.57:0/2805923911 wait complete. 2024-03-27T09:59:27.317 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:27.327+0000 7f6906600640 1 Processor -- start 2024-03-27T09:59:27.317 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:27.327+0000 7f6906600640 1 -- start start 2024-03-27T09:59:27.319 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:27.328+0000 7f6906600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f69000b1330 0x7f690014ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:27.319 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:27.328+0000 7f6906600640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69000b58d0 0x7f690014e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:27.319 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:27.328+0000 7f6906600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f69001616c0 0x7f69000c7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:27.319 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:27.328+0000 7f6906600640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f69000cead0 con 0x7f69000b58d0 2024-03-27T09:59:27.319 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:27.328+0000 7f6906600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f69000b2350 con 0x7f69001616c0 2024-03-27T09:59:27.320 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:27.328+0000 7f6906600640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f69000cec50 con 0x7f69000b1330 2024-03-27T09:59:27.320 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:27.329+0000 7f68ffe00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69000b58d0 0x7f690014e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:27.320 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:27.329+0000 7f68ffe00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69000b58d0 0x7f690014e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56204/0 (socket says 172.21.15.57:56204) 2024-03-27T09:59:27.320 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:27.329+0000 7f68ffe00640 1 -- 172.21.15.57:0/2775130427 learned_addr learned my addr 172.21.15.57:0/2775130427 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T09:59:27.320 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:27.329+0000 7f6905200640 1 --2- 172.21.15.57:0/2775130427 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f69000b1330 0x7f690014ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:27.320 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:27.329+0000 7f6905c00640 1 --2- 172.21.15.57:0/2775130427 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f69001616c0 0x7f69000c7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:27.320 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:27.329+0000 7f68ffe00640 1 -- 172.21.15.57:0/2775130427 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f69000b1330 msgr2=0x7f690014ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:27.320 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:27.329+0000 7f68ffe00640 1 --2- 172.21.15.57:0/2775130427 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f69000b1330 0x7f690014ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:27.320 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:27.329+0000 7f68ffe00640 1 -- 172.21.15.57:0/2775130427 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f69001616c0 msgr2=0x7f69000c7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:27.320 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:27.329+0000 7f68ffe00640 1 --2- 172.21.15.57:0/2775130427 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f69001616c0 0x7f69000c7cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:27.320 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:27.329+0000 7f68ffe00640 1 -- 172.21.15.57:0/2775130427 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f690014d450 con 0x7f69000b58d0 2024-03-27T09:59:27.321 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:27.330+0000 7f68ffe00640 1 --2- 172.21.15.57:0/2775130427 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69000b58d0 0x7f690014e4d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f68ec00c3f0 tx=0x7f68ec00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:27.321 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:27.330+0000 7f68fcc00640 1 -- 172.21.15.57:0/2775130427 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68ec007020 con 0x7f69000b58d0 2024-03-27T09:59:27.321 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:27.330+0000 7f68fcc00640 1 -- 172.21.15.57:0/2775130427 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68ec0071c0 con 0x7f69000b58d0 2024-03-27T09:59:27.322 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:27.330+0000 7f6906600640 1 -- 172.21.15.57:0/2775130427 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f690014d730 con 0x7f69000b58d0 2024-03-27T09:59:27.322 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:27.330+0000 7f68fcc00640 1 -- 172.21.15.57:0/2775130427 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68ec007590 con 0x7f69000b58d0 2024-03-27T09:59:27.322 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:27.330+0000 7f6906600640 1 -- 172.21.15.57:0/2775130427 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f690014dcf0 con 0x7f69000b58d0 2024-03-27T09:59:27.322 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:27.331+0000 7f6906600640 1 -- 172.21.15.57:0/2775130427 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6900068540 con 0x7f69000b58d0 2024-03-27T09:59:27.323 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:27.333+0000 7f68fcc00640 1 -- 172.21.15.57:0/2775130427 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f68ec019020 con 0x7f69000b58d0 2024-03-27T09:59:27.324 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:27.333+0000 7f68fcc00640 1 --2- 172.21.15.57:0/2775130427 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f68e006c530 0x7f68e006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:27.324 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:27.334+0000 7f68fcc00640 1 -- 172.21.15.57:0/2775130427 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5227+0+0 (secure 0 0 0) 0x7f68ec08ad00 con 0x7f69000b58d0 2024-03-27T09:59:27.324 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:27.334+0000 7f6905200640 1 --2- 172.21.15.57:0/2775130427 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f68e006c530 0x7f68e006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:27.325 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:27.335+0000 7f6905200640 1 --2- 172.21.15.57:0/2775130427 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f68e006c530 0x7f68e006e9f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f68f4036000 tx=0x7f68f403c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:27.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:27.339+0000 7f68fcc00640 1 -- 172.21.15.57:0/2775130427 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f68ec0594f0 con 0x7f69000b58d0 2024-03-27T09:59:27.531 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:27.541+0000 7f6906600640 1 -- 172.21.15.57:0/2775130427 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7f69000d0ae0 con 0x7f69000b58d0 2024-03-27T09:59:28.072 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:28.081+0000 7f68fcc00640 1 -- 172.21.15.57:0/2775130427 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v19) ==== 171+0+0 (secure 0 0 0) 0x7f68ec058df0 con 0x7f69000b58d0 2024-03-27T09:59:28.072 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_data' created 2024-03-27T09:59:28.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:28.085+0000 7f6906600640 1 -- 172.21.15.57:0/2775130427 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f68e006c530 msgr2=0x7f68e006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:28.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:28.085+0000 7f6906600640 1 --2- 172.21.15.57:0/2775130427 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f68e006c530 0x7f68e006e9f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f68f4036000 tx=0x7f68f403c040 comp rx=0 tx=0).stop 2024-03-27T09:59:28.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:28.085+0000 7f6906600640 1 -- 172.21.15.57:0/2775130427 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69000b58d0 msgr2=0x7f690014e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:28.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:28.085+0000 7f6906600640 1 --2- 172.21.15.57:0/2775130427 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69000b58d0 0x7f690014e4d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f68ec00c3f0 tx=0x7f68ec00c8b0 comp rx=0 tx=0).stop 2024-03-27T09:59:28.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:28.085+0000 7f6906600640 1 -- 172.21.15.57:0/2775130427 shutdown_connections 2024-03-27T09:59:28.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:28.085+0000 7f6906600640 1 --2- 172.21.15.57:0/2775130427 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f68e006c530 0x7f68e006e9f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:28.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:28.085+0000 7f6906600640 1 --2- 172.21.15.57:0/2775130427 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f69001616c0 0x7f69000c7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:28.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:28.085+0000 7f6906600640 1 --2- 172.21.15.57:0/2775130427 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69000b58d0 0x7f690014e4d0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:28.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:28.085+0000 7f6906600640 1 --2- 172.21.15.57:0/2775130427 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f69000b1330 0x7f690014ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:28.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:28.085+0000 7f6906600640 1 -- 172.21.15.57:0/2775130427 >> 172.21.15.57:0/2775130427 conn(0x7f690008dbe0 msgr2=0x7f69000b4c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:28.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:28.086+0000 7f6906600640 1 -- 172.21.15.57:0/2775130427 shutdown_connections 2024-03-27T09:59:28.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:28.086+0000 7f6906600640 1 -- 172.21.15.57:0/2775130427 wait complete. 2024-03-27T09:59:28.109 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-03-27T09:59:28.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:28.308+0000 7f1a7e600640 1 Processor -- start 2024-03-27T09:59:28.299 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:28.308+0000 7f1a7e600640 1 -- start start 2024-03-27T09:59:28.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:28.310+0000 7f1a7e600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1a780aea20 0x7f1a7815d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:28.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:28.310+0000 7f1a7e600640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f1a780acd60 0x7f1a780aee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:28.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:28.310+0000 7f1a7e600640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1a780711b0 0x7f1a780715c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:28.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:28.310+0000 7f1a7e600640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f1a780af340 con 0x7f1a780711b0 2024-03-27T09:59:28.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:28.310+0000 7f1a7e600640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f1a7815c4c0 con 0x7f1a780acd60 2024-03-27T09:59:28.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:28.310+0000 7f1a7e600640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f1a780ad1c0 con 0x7f1a780aea20 2024-03-27T09:59:28.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:28.311+0000 7f1a77e00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1a780711b0 0x7f1a780715c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:28.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:28.311+0000 7f1a77e00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1a780711b0 0x7f1a780715c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56206/0 (socket says 172.21.15.57:56206) 2024-03-27T09:59:28.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:28.311+0000 7f1a77e00640 1 -- 172.21.15.57:0/1716577701 learned_addr learned my addr 172.21.15.57:0/1716577701 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T09:59:28.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:28.311+0000 7f1a77400640 1 --2- 172.21.15.57:0/1716577701 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1a780aea20 0x7f1a7815d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:28.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:28.311+0000 7f1a76a00640 1 --2- 172.21.15.57:0/1716577701 >> v2:172.21.15.118:3300/0 conn(0x7f1a780acd60 0x7f1a780aee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:28.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:28.311+0000 7f1a77e00640 1 -- 172.21.15.57:0/1716577701 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1a780aea20 msgr2=0x7f1a7815d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T09:59:28.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:28.311+0000 7f1a77e00640 1 --2- 172.21.15.57:0/1716577701 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1a780aea20 0x7f1a7815d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:28.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:28.311+0000 7f1a77e00640 1 -- 172.21.15.57:0/1716577701 >> v2:172.21.15.118:3300/0 conn(0x7f1a780acd60 msgr2=0x7f1a780aee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T09:59:28.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:28.311+0000 7f1a77e00640 1 --2- 172.21.15.57:0/1716577701 >> v2:172.21.15.118:3300/0 conn(0x7f1a780acd60 0x7f1a780aee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:28.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:28.311+0000 7f1a77e00640 1 -- 172.21.15.57:0/1716577701 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a78072600 con 0x7f1a780711b0 2024-03-27T09:59:28.303 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:28.312+0000 7f1a77e00640 1 --2- 172.21.15.57:0/1716577701 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1a780711b0 0x7f1a780715c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1a78070d50 tx=0x7f1a7002be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=957735f2b513561a server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:28.303 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:28.313+0000 7f1a76000640 1 -- 172.21.15.57:0/1716577701 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a7002c9e0 con 0x7f1a780711b0 2024-03-27T09:59:28.303 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:28.313+0000 7f1a76000640 1 -- 172.21.15.57:0/1716577701 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a7002cb80 con 0x7f1a780711b0 2024-03-27T09:59:28.303 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:28.313+0000 7f1a76000640 1 -- 172.21.15.57:0/1716577701 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a700343f0 con 0x7f1a780711b0 2024-03-27T09:59:28.304 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:28.313+0000 7f1a7e600640 1 -- 172.21.15.57:0/1716577701 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1a780711b0 msgr2=0x7f1a780715c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:28.304 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:28.313+0000 7f1a7e600640 1 --2- 172.21.15.57:0/1716577701 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1a780711b0 0x7f1a780715c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f1a78070d50 tx=0x7f1a7002be40 comp rx=0 tx=0).stop 2024-03-27T09:59:28.304 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:28.314+0000 7f1a7e600640 1 -- 172.21.15.57:0/1716577701 shutdown_connections 2024-03-27T09:59:28.304 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:28.314+0000 7f1a7e600640 1 --2- 172.21.15.57:0/1716577701 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1a780711b0 0x7f1a780715c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:28.304 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:28.314+0000 7f1a7e600640 1 --2- 172.21.15.57:0/1716577701 >> v2:172.21.15.118:3300/0 conn(0x7f1a780acd60 0x7f1a780aee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:28.304 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:28.314+0000 7f1a7e600640 1 --2- 172.21.15.57:0/1716577701 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1a780aea20 0x7f1a7815d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:28.304 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:28.314+0000 7f1a7e600640 1 -- 172.21.15.57:0/1716577701 >> 172.21.15.57:0/1716577701 conn(0x7f1a780b18a0 msgr2=0x7f1a780b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:28.304 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:28.314+0000 7f1a7e600640 1 -- 172.21.15.57:0/1716577701 shutdown_connections 2024-03-27T09:59:28.304 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:28.314+0000 7f1a7e600640 1 -- 172.21.15.57:0/1716577701 wait complete. 2024-03-27T09:59:28.306 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:28.316+0000 7f1a7e600640 1 Processor -- start 2024-03-27T09:59:28.306 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:28.316+0000 7f1a7e600640 1 -- start start 2024-03-27T09:59:28.308 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:28.317+0000 7f1a7e600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a780711b0 0x7f1a7814ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:28.308 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:28.317+0000 7f1a7e600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1a780acd60 0x7f1a780af920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:28.308 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:28.317+0000 7f1a7e600640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1a780aea20 0x7f1a780afe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:28.308 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:28.317+0000 7f1a7e600640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f1a78072ea0 con 0x7f1a780aea20 2024-03-27T09:59:28.308 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:28.317+0000 7f1a7e600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f1a78072bc0 con 0x7f1a780711b0 2024-03-27T09:59:28.308 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:28.317+0000 7f1a7e600640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f1a780733c0 con 0x7f1a780acd60 2024-03-27T09:59:28.308 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:28.318+0000 7f1a77e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1a780aea20 0x7f1a780afe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:28.308 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:28.318+0000 7f1a77e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1a780aea20 0x7f1a780afe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56222/0 (socket says 172.21.15.57:56222) 2024-03-27T09:59:28.308 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:28.318+0000 7f1a77e00640 1 -- 172.21.15.57:0/2846927166 learned_addr learned my addr 172.21.15.57:0/2846927166 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T09:59:28.308 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:28.318+0000 7f1a76a00640 1 --2- 172.21.15.57:0/2846927166 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1a780acd60 0x7f1a780af920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:28.308 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:28.318+0000 7f1a77400640 1 --2- 172.21.15.57:0/2846927166 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a780711b0 0x7f1a7814ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:28.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:28.318+0000 7f1a77e00640 1 -- 172.21.15.57:0/2846927166 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1a780acd60 msgr2=0x7f1a780af920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:28.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:28.318+0000 7f1a77e00640 1 --2- 172.21.15.57:0/2846927166 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1a780acd60 0x7f1a780af920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:28.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:28.318+0000 7f1a77e00640 1 -- 172.21.15.57:0/2846927166 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a780711b0 msgr2=0x7f1a7814ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:28.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:28.318+0000 7f1a77e00640 1 --2- 172.21.15.57:0/2846927166 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a780711b0 0x7f1a7814ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:28.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:28.318+0000 7f1a77e00640 1 -- 172.21.15.57:0/2846927166 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a781f5130 con 0x7f1a780aea20 2024-03-27T09:59:28.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:28.318+0000 7f1a77400640 1 --2- 172.21.15.57:0/2846927166 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a780711b0 0x7f1a7814ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T09:59:28.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:28.319+0000 7f1a77e00640 1 --2- 172.21.15.57:0/2846927166 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1a780aea20 0x7f1a780afe60 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1a70036040 tx=0x7f1a70004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:28.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:28.319+0000 7f1a6f400640 1 -- 172.21.15.57:0/2846927166 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a70043020 con 0x7f1a780aea20 2024-03-27T09:59:28.311 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:28.319+0000 7f1a6f400640 1 -- 172.21.15.57:0/2846927166 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a7003e450 con 0x7f1a780aea20 2024-03-27T09:59:28.311 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:28.319+0000 7f1a7e600640 1 -- 172.21.15.57:0/2846927166 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a781f5410 con 0x7f1a780aea20 2024-03-27T09:59:28.311 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:28.319+0000 7f1a6f400640 1 -- 172.21.15.57:0/2846927166 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a70009510 con 0x7f1a780aea20 2024-03-27T09:59:28.311 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:28.319+0000 7f1a7e600640 1 -- 172.21.15.57:0/2846927166 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a781f59d0 con 0x7f1a780aea20 2024-03-27T09:59:28.311 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:28.320+0000 7f1a7e600640 1 -- 172.21.15.57:0/2846927166 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a780757d0 con 0x7f1a780aea20 2024-03-27T09:59:28.311 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:28.321+0000 7f1a6f400640 1 -- 172.21.15.57:0/2846927166 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f1a70046020 con 0x7f1a780aea20 2024-03-27T09:59:28.313 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:28.323+0000 7f1a6f400640 1 --2- 172.21.15.57:0/2846927166 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f1a5806c560 0x7f1a5806ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:28.313 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:28.323+0000 7f1a6f400640 1 -- 172.21.15.57:0/2846927166 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5609+0+0 (secure 0 0 0) 0x7f1a700adf40 con 0x7f1a780aea20 2024-03-27T09:59:28.313 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:28.323+0000 7f1a77400640 1 --2- 172.21.15.57:0/2846927166 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f1a5806c560 0x7f1a5806ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:28.314 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:28.324+0000 7f1a77400640 1 --2- 172.21.15.57:0/2846927166 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f1a5806c560 0x7f1a5806ea20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1a68006fd0 tx=0x7f1a68008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:28.319 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:28.329+0000 7f1a6f400640 1 -- 172.21.15.57:0/2846927166 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f1a7004d030 con 0x7f1a780aea20 2024-03-27T09:59:28.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:28.569+0000 7f1a7e600640 1 -- 172.21.15.57:0/2846927166 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f1a78074dc0 con 0x7f1a780aea20 2024-03-27T09:59:29.131 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:29.140+0000 7f1a6f400640 1 -- 172.21.15.57:0/2846927166 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f1a7007c520 con 0x7f1a780aea20 2024-03-27T09:59:29.133 INFO:teuthology.orchestra.run.smithi057.stderr:new fs with metadata pool 2 and data pool 3 2024-03-27T09:59:29.138 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:29.147+0000 7f1a7e600640 1 -- 172.21.15.57:0/2846927166 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f1a5806c560 msgr2=0x7f1a5806ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:29.138 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:29.147+0000 7f1a7e600640 1 --2- 172.21.15.57:0/2846927166 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f1a5806c560 0x7f1a5806ea20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1a68006fd0 tx=0x7f1a68008040 comp rx=0 tx=0).stop 2024-03-27T09:59:29.138 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:29.147+0000 7f1a7e600640 1 -- 172.21.15.57:0/2846927166 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1a780aea20 msgr2=0x7f1a780afe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:29.138 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:29.147+0000 7f1a7e600640 1 --2- 172.21.15.57:0/2846927166 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1a780aea20 0x7f1a780afe60 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1a70036040 tx=0x7f1a70004a40 comp rx=0 tx=0).stop 2024-03-27T09:59:29.138 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:29.147+0000 7f1a7e600640 1 -- 172.21.15.57:0/2846927166 shutdown_connections 2024-03-27T09:59:29.138 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:29.147+0000 7f1a7e600640 1 --2- 172.21.15.57:0/2846927166 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1a780aea20 0x7f1a780afe60 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:29.138 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:29.147+0000 7f1a7e600640 1 --2- 172.21.15.57:0/2846927166 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1a780acd60 0x7f1a780af920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:29.139 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:29.147+0000 7f1a7e600640 1 --2- 172.21.15.57:0/2846927166 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f1a5806c560 0x7f1a5806ea20 secure :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1a68006fd0 tx=0x7f1a68008040 comp rx=0 tx=0).stop 2024-03-27T09:59:29.139 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:29.147+0000 7f1a7e600640 1 --2- 172.21.15.57:0/2846927166 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1a780711b0 0x7f1a7814ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:29.139 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:29.147+0000 7f1a7e600640 1 -- 172.21.15.57:0/2846927166 >> 172.21.15.57:0/2846927166 conn(0x7f1a780b18a0 msgr2=0x7f1a78071590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:29.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:29.151+0000 7f1a7e600640 1 -- 172.21.15.57:0/2846927166 shutdown_connections 2024-03-27T09:59:29.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:29.151+0000 7f1a7e600640 1 -- 172.21.15.57:0/2846927166 wait complete. 2024-03-27T09:59:29.172 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-03-27T09:59:29.172 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-03-27T09:59:29.359 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:29.368+0000 7f0a07200640 1 Processor -- start 2024-03-27T09:59:29.359 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:29.369+0000 7f0a07200640 1 -- start start 2024-03-27T09:59:29.361 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:29.370+0000 7f0a07200640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f0a0015ef70 0x7f0a000ae530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:29.361 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:29.370+0000 7f0a07200640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a0015f550 con 0x7f0a000ce0c0 2024-03-27T09:59:29.361 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:29.370+0000 7f0a07200640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a000ada50 con 0x7f0a000cce40 2024-03-27T09:59:29.361 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:29.370+0000 7f0a07200640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f0a00158d20 con 0x7f0a0015ef70 2024-03-27T09:59:29.361 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:29.370+0000 7f09ffe00640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f0a000ce0c0 0x7f0a000cc730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:48070/0 (socket says 172.21.15.57:48070) 2024-03-27T09:59:29.361 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:29.370+0000 7f09ffe00640 1 -- 172.21.15.57:0/1397232695 learned_addr learned my addr 172.21.15.57:0/1397232695 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T09:59:29.361 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:29.371+0000 7f0a05200640 1 --2- 172.21.15.57:0/1397232695 >> v2:172.21.15.118:3300/0 conn(0x7f0a0015ef70 0x7f0a000ae530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:29.361 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:29.371+0000 7f09ff400640 1 -- 172.21.15.57:0/1397232695 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1194237296 0 0) 0x7f0a0015f550 con 0x7f0a000ce0c0 2024-03-27T09:59:29.361 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:29.371+0000 7f09ff400640 1 -- 172.21.15.57:0/1397232695 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f09e4003520 con 0x7f0a000ce0c0 2024-03-27T09:59:29.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:29.371+0000 7f09ff400640 1 -- 172.21.15.57:0/1397232695 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 260681163 0 0) 0x7f09e4003520 con 0x7f0a000ce0c0 2024-03-27T09:59:29.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:29.371+0000 7f09ff400640 1 -- 172.21.15.57:0/1397232695 >> v2:172.21.15.118:3300/0 conn(0x7f0a0015ef70 msgr2=0x7f0a000ae530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T09:59:29.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:29.371+0000 7f09ff400640 1 --2- 172.21.15.57:0/1397232695 >> v2:172.21.15.118:3300/0 conn(0x7f0a0015ef70 0x7f0a000ae530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:29.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:29.371+0000 7f09ff400640 1 -- 172.21.15.57:0/1397232695 >> v1:172.21.15.118:6789/0 conn(0x7f0a000cce40 legacy=0x7f0a0015e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:29.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:29.371+0000 7f09ff400640 1 -- 172.21.15.57:0/1397232695 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a000add30 con 0x7f0a000ce0c0 2024-03-27T09:59:29.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:29.371+0000 7f09ff400640 1 -- 172.21.15.57:0/1397232695 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4227751516 0 0) 0x7f09f0001670 con 0x7f0a000ce0c0 2024-03-27T09:59:29.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:29.371+0000 7f0a05200640 1 --2- 172.21.15.57:0/1397232695 >> v2:172.21.15.118:3300/0 conn(0x7f0a0015ef70 0x7f0a000ae530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T09:59:29.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:29.371+0000 7f09ff400640 1 -- 172.21.15.57:0/1397232695 >> v1:172.21.15.57:6789/0 conn(0x7f0a000ce0c0 legacy=0x7f0a000cc730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:29.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:29.371+0000 7f09ff400640 1 --2- 172.21.15.57:0/1397232695 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09e4003a00 0x7f09e4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:29.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:29.371+0000 7f09ff400640 1 --2- 172.21.15.57:0/1397232695 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f09e4004800 0x7f09e4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:29.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:29.371+0000 7f09ff400640 1 --2- 172.21.15.57:0/1397232695 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09e40051c0 0x7f09e400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:29.365 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:29.371+0000 7f09ff400640 1 -- 172.21.15.57:0/1397232695 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f09e400c090 con 0x7f09e40051c0 2024-03-27T09:59:29.365 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:29.371+0000 7f09ff400640 1 -- 172.21.15.57:0/1397232695 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f09e400c240 con 0x7f09e4003a00 2024-03-27T09:59:29.365 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:29.371+0000 7f09ff400640 1 -- 172.21.15.57:0/1397232695 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f09e400c440 con 0x7f09e4004800 2024-03-27T09:59:29.365 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:29.372+0000 7f0a05200640 1 --2- 172.21.15.57:0/1397232695 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09e40051c0 0x7f09e400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:29.365 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:29.372+0000 7f09f7e00640 1 --2- 172.21.15.57:0/1397232695 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f09e4004800 0x7f09e4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:29.365 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:29.372+0000 7f09ffe00640 1 --2- 172.21.15.57:0/1397232695 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09e4003a00 0x7f09e4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:29.365 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:29.372+0000 7f0a05200640 1 -- 172.21.15.57:0/1397232695 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f09e4004800 msgr2=0x7f09e4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T09:59:29.365 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:29.372+0000 7f0a05200640 1 --2- 172.21.15.57:0/1397232695 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f09e4004800 0x7f09e4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:29.365 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:29.372+0000 7f0a05200640 1 -- 172.21.15.57:0/1397232695 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09e4003a00 msgr2=0x7f09e4003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T09:59:29.365 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:29.372+0000 7f0a05200640 1 --2- 172.21.15.57:0/1397232695 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09e4003a00 0x7f09e4003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:29.365 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:29.372+0000 7f0a05200640 1 -- 172.21.15.57:0/1397232695 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09e4003520 con 0x7f09e40051c0 2024-03-27T09:59:29.365 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:29.372+0000 7f09ffe00640 1 --2- 172.21.15.57:0/1397232695 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09e4003a00 0x7f09e4003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T09:59:29.365 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:29.373+0000 7f0a05200640 1 -- 172.21.15.57:0/1397232695 reap_dead start 2024-03-27T09:59:29.366 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:29.373+0000 7f0a05200640 1 --2- 172.21.15.57:0/1397232695 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09e40051c0 0x7f09e400b9c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f09f800e350 tx=0x7f09e4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d43419e2005d575 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:29.366 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:29.373+0000 7f09ff400640 1 -- 172.21.15.57:0/1397232695 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09f8039070 con 0x7f09e40051c0 2024-03-27T09:59:29.366 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:29.373+0000 7f09ff400640 1 -- 172.21.15.57:0/1397232695 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09f802ce20 con 0x7f09e40051c0 2024-03-27T09:59:29.366 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:29.373+0000 7f09ff400640 1 -- 172.21.15.57:0/1397232695 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09f8009de0 con 0x7f09e40051c0 2024-03-27T09:59:29.367 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:29.374+0000 7f0a07200640 1 -- 172.21.15.57:0/1397232695 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09e40051c0 msgr2=0x7f09e400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:29.367 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:29.374+0000 7f0a07200640 1 --2- 172.21.15.57:0/1397232695 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09e40051c0 0x7f09e400b9c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f09f800e350 tx=0x7f09e4005830 comp rx=0 tx=0).stop 2024-03-27T09:59:29.367 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:29.374+0000 7f0a07200640 1 -- 172.21.15.57:0/1397232695 shutdown_connections 2024-03-27T09:59:29.367 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:29.374+0000 7f0a07200640 1 --2- 172.21.15.57:0/1397232695 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09e40051c0 0x7f09e400b9c0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:29.367 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:29.374+0000 7f0a07200640 1 -- 172.21.15.57:0/1397232695 >> 172.21.15.57:0/1397232695 conn(0x7f0a000b1870 msgr2=0x7f0a000b1c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:29.367 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:29.374+0000 7f0a07200640 1 -- 172.21.15.57:0/1397232695 shutdown_connections 2024-03-27T09:59:29.367 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:29.374+0000 7f0a07200640 1 -- 172.21.15.57:0/1397232695 wait complete. 2024-03-27T09:59:29.367 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:29.376+0000 7f0a07200640 1 Processor -- start 2024-03-27T09:59:29.367 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:29.376+0000 7f0a07200640 1 -- start start 2024-03-27T09:59:29.369 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:29.377+0000 7f0a07200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09e40051c0 0x7f0a00160f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:29.369 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:29.377+0000 7f0a07200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0a001f7130 0x7f0a000c3d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:29.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:29.377+0000 7f0a07200640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0a000c5ad0 0x7f0a000c5f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:29.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:29.377+0000 7f0a07200640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f0a000ae8c0 con 0x7f0a000c5ad0 2024-03-27T09:59:29.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:29.377+0000 7f0a07200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f0a000ae740 con 0x7f09e40051c0 2024-03-27T09:59:29.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:29.377+0000 7f0a07200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f0a000ce4a0 con 0x7f0a001f7130 2024-03-27T09:59:29.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:29.378+0000 7f0a05200640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0a000c5ad0 0x7f0a000c5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:29.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:29.378+0000 7f0a05200640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0a000c5ad0 0x7f0a000c5f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56232/0 (socket says 172.21.15.57:56232) 2024-03-27T09:59:29.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:29.378+0000 7f0a05200640 1 -- 172.21.15.57:0/4099295000 learned_addr learned my addr 172.21.15.57:0/4099295000 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T09:59:29.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:29.378+0000 7f09f7e00640 1 --2- 172.21.15.57:0/4099295000 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0a001f7130 0x7f0a000c3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:29.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:29.378+0000 7f09ffe00640 1 --2- 172.21.15.57:0/4099295000 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09e40051c0 0x7f0a00160f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:29.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:29.378+0000 7f0a05200640 1 -- 172.21.15.57:0/4099295000 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0a001f7130 msgr2=0x7f0a000c3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:29.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:29.378+0000 7f0a05200640 1 --2- 172.21.15.57:0/4099295000 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0a001f7130 0x7f0a000c3d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:29.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:29.378+0000 7f0a05200640 1 -- 172.21.15.57:0/4099295000 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09e40051c0 msgr2=0x7f0a00160f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:29.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:29.378+0000 7f0a05200640 1 --2- 172.21.15.57:0/4099295000 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09e40051c0 0x7f0a00160f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:29.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:29.378+0000 7f0a05200640 1 -- 172.21.15.57:0/4099295000 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a000c42d0 con 0x7f0a000c5ad0 2024-03-27T09:59:29.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:29.379+0000 7f0a05200640 1 --2- 172.21.15.57:0/4099295000 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0a000c5ad0 0x7f0a000c5f50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f09f802c870 tx=0x7f09f8004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:29.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:29.379+0000 7f09fcc00640 1 -- 172.21.15.57:0/4099295000 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09f8039070 con 0x7f0a000c5ad0 2024-03-27T09:59:29.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:29.379+0000 7f09fcc00640 1 -- 172.21.15.57:0/4099295000 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09f8044070 con 0x7f0a000c5ad0 2024-03-27T09:59:29.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:29.379+0000 7f09fcc00640 1 -- 172.21.15.57:0/4099295000 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09f8009de0 con 0x7f0a000c5ad0 2024-03-27T09:59:29.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:29.379+0000 7f0a07200640 1 -- 172.21.15.57:0/4099295000 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a000c4550 con 0x7f0a000c5ad0 2024-03-27T09:59:29.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:29.379+0000 7f0a07200640 1 -- 172.21.15.57:0/4099295000 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a000c4b10 con 0x7f0a000c5ad0 2024-03-27T09:59:29.372 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:29.380+0000 7f0a07200640 1 -- 172.21.15.57:0/4099295000 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a000ce950 con 0x7f0a000c5ad0 2024-03-27T09:59:29.372 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:29.381+0000 7f09fcc00640 1 -- 172.21.15.57:0/4099295000 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f09f803ea50 con 0x7f0a000c5ad0 2024-03-27T09:59:29.372 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:29.382+0000 7f09fcc00640 1 --2- 172.21.15.57:0/4099295000 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f09dc06c580 0x7f09dc06ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:29.372 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:29.382+0000 7f09fcc00640 1 -- 172.21.15.57:0/4099295000 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f09f80adb70 con 0x7f0a000c5ad0 2024-03-27T09:59:29.372 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:29.382+0000 7f09ffe00640 1 --2- 172.21.15.57:0/4099295000 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f09dc06c580 0x7f09dc06ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:29.372 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:29.383+0000 7f09ffe00640 1 --2- 172.21.15.57:0/4099295000 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f09dc06c580 0x7f09dc06ea40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f09f0000c00 tx=0x7f09f00015b0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:29.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:29.386+0000 7f09fcc00640 1 -- 172.21.15.57:0/4099295000 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f0a000ce950 con 0x7f0a000c5ad0 2024-03-27T09:59:29.586 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:29.596+0000 7f0a07200640 1 -- 172.21.15.57:0/4099295000 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7f0a000aed80 con 0x7f0a000c5ad0 2024-03-27T09:59:30.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:30.112+0000 7f09fcc00640 1 -- 172.21.15.57:0/4099295000 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v21) ==== 157+0+0 (secure 0 0 0) 0x7f0a000aed80 con 0x7f0a000c5ad0 2024-03-27T09:59:30.107 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:30.117+0000 7f0a07200640 1 -- 172.21.15.57:0/4099295000 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f09dc06c580 msgr2=0x7f09dc06ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:30.107 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:30.117+0000 7f0a07200640 1 --2- 172.21.15.57:0/4099295000 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f09dc06c580 0x7f09dc06ea40 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f09f0000c00 tx=0x7f09f00015b0 comp rx=0 tx=0).stop 2024-03-27T09:59:30.107 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:30.117+0000 7f0a07200640 1 -- 172.21.15.57:0/4099295000 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0a000c5ad0 msgr2=0x7f0a000c5f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:30.107 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:30.117+0000 7f0a07200640 1 --2- 172.21.15.57:0/4099295000 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0a000c5ad0 0x7f0a000c5f50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f09f802c870 tx=0x7f09f8004ab0 comp rx=0 tx=0).stop 2024-03-27T09:59:30.108 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:30.117+0000 7f0a07200640 1 -- 172.21.15.57:0/4099295000 shutdown_connections 2024-03-27T09:59:30.108 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:30.117+0000 7f0a07200640 1 --2- 172.21.15.57:0/4099295000 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0a000c5ad0 0x7f0a000c5f50 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:30.108 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:30.117+0000 7f0a07200640 1 --2- 172.21.15.57:0/4099295000 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0a001f7130 0x7f0a000c3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:30.108 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:30.117+0000 7f0a07200640 1 --2- 172.21.15.57:0/4099295000 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f09dc06c580 0x7f09dc06ea40 secure :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f09f0000c00 tx=0x7f09f00015b0 comp rx=0 tx=0).stop 2024-03-27T09:59:30.108 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:30.117+0000 7f0a07200640 1 --2- 172.21.15.57:0/4099295000 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09e40051c0 0x7f0a00160f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:30.108 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:30.117+0000 7f0a07200640 1 -- 172.21.15.57:0/4099295000 >> 172.21.15.57:0/4099295000 conn(0x7f0a000b1870 msgr2=0x7f0a0006cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:30.109 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:30.118+0000 7f0a07200640 1 -- 172.21.15.57:0/4099295000 shutdown_connections 2024-03-27T09:59:30.109 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:30.119+0000 7f0a07200640 1 -- 172.21.15.57:0/4099295000 wait complete. 2024-03-27T09:59:30.130 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-03-27T09:59:30.363 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:30.373+0000 7f2f3da00640 1 Processor -- start 2024-03-27T09:59:30.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:30.373+0000 7f2f3da00640 1 -- start start 2024-03-27T09:59:30.366 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:30.375+0000 7f2f3da00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2f380ce3c0 0x7f2f38161ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:30.366 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:30.375+0000 7f2f3da00640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f380aea90 con 0x7f2f38162220 2024-03-27T09:59:30.366 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:30.375+0000 7f2f3da00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f380aed70 con 0x7f2f38155320 2024-03-27T09:59:30.366 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:30.375+0000 7f2f3da00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f2f38162680 con 0x7f2f380ce3c0 2024-03-27T09:59:30.366 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:30.376+0000 7f2f3d000640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f2f38162220 0x7f2f380c5290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:48074/0 (socket says 172.21.15.57:48074) 2024-03-27T09:59:30.366 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:30.376+0000 7f2f3d000640 1 -- 172.21.15.57:0/3177604470 learned_addr learned my addr 172.21.15.57:0/3177604470 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T09:59:30.366 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:30.376+0000 7f2f37400640 1 --2- 172.21.15.57:0/3177604470 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2f380ce3c0 0x7f2f38161ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:30.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:30.376+0000 7f2f36a00640 1 -- 172.21.15.57:0/3177604470 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2119765377 0 0) 0x7f2f380aea90 con 0x7f2f38162220 2024-03-27T09:59:30.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:30.376+0000 7f2f36a00640 1 -- 172.21.15.57:0/3177604470 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2f1c003520 con 0x7f2f38162220 2024-03-27T09:59:30.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:30.376+0000 7f2f36a00640 1 -- 172.21.15.57:0/3177604470 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1020935508 0 0) 0x7f2f1c003520 con 0x7f2f38162220 2024-03-27T09:59:30.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:30.376+0000 7f2f36a00640 1 -- 172.21.15.57:0/3177604470 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2f380ce3c0 msgr2=0x7f2f38161ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T09:59:30.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:30.376+0000 7f2f36a00640 1 --2- 172.21.15.57:0/3177604470 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2f380ce3c0 0x7f2f38161ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:30.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:30.376+0000 7f2f36a00640 1 -- 172.21.15.57:0/3177604470 >> v1:172.21.15.118:6789/0 conn(0x7f2f38155320 legacy=0x7f2f380ae2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:30.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:30.377+0000 7f2f36a00640 1 -- 172.21.15.57:0/3177604470 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f380af050 con 0x7f2f38162220 2024-03-27T09:59:30.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:30.377+0000 7f2f36a00640 1 -- 172.21.15.57:0/3177604470 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4227751516 0 0) 0x7f2f300019f0 con 0x7f2f38162220 2024-03-27T09:59:30.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:30.377+0000 7f2f36a00640 1 -- 172.21.15.57:0/3177604470 >> v1:172.21.15.57:6789/0 conn(0x7f2f38162220 legacy=0x7f2f380c5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:30.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:30.377+0000 7f2f36a00640 1 --2- 172.21.15.57:0/3177604470 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2f1c0039e0 0x7f2f1c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:30.369 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:30.377+0000 7f2f36a00640 1 --2- 172.21.15.57:0/3177604470 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f1c004390 0x7f2f1c004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:30.369 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:30.377+0000 7f2f36a00640 1 --2- 172.21.15.57:0/3177604470 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2f380ce3c0 0x7f2f1c0050c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:30.369 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:30.377+0000 7f2f36a00640 1 -- 172.21.15.57:0/3177604470 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f2f1c00b9c0 con 0x7f2f1c0039e0 2024-03-27T09:59:30.369 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:30.377+0000 7f2f36a00640 1 -- 172.21.15.57:0/3177604470 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f2f1c00bb40 con 0x7f2f1c004390 2024-03-27T09:59:30.369 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:30.377+0000 7f2f36a00640 1 -- 172.21.15.57:0/3177604470 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f2f1c00bd40 con 0x7f2f380ce3c0 2024-03-27T09:59:30.369 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:30.377+0000 7f2f37e00640 1 --2- 172.21.15.57:0/3177604470 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2f1c0039e0 0x7f2f1c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:30.369 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:30.377+0000 7f2f37400640 1 --2- 172.21.15.57:0/3177604470 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f1c004390 0x7f2f1c004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:30.369 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:30.377+0000 7f2f3d000640 1 --2- 172.21.15.57:0/3177604470 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2f380ce3c0 0x7f2f1c0050c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:30.369 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:30.377+0000 7f2f37e00640 1 -- 172.21.15.57:0/3177604470 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2f380ce3c0 msgr2=0x7f2f1c0050c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T09:59:30.369 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:30.377+0000 7f2f37e00640 1 --2- 172.21.15.57:0/3177604470 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2f380ce3c0 0x7f2f1c0050c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:30.369 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:30.377+0000 7f2f37e00640 1 -- 172.21.15.57:0/3177604470 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f1c004390 msgr2=0x7f2f1c004860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T09:59:30.369 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:30.378+0000 7f2f37e00640 1 --2- 172.21.15.57:0/3177604470 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f1c004390 0x7f2f1c004860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:30.369 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:30.378+0000 7f2f37e00640 1 -- 172.21.15.57:0/3177604470 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f1c003520 con 0x7f2f1c0039e0 2024-03-27T09:59:30.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:30.379+0000 7f2f37e00640 1 --2- 172.21.15.57:0/3177604470 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2f1c0039e0 0x7f2f1c003dc0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2f28001860 tx=0x7f2f1c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef2b46aac7afb5e5 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:30.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:30.379+0000 7f2f36a00640 1 -- 172.21.15.57:0/3177604470 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f2802f050 con 0x7f2f1c0039e0 2024-03-27T09:59:30.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:30.379+0000 7f2f36a00640 1 -- 172.21.15.57:0/3177604470 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f28033650 con 0x7f2f1c0039e0 2024-03-27T09:59:30.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:30.379+0000 7f2f36a00640 1 -- 172.21.15.57:0/3177604470 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f28001430 con 0x7f2f1c0039e0 2024-03-27T09:59:30.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:30.379+0000 7f2f3da00640 1 -- 172.21.15.57:0/3177604470 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2f1c0039e0 msgr2=0x7f2f1c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:30.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:30.379+0000 7f2f3da00640 1 --2- 172.21.15.57:0/3177604470 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2f1c0039e0 0x7f2f1c003dc0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2f28001860 tx=0x7f2f1c005830 comp rx=0 tx=0).stop 2024-03-27T09:59:30.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:30.380+0000 7f2f3d000640 1 -- 172.21.15.57:0/3177604470 reap_dead start 2024-03-27T09:59:30.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:30.380+0000 7f2f3da00640 1 -- 172.21.15.57:0/3177604470 shutdown_connections 2024-03-27T09:59:30.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:30.380+0000 7f2f3da00640 1 -- 172.21.15.57:0/3177604470 >> 172.21.15.57:0/3177604470 conn(0x7f2f380cfb60 msgr2=0x7f2f380cff40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:30.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:30.380+0000 7f2f3da00640 1 -- 172.21.15.57:0/3177604470 shutdown_connections 2024-03-27T09:59:30.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:30.380+0000 7f2f3da00640 1 -- 172.21.15.57:0/3177604470 wait complete. 2024-03-27T09:59:30.372 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:30.382+0000 7f2f3da00640 1 Processor -- start 2024-03-27T09:59:30.372 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:30.382+0000 7f2f3da00640 1 -- start start 2024-03-27T09:59:30.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:30.383+0000 7f2f3da00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2f1c0039e0 0x7f2f3815fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:30.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:30.383+0000 7f2f3da00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2f38152de0 0x7f2f3814e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:30.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:30.383+0000 7f2f3da00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f380cb4d0 0x7f2f380cb980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:30.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:30.383+0000 7f2f3da00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f2f38161ce0 con 0x7f2f1c0039e0 2024-03-27T09:59:30.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:30.383+0000 7f2f3da00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f2f380c4e00 con 0x7f2f380cb4d0 2024-03-27T09:59:30.374 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:30.383+0000 7f2f3da00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f2f38161e60 con 0x7f2f38152de0 2024-03-27T09:59:30.374 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:30.383+0000 7f2f37e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2f1c0039e0 0x7f2f3815fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:30.374 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:30.383+0000 7f2f37e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2f1c0039e0 0x7f2f3815fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56244/0 (socket says 172.21.15.57:56244) 2024-03-27T09:59:30.374 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:30.383+0000 7f2f37e00640 1 -- 172.21.15.57:0/143701779 learned_addr learned my addr 172.21.15.57:0/143701779 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T09:59:30.374 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:30.383+0000 7f2f37e00640 1 -- 172.21.15.57:0/143701779 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2f38152de0 msgr2=0x7f2f3814e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:30.374 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:30.383+0000 7f2f37e00640 1 --2- 172.21.15.57:0/143701779 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2f38152de0 0x7f2f3814e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:30.374 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:30.383+0000 7f2f37e00640 1 -- 172.21.15.57:0/143701779 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f380cb4d0 msgr2=0x7f2f380cb980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:30.374 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:30.383+0000 7f2f37e00640 1 --2- 172.21.15.57:0/143701779 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f380cb4d0 0x7f2f380cb980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:30.374 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:30.383+0000 7f2f37e00640 1 -- 172.21.15.57:0/143701779 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f38153610 con 0x7f2f1c0039e0 2024-03-27T09:59:30.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:30.384+0000 7f2f37e00640 1 --2- 172.21.15.57:0/143701779 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2f1c0039e0 0x7f2f3815fe50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2f2802bdf0 tx=0x7f2f28001230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:30.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:30.384+0000 7f2f2fe00640 1 -- 172.21.15.57:0/143701779 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f280035f0 con 0x7f2f1c0039e0 2024-03-27T09:59:30.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:30.384+0000 7f2f2fe00640 1 -- 172.21.15.57:0/143701779 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f28003790 con 0x7f2f1c0039e0 2024-03-27T09:59:30.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:30.384+0000 7f2f3da00640 1 -- 172.21.15.57:0/143701779 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f381538f0 con 0x7f2f1c0039e0 2024-03-27T09:59:30.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:30.384+0000 7f2f2fe00640 1 -- 172.21.15.57:0/143701779 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f28003b60 con 0x7f2f1c0039e0 2024-03-27T09:59:30.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:30.384+0000 7f2f3da00640 1 -- 172.21.15.57:0/143701779 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f38153eb0 con 0x7f2f1c0039e0 2024-03-27T09:59:30.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:30.385+0000 7f2f3da00640 1 -- 172.21.15.57:0/143701779 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f38068540 con 0x7f2f1c0039e0 2024-03-27T09:59:30.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:30.386+0000 7f2f2fe00640 1 -- 172.21.15.57:0/143701779 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f2f28003d00 con 0x7f2f1c0039e0 2024-03-27T09:59:30.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:30.387+0000 7f2f2fe00640 1 --2- 172.21.15.57:0/143701779 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f2f1406c560 0x7f2f1406ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:30.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:30.387+0000 7f2f2fe00640 1 -- 172.21.15.57:0/143701779 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 6007+0+0 (secure 0 0 0) 0x7f2f280ad650 con 0x7f2f1c0039e0 2024-03-27T09:59:30.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:30.387+0000 7f2f37400640 1 --2- 172.21.15.57:0/143701779 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f2f1406c560 0x7f2f1406ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:30.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:30.388+0000 7f2f37400640 1 --2- 172.21.15.57:0/143701779 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f2f1406c560 0x7f2f1406ea20 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2f381f7890 tx=0x7f2f20008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:30.381 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:30.391+0000 7f2f2fe00640 1 -- 172.21.15.57:0/143701779 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f2f2804a030 con 0x7f2f1c0039e0 2024-03-27T09:59:30.584 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:30.594+0000 7f2f3da00640 1 -- 172.21.15.57:0/143701779 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f2f380711f0 con 0x7f2f1c0039e0 2024-03-27T09:59:32.167 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:32.176+0000 7f2f2fe00640 1 -- 172.21.15.57:0/143701779 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v23) ==== 228+0+0 (secure 0 0 0) 0x7f2f28041070 con 0x7f2f1c0039e0 2024-03-27T09:59:32.167 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_data_ec' created 2024-03-27T09:59:32.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:32.179+0000 7f2f3da00640 1 -- 172.21.15.57:0/143701779 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f2f1406c560 msgr2=0x7f2f1406ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:32.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:32.179+0000 7f2f3da00640 1 --2- 172.21.15.57:0/143701779 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f2f1406c560 0x7f2f1406ea20 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2f381f7890 tx=0x7f2f20008040 comp rx=0 tx=0).stop 2024-03-27T09:59:32.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:32.179+0000 7f2f3da00640 1 -- 172.21.15.57:0/143701779 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2f1c0039e0 msgr2=0x7f2f3815fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:32.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:32.179+0000 7f2f3da00640 1 --2- 172.21.15.57:0/143701779 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2f1c0039e0 0x7f2f3815fe50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f2f2802bdf0 tx=0x7f2f28001230 comp rx=0 tx=0).stop 2024-03-27T09:59:32.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:32.180+0000 7f2f3da00640 1 -- 172.21.15.57:0/143701779 shutdown_connections 2024-03-27T09:59:32.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:32.180+0000 7f2f3da00640 1 --2- 172.21.15.57:0/143701779 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f2f1406c560 0x7f2f1406ea20 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:32.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:32.180+0000 7f2f3da00640 1 --2- 172.21.15.57:0/143701779 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2f380cb4d0 0x7f2f380cb980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:32.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:32.180+0000 7f2f3da00640 1 --2- 172.21.15.57:0/143701779 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2f38152de0 0x7f2f3814e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:32.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:32.180+0000 7f2f3da00640 1 --2- 172.21.15.57:0/143701779 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2f1c0039e0 0x7f2f3815fe50 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:32.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:32.180+0000 7f2f3da00640 1 -- 172.21.15.57:0/143701779 >> 172.21.15.57:0/143701779 conn(0x7f2f380cfb60 msgr2=0x7f2f380b0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:32.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:32.180+0000 7f2f3da00640 1 -- 172.21.15.57:0/143701779 shutdown_connections 2024-03-27T09:59:32.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:32.181+0000 7f2f3da00640 1 -- 172.21.15.57:0/143701779 wait complete. 2024-03-27T09:59:32.201 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-03-27T09:59:32.401 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:32.410+0000 7ff366c00640 1 Processor -- start 2024-03-27T09:59:32.401 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:32.410+0000 7ff366c00640 1 -- start start 2024-03-27T09:59:32.403 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:32.412+0000 7ff366c00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff3600cce40 0x7ff3600ae530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:32.403 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:32.412+0000 7ff366c00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff36015e860 0x7ff36015ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:32.403 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:32.412+0000 7ff366c00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff36015f550 con 0x7ff3600ce0c0 2024-03-27T09:59:32.403 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:32.412+0000 7ff366c00640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7ff360158d20 con 0x7ff36015e860 2024-03-27T09:59:32.403 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:32.412+0000 7ff366c00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7ff3600ce4a0 con 0x7ff3600cce40 2024-03-27T09:59:32.404 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:32.412+0000 7ff364c00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff36015e860 0x7ff36015ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:32.404 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:32.412+0000 7ff364c00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff36015e860 0x7ff36015ecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47666/0 (socket says 172.21.15.57:47666) 2024-03-27T09:59:32.404 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:32.412+0000 7ff364c00640 1 -- 172.21.15.57:0/2948346164 learned_addr learned my addr 172.21.15.57:0/2948346164 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T09:59:32.404 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:32.413+0000 7ff357e00640 1 --2- 172.21.15.57:0/2948346164 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff3600cce40 0x7ff3600ae530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:32.404 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:32.413+0000 7ff364c00640 1 -- 172.21.15.57:0/2948346164 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff3600cce40 msgr2=0x7ff3600ae530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T09:59:32.404 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:32.413+0000 7ff364c00640 1 --2- 172.21.15.57:0/2948346164 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff3600cce40 0x7ff3600ae530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:32.404 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:32.413+0000 7ff364c00640 1 -- 172.21.15.57:0/2948346164 >> v1:172.21.15.118:6789/0 conn(0x7ff3600ce0c0 legacy=0x7ff3600cc730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:32.404 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:32.413+0000 7ff364c00640 1 -- 172.21.15.57:0/2948346164 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3600ada50 con 0x7ff36015e860 2024-03-27T09:59:32.404 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:32.414+0000 7ff364c00640 1 --2- 172.21.15.57:0/2948346164 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff36015e860 0x7ff36015ecd0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff358009e50 tx=0x7ff35802bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d755ffddc0cdfd8b server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:32.405 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:32.414+0000 7ff35f400640 1 -- 172.21.15.57:0/2948346164 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff35802cb00 con 0x7ff36015e860 2024-03-27T09:59:32.405 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:32.414+0000 7ff35f400640 1 -- 172.21.15.57:0/2948346164 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff35802cca0 con 0x7ff36015e860 2024-03-27T09:59:32.405 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:32.414+0000 7ff35f400640 1 -- 172.21.15.57:0/2948346164 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff358034610 con 0x7ff36015e860 2024-03-27T09:59:32.405 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:32.415+0000 7ff366c00640 1 -- 172.21.15.57:0/2948346164 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff36015e860 msgr2=0x7ff36015ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:32.406 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:32.415+0000 7ff366c00640 1 --2- 172.21.15.57:0/2948346164 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff36015e860 0x7ff36015ecd0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff358009e50 tx=0x7ff35802bf60 comp rx=0 tx=0).stop 2024-03-27T09:59:32.406 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:32.415+0000 7ff366c00640 1 -- 172.21.15.57:0/2948346164 shutdown_connections 2024-03-27T09:59:32.406 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:32.415+0000 7ff366c00640 1 --2- 172.21.15.57:0/2948346164 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff3600cce40 0x7ff3600ae530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:32.406 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:32.415+0000 7ff366c00640 1 --2- 172.21.15.57:0/2948346164 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff36015e860 0x7ff36015ecd0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:32.406 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:32.415+0000 7ff366c00640 1 -- 172.21.15.57:0/2948346164 >> 172.21.15.57:0/2948346164 conn(0x7ff3600b1870 msgr2=0x7ff3600b1c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:32.406 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:32.415+0000 7ff366c00640 1 -- 172.21.15.57:0/2948346164 shutdown_connections 2024-03-27T09:59:32.406 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:32.415+0000 7ff366c00640 1 -- 172.21.15.57:0/2948346164 wait complete. 2024-03-27T09:59:32.407 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:32.417+0000 7ff366c00640 1 Processor -- start 2024-03-27T09:59:32.407 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:32.417+0000 7ff366c00640 1 -- start start 2024-03-27T09:59:32.409 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:32.418+0000 7ff366c00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff3600cce40 0x7ff3600c7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:32.409 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:32.418+0000 7ff366c00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3600ce0c0 0x7ff360154410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:32.409 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:32.418+0000 7ff366c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff36015e860 0x7ff3600b42b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:32.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:32.418+0000 7ff366c00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7ff36015f210 con 0x7ff3600ce0c0 2024-03-27T09:59:32.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:32.418+0000 7ff366c00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7ff3600ae0a0 con 0x7ff36015e860 2024-03-27T09:59:32.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:32.418+0000 7ff366c00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7ff36006cef0 con 0x7ff3600cce40 2024-03-27T09:59:32.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:32.419+0000 7ff357e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3600ce0c0 0x7ff360154410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:32.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:32.419+0000 7ff357e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3600ce0c0 0x7ff360154410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47680/0 (socket says 172.21.15.57:47680) 2024-03-27T09:59:32.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:32.419+0000 7ff357e00640 1 -- 172.21.15.57:0/1841747352 learned_addr learned my addr 172.21.15.57:0/1841747352 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T09:59:32.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:32.419+0000 7ff364c00640 1 --2- 172.21.15.57:0/1841747352 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff36015e860 0x7ff3600b42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:32.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:32.419+0000 7ff35fe00640 1 --2- 172.21.15.57:0/1841747352 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff3600cce40 0x7ff3600c7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:32.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:32.419+0000 7ff357e00640 1 -- 172.21.15.57:0/1841747352 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff3600cce40 msgr2=0x7ff3600c7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:32.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:32.419+0000 7ff357e00640 1 --2- 172.21.15.57:0/1841747352 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff3600cce40 0x7ff3600c7ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:32.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:32.419+0000 7ff357e00640 1 -- 172.21.15.57:0/1841747352 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff36015e860 msgr2=0x7ff3600b42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:32.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:32.419+0000 7ff357e00640 1 --2- 172.21.15.57:0/1841747352 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff36015e860 0x7ff3600b42b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:32.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:32.419+0000 7ff357e00640 1 -- 172.21.15.57:0/1841747352 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3601f8260 con 0x7ff3600ce0c0 2024-03-27T09:59:32.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:32.419+0000 7ff357e00640 1 --2- 172.21.15.57:0/1841747352 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3600ce0c0 0x7ff360154410 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff34800e9b0 tx=0x7ff34800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:32.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:32.420+0000 7ff35cc00640 1 -- 172.21.15.57:0/1841747352 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff348017070 con 0x7ff3600ce0c0 2024-03-27T09:59:32.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:32.420+0000 7ff35cc00640 1 -- 172.21.15.57:0/1841747352 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff34800c9a0 con 0x7ff3600ce0c0 2024-03-27T09:59:32.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:32.420+0000 7ff35cc00640 1 -- 172.21.15.57:0/1841747352 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff34800cd90 con 0x7ff3600ce0c0 2024-03-27T09:59:32.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:32.420+0000 7ff366c00640 1 -- 172.21.15.57:0/1841747352 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3600c73c0 con 0x7ff3600ce0c0 2024-03-27T09:59:32.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:32.420+0000 7ff366c00640 1 -- 172.21.15.57:0/1841747352 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff360154950 con 0x7ff3600ce0c0 2024-03-27T09:59:32.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:32.421+0000 7ff366c00640 1 -- 172.21.15.57:0/1841747352 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff360068620 con 0x7ff3600ce0c0 2024-03-27T09:59:32.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:32.422+0000 7ff35cc00640 1 -- 172.21.15.57:0/1841747352 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7ff34801a070 con 0x7ff3600ce0c0 2024-03-27T09:59:32.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:32.424+0000 7ff35cc00640 1 --2- 172.21.15.57:0/1841747352 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7ff33c06c580 0x7ff33c06ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:32.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:32.424+0000 7ff35cc00640 1 -- 172.21.15.57:0/1841747352 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 6500+0+0 (secure 0 0 0) 0x7ff34808bc40 con 0x7ff3600ce0c0 2024-03-27T09:59:32.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:32.424+0000 7ff35fe00640 1 --2- 172.21.15.57:0/1841747352 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7ff33c06c580 0x7ff33c06ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:32.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:32.425+0000 7ff35fe00640 1 --2- 172.21.15.57:0/1841747352 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7ff33c06c580 0x7ff33c06ea40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff350001640 tx=0x7ff350009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:32.419 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:32.429+0000 7ff35cc00640 1 -- 172.21.15.57:0/1841747352 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7ff348059960 con 0x7ff3600ce0c0 2024-03-27T09:59:32.620 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:32.630+0000 7ff366c00640 1 -- 172.21.15.57:0/1841747352 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7ff3600af1b0 con 0x7ff3600ce0c0 2024-03-27T09:59:33.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:33.180+0000 7ff35cc00640 1 -- 172.21.15.57:0/1841747352 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v24) ==== 169+0+0 (secure 0 0 0) 0x7ff34805dc60 con 0x7ff3600ce0c0 2024-03-27T09:59:33.171 INFO:teuthology.orchestra.run.smithi057.stderr:set pool 4 allow_ec_overwrites to true 2024-03-27T09:59:33.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:33.185+0000 7ff366c00640 1 -- 172.21.15.57:0/1841747352 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7ff33c06c580 msgr2=0x7ff33c06ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:33.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:33.185+0000 7ff366c00640 1 --2- 172.21.15.57:0/1841747352 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7ff33c06c580 0x7ff33c06ea40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff350001640 tx=0x7ff350009040 comp rx=0 tx=0).stop 2024-03-27T09:59:33.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:33.185+0000 7ff366c00640 1 -- 172.21.15.57:0/1841747352 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3600ce0c0 msgr2=0x7ff360154410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:33.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:33.185+0000 7ff366c00640 1 --2- 172.21.15.57:0/1841747352 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3600ce0c0 0x7ff360154410 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff34800e9b0 tx=0x7ff34800ee70 comp rx=0 tx=0).stop 2024-03-27T09:59:33.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:33.186+0000 7ff366c00640 1 -- 172.21.15.57:0/1841747352 shutdown_connections 2024-03-27T09:59:33.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:33.186+0000 7ff366c00640 1 --2- 172.21.15.57:0/1841747352 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7ff33c06c580 0x7ff33c06ea40 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:33.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:33.186+0000 7ff366c00640 1 --2- 172.21.15.57:0/1841747352 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff36015e860 0x7ff3600b42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:33.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:33.186+0000 7ff366c00640 1 --2- 172.21.15.57:0/1841747352 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3600ce0c0 0x7ff360154410 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:33.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:33.186+0000 7ff366c00640 1 --2- 172.21.15.57:0/1841747352 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff3600cce40 0x7ff3600c7ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:33.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:33.186+0000 7ff366c00640 1 -- 172.21.15.57:0/1841747352 >> 172.21.15.57:0/1841747352 conn(0x7ff3600b1870 msgr2=0x7ff360157bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:33.181 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:33.188+0000 7ff366c00640 1 -- 172.21.15.57:0/1841747352 shutdown_connections 2024-03-27T09:59:33.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:33.193+0000 7ff366c00640 1 -- 172.21.15.57:0/1841747352 wait complete. 2024-03-27T09:59:33.221 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-03-27T09:59:33.408 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:33.417+0000 7fb475c00640 1 Processor -- start 2024-03-27T09:59:33.408 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:33.417+0000 7fb475c00640 1 -- start start 2024-03-27T09:59:33.409 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:33.419+0000 7fb475c00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb4700711b0 0x7fb470071600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:33.409 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:33.419+0000 7fb475c00640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4700b3fe0 con 0x7fb47006d710 2024-03-27T09:59:33.409 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:33.419+0000 7fb475c00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb47006cf30 con 0x7fb470165bc0 2024-03-27T09:59:33.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:33.419+0000 7fb475c00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fb470071b40 con 0x7fb4700711b0 2024-03-27T09:59:33.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:33.419+0000 7fb46f400640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fb47006d710 0x7fb47006db60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:58266/0 (socket says 172.21.15.57:58266) 2024-03-27T09:59:33.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:33.419+0000 7fb46f400640 1 -- 172.21.15.57:0/1598204540 learned_addr learned my addr 172.21.15.57:0/1598204540 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T09:59:33.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:33.419+0000 7fb46e000640 1 --2- 172.21.15.57:0/1598204540 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb4700711b0 0x7fb470071600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:33.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:33.420+0000 7fb46d600640 1 -- 172.21.15.57:0/1598204540 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3791750297 0 0) 0x7fb468001490 con 0x7fb47006d710 2024-03-27T09:59:33.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:33.420+0000 7fb46d600640 1 -- 172.21.15.57:0/1598204540 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb454003520 con 0x7fb47006d710 2024-03-27T09:59:33.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:33.420+0000 7fb46d600640 1 -- 172.21.15.57:0/1598204540 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3054462304 0 0) 0x7fb47006cf30 con 0x7fb470165bc0 2024-03-27T09:59:33.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:33.420+0000 7fb46d600640 1 -- 172.21.15.57:0/1598204540 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb468001490 con 0x7fb470165bc0 2024-03-27T09:59:33.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:33.420+0000 7fb46e000640 1 -- 172.21.15.57:0/1598204540 >> v1:172.21.15.118:6789/0 conn(0x7fb470165bc0 legacy=0x7fb4700b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:33.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:33.420+0000 7fb46d600640 1 -- 172.21.15.57:0/1598204540 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3252521133 0 0) 0x7fb454003520 con 0x7fb47006d710 2024-03-27T09:59:33.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:33.420+0000 7fb46e000640 1 -- 172.21.15.57:0/1598204540 >> v1:172.21.15.57:6789/0 conn(0x7fb47006d710 legacy=0x7fb47006db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:33.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:33.420+0000 7fb46e000640 1 -- 172.21.15.57:0/1598204540 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4700b4820 con 0x7fb4700711b0 2024-03-27T09:59:33.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:33.422+0000 7fb46e000640 1 --2- 172.21.15.57:0/1598204540 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb4700711b0 0x7fb470071600 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb4580097d0 tx=0x7fb45802b6e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff4fb06d1454e02d server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:33.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:33.422+0000 7fb46d600640 1 -- 172.21.15.57:0/1598204540 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb458037070 con 0x7fb4700711b0 2024-03-27T09:59:33.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:33.422+0000 7fb46d600640 1 -- 172.21.15.57:0/1598204540 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb458030510 con 0x7fb4700711b0 2024-03-27T09:59:33.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:33.422+0000 7fb46d600640 1 -- 172.21.15.57:0/1598204540 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb468001bc0 con 0x7fb4700711b0 2024-03-27T09:59:33.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:33.422+0000 7fb475c00640 1 -- 172.21.15.57:0/1598204540 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb4700711b0 msgr2=0x7fb470071600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:33.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:33.422+0000 7fb475c00640 1 --2- 172.21.15.57:0/1598204540 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb4700711b0 0x7fb470071600 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb4580097d0 tx=0x7fb45802b6e0 comp rx=0 tx=0).stop 2024-03-27T09:59:33.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:33.423+0000 7fb475c00640 1 -- 172.21.15.57:0/1598204540 shutdown_connections 2024-03-27T09:59:33.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:33.423+0000 7fb475c00640 1 --2- 172.21.15.57:0/1598204540 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb4700711b0 0x7fb470071600 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:33.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:33.423+0000 7fb475c00640 1 -- 172.21.15.57:0/1598204540 >> 172.21.15.57:0/1598204540 conn(0x7fb4700b18a0 msgr2=0x7fb4700b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:33.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:33.423+0000 7fb475c00640 1 -- 172.21.15.57:0/1598204540 shutdown_connections 2024-03-27T09:59:33.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:33.423+0000 7fb475c00640 1 -- 172.21.15.57:0/1598204540 wait complete. 2024-03-27T09:59:33.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:33.424+0000 7fb475c00640 1 Processor -- start 2024-03-27T09:59:33.415 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:33.425+0000 7fb475c00640 1 -- start start 2024-03-27T09:59:33.416 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:33.425+0000 7fb475c00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb47006d710 0x7fb4700acd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:33.416 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:33.425+0000 7fb475c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb4700711b0 0x7fb470151ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:33.416 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:33.425+0000 7fb475c00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb470165bc0 0x7fb47009cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:33.416 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:33.426+0000 7fb475c00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fb47006d1f0 con 0x7fb470165bc0 2024-03-27T09:59:33.416 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:33.426+0000 7fb475c00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fb4700b4de0 con 0x7fb4700711b0 2024-03-27T09:59:33.416 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:33.426+0000 7fb475c00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fb470165fa0 con 0x7fb47006d710 2024-03-27T09:59:33.416 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:33.426+0000 7fb46f400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb470165bc0 0x7fb47009cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:33.416 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:33.426+0000 7fb46f400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb470165bc0 0x7fb47009cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47692/0 (socket says 172.21.15.57:47692) 2024-03-27T09:59:33.417 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:33.426+0000 7fb46f400640 1 -- 172.21.15.57:0/856380564 learned_addr learned my addr 172.21.15.57:0/856380564 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T09:59:33.417 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:33.426+0000 7fb46e000640 1 --2- 172.21.15.57:0/856380564 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb4700711b0 0x7fb470151ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:33.417 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:33.426+0000 7fb46ea00640 1 --2- 172.21.15.57:0/856380564 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb47006d710 0x7fb4700acd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:33.418 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:33.426+0000 7fb46f400640 1 -- 172.21.15.57:0/856380564 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb47006d710 msgr2=0x7fb4700acd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:33.418 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:33.426+0000 7fb46f400640 1 --2- 172.21.15.57:0/856380564 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb47006d710 0x7fb4700acd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:33.418 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:33.426+0000 7fb46f400640 1 -- 172.21.15.57:0/856380564 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb4700711b0 msgr2=0x7fb470151ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:33.418 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:33.426+0000 7fb46f400640 1 --2- 172.21.15.57:0/856380564 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb4700711b0 0x7fb470151ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:33.418 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:33.426+0000 7fb46f400640 1 -- 172.21.15.57:0/856380564 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4701fbc00 con 0x7fb470165bc0 2024-03-27T09:59:33.418 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:33.427+0000 7fb46f400640 1 --2- 172.21.15.57:0/856380564 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb470165bc0 0x7fb47009cda0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb4680020a0 tx=0x7fb46800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:33.418 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:33.427+0000 7fb466a00640 1 -- 172.21.15.57:0/856380564 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb468012400 con 0x7fb470165bc0 2024-03-27T09:59:33.418 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:33.427+0000 7fb466a00640 1 -- 172.21.15.57:0/856380564 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4680125c0 con 0x7fb470165bc0 2024-03-27T09:59:33.418 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:33.427+0000 7fb466a00640 1 -- 172.21.15.57:0/856380564 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4680129b0 con 0x7fb470165bc0 2024-03-27T09:59:33.418 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:33.427+0000 7fb475c00640 1 -- 172.21.15.57:0/856380564 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4701fbee0 con 0x7fb470165bc0 2024-03-27T09:59:33.418 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:33.427+0000 7fb475c00640 1 -- 172.21.15.57:0/856380564 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4701fc4a0 con 0x7fb470165bc0 2024-03-27T09:59:33.419 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:33.428+0000 7fb475c00640 1 -- 172.21.15.57:0/856380564 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb470068540 con 0x7fb470165bc0 2024-03-27T09:59:33.419 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:33.429+0000 7fb466a00640 1 -- 172.21.15.57:0/856380564 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fb468012b50 con 0x7fb470165bc0 2024-03-27T09:59:33.420 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:33.430+0000 7fb466a00640 1 --2- 172.21.15.57:0/856380564 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fb44c06c530 0x7fb44c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:33.420 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:33.430+0000 7fb466a00640 1 -- 172.21.15.57:0/856380564 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6500+0+0 (secure 0 0 0) 0x7fb46808c360 con 0x7fb470165bc0 2024-03-27T09:59:33.420 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:33.431+0000 7fb46ea00640 1 --2- 172.21.15.57:0/856380564 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fb44c06c530 0x7fb44c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:33.421 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:33.431+0000 7fb46ea00640 1 --2- 172.21.15.57:0/856380564 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fb44c06c530 0x7fb44c06e9f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb4700b3c80 tx=0x7fb460009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:33.424 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:33.435+0000 7fb466a00640 1 -- 172.21.15.57:0/856380564 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7fb4700b3fe0 con 0x7fb470165bc0 2024-03-27T09:59:33.666 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:33.675+0000 7fb475c00640 1 -- 172.21.15.57:0/856380564 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7fb47006ec20 con 0x7fb470165bc0 2024-03-27T09:59:34.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.230+0000 7fb466a00640 1 -- 172.21.15.57:0/856380564 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) ==== 137+0+0 (secure 0 0 0) 0x7fb46805a650 con 0x7fb470165bc0 2024-03-27T09:59:34.221 INFO:teuthology.orchestra.run.smithi057.stderr:added data pool 4 to fsmap 2024-03-27T09:59:34.224 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.234+0000 7fb475c00640 1 -- 172.21.15.57:0/856380564 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fb44c06c530 msgr2=0x7fb44c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:34.224 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.234+0000 7fb475c00640 1 --2- 172.21.15.57:0/856380564 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fb44c06c530 0x7fb44c06e9f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb4700b3c80 tx=0x7fb460009040 comp rx=0 tx=0).stop 2024-03-27T09:59:34.224 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.234+0000 7fb475c00640 1 -- 172.21.15.57:0/856380564 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb470165bc0 msgr2=0x7fb47009cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:34.224 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.234+0000 7fb475c00640 1 --2- 172.21.15.57:0/856380564 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb470165bc0 0x7fb47009cda0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb4680020a0 tx=0x7fb46800a430 comp rx=0 tx=0).stop 2024-03-27T09:59:34.225 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.234+0000 7fb475c00640 1 -- 172.21.15.57:0/856380564 shutdown_connections 2024-03-27T09:59:34.225 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.234+0000 7fb475c00640 1 --2- 172.21.15.57:0/856380564 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb470165bc0 0x7fb47009cda0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:34.225 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.234+0000 7fb475c00640 1 --2- 172.21.15.57:0/856380564 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fb44c06c530 0x7fb44c06e9f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:34.225 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.234+0000 7fb475c00640 1 --2- 172.21.15.57:0/856380564 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb4700711b0 0x7fb470151ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:34.225 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.234+0000 7fb475c00640 1 --2- 172.21.15.57:0/856380564 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb47006d710 0x7fb4700acd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:34.225 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.234+0000 7fb475c00640 1 -- 172.21.15.57:0/856380564 >> 172.21.15.57:0/856380564 conn(0x7fb4700b18a0 msgr2=0x7fb4700b1c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:34.225 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.235+0000 7fb475c00640 1 -- 172.21.15.57:0/856380564 shutdown_connections 2024-03-27T09:59:34.225 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.235+0000 7fb475c00640 1 -- 172.21.15.57:0/856380564 wait complete. 2024-03-27T09:59:34.246 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-27T09:59:34.454 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.463+0000 7f1328e00640 1 Processor -- start 2024-03-27T09:59:34.454 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.464+0000 7f1328e00640 1 -- start start 2024-03-27T09:59:34.456 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.465+0000 7f1328e00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f13240d2820 0x7f13240d0780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:34.456 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.465+0000 7f1328e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f13240d4b50 0x7f13240d0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:34.456 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.465+0000 7f1328e00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13240d2d90 con 0x7f1324161830 2024-03-27T09:59:34.456 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.465+0000 7f1328e00640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f13240cf4e0 con 0x7f13240d2820 2024-03-27T09:59:34.456 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.465+0000 7f1328e00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f13240cee90 con 0x7f13240d4b50 2024-03-27T09:59:34.456 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.465+0000 7f131be00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f13240d2820 0x7f13240d0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:34.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.466+0000 7f131be00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f13240d2820 0x7f13240d0780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47704/0 (socket says 172.21.15.57:47704) 2024-03-27T09:59:34.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.466+0000 7f131be00640 1 -- 172.21.15.57:0/418479152 learned_addr learned my addr 172.21.15.57:0/418479152 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T09:59:34.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.466+0000 7f1323e00640 1 --2- 172.21.15.57:0/418479152 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f13240d4b50 0x7f13240d0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:34.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.466+0000 7f131be00640 1 -- 172.21.15.57:0/418479152 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f13240d4b50 msgr2=0x7f13240d0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T09:59:34.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.466+0000 7f131be00640 1 --2- 172.21.15.57:0/418479152 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f13240d4b50 0x7f13240d0cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:34.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.466+0000 7f131be00640 1 -- 172.21.15.57:0/418479152 >> v1:172.21.15.118:6789/0 conn(0x7f1324161830 legacy=0x7f13240cf970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T09:59:34.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.466+0000 7f131be00640 1 -- 172.21.15.57:0/418479152 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13240cf170 con 0x7f13240d2820 2024-03-27T09:59:34.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.466+0000 7f1323e00640 1 --2- 172.21.15.57:0/418479152 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f13240d4b50 0x7f13240d0cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T09:59:34.458 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.467+0000 7f131be00640 1 --2- 172.21.15.57:0/418479152 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13240d2820 0x7f13240d0780 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f130c009870 tx=0x7f130c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7f5218add094130 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:34.458 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.467+0000 7f1322a00640 1 -- 172.21.15.57:0/418479152 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f130c035020 con 0x7f13240d2820 2024-03-27T09:59:34.459 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.467+0000 7f1322a00640 1 -- 172.21.15.57:0/418479152 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f130c031640 con 0x7f13240d2820 2024-03-27T09:59:34.459 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.468+0000 7f1322a00640 1 -- 172.21.15.57:0/418479152 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f130c02d040 con 0x7f13240d2820 2024-03-27T09:59:34.459 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.468+0000 7f1328e00640 1 -- 172.21.15.57:0/418479152 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13240d2820 msgr2=0x7f13240d0780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:34.459 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.468+0000 7f1328e00640 1 --2- 172.21.15.57:0/418479152 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13240d2820 0x7f13240d0780 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f130c009870 tx=0x7f130c02b8f0 comp rx=0 tx=0).stop 2024-03-27T09:59:34.459 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.468+0000 7f1328e00640 1 -- 172.21.15.57:0/418479152 shutdown_connections 2024-03-27T09:59:34.459 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.468+0000 7f1328e00640 1 --2- 172.21.15.57:0/418479152 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f13240d4b50 0x7f13240d0cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:34.459 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.468+0000 7f1328e00640 1 --2- 172.21.15.57:0/418479152 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13240d2820 0x7f13240d0780 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:34.459 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.468+0000 7f1328e00640 1 -- 172.21.15.57:0/418479152 >> 172.21.15.57:0/418479152 conn(0x7f13240d4030 msgr2=0x7f13240d4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:34.459 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.468+0000 7f1328e00640 1 -- 172.21.15.57:0/418479152 shutdown_connections 2024-03-27T09:59:34.459 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.468+0000 7f1328e00640 1 -- 172.21.15.57:0/418479152 wait complete. 2024-03-27T09:59:34.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.470+0000 7f1328e00640 1 Processor -- start 2024-03-27T09:59:34.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.470+0000 7f1328e00640 1 -- start start 2024-03-27T09:59:34.462 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.471+0000 7f1328e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13240d2820 0x7f132415a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:34.462 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.471+0000 7f1328e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f13240d4b50 0x7f1324158be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:34.462 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.471+0000 7f1328e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1324161830 0x7f1324156250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:34.462 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.471+0000 7f1328e00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f13240ce330 con 0x7f13240d2820 2024-03-27T09:59:34.462 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.471+0000 7f1328e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f13240d3070 con 0x7f1324161830 2024-03-27T09:59:34.462 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.471+0000 7f1328e00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f13240ce4b0 con 0x7f13240d4b50 2024-03-27T09:59:34.462 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.471+0000 7f1323400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13240d2820 0x7f132415a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:34.462 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.471+0000 7f1323400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13240d2820 0x7f132415a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47708/0 (socket says 172.21.15.57:47708) 2024-03-27T09:59:34.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.471+0000 7f1323400640 1 -- 172.21.15.57:0/4081055968 learned_addr learned my addr 172.21.15.57:0/4081055968 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T09:59:34.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.472+0000 7f131be00640 1 --2- 172.21.15.57:0/4081055968 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f13240d4b50 0x7f1324158be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:34.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.472+0000 7f1323e00640 1 --2- 172.21.15.57:0/4081055968 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1324161830 0x7f1324156250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:34.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.472+0000 7f1323400640 1 -- 172.21.15.57:0/4081055968 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f13240d4b50 msgr2=0x7f1324158be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:34.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.472+0000 7f1323400640 1 --2- 172.21.15.57:0/4081055968 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f13240d4b50 0x7f1324158be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:34.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.472+0000 7f1323400640 1 -- 172.21.15.57:0/4081055968 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1324161830 msgr2=0x7f1324156250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:34.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.472+0000 7f1323400640 1 --2- 172.21.15.57:0/4081055968 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1324161830 0x7f1324156250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:34.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.472+0000 7f1323400640 1 -- 172.21.15.57:0/4081055968 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1324156790 con 0x7f13240d2820 2024-03-27T09:59:34.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.472+0000 7f1323400640 1 --2- 172.21.15.57:0/4081055968 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13240d2820 0x7f132415a310 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f131400c430 tx=0x7f131400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:34.464 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.472+0000 7f131b400640 1 -- 172.21.15.57:0/4081055968 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1314017070 con 0x7f13240d2820 2024-03-27T09:59:34.464 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.472+0000 7f131b400640 1 -- 172.21.15.57:0/4081055968 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13140052d0 con 0x7f13240d2820 2024-03-27T09:59:34.464 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.472+0000 7f131b400640 1 -- 172.21.15.57:0/4081055968 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1314003830 con 0x7f13240d2820 2024-03-27T09:59:34.464 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.472+0000 7f1328e00640 1 -- 172.21.15.57:0/4081055968 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1324159270 con 0x7f13240d2820 2024-03-27T09:59:34.464 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.473+0000 7f1328e00640 1 -- 172.21.15.57:0/4081055968 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1324159830 con 0x7f13240d2820 2024-03-27T09:59:34.464 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.474+0000 7f1328e00640 1 -- 172.21.15.57:0/4081055968 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1324068540 con 0x7f13240d2820 2024-03-27T09:59:34.465 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.475+0000 7f131b400640 1 -- 172.21.15.57:0/4081055968 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f131401a070 con 0x7f13240d2820 2024-03-27T09:59:34.466 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.476+0000 7f131b400640 1 --2- 172.21.15.57:0/4081055968 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f130006c530 0x7f130006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:34.466 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.476+0000 7f131b400640 1 -- 172.21.15.57:0/4081055968 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f131408ad90 con 0x7f13240d2820 2024-03-27T09:59:34.466 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.476+0000 7f131be00640 1 --2- 172.21.15.57:0/4081055968 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f130006c530 0x7f130006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:34.466 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.477+0000 7f131be00640 1 --2- 172.21.15.57:0/4081055968 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f130006c530 0x7f130006e9f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f130c036000 tx=0x7f130c03c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:34.470 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.480+0000 7f131b400640 1 -- 172.21.15.57:0/4081055968 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f1314059060 con 0x7f13240d2820 2024-03-27T09:59:34.618 INFO:tasks.ceph.mds.d.smithi118.stderr:2024-03-27T09:59:34.628+0000 7fb47bc00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-27T09:59:34.711 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.720+0000 7f1328e00640 1 -- 172.21.15.57:0/4081055968 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f132415d560 con 0x7f13240d2820 2024-03-27T09:59:34.712 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.721+0000 7f131b400640 1 -- 172.21.15.57:0/4081055968 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5183 (secure 0 0 0) 0x7f1314058960 con 0x7f13240d2820 2024-03-27T09:59:34.712 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T09:59:34.712 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/1178943431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1178943431},{"type":"v1","addr":"172.21.15.118:6834","nonce":1178943431}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6836/1248533620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6835","nonce":1248533620},{"type":"v1","addr":"172.21.15.57:6836","nonce":1248533620}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6837/4133386889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":4133386889},{"type":"v1","addr":"172.21.15.57:6837","nonce":4133386889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-27T09:59:28.571425+0000","modified":"2024-03-27T09:59:33.677904+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6835/1823694233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":1823694233},{"type":"v1","addr":"172.21.15.118:6835","nonce":1823694233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4282,"qdb_cluster":[4282]},"id":1}]} 2024-03-27T09:59:34.712 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 7 2024-03-27T09:59:34.715 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.724+0000 7f1328e00640 1 -- 172.21.15.57:0/4081055968 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f130006c530 msgr2=0x7f130006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:34.715 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.724+0000 7f1328e00640 1 --2- 172.21.15.57:0/4081055968 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f130006c530 0x7f130006e9f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f130c036000 tx=0x7f130c03c040 comp rx=0 tx=0).stop 2024-03-27T09:59:34.715 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.724+0000 7f1328e00640 1 -- 172.21.15.57:0/4081055968 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13240d2820 msgr2=0x7f132415a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:34.715 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.724+0000 7f1328e00640 1 --2- 172.21.15.57:0/4081055968 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13240d2820 0x7f132415a310 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f131400c430 tx=0x7f131400c8f0 comp rx=0 tx=0).stop 2024-03-27T09:59:34.715 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.724+0000 7f1328e00640 1 -- 172.21.15.57:0/4081055968 shutdown_connections 2024-03-27T09:59:34.715 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.724+0000 7f1328e00640 1 --2- 172.21.15.57:0/4081055968 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f130006c530 0x7f130006e9f0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:34.715 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.724+0000 7f1328e00640 1 --2- 172.21.15.57:0/4081055968 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1324161830 0x7f1324156250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:34.715 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.724+0000 7f1328e00640 1 --2- 172.21.15.57:0/4081055968 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f13240d4b50 0x7f1324158be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:34.715 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.724+0000 7f1328e00640 1 --2- 172.21.15.57:0/4081055968 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13240d2820 0x7f132415a310 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:34.715 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.724+0000 7f1328e00640 1 -- 172.21.15.57:0/4081055968 >> 172.21.15.57:0/4081055968 conn(0x7f13240d4030 msgr2=0x7f13240c7b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:34.715 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.725+0000 7f1328e00640 1 -- 172.21.15.57:0/4081055968 shutdown_connections 2024-03-27T09:59:34.715 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.725+0000 7f1328e00640 1 -- 172.21.15.57:0/4081055968 wait complete. 2024-03-27T09:59:34.734 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-27T09:59:34.946 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.956+0000 7fa396800640 1 Processor -- start 2024-03-27T09:59:34.946 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.956+0000 7fa396800640 1 -- start start 2024-03-27T09:59:34.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.957+0000 7fa396800640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fa3900d2cd0 0x7fa3900d1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:34.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.957+0000 7fa396800640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3900cff30 con 0x7fa3900b4400 2024-03-27T09:59:34.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.957+0000 7fa396800640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3900cf970 con 0x7fa3900b4ae0 2024-03-27T09:59:34.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.957+0000 7fa396800640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7fa3900cfc50 con 0x7fa3900d2cd0 2024-03-27T09:59:34.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.958+0000 7fa395400640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fa3900b4400 0x7fa3900d25c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:58272/0 (socket says 172.21.15.57:58272) 2024-03-27T09:59:34.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.958+0000 7fa395400640 1 -- 172.21.15.57:0/3839293563 learned_addr learned my addr 172.21.15.57:0/3839293563 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T09:59:34.949 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.958+0000 7fa38fe00640 1 -- 172.21.15.57:0/3839293563 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4233383073 0 0) 0x7fa3900cff30 con 0x7fa3900b4400 2024-03-27T09:59:34.949 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.958+0000 7fa38fe00640 1 -- 172.21.15.57:0/3839293563 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa378003520 con 0x7fa3900b4400 2024-03-27T09:59:34.949 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.958+0000 7fa38fe00640 1 -- 172.21.15.57:0/3839293563 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1212513774 0 0) 0x7fa378003520 con 0x7fa3900b4400 2024-03-27T09:59:34.949 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.958+0000 7fa38fe00640 1 -- 172.21.15.57:0/3839293563 >> v2:172.21.15.118:3300/0 conn(0x7fa3900d2cd0 msgr2=0x7fa3900d1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T09:59:34.949 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.958+0000 7fa38fe00640 1 --2- 172.21.15.57:0/3839293563 >> v2:172.21.15.118:3300/0 conn(0x7fa3900d2cd0 0x7fa3900d1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:34.950 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.959+0000 7fa38fe00640 1 -- 172.21.15.57:0/3839293563 >> v1:172.21.15.118:6789/0 conn(0x7fa3900b4ae0 legacy=0x7fa3900b73f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T09:59:34.950 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.959+0000 7fa38fe00640 1 -- 172.21.15.57:0/3839293563 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3900b6ed0 con 0x7fa3900b4400 2024-03-27T09:59:34.950 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.959+0000 7fa38fe00640 1 -- 172.21.15.57:0/3839293563 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4227751516 0 0) 0x7fa384001670 con 0x7fa3900b4400 2024-03-27T09:59:34.950 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.959+0000 7fa38fe00640 1 -- 172.21.15.57:0/3839293563 >> v1:172.21.15.57:6789/0 conn(0x7fa3900b4400 legacy=0x7fa3900d25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:34.950 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.959+0000 7fa38fe00640 1 --2- 172.21.15.57:0/3839293563 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa3780039b0 0x7fa378003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:34.950 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.959+0000 7fa38fe00640 1 --2- 172.21.15.57:0/3839293563 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa378004800 0x7fa378004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:34.950 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.959+0000 7fa38fe00640 1 --2- 172.21.15.57:0/3839293563 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa378005230 0x7fa37800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:34.950 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.959+0000 7fa38fe00640 1 -- 172.21.15.57:0/3839293563 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fa3900cfc50 con 0x7fa378004800 2024-03-27T09:59:34.950 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.959+0000 7fa38fe00640 1 -- 172.21.15.57:0/3839293563 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fa37800c190 con 0x7fa378005230 2024-03-27T09:59:34.950 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.959+0000 7fa38fe00640 1 -- 172.21.15.57:0/3839293563 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fa37800c390 con 0x7fa3780039b0 2024-03-27T09:59:34.950 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.959+0000 7fa394a00640 1 --2- 172.21.15.57:0/3839293563 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa378004800 0x7fa378004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:34.952 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.960+0000 7fa394a00640 1 -- 172.21.15.57:0/3839293563 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa3780039b0 msgr2=0x7fa378003db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T09:59:34.952 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.960+0000 7fa394a00640 1 --2- 172.21.15.57:0/3839293563 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa3780039b0 0x7fa378003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:34.952 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.960+0000 7fa394a00640 1 -- 172.21.15.57:0/3839293563 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa378005230 msgr2=0x7fa37800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T09:59:34.952 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.960+0000 7fa394a00640 1 --2- 172.21.15.57:0/3839293563 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa378005230 0x7fa37800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:34.952 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.960+0000 7fa394a00640 1 -- 172.21.15.57:0/3839293563 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3900b6ed0 con 0x7fa378004800 2024-03-27T09:59:34.952 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.960+0000 7fa395e00640 1 -- 172.21.15.57:0/3839293563 reap_dead start 2024-03-27T09:59:34.952 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.961+0000 7fa394a00640 1 --2- 172.21.15.57:0/3839293563 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa378004800 0x7fa378004c80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa37c009860 tx=0x7fa378005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1a118884821b45a server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:34.952 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.961+0000 7fa38fe00640 1 -- 172.21.15.57:0/3839293563 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa37c037070 con 0x7fa378004800 2024-03-27T09:59:34.952 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.961+0000 7fa38fe00640 1 -- 172.21.15.57:0/3839293563 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa37c032620 con 0x7fa378004800 2024-03-27T09:59:34.953 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.961+0000 7fa38fe00640 1 -- 172.21.15.57:0/3839293563 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa37c009460 con 0x7fa378004800 2024-03-27T09:59:34.953 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.961+0000 7fa396800640 1 -- 172.21.15.57:0/3839293563 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa378004800 msgr2=0x7fa378004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:34.953 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.961+0000 7fa396800640 1 --2- 172.21.15.57:0/3839293563 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa378004800 0x7fa378004c80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa37c009860 tx=0x7fa378005830 comp rx=0 tx=0).stop 2024-03-27T09:59:34.953 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.962+0000 7fa396800640 1 -- 172.21.15.57:0/3839293563 shutdown_connections 2024-03-27T09:59:34.953 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.962+0000 7fa396800640 1 --2- 172.21.15.57:0/3839293563 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa378004800 0x7fa378004c80 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:34.953 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.962+0000 7fa396800640 1 -- 172.21.15.57:0/3839293563 >> 172.21.15.57:0/3839293563 conn(0x7fa3900d3fe0 msgr2=0x7fa3900d43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:34.953 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.962+0000 7fa396800640 1 -- 172.21.15.57:0/3839293563 shutdown_connections 2024-03-27T09:59:34.953 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.962+0000 7fa396800640 1 -- 172.21.15.57:0/3839293563 wait complete. 2024-03-27T09:59:34.953 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.963+0000 7fa396800640 1 Processor -- start 2024-03-27T09:59:34.954 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.963+0000 7fa396800640 1 -- start start 2024-03-27T09:59:34.955 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.964+0000 7fa396800640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa378004800 0x7fa3901566a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:34.956 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.964+0000 7fa396800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3901f3f00 0x7fa39015bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:34.956 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.964+0000 7fa396800640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa39015c010 0x7fa39006c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:34.956 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.964+0000 7fa396800640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fa3900b47e0 con 0x7fa378004800 2024-03-27T09:59:34.956 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.964+0000 7fa396800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fa3900b52a0 con 0x7fa3901f3f00 2024-03-27T09:59:34.956 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.964+0000 7fa396800640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fa3900d1dc0 con 0x7fa39015c010 2024-03-27T09:59:34.956 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.965+0000 7fa395400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa378004800 0x7fa3901566a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:34.956 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.965+0000 7fa395400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa378004800 0x7fa3901566a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47722/0 (socket says 172.21.15.57:47722) 2024-03-27T09:59:34.956 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.965+0000 7fa395400640 1 -- 172.21.15.57:0/2873015875 learned_addr learned my addr 172.21.15.57:0/2873015875 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T09:59:34.956 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.965+0000 7fa395e00640 1 --2- 172.21.15.57:0/2873015875 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa39015c010 0x7fa39006c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:34.956 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.965+0000 7fa394a00640 1 --2- 172.21.15.57:0/2873015875 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3901f3f00 0x7fa39015bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:34.956 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.965+0000 7fa395400640 1 -- 172.21.15.57:0/2873015875 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa39015c010 msgr2=0x7fa39006c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:34.956 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.965+0000 7fa395400640 1 --2- 172.21.15.57:0/2873015875 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa39015c010 0x7fa39006c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:34.956 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.965+0000 7fa395400640 1 -- 172.21.15.57:0/2873015875 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3901f3f00 msgr2=0x7fa39015bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:34.957 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.965+0000 7fa395400640 1 --2- 172.21.15.57:0/2873015875 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3901f3f00 0x7fa39015bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:34.957 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.965+0000 7fa395400640 1 -- 172.21.15.57:0/2873015875 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa39015c540 con 0x7fa378004800 2024-03-27T09:59:34.957 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.965+0000 7fa395400640 1 --2- 172.21.15.57:0/2873015875 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa378004800 0x7fa3901566a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa38400cac0 tx=0x7fa38400cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:34.957 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.966+0000 7fa38d600640 1 -- 172.21.15.57:0/2873015875 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa384018070 con 0x7fa378004800 2024-03-27T09:59:34.957 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.966+0000 7fa38d600640 1 -- 172.21.15.57:0/2873015875 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3840074e0 con 0x7fa378004800 2024-03-27T09:59:34.957 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.966+0000 7fa38d600640 1 -- 172.21.15.57:0/2873015875 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3840047e0 con 0x7fa378004800 2024-03-27T09:59:34.957 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.966+0000 7fa396800640 1 -- 172.21.15.57:0/2873015875 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa39015c820 con 0x7fa378004800 2024-03-27T09:59:34.957 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.966+0000 7fa396800640 1 -- 172.21.15.57:0/2873015875 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa39015cde0 con 0x7fa378004800 2024-03-27T09:59:34.958 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.967+0000 7fa396800640 1 -- 172.21.15.57:0/2873015875 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa390068540 con 0x7fa378004800 2024-03-27T09:59:34.958 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.968+0000 7fa38d600640 1 -- 172.21.15.57:0/2873015875 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fa384004980 con 0x7fa378004800 2024-03-27T09:59:34.959 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.969+0000 7fa38d600640 1 --2- 172.21.15.57:0/2873015875 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fa37006c530 0x7fa37006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:34.959 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.969+0000 7fa38d600640 1 -- 172.21.15.57:0/2873015875 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fa38408b260 con 0x7fa378004800 2024-03-27T09:59:34.959 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.969+0000 7fa394a00640 1 --2- 172.21.15.57:0/2873015875 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fa37006c530 0x7fa37006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:34.959 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.970+0000 7fa394a00640 1 --2- 172.21.15.57:0/2873015875 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fa37006c530 0x7fa37006e9f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa37c034000 tx=0x7fa37c008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:34.963 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:34.974+0000 7fa38d600640 1 -- 172.21.15.57:0/2873015875 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7fa384058e50 con 0x7fa378004800 2024-03-27T09:59:35.167 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.177+0000 7fa396800640 1 -- 172.21.15.57:0/2873015875 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa3900d23a0 con 0x7fa378004800 2024-03-27T09:59:35.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.179+0000 7fa38d600640 1 -- 172.21.15.57:0/2873015875 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18515 (secure 0 0 0) 0x7fa38405d150 con 0x7fa378004800 2024-03-27T09:59:35.170 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T09:59:35.170 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":25,"fsid":"7ac43f86-2c16-4a97-98fb-715d3cebc75c","created":"2024-03-27T09:59:04.033417+0000","modified":"2024-03-27T09:59:33.677696+0000","last_up_change":"2024-03-27T09:59:16.969624+0000","last_in_change":"2024-03-27T09:59:07.421690+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-27T09:59:17.253008+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-27T09:59:26.690365+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-27T09:59:27.559059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-27T09:59:31.187596+0000","flags":32773,"flags_names":"hashpspool,ec_overwrites,creating","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"47b44362-7302-4f2a-b735-582c6c3850cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6801","nonce":2020036298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6803","nonce":2020036298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6807","nonce":2020036298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6805","nonce":2020036298}]},"public_addr":"172.21.15.57:6801/2020036298","cluster_addr":"172.21.15.57:6803/2020036298","heartbeat_back_addr":"172.21.15.57:6807/2020036298","heartbeat_front_addr":"172.21.15.57:6805/2020036298","state":["exists","up"]},{"osd":1,"uuid":"feaf96f0-9431-4188-9a09-da505b40e934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6809","nonce":3190929242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6811","nonce":3190929242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6815","nonce":3190929242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6813","nonce":3190929242}]},"public_addr":"172.21.15.57:6809/3190929242","cluster_addr":"172.21.15.57:6811/3190929242","heartbeat_back_addr":"172.21.15.57:6815/3190929242","heartbeat_front_addr":"172.21.15.57:6813/3190929242","state":["exists","up"]},{"osd":2,"uuid":"21e406e6-cfbc-4fe7-a816-e2420487c95d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6817","nonce":4065849973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6819","nonce":4065849973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6823","nonce":4065849973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6821","nonce":4065849973}]},"public_addr":"172.21.15.57:6817/4065849973","cluster_addr":"172.21.15.57:6819/4065849973","heartbeat_back_addr":"172.21.15.57:6823/4065849973","heartbeat_front_addr":"172.21.15.57:6821/4065849973","state":["exists","up"]},{"osd":3,"uuid":"a389af1d-76c4-4dfc-b215-f983f4931257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6825","nonce":158084809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6827","nonce":158084809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6831","nonce":158084809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6829","nonce":158084809}]},"public_addr":"172.21.15.57:6825/158084809","cluster_addr":"172.21.15.57:6827/158084809","heartbeat_back_addr":"172.21.15.57:6831/158084809","heartbeat_front_addr":"172.21.15.57:6829/158084809","state":["exists","up"]},{"osd":4,"uuid":"e9b05dca-557a-43ee-b43f-9ce5b7d28304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6823","nonce":108719401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6827","nonce":108719401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6831","nonce":108719401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6829","nonce":108719401}]},"public_addr":"172.21.15.118:6823/108719401","cluster_addr":"172.21.15.118:6827/108719401","heartbeat_back_addr":"172.21.15.118:6831/108719401","heartbeat_front_addr":"172.21.15.118:6829/108719401","state":["exists","up"]},{"osd":5,"uuid":"d968177d-44ff-499a-b00a-b147ed879253","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6817","nonce":2704605866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6819","nonce":2704605866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6826","nonce":2704605866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6822","nonce":2704605866}]},"public_addr":"172.21.15.118:6817/2704605866","cluster_addr":"172.21.15.118:6819/2704605866","heartbeat_back_addr":"172.21.15.118:6826/2704605866","heartbeat_front_addr":"172.21.15.118:6822/2704605866","state":["exists","up"]},{"osd":6,"uuid":"e8f98052-e6ad-4cfe-a4a9-0b17a434d54e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6801","nonce":1963659095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6803","nonce":1963659095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6807","nonce":1963659095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6805","nonce":1963659095}]},"public_addr":"172.21.15.118:6801/1963659095","cluster_addr":"172.21.15.118:6803/1963659095","heartbeat_back_addr":"172.21.15.118:6807/1963659095","heartbeat_front_addr":"172.21.15.118:6805/1963659095","state":["exists","up"]},{"osd":7,"uuid":"eccff987-8e51-4a63-845a-cf0a3196d7fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6809","nonce":1955879596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6811","nonce":1955879596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6815","nonce":1955879596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6813","nonce":1955879596}]},"public_addr":"172.21.15.118:6809/1955879596","cluster_addr":"172.21.15.118:6811/1955879596","heartbeat_back_addr":"172.21.15.118:6815/1955879596","heartbeat_front_addr":"172.21.15.118:6813/1955879596","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.721258+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.696610+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.777895+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.806769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.743259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.845687+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:13.020165+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.722294+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-27T09:59:35.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.182+0000 7fa396800640 1 -- 172.21.15.57:0/2873015875 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fa37006c530 msgr2=0x7fa37006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:35.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.182+0000 7fa396800640 1 --2- 172.21.15.57:0/2873015875 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fa37006c530 0x7fa37006e9f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa37c034000 tx=0x7fa37c008030 comp rx=0 tx=0).stop 2024-03-27T09:59:35.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.182+0000 7fa396800640 1 -- 172.21.15.57:0/2873015875 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa378004800 msgr2=0x7fa3901566a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:35.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.182+0000 7fa396800640 1 --2- 172.21.15.57:0/2873015875 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa378004800 0x7fa3901566a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa38400cac0 tx=0x7fa38400cf80 comp rx=0 tx=0).stop 2024-03-27T09:59:35.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.182+0000 7fa396800640 1 -- 172.21.15.57:0/2873015875 shutdown_connections 2024-03-27T09:59:35.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.182+0000 7fa396800640 1 --2- 172.21.15.57:0/2873015875 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa39015c010 0x7fa39006c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:35.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.182+0000 7fa396800640 1 --2- 172.21.15.57:0/2873015875 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fa37006c530 0x7fa37006e9f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:35.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.182+0000 7fa396800640 1 --2- 172.21.15.57:0/2873015875 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3901f3f00 0x7fa39015bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:35.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.182+0000 7fa396800640 1 --2- 172.21.15.57:0/2873015875 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa378004800 0x7fa3901566a0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:35.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.182+0000 7fa396800640 1 -- 172.21.15.57:0/2873015875 >> 172.21.15.57:0/2873015875 conn(0x7fa3900d3fe0 msgr2=0x7fa3900d25c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:35.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.183+0000 7fa396800640 1 -- 172.21.15.57:0/2873015875 shutdown_connections 2024-03-27T09:59:35.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.183+0000 7fa396800640 1 -- 172.21.15.57:0/2873015875 wait complete. 2024-03-27T09:59:35.192 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-27T09:59:35.387 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.396+0000 7f0776400640 1 Processor -- start 2024-03-27T09:59:35.387 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.397+0000 7f0776400640 1 -- start start 2024-03-27T09:59:35.389 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.398+0000 7f0776400640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f077015e3b0 0x7f07700cd620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:35.389 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.398+0000 7f0776400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f0770067280 0x7f077006b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:35.389 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.398+0000 7f0776400640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f077015e790 con 0x7f077006ba80 2024-03-27T09:59:35.389 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.398+0000 7f0776400640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f07700afd80 con 0x7f077015e3b0 2024-03-27T09:59:35.389 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.398+0000 7f0776400640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f07700b00f0 con 0x7f0770067280 2024-03-27T09:59:35.389 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.398+0000 7f0775000640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f077015e3b0 0x7f07700cd620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:35.389 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.398+0000 7f0775000640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f077015e3b0 0x7f07700cd620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47728/0 (socket says 172.21.15.57:47728) 2024-03-27T09:59:35.389 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.398+0000 7f0775000640 1 -- 172.21.15.57:0/2030562793 learned_addr learned my addr 172.21.15.57:0/2030562793 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T09:59:35.389 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.399+0000 7f076fe00640 1 --2- 172.21.15.57:0/2030562793 >> v2:172.21.15.118:3300/0 conn(0x7f0770067280 0x7f077006b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:35.389 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.399+0000 7f0775000640 1 -- 172.21.15.57:0/2030562793 >> v2:172.21.15.118:3300/0 conn(0x7f0770067280 msgr2=0x7f077006b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T09:59:35.389 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.399+0000 7f0775000640 1 --2- 172.21.15.57:0/2030562793 >> v2:172.21.15.118:3300/0 conn(0x7f0770067280 0x7f077006b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:35.389 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.399+0000 7f0775000640 1 -- 172.21.15.57:0/2030562793 >> v1:172.21.15.118:6789/0 conn(0x7f077006ba80 legacy=0x7f0770072c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T09:59:35.389 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.399+0000 7f0775000640 1 -- 172.21.15.57:0/2030562793 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07700b6070 con 0x7f077015e3b0 2024-03-27T09:59:35.390 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.399+0000 7f076fe00640 1 --2- 172.21.15.57:0/2030562793 >> v2:172.21.15.118:3300/0 conn(0x7f0770067280 0x7f077006b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T09:59:35.390 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.400+0000 7f0775000640 1 --2- 172.21.15.57:0/2030562793 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f077015e3b0 0x7f07700cd620 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0770073d60 tx=0x7f076402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2a5f98d72b10460 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:35.390 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.400+0000 7f076f400640 1 -- 172.21.15.57:0/2030562793 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0764035020 con 0x7f077015e3b0 2024-03-27T09:59:35.390 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.400+0000 7f076f400640 1 -- 172.21.15.57:0/2030562793 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0764031870 con 0x7f077015e3b0 2024-03-27T09:59:35.390 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.400+0000 7f076f400640 1 -- 172.21.15.57:0/2030562793 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0764031c40 con 0x7f077015e3b0 2024-03-27T09:59:35.391 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.401+0000 7f0776400640 1 -- 172.21.15.57:0/2030562793 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f077015e3b0 msgr2=0x7f07700cd620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:35.391 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.401+0000 7f0776400640 1 --2- 172.21.15.57:0/2030562793 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f077015e3b0 0x7f07700cd620 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0770073d60 tx=0x7f076402b910 comp rx=0 tx=0).stop 2024-03-27T09:59:35.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.401+0000 7f0776400640 1 -- 172.21.15.57:0/2030562793 shutdown_connections 2024-03-27T09:59:35.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.401+0000 7f0776400640 1 --2- 172.21.15.57:0/2030562793 >> v2:172.21.15.118:3300/0 conn(0x7f0770067280 0x7f077006b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:35.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.401+0000 7f0776400640 1 --2- 172.21.15.57:0/2030562793 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f077015e3b0 0x7f07700cd620 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:35.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.401+0000 7f0776400640 1 -- 172.21.15.57:0/2030562793 >> 172.21.15.57:0/2030562793 conn(0x7f07700b1ec0 msgr2=0x7f07700b22a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:35.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.401+0000 7f0776400640 1 -- 172.21.15.57:0/2030562793 shutdown_connections 2024-03-27T09:59:35.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.401+0000 7f0776400640 1 -- 172.21.15.57:0/2030562793 wait complete. 2024-03-27T09:59:35.393 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.403+0000 7f0776400640 1 Processor -- start 2024-03-27T09:59:35.393 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.403+0000 7f0776400640 1 -- start start 2024-03-27T09:59:35.395 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.404+0000 7f0776400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0770067280 0x7f07701f36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:35.395 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.404+0000 7f0776400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f077006ba80 0x7f07700cfe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:35.395 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.404+0000 7f0776400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f077015e3b0 0x7f07700cb0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:35.395 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.404+0000 7f0776400640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f07700b0f30 con 0x7f077015e3b0 2024-03-27T09:59:35.395 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.404+0000 7f0776400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f077006bed0 con 0x7f0770067280 2024-03-27T09:59:35.395 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.404+0000 7f0776400640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f07700b0600 con 0x7f077006ba80 2024-03-27T09:59:35.396 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.405+0000 7f0775a00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f077015e3b0 0x7f07700cb0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:35.396 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.405+0000 7f0775a00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f077015e3b0 0x7f07700cb0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47744/0 (socket says 172.21.15.57:47744) 2024-03-27T09:59:35.396 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.405+0000 7f0775a00640 1 -- 172.21.15.57:0/1267940476 learned_addr learned my addr 172.21.15.57:0/1267940476 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T09:59:35.396 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.405+0000 7f076fe00640 1 --2- 172.21.15.57:0/1267940476 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f077006ba80 0x7f07700cfe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:35.396 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.405+0000 7f0775000640 1 --2- 172.21.15.57:0/1267940476 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0770067280 0x7f07701f36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:35.396 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.405+0000 7f0775a00640 1 -- 172.21.15.57:0/1267940476 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f077006ba80 msgr2=0x7f07700cfe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:35.396 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.405+0000 7f0775a00640 1 --2- 172.21.15.57:0/1267940476 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f077006ba80 0x7f07700cfe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:35.396 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.405+0000 7f0775a00640 1 -- 172.21.15.57:0/1267940476 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0770067280 msgr2=0x7f07701f36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:35.396 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.405+0000 7f0775a00640 1 --2- 172.21.15.57:0/1267940476 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0770067280 0x7f07701f36c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:35.396 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.405+0000 7f0775a00640 1 -- 172.21.15.57:0/1267940476 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07700d0c20 con 0x7f077015e3b0 2024-03-27T09:59:35.396 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.405+0000 7f0775000640 1 --2- 172.21.15.57:0/1267940476 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0770067280 0x7f07701f36c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T09:59:35.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.405+0000 7f0775a00640 1 --2- 172.21.15.57:0/1267940476 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f077015e3b0 0x7f07700cb0c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f076800c780 tx=0x7f076800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:35.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.406+0000 7f076cc00640 1 -- 172.21.15.57:0/1267940476 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0768004b60 con 0x7f077015e3b0 2024-03-27T09:59:35.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.406+0000 7f076cc00640 1 -- 172.21.15.57:0/1267940476 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0768004d00 con 0x7f077015e3b0 2024-03-27T09:59:35.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.406+0000 7f076cc00640 1 -- 172.21.15.57:0/1267940476 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f076800aa90 con 0x7f077015e3b0 2024-03-27T09:59:35.398 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.406+0000 7f0776400640 1 -- 172.21.15.57:0/1267940476 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07700d0660 con 0x7f077015e3b0 2024-03-27T09:59:35.398 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.406+0000 7f0776400640 1 -- 172.21.15.57:0/1267940476 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07700c77b0 con 0x7f077015e3b0 2024-03-27T09:59:35.398 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.407+0000 7f0776400640 1 -- 172.21.15.57:0/1267940476 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0770068c50 con 0x7f077015e3b0 2024-03-27T09:59:35.398 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.408+0000 7f076cc00640 1 -- 172.21.15.57:0/1267940476 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f076800ac30 con 0x7f077015e3b0 2024-03-27T09:59:35.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.409+0000 7f076cc00640 1 --2- 172.21.15.57:0/1267940476 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f075006c560 0x7f075006ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:35.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.409+0000 7f076cc00640 1 -- 172.21.15.57:0/1267940476 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f076808bdb0 con 0x7f077015e3b0 2024-03-27T09:59:35.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.409+0000 7f0775000640 1 --2- 172.21.15.57:0/1267940476 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f075006c560 0x7f075006ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:35.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.410+0000 7f0775000640 1 --2- 172.21.15.57:0/1267940476 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f075006c560 0x7f075006ea20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0764036000 tx=0x7f076403c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:35.403 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.413+0000 7f076cc00640 1 -- 172.21.15.57:0/1267940476 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f0768090070 con 0x7f077015e3b0 2024-03-27T09:59:35.606 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.616+0000 7f0776400640 1 -- 172.21.15.57:0/1267940476 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f077006f6f0 con 0x7f077015e3b0 2024-03-27T09:59:35.609 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.618+0000 7f076cc00640 1 -- 172.21.15.57:0/1267940476 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18502 (secure 0 0 0) 0x7f0768020070 con 0x7f077015e3b0 2024-03-27T09:59:35.609 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T09:59:35.609 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":26,"fsid":"7ac43f86-2c16-4a97-98fb-715d3cebc75c","created":"2024-03-27T09:59:04.033417+0000","modified":"2024-03-27T09:59:35.208743+0000","last_up_change":"2024-03-27T09:59:16.969624+0000","last_in_change":"2024-03-27T09:59:07.421690+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-27T09:59:17.253008+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-27T09:59:26.690365+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-27T09:59:27.559059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-27T09:59:31.187596+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"47b44362-7302-4f2a-b735-582c6c3850cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6801","nonce":2020036298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6803","nonce":2020036298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6807","nonce":2020036298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6805","nonce":2020036298}]},"public_addr":"172.21.15.57:6801/2020036298","cluster_addr":"172.21.15.57:6803/2020036298","heartbeat_back_addr":"172.21.15.57:6807/2020036298","heartbeat_front_addr":"172.21.15.57:6805/2020036298","state":["exists","up"]},{"osd":1,"uuid":"feaf96f0-9431-4188-9a09-da505b40e934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6809","nonce":3190929242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6811","nonce":3190929242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6815","nonce":3190929242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6813","nonce":3190929242}]},"public_addr":"172.21.15.57:6809/3190929242","cluster_addr":"172.21.15.57:6811/3190929242","heartbeat_back_addr":"172.21.15.57:6815/3190929242","heartbeat_front_addr":"172.21.15.57:6813/3190929242","state":["exists","up"]},{"osd":2,"uuid":"21e406e6-cfbc-4fe7-a816-e2420487c95d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6817","nonce":4065849973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6819","nonce":4065849973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6823","nonce":4065849973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6821","nonce":4065849973}]},"public_addr":"172.21.15.57:6817/4065849973","cluster_addr":"172.21.15.57:6819/4065849973","heartbeat_back_addr":"172.21.15.57:6823/4065849973","heartbeat_front_addr":"172.21.15.57:6821/4065849973","state":["exists","up"]},{"osd":3,"uuid":"a389af1d-76c4-4dfc-b215-f983f4931257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6825","nonce":158084809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6827","nonce":158084809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6831","nonce":158084809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6829","nonce":158084809}]},"public_addr":"172.21.15.57:6825/158084809","cluster_addr":"172.21.15.57:6827/158084809","heartbeat_back_addr":"172.21.15.57:6831/158084809","heartbeat_front_addr":"172.21.15.57:6829/158084809","state":["exists","up"]},{"osd":4,"uuid":"e9b05dca-557a-43ee-b43f-9ce5b7d28304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6823","nonce":108719401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6827","nonce":108719401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6831","nonce":108719401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6829","nonce":108719401}]},"public_addr":"172.21.15.118:6823/108719401","cluster_addr":"172.21.15.118:6827/108719401","heartbeat_back_addr":"172.21.15.118:6831/108719401","heartbeat_front_addr":"172.21.15.118:6829/108719401","state":["exists","up"]},{"osd":5,"uuid":"d968177d-44ff-499a-b00a-b147ed879253","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6817","nonce":2704605866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6819","nonce":2704605866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6826","nonce":2704605866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6822","nonce":2704605866}]},"public_addr":"172.21.15.118:6817/2704605866","cluster_addr":"172.21.15.118:6819/2704605866","heartbeat_back_addr":"172.21.15.118:6826/2704605866","heartbeat_front_addr":"172.21.15.118:6822/2704605866","state":["exists","up"]},{"osd":6,"uuid":"e8f98052-e6ad-4cfe-a4a9-0b17a434d54e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6801","nonce":1963659095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6803","nonce":1963659095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6807","nonce":1963659095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6805","nonce":1963659095}]},"public_addr":"172.21.15.118:6801/1963659095","cluster_addr":"172.21.15.118:6803/1963659095","heartbeat_back_addr":"172.21.15.118:6807/1963659095","heartbeat_front_addr":"172.21.15.118:6805/1963659095","state":["exists","up"]},{"osd":7,"uuid":"eccff987-8e51-4a63-845a-cf0a3196d7fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6809","nonce":1955879596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6811","nonce":1955879596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6815","nonce":1955879596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6813","nonce":1955879596}]},"public_addr":"172.21.15.118:6809/1955879596","cluster_addr":"172.21.15.118:6811/1955879596","heartbeat_back_addr":"172.21.15.118:6815/1955879596","heartbeat_front_addr":"172.21.15.118:6813/1955879596","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.721258+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.696610+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.777895+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.806769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.743259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.845687+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:13.020165+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.722294+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-27T09:59:35.611 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.621+0000 7f0776400640 1 -- 172.21.15.57:0/1267940476 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f075006c560 msgr2=0x7f075006ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:35.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.621+0000 7f0776400640 1 --2- 172.21.15.57:0/1267940476 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f075006c560 0x7f075006ea20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0764036000 tx=0x7f076403c040 comp rx=0 tx=0).stop 2024-03-27T09:59:35.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.621+0000 7f0776400640 1 -- 172.21.15.57:0/1267940476 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f077015e3b0 msgr2=0x7f07700cb0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:35.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.621+0000 7f0776400640 1 --2- 172.21.15.57:0/1267940476 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f077015e3b0 0x7f07700cb0c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f076800c780 tx=0x7f076800cc40 comp rx=0 tx=0).stop 2024-03-27T09:59:35.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.621+0000 7f0776400640 1 -- 172.21.15.57:0/1267940476 shutdown_connections 2024-03-27T09:59:35.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.621+0000 7f0776400640 1 --2- 172.21.15.57:0/1267940476 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f077015e3b0 0x7f07700cb0c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:35.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.621+0000 7f0776400640 1 --2- 172.21.15.57:0/1267940476 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f077006ba80 0x7f07700cfe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:35.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.621+0000 7f0776400640 1 --2- 172.21.15.57:0/1267940476 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f075006c560 0x7f075006ea20 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:35.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.621+0000 7f0776400640 1 --2- 172.21.15.57:0/1267940476 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0770067280 0x7f07701f36c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:35.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.621+0000 7f0776400640 1 -- 172.21.15.57:0/1267940476 >> 172.21.15.57:0/1267940476 conn(0x7f07700b1ec0 msgr2=0x7f0770074990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:35.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.621+0000 7f0776400640 1 -- 172.21.15.57:0/1267940476 shutdown_connections 2024-03-27T09:59:35.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.622+0000 7f0776400640 1 -- 172.21.15.57:0/1267940476 wait complete. 2024-03-27T09:59:35.643 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-27T09:59:35.860 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.869+0000 7fc087200640 1 Processor -- start 2024-03-27T09:59:35.860 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.869+0000 7fc087200640 1 -- start start 2024-03-27T09:59:35.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.871+0000 7fc087200640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc088161830 0x7fc0880cf970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:35.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.871+0000 7fc087200640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0880d2d90 con 0x7fc0880d0e90 2024-03-27T09:59:35.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.871+0000 7fc087200640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0880cee90 con 0x7fc0880cfeb0 2024-03-27T09:59:35.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.871+0000 7fc087200640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7fc0880cf4e0 con 0x7fc088161830 2024-03-27T09:59:35.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.871+0000 7fc085e00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc088161830 0x7fc0880cf970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:35.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.871+0000 7fc086800640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fc0880d0e90 0x7fc0880c7b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:58280/0 (socket says 172.21.15.57:58280) 2024-03-27T09:59:35.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.871+0000 7fc086800640 1 -- 172.21.15.57:0/2467102831 learned_addr learned my addr 172.21.15.57:0/2467102831 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T09:59:35.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.872+0000 7fc084a00640 1 -- 172.21.15.57:0/2467102831 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2647757516 0 0) 0x7fc0880d2d90 con 0x7fc0880d0e90 2024-03-27T09:59:35.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.872+0000 7fc085e00640 1 -- 172.21.15.57:0/2467102831 >> v1:172.21.15.118:6789/0 conn(0x7fc0880cfeb0 legacy=0x7fc0880d0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:35.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.872+0000 7fc085e00640 1 -- 172.21.15.57:0/2467102831 >> v1:172.21.15.57:6789/0 conn(0x7fc0880d0e90 legacy=0x7fc0880c7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:35.863 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.872+0000 7fc085e00640 1 -- 172.21.15.57:0/2467102831 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0880cf170 con 0x7fc088161830 2024-03-27T09:59:35.863 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.873+0000 7fc085e00640 1 --2- 172.21.15.57:0/2467102831 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc088161830 0x7fc0880cf970 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc078009d90 tx=0x7fc07802beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=644772150c09682d server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:35.863 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.873+0000 7fc084a00640 1 -- 172.21.15.57:0/2467102831 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc078039070 con 0x7fc088161830 2024-03-27T09:59:35.863 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.873+0000 7fc084a00640 1 -- 172.21.15.57:0/2467102831 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc07802cc60 con 0x7fc088161830 2024-03-27T09:59:35.863 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.873+0000 7fc084a00640 1 -- 172.21.15.57:0/2467102831 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc078034660 con 0x7fc088161830 2024-03-27T09:59:35.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.874+0000 7fc087200640 1 -- 172.21.15.57:0/2467102831 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc088161830 msgr2=0x7fc0880cf970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:35.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.874+0000 7fc087200640 1 --2- 172.21.15.57:0/2467102831 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc088161830 0x7fc0880cf970 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc078009d90 tx=0x7fc07802beb0 comp rx=0 tx=0).stop 2024-03-27T09:59:35.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.874+0000 7fc087200640 1 -- 172.21.15.57:0/2467102831 shutdown_connections 2024-03-27T09:59:35.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.874+0000 7fc087200640 1 --2- 172.21.15.57:0/2467102831 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc088161830 0x7fc0880cf970 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:35.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.874+0000 7fc087200640 1 -- 172.21.15.57:0/2467102831 >> 172.21.15.57:0/2467102831 conn(0x7fc0880d4030 msgr2=0x7fc0880d4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:35.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.874+0000 7fc087200640 1 -- 172.21.15.57:0/2467102831 shutdown_connections 2024-03-27T09:59:35.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.874+0000 7fc087200640 1 -- 172.21.15.57:0/2467102831 wait complete. 2024-03-27T09:59:35.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.876+0000 7fc087200640 1 Processor -- start 2024-03-27T09:59:35.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.876+0000 7fc087200640 1 -- start start 2024-03-27T09:59:35.868 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.877+0000 7fc087200640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0880cfeb0 0x7fc088154cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:35.868 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.877+0000 7fc087200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc0880d0e90 0x7fc088156b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:35.868 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.877+0000 7fc087200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc088161830 0x7fc088152fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:35.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.877+0000 7fc087200640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fc0880ce4b0 con 0x7fc0880cfeb0 2024-03-27T09:59:35.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.877+0000 7fc087200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fc0880ce330 con 0x7fc088161830 2024-03-27T09:59:35.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.877+0000 7fc087200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fc088161c10 con 0x7fc0880d0e90 2024-03-27T09:59:35.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.877+0000 7fc085e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0880cfeb0 0x7fc088154cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:35.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.877+0000 7fc085e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0880cfeb0 0x7fc088154cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47762/0 (socket says 172.21.15.57:47762) 2024-03-27T09:59:35.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.877+0000 7fc085e00640 1 -- 172.21.15.57:0/2661199629 learned_addr learned my addr 172.21.15.57:0/2661199629 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T09:59:35.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.877+0000 7fc085400640 1 --2- 172.21.15.57:0/2661199629 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc0880d0e90 0x7fc088156b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:35.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.878+0000 7fc086800640 1 --2- 172.21.15.57:0/2661199629 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc088161830 0x7fc088152fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:35.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.878+0000 7fc085e00640 1 -- 172.21.15.57:0/2661199629 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc0880d0e90 msgr2=0x7fc088156b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:35.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.878+0000 7fc085e00640 1 --2- 172.21.15.57:0/2661199629 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc0880d0e90 0x7fc088156b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:35.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.878+0000 7fc085e00640 1 -- 172.21.15.57:0/2661199629 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc088161830 msgr2=0x7fc088152fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:35.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.878+0000 7fc085e00640 1 --2- 172.21.15.57:0/2661199629 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc088161830 0x7fc088152fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:35.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.878+0000 7fc085e00640 1 -- 172.21.15.57:0/2661199629 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc088157060 con 0x7fc0880cfeb0 2024-03-27T09:59:35.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.878+0000 7fc085400640 1 --2- 172.21.15.57:0/2661199629 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc0880d0e90 0x7fc088156b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T09:59:35.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.878+0000 7fc086800640 1 --2- 172.21.15.57:0/2661199629 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc088161830 0x7fc088152fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T09:59:35.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.878+0000 7fc085e00640 1 --2- 172.21.15.57:0/2661199629 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0880cfeb0 0x7fc088154cd0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc078009d90 tx=0x7fc078004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:35.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.878+0000 7fc07e000640 1 -- 172.21.15.57:0/2661199629 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc078039050 con 0x7fc0880cfeb0 2024-03-27T09:59:35.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.878+0000 7fc07e000640 1 -- 172.21.15.57:0/2661199629 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc078045070 con 0x7fc0880cfeb0 2024-03-27T09:59:35.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.878+0000 7fc07e000640 1 -- 172.21.15.57:0/2661199629 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc07803ea50 con 0x7fc0880cfeb0 2024-03-27T09:59:35.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.878+0000 7fc087200640 1 -- 172.21.15.57:0/2661199629 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0881552b0 con 0x7fc0880cfeb0 2024-03-27T09:59:35.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.878+0000 7fc087200640 1 -- 172.21.15.57:0/2661199629 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc088155870 con 0x7fc0880cfeb0 2024-03-27T09:59:35.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.879+0000 7fc087200640 1 -- 172.21.15.57:0/2661199629 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc088068540 con 0x7fc0880cfeb0 2024-03-27T09:59:35.871 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.880+0000 7fc07e000640 1 -- 172.21.15.57:0/2661199629 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fc07802cae0 con 0x7fc0880cfeb0 2024-03-27T09:59:35.871 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.881+0000 7fc07e000640 1 --2- 172.21.15.57:0/2661199629 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fc06406c530 0x7fc06406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:35.871 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.881+0000 7fc07e000640 1 -- 172.21.15.57:0/2661199629 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fc0780aea60 con 0x7fc0880cfeb0 2024-03-27T09:59:35.871 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.882+0000 7fc085400640 1 --2- 172.21.15.57:0/2661199629 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fc06406c530 0x7fc06406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:35.872 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.882+0000 7fc085400640 1 --2- 172.21.15.57:0/2661199629 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fc06406c530 0x7fc06406e9f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc08815ddd0 tx=0x7fc070009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:35.876 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:35.886+0000 7fc07e000640 1 -- 172.21.15.57:0/2661199629 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7fc07807cdc0 con 0x7fc0880cfeb0 2024-03-27T09:59:36.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:36.131+0000 7fc087200640 1 -- 172.21.15.57:0/2661199629 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc08808d780 con 0x7fc0880cfeb0 2024-03-27T09:59:36.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:36.133+0000 7fc07e000640 1 -- 172.21.15.57:0/2661199629 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5183 (secure 0 0 0) 0x7fc07807c6c0 con 0x7fc0880cfeb0 2024-03-27T09:59:36.123 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T09:59:36.123 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/1178943431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1178943431},{"type":"v1","addr":"172.21.15.118:6834","nonce":1178943431}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6836/1248533620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6835","nonce":1248533620},{"type":"v1","addr":"172.21.15.57:6836","nonce":1248533620}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6837/4133386889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":4133386889},{"type":"v1","addr":"172.21.15.57:6837","nonce":4133386889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-27T09:59:28.571425+0000","modified":"2024-03-27T09:59:33.677904+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6835/1823694233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":1823694233},{"type":"v1","addr":"172.21.15.118:6835","nonce":1823694233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4282,"qdb_cluster":[4282]},"id":1}]} 2024-03-27T09:59:36.123 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 7 2024-03-27T09:59:36.126 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:36.136+0000 7fc087200640 1 -- 172.21.15.57:0/2661199629 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fc06406c530 msgr2=0x7fc06406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:36.126 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:36.136+0000 7fc087200640 1 --2- 172.21.15.57:0/2661199629 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fc06406c530 0x7fc06406e9f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc08815ddd0 tx=0x7fc070009040 comp rx=0 tx=0).stop 2024-03-27T09:59:36.127 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:36.136+0000 7fc087200640 1 -- 172.21.15.57:0/2661199629 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0880cfeb0 msgr2=0x7fc088154cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:36.127 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:36.136+0000 7fc087200640 1 --2- 172.21.15.57:0/2661199629 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0880cfeb0 0x7fc088154cd0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc078009d90 tx=0x7fc078004a40 comp rx=0 tx=0).stop 2024-03-27T09:59:36.127 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:36.136+0000 7fc087200640 1 -- 172.21.15.57:0/2661199629 shutdown_connections 2024-03-27T09:59:36.127 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:36.136+0000 7fc087200640 1 --2- 172.21.15.57:0/2661199629 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fc06406c530 0x7fc06406e9f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:36.127 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:36.136+0000 7fc087200640 1 --2- 172.21.15.57:0/2661199629 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc088161830 0x7fc088152fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:36.127 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:36.136+0000 7fc087200640 1 --2- 172.21.15.57:0/2661199629 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc0880d0e90 0x7fc088156b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:36.127 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:36.136+0000 7fc087200640 1 --2- 172.21.15.57:0/2661199629 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0880cfeb0 0x7fc088154cd0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:36.127 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:36.136+0000 7fc087200640 1 -- 172.21.15.57:0/2661199629 >> 172.21.15.57:0/2661199629 conn(0x7fc0880d4030 msgr2=0x7fc0880c8400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:36.127 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:36.136+0000 7fc087200640 1 -- 172.21.15.57:0/2661199629 shutdown_connections 2024-03-27T09:59:36.127 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:36.136+0000 7fc087200640 1 -- 172.21.15.57:0/2661199629 wait complete. 2024-03-27T09:59:36.146 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-27T09:59:36.356 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:36.366+0000 7f3a37800640 1 Processor -- start 2024-03-27T09:59:36.356 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:36.366+0000 7f3a37800640 1 -- start start 2024-03-27T09:59:36.358 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:36.368+0000 7f3a37800640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3a3015e1b0 0x7f3a300b2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:36.358 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:36.368+0000 7f3a37800640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f3a3015e590 0x7f3a300d1e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:36.358 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:36.368+0000 7f3a37800640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a301628d0 con 0x7f3a3006c940 2024-03-27T09:59:36.358 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:36.368+0000 7f3a37800640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f3a30162670 con 0x7f3a3015e590 2024-03-27T09:59:36.358 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:36.368+0000 7f3a37800640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f3a30162bb0 con 0x7f3a3015e1b0 2024-03-27T09:59:36.359 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:36.368+0000 7f3a35800640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f3a3015e590 0x7f3a300d1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:36.359 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:36.368+0000 7f3a34e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3a3015e1b0 0x7f3a300b2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:36.359 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:36.368+0000 7f3a34e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3a3015e1b0 0x7f3a300b2950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.57:44892/0 (socket says 172.21.15.57:44892) 2024-03-27T09:59:36.359 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:36.368+0000 7f3a34e00640 1 -- 172.21.15.57:0/13719098 learned_addr learned my addr 172.21.15.57:0/13719098 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T09:59:36.359 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:36.369+0000 7f3a34e00640 1 -- 172.21.15.57:0/13719098 >> v2:172.21.15.118:3300/0 conn(0x7f3a3015e590 msgr2=0x7f3a300d1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T09:59:36.360 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:36.369+0000 7f3a34e00640 1 --2- 172.21.15.57:0/13719098 >> v2:172.21.15.118:3300/0 conn(0x7f3a3015e590 0x7f3a300d1e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:36.360 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:36.369+0000 7f3a34e00640 1 -- 172.21.15.57:0/13719098 >> v1:172.21.15.118:6789/0 conn(0x7f3a3006c940 legacy=0x7f3a30161f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:36.360 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:36.369+0000 7f3a34e00640 1 -- 172.21.15.57:0/13719098 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a300b2150 con 0x7f3a3015e1b0 2024-03-27T09:59:36.360 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:36.371+0000 7f3a34e00640 1 --2- 172.21.15.57:0/13719098 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3a3015e1b0 0x7f3a300b2950 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3a24009870 tx=0x7f3a2402b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=944d3e36e52c8490 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:36.361 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:36.371+0000 7f3a2f400640 1 -- 172.21.15.57:0/13719098 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a24035020 con 0x7f3a3015e1b0 2024-03-27T09:59:36.361 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:36.371+0000 7f3a2f400640 1 -- 172.21.15.57:0/13719098 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a24031640 con 0x7f3a3015e1b0 2024-03-27T09:59:36.361 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:36.371+0000 7f3a2f400640 1 -- 172.21.15.57:0/13719098 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a2402d040 con 0x7f3a3015e1b0 2024-03-27T09:59:36.362 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:36.372+0000 7f3a37800640 1 -- 172.21.15.57:0/13719098 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3a3015e1b0 msgr2=0x7f3a300b2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:36.362 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:36.372+0000 7f3a37800640 1 --2- 172.21.15.57:0/13719098 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3a3015e1b0 0x7f3a300b2950 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3a24009870 tx=0x7f3a2402b8f0 comp rx=0 tx=0).stop 2024-03-27T09:59:36.362 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:36.372+0000 7f3a37800640 1 -- 172.21.15.57:0/13719098 shutdown_connections 2024-03-27T09:59:36.362 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:36.372+0000 7f3a37800640 1 --2- 172.21.15.57:0/13719098 >> v2:172.21.15.118:3300/0 conn(0x7f3a3015e590 0x7f3a300d1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:36.362 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:36.372+0000 7f3a37800640 1 --2- 172.21.15.57:0/13719098 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3a3015e1b0 0x7f3a300b2950 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:36.362 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:36.372+0000 7f3a37800640 1 -- 172.21.15.57:0/13719098 >> 172.21.15.57:0/13719098 conn(0x7f3a3009aa30 msgr2=0x7f3a3009ae40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:36.363 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:36.372+0000 7f3a37800640 1 -- 172.21.15.57:0/13719098 shutdown_connections 2024-03-27T09:59:36.363 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:36.372+0000 7f3a37800640 1 -- 172.21.15.57:0/13719098 wait complete. 2024-03-27T09:59:36.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:36.374+0000 7f3a37800640 1 Processor -- start 2024-03-27T09:59:36.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:36.374+0000 7f3a37800640 1 -- start start 2024-03-27T09:59:36.365 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:36.375+0000 7f3a37800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a3006c940 0x7f3a30158e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:36.366 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:36.375+0000 7f3a37800640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3a3015e1b0 0x7f3a30152d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:36.366 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:36.375+0000 7f3a37800640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a3015e590 0x7f3a300d0a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:36.366 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:36.375+0000 7f3a37800640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f3a300b2e90 con 0x7f3a3015e590 2024-03-27T09:59:36.366 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:36.375+0000 7f3a37800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f3a300d2380 con 0x7f3a3006c940 2024-03-27T09:59:36.366 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:36.375+0000 7f3a37800640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f3a301f88c0 con 0x7f3a3015e1b0 2024-03-27T09:59:36.366 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:36.375+0000 7f3a35800640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a3015e590 0x7f3a300d0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:36.366 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:36.375+0000 7f3a35800640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a3015e590 0x7f3a300d0a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47776/0 (socket says 172.21.15.57:47776) 2024-03-27T09:59:36.366 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:36.375+0000 7f3a35800640 1 -- 172.21.15.57:0/2047206024 learned_addr learned my addr 172.21.15.57:0/2047206024 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T09:59:36.366 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:36.375+0000 7f3a2fe00640 1 --2- 172.21.15.57:0/2047206024 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3a3015e1b0 0x7f3a30152d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:36.366 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:36.375+0000 7f3a34e00640 1 --2- 172.21.15.57:0/2047206024 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a3006c940 0x7f3a30158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:36.366 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:36.375+0000 7f3a35800640 1 -- 172.21.15.57:0/2047206024 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3a3015e1b0 msgr2=0x7f3a30152d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:36.367 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:36.375+0000 7f3a35800640 1 --2- 172.21.15.57:0/2047206024 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3a3015e1b0 0x7f3a30152d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:36.367 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:36.375+0000 7f3a35800640 1 -- 172.21.15.57:0/2047206024 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a3006c940 msgr2=0x7f3a30158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:36.367 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:36.375+0000 7f3a35800640 1 --2- 172.21.15.57:0/2047206024 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a3006c940 0x7f3a30158e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:36.367 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:36.375+0000 7f3a35800640 1 -- 172.21.15.57:0/2047206024 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a301580d0 con 0x7f3a3015e590 2024-03-27T09:59:36.367 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:36.375+0000 7f3a34e00640 1 --2- 172.21.15.57:0/2047206024 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a3006c940 0x7f3a30158e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T09:59:36.367 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:36.376+0000 7f3a35800640 1 --2- 172.21.15.57:0/2047206024 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a3015e590 0x7f3a300d0a50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3a2800efc0 tx=0x7f3a2800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:36.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:36.376+0000 7f3a2cc00640 1 -- 172.21.15.57:0/2047206024 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a28018020 con 0x7f3a3015e590 2024-03-27T09:59:36.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:36.376+0000 7f3a2cc00640 1 -- 172.21.15.57:0/2047206024 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a28014480 con 0x7f3a3015e590 2024-03-27T09:59:36.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:36.376+0000 7f3a2cc00640 1 -- 172.21.15.57:0/2047206024 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a28014870 con 0x7f3a3015e590 2024-03-27T09:59:36.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:36.376+0000 7f3a37800640 1 -- 172.21.15.57:0/2047206024 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a301583b0 con 0x7f3a3015e590 2024-03-27T09:59:36.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:36.376+0000 7f3a37800640 1 -- 172.21.15.57:0/2047206024 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a30158970 con 0x7f3a3015e590 2024-03-27T09:59:36.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:36.377+0000 7f3a37800640 1 -- 172.21.15.57:0/2047206024 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a30068620 con 0x7f3a3015e590 2024-03-27T09:59:36.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:36.378+0000 7f3a2cc00640 1 -- 172.21.15.57:0/2047206024 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f3a28005d10 con 0x7f3a3015e590 2024-03-27T09:59:36.369 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:36.379+0000 7f3a2cc00640 1 --2- 172.21.15.57:0/2047206024 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f3a1006c560 0x7f3a1006ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:36.369 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:36.379+0000 7f3a2cc00640 1 -- 172.21.15.57:0/2047206024 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f3a2808c540 con 0x7f3a3015e590 2024-03-27T09:59:36.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:36.380+0000 7f3a34e00640 1 --2- 172.21.15.57:0/2047206024 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f3a1006c560 0x7f3a1006ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:36.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:36.380+0000 7f3a34e00640 1 --2- 172.21.15.57:0/2047206024 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f3a1006c560 0x7f3a1006ea20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3a24036000 tx=0x7f3a24008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:36.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:36.384+0000 7f3a2cc00640 1 -- 172.21.15.57:0/2047206024 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f3a28022070 con 0x7f3a3015e590 2024-03-27T09:59:36.567 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:36.577+0000 7f3a37800640 1 -- 172.21.15.57:0/2047206024 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3a300b1ab0 con 0x7f3a3015e590 2024-03-27T09:59:36.570 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:36.580+0000 7f3a2cc00640 1 -- 172.21.15.57:0/2047206024 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18502 (secure 0 0 0) 0x7f3a28010040 con 0x7f3a3015e590 2024-03-27T09:59:36.571 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T09:59:36.571 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":26,"fsid":"7ac43f86-2c16-4a97-98fb-715d3cebc75c","created":"2024-03-27T09:59:04.033417+0000","modified":"2024-03-27T09:59:35.208743+0000","last_up_change":"2024-03-27T09:59:16.969624+0000","last_in_change":"2024-03-27T09:59:07.421690+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-27T09:59:17.253008+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-27T09:59:26.690365+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-27T09:59:27.559059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-27T09:59:31.187596+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"47b44362-7302-4f2a-b735-582c6c3850cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6801","nonce":2020036298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6803","nonce":2020036298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6807","nonce":2020036298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6805","nonce":2020036298}]},"public_addr":"172.21.15.57:6801/2020036298","cluster_addr":"172.21.15.57:6803/2020036298","heartbeat_back_addr":"172.21.15.57:6807/2020036298","heartbeat_front_addr":"172.21.15.57:6805/2020036298","state":["exists","up"]},{"osd":1,"uuid":"feaf96f0-9431-4188-9a09-da505b40e934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6809","nonce":3190929242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6811","nonce":3190929242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6815","nonce":3190929242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6813","nonce":3190929242}]},"public_addr":"172.21.15.57:6809/3190929242","cluster_addr":"172.21.15.57:6811/3190929242","heartbeat_back_addr":"172.21.15.57:6815/3190929242","heartbeat_front_addr":"172.21.15.57:6813/3190929242","state":["exists","up"]},{"osd":2,"uuid":"21e406e6-cfbc-4fe7-a816-e2420487c95d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6817","nonce":4065849973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6819","nonce":4065849973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6823","nonce":4065849973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6821","nonce":4065849973}]},"public_addr":"172.21.15.57:6817/4065849973","cluster_addr":"172.21.15.57:6819/4065849973","heartbeat_back_addr":"172.21.15.57:6823/4065849973","heartbeat_front_addr":"172.21.15.57:6821/4065849973","state":["exists","up"]},{"osd":3,"uuid":"a389af1d-76c4-4dfc-b215-f983f4931257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6825","nonce":158084809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6827","nonce":158084809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6831","nonce":158084809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6829","nonce":158084809}]},"public_addr":"172.21.15.57:6825/158084809","cluster_addr":"172.21.15.57:6827/158084809","heartbeat_back_addr":"172.21.15.57:6831/158084809","heartbeat_front_addr":"172.21.15.57:6829/158084809","state":["exists","up"]},{"osd":4,"uuid":"e9b05dca-557a-43ee-b43f-9ce5b7d28304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6823","nonce":108719401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6827","nonce":108719401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6831","nonce":108719401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6829","nonce":108719401}]},"public_addr":"172.21.15.118:6823/108719401","cluster_addr":"172.21.15.118:6827/108719401","heartbeat_back_addr":"172.21.15.118:6831/108719401","heartbeat_front_addr":"172.21.15.118:6829/108719401","state":["exists","up"]},{"osd":5,"uuid":"d968177d-44ff-499a-b00a-b147ed879253","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6817","nonce":2704605866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6819","nonce":2704605866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6826","nonce":2704605866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6822","nonce":2704605866}]},"public_addr":"172.21.15.118:6817/2704605866","cluster_addr":"172.21.15.118:6819/2704605866","heartbeat_back_addr":"172.21.15.118:6826/2704605866","heartbeat_front_addr":"172.21.15.118:6822/2704605866","state":["exists","up"]},{"osd":6,"uuid":"e8f98052-e6ad-4cfe-a4a9-0b17a434d54e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6801","nonce":1963659095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6803","nonce":1963659095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6807","nonce":1963659095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6805","nonce":1963659095}]},"public_addr":"172.21.15.118:6801/1963659095","cluster_addr":"172.21.15.118:6803/1963659095","heartbeat_back_addr":"172.21.15.118:6807/1963659095","heartbeat_front_addr":"172.21.15.118:6805/1963659095","state":["exists","up"]},{"osd":7,"uuid":"eccff987-8e51-4a63-845a-cf0a3196d7fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6809","nonce":1955879596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6811","nonce":1955879596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6815","nonce":1955879596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6813","nonce":1955879596}]},"public_addr":"172.21.15.118:6809/1955879596","cluster_addr":"172.21.15.118:6811/1955879596","heartbeat_back_addr":"172.21.15.118:6815/1955879596","heartbeat_front_addr":"172.21.15.118:6813/1955879596","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.721258+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.696610+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.777895+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.806769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.743259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.845687+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:13.020165+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.722294+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-27T09:59:36.574 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:36.583+0000 7f3a37800640 1 -- 172.21.15.57:0/2047206024 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f3a1006c560 msgr2=0x7f3a1006ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:36.574 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:36.583+0000 7f3a37800640 1 --2- 172.21.15.57:0/2047206024 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f3a1006c560 0x7f3a1006ea20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3a24036000 tx=0x7f3a24008030 comp rx=0 tx=0).stop 2024-03-27T09:59:36.574 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:36.583+0000 7f3a37800640 1 -- 172.21.15.57:0/2047206024 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a3015e590 msgr2=0x7f3a300d0a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:36.574 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:36.583+0000 7f3a37800640 1 --2- 172.21.15.57:0/2047206024 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a3015e590 0x7f3a300d0a50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3a2800efc0 tx=0x7f3a2800c490 comp rx=0 tx=0).stop 2024-03-27T09:59:36.574 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:36.583+0000 7f3a37800640 1 -- 172.21.15.57:0/2047206024 shutdown_connections 2024-03-27T09:59:36.574 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:36.583+0000 7f3a37800640 1 --2- 172.21.15.57:0/2047206024 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a3015e590 0x7f3a300d0a50 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:36.574 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:36.583+0000 7f3a37800640 1 --2- 172.21.15.57:0/2047206024 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3a3015e1b0 0x7f3a30152d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:36.574 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:36.583+0000 7f3a37800640 1 --2- 172.21.15.57:0/2047206024 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f3a1006c560 0x7f3a1006ea20 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:36.574 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:36.583+0000 7f3a37800640 1 --2- 172.21.15.57:0/2047206024 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a3006c940 0x7f3a30158e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:36.574 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:36.583+0000 7f3a37800640 1 -- 172.21.15.57:0/2047206024 >> 172.21.15.57:0/2047206024 conn(0x7f3a3009aa30 msgr2=0x7f3a30161ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:36.574 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:36.583+0000 7f3a37800640 1 -- 172.21.15.57:0/2047206024 shutdown_connections 2024-03-27T09:59:36.574 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:36.583+0000 7f3a37800640 1 -- 172.21.15.57:0/2047206024 wait complete. 2024-03-27T09:59:36.995 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-27T09:59:28.571425+0000', 'modified': '2024-03-27T09:59:33.677904+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4282}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4282': {'gid': 4282, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.118:6835/1823694233', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.118:6833', 'nonce': 1823694233}, {'type': 'v1', 'addr': '172.21.15.118:6835', 'nonce': 1823694233}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 4282, 'qdb_cluster': [4282]} 2024-03-27T09:59:36.995 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-03-27T09:59:36.995 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-03-27T09:59:37.232 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.242+0000 7f58dc400640 1 Processor -- start 2024-03-27T09:59:37.232 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.242+0000 7f58dc400640 1 -- start start 2024-03-27T09:59:37.234 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.244+0000 7f58dc400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f58d40d3fe0 0x7f58d40d4440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:37.234 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.244+0000 7f58dc400640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f58d40ceee0 0x7f58d40cf330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:37.234 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.244+0000 7f58dc400640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58d415f850 con 0x7f58d415e4a0 2024-03-27T09:59:37.234 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.244+0000 7f58dc400640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f58d40d0a10 con 0x7f58d40ceee0 2024-03-27T09:59:37.234 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.244+0000 7f58dc400640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f58d40d0cf0 con 0x7f58d40d3fe0 2024-03-27T09:59:37.234 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.244+0000 7f58da400640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f58d40ceee0 0x7f58d40cf330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:37.234 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.244+0000 7f58d9a00640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f58d415e4a0 0x7f58d40d14f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:58292/0 (socket says 172.21.15.57:58292) 2024-03-27T09:59:37.235 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.244+0000 7f58d9a00640 1 -- 172.21.15.57:0/2460701589 learned_addr learned my addr 172.21.15.57:0/2460701589 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T09:59:37.235 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.244+0000 7f58d9000640 1 --2- 172.21.15.57:0/2460701589 >> v2:172.21.15.118:3300/0 conn(0x7f58d40d3fe0 0x7f58d40d4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:37.235 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.245+0000 7f58da400640 1 -- 172.21.15.57:0/2460701589 >> v2:172.21.15.118:3300/0 conn(0x7f58d40d3fe0 msgr2=0x7f58d40d4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T09:59:37.235 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.245+0000 7f58da400640 1 --2- 172.21.15.57:0/2460701589 >> v2:172.21.15.118:3300/0 conn(0x7f58d40d3fe0 0x7f58d40d4440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:37.235 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.245+0000 7f58da400640 1 -- 172.21.15.57:0/2460701589 >> v1:172.21.15.57:6789/0 conn(0x7f58d415e4a0 legacy=0x7f58d40d14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:37.235 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.245+0000 7f58da400640 1 -- 172.21.15.57:0/2460701589 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58d40d4980 con 0x7f58d40ceee0 2024-03-27T09:59:37.236 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.245+0000 7f58d3e00640 1 -- 172.21.15.57:0/2460701589 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4031919363 0 0) 0x7f58d415f850 con 0x7f58d415e4a0 2024-03-27T09:59:37.236 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.246+0000 7f58da400640 1 --2- 172.21.15.57:0/2460701589 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f58d40ceee0 0x7f58d40cf330 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f58d40a20b0 tx=0x7f58cc02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9695eae33e8ab645 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:37.236 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.246+0000 7f58d3e00640 1 -- 172.21.15.57:0/2460701589 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58cc039070 con 0x7f58d40ceee0 2024-03-27T09:59:37.236 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.246+0000 7f58d3e00640 1 -- 172.21.15.57:0/2460701589 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58cc02cc80 con 0x7f58d40ceee0 2024-03-27T09:59:37.237 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.246+0000 7f58d3e00640 1 -- 172.21.15.57:0/2460701589 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58cc034660 con 0x7f58d40ceee0 2024-03-27T09:59:37.237 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.247+0000 7f58dc400640 1 -- 172.21.15.57:0/2460701589 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f58d40ceee0 msgr2=0x7f58d40cf330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:37.237 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.247+0000 7f58dc400640 1 --2- 172.21.15.57:0/2460701589 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f58d40ceee0 0x7f58d40cf330 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f58d40a20b0 tx=0x7f58cc02bed0 comp rx=0 tx=0).stop 2024-03-27T09:59:37.238 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.247+0000 7f58dc400640 1 -- 172.21.15.57:0/2460701589 shutdown_connections 2024-03-27T09:59:37.238 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.247+0000 7f58dc400640 1 --2- 172.21.15.57:0/2460701589 >> v2:172.21.15.118:3300/0 conn(0x7f58d40d3fe0 0x7f58d40d4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:37.238 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.247+0000 7f58dc400640 1 --2- 172.21.15.57:0/2460701589 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f58d40ceee0 0x7f58d40cf330 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:37.238 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.247+0000 7f58dc400640 1 -- 172.21.15.57:0/2460701589 >> 172.21.15.57:0/2460701589 conn(0x7f58d408db50 msgr2=0x7f58d409d470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:37.238 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.247+0000 7f58dc400640 1 -- 172.21.15.57:0/2460701589 shutdown_connections 2024-03-27T09:59:37.238 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.247+0000 7f58dc400640 1 -- 172.21.15.57:0/2460701589 wait complete. 2024-03-27T09:59:37.240 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.250+0000 7f58dc400640 1 Processor -- start 2024-03-27T09:59:37.240 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.250+0000 7f58dc400640 1 -- start start 2024-03-27T09:59:37.242 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.251+0000 7f58dc400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f58d40ceee0 0x7f58d40cdfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:37.242 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.251+0000 7f58dc400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f58d40d3fe0 0x7f58d41f3e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:37.242 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.251+0000 7f58dc400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f58d415e4a0 0x7f58d40cb480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:37.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.251+0000 7f58dc400640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f58d40b3000 con 0x7f58d40ceee0 2024-03-27T09:59:37.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.251+0000 7f58dc400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f58d40b2e80 con 0x7f58d40d3fe0 2024-03-27T09:59:37.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.251+0000 7f58dc400640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f58d40b3180 con 0x7f58d415e4a0 2024-03-27T09:59:37.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.252+0000 7f58d9a00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f58d40ceee0 0x7f58d40cdfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:37.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.252+0000 7f58d9a00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f58d40ceee0 0x7f58d40cdfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47796/0 (socket says 172.21.15.57:47796) 2024-03-27T09:59:37.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.252+0000 7f58d9a00640 1 -- 172.21.15.57:0/2061055908 learned_addr learned my addr 172.21.15.57:0/2061055908 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T09:59:37.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.252+0000 7f58d9000640 1 --2- 172.21.15.57:0/2061055908 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f58d40d3fe0 0x7f58d41f3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:37.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.252+0000 7f58da400640 1 --2- 172.21.15.57:0/2061055908 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f58d415e4a0 0x7f58d40cb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:37.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.252+0000 7f58d9a00640 1 -- 172.21.15.57:0/2061055908 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f58d415e4a0 msgr2=0x7f58d40cb480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:37.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.252+0000 7f58d9a00640 1 --2- 172.21.15.57:0/2061055908 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f58d415e4a0 0x7f58d40cb480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:37.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.252+0000 7f58d9a00640 1 -- 172.21.15.57:0/2061055908 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f58d40d3fe0 msgr2=0x7f58d41f3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:37.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.252+0000 7f58d9a00640 1 --2- 172.21.15.57:0/2061055908 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f58d40d3fe0 0x7f58d41f3e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:37.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.252+0000 7f58d9a00640 1 -- 172.21.15.57:0/2061055908 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58d40cb9c0 con 0x7f58d40ceee0 2024-03-27T09:59:37.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.253+0000 7f58d9a00640 1 --2- 172.21.15.57:0/2061055908 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f58d40ceee0 0x7f58d40cdfb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f58c800c3f0 tx=0x7f58c800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:37.244 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.253+0000 7f58d1600640 1 -- 172.21.15.57:0/2061055908 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58c80074e0 con 0x7f58d40ceee0 2024-03-27T09:59:37.244 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.253+0000 7f58d1600640 1 -- 172.21.15.57:0/2061055908 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58c80047e0 con 0x7f58d40ceee0 2024-03-27T09:59:37.244 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.253+0000 7f58dc400640 1 -- 172.21.15.57:0/2061055908 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58d40c8af0 con 0x7f58d40ceee0 2024-03-27T09:59:37.244 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.253+0000 7f58d1600640 1 -- 172.21.15.57:0/2061055908 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58c8004c10 con 0x7f58d40ceee0 2024-03-27T09:59:37.244 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.253+0000 7f58dc400640 1 -- 172.21.15.57:0/2061055908 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58d40c8d90 con 0x7f58d40ceee0 2024-03-27T09:59:37.245 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.255+0000 7f58d1600640 1 -- 172.21.15.57:0/2061055908 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f58c8011070 con 0x7f58d40ceee0 2024-03-27T09:59:37.246 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.256+0000 7f58d1600640 1 --2- 172.21.15.57:0/2061055908 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f58b406c560 0x7f58b406ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:37.246 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.256+0000 7f58d1600640 1 -- 172.21.15.57:0/2061055908 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f58c808b610 con 0x7f58d40ceee0 2024-03-27T09:59:37.246 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.257+0000 7f58d9000640 1 --2- 172.21.15.57:0/2061055908 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f58b406c560 0x7f58b406ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:37.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.257+0000 7f58df02b740 1 Processor -- start 2024-03-27T09:59:37.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.257+0000 7f58df02b740 1 -- start start 2024-03-27T09:59:37.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.257+0000 7f58d9000640 1 --2- 172.21.15.57:0/2061055908 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f58b406c560 0x7f58b406ea20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f58d40cae90 tx=0x7f58c0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:37.249 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.258+0000 7f58df02b740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560224fc7fd0 0x560224f9af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:37.249 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.258+0000 7f58df02b740 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x560224fc83b0 0x560224fcad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:37.249 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.258+0000 7f58df02b740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560224f9b4b0 0x560224fcb2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:37.249 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.258+0000 7f58df02b740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x560224f62920 con 0x560224fc7fd0 2024-03-27T09:59:37.249 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.258+0000 7f58df02b740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x560224eb2fa0 con 0x560224f9b4b0 2024-03-27T09:59:37.249 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.258+0000 7f58df02b740 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x560224f04f90 con 0x560224fc83b0 2024-03-27T09:59:37.249 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.258+0000 7f58d9a00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560224fc7fd0 0x560224f9af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:37.249 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.258+0000 7f58d9a00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560224fc7fd0 0x560224f9af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47812/0 (socket says 172.21.15.57:47812) 2024-03-27T09:59:37.249 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.258+0000 7f58d9a00640 1 -- 172.21.15.57:0/3835174296 learned_addr learned my addr 172.21.15.57:0/3835174296 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T09:59:37.249 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.259+0000 7f58d9000640 1 --2- 172.21.15.57:0/3835174296 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x560224fc83b0 0x560224fcad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:37.249 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.259+0000 7f58da400640 1 --2- 172.21.15.57:0/3835174296 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560224f9b4b0 0x560224fcb2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:37.250 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.259+0000 7f58d9a00640 1 -- 172.21.15.57:0/3835174296 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x560224fc83b0 msgr2=0x560224fcad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T09:59:37.250 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.259+0000 7f58d9a00640 1 --2- 172.21.15.57:0/3835174296 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x560224fc83b0 0x560224fcad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:37.250 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.259+0000 7f58d9a00640 1 -- 172.21.15.57:0/3835174296 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560224f9b4b0 msgr2=0x560224fcb2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T09:59:37.250 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.259+0000 7f58d9a00640 1 --2- 172.21.15.57:0/3835174296 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560224f9b4b0 0x560224fcb2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:37.250 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.259+0000 7f58d9a00640 1 -- 172.21.15.57:0/3835174296 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560224c192d0 con 0x560224fc7fd0 2024-03-27T09:59:37.250 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.259+0000 7f58d9a00640 1 --2- 172.21.15.57:0/3835174296 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560224fc7fd0 0x560224f9af70 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f58c8061890 tx=0x7f58c8055500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb1496641cebb3a4 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:37.251 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.259+0000 7f58c6000640 1 -- 172.21.15.57:0/3835174296 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58c805d590 con 0x560224fc7fd0 2024-03-27T09:59:37.251 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.259+0000 7f58c6000640 1 -- 172.21.15.57:0/3835174296 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58c8061dc0 con 0x560224fc7fd0 2024-03-27T09:59:37.251 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.259+0000 7f58c6000640 1 -- 172.21.15.57:0/3835174296 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58c80574e0 con 0x560224fc7fd0 2024-03-27T09:59:37.251 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.260+0000 7f58df02b740 1 -- 172.21.15.57:0/3835174296 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560224fc7fd0 msgr2=0x560224f9af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:37.251 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.260+0000 7f58df02b740 1 --2- 172.21.15.57:0/3835174296 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560224fc7fd0 0x560224f9af70 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f58c8061890 tx=0x7f58c8055500 comp rx=0 tx=0).stop 2024-03-27T09:59:37.251 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.260+0000 7f58df02b740 1 -- 172.21.15.57:0/3835174296 shutdown_connections 2024-03-27T09:59:37.251 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.260+0000 7f58df02b740 1 --2- 172.21.15.57:0/3835174296 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560224f9b4b0 0x560224fcb2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:37.252 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.260+0000 7f58df02b740 1 --2- 172.21.15.57:0/3835174296 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x560224fc83b0 0x560224fcad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:37.252 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.260+0000 7f58df02b740 1 --2- 172.21.15.57:0/3835174296 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560224fc7fd0 0x560224f9af70 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:37.252 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.260+0000 7f58df02b740 1 -- 172.21.15.57:0/3835174296 >> 172.21.15.57:0/3835174296 conn(0x560224f9d1e0 msgr2=0x560224fe5d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:37.252 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.260+0000 7f58df02b740 1 -- 172.21.15.57:0/3835174296 shutdown_connections 2024-03-27T09:59:37.252 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.260+0000 7f58df02b740 1 -- 172.21.15.57:0/3835174296 wait complete. 2024-03-27T09:59:37.252 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.261+0000 7f58df02b740 1 -- start start 2024-03-27T09:59:37.252 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.261+0000 7f58df02b740 1 Processor -- start 2024-03-27T09:59:37.255 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.262+0000 7f58df02b740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560224fc7fd0 0x560224fb16b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:37.255 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.262+0000 7f58df02b740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560224fc83b0 0x560224fb1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:37.255 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.262+0000 7f58df02b740 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x560224fc5ef0 0x560224fc3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:37.255 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.262+0000 7f58df02b740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x560224f00f40 con 0x560224fc7fd0 2024-03-27T09:59:37.255 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.262+0000 7f58df02b740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x560224ead650 con 0x560224fc83b0 2024-03-27T09:59:37.255 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.262+0000 7f58df02b740 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x560224ec0a10 con 0x560224fc5ef0 2024-03-27T09:59:37.255 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.262+0000 7f58df02b740 10 client.0 _ll_register_callbacks cb 0x560224effff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T09:59:37.255 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.263+0000 7f58d9a00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560224fc7fd0 0x560224fb16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:37.256 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.263+0000 7f58d9a00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560224fc7fd0 0x560224fb16b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47826/0 (socket says 172.21.15.57:47826) 2024-03-27T09:59:37.256 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.263+0000 7f58d9a00640 1 -- 172.21.15.57:0/722357161 learned_addr learned my addr 172.21.15.57:0/722357161 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T09:59:37.256 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.263+0000 7f58d9000640 1 --2- 172.21.15.57:0/722357161 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560224fc83b0 0x560224fb1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:37.256 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.263+0000 7f58da400640 1 --2- 172.21.15.57:0/722357161 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x560224fc5ef0 0x560224fc3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:37.256 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.263+0000 7f58d9a00640 1 -- 172.21.15.57:0/722357161 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x560224fc5ef0 msgr2=0x560224fc3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T09:59:37.256 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.263+0000 7f58d9a00640 1 --2- 172.21.15.57:0/722357161 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x560224fc5ef0 0x560224fc3fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:37.256 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.263+0000 7f58d9a00640 1 -- 172.21.15.57:0/722357161 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560224fc83b0 msgr2=0x560224fb1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T09:59:37.256 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.263+0000 7f58d9a00640 1 --2- 172.21.15.57:0/722357161 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560224fc83b0 0x560224fb1bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:37.256 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.263+0000 7f58d9a00640 1 -- 172.21.15.57:0/722357161 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560224ce36b0 con 0x560224fc7fd0 2024-03-27T09:59:37.256 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.263+0000 7f58d9a00640 1 --2- 172.21.15.57:0/722357161 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560224fc7fd0 0x560224fb16b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f58c800c3c0 tx=0x7f58c805c070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd94043f2af8da92 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:37.256 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.263+0000 7f58baa00640 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2024-03-27T09:59:37.256 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.264+0000 7f58baa00640 1 -- 172.21.15.57:0/722357161 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58c805d590 con 0x560224fc7fd0 2024-03-27T09:59:37.256 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.264+0000 7f58baa00640 1 -- 172.21.15.57:0/722357161 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f58c805d160 con 0x560224fc7fd0 2024-03-27T09:59:37.256 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.264+0000 7f58df02b740 1 -- 172.21.15.57:0/722357161 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f58c8061dc0 con 0x560224fc7fd0 2024-03-27T09:59:37.256 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.264+0000 7f58baa00640 1 -- 172.21.15.57:0/722357161 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7f58c8078050 con 0x560224fc7fd0 2024-03-27T09:59:37.257 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.264+0000 7f58df02b740 10 client.4413 fetch_fsmap learned FSMap version 7 2024-03-27T09:59:37.257 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.264+0000 7f58df02b740 1 -- 172.21.15.57:0/722357161 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x560224fc6f00 con 0x560224fc7fd0 2024-03-27T09:59:37.257 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.264+0000 7f58baa00640 1 -- 172.21.15.57:0/722357161 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58c8061dc0 con 0x560224fc7fd0 2024-03-27T09:59:37.257 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.264+0000 7f58baa00640 1 -- 172.21.15.57:0/722357161 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 7) ==== 3502+0+0 (secure 0 0 0) 0x7f58c8089280 con 0x560224fc7fd0 2024-03-27T09:59:37.257 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.264+0000 7f58df02b740 10 client.4413 fetch_fsmap finished waiting for FSMap version 7 2024-03-27T09:59:37.257 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.264+0000 7f58df02b740 10 client.4413 resolve_mds: resolved name 'd' to daemon mds.d 2024-03-27T09:59:37.257 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.264+0000 7f58df02b740 20 client.4413 populate_metadata read hostname 'smithi057' 2024-03-27T09:59:37.257 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.264+0000 7f58df02b740 1 --2- 172.21.15.57:0/722357161 >> [v2:172.21.15.118:6833/1823694233,v1:172.21.15.118:6835/1823694233] conn(0x560224fccf40 0x560224fcd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:37.257 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.264+0000 7f58df02b740 4 client.4413 mds_command: new command op to 4282 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T09:59:37.257 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.264+0000 7f58df02b740 1 -- 172.21.15.57:0/722357161 --> [v2:172.21.15.118:6833/1823694233,v1:172.21.15.118:6835/1823694233] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560224f124d0 con 0x560224fccf40 2024-03-27T09:59:37.257 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.265+0000 7f58d9000640 1 --2- 172.21.15.57:0/722357161 >> [v2:172.21.15.118:6833/1823694233,v1:172.21.15.118:6835/1823694233] conn(0x560224fccf40 0x560224fcd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:37.258 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.266+0000 7f58d9000640 1 --2- 172.21.15.57:0/722357161 >> [v2:172.21.15.118:6833/1823694233,v1:172.21.15.118:6835/1823694233] conn(0x560224fccf40 0x560224fcd320 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f4013558a6a98181 server_cookie=742b967be29d784 in_seq=0 out_seq=0 2024-03-27T09:59:37.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.266+0000 7f58baa00640 10 client.4413 ms_handle_connect on v2:172.21.15.118:6833/1823694233 2024-03-27T09:59:37.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.267+0000 7f58baa00640 1 -- 172.21.15.57:0/722357161 <== mds.0 v2:172.21.15.118:6833/1823694233 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x560224f124d0 con 0x560224fccf40 2024-03-27T09:59:37.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.268+0000 7f58baa00640 10 client.4413 handle_command_reply: tid=0 2024-03-27T09:59:37.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.268+0000 7f58df02b740 1 client.4413 shutdown 2024-03-27T09:59:37.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.268+0000 7f58df02b740 1 -- 172.21.15.57:0/722357161 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560224fc7fd0 msgr2=0x560224fb16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:37.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.268+0000 7f58df02b740 1 --2- 172.21.15.57:0/722357161 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560224fc7fd0 0x560224fb16b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f58c800c3c0 tx=0x7f58c805c070 comp rx=0 tx=0).stop 2024-03-27T09:59:37.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.268+0000 7f58df02b740 1 -- 172.21.15.57:0/722357161 shutdown_connections 2024-03-27T09:59:37.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.268+0000 7f58df02b740 1 --2- 172.21.15.57:0/722357161 >> [v2:172.21.15.118:6833/1823694233,v1:172.21.15.118:6835/1823694233] conn(0x560224fccf40 0x560224fcd320 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:37.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.268+0000 7f58df02b740 1 --2- 172.21.15.57:0/722357161 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x560224fc5ef0 0x560224fc3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:37.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.268+0000 7f58df02b740 1 --2- 172.21.15.57:0/722357161 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560224fc83b0 0x560224fb1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:37.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.268+0000 7f58df02b740 1 --2- 172.21.15.57:0/722357161 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560224fc7fd0 0x560224fb16b0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:37.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.268+0000 7f58df02b740 1 -- 172.21.15.57:0/722357161 >> 172.21.15.57:0/722357161 conn(0x560224f9b4b0 msgr2=0x560224fcad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:37.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.268+0000 7f58baa00640 0 client.4413 ms_handle_reset on v2:172.21.15.118:6833/1823694233 2024-03-27T09:59:37.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.268+0000 7f58df02b740 1 -- 172.21.15.57:0/722357161 shutdown_connections 2024-03-27T09:59:37.260 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.268+0000 7f58df02b740 1 -- 172.21.15.57:0/722357161 wait complete. 2024-03-27T09:59:37.260 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.268+0000 7f58df02b740 20 client.4413 trim_cache size 0 max 16384 2024-03-27T09:59:37.278 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.288+0000 7f58df02b740 1 Processor -- start 2024-03-27T09:59:37.279 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.288+0000 7f58df02b740 1 -- start start 2024-03-27T09:59:37.279 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.289+0000 7f58df02b740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560224fc5ef0 0x560224fc3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:37.279 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.289+0000 7f58df02b740 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x560224fc7fd0 0x560224fccec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:37.279 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.289+0000 7f58df02b740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560224fc83b0 0x560224f99e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:37.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.289+0000 7f58df02b740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f58d4200ce0 con 0x560224fc5ef0 2024-03-27T09:59:37.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.289+0000 7f58df02b740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f58d40ca580 con 0x560224fc83b0 2024-03-27T09:59:37.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.289+0000 7f58df02b740 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f58d4200690 con 0x560224fc7fd0 2024-03-27T09:59:37.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.289+0000 7f58d9a00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560224fc5ef0 0x560224fc3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:37.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.290+0000 7f58d9a00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560224fc5ef0 0x560224fc3ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47840/0 (socket says 172.21.15.57:47840) 2024-03-27T09:59:37.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.290+0000 7f58d9a00640 1 -- 172.21.15.57:0/3482550976 learned_addr learned my addr 172.21.15.57:0/3482550976 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T09:59:37.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.290+0000 7f58d9000640 1 --2- 172.21.15.57:0/3482550976 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x560224fc7fd0 0x560224fccec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:37.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.290+0000 7f58da400640 1 --2- 172.21.15.57:0/3482550976 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560224fc83b0 0x560224f99e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:37.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.290+0000 7f58d9a00640 1 -- 172.21.15.57:0/3482550976 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x560224fc7fd0 msgr2=0x560224fccec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T09:59:37.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.290+0000 7f58d9a00640 1 --2- 172.21.15.57:0/3482550976 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x560224fc7fd0 0x560224fccec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:37.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.290+0000 7f58d9a00640 1 -- 172.21.15.57:0/3482550976 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560224fc83b0 msgr2=0x560224f99e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T09:59:37.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.290+0000 7f58d9a00640 1 --2- 172.21.15.57:0/3482550976 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560224fc83b0 0x560224f99e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:37.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.290+0000 7f58d9a00640 1 -- 172.21.15.57:0/3482550976 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560224f9c940 con 0x560224fc5ef0 2024-03-27T09:59:37.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.290+0000 7f58d9a00640 1 --2- 172.21.15.57:0/3482550976 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560224fc5ef0 0x560224fc3ea0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f58c8059a90 tx=0x7f58c8085070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd4d60f2d0fe3534 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:37.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.290+0000 7f58c5600640 1 -- 172.21.15.57:0/3482550976 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58c8061dc0 con 0x560224fc5ef0 2024-03-27T09:59:37.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.291+0000 7f58c5600640 1 -- 172.21.15.57:0/3482550976 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58c805d590 con 0x560224fc5ef0 2024-03-27T09:59:37.282 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.291+0000 7f58c5600640 1 -- 172.21.15.57:0/3482550976 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58c80591e0 con 0x560224fc5ef0 2024-03-27T09:59:37.282 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.291+0000 7f58df02b740 1 -- 172.21.15.57:0/3482550976 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560224fc5ef0 msgr2=0x560224fc3ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:37.282 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.291+0000 7f58df02b740 1 --2- 172.21.15.57:0/3482550976 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560224fc5ef0 0x560224fc3ea0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f58c8059a90 tx=0x7f58c8085070 comp rx=0 tx=0).stop 2024-03-27T09:59:37.282 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.291+0000 7f58df02b740 1 -- 172.21.15.57:0/3482550976 shutdown_connections 2024-03-27T09:59:37.282 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.291+0000 7f58df02b740 1 --2- 172.21.15.57:0/3482550976 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560224fc83b0 0x560224f99e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:37.282 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.291+0000 7f58df02b740 1 --2- 172.21.15.57:0/3482550976 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x560224fc7fd0 0x560224fccec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:37.282 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.291+0000 7f58df02b740 1 --2- 172.21.15.57:0/3482550976 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560224fc5ef0 0x560224fc3ea0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:37.283 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.291+0000 7f58df02b740 1 -- 172.21.15.57:0/3482550976 >> 172.21.15.57:0/3482550976 conn(0x560224f9b4b0 msgr2=0x560224f96210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:37.283 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.292+0000 7f58df02b740 1 -- 172.21.15.57:0/3482550976 shutdown_connections 2024-03-27T09:59:37.283 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.292+0000 7f58df02b740 1 -- 172.21.15.57:0/3482550976 wait complete. 2024-03-27T09:59:37.283 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.293+0000 7f58df02b740 1 -- start start 2024-03-27T09:59:37.283 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.293+0000 7f58df02b740 1 Processor -- start 2024-03-27T09:59:37.284 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.294+0000 7f58df02b740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560224fc5ef0 0x560225008370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:37.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.294+0000 7f58df02b740 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x560224fc7fd0 0x560225050c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:37.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.294+0000 7f58df02b740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560224fc83b0 0x560224fe99e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:37.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.294+0000 7f58df02b740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x560224f00f40 con 0x560224fc83b0 2024-03-27T09:59:37.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.294+0000 7f58df02b740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x560224ead650 con 0x560224fc5ef0 2024-03-27T09:59:37.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.294+0000 7f58df02b740 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x560224ff9650 con 0x560224fc7fd0 2024-03-27T09:59:37.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.294+0000 7f58df02b740 10 client.0 _ll_register_callbacks cb 0x7f58c8070070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T09:59:37.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.294+0000 7f58da400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560224fc83b0 0x560224fe99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:37.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.294+0000 7f58da400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560224fc83b0 0x560224fe99e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47856/0 (socket says 172.21.15.57:47856) 2024-03-27T09:59:37.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.294+0000 7f58da400640 1 -- 172.21.15.57:0/2130024986 learned_addr learned my addr 172.21.15.57:0/2130024986 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T09:59:37.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.294+0000 7f58d9a00640 1 --2- 172.21.15.57:0/2130024986 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560224fc5ef0 0x560225008370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:37.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.294+0000 7f58d9000640 1 --2- 172.21.15.57:0/2130024986 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x560224fc7fd0 0x560225050c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:37.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.295+0000 7f58da400640 1 -- 172.21.15.57:0/2130024986 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x560224fc7fd0 msgr2=0x560225050c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T09:59:37.286 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.295+0000 7f58da400640 1 --2- 172.21.15.57:0/2130024986 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x560224fc7fd0 0x560225050c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:37.286 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.295+0000 7f58da400640 1 -- 172.21.15.57:0/2130024986 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560224fc5ef0 msgr2=0x560225008370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T09:59:37.286 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.295+0000 7f58da400640 1 --2- 172.21.15.57:0/2130024986 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560224fc5ef0 0x560225008370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:37.286 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.295+0000 7f58da400640 1 -- 172.21.15.57:0/2130024986 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560224f9a3a0 con 0x560224fc83b0 2024-03-27T09:59:37.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.295+0000 7f58da400640 1 --2- 172.21.15.57:0/2130024986 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560224fc83b0 0x560224fe99e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f58cc02c4e0 tx=0x7f58cc004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=358b164326997296 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:37.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.295+0000 7f58baa00640 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2024-03-27T09:59:37.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.295+0000 7f58baa00640 1 -- 172.21.15.57:0/2130024986 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58cc046070 con 0x560224fc83b0 2024-03-27T09:59:37.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.295+0000 7f58baa00640 1 -- 172.21.15.57:0/2130024986 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f58cc034d50 con 0x560224fc83b0 2024-03-27T09:59:37.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.295+0000 7f58df02b740 1 -- 172.21.15.57:0/2130024986 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f58c805d590 con 0x560224fc83b0 2024-03-27T09:59:37.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.295+0000 7f58baa00640 1 -- 172.21.15.57:0/2130024986 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7f58cc052050 con 0x560224fc83b0 2024-03-27T09:59:37.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.295+0000 7f58df02b740 10 client.4419 fetch_fsmap learned FSMap version 7 2024-03-27T09:59:37.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.296+0000 7f58df02b740 1 -- 172.21.15.57:0/2130024986 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x560224fe94c0 con 0x560224fc83b0 2024-03-27T09:59:37.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.296+0000 7f58baa00640 1 -- 172.21.15.57:0/2130024986 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58c805d590 con 0x560224fc83b0 2024-03-27T09:59:37.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.296+0000 7f58baa00640 1 -- 172.21.15.57:0/2130024986 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 7) ==== 3502+0+0 (secure 0 0 0) 0x7f58cc055020 con 0x560224fc83b0 2024-03-27T09:59:37.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.296+0000 7f58df02b740 10 client.4419 fetch_fsmap finished waiting for FSMap version 7 2024-03-27T09:59:37.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.296+0000 7f58df02b740 10 client.4419 resolve_mds: resolved name 'd' to daemon mds.d 2024-03-27T09:59:37.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.296+0000 7f58df02b740 20 client.4419 populate_metadata read hostname 'smithi057' 2024-03-27T09:59:37.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.296+0000 7f58df02b740 1 --2- 172.21.15.57:0/2130024986 >> [v2:172.21.15.118:6833/1823694233,v1:172.21.15.118:6835/1823694233] conn(0x560224f9f120 0x560224fdb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:37.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.296+0000 7f58df02b740 4 client.4419 mds_command: new command op to 4282 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-27T09:59:37.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.296+0000 7f58df02b740 1 -- 172.21.15.57:0/2130024986 --> [v2:172.21.15.118:6833/1823694233,v1:172.21.15.118:6835/1823694233] -- command(tid 0: {"prefix": "status"}) -- 0x560224fc5a60 con 0x560224f9f120 2024-03-27T09:59:37.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.296+0000 7f58d9a00640 1 --2- 172.21.15.57:0/2130024986 >> [v2:172.21.15.118:6833/1823694233,v1:172.21.15.118:6835/1823694233] conn(0x560224f9f120 0x560224fdb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:37.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.297+0000 7f58d9a00640 1 --2- 172.21.15.57:0/2130024986 >> [v2:172.21.15.118:6833/1823694233,v1:172.21.15.118:6835/1823694233] conn(0x560224f9f120 0x560224fdb6f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a20dffac01e39f3 server_cookie=caf57f62cb299aa5 in_seq=0 out_seq=0 2024-03-27T09:59:37.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.297+0000 7f58baa00640 10 client.4419 ms_handle_connect on v2:172.21.15.118:6833/1823694233 2024-03-27T09:59:37.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.298+0000 7f58baa00640 1 -- 172.21.15.57:0/2130024986 <== mds.0 v2:172.21.15.118:6833/1823694233 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x560224fc5a60 con 0x560224f9f120 2024-03-27T09:59:37.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.298+0000 7f58baa00640 10 client.4419 handle_command_reply: tid=0 2024-03-27T09:59:37.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.298+0000 7f58df02b740 1 client.4419 shutdown 2024-03-27T09:59:37.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.298+0000 7f58df02b740 1 -- 172.21.15.57:0/2130024986 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560224fc83b0 msgr2=0x560224fe99e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:37.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.298+0000 7f58df02b740 1 --2- 172.21.15.57:0/2130024986 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560224fc83b0 0x560224fe99e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f58cc02c4e0 tx=0x7f58cc004ab0 comp rx=0 tx=0).stop 2024-03-27T09:59:37.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.298+0000 7f58df02b740 1 -- 172.21.15.57:0/2130024986 shutdown_connections 2024-03-27T09:59:37.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.298+0000 7f58df02b740 1 --2- 172.21.15.57:0/2130024986 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x560224fc83b0 0x560224fe99e0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:37.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.298+0000 7f58df02b740 1 --2- 172.21.15.57:0/2130024986 >> [v2:172.21.15.118:6833/1823694233,v1:172.21.15.118:6835/1823694233] conn(0x560224f9f120 0x560224fdb6f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:37.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.298+0000 7f58df02b740 1 --2- 172.21.15.57:0/2130024986 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x560224fc7fd0 0x560225050c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:37.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.298+0000 7f58df02b740 1 --2- 172.21.15.57:0/2130024986 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x560224fc5ef0 0x560225008370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:37.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.298+0000 7f58df02b740 1 -- 172.21.15.57:0/2130024986 >> 172.21.15.57:0/2130024986 conn(0x560224f9b4b0 msgr2=0x560224fcaf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:37.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.298+0000 7f58baa00640 0 client.4419 ms_handle_reset on v2:172.21.15.118:6833/1823694233 2024-03-27T09:59:37.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.298+0000 7f58df02b740 1 -- 172.21.15.57:0/2130024986 shutdown_connections 2024-03-27T09:59:37.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.298+0000 7f58df02b740 1 -- 172.21.15.57:0/2130024986 wait complete. 2024-03-27T09:59:37.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.298+0000 7f58df02b740 20 client.4419 trim_cache size 0 max 16384 2024-03-27T09:59:37.291 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-03-27T09:59:37.291 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_fsid": "7ac43f86-2c16-4a97-98fb-715d3cebc75c", 2024-03-27T09:59:37.291 INFO:teuthology.orchestra.run.smithi057.stdout: "whoami": 0, 2024-03-27T09:59:37.291 INFO:teuthology.orchestra.run.smithi057.stdout: "id": 4282, 2024-03-27T09:59:37.291 INFO:teuthology.orchestra.run.smithi057.stdout: "want_state": "up:active", 2024-03-27T09:59:37.291 INFO:teuthology.orchestra.run.smithi057.stdout: "state": "up:active", 2024-03-27T09:59:37.291 INFO:teuthology.orchestra.run.smithi057.stdout: "fs_name": "cephfs", 2024-03-27T09:59:37.291 INFO:teuthology.orchestra.run.smithi057.stdout: "rank_uptime": 8.1532538250000002, 2024-03-27T09:59:37.291 INFO:teuthology.orchestra.run.smithi057.stdout: "mdsmap_epoch": 7, 2024-03-27T09:59:37.292 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_epoch": 26, 2024-03-27T09:59:37.292 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_epoch_barrier": 25, 2024-03-27T09:59:37.292 INFO:teuthology.orchestra.run.smithi057.stdout: "uptime": 13.664420873999999 2024-03-27T09:59:37.292 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-03-27T09:59:37.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.299+0000 7f58dc400640 1 -- 172.21.15.57:0/2061055908 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f58b406c560 msgr2=0x7f58b406ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:37.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.299+0000 7f58dc400640 1 --2- 172.21.15.57:0/2061055908 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f58b406c560 0x7f58b406ea20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f58d40cae90 tx=0x7f58c0008040 comp rx=0 tx=0).stop 2024-03-27T09:59:37.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.299+0000 7f58dc400640 1 -- 172.21.15.57:0/2061055908 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f58d40ceee0 msgr2=0x7f58d40cdfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:37.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.299+0000 7f58dc400640 1 --2- 172.21.15.57:0/2061055908 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f58d40ceee0 0x7f58d40cdfb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f58c800c3f0 tx=0x7f58c800c8b0 comp rx=0 tx=0).stop 2024-03-27T09:59:37.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.299+0000 7f58dc400640 1 -- 172.21.15.57:0/2061055908 shutdown_connections 2024-03-27T09:59:37.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.299+0000 7f58dc400640 1 --2- 172.21.15.57:0/2061055908 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f58d415e4a0 0x7f58d40cb480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:37.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.299+0000 7f58dc400640 1 --2- 172.21.15.57:0/2061055908 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f58b406c560 0x7f58b406ea20 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:37.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.299+0000 7f58dc400640 1 --2- 172.21.15.57:0/2061055908 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f58d40d3fe0 0x7f58d41f3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:37.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.299+0000 7f58dc400640 1 --2- 172.21.15.57:0/2061055908 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f58d40ceee0 0x7f58d40cdfb0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:37.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.299+0000 7f58dc400640 1 -- 172.21.15.57:0/2061055908 >> 172.21.15.57:0/2061055908 conn(0x7f58d408db50 msgr2=0x7f58d40b17b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:37.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.299+0000 7f58dc400640 1 -- 172.21.15.57:0/2061055908 shutdown_connections 2024-03-27T09:59:37.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.299+0000 7f58dc400640 1 -- 172.21.15.57:0/2061055908 wait complete. 2024-03-27T09:59:37.306 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-27T09:59:37.306 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-03-27T09:59:37.306 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-27T09:59:37.497 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.507+0000 7f1b51600640 1 Processor -- start 2024-03-27T09:59:37.497 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.507+0000 7f1b51600640 1 -- start start 2024-03-27T09:59:37.499 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.508+0000 7f1b51600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1b4c0b4d60 0x7f1b4c0acd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:37.499 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.508+0000 7f1b51600640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1b4c0aefd0 0x7f1b4c0b3230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:37.499 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.508+0000 7f1b51600640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b4c0ad440 con 0x7f1b4c15c0e0 2024-03-27T09:59:37.499 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.508+0000 7f1b51600640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f1b4c15d5a0 con 0x7f1b4c0aefd0 2024-03-27T09:59:37.500 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.509+0000 7f1b51600640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f1b4c15c7e0 con 0x7f1b4c0b4d60 2024-03-27T09:59:37.500 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.509+0000 7f1b4b400640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1b4c0aefd0 0x7f1b4c0b3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:37.500 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.509+0000 7f1b4b400640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1b4c0aefd0 0x7f1b4c0b3230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47866/0 (socket says 172.21.15.57:47866) 2024-03-27T09:59:37.500 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.509+0000 7f1b4b400640 1 -- 172.21.15.57:0/782980742 learned_addr learned my addr 172.21.15.57:0/782980742 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T09:59:37.500 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.509+0000 7f1b4a000640 1 --2- 172.21.15.57:0/782980742 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1b4c0b4d60 0x7f1b4c0acd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:37.500 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.509+0000 7f1b4b400640 1 -- 172.21.15.57:0/782980742 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1b4c0b4d60 msgr2=0x7f1b4c0acd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T09:59:37.500 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.509+0000 7f1b4b400640 1 --2- 172.21.15.57:0/782980742 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1b4c0b4d60 0x7f1b4c0acd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:37.500 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.509+0000 7f1b4b400640 1 -- 172.21.15.57:0/782980742 >> v1:172.21.15.118:6789/0 conn(0x7f1b4c15c0e0 legacy=0x7f1b4c0ae8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:37.500 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.509+0000 7f1b4b400640 1 -- 172.21.15.57:0/782980742 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b4c15cac0 con 0x7f1b4c0aefd0 2024-03-27T09:59:37.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.510+0000 7f1b4b400640 1 --2- 172.21.15.57:0/782980742 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b4c0aefd0 0x7f1b4c0b3230 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1b44009870 tx=0x7f1b4402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de8e0095ff5c6222 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:37.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.511+0000 7f1b49600640 1 -- 172.21.15.57:0/782980742 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b44035020 con 0x7f1b4c0aefd0 2024-03-27T09:59:37.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.511+0000 7f1b49600640 1 -- 172.21.15.57:0/782980742 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b44031640 con 0x7f1b4c0aefd0 2024-03-27T09:59:37.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.511+0000 7f1b49600640 1 -- 172.21.15.57:0/782980742 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b4402d040 con 0x7f1b4c0aefd0 2024-03-27T09:59:37.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.511+0000 7f1b51600640 1 -- 172.21.15.57:0/782980742 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b4c0aefd0 msgr2=0x7f1b4c0b3230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:37.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.511+0000 7f1b51600640 1 --2- 172.21.15.57:0/782980742 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b4c0aefd0 0x7f1b4c0b3230 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1b44009870 tx=0x7f1b4402b8f0 comp rx=0 tx=0).stop 2024-03-27T09:59:37.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.511+0000 7f1b51600640 1 -- 172.21.15.57:0/782980742 shutdown_connections 2024-03-27T09:59:37.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.511+0000 7f1b51600640 1 --2- 172.21.15.57:0/782980742 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1b4c0b4d60 0x7f1b4c0acd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:37.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.511+0000 7f1b51600640 1 --2- 172.21.15.57:0/782980742 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b4c0aefd0 0x7f1b4c0b3230 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:37.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.511+0000 7f1b51600640 1 -- 172.21.15.57:0/782980742 >> 172.21.15.57:0/782980742 conn(0x7f1b4c06bb70 msgr2=0x7f1b4c0b1980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:37.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.512+0000 7f1b51600640 1 -- 172.21.15.57:0/782980742 shutdown_connections 2024-03-27T09:59:37.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.512+0000 7f1b51600640 1 -- 172.21.15.57:0/782980742 wait complete. 2024-03-27T09:59:37.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.513+0000 7f1b51600640 1 Processor -- start 2024-03-27T09:59:37.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.513+0000 7f1b51600640 1 -- start start 2024-03-27T09:59:37.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.514+0000 7f1b51600640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b4c0aefd0 0x7f1b4c14c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:37.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.514+0000 7f1b51600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1b4c0b4d60 0x7f1b4c15a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:37.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.514+0000 7f1b51600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1b4c15c0e0 0x7f1b4c1f6c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:37.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.514+0000 7f1b51600640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f1b4c15c4c0 con 0x7f1b4c0aefd0 2024-03-27T09:59:37.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.514+0000 7f1b51600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f1b4c15d080 con 0x7f1b4c15c0e0 2024-03-27T09:59:37.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.514+0000 7f1b51600640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f1b4c0b3770 con 0x7f1b4c0b4d60 2024-03-27T09:59:37.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.515+0000 7f1b4aa00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b4c0aefd0 0x7f1b4c14c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:37.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.515+0000 7f1b4aa00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b4c0aefd0 0x7f1b4c14c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47878/0 (socket says 172.21.15.57:47878) 2024-03-27T09:59:37.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.515+0000 7f1b4aa00640 1 -- 172.21.15.57:0/2738821113 learned_addr learned my addr 172.21.15.57:0/2738821113 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T09:59:37.507 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.515+0000 7f1b4b400640 1 --2- 172.21.15.57:0/2738821113 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1b4c15c0e0 0x7f1b4c1f6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:37.507 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.515+0000 7f1b4a000640 1 --2- 172.21.15.57:0/2738821113 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1b4c0b4d60 0x7f1b4c15a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:37.507 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.515+0000 7f1b4aa00640 1 -- 172.21.15.57:0/2738821113 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1b4c0b4d60 msgr2=0x7f1b4c15a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:37.507 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.515+0000 7f1b4aa00640 1 --2- 172.21.15.57:0/2738821113 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1b4c0b4d60 0x7f1b4c15a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:37.507 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.515+0000 7f1b4aa00640 1 -- 172.21.15.57:0/2738821113 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1b4c15c0e0 msgr2=0x7f1b4c1f6c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:37.507 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.515+0000 7f1b4aa00640 1 --2- 172.21.15.57:0/2738821113 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1b4c15c0e0 0x7f1b4c1f6c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:37.507 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.515+0000 7f1b4aa00640 1 -- 172.21.15.57:0/2738821113 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b4c158690 con 0x7f1b4c0aefd0 2024-03-27T09:59:37.507 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.515+0000 7f1b4b400640 1 --2- 172.21.15.57:0/2738821113 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1b4c15c0e0 0x7f1b4c1f6c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T09:59:37.507 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.516+0000 7f1b4aa00640 1 --2- 172.21.15.57:0/2738821113 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b4c0aefd0 0x7f1b4c14c020 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c00c3c0 tx=0x7f1b3c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:37.507 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.516+0000 7f1b42a00640 1 -- 172.21.15.57:0/2738821113 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b3c0052d0 con 0x7f1b4c0aefd0 2024-03-27T09:59:37.507 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.516+0000 7f1b42a00640 1 -- 172.21.15.57:0/2738821113 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b3c005490 con 0x7f1b4c0aefd0 2024-03-27T09:59:37.507 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.516+0000 7f1b51600640 1 -- 172.21.15.57:0/2738821113 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b4c158970 con 0x7f1b4c0aefd0 2024-03-27T09:59:37.507 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.516+0000 7f1b42a00640 1 -- 172.21.15.57:0/2738821113 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b3c007260 con 0x7f1b4c0aefd0 2024-03-27T09:59:37.507 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.516+0000 7f1b51600640 1 -- 172.21.15.57:0/2738821113 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b4c158f30 con 0x7f1b4c0aefd0 2024-03-27T09:59:37.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.517+0000 7f1b51600640 1 -- 172.21.15.57:0/2738821113 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b4c068540 con 0x7f1b4c0aefd0 2024-03-27T09:59:37.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.518+0000 7f1b42a00640 1 -- 172.21.15.57:0/2738821113 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f1b3c007400 con 0x7f1b4c0aefd0 2024-03-27T09:59:37.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.519+0000 7f1b42a00640 1 --2- 172.21.15.57:0/2738821113 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f1b2c06c530 0x7f1b2c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:37.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.519+0000 7f1b42a00640 1 -- 172.21.15.57:0/2738821113 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f1b3c08afc0 con 0x7f1b4c0aefd0 2024-03-27T09:59:37.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.519+0000 7f1b4a000640 1 --2- 172.21.15.57:0/2738821113 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f1b2c06c530 0x7f1b2c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:37.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.520+0000 7f1b4a000640 1 --2- 172.21.15.57:0/2738821113 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f1b2c06c530 0x7f1b2c06e9f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c0ad250 tx=0x7f1b38008440 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:37.514 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.524+0000 7f1b42a00640 1 -- 172.21.15.57:0/2738821113 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f1b3c059200 con 0x7f1b4c0aefd0 2024-03-27T09:59:37.758 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.768+0000 7f1b51600640 1 -- 172.21.15.57:0/2738821113 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f1b4c156b80 con 0x7f1b4c0aefd0 2024-03-27T09:59:37.758 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.769+0000 7f1b42a00640 1 -- 172.21.15.57:0/2738821113 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+88 (secure 0 0 0) 0x7f1b3c058b00 con 0x7f1b4c0aefd0 2024-03-27T09:59:37.759 INFO:teuthology.orchestra.run.smithi057.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-03-27T09:59:37.762 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.771+0000 7f1b51600640 1 -- 172.21.15.57:0/2738821113 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f1b2c06c530 msgr2=0x7f1b2c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:37.762 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.771+0000 7f1b51600640 1 --2- 172.21.15.57:0/2738821113 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f1b2c06c530 0x7f1b2c06e9f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c0ad250 tx=0x7f1b38008440 comp rx=0 tx=0).stop 2024-03-27T09:59:37.762 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.771+0000 7f1b51600640 1 -- 172.21.15.57:0/2738821113 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b4c0aefd0 msgr2=0x7f1b4c14c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:37.762 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.771+0000 7f1b51600640 1 --2- 172.21.15.57:0/2738821113 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b4c0aefd0 0x7f1b4c14c020 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1b3c00c3c0 tx=0x7f1b3c00c880 comp rx=0 tx=0).stop 2024-03-27T09:59:37.762 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.771+0000 7f1b51600640 1 -- 172.21.15.57:0/2738821113 shutdown_connections 2024-03-27T09:59:37.762 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.771+0000 7f1b51600640 1 --2- 172.21.15.57:0/2738821113 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f1b2c06c530 0x7f1b2c06e9f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:37.762 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.771+0000 7f1b51600640 1 --2- 172.21.15.57:0/2738821113 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1b4c15c0e0 0x7f1b4c1f6c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:37.762 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.771+0000 7f1b51600640 1 --2- 172.21.15.57:0/2738821113 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1b4c0b4d60 0x7f1b4c15a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:37.762 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.771+0000 7f1b51600640 1 --2- 172.21.15.57:0/2738821113 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1b4c0aefd0 0x7f1b4c14c020 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:37.762 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.771+0000 7f1b51600640 1 -- 172.21.15.57:0/2738821113 >> 172.21.15.57:0/2738821113 conn(0x7f1b4c06bb70 msgr2=0x7f1b4c15ed30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:37.762 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.772+0000 7f1b51600640 1 -- 172.21.15.57:0/2738821113 shutdown_connections 2024-03-27T09:59:37.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37.772+0000 7f1b51600640 1 -- 172.21.15.57:0/2738821113 wait complete. 2024-03-27T09:59:37.781 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-03-27T09:59:37.781 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-27T09:59:37.781 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi057.front.sepia.ceph.com 2024-03-27T09:59:37.781 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-03-27T09:59:37.781 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-03-27T09:59:37.781 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-03-27T09:59:37.781 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-27T09:59:37.782 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-27T09:59:37.782 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-03-27T09:59:37.782 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T09:59:37.782 DEBUG:teuthology.orchestra.run.smithi057:> ip addr 2024-03-27T09:59:37.833 INFO:teuthology.orchestra.run.smithi057.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-27T09:59:37.833 INFO:teuthology.orchestra.run.smithi057.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-27T09:59:37.833 INFO:teuthology.orchestra.run.smithi057.stdout: inet 127.0.0.1/8 scope host lo 2024-03-27T09:59:37.833 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2024-03-27T09:59:37.834 INFO:teuthology.orchestra.run.smithi057.stdout: inet6 ::1/128 scope host 2024-03-27T09:59:37.834 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2024-03-27T09:59:37.834 INFO:teuthology.orchestra.run.smithi057.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-27T09:59:37.834 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 0c:c4:7a:6b:ff:86 brd ff:ff:ff:ff:ff:ff 2024-03-27T09:59:37.834 INFO:teuthology.orchestra.run.smithi057.stdout: altname enp7s0f0 2024-03-27T09:59:37.834 INFO:teuthology.orchestra.run.smithi057.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-27T09:59:37.834 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 0c:c4:7a:6b:ff:87 brd ff:ff:ff:ff:ff:ff 2024-03-27T09:59:37.834 INFO:teuthology.orchestra.run.smithi057.stdout: altname enp7s0f1 2024-03-27T09:59:37.834 INFO:teuthology.orchestra.run.smithi057.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-27T09:59:37.834 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 0c:c4:7a:bd:15:62 brd ff:ff:ff:ff:ff:ff 2024-03-27T09:59:37.834 INFO:teuthology.orchestra.run.smithi057.stdout: altname enp1s0f0 2024-03-27T09:59:37.834 INFO:teuthology.orchestra.run.smithi057.stdout: inet 172.21.15.57/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-03-27T09:59:37.834 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft 42550sec preferred_lft 42550sec 2024-03-27T09:59:37.834 INFO:teuthology.orchestra.run.smithi057.stdout: inet6 fe80::ec4:7aff:febd:1562/64 scope link noprefixroute 2024-03-27T09:59:37.835 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2024-03-27T09:59:37.835 INFO:teuthology.orchestra.run.smithi057.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-27T09:59:37.835 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 0c:c4:7a:bd:15:63 brd ff:ff:ff:ff:ff:ff 2024-03-27T09:59:37.835 INFO:teuthology.orchestra.run.smithi057.stdout: altname enp1s0f1 2024-03-27T09:59:37.836 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-03-27T09:59:37.836 DEBUG:teuthology.orchestra.run.smithi057:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-27T09:59:37.836 DEBUG:teuthology.orchestra.run.smithi057:> set -e 2024-03-27T09:59:37.836 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip link add name ceph-brx type bridge 2024-03-27T09:59:37.836 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip addr flush dev ceph-brx 2024-03-27T09:59:37.837 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip link set ceph-brx up 2024-03-27T09:59:37.837 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-03-27T09:59:37.837 DEBUG:teuthology.orchestra.run.smithi057:> ') 2024-03-27T09:59:37.944 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-27T09:59:38.353 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-27T09:59:38.363 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T09:59:38.363 DEBUG:teuthology.orchestra.run.smithi057:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-27T09:59:38.442 INFO:teuthology.orchestra.run.smithi057.stdout:1 2024-03-27T09:59:38.446 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T09:59:38.446 DEBUG:teuthology.orchestra.run.smithi057:> route 2024-03-27T09:59:38.507 INFO:teuthology.orchestra.run.smithi057.stdout:Kernel IP routing table 2024-03-27T09:59:38.507 INFO:teuthology.orchestra.run.smithi057.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-27T09:59:38.507 INFO:teuthology.orchestra.run.smithi057.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-03-27T09:59:38.507 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-03-27T09:59:38.507 INFO:teuthology.orchestra.run.smithi057.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-27T09:59:38.508 DEBUG:teuthology.orchestra.run.smithi057:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-27T09:59:38.508 DEBUG:teuthology.orchestra.run.smithi057:> set -e 2024-03-27T09:59:38.508 DEBUG:teuthology.orchestra.run.smithi057:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-03-27T09:59:38.508 DEBUG:teuthology.orchestra.run.smithi057:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-03-27T09:59:38.508 DEBUG:teuthology.orchestra.run.smithi057:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-03-27T09:59:38.508 DEBUG:teuthology.orchestra.run.smithi057:> ') 2024-03-27T09:59:38.619 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:38 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-27T09:59:39.268 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-27T09:59:39.280 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T09:59:39.280 DEBUG:teuthology.orchestra.run.smithi057:> ip netns list 2024-03-27T09:59:39.331 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T09:59:39.331 DEBUG:teuthology.orchestra.run.smithi057:> ip netns list-id 2024-03-27T09:59:39.378 DEBUG:teuthology.orchestra.run.smithi057:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-27T09:59:39.378 DEBUG:teuthology.orchestra.run.smithi057:> set -e 2024-03-27T09:59:39.379 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-03-27T09:59:39.379 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-03-27T09:59:39.379 DEBUG:teuthology.orchestra.run.smithi057:> ') 2024-03-27T09:59:39.524 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-27T09:59:39.616 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-27T09:59:39.625 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-03-27T09:59:39.625 DEBUG:teuthology.orchestra.run.smithi057:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-27T09:59:39.625 DEBUG:teuthology.orchestra.run.smithi057:> set -e 2024-03-27T09:59:39.625 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-03-27T09:59:39.625 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-03-27T09:59:39.626 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-03-27T09:59:39.626 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-03-27T09:59:39.626 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-03-27T09:59:39.626 DEBUG:teuthology.orchestra.run.smithi057:> ') 2024-03-27T09:59:39.726 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-27T09:59:39.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-27T09:59:39.957 DEBUG:teuthology.orchestra.run.smithi057:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-27T09:59:39.957 DEBUG:teuthology.orchestra.run.smithi057:> set -e 2024-03-27T09:59:39.957 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip link set brx.0 up 2024-03-27T09:59:39.957 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip link set dev brx.0 master ceph-brx 2024-03-27T09:59:39.957 DEBUG:teuthology.orchestra.run.smithi057:> ') 2024-03-27T09:59:40.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-27T09:59:40.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-27T09:59:40.182 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-03-27T09:59:40.183 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-27T09:59:40.183 DEBUG:teuthology.orchestra.run.smithi057:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-03-27T09:59:40.229 INFO:teuthology.orchestra.run.smithi057.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-03-27T09:59:40.230 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-27T09:59:40.230 DEBUG:teuthology.orchestra.run.smithi057:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-03-27T09:59:40.316 DEBUG:teuthology.orchestra.run.smithi057:> sudo modprobe fuse 2024-03-27T09:59:40.446 DEBUG:teuthology.orchestra.run.smithi057:> cat /proc/self/mounts | awk '{print $2}' 2024-03-27T09:59:40.504 INFO:teuthology.orchestra.run.smithi057.stdout:/proc 2024-03-27T09:59:40.504 INFO:teuthology.orchestra.run.smithi057.stdout:/sys 2024-03-27T09:59:40.504 INFO:teuthology.orchestra.run.smithi057.stdout:/dev 2024-03-27T09:59:40.504 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/kernel/security 2024-03-27T09:59:40.504 INFO:teuthology.orchestra.run.smithi057.stdout:/dev/shm 2024-03-27T09:59:40.504 INFO:teuthology.orchestra.run.smithi057.stdout:/dev/pts 2024-03-27T09:59:40.505 INFO:teuthology.orchestra.run.smithi057.stdout:/run 2024-03-27T09:59:40.505 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/cgroup 2024-03-27T09:59:40.505 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/pstore 2024-03-27T09:59:40.505 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/bpf 2024-03-27T09:59:40.505 INFO:teuthology.orchestra.run.smithi057.stdout:/ 2024-03-27T09:59:40.505 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/selinux 2024-03-27T09:59:40.505 INFO:teuthology.orchestra.run.smithi057.stdout:/proc/sys/fs/binfmt_misc 2024-03-27T09:59:40.505 INFO:teuthology.orchestra.run.smithi057.stdout:/dev/hugepages 2024-03-27T09:59:40.505 INFO:teuthology.orchestra.run.smithi057.stdout:/dev/mqueue 2024-03-27T09:59:40.505 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/kernel/debug 2024-03-27T09:59:40.505 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/kernel/tracing 2024-03-27T09:59:40.505 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/fuse/connections 2024-03-27T09:59:40.505 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/kernel/config 2024-03-27T09:59:40.505 INFO:teuthology.orchestra.run.smithi057.stdout:/run/credentials/systemd-sysctl.service 2024-03-27T09:59:40.506 INFO:teuthology.orchestra.run.smithi057.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-27T09:59:40.506 INFO:teuthology.orchestra.run.smithi057.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-27T09:59:40.506 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/nfs/rpc_pipefs 2024-03-27T09:59:40.506 INFO:teuthology.orchestra.run.smithi057.stdout:/run/user/1000 2024-03-27T09:59:40.506 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/ceph 2024-03-27T09:59:40.506 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/ceph/osd/ceph-0 2024-03-27T09:59:40.506 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/ceph/osd/ceph-1 2024-03-27T09:59:40.506 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/ceph/osd/ceph-2 2024-03-27T09:59:40.506 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/ceph/osd/ceph-3 2024-03-27T09:59:40.506 INFO:teuthology.orchestra.run.smithi057.stdout:/run/netns 2024-03-27T09:59:40.506 INFO:teuthology.orchestra.run.smithi057.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-03-27T09:59:40.506 INFO:teuthology.orchestra.run.smithi057.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-03-27T09:59:40.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T09:59:40.507 DEBUG:teuthology.orchestra.run.smithi057:> ls /sys/fs/fuse/connections 2024-03-27T09:59:40.562 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-03-27T09:59:40.562 DEBUG:teuthology.orchestra.run.smithi057:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-03-27T09:59:40.567 DEBUG:teuthology.orchestra.run.smithi057:> sudo modprobe fuse 2024-03-27T09:59:40.643 DEBUG:teuthology.orchestra.run.smithi057:> cat /proc/self/mounts | awk '{print $2}' 2024-03-27T09:59:40.683 INFO:teuthology.orchestra.run.smithi057.stdout:/proc 2024-03-27T09:59:40.683 INFO:teuthology.orchestra.run.smithi057.stdout:/sys 2024-03-27T09:59:40.684 INFO:teuthology.orchestra.run.smithi057.stdout:/dev 2024-03-27T09:59:40.684 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/kernel/security 2024-03-27T09:59:40.684 INFO:teuthology.orchestra.run.smithi057.stdout:/dev/shm 2024-03-27T09:59:40.684 INFO:teuthology.orchestra.run.smithi057.stdout:/dev/pts 2024-03-27T09:59:40.684 INFO:teuthology.orchestra.run.smithi057.stdout:/run 2024-03-27T09:59:40.684 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/cgroup 2024-03-27T09:59:40.684 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/pstore 2024-03-27T09:59:40.684 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/bpf 2024-03-27T09:59:40.684 INFO:teuthology.orchestra.run.smithi057.stdout:/ 2024-03-27T09:59:40.684 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/selinux 2024-03-27T09:59:40.684 INFO:teuthology.orchestra.run.smithi057.stdout:/proc/sys/fs/binfmt_misc 2024-03-27T09:59:40.684 INFO:teuthology.orchestra.run.smithi057.stdout:/dev/hugepages 2024-03-27T09:59:40.684 INFO:teuthology.orchestra.run.smithi057.stdout:/dev/mqueue 2024-03-27T09:59:40.684 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/kernel/debug 2024-03-27T09:59:40.684 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/kernel/tracing 2024-03-27T09:59:40.684 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/fuse/connections 2024-03-27T09:59:40.685 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/kernel/config 2024-03-27T09:59:40.685 INFO:teuthology.orchestra.run.smithi057.stdout:/run/credentials/systemd-sysctl.service 2024-03-27T09:59:40.685 INFO:teuthology.orchestra.run.smithi057.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-27T09:59:40.685 INFO:teuthology.orchestra.run.smithi057.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-27T09:59:40.685 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/nfs/rpc_pipefs 2024-03-27T09:59:40.685 INFO:teuthology.orchestra.run.smithi057.stdout:/run/user/1000 2024-03-27T09:59:40.685 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/ceph 2024-03-27T09:59:40.685 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/ceph/osd/ceph-0 2024-03-27T09:59:40.685 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/ceph/osd/ceph-1 2024-03-27T09:59:40.685 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/ceph/osd/ceph-2 2024-03-27T09:59:40.685 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/ceph/osd/ceph-3 2024-03-27T09:59:40.685 INFO:teuthology.orchestra.run.smithi057.stdout:/run/netns 2024-03-27T09:59:40.685 INFO:teuthology.orchestra.run.smithi057.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-03-27T09:59:40.685 INFO:teuthology.orchestra.run.smithi057.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-03-27T09:59:40.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T09:59:40.686 DEBUG:teuthology.orchestra.run.smithi057:> ls /sys/fs/fuse/connections 2024-03-27T09:59:40.759 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi057.stderr:2024-03-27T09:59:40.770+0000 7ff0f5c3a480 -1 init, newargv = 0x55d80b720870 newargc=15 2024-03-27T09:59:40.759 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi057.stderr:ceph-fuse[43889]: starting ceph client 2024-03-27T09:59:40.774 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi057.stderr:ceph-fuse[43889]: starting fuse 2024-03-27T09:59:40.775 INFO:teuthology.orchestra.run.smithi057.stdout:42 2024-03-27T09:59:40.775 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2024-03-27T09:59:40.775 DEBUG:teuthology.orchestra.run.smithi057:> sudo stdin-killer -- python3 -c ' 2024-03-27T09:59:40.775 DEBUG:teuthology.orchestra.run.smithi057:> import glob 2024-03-27T09:59:40.775 DEBUG:teuthology.orchestra.run.smithi057:> import re 2024-03-27T09:59:40.775 DEBUG:teuthology.orchestra.run.smithi057:> import os 2024-03-27T09:59:40.776 DEBUG:teuthology.orchestra.run.smithi057:> import subprocess 2024-03-27T09:59:40.776 DEBUG:teuthology.orchestra.run.smithi057:> 2024-03-27T09:59:40.776 DEBUG:teuthology.orchestra.run.smithi057:> def _find_admin_socket(client_name): 2024-03-27T09:59:40.776 DEBUG:teuthology.orchestra.run.smithi057:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-03-27T09:59:40.776 DEBUG:teuthology.orchestra.run.smithi057:> files = glob.glob(asok_path) 2024-03-27T09:59:40.776 DEBUG:teuthology.orchestra.run.smithi057:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-03-27T09:59:40.776 DEBUG:teuthology.orchestra.run.smithi057:> 2024-03-27T09:59:40.776 DEBUG:teuthology.orchestra.run.smithi057:> # Given a non-glob path, it better be there 2024-03-27T09:59:40.776 DEBUG:teuthology.orchestra.run.smithi057:> if "*" not in asok_path: 2024-03-27T09:59:40.776 DEBUG:teuthology.orchestra.run.smithi057:> assert(len(files) == 1) 2024-03-27T09:59:40.776 DEBUG:teuthology.orchestra.run.smithi057:> return files[0] 2024-03-27T09:59:40.776 DEBUG:teuthology.orchestra.run.smithi057:> 2024-03-27T09:59:40.776 DEBUG:teuthology.orchestra.run.smithi057:> for f in files: 2024-03-27T09:59:40.776 DEBUG:teuthology.orchestra.run.smithi057:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-03-27T09:59:40.776 DEBUG:teuthology.orchestra.run.smithi057:> if os.path.exists("/proc/{0}".format(pid)): 2024-03-27T09:59:40.776 DEBUG:teuthology.orchestra.run.smithi057:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-03-27T09:59:40.776 DEBUG:teuthology.orchestra.run.smithi057:> contents = proc_f.read() 2024-03-27T09:59:40.777 DEBUG:teuthology.orchestra.run.smithi057:> if mountpoint in contents: 2024-03-27T09:59:40.777 DEBUG:teuthology.orchestra.run.smithi057:> return f 2024-03-27T09:59:40.777 DEBUG:teuthology.orchestra.run.smithi057:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-03-27T09:59:40.777 DEBUG:teuthology.orchestra.run.smithi057:> 2024-03-27T09:59:40.777 DEBUG:teuthology.orchestra.run.smithi057:> print(_find_admin_socket("client.admin")) 2024-03-27T09:59:40.777 DEBUG:teuthology.orchestra.run.smithi057:> ' 2024-03-27T09:59:40.978 INFO:teuthology.orchestra.run.smithi057.stdout:/var/run/ceph/ceph-client.admin.43889.asok 2024-03-27T09:59:40.983 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-27T09:59:40.997 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.43889.asok 2024-03-27T09:59:40.997 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T09:59:40.997 DEBUG:teuthology.orchestra.run.smithi057:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.43889.asok status 2024-03-27T09:59:41.245 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-03-27T09:59:41.246 INFO:teuthology.orchestra.run.smithi057.stdout: "metadata": { 2024-03-27T09:59:41.246 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph_sha1": "155268c4e432a12433aa833f174f9fe3b1016ae0", 2024-03-27T09:59:41.246 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph_version": "ceph version 19.0.0-2478-g155268c4 (155268c4e432a12433aa833f174f9fe3b1016ae0) squid (dev)", 2024-03-27T09:59:41.246 INFO:teuthology.orchestra.run.smithi057.stdout: "entity_id": "admin", 2024-03-27T09:59:41.246 INFO:teuthology.orchestra.run.smithi057.stdout: "hostname": "smithi057", 2024-03-27T09:59:41.246 INFO:teuthology.orchestra.run.smithi057.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-03-27T09:59:41.246 INFO:teuthology.orchestra.run.smithi057.stdout: "pid": "43889", 2024-03-27T09:59:41.246 INFO:teuthology.orchestra.run.smithi057.stdout: "root": "/" 2024-03-27T09:59:41.246 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-03-27T09:59:41.246 INFO:teuthology.orchestra.run.smithi057.stdout: "dentry_count": 0, 2024-03-27T09:59:41.246 INFO:teuthology.orchestra.run.smithi057.stdout: "dentry_pinned_count": 0, 2024-03-27T09:59:41.246 INFO:teuthology.orchestra.run.smithi057.stdout: "id": 4431, 2024-03-27T09:59:41.246 INFO:teuthology.orchestra.run.smithi057.stdout: "inst": { 2024-03-27T09:59:41.247 INFO:teuthology.orchestra.run.smithi057.stdout: "name": { 2024-03-27T09:59:41.247 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "client", 2024-03-27T09:59:41.247 INFO:teuthology.orchestra.run.smithi057.stdout: "num": 4431 2024-03-27T09:59:41.247 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-03-27T09:59:41.247 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": { 2024-03-27T09:59:41.247 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-03-27T09:59:41.247 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:0", 2024-03-27T09:59:41.247 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 2233838715 2024-03-27T09:59:41.247 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-03-27T09:59:41.247 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-03-27T09:59:41.247 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": { 2024-03-27T09:59:41.247 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-03-27T09:59:41.247 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "172.21.15.57:0", 2024-03-27T09:59:41.247 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 2233838715 2024-03-27T09:59:41.247 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-03-27T09:59:41.247 INFO:teuthology.orchestra.run.smithi057.stdout: "inst_str": "client.4431 172.21.15.57:0/2233838715", 2024-03-27T09:59:41.248 INFO:teuthology.orchestra.run.smithi057.stdout: "addr_str": "172.21.15.57:0/2233838715", 2024-03-27T09:59:41.248 INFO:teuthology.orchestra.run.smithi057.stdout: "inode_count": 1, 2024-03-27T09:59:41.248 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_epoch": 7, 2024-03-27T09:59:41.248 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_epoch": 26, 2024-03-27T09:59:41.248 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_epoch_barrier": 0, 2024-03-27T09:59:41.248 INFO:teuthology.orchestra.run.smithi057.stdout: "blocklisted": false, 2024-03-27T09:59:41.248 INFO:teuthology.orchestra.run.smithi057.stdout: "fs_name": "cephfs" 2024-03-27T09:59:41.248 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-03-27T09:59:41.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T09:59:41.263 DEBUG:teuthology.orchestra.run.smithi057:> stat --file-system '--printf=%T 2024-03-27T09:59:41.263 DEBUG:teuthology.orchestra.run.smithi057:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-03-27T09:59:41.315 INFO:teuthology.orchestra.run.smithi057.stdout:fuseblk 2024-03-27T09:59:41.315 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-03-27T09:59:41.315 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T09:59:41.316 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-03-27T09:59:41.414 DEBUG:teuthology.orchestra.run.smithi057:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-03-27T09:59:41.533 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:41 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-27T09:59:41.571 INFO:teuthology.orchestra.run.smithi057.stdout:# file: . 2024-03-27T09:59:41.572 INFO:teuthology.orchestra.run.smithi057.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-03-27T09:59:41.572 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T09:59:41.572 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-27T09:59:41.582 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-03-27T09:59:41.582 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-27T09:59:41.638 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-27T09:59:41.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:41.872+0000 7f7ad7200640 1 Processor -- start 2024-03-27T09:59:41.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:41.872+0000 7f7ad7200640 1 -- start start 2024-03-27T09:59:41.863 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:41.874+0000 7f7ad7200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7ad8158530 0x7f7ad80ad8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:41.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:41.874+0000 7f7ad7200640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7ad80adde0 0x7f7ad8071b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:41.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:41.874+0000 7f7ad7200640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f7ad80720d0 0x7f7ad806e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:41.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:41.874+0000 7f7ad7200640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f7ad806e210 con 0x7f7ad80adde0 2024-03-27T09:59:41.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:41.874+0000 7f7ad7200640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f7ad806e4f0 con 0x7f7ad80720d0 2024-03-27T09:59:41.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:41.874+0000 7f7ad7200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f7ad80710b0 con 0x7f7ad8158530 2024-03-27T09:59:41.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:41.874+0000 7f7ad5400640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7ad80adde0 0x7f7ad8071b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:41.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:41.874+0000 7f7ad5400640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7ad80adde0 0x7f7ad8071b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46278/0 (socket says 172.21.15.57:46278) 2024-03-27T09:59:41.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:41.874+0000 7f7ad5400640 1 -- 172.21.15.57:0/1367245184 learned_addr learned my addr 172.21.15.57:0/1367245184 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T09:59:41.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:41.874+0000 7f7ad6800640 1 --2- 172.21.15.57:0/1367245184 >> v2:172.21.15.118:3300/0 conn(0x7f7ad80720d0 0x7f7ad806e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:41.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:41.874+0000 7f7ad5e00640 1 --2- 172.21.15.57:0/1367245184 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7ad8158530 0x7f7ad80ad8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:41.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:41.875+0000 7f7ad5400640 1 -- 172.21.15.57:0/1367245184 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7ad8158530 msgr2=0x7f7ad80ad8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T09:59:41.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:41.875+0000 7f7ad5400640 1 --2- 172.21.15.57:0/1367245184 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7ad8158530 0x7f7ad80ad8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:41.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:41.875+0000 7f7ad5400640 1 -- 172.21.15.57:0/1367245184 >> v2:172.21.15.118:3300/0 conn(0x7f7ad80720d0 msgr2=0x7f7ad806e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T09:59:41.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:41.875+0000 7f7ad5400640 1 --2- 172.21.15.57:0/1367245184 >> v2:172.21.15.118:3300/0 conn(0x7f7ad80720d0 0x7f7ad806e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:41.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:41.875+0000 7f7ad5400640 1 -- 172.21.15.57:0/1367245184 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ad8071390 con 0x7f7ad80adde0 2024-03-27T09:59:41.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:41.875+0000 7f7ad5e00640 1 --2- 172.21.15.57:0/1367245184 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7ad8158530 0x7f7ad80ad8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T09:59:41.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:41.876+0000 7f7ad5400640 1 --2- 172.21.15.57:0/1367245184 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ad80adde0 0x7f7ad8071b90 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7ad815c1a0 tx=0x7f7ac402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf0c1bea6bcbe271 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:41.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:41.876+0000 7f7ad4a00640 1 -- 172.21.15.57:0/1367245184 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ac4035020 con 0x7f7ad80adde0 2024-03-27T09:59:41.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:41.876+0000 7f7ad4a00640 1 -- 172.21.15.57:0/1367245184 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ac4031870 con 0x7f7ad80adde0 2024-03-27T09:59:41.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:41.876+0000 7f7ad4a00640 1 -- 172.21.15.57:0/1367245184 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ac4031c40 con 0x7f7ad80adde0 2024-03-27T09:59:41.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:41.877+0000 7f7ad7200640 1 -- 172.21.15.57:0/1367245184 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ad80adde0 msgr2=0x7f7ad8071b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:41.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:41.877+0000 7f7ad7200640 1 --2- 172.21.15.57:0/1367245184 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ad80adde0 0x7f7ad8071b90 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7ad815c1a0 tx=0x7f7ac402b910 comp rx=0 tx=0).stop 2024-03-27T09:59:41.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:41.877+0000 7f7ad7200640 1 -- 172.21.15.57:0/1367245184 shutdown_connections 2024-03-27T09:59:41.867 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:41.877+0000 7f7ad7200640 1 --2- 172.21.15.57:0/1367245184 >> v2:172.21.15.118:3300/0 conn(0x7f7ad80720d0 0x7f7ad806e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:41.867 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:41.877+0000 7f7ad7200640 1 --2- 172.21.15.57:0/1367245184 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ad80adde0 0x7f7ad8071b90 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:41.867 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:41.877+0000 7f7ad7200640 1 --2- 172.21.15.57:0/1367245184 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7ad8158530 0x7f7ad80ad8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:41.867 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:41.877+0000 7f7ad7200640 1 -- 172.21.15.57:0/1367245184 >> 172.21.15.57:0/1367245184 conn(0x7f7ad80b1770 msgr2=0x7f7ad80b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:41.867 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:41.877+0000 7f7ad7200640 1 -- 172.21.15.57:0/1367245184 shutdown_connections 2024-03-27T09:59:41.867 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:41.877+0000 7f7ad7200640 1 -- 172.21.15.57:0/1367245184 wait complete. 2024-03-27T09:59:41.868 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:41.879+0000 7f7ad7200640 1 Processor -- start 2024-03-27T09:59:41.868 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:41.879+0000 7f7ad7200640 1 -- start start 2024-03-27T09:59:41.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:41.880+0000 7f7ad7200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7ad80720d0 0x7f7ad81484c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:41.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:41.880+0000 7f7ad7200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ad80adde0 0x7f7ad80b3970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:41.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:41.880+0000 7f7ad7200640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ad8158530 0x7f7ad80b3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:41.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:41.880+0000 7f7ad7200640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f7ad8158a90 con 0x7f7ad8158530 2024-03-27T09:59:41.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:41.880+0000 7f7ad7200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f7ad8158910 con 0x7f7ad80adde0 2024-03-27T09:59:41.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:41.880+0000 7f7ad7200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f7ad806eeb0 con 0x7f7ad80720d0 2024-03-27T09:59:41.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:41.880+0000 7f7ad6800640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ad8158530 0x7f7ad80b3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:41.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:41.880+0000 7f7ad6800640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ad8158530 0x7f7ad80b3eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46286/0 (socket says 172.21.15.57:46286) 2024-03-27T09:59:41.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:41.880+0000 7f7ad6800640 1 -- 172.21.15.57:0/568475105 learned_addr learned my addr 172.21.15.57:0/568475105 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T09:59:41.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:41.880+0000 7f7ad5e00640 1 --2- 172.21.15.57:0/568475105 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7ad80720d0 0x7f7ad81484c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:41.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:41.881+0000 7f7ad5400640 1 --2- 172.21.15.57:0/568475105 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ad80adde0 0x7f7ad80b3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:41.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:41.881+0000 7f7ad6800640 1 -- 172.21.15.57:0/568475105 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7ad80720d0 msgr2=0x7f7ad81484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:41.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:41.881+0000 7f7ad6800640 1 --2- 172.21.15.57:0/568475105 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7ad80720d0 0x7f7ad81484c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:41.871 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:41.881+0000 7f7ad6800640 1 -- 172.21.15.57:0/568475105 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ad80adde0 msgr2=0x7f7ad80b3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:41.871 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:41.881+0000 7f7ad6800640 1 --2- 172.21.15.57:0/568475105 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ad80adde0 0x7f7ad80b3970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:41.871 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:41.881+0000 7f7ad6800640 1 -- 172.21.15.57:0/568475105 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ad80cd210 con 0x7f7ad8158530 2024-03-27T09:59:41.871 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:41.881+0000 7f7ad6800640 1 --2- 172.21.15.57:0/568475105 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ad8158530 0x7f7ad80b3eb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7ad0007d10 tx=0x7f7ad000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:41.872 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:41.881+0000 7f7ace000640 1 -- 172.21.15.57:0/568475105 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ad0014420 con 0x7f7ad8158530 2024-03-27T09:59:41.872 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:41.881+0000 7f7ace000640 1 -- 172.21.15.57:0/568475105 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ad0019070 con 0x7f7ad8158530 2024-03-27T09:59:41.872 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:41.881+0000 7f7ace000640 1 -- 172.21.15.57:0/568475105 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ad0014820 con 0x7f7ad8158530 2024-03-27T09:59:41.872 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:41.881+0000 7f7ad7200640 1 -- 172.21.15.57:0/568475105 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ad80cd4f0 con 0x7f7ad8158530 2024-03-27T09:59:41.872 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:41.882+0000 7f7ad7200640 1 -- 172.21.15.57:0/568475105 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ad80cdab0 con 0x7f7ad8158530 2024-03-27T09:59:41.872 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:41.883+0000 7f7ad7200640 1 -- 172.21.15.57:0/568475105 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ad8068540 con 0x7f7ad8158530 2024-03-27T09:59:41.873 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:41.884+0000 7f7ace000640 1 -- 172.21.15.57:0/568475105 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f7ad00149c0 con 0x7f7ad8158530 2024-03-27T09:59:41.874 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:41.885+0000 7f7ace000640 1 --2- 172.21.15.57:0/568475105 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f7ab806c530 0x7f7ab806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:41.874 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:41.885+0000 7f7ace000640 1 -- 172.21.15.57:0/568475105 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f7ad008c2d0 con 0x7f7ad8158530 2024-03-27T09:59:41.875 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:41.886+0000 7f7ad5e00640 1 --2- 172.21.15.57:0/568475105 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f7ab806c530 0x7f7ab806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:41.875 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:41.886+0000 7f7ad5e00640 1 --2- 172.21.15.57:0/568475105 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f7ab806c530 0x7f7ab806e9f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7ac800a950 tx=0x7f7ac8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:41.879 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:41.890+0000 7f7ace000640 1 -- 172.21.15.57:0/568475105 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f7ad005a510 con 0x7f7ad8158530 2024-03-27T09:59:42.083 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.094+0000 7f7ad7200640 1 -- 172.21.15.57:0/568475105 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7ad80b2f60 con 0x7f7ad8158530 2024-03-27T09:59:42.086 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.097+0000 7f7ace000640 1 -- 172.21.15.57:0/568475105 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18502 (secure 0 0 0) 0x7f7ad0059e10 con 0x7f7ad8158530 2024-03-27T09:59:42.087 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T09:59:42.087 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":26,"fsid":"7ac43f86-2c16-4a97-98fb-715d3cebc75c","created":"2024-03-27T09:59:04.033417+0000","modified":"2024-03-27T09:59:35.208743+0000","last_up_change":"2024-03-27T09:59:16.969624+0000","last_in_change":"2024-03-27T09:59:07.421690+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-27T09:59:17.253008+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-27T09:59:26.690365+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-27T09:59:27.559059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-27T09:59:31.187596+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"47b44362-7302-4f2a-b735-582c6c3850cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6801","nonce":2020036298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6803","nonce":2020036298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6807","nonce":2020036298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6805","nonce":2020036298}]},"public_addr":"172.21.15.57:6801/2020036298","cluster_addr":"172.21.15.57:6803/2020036298","heartbeat_back_addr":"172.21.15.57:6807/2020036298","heartbeat_front_addr":"172.21.15.57:6805/2020036298","state":["exists","up"]},{"osd":1,"uuid":"feaf96f0-9431-4188-9a09-da505b40e934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6809","nonce":3190929242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6811","nonce":3190929242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6815","nonce":3190929242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6813","nonce":3190929242}]},"public_addr":"172.21.15.57:6809/3190929242","cluster_addr":"172.21.15.57:6811/3190929242","heartbeat_back_addr":"172.21.15.57:6815/3190929242","heartbeat_front_addr":"172.21.15.57:6813/3190929242","state":["exists","up"]},{"osd":2,"uuid":"21e406e6-cfbc-4fe7-a816-e2420487c95d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6817","nonce":4065849973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6819","nonce":4065849973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6823","nonce":4065849973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6821","nonce":4065849973}]},"public_addr":"172.21.15.57:6817/4065849973","cluster_addr":"172.21.15.57:6819/4065849973","heartbeat_back_addr":"172.21.15.57:6823/4065849973","heartbeat_front_addr":"172.21.15.57:6821/4065849973","state":["exists","up"]},{"osd":3,"uuid":"a389af1d-76c4-4dfc-b215-f983f4931257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6825","nonce":158084809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6827","nonce":158084809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6831","nonce":158084809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6829","nonce":158084809}]},"public_addr":"172.21.15.57:6825/158084809","cluster_addr":"172.21.15.57:6827/158084809","heartbeat_back_addr":"172.21.15.57:6831/158084809","heartbeat_front_addr":"172.21.15.57:6829/158084809","state":["exists","up"]},{"osd":4,"uuid":"e9b05dca-557a-43ee-b43f-9ce5b7d28304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6823","nonce":108719401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6827","nonce":108719401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6831","nonce":108719401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6829","nonce":108719401}]},"public_addr":"172.21.15.118:6823/108719401","cluster_addr":"172.21.15.118:6827/108719401","heartbeat_back_addr":"172.21.15.118:6831/108719401","heartbeat_front_addr":"172.21.15.118:6829/108719401","state":["exists","up"]},{"osd":5,"uuid":"d968177d-44ff-499a-b00a-b147ed879253","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6817","nonce":2704605866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6819","nonce":2704605866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6826","nonce":2704605866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6822","nonce":2704605866}]},"public_addr":"172.21.15.118:6817/2704605866","cluster_addr":"172.21.15.118:6819/2704605866","heartbeat_back_addr":"172.21.15.118:6826/2704605866","heartbeat_front_addr":"172.21.15.118:6822/2704605866","state":["exists","up"]},{"osd":6,"uuid":"e8f98052-e6ad-4cfe-a4a9-0b17a434d54e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6801","nonce":1963659095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6803","nonce":1963659095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6807","nonce":1963659095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6805","nonce":1963659095}]},"public_addr":"172.21.15.118:6801/1963659095","cluster_addr":"172.21.15.118:6803/1963659095","heartbeat_back_addr":"172.21.15.118:6807/1963659095","heartbeat_front_addr":"172.21.15.118:6805/1963659095","state":["exists","up"]},{"osd":7,"uuid":"eccff987-8e51-4a63-845a-cf0a3196d7fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6809","nonce":1955879596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6811","nonce":1955879596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6815","nonce":1955879596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6813","nonce":1955879596}]},"public_addr":"172.21.15.118:6809/1955879596","cluster_addr":"172.21.15.118:6811/1955879596","heartbeat_back_addr":"172.21.15.118:6815/1955879596","heartbeat_front_addr":"172.21.15.118:6813/1955879596","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.721258+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.696610+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.777895+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.806769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.743259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.845687+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:13.020165+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.722294+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-27T09:59:42.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.100+0000 7f7ad7200640 1 -- 172.21.15.57:0/568475105 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f7ab806c530 msgr2=0x7f7ab806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:42.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.100+0000 7f7ad7200640 1 --2- 172.21.15.57:0/568475105 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f7ab806c530 0x7f7ab806e9f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7ac800a950 tx=0x7f7ac8008040 comp rx=0 tx=0).stop 2024-03-27T09:59:42.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.100+0000 7f7ad7200640 1 -- 172.21.15.57:0/568475105 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ad8158530 msgr2=0x7f7ad80b3eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:42.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.100+0000 7f7ad7200640 1 --2- 172.21.15.57:0/568475105 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ad8158530 0x7f7ad80b3eb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7ad0007d10 tx=0x7f7ad000e4b0 comp rx=0 tx=0).stop 2024-03-27T09:59:42.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.100+0000 7f7ad7200640 1 -- 172.21.15.57:0/568475105 shutdown_connections 2024-03-27T09:59:42.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.100+0000 7f7ad7200640 1 --2- 172.21.15.57:0/568475105 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7ad8158530 0x7f7ad80b3eb0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:42.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.100+0000 7f7ad7200640 1 --2- 172.21.15.57:0/568475105 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f7ab806c530 0x7f7ab806e9f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:42.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.100+0000 7f7ad7200640 1 --2- 172.21.15.57:0/568475105 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7ad80adde0 0x7f7ad80b3970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:42.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.100+0000 7f7ad7200640 1 --2- 172.21.15.57:0/568475105 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7ad80720d0 0x7f7ad81484c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:42.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.100+0000 7f7ad7200640 1 -- 172.21.15.57:0/568475105 >> 172.21.15.57:0/568475105 conn(0x7f7ad80b1770 msgr2=0x7f7ad814a970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:42.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.101+0000 7f7ad7200640 1 -- 172.21.15.57:0/568475105 shutdown_connections 2024-03-27T09:59:42.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.101+0000 7f7ad7200640 1 -- 172.21.15.57:0/568475105 wait complete. 2024-03-27T09:59:42.110 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-27T09:59:17.253008+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-27T09:59:26.690365+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-27T09:59:27.559059+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-27T09:59:31.187596+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-27T09:59:42.110 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-27T09:59:42.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.345+0000 7f8d74c00640 1 Processor -- start 2024-03-27T09:59:42.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.346+0000 7f8d74c00640 1 -- start start 2024-03-27T09:59:42.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.347+0000 7f8d74c00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8d70161c00 0x7f8d700d1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:42.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.347+0000 7f8d74c00640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d700cfe40 con 0x7f8d700d2820 2024-03-27T09:59:42.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.347+0000 7f8d74c00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d700d0120 con 0x7f8d700d4c10 2024-03-27T09:59:42.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.347+0000 7f8d74c00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f8d700d2410 con 0x7f8d70161c00 2024-03-27T09:59:42.337 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.347+0000 7f8d6de00640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f8d700d2820 0x7f8d701614f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:44824/0 (socket says 172.21.15.57:44824) 2024-03-27T09:59:42.337 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.347+0000 7f8d6de00640 1 -- 172.21.15.57:0/3988584138 learned_addr learned my addr 172.21.15.57:0/3988584138 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T09:59:42.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.348+0000 7f8d6d400640 1 --2- 172.21.15.57:0/3988584138 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8d70161c00 0x7f8d700d1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:42.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.348+0000 7f8d6ca00640 1 -- 172.21.15.57:0/3988584138 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2953693408 0 0) 0x7f8d700cfe40 con 0x7f8d700d2820 2024-03-27T09:59:42.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.348+0000 7f8d6ca00640 1 -- 172.21.15.57:0/3988584138 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8d54003520 con 0x7f8d700d2820 2024-03-27T09:59:42.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.348+0000 7f8d6ca00640 1 -- 172.21.15.57:0/3988584138 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3588626338 0 0) 0x7f8d54003520 con 0x7f8d700d2820 2024-03-27T09:59:42.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.348+0000 7f8d6ca00640 1 -- 172.21.15.57:0/3988584138 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8d70161c00 msgr2=0x7f8d700d1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T09:59:42.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.348+0000 7f8d6ca00640 1 --2- 172.21.15.57:0/3988584138 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8d70161c00 0x7f8d700d1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:42.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.348+0000 7f8d6ca00640 1 -- 172.21.15.57:0/3988584138 >> v1:172.21.15.118:6789/0 conn(0x7f8d700d4c10 legacy=0x7f8d700b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:42.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.348+0000 7f8d6ca00640 1 -- 172.21.15.57:0/3988584138 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d700b37d0 con 0x7f8d700d2820 2024-03-27T09:59:42.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.348+0000 7f8d6ca00640 1 -- 172.21.15.57:0/3988584138 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4227751516 0 0) 0x7f8d600019f0 con 0x7f8d700d2820 2024-03-27T09:59:42.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.348+0000 7f8d6ca00640 1 -- 172.21.15.57:0/3988584138 >> v1:172.21.15.57:6789/0 conn(0x7f8d700d2820 legacy=0x7f8d701614f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:42.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.349+0000 7f8d6ca00640 1 --2- 172.21.15.57:0/3988584138 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8d540039e0 0x7f8d54003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:42.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.349+0000 7f8d6ca00640 1 --2- 172.21.15.57:0/3988584138 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8d54004800 0x7f8d54004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:42.340 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.349+0000 7f8d6ca00640 1 --2- 172.21.15.57:0/3988584138 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8d70161c00 0x7f8d54005270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:42.340 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.349+0000 7f8d6ca00640 1 -- 172.21.15.57:0/3988584138 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f8d700d2410 con 0x7f8d54004800 2024-03-27T09:59:42.340 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.349+0000 7f8d6ca00640 1 -- 172.21.15.57:0/3988584138 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f8d5400bb50 con 0x7f8d540039e0 2024-03-27T09:59:42.340 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.349+0000 7f8d6ca00640 1 -- 172.21.15.57:0/3988584138 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f8d5400bd50 con 0x7f8d70161c00 2024-03-27T09:59:42.340 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.349+0000 7f8d6d400640 1 --2- 172.21.15.57:0/3988584138 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8d54004800 0x7f8d54004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:42.340 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.349+0000 7f8d6e800640 1 --2- 172.21.15.57:0/3988584138 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8d70161c00 0x7f8d54005270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:42.340 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.349+0000 7f8d6de00640 1 --2- 172.21.15.57:0/3988584138 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8d540039e0 0x7f8d54003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:42.340 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.349+0000 7f8d6d400640 1 -- 172.21.15.57:0/3988584138 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8d70161c00 msgr2=0x7f8d54005270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T09:59:42.340 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.349+0000 7f8d6d400640 1 --2- 172.21.15.57:0/3988584138 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8d70161c00 0x7f8d54005270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:42.340 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.349+0000 7f8d6d400640 1 -- 172.21.15.57:0/3988584138 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8d540039e0 msgr2=0x7f8d54003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T09:59:42.340 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.349+0000 7f8d6d400640 1 --2- 172.21.15.57:0/3988584138 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8d540039e0 0x7f8d54003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:42.340 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.349+0000 7f8d6d400640 1 -- 172.21.15.57:0/3988584138 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d54003520 con 0x7f8d54004800 2024-03-27T09:59:42.340 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.349+0000 7f8d6e800640 1 --2- 172.21.15.57:0/3988584138 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8d70161c00 0x7f8d54005270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T09:59:42.341 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.351+0000 7f8d6d400640 1 --2- 172.21.15.57:0/3988584138 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8d54004800 0x7f8d54004c80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8d58009ac0 tx=0x7f8d54005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7fc8611679c7f79 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:42.341 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.351+0000 7f8d6ca00640 1 -- 172.21.15.57:0/3988584138 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d58039070 con 0x7f8d54004800 2024-03-27T09:59:42.341 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.351+0000 7f8d6ca00640 1 -- 172.21.15.57:0/3988584138 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d5802c6b0 con 0x7f8d54004800 2024-03-27T09:59:42.342 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.351+0000 7f8d6ca00640 1 -- 172.21.15.57:0/3988584138 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d58009690 con 0x7f8d54004800 2024-03-27T09:59:42.342 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.352+0000 7f8d74c00640 1 -- 172.21.15.57:0/3988584138 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8d54004800 msgr2=0x7f8d54004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:42.342 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.352+0000 7f8d74c00640 1 --2- 172.21.15.57:0/3988584138 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8d54004800 0x7f8d54004c80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8d58009ac0 tx=0x7f8d54005830 comp rx=0 tx=0).stop 2024-03-27T09:59:42.342 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.352+0000 7f8d6e800640 1 -- 172.21.15.57:0/3988584138 reap_dead start 2024-03-27T09:59:42.342 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.352+0000 7f8d74c00640 1 -- 172.21.15.57:0/3988584138 shutdown_connections 2024-03-27T09:59:42.342 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.352+0000 7f8d74c00640 1 -- 172.21.15.57:0/3988584138 >> 172.21.15.57:0/3988584138 conn(0x7f8d700d40f0 msgr2=0x7f8d700d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:42.342 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.352+0000 7f8d74c00640 1 -- 172.21.15.57:0/3988584138 shutdown_connections 2024-03-27T09:59:42.342 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.352+0000 7f8d74c00640 1 -- 172.21.15.57:0/3988584138 wait complete. 2024-03-27T09:59:42.343 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.354+0000 7f8d74c00640 1 Processor -- start 2024-03-27T09:59:42.343 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.354+0000 7f8d74c00640 1 -- start start 2024-03-27T09:59:42.345 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.355+0000 7f8d74c00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8d54004800 0x7f8d701506e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:42.345 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.355+0000 7f8d74c00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8d701f4a40 0x7f8d700c7780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:42.345 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.355+0000 7f8d74c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8d700b89e0 0x7f8d700b8e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:42.345 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.355+0000 7f8d74c00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f8d700d2c00 con 0x7f8d54004800 2024-03-27T09:59:42.345 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.355+0000 7f8d74c00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f8d700d0400 con 0x7f8d700b89e0 2024-03-27T09:59:42.345 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.355+0000 7f8d74c00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f8d700d2d80 con 0x7f8d701f4a40 2024-03-27T09:59:42.345 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.355+0000 7f8d6de00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8d54004800 0x7f8d701506e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:42.346 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.355+0000 7f8d6de00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8d54004800 0x7f8d701506e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46304/0 (socket says 172.21.15.57:46304) 2024-03-27T09:59:42.346 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.355+0000 7f8d6de00640 1 -- 172.21.15.57:0/776120017 learned_addr learned my addr 172.21.15.57:0/776120017 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T09:59:42.346 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.355+0000 7f8d6d400640 1 --2- 172.21.15.57:0/776120017 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8d701f4a40 0x7f8d700c7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:42.346 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.355+0000 7f8d6e800640 1 --2- 172.21.15.57:0/776120017 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8d700b89e0 0x7f8d700b8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:42.346 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.355+0000 7f8d6de00640 1 -- 172.21.15.57:0/776120017 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8d701f4a40 msgr2=0x7f8d700c7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:42.346 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.355+0000 7f8d6de00640 1 --2- 172.21.15.57:0/776120017 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8d701f4a40 0x7f8d700c7780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:42.346 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.355+0000 7f8d6de00640 1 -- 172.21.15.57:0/776120017 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8d700b89e0 msgr2=0x7f8d700b8e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:42.346 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.355+0000 7f8d6de00640 1 --2- 172.21.15.57:0/776120017 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8d700b89e0 0x7f8d700b8e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:42.346 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.355+0000 7f8d6de00640 1 -- 172.21.15.57:0/776120017 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d700c7f00 con 0x7f8d54004800 2024-03-27T09:59:42.346 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.355+0000 7f8d6e800640 1 --2- 172.21.15.57:0/776120017 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8d700b89e0 0x7f8d700b8e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T09:59:42.346 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.356+0000 7f8d6de00640 1 --2- 172.21.15.57:0/776120017 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8d54004800 0x7f8d701506e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8d60007a60 tx=0x7f8d6000e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:42.346 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.356+0000 7f8d66000640 1 -- 172.21.15.57:0/776120017 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d6000edf0 con 0x7f8d54004800 2024-03-27T09:59:42.346 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.356+0000 7f8d66000640 1 -- 172.21.15.57:0/776120017 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d60018070 con 0x7f8d54004800 2024-03-27T09:59:42.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.356+0000 7f8d66000640 1 -- 172.21.15.57:0/776120017 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d60013660 con 0x7f8d54004800 2024-03-27T09:59:42.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.356+0000 7f8d74c00640 1 -- 172.21.15.57:0/776120017 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d700c81e0 con 0x7f8d54004800 2024-03-27T09:59:42.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.356+0000 7f8d74c00640 1 -- 172.21.15.57:0/776120017 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d700c87a0 con 0x7f8d54004800 2024-03-27T09:59:42.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.357+0000 7f8d74c00640 1 -- 172.21.15.57:0/776120017 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d70068540 con 0x7f8d54004800 2024-03-27T09:59:42.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.358+0000 7f8d66000640 1 -- 172.21.15.57:0/776120017 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f8d60013800 con 0x7f8d54004800 2024-03-27T09:59:42.348 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.359+0000 7f8d66000640 1 --2- 172.21.15.57:0/776120017 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f8d4c06c560 0x7f8d4c06ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:42.348 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.359+0000 7f8d66000640 1 -- 172.21.15.57:0/776120017 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f8d6008c160 con 0x7f8d54004800 2024-03-27T09:59:42.348 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.359+0000 7f8d6d400640 1 --2- 172.21.15.57:0/776120017 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f8d4c06c560 0x7f8d4c06ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:42.349 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.360+0000 7f8d6d400640 1 --2- 172.21.15.57:0/776120017 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f8d4c06c560 0x7f8d4c06ea20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8d58009ac0 tx=0x7f8d58030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:42.353 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.364+0000 7f8d66000640 1 -- 172.21.15.57:0/776120017 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f8d6005a3a0 con 0x7f8d54004800 2024-03-27T09:59:42.555 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.566+0000 7f8d74c00640 1 -- 172.21.15.57:0/776120017 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f8d701f4e20 con 0x7f8d54004800 2024-03-27T09:59:42.556 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.567+0000 7f8d66000640 1 -- 172.21.15.57:0/776120017 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7f8d60059ca0 con 0x7f8d54004800 2024-03-27T09:59:42.556 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2024-03-27T09:59:42.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.569+0000 7f8d74c00640 1 -- 172.21.15.57:0/776120017 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f8d4c06c560 msgr2=0x7f8d4c06ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:42.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.569+0000 7f8d74c00640 1 --2- 172.21.15.57:0/776120017 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f8d4c06c560 0x7f8d4c06ea20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8d58009ac0 tx=0x7f8d58030000 comp rx=0 tx=0).stop 2024-03-27T09:59:42.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.569+0000 7f8d74c00640 1 -- 172.21.15.57:0/776120017 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8d54004800 msgr2=0x7f8d701506e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:42.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.569+0000 7f8d74c00640 1 --2- 172.21.15.57:0/776120017 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8d54004800 0x7f8d701506e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8d60007a60 tx=0x7f8d6000e530 comp rx=0 tx=0).stop 2024-03-27T09:59:42.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.570+0000 7f8d74c00640 1 -- 172.21.15.57:0/776120017 shutdown_connections 2024-03-27T09:59:42.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.570+0000 7f8d74c00640 1 --2- 172.21.15.57:0/776120017 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f8d4c06c560 0x7f8d4c06ea20 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:42.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.570+0000 7f8d74c00640 1 --2- 172.21.15.57:0/776120017 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8d700b89e0 0x7f8d700b8e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:42.560 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.570+0000 7f8d74c00640 1 --2- 172.21.15.57:0/776120017 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8d701f4a40 0x7f8d700c7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:42.560 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.570+0000 7f8d74c00640 1 --2- 172.21.15.57:0/776120017 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8d54004800 0x7f8d701506e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:42.560 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.570+0000 7f8d74c00640 1 -- 172.21.15.57:0/776120017 >> 172.21.15.57:0/776120017 conn(0x7f8d700d40f0 msgr2=0x7f8d7006d050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:42.560 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.570+0000 7f8d74c00640 1 -- 172.21.15.57:0/776120017 shutdown_connections 2024-03-27T09:59:42.560 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.570+0000 7f8d74c00640 1 -- 172.21.15.57:0/776120017 wait complete. 2024-03-27T09:59:42.577 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-27T09:59:42.795 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.806+0000 7fbe03e00640 1 Processor -- start 2024-03-27T09:59:42.796 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.806+0000 7fbe03e00640 1 -- start start 2024-03-27T09:59:42.798 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.808+0000 7fbe03e00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fbe041458e0 0x7fbe0406d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:42.798 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.808+0000 7fbe03e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbe0415fa90 0x7fbe0415fef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:42.798 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.808+0000 7fbe03e00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbe040cb0f0 0x7fbe040cb540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:42.798 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.808+0000 7fbe03e00640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7fbe04160430 con 0x7fbe040cb0f0 2024-03-27T09:59:42.798 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.808+0000 7fbe03e00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7fbe040ca330 con 0x7fbe041458e0 2024-03-27T09:59:42.798 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.808+0000 7fbe03e00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fbe040ca610 con 0x7fbe0415fa90 2024-03-27T09:59:42.798 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.809+0000 7fbe03400640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbe040cb0f0 0x7fbe040cb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:42.798 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.809+0000 7fbe03400640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbe040cb0f0 0x7fbe040cb540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46308/0 (socket says 172.21.15.57:46308) 2024-03-27T09:59:42.798 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.809+0000 7fbe03400640 1 -- 172.21.15.57:0/3933420241 learned_addr learned my addr 172.21.15.57:0/3933420241 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T09:59:42.798 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.809+0000 7fbe02000640 1 --2- 172.21.15.57:0/3933420241 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbe0415fa90 0x7fbe0415fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:42.799 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.809+0000 7fbe02a00640 1 --2- 172.21.15.57:0/3933420241 >> v2:172.21.15.118:3300/0 conn(0x7fbe041458e0 0x7fbe0406d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:42.799 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.809+0000 7fbe03400640 1 -- 172.21.15.57:0/3933420241 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbe0415fa90 msgr2=0x7fbe0415fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T09:59:42.799 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.809+0000 7fbe03400640 1 --2- 172.21.15.57:0/3933420241 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbe0415fa90 0x7fbe0415fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:42.799 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.809+0000 7fbe03400640 1 -- 172.21.15.57:0/3933420241 >> v2:172.21.15.118:3300/0 conn(0x7fbe041458e0 msgr2=0x7fbe0406d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T09:59:42.799 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.809+0000 7fbe03400640 1 --2- 172.21.15.57:0/3933420241 >> v2:172.21.15.118:3300/0 conn(0x7fbe041458e0 0x7fbe0406d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:42.799 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.809+0000 7fbe03400640 1 -- 172.21.15.57:0/3933420241 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe040ca8f0 con 0x7fbe040cb0f0 2024-03-27T09:59:42.799 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.809+0000 7fbe02a00640 1 --2- 172.21.15.57:0/3933420241 >> v2:172.21.15.118:3300/0 conn(0x7fbe041458e0 0x7fbe0406d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T09:59:42.800 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.811+0000 7fbe03400640 1 --2- 172.21.15.57:0/3933420241 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe040cb0f0 0x7fbe040cb540 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fbe040508d0 tx=0x7fbdfc02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61122784d979e59d server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:42.800 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.811+0000 7fbe01600640 1 -- 172.21.15.57:0/3933420241 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdfc02ca70 con 0x7fbe040cb0f0 2024-03-27T09:59:42.800 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.811+0000 7fbe01600640 1 -- 172.21.15.57:0/3933420241 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdfc02cc10 con 0x7fbe040cb0f0 2024-03-27T09:59:42.800 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.811+0000 7fbe01600640 1 -- 172.21.15.57:0/3933420241 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdfc0343f0 con 0x7fbe040cb0f0 2024-03-27T09:59:42.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.812+0000 7fbe03e00640 1 -- 172.21.15.57:0/3933420241 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe040cb0f0 msgr2=0x7fbe040cb540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:42.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.812+0000 7fbe03e00640 1 --2- 172.21.15.57:0/3933420241 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe040cb0f0 0x7fbe040cb540 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fbe040508d0 tx=0x7fbdfc02bed0 comp rx=0 tx=0).stop 2024-03-27T09:59:42.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.812+0000 7fbe03e00640 1 -- 172.21.15.57:0/3933420241 shutdown_connections 2024-03-27T09:59:42.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.812+0000 7fbe03e00640 1 --2- 172.21.15.57:0/3933420241 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe040cb0f0 0x7fbe040cb540 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:42.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.812+0000 7fbe03e00640 1 --2- 172.21.15.57:0/3933420241 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbe0415fa90 0x7fbe0415fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:42.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.812+0000 7fbe03e00640 1 --2- 172.21.15.57:0/3933420241 >> v2:172.21.15.118:3300/0 conn(0x7fbe041458e0 0x7fbe0406d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:42.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.812+0000 7fbe03e00640 1 -- 172.21.15.57:0/3933420241 >> 172.21.15.57:0/3933420241 conn(0x7fbe040cfb40 msgr2=0x7fbe040cff20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:42.802 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.812+0000 7fbe03e00640 1 -- 172.21.15.57:0/3933420241 shutdown_connections 2024-03-27T09:59:42.802 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.812+0000 7fbe03e00640 1 -- 172.21.15.57:0/3933420241 wait complete. 2024-03-27T09:59:42.803 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.814+0000 7fbe03e00640 1 Processor -- start 2024-03-27T09:59:42.803 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.815+0000 7fbe03e00640 1 -- start start 2024-03-27T09:59:42.806 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.816+0000 7fbe03e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbe040cb0f0 0x7fbe0412f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:42.806 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.816+0000 7fbe03e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe041458e0 0x7fbe04130fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:42.806 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.816+0000 7fbe03e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbe0415fa90 0x7fbe040ce550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:42.806 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.816+0000 7fbe03e00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fbe040cbc00 con 0x7fbe041458e0 2024-03-27T09:59:42.806 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.816+0000 7fbe03e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fbe040cba80 con 0x7fbe040cb0f0 2024-03-27T09:59:42.806 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.816+0000 7fbe03e00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fbe040cbd80 con 0x7fbe0415fa90 2024-03-27T09:59:42.806 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.816+0000 7fbe02000640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe041458e0 0x7fbe04130fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:42.806 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.816+0000 7fbe02000640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe041458e0 0x7fbe04130fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46312/0 (socket says 172.21.15.57:46312) 2024-03-27T09:59:42.806 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.816+0000 7fbe02000640 1 -- 172.21.15.57:0/3187784157 learned_addr learned my addr 172.21.15.57:0/3187784157 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T09:59:42.806 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.817+0000 7fbe02a00640 1 --2- 172.21.15.57:0/3187784157 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbe040cb0f0 0x7fbe0412f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:42.806 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.817+0000 7fbe03400640 1 --2- 172.21.15.57:0/3187784157 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbe0415fa90 0x7fbe040ce550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:42.806 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.817+0000 7fbe02000640 1 -- 172.21.15.57:0/3187784157 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbe0415fa90 msgr2=0x7fbe040ce550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:42.807 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.817+0000 7fbe02000640 1 --2- 172.21.15.57:0/3187784157 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbe0415fa90 0x7fbe040ce550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:42.807 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.817+0000 7fbe02000640 1 -- 172.21.15.57:0/3187784157 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbe040cb0f0 msgr2=0x7fbe0412f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:42.807 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.817+0000 7fbe02000640 1 --2- 172.21.15.57:0/3187784157 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbe040cb0f0 0x7fbe0412f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:42.807 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.817+0000 7fbe02000640 1 -- 172.21.15.57:0/3187784157 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe04131a20 con 0x7fbe041458e0 2024-03-27T09:59:42.807 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.817+0000 7fbe02000640 1 --2- 172.21.15.57:0/3187784157 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe041458e0 0x7fbe04130fb0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fbdf000e9b0 tx=0x7fbdf000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:42.808 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.817+0000 7fbdfb400640 1 -- 172.21.15.57:0/3187784157 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdf0017070 con 0x7fbe041458e0 2024-03-27T09:59:42.808 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.818+0000 7fbdfb400640 1 -- 172.21.15.57:0/3187784157 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdf000c9a0 con 0x7fbe041458e0 2024-03-27T09:59:42.808 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.818+0000 7fbdfb400640 1 -- 172.21.15.57:0/3187784157 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdf000cd90 con 0x7fbe041458e0 2024-03-27T09:59:42.808 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.818+0000 7fbe03e00640 1 -- 172.21.15.57:0/3187784157 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe041324b0 con 0x7fbe041458e0 2024-03-27T09:59:42.808 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.818+0000 7fbe03e00640 1 -- 172.21.15.57:0/3187784157 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe04132a70 con 0x7fbe041458e0 2024-03-27T09:59:42.808 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.819+0000 7fbe03e00640 1 -- 172.21.15.57:0/3187784157 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe04068540 con 0x7fbe041458e0 2024-03-27T09:59:42.809 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.820+0000 7fbdfb400640 1 -- 172.21.15.57:0/3187784157 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fbdf001a070 con 0x7fbe041458e0 2024-03-27T09:59:42.810 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.821+0000 7fbdfb400640 1 --2- 172.21.15.57:0/3187784157 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fbde406c530 0x7fbde406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:42.810 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.821+0000 7fbdfb400640 1 -- 172.21.15.57:0/3187784157 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fbdf008bd80 con 0x7fbe041458e0 2024-03-27T09:59:42.810 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.821+0000 7fbe02a00640 1 --2- 172.21.15.57:0/3187784157 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fbde406c530 0x7fbde406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:42.811 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.822+0000 7fbe02a00640 1 --2- 172.21.15.57:0/3187784157 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fbde406c530 0x7fbde406e9f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbdf4006fd0 tx=0x7fbdf4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:42.816 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:42.827+0000 7fbdfb400640 1 -- 172.21.15.57:0/3187784157 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7fbdf005a0f0 con 0x7fbe041458e0 2024-03-27T09:59:43.026 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.037+0000 7fbe03e00640 1 -- 172.21.15.57:0/3187784157 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fbe040cf490 con 0x7fbe041458e0 2024-03-27T09:59:43.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.038+0000 7fbdfb400640 1 -- 172.21.15.57:0/3187784157 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7fbdf00599f0 con 0x7fbe041458e0 2024-03-27T09:59:43.027 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2024-03-27T09:59:43.030 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.041+0000 7fbe03e00640 1 -- 172.21.15.57:0/3187784157 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fbde406c530 msgr2=0x7fbde406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:43.030 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.041+0000 7fbe03e00640 1 --2- 172.21.15.57:0/3187784157 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fbde406c530 0x7fbde406e9f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbdf4006fd0 tx=0x7fbdf4008040 comp rx=0 tx=0).stop 2024-03-27T09:59:43.030 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.041+0000 7fbe03e00640 1 -- 172.21.15.57:0/3187784157 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe041458e0 msgr2=0x7fbe04130fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:43.030 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.041+0000 7fbe03e00640 1 --2- 172.21.15.57:0/3187784157 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe041458e0 0x7fbe04130fb0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fbdf000e9b0 tx=0x7fbdf000ee70 comp rx=0 tx=0).stop 2024-03-27T09:59:43.030 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.041+0000 7fbe03e00640 1 -- 172.21.15.57:0/3187784157 shutdown_connections 2024-03-27T09:59:43.030 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.041+0000 7fbe03e00640 1 --2- 172.21.15.57:0/3187784157 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbe0415fa90 0x7fbe040ce550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:43.031 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.041+0000 7fbe03e00640 1 --2- 172.21.15.57:0/3187784157 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe041458e0 0x7fbe04130fb0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:43.031 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.041+0000 7fbe03e00640 1 --2- 172.21.15.57:0/3187784157 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fbde406c530 0x7fbde406e9f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:43.031 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.041+0000 7fbe03e00640 1 --2- 172.21.15.57:0/3187784157 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbe040cb0f0 0x7fbe0412f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:43.031 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.041+0000 7fbe03e00640 1 -- 172.21.15.57:0/3187784157 >> 172.21.15.57:0/3187784157 conn(0x7fbe040cfb40 msgr2=0x7fbe040cff20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:43.031 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.041+0000 7fbe03e00640 1 -- 172.21.15.57:0/3187784157 shutdown_connections 2024-03-27T09:59:43.031 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.041+0000 7fbe03e00640 1 -- 172.21.15.57:0/3187784157 wait complete. 2024-03-27T09:59:43.048 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-27T09:59:43.279 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.290+0000 7f3373000640 1 Processor -- start 2024-03-27T09:59:43.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.290+0000 7f3373000640 1 -- start start 2024-03-27T09:59:43.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.292+0000 7f3373000640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f336c15e9e0 0x7f336c0d16c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:43.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.292+0000 7f3373000640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f336c0ce790 0x7f336c0cec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:43.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.292+0000 7f3373000640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f336c06dc10 con 0x7f336c15e600 2024-03-27T09:59:43.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.292+0000 7f3373000640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f336c0d1230 con 0x7f336c0ce790 2024-03-27T09:59:43.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.292+0000 7f3373000640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f336c0d0380 con 0x7f336c15e9e0 2024-03-27T09:59:43.282 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.293+0000 7f3371000640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f336c0ce790 0x7f336c0cec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:43.282 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.293+0000 7f336b400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f336c15e9e0 0x7f336c0d16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:43.282 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.293+0000 7f3371000640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f336c0ce790 0x7f336c0cec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.57:34020/0 (socket says 172.21.15.57:34020) 2024-03-27T09:59:43.282 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.293+0000 7f3371000640 1 -- 172.21.15.57:0/3074210807 learned_addr learned my addr 172.21.15.57:0/3074210807 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T09:59:43.282 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.293+0000 7f336be00640 1 --1- 172.21.15.57:0/3074210807 >> v1:172.21.15.118:6789/0 conn(0x7f336c15e600 0x7f336c06d500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.57:41190/0 (socket says 172.21.15.57:41190) 2024-03-27T09:59:43.283 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.293+0000 7f336b400640 1 -- 172.21.15.57:0/3074210807 >> v2:172.21.15.118:3300/0 conn(0x7f336c0ce790 msgr2=0x7f336c0cec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T09:59:43.283 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.293+0000 7f336b400640 1 --2- 172.21.15.57:0/3074210807 >> v2:172.21.15.118:3300/0 conn(0x7f336c0ce790 0x7f336c0cec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:43.283 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.293+0000 7f336b400640 1 -- 172.21.15.57:0/3074210807 >> v1:172.21.15.118:6789/0 conn(0x7f336c15e600 legacy=0x7f336c06d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:43.283 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.293+0000 7f336b400640 1 -- 172.21.15.57:0/3074210807 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f336c0d0620 con 0x7f336c15e9e0 2024-03-27T09:59:43.284 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.295+0000 7f336b400640 1 --2- 172.21.15.57:0/3074210807 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f336c15e9e0 0x7f336c0d16c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f33580097a0 tx=0x7f335802b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d593c7125b996e6a server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:43.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.295+0000 7f336aa00640 1 -- 172.21.15.57:0/3074210807 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3358035020 con 0x7f336c15e9e0 2024-03-27T09:59:43.286 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.295+0000 7f336aa00640 1 -- 172.21.15.57:0/3074210807 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3358031830 con 0x7f336c15e9e0 2024-03-27T09:59:43.286 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.295+0000 7f336aa00640 1 -- 172.21.15.57:0/3074210807 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3358031c00 con 0x7f336c15e9e0 2024-03-27T09:59:43.286 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.296+0000 7f3373000640 1 -- 172.21.15.57:0/3074210807 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f336c15e9e0 msgr2=0x7f336c0d16c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:43.286 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.296+0000 7f3373000640 1 --2- 172.21.15.57:0/3074210807 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f336c15e9e0 0x7f336c0d16c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f33580097a0 tx=0x7f335802b8d0 comp rx=0 tx=0).stop 2024-03-27T09:59:43.286 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.296+0000 7f3373000640 1 -- 172.21.15.57:0/3074210807 shutdown_connections 2024-03-27T09:59:43.286 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.296+0000 7f3373000640 1 --2- 172.21.15.57:0/3074210807 >> v2:172.21.15.118:3300/0 conn(0x7f336c0ce790 0x7f336c0cec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:43.286 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.296+0000 7f3373000640 1 --2- 172.21.15.57:0/3074210807 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f336c15e9e0 0x7f336c0d16c0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:43.286 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.296+0000 7f3373000640 1 -- 172.21.15.57:0/3074210807 >> 172.21.15.57:0/3074210807 conn(0x7f336c0d1f10 msgr2=0x7f336c0d2320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:43.286 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.296+0000 7f3373000640 1 -- 172.21.15.57:0/3074210807 shutdown_connections 2024-03-27T09:59:43.286 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.296+0000 7f3373000640 1 -- 172.21.15.57:0/3074210807 wait complete. 2024-03-27T09:59:43.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.298+0000 7f3373000640 1 Processor -- start 2024-03-27T09:59:43.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.298+0000 7f3373000640 1 -- start start 2024-03-27T09:59:43.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.299+0000 7f3373000640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f336c0ce790 0x7f336c0c87c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:43.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.299+0000 7f3373000640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f336c15e600 0x7f336c0b6fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:43.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.299+0000 7f3373000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f336c15e9e0 0x7f336c1e90a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:43.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.299+0000 7f3373000640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f336c0d0ec0 con 0x7f336c0ce790 2024-03-27T09:59:43.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.299+0000 7f3373000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f336c0d0be0 con 0x7f336c15e9e0 2024-03-27T09:59:43.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.299+0000 7f3373000640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f336c0b35b0 con 0x7f336c15e600 2024-03-27T09:59:43.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.299+0000 7f336be00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f336c0ce790 0x7f336c0c87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:43.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.300+0000 7f336be00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f336c0ce790 0x7f336c0c87c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46322/0 (socket says 172.21.15.57:46322) 2024-03-27T09:59:43.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.300+0000 7f336be00640 1 -- 172.21.15.57:0/297758649 learned_addr learned my addr 172.21.15.57:0/297758649 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T09:59:43.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.300+0000 7f336b400640 1 --2- 172.21.15.57:0/297758649 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f336c15e600 0x7f336c0b6fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:43.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.300+0000 7f3371000640 1 --2- 172.21.15.57:0/297758649 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f336c15e9e0 0x7f336c1e90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:43.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.300+0000 7f336be00640 1 -- 172.21.15.57:0/297758649 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f336c15e600 msgr2=0x7f336c0b6fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:43.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.300+0000 7f336be00640 1 --2- 172.21.15.57:0/297758649 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f336c15e600 0x7f336c0b6fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:43.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.300+0000 7f336be00640 1 -- 172.21.15.57:0/297758649 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f336c15e9e0 msgr2=0x7f336c1e90a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:43.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.300+0000 7f336be00640 1 --2- 172.21.15.57:0/297758649 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f336c15e9e0 0x7f336c1e90a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:43.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.300+0000 7f336be00640 1 -- 172.21.15.57:0/297758649 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f336c0c7720 con 0x7f336c0ce790 2024-03-27T09:59:43.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.300+0000 7f336b400640 1 --2- 172.21.15.57:0/297758649 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f336c15e600 0x7f336c0b6fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T09:59:43.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.300+0000 7f336be00640 1 --2- 172.21.15.57:0/297758649 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f336c0ce790 0x7f336c0c87c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f335c00cb10 tx=0x7f335c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:43.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.301+0000 7f3363e00640 1 -- 172.21.15.57:0/297758649 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f335c017070 con 0x7f336c0ce790 2024-03-27T09:59:43.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.301+0000 7f3363e00640 1 -- 172.21.15.57:0/297758649 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f335c00a860 con 0x7f336c0ce790 2024-03-27T09:59:43.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.301+0000 7f3373000640 1 -- 172.21.15.57:0/297758649 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f336c0c7a00 con 0x7f336c0ce790 2024-03-27T09:59:43.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.301+0000 7f3363e00640 1 -- 172.21.15.57:0/297758649 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f335c00ac30 con 0x7f336c0ce790 2024-03-27T09:59:43.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.301+0000 7f3373000640 1 -- 172.21.15.57:0/297758649 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f336c0c7fc0 con 0x7f336c0ce790 2024-03-27T09:59:43.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.302+0000 7f3373000640 1 -- 172.21.15.57:0/297758649 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f336c0c8400 con 0x7f336c0ce790 2024-03-27T09:59:43.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.303+0000 7f3363e00640 1 -- 172.21.15.57:0/297758649 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f335c01a070 con 0x7f336c0ce790 2024-03-27T09:59:43.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.304+0000 7f3363e00640 1 --2- 172.21.15.57:0/297758649 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f334c06c530 0x7f334c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:43.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.304+0000 7f3363e00640 1 -- 172.21.15.57:0/297758649 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f335c08b500 con 0x7f336c0ce790 2024-03-27T09:59:43.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.304+0000 7f336b400640 1 --2- 172.21.15.57:0/297758649 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f334c06c530 0x7f334c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:43.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.305+0000 7f336b400640 1 --2- 172.21.15.57:0/297758649 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f334c06c530 0x7f334c06e9f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3358036000 tx=0x7f335803c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:43.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.309+0000 7f3363e00640 1 -- 172.21.15.57:0/297758649 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f335c0596b0 con 0x7f336c0ce790 2024-03-27T09:59:43.500 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.511+0000 7f3373000640 1 -- 172.21.15.57:0/297758649 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f336c068540 con 0x7f336c0ce790 2024-03-27T09:59:43.500 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.511+0000 7f3363e00640 1 -- 172.21.15.57:0/297758649 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7f335c058fb0 con 0x7f336c0ce790 2024-03-27T09:59:43.501 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2024-03-27T09:59:43.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.514+0000 7f3373000640 1 -- 172.21.15.57:0/297758649 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f334c06c530 msgr2=0x7f334c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:43.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.514+0000 7f3373000640 1 --2- 172.21.15.57:0/297758649 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f334c06c530 0x7f334c06e9f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3358036000 tx=0x7f335803c040 comp rx=0 tx=0).stop 2024-03-27T09:59:43.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.514+0000 7f3373000640 1 -- 172.21.15.57:0/297758649 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f336c0ce790 msgr2=0x7f336c0c87c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:43.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.514+0000 7f3373000640 1 --2- 172.21.15.57:0/297758649 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f336c0ce790 0x7f336c0c87c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f335c00cb10 tx=0x7f335c00a060 comp rx=0 tx=0).stop 2024-03-27T09:59:43.504 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.514+0000 7f3373000640 1 -- 172.21.15.57:0/297758649 shutdown_connections 2024-03-27T09:59:43.504 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.514+0000 7f3373000640 1 --2- 172.21.15.57:0/297758649 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f334c06c530 0x7f334c06e9f0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:43.504 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.514+0000 7f3373000640 1 --2- 172.21.15.57:0/297758649 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f336c15e9e0 0x7f336c1e90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:43.504 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.514+0000 7f3373000640 1 --2- 172.21.15.57:0/297758649 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f336c15e600 0x7f336c0b6fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:43.504 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.514+0000 7f3373000640 1 --2- 172.21.15.57:0/297758649 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f336c0ce790 0x7f336c0c87c0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:43.504 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.514+0000 7f3373000640 1 -- 172.21.15.57:0/297758649 >> 172.21.15.57:0/297758649 conn(0x7f336c0d1f10 msgr2=0x7f336c074990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:43.504 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.515+0000 7f3373000640 1 -- 172.21.15.57:0/297758649 shutdown_connections 2024-03-27T09:59:43.504 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.515+0000 7f3373000640 1 -- 172.21.15.57:0/297758649 wait complete. 2024-03-27T09:59:43.524 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-27T09:59:43.741 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.752+0000 7fc946400640 1 Processor -- start 2024-03-27T09:59:43.741 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.752+0000 7fc946400640 1 -- start start 2024-03-27T09:59:43.743 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.754+0000 7fc946400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fc9400ca6e0 0x7fc9400c4e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:43.743 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.754+0000 7fc946400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc9400cbb50 0x7fc9400caac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:43.743 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.754+0000 7fc946400640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9400cb720 con 0x7fc9400cb000 2024-03-27T09:59:43.743 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.754+0000 7fc946400640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7fc9400c5570 con 0x7fc9400ca6e0 2024-03-27T09:59:43.744 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.754+0000 7fc946400640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fc9400c5850 con 0x7fc9400cbb50 2024-03-27T09:59:43.744 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.754+0000 7fc945a00640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fc9400cb000 0x7fc9400ad8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:44840/0 (socket says 172.21.15.57:44840) 2024-03-27T09:59:43.744 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.754+0000 7fc945a00640 1 -- 172.21.15.57:0/69564996 learned_addr learned my addr 172.21.15.57:0/69564996 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T09:59:43.744 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.754+0000 7fc945000640 1 --2- 172.21.15.57:0/69564996 >> v2:172.21.15.118:3300/0 conn(0x7fc9400ca6e0 0x7fc9400c4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:43.744 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.754+0000 7fc93fe00640 1 --2- 172.21.15.57:0/69564996 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc9400cbb50 0x7fc9400caac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:43.745 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.755+0000 7fc93f400640 1 -- 172.21.15.57:0/69564996 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 21883722 0 0) 0x7fc9400cb720 con 0x7fc9400cb000 2024-03-27T09:59:43.745 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.755+0000 7fc93f400640 1 -- 172.21.15.57:0/69564996 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc928003520 con 0x7fc9400cb000 2024-03-27T09:59:43.745 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.755+0000 7fc93fe00640 1 -- 172.21.15.57:0/69564996 >> v2:172.21.15.118:3300/0 conn(0x7fc9400ca6e0 msgr2=0x7fc9400c4e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T09:59:43.745 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.755+0000 7fc93fe00640 1 --2- 172.21.15.57:0/69564996 >> v2:172.21.15.118:3300/0 conn(0x7fc9400ca6e0 0x7fc9400c4e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:43.745 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.755+0000 7fc93fe00640 1 -- 172.21.15.57:0/69564996 >> v1:172.21.15.57:6789/0 conn(0x7fc9400cb000 legacy=0x7fc9400ad8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:43.745 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.755+0000 7fc93fe00640 1 -- 172.21.15.57:0/69564996 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9400c5b30 con 0x7fc9400cbb50 2024-03-27T09:59:43.745 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.755+0000 7fc945000640 1 --2- 172.21.15.57:0/69564996 >> v2:172.21.15.118:3300/0 conn(0x7fc9400ca6e0 0x7fc9400c4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T09:59:43.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.756+0000 7fc93fe00640 1 --2- 172.21.15.57:0/69564996 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc9400cbb50 0x7fc9400caac0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc92c0097a0 tx=0x7fc92c02b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5792b903e517e795 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:43.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.757+0000 7fc93f400640 1 -- 172.21.15.57:0/69564996 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc92c031780 con 0x7fc9400cbb50 2024-03-27T09:59:43.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.757+0000 7fc93f400640 1 -- 172.21.15.57:0/69564996 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc92c037070 con 0x7fc9400cbb50 2024-03-27T09:59:43.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.757+0000 7fc93f400640 1 -- 172.21.15.57:0/69564996 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc92c031b40 con 0x7fc9400cbb50 2024-03-27T09:59:43.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.757+0000 7fc946400640 1 -- 172.21.15.57:0/69564996 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc9400cbb50 msgr2=0x7fc9400caac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:43.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.757+0000 7fc946400640 1 --2- 172.21.15.57:0/69564996 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc9400cbb50 0x7fc9400caac0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc92c0097a0 tx=0x7fc92c02b820 comp rx=0 tx=0).stop 2024-03-27T09:59:43.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.757+0000 7fc946400640 1 -- 172.21.15.57:0/69564996 shutdown_connections 2024-03-27T09:59:43.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.757+0000 7fc946400640 1 --2- 172.21.15.57:0/69564996 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc9400cbb50 0x7fc9400caac0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:43.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.757+0000 7fc946400640 1 --2- 172.21.15.57:0/69564996 >> v2:172.21.15.118:3300/0 conn(0x7fc9400ca6e0 0x7fc9400c4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:43.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.757+0000 7fc946400640 1 -- 172.21.15.57:0/69564996 >> 172.21.15.57:0/69564996 conn(0x7fc9400cfb40 msgr2=0x7fc9400cff20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:43.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.757+0000 7fc946400640 1 -- 172.21.15.57:0/69564996 shutdown_connections 2024-03-27T09:59:43.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.758+0000 7fc946400640 1 -- 172.21.15.57:0/69564996 wait complete. 2024-03-27T09:59:43.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.759+0000 7fc946400640 1 Processor -- start 2024-03-27T09:59:43.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.759+0000 7fc946400640 1 -- start start 2024-03-27T09:59:43.750 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.760+0000 7fc946400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9400ca6e0 0x7fc94014b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:43.750 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.760+0000 7fc946400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc9400cb000 0x7fc9400b2820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:43.750 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.760+0000 7fc946400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc9400cbb50 0x7fc9400b4d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:43.750 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.760+0000 7fc946400640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fc9400adfb0 con 0x7fc9400ca6e0 2024-03-27T09:59:43.750 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.760+0000 7fc946400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fc9400c60f0 con 0x7fc9400cbb50 2024-03-27T09:59:43.750 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.760+0000 7fc946400640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fc9400ae130 con 0x7fc9400cb000 2024-03-27T09:59:43.750 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.760+0000 7fc945000640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9400ca6e0 0x7fc94014b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:43.750 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.760+0000 7fc945000640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9400ca6e0 0x7fc94014b4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46328/0 (socket says 172.21.15.57:46328) 2024-03-27T09:59:43.750 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.761+0000 7fc945000640 1 -- 172.21.15.57:0/1465537905 learned_addr learned my addr 172.21.15.57:0/1465537905 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T09:59:43.750 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.761+0000 7fc93fe00640 1 --2- 172.21.15.57:0/1465537905 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc9400cb000 0x7fc9400b2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:43.751 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.761+0000 7fc945a00640 1 --2- 172.21.15.57:0/1465537905 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc9400cbb50 0x7fc9400b4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:43.751 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.761+0000 7fc945000640 1 -- 172.21.15.57:0/1465537905 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc9400cb000 msgr2=0x7fc9400b2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:43.751 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.761+0000 7fc945000640 1 --2- 172.21.15.57:0/1465537905 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc9400cb000 0x7fc9400b2820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:43.751 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.761+0000 7fc945000640 1 -- 172.21.15.57:0/1465537905 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc9400cbb50 msgr2=0x7fc9400b4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:43.751 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.761+0000 7fc945000640 1 --2- 172.21.15.57:0/1465537905 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc9400cbb50 0x7fc9400b4d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:43.751 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.761+0000 7fc945000640 1 -- 172.21.15.57:0/1465537905 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9400b3170 con 0x7fc9400ca6e0 2024-03-27T09:59:43.751 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.761+0000 7fc945a00640 1 --2- 172.21.15.57:0/1465537905 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc9400cbb50 0x7fc9400b4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T09:59:43.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.761+0000 7fc945000640 1 --2- 172.21.15.57:0/1465537905 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9400ca6e0 0x7fc94014b4f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc93400ebe0 tx=0x7fc93400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:43.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.762+0000 7fc93cc00640 1 -- 172.21.15.57:0/1465537905 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc934017070 con 0x7fc9400ca6e0 2024-03-27T09:59:43.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.762+0000 7fc93cc00640 1 -- 172.21.15.57:0/1465537905 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc93400cc30 con 0x7fc9400ca6e0 2024-03-27T09:59:43.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.762+0000 7fc93cc00640 1 -- 172.21.15.57:0/1465537905 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc934013470 con 0x7fc9400ca6e0 2024-03-27T09:59:43.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.762+0000 7fc946400640 1 -- 172.21.15.57:0/1465537905 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9400b3450 con 0x7fc9400ca6e0 2024-03-27T09:59:43.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.762+0000 7fc946400640 1 -- 172.21.15.57:0/1465537905 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9400b3a10 con 0x7fc9400ca6e0 2024-03-27T09:59:43.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.763+0000 7fc946400640 1 -- 172.21.15.57:0/1465537905 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc940068540 con 0x7fc9400ca6e0 2024-03-27T09:59:43.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.764+0000 7fc93cc00640 1 -- 172.21.15.57:0/1465537905 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fc93401a070 con 0x7fc9400ca6e0 2024-03-27T09:59:43.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.765+0000 7fc93cc00640 1 --2- 172.21.15.57:0/1465537905 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fc92006c530 0x7fc92006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:43.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.765+0000 7fc93cc00640 1 -- 172.21.15.57:0/1465537905 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fc93408bdb0 con 0x7fc9400ca6e0 2024-03-27T09:59:43.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.765+0000 7fc93fe00640 1 --2- 172.21.15.57:0/1465537905 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fc92006c530 0x7fc92006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:43.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.766+0000 7fc93fe00640 1 --2- 172.21.15.57:0/1465537905 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fc92006c530 0x7fc92006e9f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc92c036000 tx=0x7fc92c03d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:43.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.770+0000 7fc93cc00640 1 -- 172.21.15.57:0/1465537905 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7fc934090070 con 0x7fc9400ca6e0 2024-03-27T09:59:43.967 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.978+0000 7fc946400640 1 -- 172.21.15.57:0/1465537905 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fc9400ce9d0 con 0x7fc9400ca6e0 2024-03-27T09:59:43.968 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.979+0000 7fc93cc00640 1 -- 172.21.15.57:0/1465537905 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7fc934059ff0 con 0x7fc9400ca6e0 2024-03-27T09:59:43.968 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2024-03-27T09:59:43.971 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.981+0000 7fc946400640 1 -- 172.21.15.57:0/1465537905 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fc92006c530 msgr2=0x7fc92006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:43.971 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.981+0000 7fc946400640 1 --2- 172.21.15.57:0/1465537905 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fc92006c530 0x7fc92006e9f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc92c036000 tx=0x7fc92c03d040 comp rx=0 tx=0).stop 2024-03-27T09:59:43.971 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.982+0000 7fc946400640 1 -- 172.21.15.57:0/1465537905 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9400ca6e0 msgr2=0x7fc94014b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:43.971 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.982+0000 7fc946400640 1 --2- 172.21.15.57:0/1465537905 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9400ca6e0 0x7fc94014b4f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc93400ebe0 tx=0x7fc93400c520 comp rx=0 tx=0).stop 2024-03-27T09:59:43.971 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.982+0000 7fc946400640 1 -- 172.21.15.57:0/1465537905 shutdown_connections 2024-03-27T09:59:43.971 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.982+0000 7fc946400640 1 --2- 172.21.15.57:0/1465537905 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fc92006c530 0x7fc92006e9f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:43.971 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.982+0000 7fc946400640 1 --2- 172.21.15.57:0/1465537905 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc9400cbb50 0x7fc9400b4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:43.971 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.982+0000 7fc946400640 1 --2- 172.21.15.57:0/1465537905 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc9400cb000 0x7fc9400b2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:43.971 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.982+0000 7fc946400640 1 --2- 172.21.15.57:0/1465537905 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9400ca6e0 0x7fc94014b4f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:43.971 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.982+0000 7fc946400640 1 -- 172.21.15.57:0/1465537905 >> 172.21.15.57:0/1465537905 conn(0x7fc9400cfb40 msgr2=0x7fc9400ad8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:43.972 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.982+0000 7fc946400640 1 -- 172.21.15.57:0/1465537905 shutdown_connections 2024-03-27T09:59:43.972 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:43.982+0000 7fc946400640 1 -- 172.21.15.57:0/1465537905 wait complete. 2024-03-27T09:59:43.989 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-27T09:59:44.207 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.218+0000 7f877dc00640 1 Processor -- start 2024-03-27T09:59:44.207 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.218+0000 7f877dc00640 1 -- start start 2024-03-27T09:59:44.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.219+0000 7f877dc00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8778161830 0x7f87780cf970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:44.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.219+0000 7f877dc00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f87780d0e90 0x7f87780c7b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:44.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.219+0000 7f877dc00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87780d2d90 con 0x7f87780cfeb0 2024-03-27T09:59:44.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.219+0000 7f877dc00640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f87780cf4e0 con 0x7f87780d0e90 2024-03-27T09:59:44.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.219+0000 7f877dc00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f87780cee90 con 0x7f8778161830 2024-03-27T09:59:44.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.220+0000 7f877d200640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f87780d0e90 0x7f87780c7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:44.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.220+0000 7f8777e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8778161830 0x7f87780cf970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:44.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.220+0000 7f877d200640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f87780d0e90 0x7f87780c7b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46336/0 (socket says 172.21.15.57:46336) 2024-03-27T09:59:44.210 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.220+0000 7f877d200640 1 -- 172.21.15.57:0/518744395 learned_addr learned my addr 172.21.15.57:0/518744395 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T09:59:44.210 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.221+0000 7f877d200640 1 -- 172.21.15.57:0/518744395 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8778161830 msgr2=0x7f87780cf970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T09:59:44.210 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.221+0000 7f877d200640 1 --2- 172.21.15.57:0/518744395 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8778161830 0x7f87780cf970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:44.210 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.221+0000 7f877d200640 1 -- 172.21.15.57:0/518744395 >> v1:172.21.15.118:6789/0 conn(0x7f87780cfeb0 legacy=0x7f87780d0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:44.210 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.221+0000 7f877d200640 1 -- 172.21.15.57:0/518744395 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87780cf170 con 0x7f87780d0e90 2024-03-27T09:59:44.211 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.222+0000 7f877d200640 1 --2- 172.21.15.57:0/518744395 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f87780d0e90 0x7f87780c7b80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8770009e50 tx=0x7f877002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c73787ca008cfb3a server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:44.211 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.222+0000 7f8776a00640 1 -- 172.21.15.57:0/518744395 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f877002ca70 con 0x7f87780d0e90 2024-03-27T09:59:44.211 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.222+0000 7f8776a00640 1 -- 172.21.15.57:0/518744395 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f877002cc10 con 0x7f87780d0e90 2024-03-27T09:59:44.211 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.222+0000 7f8776a00640 1 -- 172.21.15.57:0/518744395 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87700343f0 con 0x7f87780d0e90 2024-03-27T09:59:44.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.223+0000 7f877dc00640 1 -- 172.21.15.57:0/518744395 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f87780d0e90 msgr2=0x7f87780c7b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:44.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.223+0000 7f877dc00640 1 --2- 172.21.15.57:0/518744395 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f87780d0e90 0x7f87780c7b80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8770009e50 tx=0x7f877002bed0 comp rx=0 tx=0).stop 2024-03-27T09:59:44.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.223+0000 7f877dc00640 1 -- 172.21.15.57:0/518744395 shutdown_connections 2024-03-27T09:59:44.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.223+0000 7f877dc00640 1 --2- 172.21.15.57:0/518744395 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f87780d0e90 0x7f87780c7b80 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:44.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.223+0000 7f877dc00640 1 --2- 172.21.15.57:0/518744395 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8778161830 0x7f87780cf970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:44.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.223+0000 7f877dc00640 1 -- 172.21.15.57:0/518744395 >> 172.21.15.57:0/518744395 conn(0x7f87780d4030 msgr2=0x7f87780d4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:44.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.223+0000 7f877dc00640 1 -- 172.21.15.57:0/518744395 shutdown_connections 2024-03-27T09:59:44.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.223+0000 7f877dc00640 1 -- 172.21.15.57:0/518744395 wait complete. 2024-03-27T09:59:44.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.225+0000 7f877dc00640 1 Processor -- start 2024-03-27T09:59:44.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.225+0000 7f877dc00640 1 -- start start 2024-03-27T09:59:44.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.226+0000 7f877dc00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f87780cfeb0 0x7f87781f4470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:44.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.226+0000 7f877dc00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f87780d0e90 0x7f8778160b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:44.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.226+0000 7f877dc00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8778161830 0x7f877815e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:44.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.226+0000 7f877dc00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f87780ce4b0 con 0x7f87780d0e90 2024-03-27T09:59:44.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.226+0000 7f877dc00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f87780ce330 con 0x7f8778161830 2024-03-27T09:59:44.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.226+0000 7f877dc00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f8778161c10 con 0x7f87780cfeb0 2024-03-27T09:59:44.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.226+0000 7f8777400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f87780d0e90 0x7f8778160b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:44.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.226+0000 7f8777400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f87780d0e90 0x7f8778160b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46338/0 (socket says 172.21.15.57:46338) 2024-03-27T09:59:44.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.226+0000 7f8777400640 1 -- 172.21.15.57:0/971289583 learned_addr learned my addr 172.21.15.57:0/971289583 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T09:59:44.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.226+0000 7f8777e00640 1 --2- 172.21.15.57:0/971289583 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f87780cfeb0 0x7f87781f4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:44.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.227+0000 7f877d200640 1 --2- 172.21.15.57:0/971289583 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8778161830 0x7f877815e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:44.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.227+0000 7f8777400640 1 -- 172.21.15.57:0/971289583 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f87780cfeb0 msgr2=0x7f87781f4470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:44.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.227+0000 7f8777400640 1 --2- 172.21.15.57:0/971289583 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f87780cfeb0 0x7f87781f4470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:44.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.227+0000 7f8777400640 1 -- 172.21.15.57:0/971289583 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8778161830 msgr2=0x7f877815e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:44.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.227+0000 7f8777400640 1 --2- 172.21.15.57:0/971289583 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8778161830 0x7f877815e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:44.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.227+0000 7f8777400640 1 -- 172.21.15.57:0/971289583 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f877815ed80 con 0x7f87780d0e90 2024-03-27T09:59:44.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.227+0000 7f877d200640 1 --2- 172.21.15.57:0/971289583 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8778161830 0x7f877815e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T09:59:44.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.227+0000 7f8777400640 1 --2- 172.21.15.57:0/971289583 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f87780d0e90 0x7f8778160b30 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f876400c400 tx=0x7f876400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:44.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.227+0000 7f876fe00640 1 -- 172.21.15.57:0/971289583 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87640052d0 con 0x7f87780d0e90 2024-03-27T09:59:44.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.227+0000 7f876fe00640 1 -- 172.21.15.57:0/971289583 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8764005490 con 0x7f87780d0e90 2024-03-27T09:59:44.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.227+0000 7f877dc00640 1 -- 172.21.15.57:0/971289583 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8778159170 con 0x7f87780d0e90 2024-03-27T09:59:44.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.227+0000 7f876fe00640 1 -- 172.21.15.57:0/971289583 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8764007260 con 0x7f87780d0e90 2024-03-27T09:59:44.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.227+0000 7f877dc00640 1 -- 172.21.15.57:0/971289583 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8778159730 con 0x7f87780d0e90 2024-03-27T09:59:44.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.229+0000 7f877dc00640 1 -- 172.21.15.57:0/971289583 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8778159930 con 0x7f87780d0e90 2024-03-27T09:59:44.219 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.230+0000 7f876fe00640 1 -- 172.21.15.57:0/971289583 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f8764007400 con 0x7f87780d0e90 2024-03-27T09:59:44.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.231+0000 7f876fe00640 1 --2- 172.21.15.57:0/971289583 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f875806c530 0x7f875806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:44.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.231+0000 7f876fe00640 1 -- 172.21.15.57:0/971289583 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f876408aff0 con 0x7f87780d0e90 2024-03-27T09:59:44.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.231+0000 7f8777e00640 1 --2- 172.21.15.57:0/971289583 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f875806c530 0x7f875806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:44.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.232+0000 7f8777e00640 1 --2- 172.21.15.57:0/971289583 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f875806c530 0x7f875806e9f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8768009a30 tx=0x7f8768008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:44.225 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.236+0000 7f876fe00640 1 -- 172.21.15.57:0/971289583 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f8778159930 con 0x7f87780d0e90 2024-03-27T09:59:44.440 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.451+0000 7f877dc00640 1 -- 172.21.15.57:0/971289583 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f8778068540 con 0x7f87780d0e90 2024-03-27T09:59:44.441 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.452+0000 7f876fe00640 1 -- 172.21.15.57:0/971289583 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7f8764059270 con 0x7f87780d0e90 2024-03-27T09:59:44.441 INFO:teuthology.orchestra.run.smithi057.stderr:listed 0 entries 2024-03-27T09:59:44.444 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.454+0000 7f877dc00640 1 -- 172.21.15.57:0/971289583 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f875806c530 msgr2=0x7f875806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:44.444 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.454+0000 7f877dc00640 1 --2- 172.21.15.57:0/971289583 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f875806c530 0x7f875806e9f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8768009a30 tx=0x7f8768008040 comp rx=0 tx=0).stop 2024-03-27T09:59:44.444 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.454+0000 7f877dc00640 1 -- 172.21.15.57:0/971289583 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f87780d0e90 msgr2=0x7f8778160b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:44.444 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.454+0000 7f877dc00640 1 --2- 172.21.15.57:0/971289583 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f87780d0e90 0x7f8778160b30 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f876400c400 tx=0x7f876400c8c0 comp rx=0 tx=0).stop 2024-03-27T09:59:44.444 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.455+0000 7f877dc00640 1 -- 172.21.15.57:0/971289583 shutdown_connections 2024-03-27T09:59:44.444 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.455+0000 7f877dc00640 1 --2- 172.21.15.57:0/971289583 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f875806c530 0x7f875806e9f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:44.444 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.455+0000 7f877dc00640 1 --2- 172.21.15.57:0/971289583 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8778161830 0x7f877815e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:44.444 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.455+0000 7f877dc00640 1 --2- 172.21.15.57:0/971289583 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f87780d0e90 0x7f8778160b30 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:44.444 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.455+0000 7f877dc00640 1 --2- 172.21.15.57:0/971289583 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f87780cfeb0 0x7f87781f4470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:44.444 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.455+0000 7f877dc00640 1 -- 172.21.15.57:0/971289583 >> 172.21.15.57:0/971289583 conn(0x7f87780d4030 msgr2=0x7f87780ca160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:44.445 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.455+0000 7f877dc00640 1 -- 172.21.15.57:0/971289583 shutdown_connections 2024-03-27T09:59:44.445 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.455+0000 7f877dc00640 1 -- 172.21.15.57:0/971289583 wait complete. 2024-03-27T09:59:44.463 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-03-27T09:59:44.463 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-27T09:59:44.516 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-27T09:59:44.740 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.751+0000 7ffbb1a00640 1 Processor -- start 2024-03-27T09:59:44.740 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.751+0000 7ffbb1a00640 1 -- start start 2024-03-27T09:59:44.742 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.753+0000 7ffbb1a00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ffbac06b750 0x7ffbac06bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:44.742 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.753+0000 7ffbb1a00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffbac0ce740 0x7ffbac0cebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:44.742 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.753+0000 7ffbb1a00640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffbac15fc70 con 0x7ffbac145820 2024-03-27T09:59:44.742 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.753+0000 7ffbb1a00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7ffbac160b60 con 0x7ffbac06b750 2024-03-27T09:59:44.742 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.753+0000 7ffbb1a00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7ffbac06c0d0 con 0x7ffbac0ce740 2024-03-27T09:59:44.742 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.753+0000 7ffbaaa00640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7ffbac145820 0x7ffbac0cc950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:44850/0 (socket says 172.21.15.57:44850) 2024-03-27T09:59:44.742 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.753+0000 7ffbaaa00640 1 -- 172.21.15.57:0/2780577921 learned_addr learned my addr 172.21.15.57:0/2780577921 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T09:59:44.743 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.753+0000 7ffbab400640 1 --2- 172.21.15.57:0/2780577921 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffbac0ce740 0x7ffbac0cebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:44.743 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.753+0000 7ffbaa000640 1 --2- 172.21.15.57:0/2780577921 >> v2:172.21.15.118:3300/0 conn(0x7ffbac06b750 0x7ffbac06bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:44.743 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.754+0000 7ffba9600640 1 -- 172.21.15.57:0/2780577921 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 791491509 0 0) 0x7ffbac15fc70 con 0x7ffbac145820 2024-03-27T09:59:44.744 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.754+0000 7ffba9600640 1 -- 172.21.15.57:0/2780577921 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffb90003520 con 0x7ffbac145820 2024-03-27T09:59:44.744 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.754+0000 7ffbab400640 1 -- 172.21.15.57:0/2780577921 >> v2:172.21.15.118:3300/0 conn(0x7ffbac06b750 msgr2=0x7ffbac06bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T09:59:44.744 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.754+0000 7ffbab400640 1 --2- 172.21.15.57:0/2780577921 >> v2:172.21.15.118:3300/0 conn(0x7ffbac06b750 0x7ffbac06bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:44.744 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.754+0000 7ffbab400640 1 -- 172.21.15.57:0/2780577921 >> v1:172.21.15.57:6789/0 conn(0x7ffbac145820 legacy=0x7ffbac0cc950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:44.744 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.754+0000 7ffba9600640 1 -- 172.21.15.57:0/2780577921 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1774336536 0 0) 0x7ffb90003520 con 0x7ffbac145820 2024-03-27T09:59:44.744 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.754+0000 7ffbab400640 1 -- 172.21.15.57:0/2780577921 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbac15ff50 con 0x7ffbac0ce740 2024-03-27T09:59:44.744 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.754+0000 7ffbaa000640 1 --2- 172.21.15.57:0/2780577921 >> v2:172.21.15.118:3300/0 conn(0x7ffbac06b750 0x7ffbac06bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T09:59:44.744 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.756+0000 7ffbab400640 1 --2- 172.21.15.57:0/2780577921 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffbac0ce740 0x7ffbac0cebb0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ffba4009d90 tx=0x7ffba402bd70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=930c696fdb8d2cc1 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:44.745 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.756+0000 7ffba9600640 1 -- 172.21.15.57:0/2780577921 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffba4039070 con 0x7ffbac0ce740 2024-03-27T09:59:44.745 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.756+0000 7ffba9600640 1 -- 172.21.15.57:0/2780577921 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffba402c8a0 con 0x7ffbac0ce740 2024-03-27T09:59:44.745 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.756+0000 7ffba9600640 1 -- 172.21.15.57:0/2780577921 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb9c001670 con 0x7ffbac0ce740 2024-03-27T09:59:44.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.756+0000 7ffbb1a00640 1 -- 172.21.15.57:0/2780577921 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffbac0ce740 msgr2=0x7ffbac0cebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:44.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.757+0000 7ffbb1a00640 1 --2- 172.21.15.57:0/2780577921 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffbac0ce740 0x7ffbac0cebb0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ffba4009d90 tx=0x7ffba402bd70 comp rx=0 tx=0).stop 2024-03-27T09:59:44.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.757+0000 7ffbb1a00640 1 -- 172.21.15.57:0/2780577921 shutdown_connections 2024-03-27T09:59:44.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.757+0000 7ffbb1a00640 1 --2- 172.21.15.57:0/2780577921 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffbac0ce740 0x7ffbac0cebb0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:44.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.757+0000 7ffbb1a00640 1 --2- 172.21.15.57:0/2780577921 >> v2:172.21.15.118:3300/0 conn(0x7ffbac06b750 0x7ffbac06bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:44.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.757+0000 7ffbb1a00640 1 -- 172.21.15.57:0/2780577921 >> 172.21.15.57:0/2780577921 conn(0x7ffbac0b1c60 msgr2=0x7ffbac0b2070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:44.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.757+0000 7ffbb1a00640 1 -- 172.21.15.57:0/2780577921 shutdown_connections 2024-03-27T09:59:44.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.757+0000 7ffbb1a00640 1 -- 172.21.15.57:0/2780577921 wait complete. 2024-03-27T09:59:44.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.758+0000 7ffbb1a00640 1 Processor -- start 2024-03-27T09:59:44.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.759+0000 7ffbb1a00640 1 -- start start 2024-03-27T09:59:44.749 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.759+0000 7ffbb1a00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffbac06b750 0x7ffbac157880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:44.749 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.759+0000 7ffbb1a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffbac0ce740 0x7ffbac0ad8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:44.749 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.759+0000 7ffbb1a00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffbac145820 0x7ffbac155770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:44.749 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.759+0000 7ffbb1a00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7ffbac1607f0 con 0x7ffbac145820 2024-03-27T09:59:44.749 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.759+0000 7ffbb1a00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7ffbac160510 con 0x7ffbac0ce740 2024-03-27T09:59:44.749 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.759+0000 7ffbb1a00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7ffbac145c00 con 0x7ffbac06b750 2024-03-27T09:59:44.749 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.760+0000 7ffbab400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffbac145820 0x7ffbac155770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:44.750 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.760+0000 7ffbab400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffbac145820 0x7ffbac155770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46352/0 (socket says 172.21.15.57:46352) 2024-03-27T09:59:44.750 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.760+0000 7ffbab400640 1 -- 172.21.15.57:0/1398167023 learned_addr learned my addr 172.21.15.57:0/1398167023 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T09:59:44.750 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.760+0000 7ffbaa000640 1 --2- 172.21.15.57:0/1398167023 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffbac0ce740 0x7ffbac0ad8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:44.750 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.760+0000 7ffbaaa00640 1 --2- 172.21.15.57:0/1398167023 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffbac06b750 0x7ffbac157880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:44.750 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.760+0000 7ffbab400640 1 -- 172.21.15.57:0/1398167023 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffbac06b750 msgr2=0x7ffbac157880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:44.750 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.760+0000 7ffbab400640 1 --2- 172.21.15.57:0/1398167023 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffbac06b750 0x7ffbac157880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:44.750 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.760+0000 7ffbab400640 1 -- 172.21.15.57:0/1398167023 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffbac0ce740 msgr2=0x7ffbac0ad8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:44.750 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.760+0000 7ffbab400640 1 --2- 172.21.15.57:0/1398167023 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffbac0ce740 0x7ffbac0ad8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:44.750 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.760+0000 7ffbab400640 1 -- 172.21.15.57:0/1398167023 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbac0ae210 con 0x7ffbac145820 2024-03-27T09:59:44.750 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.760+0000 7ffbaa000640 1 --2- 172.21.15.57:0/1398167023 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffbac0ce740 0x7ffbac0ad8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T09:59:44.751 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.761+0000 7ffbab400640 1 --2- 172.21.15.57:0/1398167023 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffbac145820 0x7ffbac155770 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ffba4009eb0 tx=0x7ffba4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:44.751 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.761+0000 7ffba2a00640 1 -- 172.21.15.57:0/1398167023 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffba4039050 con 0x7ffbac145820 2024-03-27T09:59:44.751 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.761+0000 7ffba2a00640 1 -- 172.21.15.57:0/1398167023 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffba403a040 con 0x7ffbac145820 2024-03-27T09:59:44.751 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.761+0000 7ffbb1a00640 1 -- 172.21.15.57:0/1398167023 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbac0ae4f0 con 0x7ffbac145820 2024-03-27T09:59:44.751 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.761+0000 7ffba2a00640 1 -- 172.21.15.57:0/1398167023 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffba4009450 con 0x7ffbac145820 2024-03-27T09:59:44.751 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.761+0000 7ffbb1a00640 1 -- 172.21.15.57:0/1398167023 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbac0aeab0 con 0x7ffbac145820 2024-03-27T09:59:44.751 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.762+0000 7ffbb1a00640 1 -- 172.21.15.57:0/1398167023 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbac068620 con 0x7ffbac145820 2024-03-27T09:59:44.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.763+0000 7ffba2a00640 1 -- 172.21.15.57:0/1398167023 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7ffba4047020 con 0x7ffbac145820 2024-03-27T09:59:44.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.764+0000 7ffba2a00640 1 --2- 172.21.15.57:0/1398167023 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7ffb8c06c560 0x7ffb8c06ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:44.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.764+0000 7ffba2a00640 1 -- 172.21.15.57:0/1398167023 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7ffba40ad910 con 0x7ffbac145820 2024-03-27T09:59:44.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.765+0000 7ffbaaa00640 1 --2- 172.21.15.57:0/1398167023 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7ffb8c06c560 0x7ffb8c06ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:44.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.765+0000 7ffbaaa00640 1 --2- 172.21.15.57:0/1398167023 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7ffb8c06c560 0x7ffb8c06ea20 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ffb9c0011e0 tx=0x7ffb9c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:44.758 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.769+0000 7ffba2a00640 1 -- 172.21.15.57:0/1398167023 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7ffba404e020 con 0x7ffbac145820 2024-03-27T09:59:44.964 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.975+0000 7ffbb1a00640 1 -- 172.21.15.57:0/1398167023 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ffbac0b4a70 con 0x7ffbac145820 2024-03-27T09:59:44.967 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.978+0000 7ffba2a00640 1 -- 172.21.15.57:0/1398167023 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18502 (secure 0 0 0) 0x7ffba407bb50 con 0x7ffbac145820 2024-03-27T09:59:44.968 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T09:59:44.968 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":26,"fsid":"7ac43f86-2c16-4a97-98fb-715d3cebc75c","created":"2024-03-27T09:59:04.033417+0000","modified":"2024-03-27T09:59:35.208743+0000","last_up_change":"2024-03-27T09:59:16.969624+0000","last_in_change":"2024-03-27T09:59:07.421690+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-27T09:59:17.253008+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-27T09:59:26.690365+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-27T09:59:27.559059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-27T09:59:31.187596+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"47b44362-7302-4f2a-b735-582c6c3850cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6801","nonce":2020036298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6803","nonce":2020036298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6807","nonce":2020036298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6805","nonce":2020036298}]},"public_addr":"172.21.15.57:6801/2020036298","cluster_addr":"172.21.15.57:6803/2020036298","heartbeat_back_addr":"172.21.15.57:6807/2020036298","heartbeat_front_addr":"172.21.15.57:6805/2020036298","state":["exists","up"]},{"osd":1,"uuid":"feaf96f0-9431-4188-9a09-da505b40e934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6809","nonce":3190929242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6811","nonce":3190929242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6815","nonce":3190929242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6813","nonce":3190929242}]},"public_addr":"172.21.15.57:6809/3190929242","cluster_addr":"172.21.15.57:6811/3190929242","heartbeat_back_addr":"172.21.15.57:6815/3190929242","heartbeat_front_addr":"172.21.15.57:6813/3190929242","state":["exists","up"]},{"osd":2,"uuid":"21e406e6-cfbc-4fe7-a816-e2420487c95d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6817","nonce":4065849973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6819","nonce":4065849973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6823","nonce":4065849973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6821","nonce":4065849973}]},"public_addr":"172.21.15.57:6817/4065849973","cluster_addr":"172.21.15.57:6819/4065849973","heartbeat_back_addr":"172.21.15.57:6823/4065849973","heartbeat_front_addr":"172.21.15.57:6821/4065849973","state":["exists","up"]},{"osd":3,"uuid":"a389af1d-76c4-4dfc-b215-f983f4931257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6825","nonce":158084809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6827","nonce":158084809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6831","nonce":158084809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6829","nonce":158084809}]},"public_addr":"172.21.15.57:6825/158084809","cluster_addr":"172.21.15.57:6827/158084809","heartbeat_back_addr":"172.21.15.57:6831/158084809","heartbeat_front_addr":"172.21.15.57:6829/158084809","state":["exists","up"]},{"osd":4,"uuid":"e9b05dca-557a-43ee-b43f-9ce5b7d28304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6823","nonce":108719401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6827","nonce":108719401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6831","nonce":108719401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6829","nonce":108719401}]},"public_addr":"172.21.15.118:6823/108719401","cluster_addr":"172.21.15.118:6827/108719401","heartbeat_back_addr":"172.21.15.118:6831/108719401","heartbeat_front_addr":"172.21.15.118:6829/108719401","state":["exists","up"]},{"osd":5,"uuid":"d968177d-44ff-499a-b00a-b147ed879253","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6817","nonce":2704605866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6819","nonce":2704605866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6826","nonce":2704605866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6822","nonce":2704605866}]},"public_addr":"172.21.15.118:6817/2704605866","cluster_addr":"172.21.15.118:6819/2704605866","heartbeat_back_addr":"172.21.15.118:6826/2704605866","heartbeat_front_addr":"172.21.15.118:6822/2704605866","state":["exists","up"]},{"osd":6,"uuid":"e8f98052-e6ad-4cfe-a4a9-0b17a434d54e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6801","nonce":1963659095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6803","nonce":1963659095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6807","nonce":1963659095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6805","nonce":1963659095}]},"public_addr":"172.21.15.118:6801/1963659095","cluster_addr":"172.21.15.118:6803/1963659095","heartbeat_back_addr":"172.21.15.118:6807/1963659095","heartbeat_front_addr":"172.21.15.118:6805/1963659095","state":["exists","up"]},{"osd":7,"uuid":"eccff987-8e51-4a63-845a-cf0a3196d7fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6809","nonce":1955879596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6811","nonce":1955879596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6815","nonce":1955879596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6813","nonce":1955879596}]},"public_addr":"172.21.15.118:6809/1955879596","cluster_addr":"172.21.15.118:6811/1955879596","heartbeat_back_addr":"172.21.15.118:6815/1955879596","heartbeat_front_addr":"172.21.15.118:6813/1955879596","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.721258+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.696610+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.777895+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.806769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.743259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.845687+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:13.020165+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.722294+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-27T09:59:44.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.981+0000 7ffbb1a00640 1 -- 172.21.15.57:0/1398167023 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7ffb8c06c560 msgr2=0x7ffb8c06ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:44.971 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.981+0000 7ffbb1a00640 1 --2- 172.21.15.57:0/1398167023 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7ffb8c06c560 0x7ffb8c06ea20 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ffb9c0011e0 tx=0x7ffb9c009040 comp rx=0 tx=0).stop 2024-03-27T09:59:44.971 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.981+0000 7ffbb1a00640 1 -- 172.21.15.57:0/1398167023 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffbac145820 msgr2=0x7ffbac155770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:44.971 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.981+0000 7ffbb1a00640 1 --2- 172.21.15.57:0/1398167023 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffbac145820 0x7ffbac155770 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ffba4009eb0 tx=0x7ffba4004a40 comp rx=0 tx=0).stop 2024-03-27T09:59:44.971 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.981+0000 7ffbb1a00640 1 -- 172.21.15.57:0/1398167023 shutdown_connections 2024-03-27T09:59:44.971 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.981+0000 7ffbb1a00640 1 --2- 172.21.15.57:0/1398167023 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ffbac145820 0x7ffbac155770 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:44.971 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.981+0000 7ffbb1a00640 1 --2- 172.21.15.57:0/1398167023 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7ffb8c06c560 0x7ffb8c06ea20 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:44.971 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.981+0000 7ffbb1a00640 1 --2- 172.21.15.57:0/1398167023 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ffbac0ce740 0x7ffbac0ad8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:44.971 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.981+0000 7ffbb1a00640 1 --2- 172.21.15.57:0/1398167023 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ffbac06b750 0x7ffbac157880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:44.971 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.981+0000 7ffbb1a00640 1 -- 172.21.15.57:0/1398167023 >> 172.21.15.57:0/1398167023 conn(0x7ffbac0b1c60 msgr2=0x7ffbac0b2960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:44.971 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.982+0000 7ffbb1a00640 1 -- 172.21.15.57:0/1398167023 shutdown_connections 2024-03-27T09:59:44.971 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:44.982+0000 7ffbb1a00640 1 -- 172.21.15.57:0/1398167023 wait complete. 2024-03-27T09:59:44.991 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-27T09:59:17.253008+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-27T09:59:26.690365+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-27T09:59:27.559059+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-27T09:59:31.187596+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-27T09:59:44.991 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-27T09:59:45.219 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.230+0000 7ff333c00640 1 Processor -- start 2024-03-27T09:59:45.219 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.230+0000 7ff333c00640 1 -- start start 2024-03-27T09:59:45.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.231+0000 7ff333c00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff32c161c00 0x7ff32c0d1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:45.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.231+0000 7ff333c00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ff32c0d4c10 0x7ff32c0b3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:45.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.231+0000 7ff333c00640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff32c0cfe40 con 0x7ff32c0d2820 2024-03-27T09:59:45.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.231+0000 7ff333c00640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7ff32c0d2410 con 0x7ff32c161c00 2024-03-27T09:59:45.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.231+0000 7ff333c00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7ff32c0d0400 con 0x7ff32c0d4c10 2024-03-27T09:59:45.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.231+0000 7ff32be00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff32c161c00 0x7ff32c0d1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:45.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.231+0000 7ff32be00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff32c161c00 0x7ff32c0d1ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46364/0 (socket says 172.21.15.57:46364) 2024-03-27T09:59:45.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.231+0000 7ff32be00640 1 -- 172.21.15.57:0/2791779410 learned_addr learned my addr 172.21.15.57:0/2791779410 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T09:59:45.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.231+0000 7ff331200640 1 --1- 172.21.15.57:0/2791779410 >> v1:172.21.15.57:6789/0 conn(0x7ff32c0d2820 0x7ff32c1614f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:44862/0 (socket says 172.21.15.57:44862) 2024-03-27T09:59:45.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.232+0000 7ff331c00640 1 --2- 172.21.15.57:0/2791779410 >> v2:172.21.15.118:3300/0 conn(0x7ff32c0d4c10 0x7ff32c0b3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:45.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.232+0000 7ff32be00640 1 -- 172.21.15.57:0/2791779410 >> v2:172.21.15.118:3300/0 conn(0x7ff32c0d4c10 msgr2=0x7ff32c0b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T09:59:45.222 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.232+0000 7ff32be00640 1 --2- 172.21.15.57:0/2791779410 >> v2:172.21.15.118:3300/0 conn(0x7ff32c0d4c10 0x7ff32c0b3fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:45.222 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.232+0000 7ff32be00640 1 -- 172.21.15.57:0/2791779410 >> v1:172.21.15.57:6789/0 conn(0x7ff32c0d2820 legacy=0x7ff32c1614f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:45.222 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.232+0000 7ff32be00640 1 -- 172.21.15.57:0/2791779410 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff32c0d0120 con 0x7ff32c161c00 2024-03-27T09:59:45.222 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.233+0000 7ff32be00640 1 --2- 172.21.15.57:0/2791779410 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff32c161c00 0x7ff32c0d1ed0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff32c0739e0 tx=0x7ff31402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=295747471cb49d3a server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:45.222 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.233+0000 7ff32b400640 1 -- 172.21.15.57:0/2791779410 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff314035020 con 0x7ff32c161c00 2024-03-27T09:59:45.222 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.233+0000 7ff32b400640 1 -- 172.21.15.57:0/2791779410 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff314031870 con 0x7ff32c161c00 2024-03-27T09:59:45.222 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.233+0000 7ff32b400640 1 -- 172.21.15.57:0/2791779410 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff314031c40 con 0x7ff32c161c00 2024-03-27T09:59:45.223 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.234+0000 7ff333c00640 1 -- 172.21.15.57:0/2791779410 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff32c161c00 msgr2=0x7ff32c0d1ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:45.223 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.234+0000 7ff333c00640 1 --2- 172.21.15.57:0/2791779410 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff32c161c00 0x7ff32c0d1ed0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff32c0739e0 tx=0x7ff31402b910 comp rx=0 tx=0).stop 2024-03-27T09:59:45.223 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.234+0000 7ff333c00640 1 -- 172.21.15.57:0/2791779410 shutdown_connections 2024-03-27T09:59:45.223 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.234+0000 7ff333c00640 1 --2- 172.21.15.57:0/2791779410 >> v2:172.21.15.118:3300/0 conn(0x7ff32c0d4c10 0x7ff32c0b3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:45.223 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.234+0000 7ff333c00640 1 --2- 172.21.15.57:0/2791779410 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff32c161c00 0x7ff32c0d1ed0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:45.223 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.234+0000 7ff333c00640 1 -- 172.21.15.57:0/2791779410 >> 172.21.15.57:0/2791779410 conn(0x7ff32c0d40f0 msgr2=0x7ff32c0d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:45.223 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.234+0000 7ff333c00640 1 -- 172.21.15.57:0/2791779410 shutdown_connections 2024-03-27T09:59:45.224 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.234+0000 7ff333c00640 1 -- 172.21.15.57:0/2791779410 wait complete. 2024-03-27T09:59:45.225 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.236+0000 7ff333c00640 1 Processor -- start 2024-03-27T09:59:45.225 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.236+0000 7ff333c00640 1 -- start start 2024-03-27T09:59:45.227 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.237+0000 7ff333c00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff32c0d2820 0x7ff32c154620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:45.227 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.237+0000 7ff333c00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff32c0d4c10 0x7ff32c0b71c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:45.227 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.237+0000 7ff333c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff32c161c00 0x7ff32c0b7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:45.227 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.237+0000 7ff333c00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7ff32c0d2c00 con 0x7ff32c0d4c10 2024-03-27T09:59:45.227 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.237+0000 7ff333c00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7ff32c0b3ab0 con 0x7ff32c161c00 2024-03-27T09:59:45.227 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.237+0000 7ff333c00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7ff32c0d2d80 con 0x7ff32c0d2820 2024-03-27T09:59:45.227 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.237+0000 7ff32be00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff32c0d4c10 0x7ff32c0b71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:45.227 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.237+0000 7ff32be00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff32c0d4c10 0x7ff32c0b71c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46374/0 (socket says 172.21.15.57:46374) 2024-03-27T09:59:45.227 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.237+0000 7ff32be00640 1 -- 172.21.15.57:0/2269627869 learned_addr learned my addr 172.21.15.57:0/2269627869 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T09:59:45.227 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.238+0000 7ff331200640 1 --2- 172.21.15.57:0/2269627869 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff32c0d2820 0x7ff32c154620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:45.227 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.238+0000 7ff331c00640 1 --2- 172.21.15.57:0/2269627869 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff32c161c00 0x7ff32c0b7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:45.228 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.238+0000 7ff32be00640 1 -- 172.21.15.57:0/2269627869 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff32c0d2820 msgr2=0x7ff32c154620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:45.228 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.238+0000 7ff32be00640 1 --2- 172.21.15.57:0/2269627869 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff32c0d2820 0x7ff32c154620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:45.228 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.238+0000 7ff32be00640 1 -- 172.21.15.57:0/2269627869 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff32c161c00 msgr2=0x7ff32c0b7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:45.228 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.238+0000 7ff32be00640 1 --2- 172.21.15.57:0/2269627869 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff32c161c00 0x7ff32c0b7700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:45.228 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.238+0000 7ff32be00640 1 -- 172.21.15.57:0/2269627869 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff32c0b7d30 con 0x7ff32c0d4c10 2024-03-27T09:59:45.229 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.238+0000 7ff32be00640 1 --2- 172.21.15.57:0/2269627869 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff32c0d4c10 0x7ff32c0b71c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff31402b950 tx=0x7ff3140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:45.229 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.239+0000 7ff328c00640 1 -- 172.21.15.57:0/2269627869 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff314035040 con 0x7ff32c0d4c10 2024-03-27T09:59:45.229 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.239+0000 7ff328c00640 1 -- 172.21.15.57:0/2269627869 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff314030d00 con 0x7ff32c0d4c10 2024-03-27T09:59:45.229 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.239+0000 7ff328c00640 1 -- 172.21.15.57:0/2269627869 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3140456a0 con 0x7ff32c0d4c10 2024-03-27T09:59:45.229 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.239+0000 7ff333c00640 1 -- 172.21.15.57:0/2269627869 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff32c0b8010 con 0x7ff32c0d4c10 2024-03-27T09:59:45.229 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.239+0000 7ff333c00640 1 -- 172.21.15.57:0/2269627869 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff32c0b85d0 con 0x7ff32c0d4c10 2024-03-27T09:59:45.229 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.240+0000 7ff333c00640 1 -- 172.21.15.57:0/2269627869 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff32c068540 con 0x7ff32c0d4c10 2024-03-27T09:59:45.230 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.241+0000 7ff328c00640 1 -- 172.21.15.57:0/2269627869 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7ff314038020 con 0x7ff32c0d4c10 2024-03-27T09:59:45.231 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.242+0000 7ff328c00640 1 --2- 172.21.15.57:0/2269627869 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7ff30806c530 0x7ff30806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:45.231 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.242+0000 7ff328c00640 1 -- 172.21.15.57:0/2269627869 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7ff3140add20 con 0x7ff32c0d4c10 2024-03-27T09:59:45.231 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.242+0000 7ff331200640 1 --2- 172.21.15.57:0/2269627869 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7ff30806c530 0x7ff30806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:45.231 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.243+0000 7ff331200640 1 --2- 172.21.15.57:0/2269627869 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7ff30806c530 0x7ff30806e9f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff31c000f60 tx=0x7ff31c007cc0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:45.235 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.246+0000 7ff328c00640 1 -- 172.21.15.57:0/2269627869 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7ff31407bff0 con 0x7ff32c0d4c10 2024-03-27T09:59:45.437 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.448+0000 7ff333c00640 1 -- 172.21.15.57:0/2269627869 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff32c0d1ef0 con 0x7ff32c0d4c10 2024-03-27T09:59:45.438 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.449+0000 7ff328c00640 1 -- 172.21.15.57:0/2269627869 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7ff31407b8f0 con 0x7ff32c0d4c10 2024-03-27T09:59:45.439 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2024-03-27T09:59:45.442 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.452+0000 7ff333c00640 1 -- 172.21.15.57:0/2269627869 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7ff30806c530 msgr2=0x7ff30806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:45.442 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.452+0000 7ff333c00640 1 --2- 172.21.15.57:0/2269627869 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7ff30806c530 0x7ff30806e9f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff31c000f60 tx=0x7ff31c007cc0 comp rx=0 tx=0).stop 2024-03-27T09:59:45.442 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.452+0000 7ff333c00640 1 -- 172.21.15.57:0/2269627869 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff32c0d4c10 msgr2=0x7ff32c0b71c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:45.442 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.452+0000 7ff333c00640 1 --2- 172.21.15.57:0/2269627869 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff32c0d4c10 0x7ff32c0b71c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff31402b950 tx=0x7ff3140046c0 comp rx=0 tx=0).stop 2024-03-27T09:59:45.442 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.452+0000 7ff333c00640 1 -- 172.21.15.57:0/2269627869 shutdown_connections 2024-03-27T09:59:45.442 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.452+0000 7ff333c00640 1 --2- 172.21.15.57:0/2269627869 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7ff30806c530 0x7ff30806e9f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:45.442 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.452+0000 7ff333c00640 1 --2- 172.21.15.57:0/2269627869 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff32c161c00 0x7ff32c0b7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:45.442 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.452+0000 7ff333c00640 1 --2- 172.21.15.57:0/2269627869 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff32c0d4c10 0x7ff32c0b71c0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:45.442 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.452+0000 7ff333c00640 1 --2- 172.21.15.57:0/2269627869 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff32c0d2820 0x7ff32c154620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:45.442 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.452+0000 7ff333c00640 1 -- 172.21.15.57:0/2269627869 >> 172.21.15.57:0/2269627869 conn(0x7ff32c0d40f0 msgr2=0x7ff32c0b1f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:45.442 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.453+0000 7ff333c00640 1 -- 172.21.15.57:0/2269627869 shutdown_connections 2024-03-27T09:59:45.442 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.453+0000 7ff333c00640 1 -- 172.21.15.57:0/2269627869 wait complete. 2024-03-27T09:59:45.462 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-27T09:59:45.690 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.701+0000 7ff9bc600640 1 Processor -- start 2024-03-27T09:59:45.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.702+0000 7ff9bc600640 1 -- start start 2024-03-27T09:59:45.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.703+0000 7ff9bc600640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff9b40aea20 0x7ff9b415d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:45.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.703+0000 7ff9bc600640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9b40ad1d0 con 0x7ff9b406cf30 2024-03-27T09:59:45.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.703+0000 7ff9bc600640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9b415c4c0 con 0x7ff9b40acd60 2024-03-27T09:59:45.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.703+0000 7ff9bc600640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7ff9b4072600 con 0x7ff9b40aea20 2024-03-27T09:59:45.693 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.704+0000 7ff9b9c00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff9b40aea20 0x7ff9b415d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:45.693 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.704+0000 7ff9ba600640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7ff9b406cf30 0x7ff9b406d310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:44872/0 (socket says 172.21.15.57:44872) 2024-03-27T09:59:45.694 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.704+0000 7ff9ba600640 1 -- 172.21.15.57:0/489153515 learned_addr learned my addr 172.21.15.57:0/489153515 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T09:59:45.694 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.704+0000 7ff9b9c00640 1 -- 172.21.15.57:0/489153515 >> v1:172.21.15.118:6789/0 conn(0x7ff9b40acd60 legacy=0x7ff9b40aee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:45.694 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.704+0000 7ff9b9c00640 1 -- 172.21.15.57:0/489153515 >> v1:172.21.15.57:6789/0 conn(0x7ff9b406cf30 legacy=0x7ff9b406d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:45.694 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.704+0000 7ff9b9c00640 1 -- 172.21.15.57:0/489153515 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9b40728e0 con 0x7ff9b40aea20 2024-03-27T09:59:45.694 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.704+0000 7ff9b3e00640 1 -- 172.21.15.57:0/489153515 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1703624224 0 0) 0x7ff9b40ad1d0 con 0x7ff9b406cf30 2024-03-27T09:59:45.694 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.706+0000 7ff9b9c00640 1 --2- 172.21.15.57:0/489153515 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9b40aea20 0x7ff9b415d1a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff9a80097a0 tx=0x7ff9a802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84357ac9954cede7 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:45.695 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.706+0000 7ff9b3e00640 1 -- 172.21.15.57:0/489153515 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9a8035020 con 0x7ff9b40aea20 2024-03-27T09:59:45.695 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.706+0000 7ff9b3e00640 1 -- 172.21.15.57:0/489153515 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9a8031830 con 0x7ff9b40aea20 2024-03-27T09:59:45.695 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.706+0000 7ff9b3e00640 1 -- 172.21.15.57:0/489153515 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9a8031c00 con 0x7ff9b40aea20 2024-03-27T09:59:45.696 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.706+0000 7ff9bc600640 1 -- 172.21.15.57:0/489153515 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9b40aea20 msgr2=0x7ff9b415d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:45.696 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.706+0000 7ff9bc600640 1 --2- 172.21.15.57:0/489153515 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9b40aea20 0x7ff9b415d1a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff9a80097a0 tx=0x7ff9a802b8d0 comp rx=0 tx=0).stop 2024-03-27T09:59:45.696 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.706+0000 7ff9bc600640 1 -- 172.21.15.57:0/489153515 shutdown_connections 2024-03-27T09:59:45.696 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.707+0000 7ff9bc600640 1 --2- 172.21.15.57:0/489153515 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9b40aea20 0x7ff9b415d1a0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:45.696 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.707+0000 7ff9bc600640 1 -- 172.21.15.57:0/489153515 >> 172.21.15.57:0/489153515 conn(0x7ff9b40b18a0 msgr2=0x7ff9b40b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:45.696 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.707+0000 7ff9bc600640 1 -- 172.21.15.57:0/489153515 shutdown_connections 2024-03-27T09:59:45.696 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.707+0000 7ff9bc600640 1 -- 172.21.15.57:0/489153515 wait complete. 2024-03-27T09:59:45.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.708+0000 7ff9bc600640 1 Processor -- start 2024-03-27T09:59:45.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.708+0000 7ff9bc600640 1 -- start start 2024-03-27T09:59:45.699 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.709+0000 7ff9bc600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff9b406cf30 0x7ff9b40c8f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:45.699 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.709+0000 7ff9bc600640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9b40acd60 0x7ff9b40c9b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:45.699 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.709+0000 7ff9bc600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff9b40aea20 0x7ff9b4158160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:45.699 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.709+0000 7ff9bc600640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7ff9b40733c0 con 0x7ff9b40acd60 2024-03-27T09:59:45.700 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.709+0000 7ff9bc600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7ff9b4072ea0 con 0x7ff9b406cf30 2024-03-27T09:59:45.700 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.709+0000 7ff9bc600640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7ff9b406da20 con 0x7ff9b40aea20 2024-03-27T09:59:45.700 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.710+0000 7ff9b9200640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9b40acd60 0x7ff9b40c9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:45.700 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.710+0000 7ff9b9200640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9b40acd60 0x7ff9b40c9b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46396/0 (socket says 172.21.15.57:46396) 2024-03-27T09:59:45.700 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.710+0000 7ff9b9200640 1 -- 172.21.15.57:0/3802712698 learned_addr learned my addr 172.21.15.57:0/3802712698 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T09:59:45.700 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.710+0000 7ff9b9c00640 1 --2- 172.21.15.57:0/3802712698 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff9b406cf30 0x7ff9b40c8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:45.700 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.710+0000 7ff9ba600640 1 --2- 172.21.15.57:0/3802712698 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff9b40aea20 0x7ff9b4158160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:45.700 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.710+0000 7ff9b9200640 1 -- 172.21.15.57:0/3802712698 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff9b40aea20 msgr2=0x7ff9b4158160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:45.700 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.710+0000 7ff9b9200640 1 --2- 172.21.15.57:0/3802712698 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff9b40aea20 0x7ff9b4158160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:45.700 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.710+0000 7ff9b9200640 1 -- 172.21.15.57:0/3802712698 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff9b406cf30 msgr2=0x7ff9b40c8f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:45.700 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.710+0000 7ff9b9200640 1 --2- 172.21.15.57:0/3802712698 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff9b406cf30 0x7ff9b40c8f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:45.700 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.710+0000 7ff9b9200640 1 -- 172.21.15.57:0/3802712698 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9b409cc20 con 0x7ff9b40acd60 2024-03-27T09:59:45.700 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.710+0000 7ff9b9c00640 1 --2- 172.21.15.57:0/3802712698 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff9b406cf30 0x7ff9b40c8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T09:59:45.700 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.710+0000 7ff9ba600640 1 --2- 172.21.15.57:0/3802712698 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff9b40aea20 0x7ff9b4158160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T09:59:45.700 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.710+0000 7ff9b9200640 1 --2- 172.21.15.57:0/3802712698 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9b40acd60 0x7ff9b40c9b60 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff9a000c480 tx=0x7ff9a000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:45.701 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.711+0000 7ff9b1600640 1 -- 172.21.15.57:0/3802712698 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9a00052d0 con 0x7ff9b40acd60 2024-03-27T09:59:45.701 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.711+0000 7ff9b1600640 1 -- 172.21.15.57:0/3802712698 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9a0005470 con 0x7ff9b40acd60 2024-03-27T09:59:45.701 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.711+0000 7ff9b1600640 1 -- 172.21.15.57:0/3802712698 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9a0012870 con 0x7ff9b40acd60 2024-03-27T09:59:45.701 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.711+0000 7ff9bc600640 1 -- 172.21.15.57:0/3802712698 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9b409cee0 con 0x7ff9b40acd60 2024-03-27T09:59:45.701 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.711+0000 7ff9bc600640 1 -- 172.21.15.57:0/3802712698 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9b409d4a0 con 0x7ff9b40acd60 2024-03-27T09:59:45.701 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.712+0000 7ff9bc600640 1 -- 172.21.15.57:0/3802712698 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9b40757d0 con 0x7ff9b40acd60 2024-03-27T09:59:45.702 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.713+0000 7ff9b1600640 1 -- 172.21.15.57:0/3802712698 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7ff9a0012a10 con 0x7ff9b40acd60 2024-03-27T09:59:45.703 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.714+0000 7ff9b1600640 1 --2- 172.21.15.57:0/3802712698 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7ff99406c530 0x7ff99406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:45.703 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.714+0000 7ff9b1600640 1 -- 172.21.15.57:0/3802712698 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7ff9a008b6f0 con 0x7ff9b40acd60 2024-03-27T09:59:45.703 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.714+0000 7ff9b9c00640 1 --2- 172.21.15.57:0/3802712698 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7ff99406c530 0x7ff99406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:45.704 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.715+0000 7ff9b9c00640 1 --2- 172.21.15.57:0/3802712698 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7ff99406c530 0x7ff99406e9f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff9a8036000 tx=0x7ff9a8008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:45.708 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.719+0000 7ff9b1600640 1 -- 172.21.15.57:0/3802712698 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7ff9a00599c0 con 0x7ff9b40acd60 2024-03-27T09:59:45.909 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.919+0000 7ff9bc600640 1 -- 172.21.15.57:0/3802712698 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7ff9b4068540 con 0x7ff9b40acd60 2024-03-27T09:59:45.909 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.920+0000 7ff9b1600640 1 -- 172.21.15.57:0/3802712698 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7ff9a00592c0 con 0x7ff9b40acd60 2024-03-27T09:59:45.909 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2024-03-27T09:59:45.911 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.923+0000 7ff9bc600640 1 -- 172.21.15.57:0/3802712698 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7ff99406c530 msgr2=0x7ff99406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:45.912 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.923+0000 7ff9bc600640 1 --2- 172.21.15.57:0/3802712698 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7ff99406c530 0x7ff99406e9f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff9a8036000 tx=0x7ff9a8008030 comp rx=0 tx=0).stop 2024-03-27T09:59:45.912 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.923+0000 7ff9bc600640 1 -- 172.21.15.57:0/3802712698 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9b40acd60 msgr2=0x7ff9b40c9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:45.912 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.923+0000 7ff9bc600640 1 --2- 172.21.15.57:0/3802712698 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9b40acd60 0x7ff9b40c9b60 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff9a000c480 tx=0x7ff9a000c940 comp rx=0 tx=0).stop 2024-03-27T09:59:45.912 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.923+0000 7ff9bc600640 1 -- 172.21.15.57:0/3802712698 shutdown_connections 2024-03-27T09:59:45.913 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.923+0000 7ff9bc600640 1 --2- 172.21.15.57:0/3802712698 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff9b40aea20 0x7ff9b4158160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:45.913 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.923+0000 7ff9bc600640 1 --2- 172.21.15.57:0/3802712698 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff9b40acd60 0x7ff9b40c9b60 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:45.913 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.923+0000 7ff9bc600640 1 --2- 172.21.15.57:0/3802712698 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7ff99406c530 0x7ff99406e9f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:45.913 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.923+0000 7ff9bc600640 1 --2- 172.21.15.57:0/3802712698 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff9b406cf30 0x7ff9b40c8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:45.913 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.923+0000 7ff9bc600640 1 -- 172.21.15.57:0/3802712698 >> 172.21.15.57:0/3802712698 conn(0x7ff9b40b18a0 msgr2=0x7ff9b40b0ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:45.913 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.923+0000 7ff9bc600640 1 -- 172.21.15.57:0/3802712698 shutdown_connections 2024-03-27T09:59:45.913 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:45.923+0000 7ff9bc600640 1 -- 172.21.15.57:0/3802712698 wait complete. 2024-03-27T09:59:45.932 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-27T09:59:46.162 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.172+0000 7fb99e600640 1 Processor -- start 2024-03-27T09:59:46.162 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.173+0000 7fb99e600640 1 -- start start 2024-03-27T09:59:46.164 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.174+0000 7fb99e600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb9980ca190 0x7fb998162bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:46.164 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.174+0000 7fb99e600640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fb9980cdc20 0x7fb9980ca570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:46.164 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.174+0000 7fb99e600640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb9981661a0 0x7fb998166600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:46.164 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.174+0000 7fb99e600640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7fb9980ce060 con 0x7fb9981661a0 2024-03-27T09:59:46.164 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.175+0000 7fb99e600640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7fb9980ceea0 con 0x7fb9980cdc20 2024-03-27T09:59:46.164 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.175+0000 7fb99e600640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fb9980caab0 con 0x7fb9980ca190 2024-03-27T09:59:46.165 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.175+0000 7fb99dc00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb9981661a0 0x7fb998166600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:46.165 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.175+0000 7fb99dc00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb9981661a0 0x7fb998166600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46402/0 (socket says 172.21.15.57:46402) 2024-03-27T09:59:46.165 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.175+0000 7fb99dc00640 1 -- 172.21.15.57:0/343347810 learned_addr learned my addr 172.21.15.57:0/343347810 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T09:59:46.165 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.175+0000 7fb99d200640 1 --2- 172.21.15.57:0/343347810 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb9980ca190 0x7fb998162bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:46.165 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.175+0000 7fb997e00640 1 --2- 172.21.15.57:0/343347810 >> v2:172.21.15.118:3300/0 conn(0x7fb9980cdc20 0x7fb9980ca570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:46.166 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.175+0000 7fb99dc00640 1 -- 172.21.15.57:0/343347810 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb9980ca190 msgr2=0x7fb998162bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T09:59:46.166 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.175+0000 7fb99dc00640 1 --2- 172.21.15.57:0/343347810 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb9980ca190 0x7fb998162bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:46.166 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.175+0000 7fb99dc00640 1 -- 172.21.15.57:0/343347810 >> v2:172.21.15.118:3300/0 conn(0x7fb9980cdc20 msgr2=0x7fb9980ca570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T09:59:46.166 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.175+0000 7fb99dc00640 1 --2- 172.21.15.57:0/343347810 >> v2:172.21.15.118:3300/0 conn(0x7fb9980cdc20 0x7fb9980ca570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:46.166 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.175+0000 7fb99dc00640 1 -- 172.21.15.57:0/343347810 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9980ce290 con 0x7fb9981661a0 2024-03-27T09:59:46.166 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.177+0000 7fb99dc00640 1 --2- 172.21.15.57:0/343347810 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb9981661a0 0x7fb998166600 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb99806c6d0 tx=0x7fb99002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=891ad4e1dcb38782 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:46.166 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.177+0000 7fb997400640 1 -- 172.21.15.57:0/343347810 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb99002cb00 con 0x7fb9981661a0 2024-03-27T09:59:46.166 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.177+0000 7fb997400640 1 -- 172.21.15.57:0/343347810 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb99002cca0 con 0x7fb9981661a0 2024-03-27T09:59:46.166 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.177+0000 7fb997400640 1 -- 172.21.15.57:0/343347810 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb990034610 con 0x7fb9981661a0 2024-03-27T09:59:46.167 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.178+0000 7fb99e600640 1 -- 172.21.15.57:0/343347810 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb9981661a0 msgr2=0x7fb998166600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:46.167 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.178+0000 7fb99e600640 1 --2- 172.21.15.57:0/343347810 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb9981661a0 0x7fb998166600 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb99806c6d0 tx=0x7fb99002bf60 comp rx=0 tx=0).stop 2024-03-27T09:59:46.167 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.178+0000 7fb99e600640 1 -- 172.21.15.57:0/343347810 shutdown_connections 2024-03-27T09:59:46.168 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.178+0000 7fb99e600640 1 --2- 172.21.15.57:0/343347810 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb9981661a0 0x7fb998166600 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:46.168 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.178+0000 7fb99e600640 1 --2- 172.21.15.57:0/343347810 >> v2:172.21.15.118:3300/0 conn(0x7fb9980cdc20 0x7fb9980ca570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:46.168 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.178+0000 7fb99e600640 1 --2- 172.21.15.57:0/343347810 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb9980ca190 0x7fb998162bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:46.168 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.178+0000 7fb99e600640 1 -- 172.21.15.57:0/343347810 >> 172.21.15.57:0/343347810 conn(0x7fb9980cfb40 msgr2=0x7fb9980cff20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:46.168 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.178+0000 7fb99e600640 1 -- 172.21.15.57:0/343347810 shutdown_connections 2024-03-27T09:59:46.168 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.178+0000 7fb99e600640 1 -- 172.21.15.57:0/343347810 wait complete. 2024-03-27T09:59:46.168 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.179+0000 7fb99e600640 1 Processor -- start 2024-03-27T09:59:46.168 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.180+0000 7fb99e600640 1 -- start start 2024-03-27T09:59:46.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.181+0000 7fb99e600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb9980ca190 0x7fb9981fc4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:46.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.181+0000 7fb99e600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9980cdc20 0x7fb9981f8670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:46.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.181+0000 7fb99e600640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb9981661a0 0x7fb9981612b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:46.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.181+0000 7fb99e600640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fb9980ceb30 con 0x7fb9981661a0 2024-03-27T09:59:46.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.181+0000 7fb99e600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fb9980ce850 con 0x7fb9980cdc20 2024-03-27T09:59:46.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.181+0000 7fb99e600640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fb9980cd940 con 0x7fb9980ca190 2024-03-27T09:59:46.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.181+0000 7fb99dc00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb9981661a0 0x7fb9981612b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:46.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.181+0000 7fb99dc00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb9981661a0 0x7fb9981612b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46408/0 (socket says 172.21.15.57:46408) 2024-03-27T09:59:46.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.181+0000 7fb99dc00640 1 -- 172.21.15.57:0/1603047254 learned_addr learned my addr 172.21.15.57:0/1603047254 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T09:59:46.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.181+0000 7fb99d200640 1 --2- 172.21.15.57:0/1603047254 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb9980ca190 0x7fb9981fc4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:46.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.181+0000 7fb99dc00640 1 -- 172.21.15.57:0/1603047254 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb9980ca190 msgr2=0x7fb9981fc4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:46.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.181+0000 7fb99dc00640 1 --2- 172.21.15.57:0/1603047254 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb9980ca190 0x7fb9981fc4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:46.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.181+0000 7fb99dc00640 1 -- 172.21.15.57:0/1603047254 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9980cdc20 msgr2=0x7fb9981f8670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:46.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.181+0000 7fb99dc00640 1 --2- 172.21.15.57:0/1603047254 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9980cdc20 0x7fb9981f8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:46.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.181+0000 7fb99dc00640 1 -- 172.21.15.57:0/1603047254 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9981f95d0 con 0x7fb9981661a0 2024-03-27T09:59:46.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.182+0000 7fb99dc00640 1 --2- 172.21.15.57:0/1603047254 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb9981661a0 0x7fb9981612b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb990036040 tx=0x7fb990004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:46.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.182+0000 7fb994c00640 1 -- 172.21.15.57:0/1603047254 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb990044020 con 0x7fb9981661a0 2024-03-27T09:59:46.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.182+0000 7fb994c00640 1 -- 172.21.15.57:0/1603047254 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb99002ce50 con 0x7fb9981661a0 2024-03-27T09:59:46.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.182+0000 7fb99e600640 1 -- 172.21.15.57:0/1603047254 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9981f9010 con 0x7fb9981661a0 2024-03-27T09:59:46.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.182+0000 7fb994c00640 1 -- 172.21.15.57:0/1603047254 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9900408d0 con 0x7fb9981661a0 2024-03-27T09:59:46.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.182+0000 7fb99e600640 1 -- 172.21.15.57:0/1603047254 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9981fbcf0 con 0x7fb9981661a0 2024-03-27T09:59:46.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.183+0000 7fb99e600640 1 -- 172.21.15.57:0/1603047254 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb998068540 con 0x7fb9981661a0 2024-03-27T09:59:46.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.184+0000 7fb994c00640 1 -- 172.21.15.57:0/1603047254 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fb990005d10 con 0x7fb9981661a0 2024-03-27T09:59:46.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.185+0000 7fb994c00640 1 --2- 172.21.15.57:0/1603047254 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fb97806c530 0x7fb97806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:46.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.185+0000 7fb994c00640 1 -- 172.21.15.57:0/1603047254 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fb9900ae700 con 0x7fb9981661a0 2024-03-27T09:59:46.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.186+0000 7fb99d200640 1 --2- 172.21.15.57:0/1603047254 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fb97806c530 0x7fb97806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:46.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.186+0000 7fb99d200640 1 --2- 172.21.15.57:0/1603047254 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fb97806c530 0x7fb97806e9f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb98c006fd0 tx=0x7fb98c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:46.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.190+0000 7fb994c00640 1 -- 172.21.15.57:0/1603047254 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7fb99007c940 con 0x7fb9981661a0 2024-03-27T09:59:46.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.394+0000 7fb99e600640 1 -- 172.21.15.57:0/1603047254 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fb998162160 con 0x7fb9981661a0 2024-03-27T09:59:46.384 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.395+0000 7fb994c00640 1 -- 172.21.15.57:0/1603047254 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7fb99007c240 con 0x7fb9981661a0 2024-03-27T09:59:46.384 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2024-03-27T09:59:46.387 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.398+0000 7fb99e600640 1 -- 172.21.15.57:0/1603047254 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fb97806c530 msgr2=0x7fb97806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:46.388 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.398+0000 7fb99e600640 1 --2- 172.21.15.57:0/1603047254 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fb97806c530 0x7fb97806e9f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb98c006fd0 tx=0x7fb98c008040 comp rx=0 tx=0).stop 2024-03-27T09:59:46.388 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.398+0000 7fb99e600640 1 -- 172.21.15.57:0/1603047254 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb9981661a0 msgr2=0x7fb9981612b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:46.388 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.398+0000 7fb99e600640 1 --2- 172.21.15.57:0/1603047254 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb9981661a0 0x7fb9981612b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb990036040 tx=0x7fb990004a40 comp rx=0 tx=0).stop 2024-03-27T09:59:46.388 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.398+0000 7fb99e600640 1 -- 172.21.15.57:0/1603047254 shutdown_connections 2024-03-27T09:59:46.388 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.398+0000 7fb99e600640 1 --2- 172.21.15.57:0/1603047254 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb9981661a0 0x7fb9981612b0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:46.388 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.398+0000 7fb99e600640 1 --2- 172.21.15.57:0/1603047254 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fb97806c530 0x7fb97806e9f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:46.388 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.398+0000 7fb99e600640 1 --2- 172.21.15.57:0/1603047254 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb9980cdc20 0x7fb9981f8670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:46.388 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.398+0000 7fb99e600640 1 --2- 172.21.15.57:0/1603047254 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb9980ca190 0x7fb9981fc4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:46.388 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.398+0000 7fb99e600640 1 -- 172.21.15.57:0/1603047254 >> 172.21.15.57:0/1603047254 conn(0x7fb9980cfb40 msgr2=0x7fb998146b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:46.388 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.399+0000 7fb99e600640 1 -- 172.21.15.57:0/1603047254 shutdown_connections 2024-03-27T09:59:46.388 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.399+0000 7fb99e600640 1 -- 172.21.15.57:0/1603047254 wait complete. 2024-03-27T09:59:46.408 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-27T09:59:46.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.635+0000 7faa8d600640 1 Processor -- start 2024-03-27T09:59:46.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.636+0000 7faa8d600640 1 -- start start 2024-03-27T09:59:46.626 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.637+0000 7faa8d600640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7faa8806cf20 0x7faa88169010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:46.626 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.637+0000 7faa8d600640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa880cfe40 con 0x7faa880d3770 2024-03-27T09:59:46.626 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.637+0000 7faa8d600640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa88161d30 con 0x7faa88161950 2024-03-27T09:59:46.627 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.637+0000 7faa8d600640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7faa880d0f10 con 0x7faa8806cf20 2024-03-27T09:59:46.627 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.637+0000 7faa87400640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7faa880d3770 0x7faa880cf210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:44884/0 (socket says 172.21.15.57:44884) 2024-03-27T09:59:46.627 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.637+0000 7faa87400640 1 -- 172.21.15.57:0/3466677094 learned_addr learned my addr 172.21.15.57:0/3466677094 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T09:59:46.627 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.638+0000 7faa8cc00640 1 --2- 172.21.15.57:0/3466677094 >> v2:172.21.15.118:3300/0 conn(0x7faa8806cf20 0x7faa88169010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:46.628 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.638+0000 7faa86a00640 1 -- 172.21.15.57:0/3466677094 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 302886472 0 0) 0x7faa880cfe40 con 0x7faa880d3770 2024-03-27T09:59:46.628 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.638+0000 7faa86a00640 1 -- 172.21.15.57:0/3466677094 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faa6c003520 con 0x7faa880d3770 2024-03-27T09:59:46.629 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.638+0000 7faa86a00640 1 -- 172.21.15.57:0/3466677094 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1756886791 0 0) 0x7faa6c003520 con 0x7faa880d3770 2024-03-27T09:59:46.629 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.638+0000 7faa86a00640 1 -- 172.21.15.57:0/3466677094 >> v2:172.21.15.118:3300/0 conn(0x7faa8806cf20 msgr2=0x7faa88169010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T09:59:46.629 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.638+0000 7faa86a00640 1 --2- 172.21.15.57:0/3466677094 >> v2:172.21.15.118:3300/0 conn(0x7faa8806cf20 0x7faa88169010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:46.629 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.638+0000 7faa86a00640 1 -- 172.21.15.57:0/3466677094 >> v1:172.21.15.118:6789/0 conn(0x7faa88161950 legacy=0x7faa880ceb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:46.629 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.638+0000 7faa86a00640 1 -- 172.21.15.57:0/3466677094 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa880d11f0 con 0x7faa880d3770 2024-03-27T09:59:46.629 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.638+0000 7faa86a00640 1 -- 172.21.15.57:0/3466677094 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4227751516 0 0) 0x7faa74001670 con 0x7faa880d3770 2024-03-27T09:59:46.629 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.638+0000 7faa86a00640 1 -- 172.21.15.57:0/3466677094 >> v1:172.21.15.57:6789/0 conn(0x7faa880d3770 legacy=0x7faa880cf210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:46.629 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.638+0000 7faa86a00640 1 --2- 172.21.15.57:0/3466677094 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faa6c0039b0 0x7faa6c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:46.630 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.638+0000 7faa86a00640 1 --2- 172.21.15.57:0/3466677094 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faa6c004800 0x7faa6c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:46.630 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.638+0000 7faa86a00640 1 --2- 172.21.15.57:0/3466677094 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faa6c0051c0 0x7faa6c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:46.630 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.638+0000 7faa86a00640 1 -- 172.21.15.57:0/3466677094 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7faa880d0f10 con 0x7faa6c004800 2024-03-27T09:59:46.630 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.638+0000 7faa86a00640 1 -- 172.21.15.57:0/3466677094 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7faa6c00c070 con 0x7faa6c0039b0 2024-03-27T09:59:46.630 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.638+0000 7faa86a00640 1 -- 172.21.15.57:0/3466677094 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7faa6c00c270 con 0x7faa6c0051c0 2024-03-27T09:59:46.630 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.639+0000 7faa87400640 1 --2- 172.21.15.57:0/3466677094 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faa6c004800 0x7faa6c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:46.630 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.639+0000 7faa87e00640 1 --2- 172.21.15.57:0/3466677094 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faa6c0039b0 0x7faa6c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:46.630 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.639+0000 7faa8cc00640 1 --2- 172.21.15.57:0/3466677094 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faa6c0051c0 0x7faa6c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:46.630 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.639+0000 7faa87400640 1 -- 172.21.15.57:0/3466677094 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faa6c0051c0 msgr2=0x7faa6c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T09:59:46.630 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.639+0000 7faa87400640 1 --2- 172.21.15.57:0/3466677094 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faa6c0051c0 0x7faa6c00b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:46.630 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.639+0000 7faa87400640 1 -- 172.21.15.57:0/3466677094 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faa6c0039b0 msgr2=0x7faa6c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T09:59:46.630 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.639+0000 7faa87400640 1 --2- 172.21.15.57:0/3466677094 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faa6c0039b0 0x7faa6c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:46.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.639+0000 7faa87400640 1 -- 172.21.15.57:0/3466677094 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa6c003520 con 0x7faa6c004800 2024-03-27T09:59:46.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.639+0000 7faa8cc00640 1 -- 172.21.15.57:0/3466677094 reap_dead start 2024-03-27T09:59:46.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.640+0000 7faa87400640 1 --2- 172.21.15.57:0/3466677094 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faa6c004800 0x7faa6c004c80 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7faa7400c210 tx=0x7faa6c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a554723600e697c server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:46.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.640+0000 7faa86a00640 1 -- 172.21.15.57:0/3466677094 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa74007d30 con 0x7faa6c004800 2024-03-27T09:59:46.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.640+0000 7faa86a00640 1 -- 172.21.15.57:0/3466677094 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa74030070 con 0x7faa6c004800 2024-03-27T09:59:46.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.640+0000 7faa86a00640 1 -- 172.21.15.57:0/3466677094 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa74005d70 con 0x7faa6c004800 2024-03-27T09:59:46.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.641+0000 7faa8d600640 1 -- 172.21.15.57:0/3466677094 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faa6c004800 msgr2=0x7faa6c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:46.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.641+0000 7faa8d600640 1 --2- 172.21.15.57:0/3466677094 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faa6c004800 0x7faa6c004c80 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7faa7400c210 tx=0x7faa6c005830 comp rx=0 tx=0).stop 2024-03-27T09:59:46.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.641+0000 7faa8d600640 1 -- 172.21.15.57:0/3466677094 shutdown_connections 2024-03-27T09:59:46.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.641+0000 7faa8d600640 1 --2- 172.21.15.57:0/3466677094 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faa6c004800 0x7faa6c004c80 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:46.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.641+0000 7faa8d600640 1 -- 172.21.15.57:0/3466677094 >> 172.21.15.57:0/3466677094 conn(0x7faa880d3fc0 msgr2=0x7faa880d43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:46.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.641+0000 7faa8d600640 1 -- 172.21.15.57:0/3466677094 shutdown_connections 2024-03-27T09:59:46.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.641+0000 7faa8d600640 1 -- 172.21.15.57:0/3466677094 wait complete. 2024-03-27T09:59:46.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.643+0000 7faa8d600640 1 Processor -- start 2024-03-27T09:59:46.633 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.643+0000 7faa8d600640 1 -- start start 2024-03-27T09:59:46.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.644+0000 7faa8d600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faa6c004800 0x7faa8815e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:46.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.644+0000 7faa8d600640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faa88158280 0x7faa880cd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:46.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.644+0000 7faa8d600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faa881587d0 0x7faa881f4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:46.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.644+0000 7faa8d600640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7faa880d2240 con 0x7faa88158280 2024-03-27T09:59:46.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.644+0000 7faa8d600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7faa880d1f60 con 0x7faa881587d0 2024-03-27T09:59:46.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.644+0000 7faa8d600640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7faa880d17b0 con 0x7faa6c004800 2024-03-27T09:59:46.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.644+0000 7faa87400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faa88158280 0x7faa880cd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:46.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.644+0000 7faa87400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faa88158280 0x7faa880cd7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46422/0 (socket says 172.21.15.57:46422) 2024-03-27T09:59:46.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.644+0000 7faa87400640 1 -- 172.21.15.57:0/1658126168 learned_addr learned my addr 172.21.15.57:0/1658126168 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T09:59:46.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.644+0000 7faa87e00640 1 --2- 172.21.15.57:0/1658126168 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faa6c004800 0x7faa8815e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:46.636 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.644+0000 7faa8cc00640 1 --2- 172.21.15.57:0/1658126168 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faa881587d0 0x7faa881f4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:46.636 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.645+0000 7faa87400640 1 -- 172.21.15.57:0/1658126168 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faa6c004800 msgr2=0x7faa8815e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:46.636 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.645+0000 7faa87400640 1 --2- 172.21.15.57:0/1658126168 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faa6c004800 0x7faa8815e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:46.636 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.645+0000 7faa87400640 1 -- 172.21.15.57:0/1658126168 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faa881587d0 msgr2=0x7faa881f4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:46.636 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.645+0000 7faa87400640 1 --2- 172.21.15.57:0/1658126168 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faa881587d0 0x7faa881f4100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:46.636 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.645+0000 7faa87400640 1 -- 172.21.15.57:0/1658126168 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa880cc700 con 0x7faa88158280 2024-03-27T09:59:46.636 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.645+0000 7faa87400640 1 --2- 172.21.15.57:0/1658126168 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faa88158280 0x7faa880cd7a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7faa7400c330 tx=0x7faa7402e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:46.636 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.645+0000 7faa7fe00640 1 -- 172.21.15.57:0/1658126168 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa74046070 con 0x7faa88158280 2024-03-27T09:59:46.636 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.645+0000 7faa7fe00640 1 -- 172.21.15.57:0/1658126168 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa74004bf0 con 0x7faa88158280 2024-03-27T09:59:46.636 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.645+0000 7faa7fe00640 1 -- 172.21.15.57:0/1658126168 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa74007d10 con 0x7faa88158280 2024-03-27T09:59:46.636 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.645+0000 7faa8d600640 1 -- 172.21.15.57:0/1658126168 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa880cc9e0 con 0x7faa88158280 2024-03-27T09:59:46.636 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.645+0000 7faa8d600640 1 -- 172.21.15.57:0/1658126168 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa880ccfa0 con 0x7faa88158280 2024-03-27T09:59:46.637 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.646+0000 7faa8d600640 1 -- 172.21.15.57:0/1658126168 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa88068540 con 0x7faa88158280 2024-03-27T09:59:46.637 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.647+0000 7faa7fe00640 1 -- 172.21.15.57:0/1658126168 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7faa74007070 con 0x7faa88158280 2024-03-27T09:59:46.637 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.648+0000 7faa7fe00640 1 --2- 172.21.15.57:0/1658126168 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7faa6806c560 0x7faa6806ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:46.637 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.648+0000 7faa7fe00640 1 -- 172.21.15.57:0/1658126168 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7faa740acd70 con 0x7faa88158280 2024-03-27T09:59:46.637 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.648+0000 7faa87e00640 1 --2- 172.21.15.57:0/1658126168 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7faa6806c560 0x7faa6806ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:46.638 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.649+0000 7faa87e00640 1 --2- 172.21.15.57:0/1658126168 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7faa6806c560 0x7faa6806ea20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7faa78007fd0 tx=0x7faa78009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:46.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.653+0000 7faa7fe00640 1 -- 172.21.15.57:0/1658126168 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7faa7407b040 con 0x7faa88158280 2024-03-27T09:59:46.843 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.854+0000 7faa8d600640 1 -- 172.21.15.57:0/1658126168 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7faa880d04a0 con 0x7faa88158280 2024-03-27T09:59:46.844 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.855+0000 7faa7fe00640 1 -- 172.21.15.57:0/1658126168 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7faa7407a940 con 0x7faa88158280 2024-03-27T09:59:46.844 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2024-03-27T09:59:46.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.857+0000 7faa8d600640 1 -- 172.21.15.57:0/1658126168 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7faa6806c560 msgr2=0x7faa6806ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:46.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.857+0000 7faa8d600640 1 --2- 172.21.15.57:0/1658126168 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7faa6806c560 0x7faa6806ea20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7faa78007fd0 tx=0x7faa78009040 comp rx=0 tx=0).stop 2024-03-27T09:59:46.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.857+0000 7faa8d600640 1 -- 172.21.15.57:0/1658126168 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faa88158280 msgr2=0x7faa880cd7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:46.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.857+0000 7faa8d600640 1 --2- 172.21.15.57:0/1658126168 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faa88158280 0x7faa880cd7a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7faa7400c330 tx=0x7faa7402e070 comp rx=0 tx=0).stop 2024-03-27T09:59:46.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.858+0000 7faa8d600640 1 -- 172.21.15.57:0/1658126168 shutdown_connections 2024-03-27T09:59:46.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.858+0000 7faa8d600640 1 --2- 172.21.15.57:0/1658126168 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7faa6806c560 0x7faa6806ea20 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:46.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.858+0000 7faa8d600640 1 --2- 172.21.15.57:0/1658126168 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faa881587d0 0x7faa881f4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:46.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.858+0000 7faa8d600640 1 --2- 172.21.15.57:0/1658126168 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faa88158280 0x7faa880cd7a0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:46.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.858+0000 7faa8d600640 1 --2- 172.21.15.57:0/1658126168 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faa6c004800 0x7faa8815e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:46.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.858+0000 7faa8d600640 1 -- 172.21.15.57:0/1658126168 >> 172.21.15.57:0/1658126168 conn(0x7faa880d3fc0 msgr2=0x7faa8806bf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:46.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.858+0000 7faa8d600640 1 -- 172.21.15.57:0/1658126168 shutdown_connections 2024-03-27T09:59:46.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:46.858+0000 7faa8d600640 1 -- 172.21.15.57:0/1658126168 wait complete. 2024-03-27T09:59:46.865 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-27T09:59:47.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:47.099+0000 7f7c00800640 1 Processor -- start 2024-03-27T09:59:47.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:47.100+0000 7f7c00800640 1 -- start start 2024-03-27T09:59:47.091 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:47.101+0000 7f7c00800640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f7bf806b7a0 0x7f7bf815f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:47.091 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:47.101+0000 7f7c00800640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7bf80cd330 0x7f7bf80cd780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:47.091 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:47.101+0000 7f7c00800640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7bf815eb00 con 0x7f7bf806bb80 2024-03-27T09:59:47.091 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:47.101+0000 7f7c00800640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f7bf806dc70 con 0x7f7bf80cd330 2024-03-27T09:59:47.091 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:47.102+0000 7f7c00800640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f7bf806df50 con 0x7f7bf806b7a0 2024-03-27T09:59:47.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:47.102+0000 7f7bfe800640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7bf80cd330 0x7f7bf80cd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:47.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:47.102+0000 7f7bfe800640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7bf80cd330 0x7f7bf80cd780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46426/0 (socket says 172.21.15.57:46426) 2024-03-27T09:59:47.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:47.102+0000 7f7bfe800640 1 -- 172.21.15.57:0/338436361 learned_addr learned my addr 172.21.15.57:0/338436361 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T09:59:47.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:47.102+0000 7f7bfde00640 1 --2- 172.21.15.57:0/338436361 >> v2:172.21.15.118:3300/0 conn(0x7f7bf806b7a0 0x7f7bf815f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:47.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:47.102+0000 7f7bfe800640 1 -- 172.21.15.57:0/338436361 >> v2:172.21.15.118:3300/0 conn(0x7f7bf806b7a0 msgr2=0x7f7bf815f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T09:59:47.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:47.102+0000 7f7bfe800640 1 --2- 172.21.15.57:0/338436361 >> v2:172.21.15.118:3300/0 conn(0x7f7bf806b7a0 0x7f7bf815f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:47.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:47.102+0000 7f7bfe800640 1 -- 172.21.15.57:0/338436361 >> v1:172.21.15.57:6789/0 conn(0x7f7bf806bb80 legacy=0x7f7bf806d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:47.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:47.102+0000 7f7bfe800640 1 -- 172.21.15.57:0/338436361 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bf815edc0 con 0x7f7bf80cd330 2024-03-27T09:59:47.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:47.102+0000 7f7bfca00640 1 -- 172.21.15.57:0/338436361 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4052702175 0 0) 0x7f7bf815eb00 con 0x7f7bf806bb80 2024-03-27T09:59:47.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:47.104+0000 7f7bfe800640 1 --2- 172.21.15.57:0/338436361 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7bf80cd330 0x7f7bf80cd780 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7bf806c4a0 tx=0x7f7bf402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8eabcd7427ce1d6b server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:47.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:47.104+0000 7f7bfca00640 1 -- 172.21.15.57:0/338436361 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bf402ca80 con 0x7f7bf80cd330 2024-03-27T09:59:47.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:47.104+0000 7f7bfca00640 1 -- 172.21.15.57:0/338436361 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bf402cc20 con 0x7f7bf80cd330 2024-03-27T09:59:47.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:47.104+0000 7f7bfca00640 1 -- 172.21.15.57:0/338436361 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bf40343f0 con 0x7f7bf80cd330 2024-03-27T09:59:47.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:47.104+0000 7f7c00800640 1 -- 172.21.15.57:0/338436361 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7bf80cd330 msgr2=0x7f7bf80cd780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:47.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:47.104+0000 7f7c00800640 1 --2- 172.21.15.57:0/338436361 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7bf80cd330 0x7f7bf80cd780 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7bf806c4a0 tx=0x7f7bf402bee0 comp rx=0 tx=0).stop 2024-03-27T09:59:47.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:47.105+0000 7f7c00800640 1 -- 172.21.15.57:0/338436361 shutdown_connections 2024-03-27T09:59:47.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:47.105+0000 7f7c00800640 1 --2- 172.21.15.57:0/338436361 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7bf80cd330 0x7f7bf80cd780 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:47.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:47.105+0000 7f7c00800640 1 --2- 172.21.15.57:0/338436361 >> v2:172.21.15.118:3300/0 conn(0x7f7bf806b7a0 0x7f7bf815f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:47.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:47.105+0000 7f7c00800640 1 -- 172.21.15.57:0/338436361 >> 172.21.15.57:0/338436361 conn(0x7f7bf80b1c60 msgr2=0x7f7bf80b2070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:47.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:47.105+0000 7f7c00800640 1 -- 172.21.15.57:0/338436361 shutdown_connections 2024-03-27T09:59:47.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:47.105+0000 7f7c00800640 1 -- 172.21.15.57:0/338436361 wait complete. 2024-03-27T09:59:47.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:47.106+0000 7f7c00800640 1 Processor -- start 2024-03-27T09:59:47.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:47.107+0000 7f7c00800640 1 -- start start 2024-03-27T09:59:47.097 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:47.107+0000 7f7c00800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7bf806b7a0 0x7f7bf8137790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:47.097 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:47.107+0000 7f7c00800640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7bf806bb80 0x7f7bf81390b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:47.097 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:47.108+0000 7f7c00800640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7bf80cd330 0x7f7bf8166850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:47.097 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:47.108+0000 7f7c00800640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f7bf806d8c0 con 0x7f7bf806bb80 2024-03-27T09:59:47.098 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:47.108+0000 7f7c00800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f7bf80726b0 con 0x7f7bf806b7a0 2024-03-27T09:59:47.098 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:47.108+0000 7f7c00800640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f7bf815b0c0 con 0x7f7bf80cd330 2024-03-27T09:59:47.098 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:47.108+0000 7f7bfd400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7bf806bb80 0x7f7bf81390b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:47.098 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:47.108+0000 7f7bfd400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7bf806bb80 0x7f7bf81390b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:46430/0 (socket says 172.21.15.57:46430) 2024-03-27T09:59:47.098 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:47.108+0000 7f7bfd400640 1 -- 172.21.15.57:0/85612353 learned_addr learned my addr 172.21.15.57:0/85612353 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T09:59:47.098 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:47.108+0000 7f7bfde00640 1 --2- 172.21.15.57:0/85612353 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7bf806b7a0 0x7f7bf8137790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:47.098 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:47.108+0000 7f7bfe800640 1 --2- 172.21.15.57:0/85612353 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7bf80cd330 0x7f7bf8166850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:47.098 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:47.108+0000 7f7bfd400640 1 -- 172.21.15.57:0/85612353 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7bf80cd330 msgr2=0x7f7bf8166850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:47.098 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:47.108+0000 7f7bfd400640 1 --2- 172.21.15.57:0/85612353 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7bf80cd330 0x7f7bf8166850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:47.098 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:47.108+0000 7f7bfd400640 1 -- 172.21.15.57:0/85612353 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7bf806b7a0 msgr2=0x7f7bf8137790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:47.098 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:47.108+0000 7f7bfd400640 1 --2- 172.21.15.57:0/85612353 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7bf806b7a0 0x7f7bf8137790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:47.098 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:47.108+0000 7f7bfd400640 1 -- 172.21.15.57:0/85612353 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bf8139700 con 0x7f7bf806bb80 2024-03-27T09:59:47.098 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:47.108+0000 7f7bfde00640 1 --2- 172.21.15.57:0/85612353 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7bf806b7a0 0x7f7bf8137790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T09:59:47.098 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:47.109+0000 7f7bfd400640 1 --2- 172.21.15.57:0/85612353 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7bf806bb80 0x7f7bf81390b0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7be800c4b0 tx=0x7f7be800c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:47.099 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:47.109+0000 7f7bf2000640 1 -- 172.21.15.57:0/85612353 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7be8017070 con 0x7f7bf806bb80 2024-03-27T09:59:47.099 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:47.109+0000 7f7bf2000640 1 -- 172.21.15.57:0/85612353 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7be8005480 con 0x7f7bf806bb80 2024-03-27T09:59:47.099 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:47.109+0000 7f7bf2000640 1 -- 172.21.15.57:0/85612353 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7be8003830 con 0x7f7bf806bb80 2024-03-27T09:59:47.099 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:47.109+0000 7f7c00800640 1 -- 172.21.15.57:0/85612353 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bf81399e0 con 0x7f7bf806bb80 2024-03-27T09:59:47.100 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:47.109+0000 7f7c00800640 1 -- 172.21.15.57:0/85612353 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bf8139fa0 con 0x7f7bf806bb80 2024-03-27T09:59:47.100 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:47.110+0000 7f7c00800640 1 -- 172.21.15.57:0/85612353 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bf806f410 con 0x7f7bf806bb80 2024-03-27T09:59:47.100 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:47.111+0000 7f7bf2000640 1 -- 172.21.15.57:0/85612353 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f7be801a070 con 0x7f7bf806bb80 2024-03-27T09:59:47.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:47.112+0000 7f7bf2000640 1 --2- 172.21.15.57:0/85612353 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f7bdc06c530 0x7f7bdc06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:47.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:47.112+0000 7f7bf2000640 1 -- 172.21.15.57:0/85612353 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f7be808ae20 con 0x7f7bf806bb80 2024-03-27T09:59:47.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:47.112+0000 7f7bfde00640 1 --2- 172.21.15.57:0/85612353 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f7bdc06c530 0x7f7bdc06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:47.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:47.113+0000 7f7bfde00640 1 --2- 172.21.15.57:0/85612353 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f7bdc06c530 0x7f7bdc06e9f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7bec009ac0 tx=0x7f7bec008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:47.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:47.116+0000 7f7bf2000640 1 -- 172.21.15.57:0/85612353 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f7be80590f0 con 0x7f7bf806bb80 2024-03-27T09:59:47.322 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:47.333+0000 7f7c00800640 1 -- 172.21.15.57:0/85612353 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f7bf8068620 con 0x7f7bf806bb80 2024-03-27T09:59:47.323 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:47.334+0000 7f7bf2000640 1 -- 172.21.15.57:0/85612353 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7f7be80589f0 con 0x7f7bf806bb80 2024-03-27T09:59:47.323 INFO:teuthology.orchestra.run.smithi057.stderr:listed 0 entries 2024-03-27T09:59:47.326 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:47.337+0000 7f7c00800640 1 -- 172.21.15.57:0/85612353 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f7bdc06c530 msgr2=0x7f7bdc06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:47.326 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:47.337+0000 7f7c00800640 1 --2- 172.21.15.57:0/85612353 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f7bdc06c530 0x7f7bdc06e9f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7bec009ac0 tx=0x7f7bec008040 comp rx=0 tx=0).stop 2024-03-27T09:59:47.326 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:47.337+0000 7f7c00800640 1 -- 172.21.15.57:0/85612353 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7bf806bb80 msgr2=0x7f7bf81390b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:47.326 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:47.337+0000 7f7c00800640 1 --2- 172.21.15.57:0/85612353 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7bf806bb80 0x7f7bf81390b0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7be800c4b0 tx=0x7f7be800c970 comp rx=0 tx=0).stop 2024-03-27T09:59:47.326 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:47.337+0000 7f7c00800640 1 -- 172.21.15.57:0/85612353 shutdown_connections 2024-03-27T09:59:47.327 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:47.337+0000 7f7c00800640 1 --2- 172.21.15.57:0/85612353 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7bf80cd330 0x7f7bf8166850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:47.327 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:47.337+0000 7f7c00800640 1 --2- 172.21.15.57:0/85612353 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7bf806bb80 0x7f7bf81390b0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:47.327 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:47.337+0000 7f7c00800640 1 --2- 172.21.15.57:0/85612353 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f7bdc06c530 0x7f7bdc06e9f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:47.327 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:47.337+0000 7f7c00800640 1 --2- 172.21.15.57:0/85612353 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7bf806b7a0 0x7f7bf8137790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:47.327 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:47.337+0000 7f7c00800640 1 -- 172.21.15.57:0/85612353 >> 172.21.15.57:0/85612353 conn(0x7f7bf80b1c60 msgr2=0x7f7bf80b38d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:47.327 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:47.337+0000 7f7c00800640 1 -- 172.21.15.57:0/85612353 shutdown_connections 2024-03-27T09:59:47.327 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:47.337+0000 7f7c00800640 1 -- 172.21.15.57:0/85612353 wait complete. 2024-03-27T09:59:47.344 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi057.front.sepia.ceph.com... 2024-03-27T09:59:47.344 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T09:59:47.344 DEBUG:teuthology.orchestra.run.smithi057:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-03-27T09:59:47.434 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi057.stderr:ceph-fuse[43889]: fuse finished with error 0 and tester_r 0 2024-03-27T09:59:47.439 INFO:teuthology.orchestra.run:waiting for 300 2024-03-27T09:59:47.691 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T09:59:47.698 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T09:59:53.541 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi057.front.sepia.ceph.com 2024-03-27T09:59:53.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T09:59:53.541 DEBUG:teuthology.orchestra.run.smithi057:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-03-27T09:59:53.610 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-27T09:59:53.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:53.849+0000 7f129fe00640 1 Processor -- start 2024-03-27T09:59:53.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:53.849+0000 7f129fe00640 1 -- start start 2024-03-27T09:59:53.839 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:53.850+0000 7f129fe00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f12a015bf50 0x7f12a00d23a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:53.839 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:53.850+0000 7f129fe00640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12a00aed20 con 0x7f12a00d0930 2024-03-27T09:59:53.839 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:53.850+0000 7f129fe00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12a00aef90 con 0x7f12a00ae8d0 2024-03-27T09:59:53.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:53.850+0000 7f129fe00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f12a00cfd70 con 0x7f12a015bf50 2024-03-27T09:59:53.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:53.851+0000 7f129f400640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f12a00d0930 0x7f12a00b0030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:60818/0 (socket says 172.21.15.57:60818) 2024-03-27T09:59:53.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:53.851+0000 7f129f400640 1 -- 172.21.15.57:0/1583262256 learned_addr learned my addr 172.21.15.57:0/1583262256 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T09:59:53.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:53.851+0000 7f129ea00640 1 --2- 172.21.15.57:0/1583262256 >> v2:172.21.15.118:3300/0 conn(0x7f12a015bf50 0x7f12a00d23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:53.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:53.851+0000 7f129d600640 1 -- 172.21.15.57:0/1583262256 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1524519666 0 0) 0x7f12a00aed20 con 0x7f12a00d0930 2024-03-27T09:59:53.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:53.851+0000 7f129d600640 1 -- 172.21.15.57:0/1583262256 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1280003520 con 0x7f12a00d0930 2024-03-27T09:59:53.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:53.852+0000 7f129d600640 1 -- 172.21.15.57:0/1583262256 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2147609361 0 0) 0x7f1280003520 con 0x7f12a00d0930 2024-03-27T09:59:53.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:53.852+0000 7f129d600640 1 -- 172.21.15.57:0/1583262256 >> v2:172.21.15.118:3300/0 conn(0x7f12a015bf50 msgr2=0x7f12a00d23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T09:59:53.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:53.852+0000 7f129d600640 1 --2- 172.21.15.57:0/1583262256 >> v2:172.21.15.118:3300/0 conn(0x7f12a015bf50 0x7f12a00d23a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:53.843 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:53.852+0000 7f129d600640 1 -- 172.21.15.57:0/1583262256 >> v1:172.21.15.118:6789/0 conn(0x7f12a00ae8d0 legacy=0x7f12a00d0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:53.843 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:53.852+0000 7f129d600640 1 -- 172.21.15.57:0/1583262256 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12a00af270 con 0x7f12a00d0930 2024-03-27T09:59:53.843 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:53.852+0000 7f129d600640 1 -- 172.21.15.57:0/1583262256 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4227751516 0 0) 0x7f1298001670 con 0x7f12a00d0930 2024-03-27T09:59:53.843 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:53.852+0000 7f129d600640 1 -- 172.21.15.57:0/1583262256 >> v1:172.21.15.57:6789/0 conn(0x7f12a00d0930 legacy=0x7f12a00b0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:53.843 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:53.852+0000 7f129d600640 1 --2- 172.21.15.57:0/1583262256 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1280003a00 0x7f1280003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:53.843 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:53.852+0000 7f129d600640 1 --2- 172.21.15.57:0/1583262256 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1280004800 0x7f1280004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:53.843 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:53.852+0000 7f129d600640 1 --2- 172.21.15.57:0/1583262256 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f12800051c0 0x7f128000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:53.843 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:53.852+0000 7f129d600640 1 -- 172.21.15.57:0/1583262256 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f128000c070 con 0x7f1280004800 2024-03-27T09:59:53.843 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:53.852+0000 7f129d600640 1 -- 172.21.15.57:0/1583262256 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f128000c220 con 0x7f12800051c0 2024-03-27T09:59:53.843 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:53.852+0000 7f129d600640 1 -- 172.21.15.57:0/1583262256 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f128000c420 con 0x7f1280003a00 2024-03-27T09:59:53.843 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:53.852+0000 7f129e000640 1 --2- 172.21.15.57:0/1583262256 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1280004800 0x7f1280004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:53.843 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:53.853+0000 7f129ea00640 1 --2- 172.21.15.57:0/1583262256 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1280003a00 0x7f1280003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:53.843 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:53.853+0000 7f129f400640 1 --2- 172.21.15.57:0/1583262256 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f12800051c0 0x7f128000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:53.843 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:53.853+0000 7f129e000640 1 -- 172.21.15.57:0/1583262256 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1280003a00 msgr2=0x7f1280003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T09:59:53.844 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:53.853+0000 7f129e000640 1 --2- 172.21.15.57:0/1583262256 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1280003a00 0x7f1280003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:53.844 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:53.853+0000 7f129e000640 1 -- 172.21.15.57:0/1583262256 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f12800051c0 msgr2=0x7f128000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T09:59:53.844 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:53.853+0000 7f129e000640 1 --2- 172.21.15.57:0/1583262256 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f12800051c0 0x7f128000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:53.844 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:53.853+0000 7f129e000640 1 -- 172.21.15.57:0/1583262256 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1280003520 con 0x7f1280004800 2024-03-27T09:59:53.844 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:53.853+0000 7f129f400640 1 -- 172.21.15.57:0/1583262256 reap_dead start 2024-03-27T09:59:53.845 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:53.854+0000 7f129e000640 1 --2- 172.21.15.57:0/1583262256 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1280004800 0x7f1280004c80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1288001e50 tx=0x7f1280005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4ff7c2f0e69c007 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:53.845 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:53.854+0000 7f129d600640 1 -- 172.21.15.57:0/1583262256 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1288001a70 con 0x7f1280004800 2024-03-27T09:59:53.845 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:53.854+0000 7f129d600640 1 -- 172.21.15.57:0/1583262256 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1288003b70 con 0x7f1280004800 2024-03-27T09:59:53.845 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:53.854+0000 7f129d600640 1 -- 172.21.15.57:0/1583262256 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12880050d0 con 0x7f1280004800 2024-03-27T09:59:53.845 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:53.855+0000 7f129fe00640 1 -- 172.21.15.57:0/1583262256 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1280004800 msgr2=0x7f1280004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:53.845 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:53.855+0000 7f129fe00640 1 --2- 172.21.15.57:0/1583262256 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1280004800 0x7f1280004c80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1288001e50 tx=0x7f1280005830 comp rx=0 tx=0).stop 2024-03-27T09:59:53.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:53.855+0000 7f129fe00640 1 -- 172.21.15.57:0/1583262256 shutdown_connections 2024-03-27T09:59:53.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:53.855+0000 7f129fe00640 1 --2- 172.21.15.57:0/1583262256 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1280004800 0x7f1280004c80 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:53.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:53.855+0000 7f129fe00640 1 -- 172.21.15.57:0/1583262256 >> 172.21.15.57:0/1583262256 conn(0x7f12a009aa30 msgr2=0x7f12a009ae40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:53.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:53.855+0000 7f129fe00640 1 -- 172.21.15.57:0/1583262256 shutdown_connections 2024-03-27T09:59:53.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:53.855+0000 7f129fe00640 1 -- 172.21.15.57:0/1583262256 wait complete. 2024-03-27T09:59:53.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:53.857+0000 7f129fe00640 1 Processor -- start 2024-03-27T09:59:53.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:53.857+0000 7f129fe00640 1 -- start start 2024-03-27T09:59:53.848 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:53.858+0000 7f129fe00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1280004800 0x7f12a006da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:53.848 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:53.858+0000 7f129fe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f12a00c6540 0x7f12a00c69c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:53.848 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:53.858+0000 7f129fe00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f12a00c9ea0 0x7f12a00ca300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:53.848 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:53.858+0000 7f129fe00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f12a00afb10 con 0x7f1280004800 2024-03-27T09:59:53.848 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:53.858+0000 7f129fe00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f12a00af830 con 0x7f12a00c6540 2024-03-27T09:59:53.848 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:53.858+0000 7f129fe00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f12a015c330 con 0x7f12a00c9ea0 2024-03-27T09:59:53.848 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:53.858+0000 7f129ea00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1280004800 0x7f12a006da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:53.848 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:53.858+0000 7f129ea00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1280004800 0x7f12a006da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:48568/0 (socket says 172.21.15.57:48568) 2024-03-27T09:59:53.848 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:53.858+0000 7f129ea00640 1 -- 172.21.15.57:0/1567738970 learned_addr learned my addr 172.21.15.57:0/1567738970 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T09:59:53.848 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:53.859+0000 7f129e000640 1 --2- 172.21.15.57:0/1567738970 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f12a00c6540 0x7f12a00c69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:53.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:53.859+0000 7f129f400640 1 --2- 172.21.15.57:0/1567738970 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f12a00c9ea0 0x7f12a00ca300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:53.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:53.859+0000 7f129ea00640 1 -- 172.21.15.57:0/1567738970 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f12a00c9ea0 msgr2=0x7f12a00ca300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:53.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:53.859+0000 7f129ea00640 1 --2- 172.21.15.57:0/1567738970 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f12a00c9ea0 0x7f12a00ca300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:53.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:53.859+0000 7f129ea00640 1 -- 172.21.15.57:0/1567738970 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f12a00c6540 msgr2=0x7f12a00c69c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:53.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:53.859+0000 7f129ea00640 1 --2- 172.21.15.57:0/1567738970 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f12a00c6540 0x7f12a00c69c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:53.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:53.859+0000 7f129ea00640 1 -- 172.21.15.57:0/1567738970 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12a006c9c0 con 0x7f1280004800 2024-03-27T09:59:53.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:53.859+0000 7f129f400640 1 --2- 172.21.15.57:0/1567738970 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f12a00c9ea0 0x7f12a00ca300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T09:59:53.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:53.859+0000 7f129ea00640 1 --2- 172.21.15.57:0/1567738970 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1280004800 0x7f12a006da60 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f12900116d0 tx=0x7f1290011b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:53.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:53.859+0000 7f1297400640 1 -- 172.21.15.57:0/1567738970 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f129000f9c0 con 0x7f1280004800 2024-03-27T09:59:53.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:53.859+0000 7f1297400640 1 -- 172.21.15.57:0/1567738970 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f129000fb60 con 0x7f1280004800 2024-03-27T09:59:53.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:53.859+0000 7f1297400640 1 -- 172.21.15.57:0/1567738970 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1290015460 con 0x7f1280004800 2024-03-27T09:59:53.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:53.859+0000 7f129fe00640 1 -- 172.21.15.57:0/1567738970 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12a006cca0 con 0x7f1280004800 2024-03-27T09:59:53.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:53.860+0000 7f129fe00640 1 -- 172.21.15.57:0/1567738970 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12a006d260 con 0x7f1280004800 2024-03-27T09:59:53.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:53.861+0000 7f129fe00640 1 -- 172.21.15.57:0/1567738970 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12a0068c50 con 0x7f1280004800 2024-03-27T09:59:53.851 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:53.862+0000 7f1297400640 1 -- 172.21.15.57:0/1567738970 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f1290015600 con 0x7f1280004800 2024-03-27T09:59:53.851 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:53.863+0000 7f1297400640 1 --2- 172.21.15.57:0/1567738970 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f127c06c560 0x7f127c06ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:53.852 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:53.863+0000 7f1297400640 1 -- 172.21.15.57:0/1567738970 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f129008c470 con 0x7f1280004800 2024-03-27T09:59:53.852 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:53.863+0000 7f129e000640 1 --2- 172.21.15.57:0/1567738970 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f127c06c560 0x7f127c06ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:53.853 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:53.864+0000 7f129e000640 1 --2- 172.21.15.57:0/1567738970 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f127c06c560 0x7f127c06ea20 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1288034000 tx=0x7f1288009030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:53.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:53.868+0000 7f1297400640 1 -- 172.21.15.57:0/1567738970 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f1290019030 con 0x7f1280004800 2024-03-27T09:59:54.064 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.075+0000 7f129fe00640 1 -- 172.21.15.57:0/1567738970 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f12a00d0430 con 0x7f1280004800 2024-03-27T09:59:54.066 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.077+0000 7f1297400640 1 -- 172.21.15.57:0/1567738970 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18502 (secure 0 0 0) 0x7f129005a740 con 0x7f1280004800 2024-03-27T09:59:54.066 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T09:59:54.067 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":26,"fsid":"7ac43f86-2c16-4a97-98fb-715d3cebc75c","created":"2024-03-27T09:59:04.033417+0000","modified":"2024-03-27T09:59:35.208743+0000","last_up_change":"2024-03-27T09:59:16.969624+0000","last_in_change":"2024-03-27T09:59:07.421690+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-27T09:59:17.253008+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-27T09:59:26.690365+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-27T09:59:27.559059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-27T09:59:31.187596+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"47b44362-7302-4f2a-b735-582c6c3850cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6801","nonce":2020036298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6803","nonce":2020036298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6807","nonce":2020036298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6805","nonce":2020036298}]},"public_addr":"172.21.15.57:6801/2020036298","cluster_addr":"172.21.15.57:6803/2020036298","heartbeat_back_addr":"172.21.15.57:6807/2020036298","heartbeat_front_addr":"172.21.15.57:6805/2020036298","state":["exists","up"]},{"osd":1,"uuid":"feaf96f0-9431-4188-9a09-da505b40e934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6809","nonce":3190929242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6811","nonce":3190929242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6815","nonce":3190929242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6813","nonce":3190929242}]},"public_addr":"172.21.15.57:6809/3190929242","cluster_addr":"172.21.15.57:6811/3190929242","heartbeat_back_addr":"172.21.15.57:6815/3190929242","heartbeat_front_addr":"172.21.15.57:6813/3190929242","state":["exists","up"]},{"osd":2,"uuid":"21e406e6-cfbc-4fe7-a816-e2420487c95d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6817","nonce":4065849973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6819","nonce":4065849973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6823","nonce":4065849973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6821","nonce":4065849973}]},"public_addr":"172.21.15.57:6817/4065849973","cluster_addr":"172.21.15.57:6819/4065849973","heartbeat_back_addr":"172.21.15.57:6823/4065849973","heartbeat_front_addr":"172.21.15.57:6821/4065849973","state":["exists","up"]},{"osd":3,"uuid":"a389af1d-76c4-4dfc-b215-f983f4931257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6825","nonce":158084809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6827","nonce":158084809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6831","nonce":158084809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6829","nonce":158084809}]},"public_addr":"172.21.15.57:6825/158084809","cluster_addr":"172.21.15.57:6827/158084809","heartbeat_back_addr":"172.21.15.57:6831/158084809","heartbeat_front_addr":"172.21.15.57:6829/158084809","state":["exists","up"]},{"osd":4,"uuid":"e9b05dca-557a-43ee-b43f-9ce5b7d28304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6823","nonce":108719401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6827","nonce":108719401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6831","nonce":108719401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6829","nonce":108719401}]},"public_addr":"172.21.15.118:6823/108719401","cluster_addr":"172.21.15.118:6827/108719401","heartbeat_back_addr":"172.21.15.118:6831/108719401","heartbeat_front_addr":"172.21.15.118:6829/108719401","state":["exists","up"]},{"osd":5,"uuid":"d968177d-44ff-499a-b00a-b147ed879253","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6817","nonce":2704605866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6819","nonce":2704605866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6826","nonce":2704605866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6822","nonce":2704605866}]},"public_addr":"172.21.15.118:6817/2704605866","cluster_addr":"172.21.15.118:6819/2704605866","heartbeat_back_addr":"172.21.15.118:6826/2704605866","heartbeat_front_addr":"172.21.15.118:6822/2704605866","state":["exists","up"]},{"osd":6,"uuid":"e8f98052-e6ad-4cfe-a4a9-0b17a434d54e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6801","nonce":1963659095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6803","nonce":1963659095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6807","nonce":1963659095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6805","nonce":1963659095}]},"public_addr":"172.21.15.118:6801/1963659095","cluster_addr":"172.21.15.118:6803/1963659095","heartbeat_back_addr":"172.21.15.118:6807/1963659095","heartbeat_front_addr":"172.21.15.118:6805/1963659095","state":["exists","up"]},{"osd":7,"uuid":"eccff987-8e51-4a63-845a-cf0a3196d7fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6809","nonce":1955879596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6811","nonce":1955879596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6815","nonce":1955879596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6813","nonce":1955879596}]},"public_addr":"172.21.15.118:6809/1955879596","cluster_addr":"172.21.15.118:6811/1955879596","heartbeat_back_addr":"172.21.15.118:6815/1955879596","heartbeat_front_addr":"172.21.15.118:6813/1955879596","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.721258+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.696610+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.777895+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.806769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.743259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.845687+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:13.020165+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.722294+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-27T09:59:54.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.080+0000 7f129fe00640 1 -- 172.21.15.57:0/1567738970 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f127c06c560 msgr2=0x7f127c06ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:54.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.080+0000 7f129fe00640 1 --2- 172.21.15.57:0/1567738970 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f127c06c560 0x7f127c06ea20 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1288034000 tx=0x7f1288009030 comp rx=0 tx=0).stop 2024-03-27T09:59:54.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.080+0000 7f129fe00640 1 -- 172.21.15.57:0/1567738970 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1280004800 msgr2=0x7f12a006da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:54.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.080+0000 7f129fe00640 1 --2- 172.21.15.57:0/1567738970 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1280004800 0x7f12a006da60 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f12900116d0 tx=0x7f1290011b90 comp rx=0 tx=0).stop 2024-03-27T09:59:54.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.080+0000 7f129fe00640 1 -- 172.21.15.57:0/1567738970 shutdown_connections 2024-03-27T09:59:54.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.080+0000 7f129fe00640 1 --2- 172.21.15.57:0/1567738970 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f12a00c9ea0 0x7f12a00ca300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:54.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.080+0000 7f129fe00640 1 --2- 172.21.15.57:0/1567738970 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f127c06c560 0x7f127c06ea20 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:54.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.080+0000 7f129fe00640 1 --2- 172.21.15.57:0/1567738970 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f12a00c6540 0x7f12a00c69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:54.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.080+0000 7f129fe00640 1 --2- 172.21.15.57:0/1567738970 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1280004800 0x7f12a006da60 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:54.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.080+0000 7f129fe00640 1 -- 172.21.15.57:0/1567738970 >> 172.21.15.57:0/1567738970 conn(0x7f12a009aa30 msgr2=0x7f12a00b1810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:54.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.080+0000 7f129fe00640 1 -- 172.21.15.57:0/1567738970 shutdown_connections 2024-03-27T09:59:54.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.080+0000 7f129fe00640 1 -- 172.21.15.57:0/1567738970 wait complete. 2024-03-27T09:59:54.090 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-27T09:59:54.314 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.325+0000 7f20af800640 1 Processor -- start 2024-03-27T09:59:54.314 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.325+0000 7f20af800640 1 -- start start 2024-03-27T09:59:54.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.327+0000 7f20af800640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f20a806b7a0 0x7f20a815f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:54.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.327+0000 7f20af800640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20a815eb00 con 0x7f20a80cd330 2024-03-27T09:59:54.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.327+0000 7f20af800640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20a806dc70 con 0x7f20a806bb80 2024-03-27T09:59:54.317 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.327+0000 7f20af800640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f20a806df50 con 0x7f20a806b7a0 2024-03-27T09:59:54.317 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.328+0000 7f20ace00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f20a806b7a0 0x7f20a815f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:54.317 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.328+0000 7f20ad800640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f20a80cd330 0x7f20a80cd780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:60830/0 (socket says 172.21.15.57:60830) 2024-03-27T09:59:54.317 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.328+0000 7f20ad800640 1 -- 172.21.15.57:0/3849904111 learned_addr learned my addr 172.21.15.57:0/3849904111 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T09:59:54.317 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.328+0000 7f20ace00640 1 -- 172.21.15.57:0/3849904111 >> v1:172.21.15.118:6789/0 conn(0x7f20a806bb80 legacy=0x7f20a806d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T09:59:54.317 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.328+0000 7f20ace00640 1 -- 172.21.15.57:0/3849904111 >> v1:172.21.15.57:6789/0 conn(0x7f20a80cd330 legacy=0x7f20a80cd780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:54.317 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.328+0000 7f20ace00640 1 -- 172.21.15.57:0/3849904111 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20a815edc0 con 0x7f20a806b7a0 2024-03-27T09:59:54.318 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.329+0000 7f20ace00640 1 --2- 172.21.15.57:0/3849904111 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f20a806b7a0 0x7f20a815f5c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f209c0097a0 tx=0x7f209c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d32368b226d866d server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:54.319 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.330+0000 7f20a7400640 1 -- 172.21.15.57:0/3849904111 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f209c035020 con 0x7f20a806b7a0 2024-03-27T09:59:54.319 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.330+0000 7f20a7400640 1 -- 172.21.15.57:0/3849904111 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f209c031830 con 0x7f20a806b7a0 2024-03-27T09:59:54.319 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.330+0000 7f20a7400640 1 -- 172.21.15.57:0/3849904111 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f209c031c00 con 0x7f20a806b7a0 2024-03-27T09:59:54.320 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.331+0000 7f20af800640 1 -- 172.21.15.57:0/3849904111 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f20a806b7a0 msgr2=0x7f20a815f5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:54.320 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.331+0000 7f20af800640 1 --2- 172.21.15.57:0/3849904111 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f20a806b7a0 0x7f20a815f5c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f209c0097a0 tx=0x7f209c02b8d0 comp rx=0 tx=0).stop 2024-03-27T09:59:54.320 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.331+0000 7f20af800640 1 -- 172.21.15.57:0/3849904111 shutdown_connections 2024-03-27T09:59:54.320 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.331+0000 7f20af800640 1 --2- 172.21.15.57:0/3849904111 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f20a806b7a0 0x7f20a815f5c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:54.321 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.331+0000 7f20af800640 1 -- 172.21.15.57:0/3849904111 >> 172.21.15.57:0/3849904111 conn(0x7f20a80b1c60 msgr2=0x7f20a80b2070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:54.321 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.331+0000 7f20af800640 1 -- 172.21.15.57:0/3849904111 shutdown_connections 2024-03-27T09:59:54.321 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.331+0000 7f20af800640 1 -- 172.21.15.57:0/3849904111 wait complete. 2024-03-27T09:59:54.322 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.333+0000 7f20af800640 1 Processor -- start 2024-03-27T09:59:54.322 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.333+0000 7f20af800640 1 -- start start 2024-03-27T09:59:54.324 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.334+0000 7f20af800640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f20a806b7a0 0x7f20a8136400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:54.324 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.334+0000 7f20af800640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f20a806bb80 0x7f20a815dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:54.324 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.334+0000 7f20af800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f20a80cd330 0x7f20a8139980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:54.325 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.334+0000 7f20af800640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f20a806bfd0 con 0x7f20a806b7a0 2024-03-27T09:59:54.325 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.334+0000 7f20af800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f20a80726b0 con 0x7f20a80cd330 2024-03-27T09:59:54.325 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.334+0000 7f20af800640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f20a806c150 con 0x7f20a806bb80 2024-03-27T09:59:54.325 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.334+0000 7f20ace00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f20a806b7a0 0x7f20a8136400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:54.325 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.334+0000 7f20ace00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f20a806b7a0 0x7f20a8136400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:48584/0 (socket says 172.21.15.57:48584) 2024-03-27T09:59:54.325 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.334+0000 7f20ace00640 1 -- 172.21.15.57:0/3652713618 learned_addr learned my addr 172.21.15.57:0/3652713618 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T09:59:54.325 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.335+0000 7f20ad800640 1 --2- 172.21.15.57:0/3652713618 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f20a80cd330 0x7f20a8139980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:54.325 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.335+0000 7f20a7e00640 1 --2- 172.21.15.57:0/3652713618 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f20a806bb80 0x7f20a815dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:54.325 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.335+0000 7f20ace00640 1 -- 172.21.15.57:0/3652713618 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f20a806bb80 msgr2=0x7f20a815dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:54.325 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.335+0000 7f20ace00640 1 --2- 172.21.15.57:0/3652713618 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f20a806bb80 0x7f20a815dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:54.325 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.335+0000 7f20ace00640 1 -- 172.21.15.57:0/3652713618 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f20a80cd330 msgr2=0x7f20a8139980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:54.325 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.335+0000 7f20ace00640 1 --2- 172.21.15.57:0/3652713618 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f20a80cd330 0x7f20a8139980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:54.325 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.335+0000 7f20ace00640 1 -- 172.21.15.57:0/3652713618 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20a815c050 con 0x7f20a806b7a0 2024-03-27T09:59:54.326 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.335+0000 7f20ad800640 1 --2- 172.21.15.57:0/3652713618 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f20a80cd330 0x7f20a8139980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T09:59:54.326 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.335+0000 7f20a7e00640 1 --2- 172.21.15.57:0/3652713618 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f20a806bb80 0x7f20a815dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T09:59:54.326 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.335+0000 7f20ace00640 1 --2- 172.21.15.57:0/3652713618 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f20a806b7a0 0x7f20a8136400 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f209c02bee0 tx=0x7f209c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:54.326 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.335+0000 7f20a4c00640 1 -- 172.21.15.57:0/3652713618 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f209c041070 con 0x7f20a806b7a0 2024-03-27T09:59:54.326 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.335+0000 7f20a4c00640 1 -- 172.21.15.57:0/3652713618 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f209c03a950 con 0x7f20a806b7a0 2024-03-27T09:59:54.326 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.335+0000 7f20af800640 1 -- 172.21.15.57:0/3652713618 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20a80cd800 con 0x7f20a806b7a0 2024-03-27T09:59:54.326 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.335+0000 7f20a4c00640 1 -- 172.21.15.57:0/3652713618 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f209c035040 con 0x7f20a806b7a0 2024-03-27T09:59:54.326 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.336+0000 7f20af800640 1 -- 172.21.15.57:0/3652713618 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20a815c2f0 con 0x7f20a806b7a0 2024-03-27T09:59:54.327 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.337+0000 7f20af800640 1 -- 172.21.15.57:0/3652713618 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20a8072ba0 con 0x7f20a806b7a0 2024-03-27T09:59:54.327 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.338+0000 7f20a4c00640 1 -- 172.21.15.57:0/3652713618 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f209c04c060 con 0x7f20a806b7a0 2024-03-27T09:59:54.327 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.338+0000 7f20a4c00640 1 --2- 172.21.15.57:0/3652713618 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f208806c530 0x7f208806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:54.327 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.339+0000 7f20a4c00640 1 -- 172.21.15.57:0/3652713618 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f209c0ad4f0 con 0x7f20a806b7a0 2024-03-27T09:59:54.327 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.339+0000 7f20a7e00640 1 --2- 172.21.15.57:0/3652713618 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f208806c530 0x7f208806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:54.328 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.340+0000 7f20a7e00640 1 --2- 172.21.15.57:0/3652713618 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f208806c530 0x7f208806e9f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f20a815be70 tx=0x7f2094009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:54.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.343+0000 7f20a4c00640 1 -- 172.21.15.57:0/3652713618 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f20a8072ba0 con 0x7f20a806b7a0 2024-03-27T09:59:54.538 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.549+0000 7f20af800640 1 -- 172.21.15.57:0/3652713618 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f20a8068ff0 con 0x7f20a806b7a0 2024-03-27T09:59:54.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.551+0000 7f20a4c00640 1 -- 172.21.15.57:0/3652713618 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18502 (secure 0 0 0) 0x7f20a8068ff0 con 0x7f20a806b7a0 2024-03-27T09:59:54.541 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T09:59:54.541 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":26,"fsid":"7ac43f86-2c16-4a97-98fb-715d3cebc75c","created":"2024-03-27T09:59:04.033417+0000","modified":"2024-03-27T09:59:35.208743+0000","last_up_change":"2024-03-27T09:59:16.969624+0000","last_in_change":"2024-03-27T09:59:07.421690+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-27T09:59:17.253008+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-27T09:59:26.690365+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-27T09:59:27.559059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-27T09:59:31.187596+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"47b44362-7302-4f2a-b735-582c6c3850cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6801","nonce":2020036298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6803","nonce":2020036298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6807","nonce":2020036298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6805","nonce":2020036298}]},"public_addr":"172.21.15.57:6801/2020036298","cluster_addr":"172.21.15.57:6803/2020036298","heartbeat_back_addr":"172.21.15.57:6807/2020036298","heartbeat_front_addr":"172.21.15.57:6805/2020036298","state":["exists","up"]},{"osd":1,"uuid":"feaf96f0-9431-4188-9a09-da505b40e934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6809","nonce":3190929242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6811","nonce":3190929242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6815","nonce":3190929242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6813","nonce":3190929242}]},"public_addr":"172.21.15.57:6809/3190929242","cluster_addr":"172.21.15.57:6811/3190929242","heartbeat_back_addr":"172.21.15.57:6815/3190929242","heartbeat_front_addr":"172.21.15.57:6813/3190929242","state":["exists","up"]},{"osd":2,"uuid":"21e406e6-cfbc-4fe7-a816-e2420487c95d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6817","nonce":4065849973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6819","nonce":4065849973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6823","nonce":4065849973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6821","nonce":4065849973}]},"public_addr":"172.21.15.57:6817/4065849973","cluster_addr":"172.21.15.57:6819/4065849973","heartbeat_back_addr":"172.21.15.57:6823/4065849973","heartbeat_front_addr":"172.21.15.57:6821/4065849973","state":["exists","up"]},{"osd":3,"uuid":"a389af1d-76c4-4dfc-b215-f983f4931257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6825","nonce":158084809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6827","nonce":158084809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6831","nonce":158084809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6829","nonce":158084809}]},"public_addr":"172.21.15.57:6825/158084809","cluster_addr":"172.21.15.57:6827/158084809","heartbeat_back_addr":"172.21.15.57:6831/158084809","heartbeat_front_addr":"172.21.15.57:6829/158084809","state":["exists","up"]},{"osd":4,"uuid":"e9b05dca-557a-43ee-b43f-9ce5b7d28304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6823","nonce":108719401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6827","nonce":108719401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6831","nonce":108719401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6829","nonce":108719401}]},"public_addr":"172.21.15.118:6823/108719401","cluster_addr":"172.21.15.118:6827/108719401","heartbeat_back_addr":"172.21.15.118:6831/108719401","heartbeat_front_addr":"172.21.15.118:6829/108719401","state":["exists","up"]},{"osd":5,"uuid":"d968177d-44ff-499a-b00a-b147ed879253","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6817","nonce":2704605866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6819","nonce":2704605866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6826","nonce":2704605866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6822","nonce":2704605866}]},"public_addr":"172.21.15.118:6817/2704605866","cluster_addr":"172.21.15.118:6819/2704605866","heartbeat_back_addr":"172.21.15.118:6826/2704605866","heartbeat_front_addr":"172.21.15.118:6822/2704605866","state":["exists","up"]},{"osd":6,"uuid":"e8f98052-e6ad-4cfe-a4a9-0b17a434d54e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6801","nonce":1963659095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6803","nonce":1963659095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6807","nonce":1963659095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6805","nonce":1963659095}]},"public_addr":"172.21.15.118:6801/1963659095","cluster_addr":"172.21.15.118:6803/1963659095","heartbeat_back_addr":"172.21.15.118:6807/1963659095","heartbeat_front_addr":"172.21.15.118:6805/1963659095","state":["exists","up"]},{"osd":7,"uuid":"eccff987-8e51-4a63-845a-cf0a3196d7fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6809","nonce":1955879596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6811","nonce":1955879596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6815","nonce":1955879596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6813","nonce":1955879596}]},"public_addr":"172.21.15.118:6809/1955879596","cluster_addr":"172.21.15.118:6811/1955879596","heartbeat_back_addr":"172.21.15.118:6815/1955879596","heartbeat_front_addr":"172.21.15.118:6813/1955879596","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.721258+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.696610+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.777895+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.806769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.743259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.845687+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:13.020165+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.722294+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-27T09:59:54.544 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.554+0000 7f20af800640 1 -- 172.21.15.57:0/3652713618 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f208806c530 msgr2=0x7f208806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:54.544 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.554+0000 7f20af800640 1 --2- 172.21.15.57:0/3652713618 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f208806c530 0x7f208806e9f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f20a815be70 tx=0x7f2094009040 comp rx=0 tx=0).stop 2024-03-27T09:59:54.544 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.554+0000 7f20af800640 1 -- 172.21.15.57:0/3652713618 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f20a806b7a0 msgr2=0x7f20a8136400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:54.544 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.554+0000 7f20af800640 1 --2- 172.21.15.57:0/3652713618 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f20a806b7a0 0x7f20a8136400 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f209c02bee0 tx=0x7f209c0046c0 comp rx=0 tx=0).stop 2024-03-27T09:59:54.544 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.554+0000 7f20af800640 1 -- 172.21.15.57:0/3652713618 shutdown_connections 2024-03-27T09:59:54.544 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.554+0000 7f20af800640 1 --2- 172.21.15.57:0/3652713618 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f208806c530 0x7f208806e9f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:54.544 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.554+0000 7f20af800640 1 --2- 172.21.15.57:0/3652713618 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f20a80cd330 0x7f20a8139980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:54.544 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.554+0000 7f20af800640 1 --2- 172.21.15.57:0/3652713618 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f20a806bb80 0x7f20a815dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:54.544 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.554+0000 7f20af800640 1 --2- 172.21.15.57:0/3652713618 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f20a806b7a0 0x7f20a8136400 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:54.544 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.554+0000 7f20af800640 1 -- 172.21.15.57:0/3652713618 >> 172.21.15.57:0/3652713618 conn(0x7f20a80b1c60 msgr2=0x7f20a80b0930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:54.544 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.554+0000 7f20af800640 1 -- 172.21.15.57:0/3652713618 shutdown_connections 2024-03-27T09:59:54.544 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.554+0000 7f20af800640 1 -- 172.21.15.57:0/3652713618 wait complete. 2024-03-27T09:59:54.564 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-03-27T09:59:54.791 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.801+0000 7f4d82800640 1 Processor -- start 2024-03-27T09:59:54.791 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.802+0000 7f4d82800640 1 -- start start 2024-03-27T09:59:54.792 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.803+0000 7f4d82800640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4d7c15d1a0 0x7f4d7c0acd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:54.792 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.803+0000 7f4d82800640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f4d7c06cf30 0x7f4d7c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:54.792 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.804+0000 7f4d82800640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d7c15d630 con 0x7f4d7c0aea20 2024-03-27T09:59:54.792 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.804+0000 7f4d82800640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f4d7c15c4c0 con 0x7f4d7c06cf30 2024-03-27T09:59:54.793 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.804+0000 7f4d82800640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f4d7c072600 con 0x7f4d7c15d1a0 2024-03-27T09:59:54.793 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.804+0000 7f4d7aa00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4d7c15d1a0 0x7f4d7c0acd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:54.793 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.804+0000 7f4d7be00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f4d7c06cf30 0x7f4d7c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:54.793 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.804+0000 7f4d7be00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f4d7c06cf30 0x7f4d7c06d360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.57:52558/0 (socket says 172.21.15.57:52558) 2024-03-27T09:59:54.793 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.804+0000 7f4d7be00640 1 -- 172.21.15.57:0/2984224850 learned_addr learned my addr 172.21.15.57:0/2984224850 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T09:59:54.794 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.805+0000 7f4d7be00640 1 -- 172.21.15.57:0/2984224850 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4d7c15d1a0 msgr2=0x7f4d7c0acd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T09:59:54.794 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.805+0000 7f4d7be00640 1 --2- 172.21.15.57:0/2984224850 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4d7c15d1a0 0x7f4d7c0acd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:54.794 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.805+0000 7f4d7be00640 1 -- 172.21.15.57:0/2984224850 >> v1:172.21.15.118:6789/0 conn(0x7f4d7c0aea20 legacy=0x7f4d7c0aee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:54.794 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.805+0000 7f4d7be00640 1 -- 172.21.15.57:0/2984224850 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d7c0728e0 con 0x7f4d7c06cf30 2024-03-27T09:59:54.795 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.806+0000 7f4d7be00640 1 --2- 172.21.15.57:0/2984224850 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4d7c06cf30 0x7f4d7c06d360 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4d74009e50 tx=0x7f4d7402bed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=43b05143ca8e540a server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:54.796 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.807+0000 7f4d7a000640 1 -- 172.21.15.57:0/2984224850 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d7402ca70 con 0x7f4d7c06cf30 2024-03-27T09:59:54.796 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.807+0000 7f4d7a000640 1 -- 172.21.15.57:0/2984224850 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d7402cc10 con 0x7f4d7c06cf30 2024-03-27T09:59:54.796 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.807+0000 7f4d7a000640 1 -- 172.21.15.57:0/2984224850 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d740343f0 con 0x7f4d7c06cf30 2024-03-27T09:59:54.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.807+0000 7f4d82800640 1 -- 172.21.15.57:0/2984224850 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4d7c06cf30 msgr2=0x7f4d7c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:54.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.807+0000 7f4d82800640 1 --2- 172.21.15.57:0/2984224850 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4d7c06cf30 0x7f4d7c06d360 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4d74009e50 tx=0x7f4d7402bed0 comp rx=0 tx=0).stop 2024-03-27T09:59:54.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.808+0000 7f4d82800640 1 -- 172.21.15.57:0/2984224850 shutdown_connections 2024-03-27T09:59:54.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.808+0000 7f4d82800640 1 --2- 172.21.15.57:0/2984224850 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4d7c06cf30 0x7f4d7c06d360 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:54.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.808+0000 7f4d82800640 1 --2- 172.21.15.57:0/2984224850 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4d7c15d1a0 0x7f4d7c0acd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:54.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.808+0000 7f4d82800640 1 -- 172.21.15.57:0/2984224850 >> 172.21.15.57:0/2984224850 conn(0x7f4d7c0b18a0 msgr2=0x7f4d7c0b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:54.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.808+0000 7f4d82800640 1 -- 172.21.15.57:0/2984224850 shutdown_connections 2024-03-27T09:59:54.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.808+0000 7f4d82800640 1 -- 172.21.15.57:0/2984224850 wait complete. 2024-03-27T09:59:54.799 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.810+0000 7f4d82800640 1 Processor -- start 2024-03-27T09:59:54.799 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.810+0000 7f4d82800640 1 -- start start 2024-03-27T09:59:54.802 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.812+0000 7f4d82800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4d7c06cf30 0x7f4d7c14d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:54.802 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.812+0000 7f4d82800640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4d7c0aea20 0x7f4d7c1f5310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:54.802 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.812+0000 7f4d82800640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d7c15d1a0 0x7f4d7c1f5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:54.802 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.812+0000 7f4d82800640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f4d7c0733c0 con 0x7f4d7c15d1a0 2024-03-27T09:59:54.802 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.812+0000 7f4d82800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f4d7c072ea0 con 0x7f4d7c06cf30 2024-03-27T09:59:54.802 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.812+0000 7f4d82800640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f4d7c06d8a0 con 0x7f4d7c0aea20 2024-03-27T09:59:54.802 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.812+0000 7f4d7be00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d7c15d1a0 0x7f4d7c1f5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:54.802 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.812+0000 7f4d7be00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d7c15d1a0 0x7f4d7c1f5850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:48600/0 (socket says 172.21.15.57:48600) 2024-03-27T09:59:54.802 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.812+0000 7f4d7be00640 1 -- 172.21.15.57:0/3812780047 learned_addr learned my addr 172.21.15.57:0/3812780047 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T09:59:54.803 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.812+0000 7f4d7b400640 1 --2- 172.21.15.57:0/3812780047 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4d7c06cf30 0x7f4d7c14d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:54.803 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.812+0000 7f4d7aa00640 1 --2- 172.21.15.57:0/3812780047 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4d7c0aea20 0x7f4d7c1f5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:54.803 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.813+0000 7f4d7be00640 1 -- 172.21.15.57:0/3812780047 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4d7c0aea20 msgr2=0x7f4d7c1f5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:54.803 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.813+0000 7f4d7be00640 1 --2- 172.21.15.57:0/3812780047 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4d7c0aea20 0x7f4d7c1f5310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:54.803 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.813+0000 7f4d7be00640 1 -- 172.21.15.57:0/3812780047 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4d7c06cf30 msgr2=0x7f4d7c14d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:54.803 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.813+0000 7f4d7be00640 1 --2- 172.21.15.57:0/3812780047 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4d7c06cf30 0x7f4d7c14d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:54.803 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.813+0000 7f4d7be00640 1 -- 172.21.15.57:0/3812780047 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d7c1f6160 con 0x7f4d7c15d1a0 2024-03-27T09:59:54.803 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.813+0000 7f4d7b400640 1 --2- 172.21.15.57:0/3812780047 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4d7c06cf30 0x7f4d7c14d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T09:59:54.803 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.813+0000 7f4d7be00640 1 --2- 172.21.15.57:0/3812780047 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d7c15d1a0 0x7f4d7c1f5850 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4d74036040 tx=0x7f4d74004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:54.804 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.813+0000 7f4d73400640 1 -- 172.21.15.57:0/3812780047 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d74043020 con 0x7f4d7c15d1a0 2024-03-27T09:59:54.804 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.814+0000 7f4d73400640 1 -- 172.21.15.57:0/3812780047 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d7403e450 con 0x7f4d7c15d1a0 2024-03-27T09:59:54.804 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.814+0000 7f4d73400640 1 -- 172.21.15.57:0/3812780047 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d74009510 con 0x7f4d7c15d1a0 2024-03-27T09:59:54.804 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.814+0000 7f4d82800640 1 -- 172.21.15.57:0/3812780047 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d7c156d10 con 0x7f4d7c15d1a0 2024-03-27T09:59:54.804 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.814+0000 7f4d82800640 1 -- 172.21.15.57:0/3812780047 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d7c09aad0 con 0x7f4d7c15d1a0 2024-03-27T09:59:54.804 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.815+0000 7f4d82800640 1 -- 172.21.15.57:0/3812780047 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d7c068540 con 0x7f4d7c15d1a0 2024-03-27T09:59:54.805 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.816+0000 7f4d73400640 1 -- 172.21.15.57:0/3812780047 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f4d74046020 con 0x7f4d7c15d1a0 2024-03-27T09:59:54.806 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.817+0000 7f4d73400640 1 --2- 172.21.15.57:0/3812780047 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f4d5c06c530 0x7f4d5c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:54.806 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.817+0000 7f4d73400640 1 -- 172.21.15.57:0/3812780047 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f4d740ae1f0 con 0x7f4d7c15d1a0 2024-03-27T09:59:54.806 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.817+0000 7f4d7b400640 1 --2- 172.21.15.57:0/3812780047 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f4d5c06c530 0x7f4d5c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:54.807 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.818+0000 7f4d7b400640 1 --2- 172.21.15.57:0/3812780047 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f4d5c06c530 0x7f4d5c06e9f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c001700 tx=0x7f4d6c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:54.810 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:54.822+0000 7f4d73400640 1 -- 172.21.15.57:0/3812780047 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f4d7404d030 con 0x7f4d7c15d1a0 2024-03-27T09:59:55.056 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:55.067+0000 7f4d82800640 1 -- 172.21.15.57:0/3812780047 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f4d7c15bce0 con 0x7f4d7c15d1a0 2024-03-27T09:59:55.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:55.340+0000 7f4d73400640 1 -- 172.21.15.57:0/3812780047 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) ==== 118+0+0 (secure 0 0 0) 0x7f4d7407c430 con 0x7f4d7c15d1a0 2024-03-27T09:59:55.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:55.346+0000 7f4d82800640 1 -- 172.21.15.57:0/3812780047 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f4d5c06c530 msgr2=0x7f4d5c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:55.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:55.346+0000 7f4d82800640 1 --2- 172.21.15.57:0/3812780047 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f4d5c06c530 0x7f4d5c06e9f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c001700 tx=0x7f4d6c009040 comp rx=0 tx=0).stop 2024-03-27T09:59:55.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:55.346+0000 7f4d82800640 1 -- 172.21.15.57:0/3812780047 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d7c15d1a0 msgr2=0x7f4d7c1f5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:55.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:55.346+0000 7f4d82800640 1 --2- 172.21.15.57:0/3812780047 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d7c15d1a0 0x7f4d7c1f5850 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4d74036040 tx=0x7f4d74004a40 comp rx=0 tx=0).stop 2024-03-27T09:59:55.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:55.346+0000 7f4d82800640 1 -- 172.21.15.57:0/3812780047 shutdown_connections 2024-03-27T09:59:55.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:55.346+0000 7f4d82800640 1 --2- 172.21.15.57:0/3812780047 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4d7c15d1a0 0x7f4d7c1f5850 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:55.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:55.346+0000 7f4d82800640 1 --2- 172.21.15.57:0/3812780047 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4d7c0aea20 0x7f4d7c1f5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:55.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:55.346+0000 7f4d82800640 1 --2- 172.21.15.57:0/3812780047 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f4d5c06c530 0x7f4d5c06e9f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:55.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:55.346+0000 7f4d82800640 1 --2- 172.21.15.57:0/3812780047 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4d7c06cf30 0x7f4d7c14d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:55.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:55.346+0000 7f4d82800640 1 -- 172.21.15.57:0/3812780047 >> 172.21.15.57:0/3812780047 conn(0x7f4d7c0b18a0 msgr2=0x7f4d7c0b00c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:55.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:55.346+0000 7f4d82800640 1 -- 172.21.15.57:0/3812780047 shutdown_connections 2024-03-27T09:59:55.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:55.347+0000 7f4d82800640 1 -- 172.21.15.57:0/3812780047 wait complete. 2024-03-27T09:59:55.361 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2024-03-27T09:59:55.362 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-03-27T09:59:55.590 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:55.601+0000 7f6b54200640 1 Processor -- start 2024-03-27T09:59:55.590 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:55.601+0000 7f6b54200640 1 -- start start 2024-03-27T09:59:55.592 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:55.603+0000 7f6b54200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6b4c15b640 0x7f6b4c06e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:55.592 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:55.603+0000 7f6b54200640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f6b4c06f2a0 0x7f6b4c0b4660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:55.592 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:55.603+0000 7f6b54200640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6b4c15e8c0 0x7f6b4c0712d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:55.592 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:55.603+0000 7f6b54200640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f6b4c15b1b0 con 0x7f6b4c15e8c0 2024-03-27T09:59:55.592 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:55.603+0000 7f6b54200640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f6b4c15a8a0 con 0x7f6b4c06f2a0 2024-03-27T09:59:55.592 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:55.603+0000 7f6b54200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f6b4c0b4d20 con 0x7f6b4c15b640 2024-03-27T09:59:55.592 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:55.603+0000 7f6b52200640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6b4c15e8c0 0x7f6b4c0712d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:55.592 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:55.603+0000 7f6b52200640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6b4c15e8c0 0x7f6b4c0712d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:48602/0 (socket says 172.21.15.57:48602) 2024-03-27T09:59:55.592 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:55.603+0000 7f6b52200640 1 -- 172.21.15.57:0/1102843575 learned_addr learned my addr 172.21.15.57:0/1102843575 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T09:59:55.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:55.603+0000 7f6b51800640 1 --2- 172.21.15.57:0/1102843575 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6b4c15b640 0x7f6b4c06e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:55.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:55.603+0000 7f6b50e00640 1 --2- 172.21.15.57:0/1102843575 >> v2:172.21.15.118:3300/0 conn(0x7f6b4c06f2a0 0x7f6b4c0b4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:55.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:55.604+0000 7f6b52200640 1 -- 172.21.15.57:0/1102843575 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6b4c15b640 msgr2=0x7f6b4c06e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T09:59:55.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:55.604+0000 7f6b52200640 1 --2- 172.21.15.57:0/1102843575 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6b4c15b640 0x7f6b4c06e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:55.594 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:55.604+0000 7f6b52200640 1 -- 172.21.15.57:0/1102843575 >> v2:172.21.15.118:3300/0 conn(0x7f6b4c06f2a0 msgr2=0x7f6b4c0b4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T09:59:55.594 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:55.604+0000 7f6b52200640 1 --2- 172.21.15.57:0/1102843575 >> v2:172.21.15.118:3300/0 conn(0x7f6b4c06f2a0 0x7f6b4c0b4660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:55.594 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:55.604+0000 7f6b52200640 1 -- 172.21.15.57:0/1102843575 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b4c15ab60 con 0x7f6b4c15e8c0 2024-03-27T09:59:55.594 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:55.605+0000 7f6b52200640 1 --2- 172.21.15.57:0/1102843575 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b4c15e8c0 0x7f6b4c0712d0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f6b4c06fd60 tx=0x7f6b4402e0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd5353c27df620d3 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:55.595 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:55.606+0000 7f6b4be00640 1 -- 172.21.15.57:0/1102843575 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b4402ea80 con 0x7f6b4c15e8c0 2024-03-27T09:59:55.595 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:55.606+0000 7f6b4be00640 1 -- 172.21.15.57:0/1102843575 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b4402ec20 con 0x7f6b4c15e8c0 2024-03-27T09:59:55.595 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:55.606+0000 7f6b4be00640 1 -- 172.21.15.57:0/1102843575 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b44009600 con 0x7f6b4c15e8c0 2024-03-27T09:59:55.596 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:55.606+0000 7f6b54200640 1 -- 172.21.15.57:0/1102843575 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b4c15e8c0 msgr2=0x7f6b4c0712d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:55.596 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:55.606+0000 7f6b54200640 1 --2- 172.21.15.57:0/1102843575 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b4c15e8c0 0x7f6b4c0712d0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f6b4c06fd60 tx=0x7f6b4402e0e0 comp rx=0 tx=0).stop 2024-03-27T09:59:55.596 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:55.607+0000 7f6b54200640 1 -- 172.21.15.57:0/1102843575 shutdown_connections 2024-03-27T09:59:55.596 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:55.607+0000 7f6b54200640 1 --2- 172.21.15.57:0/1102843575 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b4c15e8c0 0x7f6b4c0712d0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:55.596 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:55.607+0000 7f6b54200640 1 --2- 172.21.15.57:0/1102843575 >> v2:172.21.15.118:3300/0 conn(0x7f6b4c06f2a0 0x7f6b4c0b4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:55.596 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:55.607+0000 7f6b54200640 1 --2- 172.21.15.57:0/1102843575 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6b4c15b640 0x7f6b4c06e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:55.596 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:55.607+0000 7f6b54200640 1 -- 172.21.15.57:0/1102843575 >> 172.21.15.57:0/1102843575 conn(0x7f6b4c0b18a0 msgr2=0x7f6b4c0b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:55.596 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:55.607+0000 7f6b54200640 1 -- 172.21.15.57:0/1102843575 shutdown_connections 2024-03-27T09:59:55.596 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:55.607+0000 7f6b54200640 1 -- 172.21.15.57:0/1102843575 wait complete. 2024-03-27T09:59:55.597 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:55.608+0000 7f6b54200640 1 Processor -- start 2024-03-27T09:59:55.597 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:55.608+0000 7f6b54200640 1 -- start start 2024-03-27T09:59:55.599 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:55.609+0000 7f6b54200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6b4c06f2a0 0x7f6b4c1449b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:55.599 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:55.609+0000 7f6b54200640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b4c15b640 0x7f6b4c1591e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:55.599 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:55.609+0000 7f6b54200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b4c15e8c0 0x7f6b4c159720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:55.599 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:55.609+0000 7f6b54200640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f6b4c071810 con 0x7f6b4c15b640 2024-03-27T09:59:55.599 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:55.609+0000 7f6b54200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f6b4c15ecf0 con 0x7f6b4c15e8c0 2024-03-27T09:59:55.600 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:55.609+0000 7f6b54200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f6b4c071990 con 0x7f6b4c06f2a0 2024-03-27T09:59:55.600 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:55.610+0000 7f6b50e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b4c15b640 0x7f6b4c1591e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:55.600 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:55.610+0000 7f6b50e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b4c15b640 0x7f6b4c1591e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:48604/0 (socket says 172.21.15.57:48604) 2024-03-27T09:59:55.600 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:55.610+0000 7f6b50e00640 1 -- 172.21.15.57:0/563809105 learned_addr learned my addr 172.21.15.57:0/563809105 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T09:59:55.600 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:55.610+0000 7f6b51800640 1 --2- 172.21.15.57:0/563809105 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6b4c06f2a0 0x7f6b4c1449b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:55.600 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:55.610+0000 7f6b52200640 1 --2- 172.21.15.57:0/563809105 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b4c15e8c0 0x7f6b4c159720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:55.600 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:55.610+0000 7f6b50e00640 1 -- 172.21.15.57:0/563809105 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6b4c06f2a0 msgr2=0x7f6b4c1449b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:55.600 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:55.610+0000 7f6b50e00640 1 --2- 172.21.15.57:0/563809105 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6b4c06f2a0 0x7f6b4c1449b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:55.600 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:55.610+0000 7f6b50e00640 1 -- 172.21.15.57:0/563809105 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b4c15e8c0 msgr2=0x7f6b4c159720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:55.600 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:55.610+0000 7f6b50e00640 1 --2- 172.21.15.57:0/563809105 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b4c15e8c0 0x7f6b4c159720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:55.600 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:55.610+0000 7f6b50e00640 1 -- 172.21.15.57:0/563809105 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b4c1e74c0 con 0x7f6b4c15b640 2024-03-27T09:59:55.600 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:55.611+0000 7f6b50e00640 1 --2- 172.21.15.57:0/563809105 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b4c15b640 0x7f6b4c1591e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6b3800d7d0 tx=0x7f6b3800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:55.601 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:55.611+0000 7f6b49600640 1 -- 172.21.15.57:0/563809105 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b3800b6c0 con 0x7f6b4c15b640 2024-03-27T09:59:55.601 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:55.611+0000 7f6b49600640 1 -- 172.21.15.57:0/563809105 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b38019070 con 0x7f6b4c15b640 2024-03-27T09:59:55.601 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:55.611+0000 7f6b49600640 1 -- 172.21.15.57:0/563809105 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b3800ba80 con 0x7f6b4c15b640 2024-03-27T09:59:55.601 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:55.611+0000 7f6b54200640 1 -- 172.21.15.57:0/563809105 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b4c1e77a0 con 0x7f6b4c15b640 2024-03-27T09:59:55.602 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:55.611+0000 7f6b54200640 1 -- 172.21.15.57:0/563809105 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b4c144ef0 con 0x7f6b4c15b640 2024-03-27T09:59:55.602 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:55.612+0000 7f6b54200640 1 -- 172.21.15.57:0/563809105 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b4c145270 con 0x7f6b4c15b640 2024-03-27T09:59:55.602 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:55.613+0000 7f6b49600640 1 -- 172.21.15.57:0/563809105 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f6b3800bc20 con 0x7f6b4c15b640 2024-03-27T09:59:55.603 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:55.614+0000 7f6b49600640 1 --2- 172.21.15.57:0/563809105 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f6b2c06c530 0x7f6b2c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:55.603 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:55.614+0000 7f6b49600640 1 -- 172.21.15.57:0/563809105 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f6b3808bfa0 con 0x7f6b4c15b640 2024-03-27T09:59:55.603 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:55.615+0000 7f6b51800640 1 --2- 172.21.15.57:0/563809105 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f6b2c06c530 0x7f6b2c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:55.604 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:55.615+0000 7f6b51800640 1 --2- 172.21.15.57:0/563809105 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f6b2c06c530 0x7f6b2c06e9f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6b40006fd0 tx=0x7f6b40008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:55.608 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:55.619+0000 7f6b49600640 1 -- 172.21.15.57:0/563809105 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f6b4c145270 con 0x7f6b4c15b640 2024-03-27T09:59:55.851 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:55.862+0000 7f6b54200640 1 -- 172.21.15.57:0/563809105 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f6b4c1e7970 con 0x7f6b4c15b640 2024-03-27T09:59:56.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:56.346+0000 7f6b49600640 1 -- 172.21.15.57:0/563809105 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) ==== 122+0+0 (secure 0 0 0) 0x7f6b3805a150 con 0x7f6b4c15b640 2024-03-27T09:59:56.340 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:56.351+0000 7f6b54200640 1 -- 172.21.15.57:0/563809105 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f6b2c06c530 msgr2=0x7f6b2c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:56.340 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:56.351+0000 7f6b54200640 1 --2- 172.21.15.57:0/563809105 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f6b2c06c530 0x7f6b2c06e9f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6b40006fd0 tx=0x7f6b40008040 comp rx=0 tx=0).stop 2024-03-27T09:59:56.340 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:56.351+0000 7f6b54200640 1 -- 172.21.15.57:0/563809105 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b4c15b640 msgr2=0x7f6b4c1591e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:56.340 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:56.351+0000 7f6b54200640 1 --2- 172.21.15.57:0/563809105 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b4c15b640 0x7f6b4c1591e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6b3800d7d0 tx=0x7f6b3800dc90 comp rx=0 tx=0).stop 2024-03-27T09:59:56.340 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:56.351+0000 7f6b54200640 1 -- 172.21.15.57:0/563809105 shutdown_connections 2024-03-27T09:59:56.341 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:56.351+0000 7f6b54200640 1 --2- 172.21.15.57:0/563809105 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f6b2c06c530 0x7f6b2c06e9f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:56.341 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:56.351+0000 7f6b54200640 1 --2- 172.21.15.57:0/563809105 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6b4c15e8c0 0x7f6b4c159720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:56.341 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:56.351+0000 7f6b54200640 1 --2- 172.21.15.57:0/563809105 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6b4c15b640 0x7f6b4c1591e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:56.341 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:56.351+0000 7f6b54200640 1 --2- 172.21.15.57:0/563809105 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6b4c06f2a0 0x7f6b4c1449b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:56.341 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:56.351+0000 7f6b54200640 1 -- 172.21.15.57:0/563809105 >> 172.21.15.57:0/563809105 conn(0x7f6b4c0b18a0 msgr2=0x7f6b4c0af810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:56.341 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:56.351+0000 7f6b54200640 1 -- 172.21.15.57:0/563809105 shutdown_connections 2024-03-27T09:59:56.341 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:56.351+0000 7f6b54200640 1 -- 172.21.15.57:0/563809105 wait complete. 2024-03-27T09:59:56.364 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-03-27T09:59:56.364 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-27T09:59:56.583 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:56.593+0000 7fda6ec00640 1 Processor -- start 2024-03-27T09:59:56.583 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:56.594+0000 7fda6ec00640 1 -- start start 2024-03-27T09:59:56.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:56.595+0000 7fda6ec00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fda680d3fe0 0x7fda680d4440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:56.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:56.595+0000 7fda6ec00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fda680ceee0 0x7fda680cf370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:56.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:56.595+0000 7fda6ec00640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda6815f850 con 0x7fda6815e4a0 2024-03-27T09:59:56.586 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:56.595+0000 7fda6ec00640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7fda680d0a10 con 0x7fda680d3fe0 2024-03-27T09:59:56.586 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:56.595+0000 7fda6ec00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fda680d0cf0 con 0x7fda680ceee0 2024-03-27T09:59:56.586 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:56.596+0000 7fda67400640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fda680d3fe0 0x7fda680d4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:56.586 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:56.596+0000 7fda67e00640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fda6815e4a0 0x7fda680d14f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:60846/0 (socket says 172.21.15.57:60846) 2024-03-27T09:59:56.586 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:56.596+0000 7fda67e00640 1 -- 172.21.15.57:0/3120797126 learned_addr learned my addr 172.21.15.57:0/3120797126 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T09:59:56.586 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:56.596+0000 7fda6cc00640 1 --2- 172.21.15.57:0/3120797126 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fda680ceee0 0x7fda680cf370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:56.586 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:56.596+0000 7fda67400640 1 -- 172.21.15.57:0/3120797126 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fda680ceee0 msgr2=0x7fda680cf370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T09:59:56.586 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:56.596+0000 7fda67400640 1 --2- 172.21.15.57:0/3120797126 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fda680ceee0 0x7fda680cf370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:56.586 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:56.596+0000 7fda67400640 1 -- 172.21.15.57:0/3120797126 >> v1:172.21.15.57:6789/0 conn(0x7fda6815e4a0 legacy=0x7fda680d14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:56.587 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:56.596+0000 7fda67400640 1 -- 172.21.15.57:0/3120797126 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda680d4980 con 0x7fda680d3fe0 2024-03-27T09:59:56.587 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:56.596+0000 7fda6cc00640 1 --2- 172.21.15.57:0/3120797126 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fda680ceee0 0x7fda680cf370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T09:59:56.587 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:56.596+0000 7fda66a00640 1 -- 172.21.15.57:0/3120797126 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1834923328 0 0) 0x7fda6815f850 con 0x7fda6815e4a0 2024-03-27T09:59:56.588 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:56.597+0000 7fda67400640 1 --2- 172.21.15.57:0/3120797126 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda680d3fe0 0x7fda680d4440 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fda500097a0 tx=0x7fda5002b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d81f7447119b5fb3 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:56.588 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:56.598+0000 7fda66a00640 1 -- 172.21.15.57:0/3120797126 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda50035020 con 0x7fda680d3fe0 2024-03-27T09:59:56.588 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:56.598+0000 7fda66a00640 1 -- 172.21.15.57:0/3120797126 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda50031810 con 0x7fda680d3fe0 2024-03-27T09:59:56.588 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:56.598+0000 7fda66a00640 1 -- 172.21.15.57:0/3120797126 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda50031be0 con 0x7fda680d3fe0 2024-03-27T09:59:56.588 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:56.598+0000 7fda6ec00640 1 -- 172.21.15.57:0/3120797126 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda680d3fe0 msgr2=0x7fda680d4440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:56.588 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:56.598+0000 7fda6ec00640 1 --2- 172.21.15.57:0/3120797126 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda680d3fe0 0x7fda680d4440 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fda500097a0 tx=0x7fda5002b8b0 comp rx=0 tx=0).stop 2024-03-27T09:59:56.588 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:56.598+0000 7fda6ec00640 1 -- 172.21.15.57:0/3120797126 shutdown_connections 2024-03-27T09:59:56.588 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:56.598+0000 7fda6ec00640 1 --2- 172.21.15.57:0/3120797126 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fda680ceee0 0x7fda680cf370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:56.588 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:56.598+0000 7fda6ec00640 1 --2- 172.21.15.57:0/3120797126 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda680d3fe0 0x7fda680d4440 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:56.588 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:56.598+0000 7fda6ec00640 1 -- 172.21.15.57:0/3120797126 >> 172.21.15.57:0/3120797126 conn(0x7fda6808db50 msgr2=0x7fda6809d470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:56.588 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:56.598+0000 7fda6ec00640 1 -- 172.21.15.57:0/3120797126 shutdown_connections 2024-03-27T09:59:56.588 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:56.598+0000 7fda6ec00640 1 -- 172.21.15.57:0/3120797126 wait complete. 2024-03-27T09:59:56.589 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:56.600+0000 7fda6ec00640 1 Processor -- start 2024-03-27T09:59:56.589 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:56.600+0000 7fda6ec00640 1 -- start start 2024-03-27T09:59:56.591 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:56.601+0000 7fda6ec00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fda680ceee0 0x7fda68150550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:56.592 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:56.601+0000 7fda6ec00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fda680d3fe0 0x7fda680cb2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:56.592 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:56.601+0000 7fda6ec00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda6815e4a0 0x7fda680ccd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:56.592 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:56.601+0000 7fda6ec00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fda680b3000 con 0x7fda6815e4a0 2024-03-27T09:59:56.592 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:56.601+0000 7fda6ec00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fda680b2e80 con 0x7fda680ceee0 2024-03-27T09:59:56.592 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:56.601+0000 7fda6ec00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fda680b3180 con 0x7fda680d3fe0 2024-03-27T09:59:56.592 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:56.601+0000 7fda6cc00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda6815e4a0 0x7fda680ccd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:56.592 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:56.602+0000 7fda6cc00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda6815e4a0 0x7fda680ccd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:48628/0 (socket says 172.21.15.57:48628) 2024-03-27T09:59:56.592 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:56.602+0000 7fda6cc00640 1 -- 172.21.15.57:0/3976540855 learned_addr learned my addr 172.21.15.57:0/3976540855 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T09:59:56.592 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:56.602+0000 7fda67e00640 1 --2- 172.21.15.57:0/3976540855 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fda680ceee0 0x7fda68150550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:56.592 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:56.602+0000 7fda67400640 1 --2- 172.21.15.57:0/3976540855 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fda680d3fe0 0x7fda680cb2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:56.592 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:56.602+0000 7fda6cc00640 1 -- 172.21.15.57:0/3976540855 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fda680d3fe0 msgr2=0x7fda680cb2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:56.592 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:56.602+0000 7fda6cc00640 1 --2- 172.21.15.57:0/3976540855 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fda680d3fe0 0x7fda680cb2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:56.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:56.602+0000 7fda6cc00640 1 -- 172.21.15.57:0/3976540855 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fda680ceee0 msgr2=0x7fda68150550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:56.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:56.602+0000 7fda6cc00640 1 --2- 172.21.15.57:0/3976540855 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fda680ceee0 0x7fda68150550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:56.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:56.602+0000 7fda6cc00640 1 -- 172.21.15.57:0/3976540855 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda680cbc60 con 0x7fda6815e4a0 2024-03-27T09:59:56.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:56.602+0000 7fda67e00640 1 --2- 172.21.15.57:0/3976540855 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fda680ceee0 0x7fda68150550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T09:59:56.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:56.602+0000 7fda6cc00640 1 --2- 172.21.15.57:0/3976540855 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda6815e4a0 0x7fda680ccd80 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fda6000e7e0 tx=0x7fda6000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:56.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:56.603+0000 7fda5fe00640 1 -- 172.21.15.57:0/3976540855 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda6000f040 con 0x7fda6815e4a0 2024-03-27T09:59:56.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:56.603+0000 7fda5fe00640 1 -- 172.21.15.57:0/3976540855 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda60004030 con 0x7fda6815e4a0 2024-03-27T09:59:56.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:56.603+0000 7fda5fe00640 1 -- 172.21.15.57:0/3976540855 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda600043e0 con 0x7fda6815e4a0 2024-03-27T09:59:56.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:56.603+0000 7fda6ec00640 1 -- 172.21.15.57:0/3976540855 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda680cbf40 con 0x7fda6815e4a0 2024-03-27T09:59:56.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:56.603+0000 7fda6ec00640 1 -- 172.21.15.57:0/3976540855 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda680cc500 con 0x7fda6815e4a0 2024-03-27T09:59:56.594 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:56.604+0000 7fda6ec00640 1 -- 172.21.15.57:0/3976540855 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda68068620 con 0x7fda6815e4a0 2024-03-27T09:59:56.594 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:56.605+0000 7fda5fe00640 1 -- 172.21.15.57:0/3976540855 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fda6000c6d0 con 0x7fda6815e4a0 2024-03-27T09:59:56.595 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:56.606+0000 7fda5fe00640 1 --2- 172.21.15.57:0/3976540855 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fda4406c530 0x7fda4406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:56.595 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:56.606+0000 7fda5fe00640 1 -- 172.21.15.57:0/3976540855 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fda6008b7e0 con 0x7fda6815e4a0 2024-03-27T09:59:56.595 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:56.606+0000 7fda67e00640 1 --2- 172.21.15.57:0/3976540855 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fda4406c530 0x7fda4406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:56.596 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:56.607+0000 7fda67e00640 1 --2- 172.21.15.57:0/3976540855 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fda4406c530 0x7fda4406e9f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fda580012e0 tx=0x7fda58005b90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:56.599 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:56.610+0000 7fda5fe00640 1 -- 172.21.15.57:0/3976540855 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7fda60017020 con 0x7fda6815e4a0 2024-03-27T09:59:56.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:56.852+0000 7fda6ec00640 1 -- 172.21.15.57:0/3976540855 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fda6806c4a0 con 0x7fda6815e4a0 2024-03-27T09:59:56.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:56.853+0000 7fda5fe00640 1 -- 172.21.15.57:0/3976540855 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5183 (secure 0 0 0) 0x7fda60059a20 con 0x7fda6815e4a0 2024-03-27T09:59:56.843 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T09:59:56.843 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/1178943431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1178943431},{"type":"v1","addr":"172.21.15.118:6834","nonce":1178943431}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6836/1248533620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6835","nonce":1248533620},{"type":"v1","addr":"172.21.15.57:6836","nonce":1248533620}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6837/4133386889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":4133386889},{"type":"v1","addr":"172.21.15.57:6837","nonce":4133386889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-27T09:59:28.571425+0000","modified":"2024-03-27T09:59:55.863525+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6835/1823694233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":1823694233},{"type":"v1","addr":"172.21.15.118:6835","nonce":1823694233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4282,"qdb_cluster":[4282]},"id":1}]} 2024-03-27T09:59:56.844 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 9 2024-03-27T09:59:56.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:56.856+0000 7fda6ec00640 1 -- 172.21.15.57:0/3976540855 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fda4406c530 msgr2=0x7fda4406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:56.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:56.856+0000 7fda6ec00640 1 --2- 172.21.15.57:0/3976540855 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fda4406c530 0x7fda4406e9f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fda580012e0 tx=0x7fda58005b90 comp rx=0 tx=0).stop 2024-03-27T09:59:56.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:56.856+0000 7fda6ec00640 1 -- 172.21.15.57:0/3976540855 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda6815e4a0 msgr2=0x7fda680ccd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:56.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:56.856+0000 7fda6ec00640 1 --2- 172.21.15.57:0/3976540855 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda6815e4a0 0x7fda680ccd80 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fda6000e7e0 tx=0x7fda6000eca0 comp rx=0 tx=0).stop 2024-03-27T09:59:56.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:56.856+0000 7fda6ec00640 1 -- 172.21.15.57:0/3976540855 shutdown_connections 2024-03-27T09:59:56.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:56.856+0000 7fda6ec00640 1 --2- 172.21.15.57:0/3976540855 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fda6815e4a0 0x7fda680ccd80 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:56.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:56.856+0000 7fda6ec00640 1 --2- 172.21.15.57:0/3976540855 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fda680d3fe0 0x7fda680cb2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:56.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:56.856+0000 7fda6ec00640 1 --2- 172.21.15.57:0/3976540855 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fda4406c530 0x7fda4406e9f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:56.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:56.856+0000 7fda6ec00640 1 --2- 172.21.15.57:0/3976540855 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fda680ceee0 0x7fda68150550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:56.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:56.856+0000 7fda6ec00640 1 -- 172.21.15.57:0/3976540855 >> 172.21.15.57:0/3976540855 conn(0x7fda6808db50 msgr2=0x7fda6806d730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:56.848 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:56.856+0000 7fda6ec00640 1 -- 172.21.15.57:0/3976540855 shutdown_connections 2024-03-27T09:59:56.848 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:56.856+0000 7fda6ec00640 1 -- 172.21.15.57:0/3976540855 wait complete. 2024-03-27T09:59:56.865 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-27T09:59:57.085 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.096+0000 7f0312a00640 1 Processor -- start 2024-03-27T09:59:57.085 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.096+0000 7f0312a00640 1 -- start start 2024-03-27T09:59:57.087 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.098+0000 7f0312a00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f030c158530 0x7f030c0ad8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:57.087 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.098+0000 7f0312a00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f030c0adde0 0x7f030c071b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:57.087 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.098+0000 7f0312a00640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f030c06e210 con 0x7f030c0720d0 2024-03-27T09:59:57.087 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.098+0000 7f0312a00640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f030c06e4f0 con 0x7f030c0adde0 2024-03-27T09:59:57.087 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.098+0000 7f0312a00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f030c0710b0 con 0x7f030c158530 2024-03-27T09:59:57.087 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.098+0000 7f0312000640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f030c0720d0 0x7f030c06e970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:60848/0 (socket says 172.21.15.57:60848) 2024-03-27T09:59:57.087 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.098+0000 7f0312000640 1 -- 172.21.15.57:0/2275960480 learned_addr learned my addr 172.21.15.57:0/2275960480 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T09:59:57.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.098+0000 7f0310c00640 1 --2- 172.21.15.57:0/2275960480 >> v2:172.21.15.57:3300/0 conn(0x7f030c0adde0 0x7f030c071b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:57.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.098+0000 7f0311600640 1 --2- 172.21.15.57:0/2275960480 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f030c158530 0x7f030c0ad8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:57.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.099+0000 7f0310c00640 1 -- 172.21.15.57:0/2275960480 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f030c158530 msgr2=0x7f030c0ad8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T09:59:57.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.099+0000 7f0310c00640 1 --2- 172.21.15.57:0/2275960480 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f030c158530 0x7f030c0ad8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:57.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.099+0000 7f0310c00640 1 -- 172.21.15.57:0/2275960480 >> v1:172.21.15.57:6789/0 conn(0x7f030c0720d0 legacy=0x7f030c06e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:57.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.099+0000 7f0310c00640 1 -- 172.21.15.57:0/2275960480 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f030c071390 con 0x7f030c0adde0 2024-03-27T09:59:57.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.099+0000 7f030be00640 1 -- 172.21.15.57:0/2275960480 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2435703424 0 0) 0x7f030c06e210 con 0x7f030c0720d0 2024-03-27T09:59:57.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.099+0000 7f0311600640 1 --2- 172.21.15.57:0/2275960480 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f030c158530 0x7f030c0ad8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T09:59:57.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.100+0000 7f0310c00640 1 --2- 172.21.15.57:0/2275960480 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f030c0adde0 0x7f030c071b90 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f02f80097a0 tx=0x7f02f802b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c32c93563a6519b server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:57.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.100+0000 7f030be00640 1 -- 172.21.15.57:0/2275960480 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02f8035020 con 0x7f030c0adde0 2024-03-27T09:59:57.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.101+0000 7f030be00640 1 -- 172.21.15.57:0/2275960480 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02f8031810 con 0x7f030c0adde0 2024-03-27T09:59:57.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.101+0000 7f030be00640 1 -- 172.21.15.57:0/2275960480 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02f8031be0 con 0x7f030c0adde0 2024-03-27T09:59:57.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.101+0000 7f0312a00640 1 -- 172.21.15.57:0/2275960480 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f030c0adde0 msgr2=0x7f030c071b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:57.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.101+0000 7f0312a00640 1 --2- 172.21.15.57:0/2275960480 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f030c0adde0 0x7f030c071b90 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f02f80097a0 tx=0x7f02f802b8b0 comp rx=0 tx=0).stop 2024-03-27T09:59:57.091 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.101+0000 7f0312a00640 1 -- 172.21.15.57:0/2275960480 shutdown_connections 2024-03-27T09:59:57.091 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.101+0000 7f0312a00640 1 --2- 172.21.15.57:0/2275960480 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f030c0adde0 0x7f030c071b90 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:57.091 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.101+0000 7f0312a00640 1 --2- 172.21.15.57:0/2275960480 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f030c158530 0x7f030c0ad8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:57.091 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.101+0000 7f0312a00640 1 -- 172.21.15.57:0/2275960480 >> 172.21.15.57:0/2275960480 conn(0x7f030c0b1770 msgr2=0x7f030c0b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:57.091 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.101+0000 7f0312a00640 1 -- 172.21.15.57:0/2275960480 shutdown_connections 2024-03-27T09:59:57.091 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.101+0000 7f0312a00640 1 -- 172.21.15.57:0/2275960480 wait complete. 2024-03-27T09:59:57.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.103+0000 7f0312a00640 1 Processor -- start 2024-03-27T09:59:57.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.103+0000 7f0312a00640 1 -- start start 2024-03-27T09:59:57.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.104+0000 7f0312a00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f030c0720d0 0x7f030c140570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:57.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.104+0000 7f0312a00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f030c0adde0 0x7f030c14f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:57.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.104+0000 7f0312a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f030c158530 0x7f030c154e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:57.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.104+0000 7f0312a00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f030c158a90 con 0x7f030c0adde0 2024-03-27T09:59:57.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.104+0000 7f0312a00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f030c158910 con 0x7f030c158530 2024-03-27T09:59:57.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.104+0000 7f0312a00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f030c06f080 con 0x7f030c0720d0 2024-03-27T09:59:57.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.105+0000 7f0310c00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f030c0adde0 0x7f030c14f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:57.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.105+0000 7f0310c00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f030c0adde0 0x7f030c14f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:48652/0 (socket says 172.21.15.57:48652) 2024-03-27T09:59:57.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.105+0000 7f0310c00640 1 -- 172.21.15.57:0/461897894 learned_addr learned my addr 172.21.15.57:0/461897894 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T09:59:57.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.105+0000 7f0312000640 1 --2- 172.21.15.57:0/461897894 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f030c158530 0x7f030c154e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:57.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.105+0000 7f0311600640 1 --2- 172.21.15.57:0/461897894 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f030c0720d0 0x7f030c140570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:57.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.105+0000 7f0310c00640 1 -- 172.21.15.57:0/461897894 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f030c0720d0 msgr2=0x7f030c140570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:57.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.105+0000 7f0310c00640 1 --2- 172.21.15.57:0/461897894 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f030c0720d0 0x7f030c140570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:57.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.105+0000 7f0310c00640 1 -- 172.21.15.57:0/461897894 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f030c158530 msgr2=0x7f030c154e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:57.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.105+0000 7f0310c00640 1 --2- 172.21.15.57:0/461897894 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f030c158530 0x7f030c154e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:57.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.105+0000 7f0310c00640 1 -- 172.21.15.57:0/461897894 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f030c158d40 con 0x7f030c0adde0 2024-03-27T09:59:57.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.105+0000 7f0312000640 1 --2- 172.21.15.57:0/461897894 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f030c158530 0x7f030c154e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T09:59:57.097 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.106+0000 7f0310c00640 1 --2- 172.21.15.57:0/461897894 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f030c0adde0 0x7f030c14f300 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f02f802bec0 tx=0x7f02f80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:57.097 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.106+0000 7f0309600640 1 -- 172.21.15.57:0/461897894 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02f8041070 con 0x7f030c0adde0 2024-03-27T09:59:57.097 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.106+0000 7f0309600640 1 -- 172.21.15.57:0/461897894 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02f803ad00 con 0x7f030c0adde0 2024-03-27T09:59:57.097 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.106+0000 7f0309600640 1 -- 172.21.15.57:0/461897894 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02f8035040 con 0x7f030c0adde0 2024-03-27T09:59:57.097 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.106+0000 7f0312a00640 1 -- 172.21.15.57:0/461897894 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f030c159020 con 0x7f030c0adde0 2024-03-27T09:59:57.097 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.106+0000 7f0312a00640 1 -- 172.21.15.57:0/461897894 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f030c1595e0 con 0x7f030c0adde0 2024-03-27T09:59:57.097 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.107+0000 7f0312a00640 1 -- 172.21.15.57:0/461897894 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f030c068540 con 0x7f030c0adde0 2024-03-27T09:59:57.097 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.108+0000 7f0309600640 1 -- 172.21.15.57:0/461897894 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f02f8038020 con 0x7f030c0adde0 2024-03-27T09:59:57.099 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.110+0000 7f0309600640 1 --2- 172.21.15.57:0/461897894 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f02ec06c530 0x7f02ec06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:57.099 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.110+0000 7f0309600640 1 -- 172.21.15.57:0/461897894 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f02f80ad7a0 con 0x7f030c0adde0 2024-03-27T09:59:57.099 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.110+0000 7f0311600640 1 --2- 172.21.15.57:0/461897894 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f02ec06c530 0x7f02ec06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:57.099 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.111+0000 7f0311600640 1 --2- 172.21.15.57:0/461897894 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f02ec06c530 0x7f02ec06e9f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0300006fd0 tx=0x7f0300008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:57.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.115+0000 7f0309600640 1 -- 172.21.15.57:0/461897894 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f02f807b9e0 con 0x7f030c0adde0 2024-03-27T09:59:57.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.327+0000 7f0312a00640 1 -- 172.21.15.57:0/461897894 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f030c0adab0 con 0x7f030c0adde0 2024-03-27T09:59:57.319 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.330+0000 7f0309600640 1 -- 172.21.15.57:0/461897894 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18502 (secure 0 0 0) 0x7f02f807b2e0 con 0x7f030c0adde0 2024-03-27T09:59:57.319 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T09:59:57.320 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":26,"fsid":"7ac43f86-2c16-4a97-98fb-715d3cebc75c","created":"2024-03-27T09:59:04.033417+0000","modified":"2024-03-27T09:59:35.208743+0000","last_up_change":"2024-03-27T09:59:16.969624+0000","last_in_change":"2024-03-27T09:59:07.421690+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-27T09:59:17.253008+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-27T09:59:26.690365+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-27T09:59:27.559059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-27T09:59:31.187596+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"47b44362-7302-4f2a-b735-582c6c3850cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6801","nonce":2020036298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6803","nonce":2020036298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6807","nonce":2020036298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6805","nonce":2020036298}]},"public_addr":"172.21.15.57:6801/2020036298","cluster_addr":"172.21.15.57:6803/2020036298","heartbeat_back_addr":"172.21.15.57:6807/2020036298","heartbeat_front_addr":"172.21.15.57:6805/2020036298","state":["exists","up"]},{"osd":1,"uuid":"feaf96f0-9431-4188-9a09-da505b40e934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6809","nonce":3190929242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6811","nonce":3190929242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6815","nonce":3190929242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6813","nonce":3190929242}]},"public_addr":"172.21.15.57:6809/3190929242","cluster_addr":"172.21.15.57:6811/3190929242","heartbeat_back_addr":"172.21.15.57:6815/3190929242","heartbeat_front_addr":"172.21.15.57:6813/3190929242","state":["exists","up"]},{"osd":2,"uuid":"21e406e6-cfbc-4fe7-a816-e2420487c95d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6817","nonce":4065849973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6819","nonce":4065849973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6823","nonce":4065849973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6821","nonce":4065849973}]},"public_addr":"172.21.15.57:6817/4065849973","cluster_addr":"172.21.15.57:6819/4065849973","heartbeat_back_addr":"172.21.15.57:6823/4065849973","heartbeat_front_addr":"172.21.15.57:6821/4065849973","state":["exists","up"]},{"osd":3,"uuid":"a389af1d-76c4-4dfc-b215-f983f4931257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6825","nonce":158084809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6827","nonce":158084809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6831","nonce":158084809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6829","nonce":158084809}]},"public_addr":"172.21.15.57:6825/158084809","cluster_addr":"172.21.15.57:6827/158084809","heartbeat_back_addr":"172.21.15.57:6831/158084809","heartbeat_front_addr":"172.21.15.57:6829/158084809","state":["exists","up"]},{"osd":4,"uuid":"e9b05dca-557a-43ee-b43f-9ce5b7d28304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6823","nonce":108719401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6827","nonce":108719401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6831","nonce":108719401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6829","nonce":108719401}]},"public_addr":"172.21.15.118:6823/108719401","cluster_addr":"172.21.15.118:6827/108719401","heartbeat_back_addr":"172.21.15.118:6831/108719401","heartbeat_front_addr":"172.21.15.118:6829/108719401","state":["exists","up"]},{"osd":5,"uuid":"d968177d-44ff-499a-b00a-b147ed879253","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6817","nonce":2704605866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6819","nonce":2704605866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6826","nonce":2704605866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6822","nonce":2704605866}]},"public_addr":"172.21.15.118:6817/2704605866","cluster_addr":"172.21.15.118:6819/2704605866","heartbeat_back_addr":"172.21.15.118:6826/2704605866","heartbeat_front_addr":"172.21.15.118:6822/2704605866","state":["exists","up"]},{"osd":6,"uuid":"e8f98052-e6ad-4cfe-a4a9-0b17a434d54e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6801","nonce":1963659095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6803","nonce":1963659095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6807","nonce":1963659095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6805","nonce":1963659095}]},"public_addr":"172.21.15.118:6801/1963659095","cluster_addr":"172.21.15.118:6803/1963659095","heartbeat_back_addr":"172.21.15.118:6807/1963659095","heartbeat_front_addr":"172.21.15.118:6805/1963659095","state":["exists","up"]},{"osd":7,"uuid":"eccff987-8e51-4a63-845a-cf0a3196d7fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6809","nonce":1955879596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6811","nonce":1955879596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6815","nonce":1955879596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6813","nonce":1955879596}]},"public_addr":"172.21.15.118:6809/1955879596","cluster_addr":"172.21.15.118:6811/1955879596","heartbeat_back_addr":"172.21.15.118:6815/1955879596","heartbeat_front_addr":"172.21.15.118:6813/1955879596","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.721258+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.696610+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.777895+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.806769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.743259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.845687+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:13.020165+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.722294+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-27T09:59:57.323 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.333+0000 7f0312a00640 1 -- 172.21.15.57:0/461897894 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f02ec06c530 msgr2=0x7f02ec06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:57.323 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.333+0000 7f0312a00640 1 --2- 172.21.15.57:0/461897894 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f02ec06c530 0x7f02ec06e9f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0300006fd0 tx=0x7f0300008040 comp rx=0 tx=0).stop 2024-03-27T09:59:57.323 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.333+0000 7f0312a00640 1 -- 172.21.15.57:0/461897894 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f030c0adde0 msgr2=0x7f030c14f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:57.323 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.333+0000 7f0312a00640 1 --2- 172.21.15.57:0/461897894 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f030c0adde0 0x7f030c14f300 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f02f802bec0 tx=0x7f02f80046c0 comp rx=0 tx=0).stop 2024-03-27T09:59:57.323 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.333+0000 7f0312a00640 1 -- 172.21.15.57:0/461897894 shutdown_connections 2024-03-27T09:59:57.323 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.333+0000 7f0312a00640 1 --2- 172.21.15.57:0/461897894 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f02ec06c530 0x7f02ec06e9f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:57.323 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.333+0000 7f0312a00640 1 --2- 172.21.15.57:0/461897894 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f030c158530 0x7f030c154e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:57.323 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.333+0000 7f0312a00640 1 --2- 172.21.15.57:0/461897894 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f030c0adde0 0x7f030c14f300 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:57.323 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.333+0000 7f0312a00640 1 --2- 172.21.15.57:0/461897894 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f030c0720d0 0x7f030c140570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:57.323 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.333+0000 7f0312a00640 1 -- 172.21.15.57:0/461897894 >> 172.21.15.57:0/461897894 conn(0x7f030c0b1770 msgr2=0x7f030c0cfab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:57.323 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.334+0000 7f0312a00640 1 -- 172.21.15.57:0/461897894 shutdown_connections 2024-03-27T09:59:57.323 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.334+0000 7f0312a00640 1 -- 172.21.15.57:0/461897894 wait complete. 2024-03-27T09:59:57.343 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-03-27T09:59:57.344 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-27T09:59:57.567 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.579+0000 7fb7c4a00640 1 Processor -- start 2024-03-27T09:59:57.568 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.579+0000 7fb7c4a00640 1 -- start start 2024-03-27T09:59:57.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.580+0000 7fb7c4a00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb7c00d2860 0x7fb7c006fd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:57.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.580+0000 7fb7c4a00640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7c00cd4a0 con 0x7fb7c00cff40 2024-03-27T09:59:57.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.580+0000 7fb7c4a00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7c00cd780 con 0x7fb7c00cf910 2024-03-27T09:59:57.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.580+0000 7fb7c4a00640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7fb7c00cda60 con 0x7fb7c00d2860 2024-03-27T09:59:57.570 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.581+0000 7fb7bf400640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fb7c00cff40 0x7fb7c00d0320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:60860/0 (socket says 172.21.15.57:60860) 2024-03-27T09:59:57.570 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.581+0000 7fb7bf400640 1 -- 172.21.15.57:0/2513767655 learned_addr learned my addr 172.21.15.57:0/2513767655 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T09:59:57.570 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.581+0000 7fb7bfe00640 1 --2- 172.21.15.57:0/2513767655 >> v2:172.21.15.57:3300/0 conn(0x7fb7c00d2860 0x7fb7c006fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:57.570 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.581+0000 7fb7be000640 1 -- 172.21.15.57:0/2513767655 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1301585563 0 0) 0x7fb7c00cd4a0 con 0x7fb7c00cff40 2024-03-27T09:59:57.570 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.581+0000 7fb7bfe00640 1 -- 172.21.15.57:0/2513767655 >> v1:172.21.15.118:6789/0 conn(0x7fb7c00cf910 legacy=0x7fb7c006f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T09:59:57.571 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.581+0000 7fb7bfe00640 1 -- 172.21.15.57:0/2513767655 >> v1:172.21.15.57:6789/0 conn(0x7fb7c00cff40 legacy=0x7fb7c00d0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:57.571 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.581+0000 7fb7bfe00640 1 -- 172.21.15.57:0/2513767655 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7c00b0e30 con 0x7fb7c00d2860 2024-03-27T09:59:57.571 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.582+0000 7fb7bfe00640 1 --2- 172.21.15.57:0/2513767655 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7c00d2860 0x7fb7c006fd60 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb7b80097a0 tx=0x7fb7b802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=661a73018c80b3e9 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:57.571 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.583+0000 7fb7be000640 1 -- 172.21.15.57:0/2513767655 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7b80315a0 con 0x7fb7c00d2860 2024-03-27T09:59:57.572 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.583+0000 7fb7be000640 1 -- 172.21.15.57:0/2513767655 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7b8037070 con 0x7fb7c00d2860 2024-03-27T09:59:57.572 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.583+0000 7fb7be000640 1 -- 172.21.15.57:0/2513767655 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7b8031960 con 0x7fb7c00d2860 2024-03-27T09:59:57.572 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.583+0000 7fb7c4a00640 1 -- 172.21.15.57:0/2513767655 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7c00d2860 msgr2=0x7fb7c006fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:57.572 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.583+0000 7fb7c4a00640 1 --2- 172.21.15.57:0/2513767655 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7c00d2860 0x7fb7c006fd60 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb7b80097a0 tx=0x7fb7b802b840 comp rx=0 tx=0).stop 2024-03-27T09:59:57.573 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.583+0000 7fb7c4a00640 1 -- 172.21.15.57:0/2513767655 shutdown_connections 2024-03-27T09:59:57.573 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.583+0000 7fb7c4a00640 1 --2- 172.21.15.57:0/2513767655 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7c00d2860 0x7fb7c006fd60 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:57.573 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.583+0000 7fb7c4a00640 1 -- 172.21.15.57:0/2513767655 >> 172.21.15.57:0/2513767655 conn(0x7fb7c00d1d40 msgr2=0x7fb7c00d2150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:57.573 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.583+0000 7fb7c4a00640 1 -- 172.21.15.57:0/2513767655 shutdown_connections 2024-03-27T09:59:57.573 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.584+0000 7fb7c4a00640 1 -- 172.21.15.57:0/2513767655 wait complete. 2024-03-27T09:59:57.574 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.585+0000 7fb7c4a00640 1 Processor -- start 2024-03-27T09:59:57.574 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.585+0000 7fb7c4a00640 1 -- start start 2024-03-27T09:59:57.578 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.586+0000 7fb7c4a00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7c00cf910 0x7fb7c015b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:57.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.586+0000 7fb7c4a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb7c00cff40 0x7fb7c00ca930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:57.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.586+0000 7fb7c4a00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb7c00d2860 0x7fb7c00b2400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:57.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.586+0000 7fb7c4a00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fb7c00702a0 con 0x7fb7c00cf910 2024-03-27T09:59:57.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.586+0000 7fb7c4a00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fb7c015fa80 con 0x7fb7c00cff40 2024-03-27T09:59:57.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.586+0000 7fb7c4a00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fb7c0070420 con 0x7fb7c00d2860 2024-03-27T09:59:57.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.587+0000 7fb7bf400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7c00cf910 0x7fb7c015b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:57.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.587+0000 7fb7bf400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7c00cf910 0x7fb7c015b950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:48666/0 (socket says 172.21.15.57:48666) 2024-03-27T09:59:57.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.587+0000 7fb7bf400640 1 -- 172.21.15.57:0/3699565691 learned_addr learned my addr 172.21.15.57:0/3699565691 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T09:59:57.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.587+0000 7fb7bea00640 1 --2- 172.21.15.57:0/3699565691 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb7c00cff40 0x7fb7c00ca930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:57.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.587+0000 7fb7bf400640 1 -- 172.21.15.57:0/3699565691 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb7c00d2860 msgr2=0x7fb7c00b2400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:57.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.587+0000 7fb7bf400640 1 --2- 172.21.15.57:0/3699565691 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb7c00d2860 0x7fb7c00b2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:57.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.587+0000 7fb7bf400640 1 -- 172.21.15.57:0/3699565691 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb7c00cff40 msgr2=0x7fb7c00ca930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:57.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.587+0000 7fb7bf400640 1 --2- 172.21.15.57:0/3699565691 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb7c00cff40 0x7fb7c00ca930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:57.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.587+0000 7fb7bf400640 1 -- 172.21.15.57:0/3699565691 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7c00c9890 con 0x7fb7c00cf910 2024-03-27T09:59:57.580 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.588+0000 7fb7bf400640 1 --2- 172.21.15.57:0/3699565691 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7c00cf910 0x7fb7c015b950 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb7b000c4d0 tx=0x7fb7b000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:57.580 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.588+0000 7fb7b7400640 1 -- 172.21.15.57:0/3699565691 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7b0018070 con 0x7fb7c00cf910 2024-03-27T09:59:57.580 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.588+0000 7fb7b7400640 1 -- 172.21.15.57:0/3699565691 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7b00074e0 con 0x7fb7c00cf910 2024-03-27T09:59:57.580 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.588+0000 7fb7b7400640 1 -- 172.21.15.57:0/3699565691 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7b0004a20 con 0x7fb7c00cf910 2024-03-27T09:59:57.580 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.588+0000 7fb7c4a00640 1 -- 172.21.15.57:0/3699565691 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7c00c9b70 con 0x7fb7c00cf910 2024-03-27T09:59:57.580 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.588+0000 7fb7c4a00640 1 -- 172.21.15.57:0/3699565691 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7c00ca130 con 0x7fb7c00cf910 2024-03-27T09:59:57.580 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.589+0000 7fb7c4a00640 1 -- 172.21.15.57:0/3699565691 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7c00752e0 con 0x7fb7c00cf910 2024-03-27T09:59:57.581 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.590+0000 7fb7b7400640 1 -- 172.21.15.57:0/3699565691 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fb7b001b070 con 0x7fb7c00cf910 2024-03-27T09:59:57.581 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.591+0000 7fb7b7400640 1 --2- 172.21.15.57:0/3699565691 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fb79c06c560 0x7fb79c06ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:57.581 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.591+0000 7fb7b7400640 1 -- 172.21.15.57:0/3699565691 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fb7b008ac70 con 0x7fb7c00cf910 2024-03-27T09:59:57.581 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.591+0000 7fb7bea00640 1 --2- 172.21.15.57:0/3699565691 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fb79c06c560 0x7fb79c06ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:57.581 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.592+0000 7fb7bea00640 1 --2- 172.21.15.57:0/3699565691 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fb79c06c560 0x7fb79c06ea20 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb7a8007fd0 tx=0x7fb7a8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:57.584 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.595+0000 7fb7b7400640 1 -- 172.21.15.57:0/3699565691 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7fb7c00752e0 con 0x7fb7c00cf910 2024-03-27T09:59:57.793 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.803+0000 7fb7c4a00640 1 -- 172.21.15.57:0/3699565691 --> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb7c00b0b30 con 0x7fb79c06c560 2024-03-27T09:59:57.805 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.816+0000 7fb7b7400640 1 -- 172.21.15.57:0/3699565691 <== mgr.4103 v2:172.21.15.57:6832/485397065 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332562 (secure 0 0 0) 0x7fb7c00b0b30 con 0x7fb79c06c560 2024-03-27T09:59:57.809 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T09:59:57.812 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-03-27T09:59:57.814 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.824+0000 7fb7c4a00640 1 -- 172.21.15.57:0/3699565691 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fb79c06c560 msgr2=0x7fb79c06ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:57.814 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.824+0000 7fb7c4a00640 1 --2- 172.21.15.57:0/3699565691 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fb79c06c560 0x7fb79c06ea20 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb7a8007fd0 tx=0x7fb7a8009040 comp rx=0 tx=0).stop 2024-03-27T09:59:57.814 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.824+0000 7fb7c4a00640 1 -- 172.21.15.57:0/3699565691 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7c00cf910 msgr2=0x7fb7c015b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:57.814 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.824+0000 7fb7c4a00640 1 --2- 172.21.15.57:0/3699565691 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7c00cf910 0x7fb7c015b950 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb7b000c4d0 tx=0x7fb7b000c990 comp rx=0 tx=0).stop 2024-03-27T09:59:57.815 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.825+0000 7fb7c4a00640 1 -- 172.21.15.57:0/3699565691 shutdown_connections 2024-03-27T09:59:57.815 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.825+0000 7fb7c4a00640 1 --2- 172.21.15.57:0/3699565691 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb7c00d2860 0x7fb7c00b2400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:57.815 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.825+0000 7fb7c4a00640 1 --2- 172.21.15.57:0/3699565691 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fb79c06c560 0x7fb79c06ea20 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:57.815 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.825+0000 7fb7c4a00640 1 --2- 172.21.15.57:0/3699565691 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb7c00cff40 0x7fb7c00ca930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:57.815 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.825+0000 7fb7c4a00640 1 --2- 172.21.15.57:0/3699565691 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb7c00cf910 0x7fb7c015b950 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:57.815 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.825+0000 7fb7c4a00640 1 -- 172.21.15.57:0/3699565691 >> 172.21.15.57:0/3699565691 conn(0x7fb7c00d1d40 msgr2=0x7fb7c006f650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:57.815 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.825+0000 7fb7c4a00640 1 -- 172.21.15.57:0/3699565691 shutdown_connections 2024-03-27T09:59:57.815 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:57.825+0000 7fb7c4a00640 1 -- 172.21.15.57:0/3699565691 wait complete. 2024-03-27T09:59:57.837 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":40,"stamp":"2024-03-27T09:59:57.230698+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236172,"kb_used_data":3368,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738548,"statfs":{"total":773094113280,"available":772852273152,"internally_reserved":0,"allocated":3448832,"data_stored":2077568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1781,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006522"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.798582+0000","last_change":"2024-03-27T09:59:28.132620+0000","last_active":"2024-03-27T09:59:35.798582+0000","last_peered":"2024-03-27T09:59:35.798582+0000","last_clean":"2024-03-27T09:59:35.798582+0000","last_became_active":"2024-03-27T09:59:28.132360+0000","last_became_peered":"2024-03-27T09:59:28.132360+0000","last_unstale":"2024-03-27T09:59:35.798582+0000","last_undegraded":"2024-03-27T09:59:35.798582+0000","last_fullsized":"2024-03-27T09:59:35.798582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T20:35:52.312192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.600893+0000","last_change":"2024-03-27T09:59:29.147335+0000","last_active":"2024-03-27T09:59:35.600893+0000","last_peered":"2024-03-27T09:59:35.600893+0000","last_clean":"2024-03-27T09:59:35.600893+0000","last_became_active":"2024-03-27T09:59:29.147015+0000","last_became_peered":"2024-03-27T09:59:29.147015+0000","last_unstale":"2024-03-27T09:59:35.600893+0000","last_undegraded":"2024-03-27T09:59:35.600893+0000","last_fullsized":"2024-03-27T09:59:35.600893+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:12:08.142213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.599213+0000","last_change":"2024-03-27T09:59:33.703543+0000","last_active":"2024-03-27T09:59:35.599213+0000","last_peered":"2024-03-27T09:59:35.599213+0000","last_clean":"2024-03-27T09:59:35.599213+0000","last_became_active":"2024-03-27T09:59:33.702853+0000","last_became_peered":"2024-03-27T09:59:33.702853+0000","last_unstale":"2024-03-27T09:59:35.599213+0000","last_undegraded":"2024-03-27T09:59:35.599213+0000","last_fullsized":"2024-03-27T09:59:35.599213+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T20:31:50.071081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.601154+0000","last_change":"2024-03-27T09:59:28.119506+0000","last_active":"2024-03-27T09:59:35.601154+0000","last_peered":"2024-03-27T09:59:35.601154+0000","last_clean":"2024-03-27T09:59:35.601154+0000","last_became_active":"2024-03-27T09:59:28.119120+0000","last_became_peered":"2024-03-27T09:59:28.119120+0000","last_unstale":"2024-03-27T09:59:35.601154+0000","last_undegraded":"2024-03-27T09:59:35.601154+0000","last_fullsized":"2024-03-27T09:59:35.601154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:40:42.254670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.797783+0000","last_change":"2024-03-27T09:59:29.152285+0000","last_active":"2024-03-27T09:59:35.797783+0000","last_peered":"2024-03-27T09:59:35.797783+0000","last_clean":"2024-03-27T09:59:35.797783+0000","last_became_active":"2024-03-27T09:59:29.150250+0000","last_became_peered":"2024-03-27T09:59:29.150250+0000","last_unstale":"2024-03-27T09:59:35.797783+0000","last_undegraded":"2024-03-27T09:59:35.797783+0000","last_fullsized":"2024-03-27T09:59:35.797783+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:45:14.005415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.228593+0000","last_change":"2024-03-27T09:59:33.227161+0000","last_active":"2024-03-27T09:59:35.228593+0000","last_peered":"2024-03-27T09:59:35.228593+0000","last_clean":"2024-03-27T09:59:35.228593+0000","last_became_active":"2024-03-27T09:59:33.225987+0000","last_became_peered":"2024-03-27T09:59:33.225987+0000","last_unstale":"2024-03-27T09:59:35.228593+0000","last_undegraded":"2024-03-27T09:59:35.228593+0000","last_fullsized":"2024-03-27T09:59:35.228593+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T20:25:58.823076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.726381+0000","last_change":"2024-03-27T09:59:28.131417+0000","last_active":"2024-03-27T09:59:36.726381+0000","last_peered":"2024-03-27T09:59:36.726381+0000","last_clean":"2024-03-27T09:59:36.726381+0000","last_became_active":"2024-03-27T09:59:28.131134+0000","last_became_peered":"2024-03-27T09:59:28.131134+0000","last_unstale":"2024-03-27T09:59:36.726381+0000","last_undegraded":"2024-03-27T09:59:36.726381+0000","last_fullsized":"2024-03-27T09:59:36.726381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:55:33.304260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.230980+0000","last_change":"2024-03-27T09:59:29.159330+0000","last_active":"2024-03-27T09:59:35.230980+0000","last_peered":"2024-03-27T09:59:35.230980+0000","last_clean":"2024-03-27T09:59:35.230980+0000","last_became_active":"2024-03-27T09:59:29.159006+0000","last_became_peered":"2024-03-27T09:59:29.159006+0000","last_unstale":"2024-03-27T09:59:35.230980+0000","last_undegraded":"2024-03-27T09:59:35.230980+0000","last_fullsized":"2024-03-27T09:59:35.230980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:03:30.407810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.232767+0000","last_change":"2024-03-27T09:59:33.224598+0000","last_active":"2024-03-27T09:59:35.232767+0000","last_peered":"2024-03-27T09:59:35.232767+0000","last_clean":"2024-03-27T09:59:35.232767+0000","last_became_active":"2024-03-27T09:59:33.224114+0000","last_became_peered":"2024-03-27T09:59:33.224114+0000","last_unstale":"2024-03-27T09:59:35.232767+0000","last_undegraded":"2024-03-27T09:59:35.232767+0000","last_fullsized":"2024-03-27T09:59:35.232767+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:02:21.892888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.726198+0000","last_change":"2024-03-27T09:59:28.129485+0000","last_active":"2024-03-27T09:59:36.726198+0000","last_peered":"2024-03-27T09:59:36.726198+0000","last_clean":"2024-03-27T09:59:36.726198+0000","last_became_active":"2024-03-27T09:59:28.129171+0000","last_became_peered":"2024-03-27T09:59:28.129171+0000","last_unstale":"2024-03-27T09:59:36.726198+0000","last_undegraded":"2024-03-27T09:59:36.726198+0000","last_fullsized":"2024-03-27T09:59:36.726198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:31:20.500733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.231419+0000","last_change":"2024-03-27T09:59:29.161577+0000","last_active":"2024-03-27T09:59:35.231419+0000","last_peered":"2024-03-27T09:59:35.231419+0000","last_clean":"2024-03-27T09:59:35.231419+0000","last_became_active":"2024-03-27T09:59:29.161395+0000","last_became_peered":"2024-03-27T09:59:29.161395+0000","last_unstale":"2024-03-27T09:59:35.231419+0000","last_undegraded":"2024-03-27T09:59:35.231419+0000","last_fullsized":"2024-03-27T09:59:35.231419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T20:51:12.586643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.229598+0000","last_change":"2024-03-27T09:59:33.213426+0000","last_active":"2024-03-27T09:59:35.229598+0000","last_peered":"2024-03-27T09:59:35.229598+0000","last_clean":"2024-03-27T09:59:35.229598+0000","last_became_active":"2024-03-27T09:59:33.212985+0000","last_became_peered":"2024-03-27T09:59:33.212985+0000","last_unstale":"2024-03-27T09:59:35.229598+0000","last_undegraded":"2024-03-27T09:59:35.229598+0000","last_fullsized":"2024-03-27T09:59:35.229598+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:03:49.254833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.231790+0000","last_change":"2024-03-27T09:59:29.153065+0000","last_active":"2024-03-27T09:59:35.231790+0000","last_peered":"2024-03-27T09:59:35.231790+0000","last_clean":"2024-03-27T09:59:35.231790+0000","last_became_active":"2024-03-27T09:59:29.152709+0000","last_became_peered":"2024-03-27T09:59:29.152709+0000","last_unstale":"2024-03-27T09:59:35.231790+0000","last_undegraded":"2024-03-27T09:59:35.231790+0000","last_fullsized":"2024-03-27T09:59:35.231790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:57:26.770369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.726196+0000","last_change":"2024-03-27T09:59:28.132199+0000","last_active":"2024-03-27T09:59:36.726196+0000","last_peered":"2024-03-27T09:59:36.726196+0000","last_clean":"2024-03-27T09:59:36.726196+0000","last_became_active":"2024-03-27T09:59:28.131839+0000","last_became_peered":"2024-03-27T09:59:28.131839+0000","last_unstale":"2024-03-27T09:59:36.726196+0000","last_undegraded":"2024-03-27T09:59:36.726196+0000","last_fullsized":"2024-03-27T09:59:36.726196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:04:46.361989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.233050+0000","last_change":"2024-03-27T09:59:33.225488+0000","last_active":"2024-03-27T09:59:35.233050+0000","last_peered":"2024-03-27T09:59:35.233050+0000","last_clean":"2024-03-27T09:59:35.233050+0000","last_became_active":"2024-03-27T09:59:33.223781+0000","last_became_peered":"2024-03-27T09:59:33.223781+0000","last_unstale":"2024-03-27T09:59:35.233050+0000","last_undegraded":"2024-03-27T09:59:35.233050+0000","last_fullsized":"2024-03-27T09:59:35.233050+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:45:04.448005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.599916+0000","last_change":"2024-03-27T09:59:29.152084+0000","last_active":"2024-03-27T09:59:35.599916+0000","last_peered":"2024-03-27T09:59:35.599916+0000","last_clean":"2024-03-27T09:59:35.599916+0000","last_became_active":"2024-03-27T09:59:29.151816+0000","last_became_peered":"2024-03-27T09:59:29.151816+0000","last_unstale":"2024-03-27T09:59:35.599916+0000","last_undegraded":"2024-03-27T09:59:35.599916+0000","last_fullsized":"2024-03-27T09:59:35.599916+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:34:04.348561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.657754+0000","last_change":"2024-03-27T09:59:28.113836+0000","last_active":"2024-03-27T09:59:36.657754+0000","last_peered":"2024-03-27T09:59:36.657754+0000","last_clean":"2024-03-27T09:59:36.657754+0000","last_became_active":"2024-03-27T09:59:28.113517+0000","last_became_peered":"2024-03-27T09:59:28.113517+0000","last_unstale":"2024-03-27T09:59:36.657754+0000","last_undegraded":"2024-03-27T09:59:36.657754+0000","last_fullsized":"2024-03-27T09:59:36.657754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:40:42.254670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.233128+0000","last_change":"2024-03-27T09:59:33.219685+0000","last_active":"2024-03-27T09:59:35.233128+0000","last_peered":"2024-03-27T09:59:35.233128+0000","last_clean":"2024-03-27T09:59:35.233128+0000","last_became_active":"2024-03-27T09:59:33.219163+0000","last_became_peered":"2024-03-27T09:59:33.219163+0000","last_unstale":"2024-03-27T09:59:35.233128+0000","last_undegraded":"2024-03-27T09:59:35.233128+0000","last_fullsized":"2024-03-27T09:59:35.233128+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:21:56.509459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.599966+0000","last_change":"2024-03-27T09:59:29.162032+0000","last_active":"2024-03-27T09:59:35.599966+0000","last_peered":"2024-03-27T09:59:35.599966+0000","last_clean":"2024-03-27T09:59:35.599966+0000","last_became_active":"2024-03-27T09:59:29.154157+0000","last_became_peered":"2024-03-27T09:59:29.154157+0000","last_unstale":"2024-03-27T09:59:35.599966+0000","last_undegraded":"2024-03-27T09:59:35.599966+0000","last_fullsized":"2024-03-27T09:59:35.599966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:57:26.770369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.658673+0000","last_change":"2024-03-27T09:59:28.129073+0000","last_active":"2024-03-27T09:59:36.658673+0000","last_peered":"2024-03-27T09:59:36.658673+0000","last_clean":"2024-03-27T09:59:36.658673+0000","last_became_active":"2024-03-27T09:59:28.128568+0000","last_became_peered":"2024-03-27T09:59:28.128568+0000","last_unstale":"2024-03-27T09:59:36.658673+0000","last_undegraded":"2024-03-27T09:59:36.658673+0000","last_fullsized":"2024-03-27T09:59:36.658673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:13:29.201574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.660426+0000","last_change":"2024-03-27T09:59:33.708504+0000","last_active":"2024-03-27T09:59:36.660426+0000","last_peered":"2024-03-27T09:59:36.660426+0000","last_clean":"2024-03-27T09:59:36.660426+0000","last_became_active":"2024-03-27T09:59:33.703606+0000","last_became_peered":"2024-03-27T09:59:33.703606+0000","last_unstale":"2024-03-27T09:59:36.660426+0000","last_undegraded":"2024-03-27T09:59:36.660426+0000","last_fullsized":"2024-03-27T09:59:36.660426+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:06:12.744793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.230009+0000","last_change":"2024-03-27T09:59:29.136122+0000","last_active":"2024-03-27T09:59:35.230009+0000","last_peered":"2024-03-27T09:59:35.230009+0000","last_clean":"2024-03-27T09:59:35.230009+0000","last_became_active":"2024-03-27T09:59:29.134653+0000","last_became_peered":"2024-03-27T09:59:29.134653+0000","last_unstale":"2024-03-27T09:59:35.230009+0000","last_undegraded":"2024-03-27T09:59:35.230009+0000","last_fullsized":"2024-03-27T09:59:35.230009+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:23:47.064643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.726161+0000","last_change":"2024-03-27T09:59:28.130295+0000","last_active":"2024-03-27T09:59:36.726161+0000","last_peered":"2024-03-27T09:59:36.726161+0000","last_clean":"2024-03-27T09:59:36.726161+0000","last_became_active":"2024-03-27T09:59:28.129719+0000","last_became_peered":"2024-03-27T09:59:28.129719+0000","last_unstale":"2024-03-27T09:59:36.726161+0000","last_undegraded":"2024-03-27T09:59:36.726161+0000","last_fullsized":"2024-03-27T09:59:36.726161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:23:46.050666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.233646+0000","last_change":"2024-03-27T09:59:33.225859+0000","last_active":"2024-03-27T09:59:35.233646+0000","last_peered":"2024-03-27T09:59:35.233646+0000","last_clean":"2024-03-27T09:59:35.233646+0000","last_became_active":"2024-03-27T09:59:33.224011+0000","last_became_peered":"2024-03-27T09:59:33.224011+0000","last_unstale":"2024-03-27T09:59:35.233646+0000","last_undegraded":"2024-03-27T09:59:35.233646+0000","last_fullsized":"2024-03-27T09:59:35.233646+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:06:12.744793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.798261+0000","last_change":"2024-03-27T09:59:29.155479+0000","last_active":"2024-03-27T09:59:35.798261+0000","last_peered":"2024-03-27T09:59:35.798261+0000","last_clean":"2024-03-27T09:59:35.798261+0000","last_became_active":"2024-03-27T09:59:29.151680+0000","last_became_peered":"2024-03-27T09:59:29.151680+0000","last_unstale":"2024-03-27T09:59:35.798261+0000","last_undegraded":"2024-03-27T09:59:35.798261+0000","last_fullsized":"2024-03-27T09:59:35.798261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:57:26.770369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.232591+0000","last_change":"2024-03-27T09:59:28.128710+0000","last_active":"2024-03-27T09:59:35.232591+0000","last_peered":"2024-03-27T09:59:35.232591+0000","last_clean":"2024-03-27T09:59:35.232591+0000","last_became_active":"2024-03-27T09:59:28.128323+0000","last_became_peered":"2024-03-27T09:59:28.128323+0000","last_unstale":"2024-03-27T09:59:35.232591+0000","last_undegraded":"2024-03-27T09:59:35.232591+0000","last_fullsized":"2024-03-27T09:59:35.232591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:55:33.304260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.232711+0000","last_change":"2024-03-27T09:59:33.705209+0000","last_active":"2024-03-27T09:59:35.232711+0000","last_peered":"2024-03-27T09:59:35.232711+0000","last_clean":"2024-03-27T09:59:35.232711+0000","last_became_active":"2024-03-27T09:59:33.704637+0000","last_became_peered":"2024-03-27T09:59:33.704637+0000","last_unstale":"2024-03-27T09:59:35.232711+0000","last_undegraded":"2024-03-27T09:59:35.232711+0000","last_fullsized":"2024-03-27T09:59:35.232711+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:07:54.369342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.601058+0000","last_change":"2024-03-27T09:59:29.160579+0000","last_active":"2024-03-27T09:59:35.601058+0000","last_peered":"2024-03-27T09:59:35.601058+0000","last_clean":"2024-03-27T09:59:35.601058+0000","last_became_active":"2024-03-27T09:59:29.160256+0000","last_became_peered":"2024-03-27T09:59:29.160256+0000","last_unstale":"2024-03-27T09:59:35.601058+0000","last_undegraded":"2024-03-27T09:59:35.601058+0000","last_fullsized":"2024-03-27T09:59:35.601058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:00:09.092063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.657792+0000","last_change":"2024-03-27T09:59:28.113830+0000","last_active":"2024-03-27T09:59:36.657792+0000","last_peered":"2024-03-27T09:59:36.657792+0000","last_clean":"2024-03-27T09:59:36.657792+0000","last_became_active":"2024-03-27T09:59:28.112951+0000","last_became_peered":"2024-03-27T09:59:28.112951+0000","last_unstale":"2024-03-27T09:59:36.657792+0000","last_undegraded":"2024-03-27T09:59:36.657792+0000","last_fullsized":"2024-03-27T09:59:36.657792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:31:20.500733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.598982+0000","last_change":"2024-03-27T09:59:33.698681+0000","last_active":"2024-03-27T09:59:35.598982+0000","last_peered":"2024-03-27T09:59:35.598982+0000","last_clean":"2024-03-27T09:59:35.598982+0000","last_became_active":"2024-03-27T09:59:33.697706+0000","last_became_peered":"2024-03-27T09:59:33.697706+0000","last_unstale":"2024-03-27T09:59:35.598982+0000","last_undegraded":"2024-03-27T09:59:35.598982+0000","last_fullsized":"2024-03-27T09:59:35.598982+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:40:22.426786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.660127+0000","last_change":"2024-03-27T09:59:29.150475+0000","last_active":"2024-03-27T09:59:36.660127+0000","last_peered":"2024-03-27T09:59:36.660127+0000","last_clean":"2024-03-27T09:59:36.660127+0000","last_became_active":"2024-03-27T09:59:29.150150+0000","last_became_peered":"2024-03-27T09:59:29.150150+0000","last_unstale":"2024-03-27T09:59:36.660127+0000","last_undegraded":"2024-03-27T09:59:36.660127+0000","last_fullsized":"2024-03-27T09:59:36.660127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T21:36:52.561523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.726237+0000","last_change":"2024-03-27T09:59:28.131581+0000","last_active":"2024-03-27T09:59:36.726237+0000","last_peered":"2024-03-27T09:59:36.726237+0000","last_clean":"2024-03-27T09:59:36.726237+0000","last_became_active":"2024-03-27T09:59:28.131279+0000","last_became_peered":"2024-03-27T09:59:28.131279+0000","last_unstale":"2024-03-27T09:59:36.726237+0000","last_undegraded":"2024-03-27T09:59:36.726237+0000","last_fullsized":"2024-03-27T09:59:36.726237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T12:53:30.888359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.797439+0000","last_change":"2024-03-27T09:59:33.702376+0000","last_active":"2024-03-27T09:59:35.797439+0000","last_peered":"2024-03-27T09:59:35.797439+0000","last_clean":"2024-03-27T09:59:35.797439+0000","last_became_active":"2024-03-27T09:59:33.698666+0000","last_became_peered":"2024-03-27T09:59:33.698666+0000","last_unstale":"2024-03-27T09:59:35.797439+0000","last_undegraded":"2024-03-27T09:59:35.797439+0000","last_fullsized":"2024-03-27T09:59:35.797439+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:26:40.882057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.231562+0000","last_change":"2024-03-27T09:59:29.156291+0000","last_active":"2024-03-27T09:59:35.231562+0000","last_peered":"2024-03-27T09:59:35.231562+0000","last_clean":"2024-03-27T09:59:35.231562+0000","last_became_active":"2024-03-27T09:59:29.156028+0000","last_became_peered":"2024-03-27T09:59:29.156028+0000","last_unstale":"2024-03-27T09:59:35.231562+0000","last_undegraded":"2024-03-27T09:59:35.231562+0000","last_fullsized":"2024-03-27T09:59:35.231562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:03:45.164612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.657738+0000","last_change":"2024-03-27T09:59:28.115841+0000","last_active":"2024-03-27T09:59:36.657738+0000","last_peered":"2024-03-27T09:59:36.657738+0000","last_clean":"2024-03-27T09:59:36.657738+0000","last_became_active":"2024-03-27T09:59:28.115592+0000","last_became_peered":"2024-03-27T09:59:28.115592+0000","last_unstale":"2024-03-27T09:59:36.657738+0000","last_undegraded":"2024-03-27T09:59:36.657738+0000","last_fullsized":"2024-03-27T09:59:36.657738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:23:46.050666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.658425+0000","last_change":"2024-03-27T09:59:33.224089+0000","last_active":"2024-03-27T09:59:36.658425+0000","last_peered":"2024-03-27T09:59:36.658425+0000","last_clean":"2024-03-27T09:59:36.658425+0000","last_became_active":"2024-03-27T09:59:33.223558+0000","last_became_peered":"2024-03-27T09:59:33.223558+0000","last_unstale":"2024-03-27T09:59:36.658425+0000","last_undegraded":"2024-03-27T09:59:36.658425+0000","last_fullsized":"2024-03-27T09:59:36.658425+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:45:04.448005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.233512+0000","last_change":"2024-03-27T09:59:29.161017+0000","last_active":"2024-03-27T09:59:35.233512+0000","last_peered":"2024-03-27T09:59:35.233512+0000","last_clean":"2024-03-27T09:59:35.233512+0000","last_became_active":"2024-03-27T09:59:29.160567+0000","last_became_peered":"2024-03-27T09:59:29.160567+0000","last_unstale":"2024-03-27T09:59:35.233512+0000","last_undegraded":"2024-03-27T09:59:35.233512+0000","last_fullsized":"2024-03-27T09:59:35.233512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:55:34.318236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.231117+0000","last_change":"2024-03-27T09:59:28.124425+0000","last_active":"2024-03-27T09:59:35.231117+0000","last_peered":"2024-03-27T09:59:35.231117+0000","last_clean":"2024-03-27T09:59:35.231117+0000","last_became_active":"2024-03-27T09:59:28.123984+0000","last_became_peered":"2024-03-27T09:59:28.123984+0000","last_unstale":"2024-03-27T09:59:35.231117+0000","last_undegraded":"2024-03-27T09:59:35.231117+0000","last_fullsized":"2024-03-27T09:59:35.231117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:23:46.050666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.660006+0000","last_change":"2024-03-27T09:59:33.226956+0000","last_active":"2024-03-27T09:59:36.660006+0000","last_peered":"2024-03-27T09:59:36.660006+0000","last_clean":"2024-03-27T09:59:36.660006+0000","last_became_active":"2024-03-27T09:59:33.223863+0000","last_became_peered":"2024-03-27T09:59:33.223863+0000","last_unstale":"2024-03-27T09:59:36.660006+0000","last_undegraded":"2024-03-27T09:59:36.660006+0000","last_fullsized":"2024-03-27T09:59:36.660006+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:26:40.882057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.658826+0000","last_change":"2024-03-27T09:59:29.155035+0000","last_active":"2024-03-27T09:59:36.658826+0000","last_peered":"2024-03-27T09:59:36.658826+0000","last_clean":"2024-03-27T09:59:36.658826+0000","last_became_active":"2024-03-27T09:59:29.154671+0000","last_became_peered":"2024-03-27T09:59:29.154671+0000","last_unstale":"2024-03-27T09:59:36.658826+0000","last_undegraded":"2024-03-27T09:59:36.658826+0000","last_fullsized":"2024-03-27T09:59:36.658826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:45:14.005415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.791187+0000","last_change":"2024-03-27T09:59:28.121148+0000","last_active":"2024-03-27T09:59:36.791187+0000","last_peered":"2024-03-27T09:59:36.791187+0000","last_clean":"2024-03-27T09:59:36.791187+0000","last_became_active":"2024-03-27T09:59:28.120840+0000","last_became_peered":"2024-03-27T09:59:28.120840+0000","last_unstale":"2024-03-27T09:59:36.791187+0000","last_undegraded":"2024-03-27T09:59:36.791187+0000","last_fullsized":"2024-03-27T09:59:36.791187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:40:42.254670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.660494+0000","last_change":"2024-03-27T09:59:33.229618+0000","last_active":"2024-03-27T09:59:36.660494+0000","last_peered":"2024-03-27T09:59:36.660494+0000","last_clean":"2024-03-27T09:59:36.660494+0000","last_became_active":"2024-03-27T09:59:33.228741+0000","last_became_peered":"2024-03-27T09:59:33.228741+0000","last_unstale":"2024-03-27T09:59:36.660494+0000","last_undegraded":"2024-03-27T09:59:36.660494+0000","last_fullsized":"2024-03-27T09:59:36.660494+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T21:18:02.752241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.797279+0000","last_change":"2024-03-27T09:59:29.156381+0000","last_active":"2024-03-27T09:59:35.797279+0000","last_peered":"2024-03-27T09:59:35.797279+0000","last_clean":"2024-03-27T09:59:35.797279+0000","last_became_active":"2024-03-27T09:59:29.156084+0000","last_became_peered":"2024-03-27T09:59:29.156084+0000","last_unstale":"2024-03-27T09:59:35.797279+0000","last_undegraded":"2024-03-27T09:59:35.797279+0000","last_fullsized":"2024-03-27T09:59:35.797279+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:31:01.574841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.727058+0000","last_change":"2024-03-27T09:59:28.130798+0000","last_active":"2024-03-27T09:59:36.727058+0000","last_peered":"2024-03-27T09:59:36.727058+0000","last_clean":"2024-03-27T09:59:36.727058+0000","last_became_active":"2024-03-27T09:59:28.130023+0000","last_became_peered":"2024-03-27T09:59:28.130023+0000","last_unstale":"2024-03-27T09:59:36.727058+0000","last_undegraded":"2024-03-27T09:59:36.727058+0000","last_fullsized":"2024-03-27T09:59:36.727058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:20:35.358265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.798067+0000","last_change":"2024-03-27T09:59:33.708547+0000","last_active":"2024-03-27T09:59:35.798067+0000","last_peered":"2024-03-27T09:59:35.798067+0000","last_clean":"2024-03-27T09:59:35.798067+0000","last_became_active":"2024-03-27T09:59:33.707071+0000","last_became_peered":"2024-03-27T09:59:33.707071+0000","last_unstale":"2024-03-27T09:59:35.798067+0000","last_undegraded":"2024-03-27T09:59:35.798067+0000","last_fullsized":"2024-03-27T09:59:35.798067+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:58:34.321312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.599551+0000","last_change":"2024-03-27T09:59:29.149027+0000","last_active":"2024-03-27T09:59:35.599551+0000","last_peered":"2024-03-27T09:59:35.599551+0000","last_clean":"2024-03-27T09:59:35.599551+0000","last_became_active":"2024-03-27T09:59:29.148746+0000","last_became_peered":"2024-03-27T09:59:29.148746+0000","last_unstale":"2024-03-27T09:59:35.599551+0000","last_undegraded":"2024-03-27T09:59:35.599551+0000","last_fullsized":"2024-03-27T09:59:35.599551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:20:50.555376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.232120+0000","last_change":"2024-03-27T09:59:28.126435+0000","last_active":"2024-03-27T09:59:35.232120+0000","last_peered":"2024-03-27T09:59:35.232120+0000","last_clean":"2024-03-27T09:59:35.232120+0000","last_became_active":"2024-03-27T09:59:28.126154+0000","last_became_peered":"2024-03-27T09:59:28.126154+0000","last_unstale":"2024-03-27T09:59:35.232120+0000","last_undegraded":"2024-03-27T09:59:35.232120+0000","last_fullsized":"2024-03-27T09:59:35.232120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:20:35.358265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":180,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.727156+0000","last_change":"2024-03-27T09:59:19.234906+0000","last_active":"2024-03-27T09:59:36.727156+0000","last_peered":"2024-03-27T09:59:36.727156+0000","last_clean":"2024-03-27T09:59:36.727156+0000","last_became_active":"2024-03-27T09:59:19.234124+0000","last_became_peered":"2024-03-27T09:59:19.234124+0000","last_unstale":"2024-03-27T09:59:36.727156+0000","last_undegraded":"2024-03-27T09:59:36.727156+0000","last_fullsized":"2024-03-27T09:59:36.727156+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:17.974760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:17.974760+0000","last_clean_scrub_stamp":"2024-03-27T09:59:17.974760+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:24:35.357325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.230468+0000","last_change":"2024-03-27T09:59:33.707287+0000","last_active":"2024-03-27T09:59:35.230468+0000","last_peered":"2024-03-27T09:59:35.230468+0000","last_clean":"2024-03-27T09:59:35.230468+0000","last_became_active":"2024-03-27T09:59:33.706791+0000","last_became_peered":"2024-03-27T09:59:33.706791+0000","last_unstale":"2024-03-27T09:59:35.230468+0000","last_undegraded":"2024-03-27T09:59:35.230468+0000","last_fullsized":"2024-03-27T09:59:35.230468+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:03:49.254833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.728483+0000","last_change":"2024-03-27T09:59:29.150091+0000","last_active":"2024-03-27T09:59:36.728483+0000","last_peered":"2024-03-27T09:59:36.728483+0000","last_clean":"2024-03-27T09:59:36.728483+0000","last_became_active":"2024-03-27T09:59:29.149700+0000","last_became_peered":"2024-03-27T09:59:29.149700+0000","last_unstale":"2024-03-27T09:59:36.728483+0000","last_undegraded":"2024-03-27T09:59:36.728483+0000","last_fullsized":"2024-03-27T09:59:36.728483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:25:26.474648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.791238+0000","last_change":"2024-03-27T09:59:28.126811+0000","last_active":"2024-03-27T09:59:36.791238+0000","last_peered":"2024-03-27T09:59:36.791238+0000","last_clean":"2024-03-27T09:59:36.791238+0000","last_became_active":"2024-03-27T09:59:28.126359+0000","last_became_peered":"2024-03-27T09:59:28.126359+0000","last_unstale":"2024-03-27T09:59:36.791238+0000","last_undegraded":"2024-03-27T09:59:36.791238+0000","last_fullsized":"2024-03-27T09:59:36.791238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:35:50.131290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.231647+0000","last_change":"2024-03-27T09:59:33.699402+0000","last_active":"2024-03-27T09:59:35.231647+0000","last_peered":"2024-03-27T09:59:35.231647+0000","last_clean":"2024-03-27T09:59:35.231647+0000","last_became_active":"2024-03-27T09:59:33.697898+0000","last_became_peered":"2024-03-27T09:59:33.697898+0000","last_unstale":"2024-03-27T09:59:35.231647+0000","last_undegraded":"2024-03-27T09:59:35.231647+0000","last_fullsized":"2024-03-27T09:59:35.231647+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:07:54.369342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.231265+0000","last_change":"2024-03-27T09:59:29.148952+0000","last_active":"2024-03-27T09:59:35.231265+0000","last_peered":"2024-03-27T09:59:35.231265+0000","last_clean":"2024-03-27T09:59:35.231265+0000","last_became_active":"2024-03-27T09:59:29.148176+0000","last_became_peered":"2024-03-27T09:59:29.148176+0000","last_unstale":"2024-03-27T09:59:35.231265+0000","last_undegraded":"2024-03-27T09:59:35.231265+0000","last_fullsized":"2024-03-27T09:59:35.231265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T20:25:54.732855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.657787+0000","last_change":"2024-03-27T09:59:28.126237+0000","last_active":"2024-03-27T09:59:36.657787+0000","last_peered":"2024-03-27T09:59:36.657787+0000","last_clean":"2024-03-27T09:59:36.657787+0000","last_became_active":"2024-03-27T09:59:28.125955+0000","last_became_peered":"2024-03-27T09:59:28.125955+0000","last_unstale":"2024-03-27T09:59:36.657787+0000","last_undegraded":"2024-03-27T09:59:36.657787+0000","last_fullsized":"2024-03-27T09:59:36.657787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:55:33.304260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.797749+0000","last_change":"2024-03-27T09:59:33.223667+0000","last_active":"2024-03-27T09:59:35.797749+0000","last_peered":"2024-03-27T09:59:35.797749+0000","last_clean":"2024-03-27T09:59:35.797749+0000","last_became_active":"2024-03-27T09:59:33.223275+0000","last_became_peered":"2024-03-27T09:59:33.223275+0000","last_unstale":"2024-03-27T09:59:35.797749+0000","last_undegraded":"2024-03-27T09:59:35.797749+0000","last_fullsized":"2024-03-27T09:59:35.797749+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T21:18:02.752241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.729264+0000","last_change":"2024-03-27T09:59:29.159775+0000","last_active":"2024-03-27T09:59:36.729264+0000","last_peered":"2024-03-27T09:59:36.729264+0000","last_clean":"2024-03-27T09:59:36.729264+0000","last_became_active":"2024-03-27T09:59:29.159484+0000","last_became_peered":"2024-03-27T09:59:29.159484+0000","last_unstale":"2024-03-27T09:59:36.729264+0000","last_undegraded":"2024-03-27T09:59:36.729264+0000","last_fullsized":"2024-03-27T09:59:36.729264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:03:45.164612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.791343+0000","last_change":"2024-03-27T09:59:28.121073+0000","last_active":"2024-03-27T09:59:36.791343+0000","last_peered":"2024-03-27T09:59:36.791343+0000","last_clean":"2024-03-27T09:59:36.791343+0000","last_became_active":"2024-03-27T09:59:28.120712+0000","last_became_peered":"2024-03-27T09:59:28.120712+0000","last_unstale":"2024-03-27T09:59:36.791343+0000","last_undegraded":"2024-03-27T09:59:36.791343+0000","last_fullsized":"2024-03-27T09:59:36.791343+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:13:29.201574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.230245+0000","last_change":"2024-03-27T09:59:33.707551+0000","last_active":"2024-03-27T09:59:35.230245+0000","last_peered":"2024-03-27T09:59:35.230245+0000","last_clean":"2024-03-27T09:59:35.230245+0000","last_became_active":"2024-03-27T09:59:33.702666+0000","last_became_peered":"2024-03-27T09:59:33.702666+0000","last_unstale":"2024-03-27T09:59:35.230245+0000","last_undegraded":"2024-03-27T09:59:35.230245+0000","last_fullsized":"2024-03-27T09:59:35.230245+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T21:18:02.752241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.728829+0000","last_change":"2024-03-27T09:59:29.165375+0000","last_active":"2024-03-27T09:59:36.728829+0000","last_peered":"2024-03-27T09:59:36.728829+0000","last_clean":"2024-03-27T09:59:36.728829+0000","last_became_active":"2024-03-27T09:59:29.164965+0000","last_became_peered":"2024-03-27T09:59:29.164965+0000","last_unstale":"2024-03-27T09:59:36.728829+0000","last_undegraded":"2024-03-27T09:59:36.728829+0000","last_fullsized":"2024-03-27T09:59:36.728829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:07:50.279121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.233583+0000","last_change":"2024-03-27T09:59:28.126548+0000","last_active":"2024-03-27T09:59:35.233583+0000","last_peered":"2024-03-27T09:59:35.233583+0000","last_clean":"2024-03-27T09:59:35.233583+0000","last_became_active":"2024-03-27T09:59:28.125963+0000","last_became_peered":"2024-03-27T09:59:28.125963+0000","last_unstale":"2024-03-27T09:59:35.233583+0000","last_undegraded":"2024-03-27T09:59:35.233583+0000","last_fullsized":"2024-03-27T09:59:35.233583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:59:55.319685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.228379+0000","last_change":"2024-03-27T09:59:33.220384+0000","last_active":"2024-03-27T09:59:35.228379+0000","last_peered":"2024-03-27T09:59:35.228379+0000","last_clean":"2024-03-27T09:59:35.228379+0000","last_became_active":"2024-03-27T09:59:33.219238+0000","last_became_peered":"2024-03-27T09:59:33.219238+0000","last_unstale":"2024-03-27T09:59:35.228379+0000","last_undegraded":"2024-03-27T09:59:35.228379+0000","last_fullsized":"2024-03-27T09:59:35.228379+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:03:34.498032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.727816+0000","last_change":"2024-03-27T09:59:29.159404+0000","last_active":"2024-03-27T09:59:36.727816+0000","last_peered":"2024-03-27T09:59:36.727816+0000","last_clean":"2024-03-27T09:59:36.727816+0000","last_became_active":"2024-03-27T09:59:29.159116+0000","last_became_peered":"2024-03-27T09:59:29.159116+0000","last_unstale":"2024-03-27T09:59:36.727816+0000","last_undegraded":"2024-03-27T09:59:36.727816+0000","last_fullsized":"2024-03-27T09:59:36.727816+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T20:51:12.586643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.791612+0000","last_change":"2024-03-27T09:59:28.130732+0000","last_active":"2024-03-27T09:59:36.791612+0000","last_peered":"2024-03-27T09:59:36.791612+0000","last_clean":"2024-03-27T09:59:36.791612+0000","last_became_active":"2024-03-27T09:59:28.128808+0000","last_became_peered":"2024-03-27T09:59:28.128808+0000","last_unstale":"2024-03-27T09:59:36.791612+0000","last_undegraded":"2024-03-27T09:59:36.791612+0000","last_fullsized":"2024-03-27T09:59:36.791612+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:23:46.050666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.798116+0000","last_change":"2024-03-27T09:59:33.208864+0000","last_active":"2024-03-27T09:59:35.798116+0000","last_peered":"2024-03-27T09:59:35.798116+0000","last_clean":"2024-03-27T09:59:35.798116+0000","last_became_active":"2024-03-27T09:59:33.208354+0000","last_became_peered":"2024-03-27T09:59:33.208354+0000","last_unstale":"2024-03-27T09:59:35.798116+0000","last_undegraded":"2024-03-27T09:59:35.798116+0000","last_fullsized":"2024-03-27T09:59:35.798116+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T20:00:16.571694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.229822+0000","last_change":"2024-03-27T09:59:29.158524+0000","last_active":"2024-03-27T09:59:35.229822+0000","last_peered":"2024-03-27T09:59:35.229822+0000","last_clean":"2024-03-27T09:59:35.229822+0000","last_became_active":"2024-03-27T09:59:29.157925+0000","last_became_peered":"2024-03-27T09:59:29.157925+0000","last_unstale":"2024-03-27T09:59:35.229822+0000","last_undegraded":"2024-03-27T09:59:35.229822+0000","last_fullsized":"2024-03-27T09:59:35.229822+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:53:03.077046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.231047+0000","last_change":"2024-03-27T09:59:28.115802+0000","last_active":"2024-03-27T09:59:35.231047+0000","last_peered":"2024-03-27T09:59:35.231047+0000","last_clean":"2024-03-27T09:59:35.231047+0000","last_became_active":"2024-03-27T09:59:28.115435+0000","last_became_peered":"2024-03-27T09:59:28.115435+0000","last_unstale":"2024-03-27T09:59:35.231047+0000","last_undegraded":"2024-03-27T09:59:35.231047+0000","last_fullsized":"2024-03-27T09:59:35.231047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:40:42.254670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.600958+0000","last_change":"2024-03-27T09:59:33.706037+0000","last_active":"2024-03-27T09:59:35.600958+0000","last_peered":"2024-03-27T09:59:35.600958+0000","last_clean":"2024-03-27T09:59:35.600958+0000","last_became_active":"2024-03-27T09:59:33.705650+0000","last_became_peered":"2024-03-27T09:59:33.705650+0000","last_unstale":"2024-03-27T09:59:35.600958+0000","last_undegraded":"2024-03-27T09:59:35.600958+0000","last_fullsized":"2024-03-27T09:59:35.600958+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:02:05.101162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.728065+0000","last_change":"2024-03-27T09:59:29.160438+0000","last_active":"2024-03-27T09:59:36.728065+0000","last_peered":"2024-03-27T09:59:36.728065+0000","last_clean":"2024-03-27T09:59:36.728065+0000","last_became_active":"2024-03-27T09:59:29.160087+0000","last_became_peered":"2024-03-27T09:59:29.160087+0000","last_unstale":"2024-03-27T09:59:36.728065+0000","last_undegraded":"2024-03-27T09:59:36.728065+0000","last_fullsized":"2024-03-27T09:59:36.728065+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:00:09.092063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.231089+0000","last_change":"2024-03-27T09:59:28.118112+0000","last_active":"2024-03-27T09:59:35.231089+0000","last_peered":"2024-03-27T09:59:35.231089+0000","last_clean":"2024-03-27T09:59:35.231089+0000","last_became_active":"2024-03-27T09:59:28.117828+0000","last_became_peered":"2024-03-27T09:59:28.117828+0000","last_unstale":"2024-03-27T09:59:35.231089+0000","last_undegraded":"2024-03-27T09:59:35.231089+0000","last_fullsized":"2024-03-27T09:59:35.231089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:13:29.201574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.599830+0000","last_change":"2024-03-27T09:59:33.700858+0000","last_active":"2024-03-27T09:59:35.599830+0000","last_peered":"2024-03-27T09:59:35.599830+0000","last_clean":"2024-03-27T09:59:35.599830+0000","last_became_active":"2024-03-27T09:59:33.700373+0000","last_became_peered":"2024-03-27T09:59:33.700373+0000","last_unstale":"2024-03-27T09:59:35.599830+0000","last_undegraded":"2024-03-27T09:59:35.599830+0000","last_fullsized":"2024-03-27T09:59:35.599830+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:25:25.072673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.798196+0000","last_change":"2024-03-27T09:59:29.169989+0000","last_active":"2024-03-27T09:59:35.798196+0000","last_peered":"2024-03-27T09:59:35.798196+0000","last_clean":"2024-03-27T09:59:35.798196+0000","last_became_active":"2024-03-27T09:59:29.169681+0000","last_became_peered":"2024-03-27T09:59:29.169681+0000","last_unstale":"2024-03-27T09:59:35.798196+0000","last_undegraded":"2024-03-27T09:59:35.798196+0000","last_fullsized":"2024-03-27T09:59:35.798196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:16:28.449509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.798374+0000","last_change":"2024-03-27T09:59:28.129054+0000","last_active":"2024-03-27T09:59:35.798374+0000","last_peered":"2024-03-27T09:59:35.798374+0000","last_clean":"2024-03-27T09:59:35.798374+0000","last_became_active":"2024-03-27T09:59:28.128808+0000","last_became_peered":"2024-03-27T09:59:28.128808+0000","last_unstale":"2024-03-27T09:59:35.798374+0000","last_undegraded":"2024-03-27T09:59:35.798374+0000","last_fullsized":"2024-03-27T09:59:35.798374+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:03:46.932809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.232702+0000","last_change":"2024-03-27T09:59:33.703875+0000","last_active":"2024-03-27T09:59:35.232702+0000","last_peered":"2024-03-27T09:59:35.232702+0000","last_clean":"2024-03-27T09:59:35.232702+0000","last_became_active":"2024-03-27T09:59:33.702585+0000","last_became_peered":"2024-03-27T09:59:33.702585+0000","last_unstale":"2024-03-27T09:59:35.232702+0000","last_undegraded":"2024-03-27T09:59:35.232702+0000","last_fullsized":"2024-03-27T09:59:35.232702+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:58:34.321312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.728323+0000","last_change":"2024-03-27T09:59:29.158099+0000","last_active":"2024-03-27T09:59:36.728323+0000","last_peered":"2024-03-27T09:59:36.728323+0000","last_clean":"2024-03-27T09:59:36.728323+0000","last_became_active":"2024-03-27T09:59:29.157758+0000","last_became_peered":"2024-03-27T09:59:29.157758+0000","last_unstale":"2024-03-27T09:59:36.728323+0000","last_undegraded":"2024-03-27T09:59:36.728323+0000","last_fullsized":"2024-03-27T09:59:36.728323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:01:42.254664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'10","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:47.450737+0000","last_change":"2024-03-27T09:59:28.113383+0000","last_active":"2024-03-27T09:59:47.450737+0000","last_peered":"2024-03-27T09:59:47.450737+0000","last_clean":"2024-03-27T09:59:47.450737+0000","last_became_active":"2024-03-27T09:59:28.113082+0000","last_became_peered":"2024-03-27T09:59:28.113082+0000","last_unstale":"2024-03-27T09:59:47.450737+0000","last_undegraded":"2024-03-27T09:59:47.450737+0000","last_fullsized":"2024-03-27T09:59:47.450737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:13:29.201574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.659224+0000","last_change":"2024-03-27T09:59:33.216434+0000","last_active":"2024-03-27T09:59:36.659224+0000","last_peered":"2024-03-27T09:59:36.659224+0000","last_clean":"2024-03-27T09:59:36.659224+0000","last_became_active":"2024-03-27T09:59:33.215962+0000","last_became_peered":"2024-03-27T09:59:33.215962+0000","last_unstale":"2024-03-27T09:59:36.659224+0000","last_undegraded":"2024-03-27T09:59:36.659224+0000","last_fullsized":"2024-03-27T09:59:36.659224+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:21:56.509459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.233348+0000","last_change":"2024-03-27T09:59:29.148504+0000","last_active":"2024-03-27T09:59:35.233348+0000","last_peered":"2024-03-27T09:59:35.233348+0000","last_clean":"2024-03-27T09:59:35.233348+0000","last_became_active":"2024-03-27T09:59:29.148235+0000","last_became_peered":"2024-03-27T09:59:29.148235+0000","last_unstale":"2024-03-27T09:59:35.233348+0000","last_undegraded":"2024-03-27T09:59:35.233348+0000","last_fullsized":"2024-03-27T09:59:35.233348+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T12:53:31.902336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.657788+0000","last_change":"2024-03-27T09:59:28.119784+0000","last_active":"2024-03-27T09:59:36.657788+0000","last_peered":"2024-03-27T09:59:36.657788+0000","last_clean":"2024-03-27T09:59:36.657788+0000","last_became_active":"2024-03-27T09:59:28.119487+0000","last_became_peered":"2024-03-27T09:59:28.119487+0000","last_unstale":"2024-03-27T09:59:36.657788+0000","last_undegraded":"2024-03-27T09:59:36.657788+0000","last_fullsized":"2024-03-27T09:59:36.657788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:20:35.358265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.233153+0000","last_change":"2024-03-27T09:59:33.225724+0000","last_active":"2024-03-27T09:59:35.233153+0000","last_peered":"2024-03-27T09:59:35.233153+0000","last_clean":"2024-03-27T09:59:35.233153+0000","last_became_active":"2024-03-27T09:59:33.224979+0000","last_became_peered":"2024-03-27T09:59:33.224979+0000","last_unstale":"2024-03-27T09:59:35.233153+0000","last_undegraded":"2024-03-27T09:59:35.233153+0000","last_fullsized":"2024-03-27T09:59:35.233153+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:26:40.882057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.798367+0000","last_change":"2024-03-27T09:59:29.154101+0000","last_active":"2024-03-27T09:59:35.798367+0000","last_peered":"2024-03-27T09:59:35.798367+0000","last_clean":"2024-03-27T09:59:35.798367+0000","last_became_active":"2024-03-27T09:59:29.152850+0000","last_became_peered":"2024-03-27T09:59:29.152850+0000","last_unstale":"2024-03-27T09:59:35.798367+0000","last_undegraded":"2024-03-27T09:59:35.798367+0000","last_fullsized":"2024-03-27T09:59:35.798367+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T20:48:05.564784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.231860+0000","last_change":"2024-03-27T09:59:28.114582+0000","last_active":"2024-03-27T09:59:35.231860+0000","last_peered":"2024-03-27T09:59:35.231860+0000","last_clean":"2024-03-27T09:59:35.231860+0000","last_became_active":"2024-03-27T09:59:28.114287+0000","last_became_peered":"2024-03-27T09:59:28.114287+0000","last_unstale":"2024-03-27T09:59:35.231860+0000","last_undegraded":"2024-03-27T09:59:35.231860+0000","last_fullsized":"2024-03-27T09:59:35.231860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:55:33.304260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.599079+0000","last_change":"2024-03-27T09:59:33.225015+0000","last_active":"2024-03-27T09:59:35.599079+0000","last_peered":"2024-03-27T09:59:35.599079+0000","last_clean":"2024-03-27T09:59:35.599079+0000","last_became_active":"2024-03-27T09:59:33.224660+0000","last_became_peered":"2024-03-27T09:59:33.224660+0000","last_unstale":"2024-03-27T09:59:35.599079+0000","last_undegraded":"2024-03-27T09:59:35.599079+0000","last_fullsized":"2024-03-27T09:59:35.599079+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:22:38.863947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.231769+0000","last_change":"2024-03-27T09:59:29.168539+0000","last_active":"2024-03-27T09:59:35.231769+0000","last_peered":"2024-03-27T09:59:35.231769+0000","last_clean":"2024-03-27T09:59:35.231769+0000","last_became_active":"2024-03-27T09:59:29.168233+0000","last_became_peered":"2024-03-27T09:59:29.168233+0000","last_unstale":"2024-03-27T09:59:35.231769+0000","last_undegraded":"2024-03-27T09:59:35.231769+0000","last_fullsized":"2024-03-27T09:59:35.231769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:25:26.474648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.232327+0000","last_change":"2024-03-27T09:59:28.118980+0000","last_active":"2024-03-27T09:59:35.232327+0000","last_peered":"2024-03-27T09:59:35.232327+0000","last_clean":"2024-03-27T09:59:35.232327+0000","last_became_active":"2024-03-27T09:59:28.118617+0000","last_became_peered":"2024-03-27T09:59:28.118617+0000","last_unstale":"2024-03-27T09:59:35.232327+0000","last_undegraded":"2024-03-27T09:59:35.232327+0000","last_fullsized":"2024-03-27T09:59:35.232327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:20:35.358265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.599375+0000","last_change":"2024-03-27T09:59:33.703257+0000","last_active":"2024-03-27T09:59:35.599375+0000","last_peered":"2024-03-27T09:59:35.599375+0000","last_clean":"2024-03-27T09:59:35.599375+0000","last_became_active":"2024-03-27T09:59:33.702264+0000","last_became_peered":"2024-03-27T09:59:33.702264+0000","last_unstale":"2024-03-27T09:59:35.599375+0000","last_undegraded":"2024-03-27T09:59:35.599375+0000","last_fullsized":"2024-03-27T09:59:35.599375+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:04:06.406267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.797590+0000","last_change":"2024-03-27T09:59:33.707371+0000","last_active":"2024-03-27T09:59:35.797590+0000","last_peered":"2024-03-27T09:59:35.797590+0000","last_clean":"2024-03-27T09:59:35.797590+0000","last_became_active":"2024-03-27T09:59:33.706609+0000","last_became_peered":"2024-03-27T09:59:33.706609+0000","last_unstale":"2024-03-27T09:59:35.797590+0000","last_undegraded":"2024-03-27T09:59:35.797590+0000","last_fullsized":"2024-03-27T09:59:35.797590+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:06:12.744793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.658398+0000","last_change":"2024-03-27T09:59:29.150732+0000","last_active":"2024-03-27T09:59:36.658398+0000","last_peered":"2024-03-27T09:59:36.658398+0000","last_clean":"2024-03-27T09:59:36.658398+0000","last_became_active":"2024-03-27T09:59:29.147814+0000","last_became_peered":"2024-03-27T09:59:29.147814+0000","last_unstale":"2024-03-27T09:59:36.658398+0000","last_undegraded":"2024-03-27T09:59:36.658398+0000","last_fullsized":"2024-03-27T09:59:36.658398+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:40:55.546423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.230076+0000","last_change":"2024-03-27T09:59:28.121927+0000","last_active":"2024-03-27T09:59:35.230076+0000","last_peered":"2024-03-27T09:59:35.230076+0000","last_clean":"2024-03-27T09:59:35.230076+0000","last_became_active":"2024-03-27T09:59:28.121549+0000","last_became_peered":"2024-03-27T09:59:28.121549+0000","last_unstale":"2024-03-27T09:59:35.230076+0000","last_undegraded":"2024-03-27T09:59:35.230076+0000","last_fullsized":"2024-03-27T09:59:35.230076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:40:42.254670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.232144+0000","last_change":"2024-03-27T09:59:33.224491+0000","last_active":"2024-03-27T09:59:35.232144+0000","last_peered":"2024-03-27T09:59:35.232144+0000","last_clean":"2024-03-27T09:59:35.232144+0000","last_became_active":"2024-03-27T09:59:33.223841+0000","last_became_peered":"2024-03-27T09:59:33.223841+0000","last_unstale":"2024-03-27T09:59:35.232144+0000","last_undegraded":"2024-03-27T09:59:35.232144+0000","last_fullsized":"2024-03-27T09:59:35.232144+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:02:21.892888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.599193+0000","last_change":"2024-03-27T09:59:29.161642+0000","last_active":"2024-03-27T09:59:35.599193+0000","last_peered":"2024-03-27T09:59:35.599193+0000","last_clean":"2024-03-27T09:59:35.599193+0000","last_became_active":"2024-03-27T09:59:29.155700+0000","last_became_peered":"2024-03-27T09:59:29.155700+0000","last_unstale":"2024-03-27T09:59:35.599193+0000","last_undegraded":"2024-03-27T09:59:35.599193+0000","last_fullsized":"2024-03-27T09:59:35.599193+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T21:36:52.561523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.599835+0000","last_change":"2024-03-27T09:59:28.111747+0000","last_active":"2024-03-27T09:59:35.599835+0000","last_peered":"2024-03-27T09:59:35.599835+0000","last_clean":"2024-03-27T09:59:35.599835+0000","last_became_active":"2024-03-27T09:59:28.111334+0000","last_became_peered":"2024-03-27T09:59:28.111334+0000","last_unstale":"2024-03-27T09:59:35.599835+0000","last_undegraded":"2024-03-27T09:59:35.599835+0000","last_fullsized":"2024-03-27T09:59:35.599835+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:35:50.131290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.232266+0000","last_change":"2024-03-27T09:59:28.115303+0000","last_active":"2024-03-27T09:59:35.232266+0000","last_peered":"2024-03-27T09:59:35.232266+0000","last_clean":"2024-03-27T09:59:35.232266+0000","last_became_active":"2024-03-27T09:59:28.113900+0000","last_became_peered":"2024-03-27T09:59:28.113900+0000","last_unstale":"2024-03-27T09:59:35.232266+0000","last_undegraded":"2024-03-27T09:59:35.232266+0000","last_fullsized":"2024-03-27T09:59:35.232266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:23:46.050666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.797870+0000","last_change":"2024-03-27T09:59:29.157943+0000","last_active":"2024-03-27T09:59:35.797870+0000","last_peered":"2024-03-27T09:59:35.797870+0000","last_clean":"2024-03-27T09:59:35.797870+0000","last_became_active":"2024-03-27T09:59:29.157663+0000","last_became_peered":"2024-03-27T09:59:29.157663+0000","last_unstale":"2024-03-27T09:59:35.797870+0000","last_undegraded":"2024-03-27T09:59:35.797870+0000","last_fullsized":"2024-03-27T09:59:35.797870+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:20:50.555376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.792577+0000","last_change":"2024-03-27T09:59:33.219540+0000","last_active":"2024-03-27T09:59:36.792577+0000","last_peered":"2024-03-27T09:59:36.792577+0000","last_clean":"2024-03-27T09:59:36.792577+0000","last_became_active":"2024-03-27T09:59:33.219085+0000","last_became_peered":"2024-03-27T09:59:33.219085+0000","last_unstale":"2024-03-27T09:59:36.792577+0000","last_undegraded":"2024-03-27T09:59:36.792577+0000","last_fullsized":"2024-03-27T09:59:36.792577+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:16:32.539730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.600218+0000","last_change":"2024-03-27T09:59:28.113237+0000","last_active":"2024-03-27T09:59:35.600218+0000","last_peered":"2024-03-27T09:59:35.600218+0000","last_clean":"2024-03-27T09:59:35.600218+0000","last_became_active":"2024-03-27T09:59:28.112995+0000","last_became_peered":"2024-03-27T09:59:28.112995+0000","last_unstale":"2024-03-27T09:59:35.600218+0000","last_undegraded":"2024-03-27T09:59:35.600218+0000","last_fullsized":"2024-03-27T09:59:35.600218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:03:46.932809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.229942+0000","last_change":"2024-03-27T09:59:29.142949+0000","last_active":"2024-03-27T09:59:35.229942+0000","last_peered":"2024-03-27T09:59:35.229942+0000","last_clean":"2024-03-27T09:59:35.229942+0000","last_became_active":"2024-03-27T09:59:29.142626+0000","last_became_peered":"2024-03-27T09:59:29.142626+0000","last_unstale":"2024-03-27T09:59:35.229942+0000","last_undegraded":"2024-03-27T09:59:35.229942+0000","last_fullsized":"2024-03-27T09:59:35.229942+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:20:36.372242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.600394+0000","last_change":"2024-03-27T09:59:33.226673+0000","last_active":"2024-03-27T09:59:35.600394+0000","last_peered":"2024-03-27T09:59:35.600394+0000","last_clean":"2024-03-27T09:59:35.600394+0000","last_became_active":"2024-03-27T09:59:33.226185+0000","last_became_peered":"2024-03-27T09:59:33.226185+0000","last_unstale":"2024-03-27T09:59:35.600394+0000","last_undegraded":"2024-03-27T09:59:35.600394+0000","last_fullsized":"2024-03-27T09:59:35.600394+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:17:46.912834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.229527+0000","last_change":"2024-03-27T09:59:29.159064+0000","last_active":"2024-03-27T09:59:35.229527+0000","last_peered":"2024-03-27T09:59:35.229527+0000","last_clean":"2024-03-27T09:59:35.229527+0000","last_became_active":"2024-03-27T09:59:29.158263+0000","last_became_peered":"2024-03-27T09:59:29.158263+0000","last_unstale":"2024-03-27T09:59:35.229527+0000","last_undegraded":"2024-03-27T09:59:35.229527+0000","last_fullsized":"2024-03-27T09:59:35.229527+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T21:36:52.561523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.791954+0000","last_change":"2024-03-27T09:59:29.148971+0000","last_active":"2024-03-27T09:59:36.791954+0000","last_peered":"2024-03-27T09:59:36.791954+0000","last_clean":"2024-03-27T09:59:36.791954+0000","last_became_active":"2024-03-27T09:59:29.148701+0000","last_became_peered":"2024-03-27T09:59:29.148701+0000","last_unstale":"2024-03-27T09:59:36.791954+0000","last_undegraded":"2024-03-27T09:59:36.791954+0000","last_fullsized":"2024-03-27T09:59:36.791954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T12:53:31.902336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.230981+0000","last_change":"2024-03-27T09:59:29.145218+0000","last_active":"2024-03-27T09:59:35.230981+0000","last_peered":"2024-03-27T09:59:35.230981+0000","last_clean":"2024-03-27T09:59:35.230981+0000","last_became_active":"2024-03-27T09:59:29.144927+0000","last_became_peered":"2024-03-27T09:59:29.144927+0000","last_unstale":"2024-03-27T09:59:35.230981+0000","last_undegraded":"2024-03-27T09:59:35.230981+0000","last_fullsized":"2024-03-27T09:59:35.230981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:12:08.142213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.797876+0000","last_change":"2024-03-27T09:59:29.155091+0000","last_active":"2024-03-27T09:59:35.797876+0000","last_peered":"2024-03-27T09:59:35.797876+0000","last_clean":"2024-03-27T09:59:35.797876+0000","last_became_active":"2024-03-27T09:59:29.153115+0000","last_became_peered":"2024-03-27T09:59:29.153115+0000","last_unstale":"2024-03-27T09:59:35.797876+0000","last_undegraded":"2024-03-27T09:59:35.797876+0000","last_fullsized":"2024-03-27T09:59:35.797876+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:40:55.546423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.600252+0000","last_change":"2024-03-27T09:59:29.139530+0000","last_active":"2024-03-27T09:59:35.600252+0000","last_peered":"2024-03-27T09:59:35.600252+0000","last_clean":"2024-03-27T09:59:35.600252+0000","last_became_active":"2024-03-27T09:59:29.135340+0000","last_became_peered":"2024-03-27T09:59:29.135340+0000","last_unstale":"2024-03-27T09:59:35.600252+0000","last_undegraded":"2024-03-27T09:59:35.600252+0000","last_fullsized":"2024-03-27T09:59:35.600252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T20:48:05.564784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.659487+0000","last_change":"2024-03-27T09:59:29.160480+0000","last_active":"2024-03-27T09:59:36.659487+0000","last_peered":"2024-03-27T09:59:36.659487+0000","last_clean":"2024-03-27T09:59:36.659487+0000","last_became_active":"2024-03-27T09:59:29.153116+0000","last_became_peered":"2024-03-27T09:59:29.153116+0000","last_unstale":"2024-03-27T09:59:36.659487+0000","last_undegraded":"2024-03-27T09:59:36.659487+0000","last_fullsized":"2024-03-27T09:59:36.659487+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:57:26.770369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.234256+0000","last_change":"2024-03-27T09:59:29.165741+0000","last_active":"2024-03-27T09:59:35.234256+0000","last_peered":"2024-03-27T09:59:35.234256+0000","last_clean":"2024-03-27T09:59:35.234256+0000","last_became_active":"2024-03-27T09:59:29.165448+0000","last_became_peered":"2024-03-27T09:59:29.165448+0000","last_unstale":"2024-03-27T09:59:35.234256+0000","last_undegraded":"2024-03-27T09:59:35.234256+0000","last_fullsized":"2024-03-27T09:59:35.234256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T20:48:05.564784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.601055+0000","last_change":"2024-03-27T09:59:29.128048+0000","last_active":"2024-03-27T09:59:35.601055+0000","last_peered":"2024-03-27T09:59:35.601055+0000","last_clean":"2024-03-27T09:59:35.601055+0000","last_became_active":"2024-03-27T09:59:29.127194+0000","last_became_peered":"2024-03-27T09:59:29.127194+0000","last_unstale":"2024-03-27T09:59:35.601055+0000","last_undegraded":"2024-03-27T09:59:35.601055+0000","last_fullsized":"2024-03-27T09:59:35.601055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T20:51:12.586643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.229823+0000","last_change":"2024-03-27T09:59:29.149715+0000","last_active":"2024-03-27T09:59:35.229823+0000","last_peered":"2024-03-27T09:59:35.229823+0000","last_clean":"2024-03-27T09:59:35.229823+0000","last_became_active":"2024-03-27T09:59:29.147816+0000","last_became_peered":"2024-03-27T09:59:29.147816+0000","last_unstale":"2024-03-27T09:59:35.229823+0000","last_undegraded":"2024-03-27T09:59:35.229823+0000","last_fullsized":"2024-03-27T09:59:35.229823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T20:48:05.564784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.599722+0000","last_change":"2024-03-27T09:59:29.127532+0000","last_active":"2024-03-27T09:59:35.599722+0000","last_peered":"2024-03-27T09:59:35.599722+0000","last_clean":"2024-03-27T09:59:35.599722+0000","last_became_active":"2024-03-27T09:59:29.126384+0000","last_became_peered":"2024-03-27T09:59:29.126384+0000","last_unstale":"2024-03-27T09:59:35.599722+0000","last_undegraded":"2024-03-27T09:59:35.599722+0000","last_fullsized":"2024-03-27T09:59:35.599722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:40:55.546423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.230828+0000","last_change":"2024-03-27T09:59:29.168460+0000","last_active":"2024-03-27T09:59:35.230828+0000","last_peered":"2024-03-27T09:59:35.230828+0000","last_clean":"2024-03-27T09:59:35.230828+0000","last_became_active":"2024-03-27T09:59:29.168082+0000","last_became_peered":"2024-03-27T09:59:29.168082+0000","last_unstale":"2024-03-27T09:59:35.230828+0000","last_undegraded":"2024-03-27T09:59:35.230828+0000","last_fullsized":"2024-03-27T09:59:35.230828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:00:09.092063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.797561+0000","last_change":"2024-03-27T09:59:29.169976+0000","last_active":"2024-03-27T09:59:35.797561+0000","last_peered":"2024-03-27T09:59:35.797561+0000","last_clean":"2024-03-27T09:59:35.797561+0000","last_became_active":"2024-03-27T09:59:29.169553+0000","last_became_peered":"2024-03-27T09:59:29.169553+0000","last_unstale":"2024-03-27T09:59:35.797561+0000","last_undegraded":"2024-03-27T09:59:35.797561+0000","last_fullsized":"2024-03-27T09:59:35.797561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T21:36:52.561523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.232376+0000","last_change":"2024-03-27T09:59:29.151159+0000","last_active":"2024-03-27T09:59:35.232376+0000","last_peered":"2024-03-27T09:59:35.232376+0000","last_clean":"2024-03-27T09:59:35.232376+0000","last_became_active":"2024-03-27T09:59:29.150521+0000","last_became_peered":"2024-03-27T09:59:29.150521+0000","last_unstale":"2024-03-27T09:59:35.232376+0000","last_undegraded":"2024-03-27T09:59:35.232376+0000","last_fullsized":"2024-03-27T09:59:35.232376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:20:50.555376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.728796+0000","last_change":"2024-03-27T09:59:29.159754+0000","last_active":"2024-03-27T09:59:36.728796+0000","last_peered":"2024-03-27T09:59:36.728796+0000","last_clean":"2024-03-27T09:59:36.728796+0000","last_became_active":"2024-03-27T09:59:29.159451+0000","last_became_peered":"2024-03-27T09:59:29.159451+0000","last_unstale":"2024-03-27T09:59:36.728796+0000","last_undegraded":"2024-03-27T09:59:36.728796+0000","last_fullsized":"2024-03-27T09:59:36.728796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:27:19.913918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.793121+0000","last_change":"2024-03-27T09:59:29.146745+0000","last_active":"2024-03-27T09:59:36.793121+0000","last_peered":"2024-03-27T09:59:36.793121+0000","last_clean":"2024-03-27T09:59:36.793121+0000","last_became_active":"2024-03-27T09:59:29.146399+0000","last_became_peered":"2024-03-27T09:59:29.146399+0000","last_unstale":"2024-03-27T09:59:36.793121+0000","last_undegraded":"2024-03-27T09:59:36.793121+0000","last_fullsized":"2024-03-27T09:59:36.793121+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:31:21.514709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.232127+0000","last_change":"2024-03-27T09:59:29.170756+0000","last_active":"2024-03-27T09:59:35.232127+0000","last_peered":"2024-03-27T09:59:35.232127+0000","last_clean":"2024-03-27T09:59:35.232127+0000","last_became_active":"2024-03-27T09:59:29.170483+0000","last_became_peered":"2024-03-27T09:59:29.170483+0000","last_unstale":"2024-03-27T09:59:35.232127+0000","last_undegraded":"2024-03-27T09:59:35.232127+0000","last_fullsized":"2024-03-27T09:59:35.232127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:01:42.254664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.229573+0000","last_change":"2024-03-27T09:59:29.156761+0000","last_active":"2024-03-27T09:59:35.229573+0000","last_peered":"2024-03-27T09:59:35.229573+0000","last_clean":"2024-03-27T09:59:35.229573+0000","last_became_active":"2024-03-27T09:59:29.156448+0000","last_became_peered":"2024-03-27T09:59:29.156448+0000","last_unstale":"2024-03-27T09:59:35.229573+0000","last_undegraded":"2024-03-27T09:59:35.229573+0000","last_fullsized":"2024-03-27T09:59:35.229573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:45:14.005415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.658573+0000","last_change":"2024-03-27T09:59:29.159241+0000","last_active":"2024-03-27T09:59:36.658573+0000","last_peered":"2024-03-27T09:59:36.658573+0000","last_clean":"2024-03-27T09:59:36.658573+0000","last_became_active":"2024-03-27T09:59:29.158935+0000","last_became_peered":"2024-03-27T09:59:29.158935+0000","last_unstale":"2024-03-27T09:59:36.658573+0000","last_undegraded":"2024-03-27T09:59:36.658573+0000","last_fullsized":"2024-03-27T09:59:36.658573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:53:03.077046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.798122+0000","last_change":"2024-03-27T09:59:29.150820+0000","last_active":"2024-03-27T09:59:35.798122+0000","last_peered":"2024-03-27T09:59:35.798122+0000","last_clean":"2024-03-27T09:59:35.798122+0000","last_became_active":"2024-03-27T09:59:29.150536+0000","last_became_peered":"2024-03-27T09:59:29.150536+0000","last_unstale":"2024-03-27T09:59:35.798122+0000","last_undegraded":"2024-03-27T09:59:35.798122+0000","last_fullsized":"2024-03-27T09:59:35.798122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:53:03.077046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.599935+0000","last_change":"2024-03-27T09:59:29.148510+0000","last_active":"2024-03-27T09:59:35.599935+0000","last_peered":"2024-03-27T09:59:35.599935+0000","last_clean":"2024-03-27T09:59:35.599935+0000","last_became_active":"2024-03-27T09:59:29.146776+0000","last_became_peered":"2024-03-27T09:59:29.146776+0000","last_unstale":"2024-03-27T09:59:35.599935+0000","last_undegraded":"2024-03-27T09:59:35.599935+0000","last_fullsized":"2024-03-27T09:59:35.599935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:45:14.005415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.233211+0000","last_change":"2024-03-27T09:59:29.149815+0000","last_active":"2024-03-27T09:59:35.233211+0000","last_peered":"2024-03-27T09:59:35.233211+0000","last_clean":"2024-03-27T09:59:35.233211+0000","last_became_active":"2024-03-27T09:59:29.147082+0000","last_became_peered":"2024-03-27T09:59:29.147082+0000","last_unstale":"2024-03-27T09:59:35.233211+0000","last_undegraded":"2024-03-27T09:59:35.233211+0000","last_fullsized":"2024-03-27T09:59:35.233211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:31:21.514709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.230648+0000","last_change":"2024-03-27T09:59:29.147375+0000","last_active":"2024-03-27T09:59:35.230648+0000","last_peered":"2024-03-27T09:59:35.230648+0000","last_clean":"2024-03-27T09:59:35.230648+0000","last_became_active":"2024-03-27T09:59:29.147012+0000","last_became_peered":"2024-03-27T09:59:29.147012+0000","last_unstale":"2024-03-27T09:59:35.230648+0000","last_undegraded":"2024-03-27T09:59:35.230648+0000","last_fullsized":"2024-03-27T09:59:35.230648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:40:55.546423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.234176+0000","last_change":"2024-03-27T09:59:29.156417+0000","last_active":"2024-03-27T09:59:35.234176+0000","last_peered":"2024-03-27T09:59:35.234176+0000","last_clean":"2024-03-27T09:59:35.234176+0000","last_became_active":"2024-03-27T09:59:29.156124+0000","last_became_peered":"2024-03-27T09:59:29.156124+0000","last_unstale":"2024-03-27T09:59:35.234176+0000","last_undegraded":"2024-03-27T09:59:35.234176+0000","last_fullsized":"2024-03-27T09:59:35.234176+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:45:14.005415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.729121+0000","last_change":"2024-03-27T09:59:29.169092+0000","last_active":"2024-03-27T09:59:36.729121+0000","last_peered":"2024-03-27T09:59:36.729121+0000","last_clean":"2024-03-27T09:59:36.729121+0000","last_became_active":"2024-03-27T09:59:29.168788+0000","last_became_peered":"2024-03-27T09:59:29.168788+0000","last_unstale":"2024-03-27T09:59:36.729121+0000","last_undegraded":"2024-03-27T09:59:36.729121+0000","last_fullsized":"2024-03-27T09:59:36.729121+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T20:25:54.732855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.598901+0000","last_change":"2024-03-27T09:59:29.157524+0000","last_active":"2024-03-27T09:59:35.598901+0000","last_peered":"2024-03-27T09:59:35.598901+0000","last_clean":"2024-03-27T09:59:35.598901+0000","last_became_active":"2024-03-27T09:59:29.153615+0000","last_became_peered":"2024-03-27T09:59:29.153615+0000","last_unstale":"2024-03-27T09:59:35.598901+0000","last_undegraded":"2024-03-27T09:59:35.598901+0000","last_fullsized":"2024-03-27T09:59:35.598901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:53:03.077046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.727620+0000","last_change":"2024-03-27T09:59:29.165201+0000","last_active":"2024-03-27T09:59:36.727620+0000","last_peered":"2024-03-27T09:59:36.727620+0000","last_clean":"2024-03-27T09:59:36.727620+0000","last_became_active":"2024-03-27T09:59:29.164845+0000","last_became_peered":"2024-03-27T09:59:29.164845+0000","last_unstale":"2024-03-27T09:59:36.727620+0000","last_undegraded":"2024-03-27T09:59:36.727620+0000","last_fullsized":"2024-03-27T09:59:36.727620+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:34:04.348561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.230702+0000","last_change":"2024-03-27T09:59:29.159124+0000","last_active":"2024-03-27T09:59:35.230702+0000","last_peered":"2024-03-27T09:59:35.230702+0000","last_clean":"2024-03-27T09:59:35.230702+0000","last_became_active":"2024-03-27T09:59:29.158654+0000","last_became_peered":"2024-03-27T09:59:29.158654+0000","last_unstale":"2024-03-27T09:59:35.230702+0000","last_undegraded":"2024-03-27T09:59:35.230702+0000","last_fullsized":"2024-03-27T09:59:35.230702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:34:04.348561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.727714+0000","last_change":"2024-03-27T09:59:29.150329+0000","last_active":"2024-03-27T09:59:36.727714+0000","last_peered":"2024-03-27T09:59:36.727714+0000","last_clean":"2024-03-27T09:59:36.727714+0000","last_became_active":"2024-03-27T09:59:29.150095+0000","last_became_peered":"2024-03-27T09:59:29.150095+0000","last_unstale":"2024-03-27T09:59:36.727714+0000","last_undegraded":"2024-03-27T09:59:36.727714+0000","last_fullsized":"2024-03-27T09:59:36.727714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:12:08.142213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.230685+0000","last_change":"2024-03-27T09:59:29.149230+0000","last_active":"2024-03-27T09:59:35.230685+0000","last_peered":"2024-03-27T09:59:35.230685+0000","last_clean":"2024-03-27T09:59:35.230685+0000","last_became_active":"2024-03-27T09:59:29.148669+0000","last_became_peered":"2024-03-27T09:59:29.148669+0000","last_unstale":"2024-03-27T09:59:35.230685+0000","last_undegraded":"2024-03-27T09:59:35.230685+0000","last_fullsized":"2024-03-27T09:59:35.230685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:27:19.913918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.798736+0000","last_change":"2024-03-27T09:59:29.151084+0000","last_active":"2024-03-27T09:59:35.798736+0000","last_peered":"2024-03-27T09:59:35.798736+0000","last_clean":"2024-03-27T09:59:35.798736+0000","last_became_active":"2024-03-27T09:59:29.149050+0000","last_became_peered":"2024-03-27T09:59:29.149050+0000","last_unstale":"2024-03-27T09:59:35.798736+0000","last_undegraded":"2024-03-27T09:59:35.798736+0000","last_fullsized":"2024-03-27T09:59:35.798736+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:40:55.617775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.660424+0000","last_change":"2024-03-27T09:59:29.160100+0000","last_active":"2024-03-27T09:59:36.660424+0000","last_peered":"2024-03-27T09:59:36.660424+0000","last_clean":"2024-03-27T09:59:36.660424+0000","last_became_active":"2024-03-27T09:59:29.158340+0000","last_became_peered":"2024-03-27T09:59:29.158340+0000","last_unstale":"2024-03-27T09:59:36.660424+0000","last_undegraded":"2024-03-27T09:59:36.660424+0000","last_fullsized":"2024-03-27T09:59:36.660424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:20:50.555376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.728983+0000","last_change":"2024-03-27T09:59:29.157565+0000","last_active":"2024-03-27T09:59:36.728983+0000","last_peered":"2024-03-27T09:59:36.728983+0000","last_clean":"2024-03-27T09:59:36.728983+0000","last_became_active":"2024-03-27T09:59:29.157278+0000","last_became_peered":"2024-03-27T09:59:29.157278+0000","last_unstale":"2024-03-27T09:59:36.728983+0000","last_undegraded":"2024-03-27T09:59:36.728983+0000","last_fullsized":"2024-03-27T09:59:36.728983+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:03:30.407810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":14,"seq":60129542153,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":286720,"data_stored":114786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542153,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":110944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542152,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":282624,"data_stored":111104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542152,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32040,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339800,"statfs":{"total":96636764160,"available":96603955200,"internally_reserved":0,"allocated":880640,"data_stored":701950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574859,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32036,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339804,"statfs":{"total":96636764160,"available":96603959296,"internally_reserved":0,"allocated":872448,"data_stored":701894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":286720,"data_stored":114786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":278528,"data_stored":111034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31460,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340380,"statfs":{"total":96636764160,"available":96604549120,"internally_reserved":0,"allocated":286720,"data_stored":111070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-27T09:59:57.842 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-27T09:59:58.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.114+0000 7f98fce00640 1 Processor -- start 2024-03-27T09:59:58.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.114+0000 7f98fce00640 1 -- start start 2024-03-27T09:59:58.106 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.115+0000 7f98fce00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f98f806b750 0x7f98f806bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:58.106 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.116+0000 7f98fce00640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98f815fc70 con 0x7f98f8145820 2024-03-27T09:59:58.106 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.116+0000 7f98fce00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98f815ff50 con 0x7f98f80ce740 2024-03-27T09:59:58.106 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.116+0000 7f98fce00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f98f8160b60 con 0x7f98f806b750 2024-03-27T09:59:58.106 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.116+0000 7f98f5e00640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f98f8145820 0x7f98f80cc950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:60868/0 (socket says 172.21.15.57:60868) 2024-03-27T09:59:58.106 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.116+0000 7f98f5e00640 1 -- 172.21.15.57:0/2148247731 learned_addr learned my addr 172.21.15.57:0/2148247731 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T09:59:58.106 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.116+0000 7f98ed400640 1 --2- 172.21.15.57:0/2148247731 >> v2:172.21.15.118:3300/0 conn(0x7f98f806b750 0x7f98f806bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:58.107 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.117+0000 7f98f5400640 1 -- 172.21.15.57:0/2148247731 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1076623538 0 0) 0x7f98f815fc70 con 0x7f98f8145820 2024-03-27T09:59:58.107 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.117+0000 7f98f5400640 1 -- 172.21.15.57:0/2148247731 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f98dc003520 con 0x7f98f8145820 2024-03-27T09:59:58.107 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.117+0000 7f98ed400640 1 -- 172.21.15.57:0/2148247731 >> v1:172.21.15.118:6789/0 conn(0x7f98f80ce740 legacy=0x7f98f80ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:58.107 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.117+0000 7f98ed400640 1 -- 172.21.15.57:0/2148247731 >> v1:172.21.15.57:6789/0 conn(0x7f98f8145820 legacy=0x7f98f80cc950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:58.107 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.117+0000 7f98ed400640 1 -- 172.21.15.57:0/2148247731 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98f8160230 con 0x7f98f806b750 2024-03-27T09:59:58.108 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.118+0000 7f98ed400640 1 --2- 172.21.15.57:0/2148247731 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f98f806b750 0x7f98f806bb90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f98f8160ce0 tx=0x7f98e002b940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fd604599817580e8 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:58.108 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.119+0000 7f98f5400640 1 -- 172.21.15.57:0/2148247731 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98e0034070 con 0x7f98f806b750 2024-03-27T09:59:58.108 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.119+0000 7f98f5400640 1 -- 172.21.15.57:0/2148247731 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98e0030800 con 0x7f98f806b750 2024-03-27T09:59:58.108 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.119+0000 7f98f5400640 1 -- 172.21.15.57:0/2148247731 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98e0030bb0 con 0x7f98f806b750 2024-03-27T09:59:58.109 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.119+0000 7f98fce00640 1 -- 172.21.15.57:0/2148247731 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f98f806b750 msgr2=0x7f98f806bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:58.109 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.119+0000 7f98fce00640 1 --2- 172.21.15.57:0/2148247731 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f98f806b750 0x7f98f806bb90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f98f8160ce0 tx=0x7f98e002b940 comp rx=0 tx=0).stop 2024-03-27T09:59:58.109 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.119+0000 7f98fce00640 1 -- 172.21.15.57:0/2148247731 shutdown_connections 2024-03-27T09:59:58.109 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.119+0000 7f98fce00640 1 --2- 172.21.15.57:0/2148247731 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f98f806b750 0x7f98f806bb90 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:58.110 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.119+0000 7f98fce00640 1 -- 172.21.15.57:0/2148247731 >> 172.21.15.57:0/2148247731 conn(0x7f98f80b1c60 msgr2=0x7f98f80b2070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:58.110 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.119+0000 7f98fce00640 1 -- 172.21.15.57:0/2148247731 shutdown_connections 2024-03-27T09:59:58.110 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.120+0000 7f98fce00640 1 -- 172.21.15.57:0/2148247731 wait complete. 2024-03-27T09:59:58.115 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.121+0000 7f98fce00640 1 Processor -- start 2024-03-27T09:59:58.115 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.121+0000 7f98fce00640 1 -- start start 2024-03-27T09:59:58.115 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.122+0000 7f98fce00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f98f806b750 0x7f98f81556c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:58.115 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.122+0000 7f98fce00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f98f80ce740 0x7f98f81416f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:58.115 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.122+0000 7f98fce00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f98f8145820 0x7f98f8133a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:58.115 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.122+0000 7f98fce00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f98f81607f0 con 0x7f98f8145820 2024-03-27T09:59:58.115 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.122+0000 7f98fce00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f98f806c0d0 con 0x7f98f806b750 2024-03-27T09:59:58.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.122+0000 7f98fce00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f98f8145c00 con 0x7f98f80ce740 2024-03-27T09:59:58.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.123+0000 7f98f6800640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f98f8145820 0x7f98f8133a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:58.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.123+0000 7f98f6800640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f98f8145820 0x7f98f8133a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:48678/0 (socket says 172.21.15.57:48678) 2024-03-27T09:59:58.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.123+0000 7f98f6800640 1 -- 172.21.15.57:0/3538552303 learned_addr learned my addr 172.21.15.57:0/3538552303 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T09:59:58.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.123+0000 7f98f5e00640 1 --2- 172.21.15.57:0/3538552303 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f98f806b750 0x7f98f81556c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:58.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.123+0000 7f98ed400640 1 --2- 172.21.15.57:0/3538552303 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f98f80ce740 0x7f98f81416f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:58.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.123+0000 7f98f6800640 1 -- 172.21.15.57:0/3538552303 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f98f80ce740 msgr2=0x7f98f81416f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:58.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.123+0000 7f98f6800640 1 --2- 172.21.15.57:0/3538552303 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f98f80ce740 0x7f98f81416f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:58.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.123+0000 7f98f6800640 1 -- 172.21.15.57:0/3538552303 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f98f806b750 msgr2=0x7f98f81556c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:58.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.123+0000 7f98f6800640 1 --2- 172.21.15.57:0/3538552303 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f98f806b750 0x7f98f81556c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:58.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.123+0000 7f98f6800640 1 -- 172.21.15.57:0/3538552303 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98f81344f0 con 0x7f98f8145820 2024-03-27T09:59:58.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.123+0000 7f98f6800640 1 --2- 172.21.15.57:0/3538552303 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f98f8145820 0x7f98f8133a00 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f98f000c7a0 tx=0x7f98f000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:58.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.124+0000 7f98eea00640 1 -- 172.21.15.57:0/3538552303 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f0003b70 con 0x7f98f8145820 2024-03-27T09:59:58.117 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.124+0000 7f98eea00640 1 -- 172.21.15.57:0/3538552303 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98f0003d30 con 0x7f98f8145820 2024-03-27T09:59:58.117 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.124+0000 7f98eea00640 1 -- 172.21.15.57:0/3538552303 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f000aa90 con 0x7f98f8145820 2024-03-27T09:59:58.117 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.124+0000 7f98fce00640 1 -- 172.21.15.57:0/3538552303 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98f81347d0 con 0x7f98f8145820 2024-03-27T09:59:58.117 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.124+0000 7f98fce00640 1 -- 172.21.15.57:0/3538552303 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98f8134d90 con 0x7f98f8145820 2024-03-27T09:59:58.117 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.125+0000 7f98fce00640 1 -- 172.21.15.57:0/3538552303 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98f8068620 con 0x7f98f8145820 2024-03-27T09:59:58.117 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.126+0000 7f98eea00640 1 -- 172.21.15.57:0/3538552303 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f98f000ac30 con 0x7f98f8145820 2024-03-27T09:59:58.118 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.128+0000 7f98eea00640 1 --2- 172.21.15.57:0/3538552303 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f98d406c530 0x7f98d406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:58.118 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.128+0000 7f98eea00640 1 -- 172.21.15.57:0/3538552303 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f98f008baf0 con 0x7f98f8145820 2024-03-27T09:59:58.118 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.128+0000 7f98f5e00640 1 --2- 172.21.15.57:0/3538552303 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f98d406c530 0x7f98d406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:58.118 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.129+0000 7f98f5e00640 1 --2- 172.21.15.57:0/3538552303 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f98d406c530 0x7f98d406e9f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f98e80011e0 tx=0x7f98e8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:58.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.133+0000 7f98eea00640 1 -- 172.21.15.57:0/3538552303 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f98f0059ca0 con 0x7f98f8145820 2024-03-27T09:59:58.325 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.335+0000 7f98fce00640 1 -- 172.21.15.57:0/3538552303 --> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f98f80b4a70 con 0x7f98d406c530 2024-03-27T09:59:58.348 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.358+0000 7f98eea00640 1 -- 172.21.15.57:0/3538552303 <== mgr.4103 v2:172.21.15.57:6832/485397065 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332562 (secure 0 0 0) 0x7f98f80b4a70 con 0x7f98d406c530 2024-03-27T09:59:58.352 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T09:59:58.355 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-03-27T09:59:58.357 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.367+0000 7f98fce00640 1 -- 172.21.15.57:0/3538552303 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f98d406c530 msgr2=0x7f98d406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:58.357 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.367+0000 7f98fce00640 1 --2- 172.21.15.57:0/3538552303 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f98d406c530 0x7f98d406e9f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f98e80011e0 tx=0x7f98e8009040 comp rx=0 tx=0).stop 2024-03-27T09:59:58.357 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.367+0000 7f98fce00640 1 -- 172.21.15.57:0/3538552303 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f98f8145820 msgr2=0x7f98f8133a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:58.358 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.367+0000 7f98fce00640 1 --2- 172.21.15.57:0/3538552303 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f98f8145820 0x7f98f8133a00 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f98f000c7a0 tx=0x7f98f000cc60 comp rx=0 tx=0).stop 2024-03-27T09:59:58.358 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.367+0000 7f98fce00640 1 -- 172.21.15.57:0/3538552303 shutdown_connections 2024-03-27T09:59:58.358 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.367+0000 7f98fce00640 1 --2- 172.21.15.57:0/3538552303 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f98f8145820 0x7f98f8133a00 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:58.358 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.367+0000 7f98fce00640 1 --2- 172.21.15.57:0/3538552303 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f98f80ce740 0x7f98f81416f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:58.358 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.367+0000 7f98fce00640 1 --2- 172.21.15.57:0/3538552303 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f98d406c530 0x7f98d406e9f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:58.358 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.367+0000 7f98fce00640 1 --2- 172.21.15.57:0/3538552303 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f98f806b750 0x7f98f81556c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:58.358 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.367+0000 7f98fce00640 1 -- 172.21.15.57:0/3538552303 >> 172.21.15.57:0/3538552303 conn(0x7f98f80b1c60 msgr2=0x7f98f80af720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:58.358 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.368+0000 7f98fce00640 1 -- 172.21.15.57:0/3538552303 shutdown_connections 2024-03-27T09:59:58.358 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.368+0000 7f98fce00640 1 -- 172.21.15.57:0/3538552303 wait complete. 2024-03-27T09:59:58.380 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":40,"stamp":"2024-03-27T09:59:57.230698+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236172,"kb_used_data":3368,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738548,"statfs":{"total":773094113280,"available":772852273152,"internally_reserved":0,"allocated":3448832,"data_stored":2077568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1781,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006522"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.798582+0000","last_change":"2024-03-27T09:59:28.132620+0000","last_active":"2024-03-27T09:59:35.798582+0000","last_peered":"2024-03-27T09:59:35.798582+0000","last_clean":"2024-03-27T09:59:35.798582+0000","last_became_active":"2024-03-27T09:59:28.132360+0000","last_became_peered":"2024-03-27T09:59:28.132360+0000","last_unstale":"2024-03-27T09:59:35.798582+0000","last_undegraded":"2024-03-27T09:59:35.798582+0000","last_fullsized":"2024-03-27T09:59:35.798582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T20:35:52.312192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.600893+0000","last_change":"2024-03-27T09:59:29.147335+0000","last_active":"2024-03-27T09:59:35.600893+0000","last_peered":"2024-03-27T09:59:35.600893+0000","last_clean":"2024-03-27T09:59:35.600893+0000","last_became_active":"2024-03-27T09:59:29.147015+0000","last_became_peered":"2024-03-27T09:59:29.147015+0000","last_unstale":"2024-03-27T09:59:35.600893+0000","last_undegraded":"2024-03-27T09:59:35.600893+0000","last_fullsized":"2024-03-27T09:59:35.600893+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:12:08.142213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.599213+0000","last_change":"2024-03-27T09:59:33.703543+0000","last_active":"2024-03-27T09:59:35.599213+0000","last_peered":"2024-03-27T09:59:35.599213+0000","last_clean":"2024-03-27T09:59:35.599213+0000","last_became_active":"2024-03-27T09:59:33.702853+0000","last_became_peered":"2024-03-27T09:59:33.702853+0000","last_unstale":"2024-03-27T09:59:35.599213+0000","last_undegraded":"2024-03-27T09:59:35.599213+0000","last_fullsized":"2024-03-27T09:59:35.599213+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T20:31:50.071081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.601154+0000","last_change":"2024-03-27T09:59:28.119506+0000","last_active":"2024-03-27T09:59:35.601154+0000","last_peered":"2024-03-27T09:59:35.601154+0000","last_clean":"2024-03-27T09:59:35.601154+0000","last_became_active":"2024-03-27T09:59:28.119120+0000","last_became_peered":"2024-03-27T09:59:28.119120+0000","last_unstale":"2024-03-27T09:59:35.601154+0000","last_undegraded":"2024-03-27T09:59:35.601154+0000","last_fullsized":"2024-03-27T09:59:35.601154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:40:42.254670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.797783+0000","last_change":"2024-03-27T09:59:29.152285+0000","last_active":"2024-03-27T09:59:35.797783+0000","last_peered":"2024-03-27T09:59:35.797783+0000","last_clean":"2024-03-27T09:59:35.797783+0000","last_became_active":"2024-03-27T09:59:29.150250+0000","last_became_peered":"2024-03-27T09:59:29.150250+0000","last_unstale":"2024-03-27T09:59:35.797783+0000","last_undegraded":"2024-03-27T09:59:35.797783+0000","last_fullsized":"2024-03-27T09:59:35.797783+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:45:14.005415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.228593+0000","last_change":"2024-03-27T09:59:33.227161+0000","last_active":"2024-03-27T09:59:35.228593+0000","last_peered":"2024-03-27T09:59:35.228593+0000","last_clean":"2024-03-27T09:59:35.228593+0000","last_became_active":"2024-03-27T09:59:33.225987+0000","last_became_peered":"2024-03-27T09:59:33.225987+0000","last_unstale":"2024-03-27T09:59:35.228593+0000","last_undegraded":"2024-03-27T09:59:35.228593+0000","last_fullsized":"2024-03-27T09:59:35.228593+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T20:25:58.823076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.726381+0000","last_change":"2024-03-27T09:59:28.131417+0000","last_active":"2024-03-27T09:59:36.726381+0000","last_peered":"2024-03-27T09:59:36.726381+0000","last_clean":"2024-03-27T09:59:36.726381+0000","last_became_active":"2024-03-27T09:59:28.131134+0000","last_became_peered":"2024-03-27T09:59:28.131134+0000","last_unstale":"2024-03-27T09:59:36.726381+0000","last_undegraded":"2024-03-27T09:59:36.726381+0000","last_fullsized":"2024-03-27T09:59:36.726381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:55:33.304260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.230980+0000","last_change":"2024-03-27T09:59:29.159330+0000","last_active":"2024-03-27T09:59:35.230980+0000","last_peered":"2024-03-27T09:59:35.230980+0000","last_clean":"2024-03-27T09:59:35.230980+0000","last_became_active":"2024-03-27T09:59:29.159006+0000","last_became_peered":"2024-03-27T09:59:29.159006+0000","last_unstale":"2024-03-27T09:59:35.230980+0000","last_undegraded":"2024-03-27T09:59:35.230980+0000","last_fullsized":"2024-03-27T09:59:35.230980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:03:30.407810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.232767+0000","last_change":"2024-03-27T09:59:33.224598+0000","last_active":"2024-03-27T09:59:35.232767+0000","last_peered":"2024-03-27T09:59:35.232767+0000","last_clean":"2024-03-27T09:59:35.232767+0000","last_became_active":"2024-03-27T09:59:33.224114+0000","last_became_peered":"2024-03-27T09:59:33.224114+0000","last_unstale":"2024-03-27T09:59:35.232767+0000","last_undegraded":"2024-03-27T09:59:35.232767+0000","last_fullsized":"2024-03-27T09:59:35.232767+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:02:21.892888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.726198+0000","last_change":"2024-03-27T09:59:28.129485+0000","last_active":"2024-03-27T09:59:36.726198+0000","last_peered":"2024-03-27T09:59:36.726198+0000","last_clean":"2024-03-27T09:59:36.726198+0000","last_became_active":"2024-03-27T09:59:28.129171+0000","last_became_peered":"2024-03-27T09:59:28.129171+0000","last_unstale":"2024-03-27T09:59:36.726198+0000","last_undegraded":"2024-03-27T09:59:36.726198+0000","last_fullsized":"2024-03-27T09:59:36.726198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:31:20.500733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.231419+0000","last_change":"2024-03-27T09:59:29.161577+0000","last_active":"2024-03-27T09:59:35.231419+0000","last_peered":"2024-03-27T09:59:35.231419+0000","last_clean":"2024-03-27T09:59:35.231419+0000","last_became_active":"2024-03-27T09:59:29.161395+0000","last_became_peered":"2024-03-27T09:59:29.161395+0000","last_unstale":"2024-03-27T09:59:35.231419+0000","last_undegraded":"2024-03-27T09:59:35.231419+0000","last_fullsized":"2024-03-27T09:59:35.231419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T20:51:12.586643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.229598+0000","last_change":"2024-03-27T09:59:33.213426+0000","last_active":"2024-03-27T09:59:35.229598+0000","last_peered":"2024-03-27T09:59:35.229598+0000","last_clean":"2024-03-27T09:59:35.229598+0000","last_became_active":"2024-03-27T09:59:33.212985+0000","last_became_peered":"2024-03-27T09:59:33.212985+0000","last_unstale":"2024-03-27T09:59:35.229598+0000","last_undegraded":"2024-03-27T09:59:35.229598+0000","last_fullsized":"2024-03-27T09:59:35.229598+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:03:49.254833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.231790+0000","last_change":"2024-03-27T09:59:29.153065+0000","last_active":"2024-03-27T09:59:35.231790+0000","last_peered":"2024-03-27T09:59:35.231790+0000","last_clean":"2024-03-27T09:59:35.231790+0000","last_became_active":"2024-03-27T09:59:29.152709+0000","last_became_peered":"2024-03-27T09:59:29.152709+0000","last_unstale":"2024-03-27T09:59:35.231790+0000","last_undegraded":"2024-03-27T09:59:35.231790+0000","last_fullsized":"2024-03-27T09:59:35.231790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:57:26.770369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.726196+0000","last_change":"2024-03-27T09:59:28.132199+0000","last_active":"2024-03-27T09:59:36.726196+0000","last_peered":"2024-03-27T09:59:36.726196+0000","last_clean":"2024-03-27T09:59:36.726196+0000","last_became_active":"2024-03-27T09:59:28.131839+0000","last_became_peered":"2024-03-27T09:59:28.131839+0000","last_unstale":"2024-03-27T09:59:36.726196+0000","last_undegraded":"2024-03-27T09:59:36.726196+0000","last_fullsized":"2024-03-27T09:59:36.726196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:04:46.361989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.233050+0000","last_change":"2024-03-27T09:59:33.225488+0000","last_active":"2024-03-27T09:59:35.233050+0000","last_peered":"2024-03-27T09:59:35.233050+0000","last_clean":"2024-03-27T09:59:35.233050+0000","last_became_active":"2024-03-27T09:59:33.223781+0000","last_became_peered":"2024-03-27T09:59:33.223781+0000","last_unstale":"2024-03-27T09:59:35.233050+0000","last_undegraded":"2024-03-27T09:59:35.233050+0000","last_fullsized":"2024-03-27T09:59:35.233050+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:45:04.448005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.599916+0000","last_change":"2024-03-27T09:59:29.152084+0000","last_active":"2024-03-27T09:59:35.599916+0000","last_peered":"2024-03-27T09:59:35.599916+0000","last_clean":"2024-03-27T09:59:35.599916+0000","last_became_active":"2024-03-27T09:59:29.151816+0000","last_became_peered":"2024-03-27T09:59:29.151816+0000","last_unstale":"2024-03-27T09:59:35.599916+0000","last_undegraded":"2024-03-27T09:59:35.599916+0000","last_fullsized":"2024-03-27T09:59:35.599916+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:34:04.348561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.657754+0000","last_change":"2024-03-27T09:59:28.113836+0000","last_active":"2024-03-27T09:59:36.657754+0000","last_peered":"2024-03-27T09:59:36.657754+0000","last_clean":"2024-03-27T09:59:36.657754+0000","last_became_active":"2024-03-27T09:59:28.113517+0000","last_became_peered":"2024-03-27T09:59:28.113517+0000","last_unstale":"2024-03-27T09:59:36.657754+0000","last_undegraded":"2024-03-27T09:59:36.657754+0000","last_fullsized":"2024-03-27T09:59:36.657754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:40:42.254670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.233128+0000","last_change":"2024-03-27T09:59:33.219685+0000","last_active":"2024-03-27T09:59:35.233128+0000","last_peered":"2024-03-27T09:59:35.233128+0000","last_clean":"2024-03-27T09:59:35.233128+0000","last_became_active":"2024-03-27T09:59:33.219163+0000","last_became_peered":"2024-03-27T09:59:33.219163+0000","last_unstale":"2024-03-27T09:59:35.233128+0000","last_undegraded":"2024-03-27T09:59:35.233128+0000","last_fullsized":"2024-03-27T09:59:35.233128+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:21:56.509459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.599966+0000","last_change":"2024-03-27T09:59:29.162032+0000","last_active":"2024-03-27T09:59:35.599966+0000","last_peered":"2024-03-27T09:59:35.599966+0000","last_clean":"2024-03-27T09:59:35.599966+0000","last_became_active":"2024-03-27T09:59:29.154157+0000","last_became_peered":"2024-03-27T09:59:29.154157+0000","last_unstale":"2024-03-27T09:59:35.599966+0000","last_undegraded":"2024-03-27T09:59:35.599966+0000","last_fullsized":"2024-03-27T09:59:35.599966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:57:26.770369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.658673+0000","last_change":"2024-03-27T09:59:28.129073+0000","last_active":"2024-03-27T09:59:36.658673+0000","last_peered":"2024-03-27T09:59:36.658673+0000","last_clean":"2024-03-27T09:59:36.658673+0000","last_became_active":"2024-03-27T09:59:28.128568+0000","last_became_peered":"2024-03-27T09:59:28.128568+0000","last_unstale":"2024-03-27T09:59:36.658673+0000","last_undegraded":"2024-03-27T09:59:36.658673+0000","last_fullsized":"2024-03-27T09:59:36.658673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:13:29.201574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.660426+0000","last_change":"2024-03-27T09:59:33.708504+0000","last_active":"2024-03-27T09:59:36.660426+0000","last_peered":"2024-03-27T09:59:36.660426+0000","last_clean":"2024-03-27T09:59:36.660426+0000","last_became_active":"2024-03-27T09:59:33.703606+0000","last_became_peered":"2024-03-27T09:59:33.703606+0000","last_unstale":"2024-03-27T09:59:36.660426+0000","last_undegraded":"2024-03-27T09:59:36.660426+0000","last_fullsized":"2024-03-27T09:59:36.660426+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:06:12.744793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.230009+0000","last_change":"2024-03-27T09:59:29.136122+0000","last_active":"2024-03-27T09:59:35.230009+0000","last_peered":"2024-03-27T09:59:35.230009+0000","last_clean":"2024-03-27T09:59:35.230009+0000","last_became_active":"2024-03-27T09:59:29.134653+0000","last_became_peered":"2024-03-27T09:59:29.134653+0000","last_unstale":"2024-03-27T09:59:35.230009+0000","last_undegraded":"2024-03-27T09:59:35.230009+0000","last_fullsized":"2024-03-27T09:59:35.230009+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:23:47.064643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.726161+0000","last_change":"2024-03-27T09:59:28.130295+0000","last_active":"2024-03-27T09:59:36.726161+0000","last_peered":"2024-03-27T09:59:36.726161+0000","last_clean":"2024-03-27T09:59:36.726161+0000","last_became_active":"2024-03-27T09:59:28.129719+0000","last_became_peered":"2024-03-27T09:59:28.129719+0000","last_unstale":"2024-03-27T09:59:36.726161+0000","last_undegraded":"2024-03-27T09:59:36.726161+0000","last_fullsized":"2024-03-27T09:59:36.726161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:23:46.050666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.233646+0000","last_change":"2024-03-27T09:59:33.225859+0000","last_active":"2024-03-27T09:59:35.233646+0000","last_peered":"2024-03-27T09:59:35.233646+0000","last_clean":"2024-03-27T09:59:35.233646+0000","last_became_active":"2024-03-27T09:59:33.224011+0000","last_became_peered":"2024-03-27T09:59:33.224011+0000","last_unstale":"2024-03-27T09:59:35.233646+0000","last_undegraded":"2024-03-27T09:59:35.233646+0000","last_fullsized":"2024-03-27T09:59:35.233646+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:06:12.744793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.798261+0000","last_change":"2024-03-27T09:59:29.155479+0000","last_active":"2024-03-27T09:59:35.798261+0000","last_peered":"2024-03-27T09:59:35.798261+0000","last_clean":"2024-03-27T09:59:35.798261+0000","last_became_active":"2024-03-27T09:59:29.151680+0000","last_became_peered":"2024-03-27T09:59:29.151680+0000","last_unstale":"2024-03-27T09:59:35.798261+0000","last_undegraded":"2024-03-27T09:59:35.798261+0000","last_fullsized":"2024-03-27T09:59:35.798261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:57:26.770369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.232591+0000","last_change":"2024-03-27T09:59:28.128710+0000","last_active":"2024-03-27T09:59:35.232591+0000","last_peered":"2024-03-27T09:59:35.232591+0000","last_clean":"2024-03-27T09:59:35.232591+0000","last_became_active":"2024-03-27T09:59:28.128323+0000","last_became_peered":"2024-03-27T09:59:28.128323+0000","last_unstale":"2024-03-27T09:59:35.232591+0000","last_undegraded":"2024-03-27T09:59:35.232591+0000","last_fullsized":"2024-03-27T09:59:35.232591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:55:33.304260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.232711+0000","last_change":"2024-03-27T09:59:33.705209+0000","last_active":"2024-03-27T09:59:35.232711+0000","last_peered":"2024-03-27T09:59:35.232711+0000","last_clean":"2024-03-27T09:59:35.232711+0000","last_became_active":"2024-03-27T09:59:33.704637+0000","last_became_peered":"2024-03-27T09:59:33.704637+0000","last_unstale":"2024-03-27T09:59:35.232711+0000","last_undegraded":"2024-03-27T09:59:35.232711+0000","last_fullsized":"2024-03-27T09:59:35.232711+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:07:54.369342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.601058+0000","last_change":"2024-03-27T09:59:29.160579+0000","last_active":"2024-03-27T09:59:35.601058+0000","last_peered":"2024-03-27T09:59:35.601058+0000","last_clean":"2024-03-27T09:59:35.601058+0000","last_became_active":"2024-03-27T09:59:29.160256+0000","last_became_peered":"2024-03-27T09:59:29.160256+0000","last_unstale":"2024-03-27T09:59:35.601058+0000","last_undegraded":"2024-03-27T09:59:35.601058+0000","last_fullsized":"2024-03-27T09:59:35.601058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:00:09.092063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.657792+0000","last_change":"2024-03-27T09:59:28.113830+0000","last_active":"2024-03-27T09:59:36.657792+0000","last_peered":"2024-03-27T09:59:36.657792+0000","last_clean":"2024-03-27T09:59:36.657792+0000","last_became_active":"2024-03-27T09:59:28.112951+0000","last_became_peered":"2024-03-27T09:59:28.112951+0000","last_unstale":"2024-03-27T09:59:36.657792+0000","last_undegraded":"2024-03-27T09:59:36.657792+0000","last_fullsized":"2024-03-27T09:59:36.657792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:31:20.500733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.598982+0000","last_change":"2024-03-27T09:59:33.698681+0000","last_active":"2024-03-27T09:59:35.598982+0000","last_peered":"2024-03-27T09:59:35.598982+0000","last_clean":"2024-03-27T09:59:35.598982+0000","last_became_active":"2024-03-27T09:59:33.697706+0000","last_became_peered":"2024-03-27T09:59:33.697706+0000","last_unstale":"2024-03-27T09:59:35.598982+0000","last_undegraded":"2024-03-27T09:59:35.598982+0000","last_fullsized":"2024-03-27T09:59:35.598982+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:40:22.426786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.660127+0000","last_change":"2024-03-27T09:59:29.150475+0000","last_active":"2024-03-27T09:59:36.660127+0000","last_peered":"2024-03-27T09:59:36.660127+0000","last_clean":"2024-03-27T09:59:36.660127+0000","last_became_active":"2024-03-27T09:59:29.150150+0000","last_became_peered":"2024-03-27T09:59:29.150150+0000","last_unstale":"2024-03-27T09:59:36.660127+0000","last_undegraded":"2024-03-27T09:59:36.660127+0000","last_fullsized":"2024-03-27T09:59:36.660127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T21:36:52.561523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.726237+0000","last_change":"2024-03-27T09:59:28.131581+0000","last_active":"2024-03-27T09:59:36.726237+0000","last_peered":"2024-03-27T09:59:36.726237+0000","last_clean":"2024-03-27T09:59:36.726237+0000","last_became_active":"2024-03-27T09:59:28.131279+0000","last_became_peered":"2024-03-27T09:59:28.131279+0000","last_unstale":"2024-03-27T09:59:36.726237+0000","last_undegraded":"2024-03-27T09:59:36.726237+0000","last_fullsized":"2024-03-27T09:59:36.726237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T12:53:30.888359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.797439+0000","last_change":"2024-03-27T09:59:33.702376+0000","last_active":"2024-03-27T09:59:35.797439+0000","last_peered":"2024-03-27T09:59:35.797439+0000","last_clean":"2024-03-27T09:59:35.797439+0000","last_became_active":"2024-03-27T09:59:33.698666+0000","last_became_peered":"2024-03-27T09:59:33.698666+0000","last_unstale":"2024-03-27T09:59:35.797439+0000","last_undegraded":"2024-03-27T09:59:35.797439+0000","last_fullsized":"2024-03-27T09:59:35.797439+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:26:40.882057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.231562+0000","last_change":"2024-03-27T09:59:29.156291+0000","last_active":"2024-03-27T09:59:35.231562+0000","last_peered":"2024-03-27T09:59:35.231562+0000","last_clean":"2024-03-27T09:59:35.231562+0000","last_became_active":"2024-03-27T09:59:29.156028+0000","last_became_peered":"2024-03-27T09:59:29.156028+0000","last_unstale":"2024-03-27T09:59:35.231562+0000","last_undegraded":"2024-03-27T09:59:35.231562+0000","last_fullsized":"2024-03-27T09:59:35.231562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:03:45.164612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.657738+0000","last_change":"2024-03-27T09:59:28.115841+0000","last_active":"2024-03-27T09:59:36.657738+0000","last_peered":"2024-03-27T09:59:36.657738+0000","last_clean":"2024-03-27T09:59:36.657738+0000","last_became_active":"2024-03-27T09:59:28.115592+0000","last_became_peered":"2024-03-27T09:59:28.115592+0000","last_unstale":"2024-03-27T09:59:36.657738+0000","last_undegraded":"2024-03-27T09:59:36.657738+0000","last_fullsized":"2024-03-27T09:59:36.657738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:23:46.050666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.658425+0000","last_change":"2024-03-27T09:59:33.224089+0000","last_active":"2024-03-27T09:59:36.658425+0000","last_peered":"2024-03-27T09:59:36.658425+0000","last_clean":"2024-03-27T09:59:36.658425+0000","last_became_active":"2024-03-27T09:59:33.223558+0000","last_became_peered":"2024-03-27T09:59:33.223558+0000","last_unstale":"2024-03-27T09:59:36.658425+0000","last_undegraded":"2024-03-27T09:59:36.658425+0000","last_fullsized":"2024-03-27T09:59:36.658425+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:45:04.448005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.233512+0000","last_change":"2024-03-27T09:59:29.161017+0000","last_active":"2024-03-27T09:59:35.233512+0000","last_peered":"2024-03-27T09:59:35.233512+0000","last_clean":"2024-03-27T09:59:35.233512+0000","last_became_active":"2024-03-27T09:59:29.160567+0000","last_became_peered":"2024-03-27T09:59:29.160567+0000","last_unstale":"2024-03-27T09:59:35.233512+0000","last_undegraded":"2024-03-27T09:59:35.233512+0000","last_fullsized":"2024-03-27T09:59:35.233512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:55:34.318236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.231117+0000","last_change":"2024-03-27T09:59:28.124425+0000","last_active":"2024-03-27T09:59:35.231117+0000","last_peered":"2024-03-27T09:59:35.231117+0000","last_clean":"2024-03-27T09:59:35.231117+0000","last_became_active":"2024-03-27T09:59:28.123984+0000","last_became_peered":"2024-03-27T09:59:28.123984+0000","last_unstale":"2024-03-27T09:59:35.231117+0000","last_undegraded":"2024-03-27T09:59:35.231117+0000","last_fullsized":"2024-03-27T09:59:35.231117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:23:46.050666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.660006+0000","last_change":"2024-03-27T09:59:33.226956+0000","last_active":"2024-03-27T09:59:36.660006+0000","last_peered":"2024-03-27T09:59:36.660006+0000","last_clean":"2024-03-27T09:59:36.660006+0000","last_became_active":"2024-03-27T09:59:33.223863+0000","last_became_peered":"2024-03-27T09:59:33.223863+0000","last_unstale":"2024-03-27T09:59:36.660006+0000","last_undegraded":"2024-03-27T09:59:36.660006+0000","last_fullsized":"2024-03-27T09:59:36.660006+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:26:40.882057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.658826+0000","last_change":"2024-03-27T09:59:29.155035+0000","last_active":"2024-03-27T09:59:36.658826+0000","last_peered":"2024-03-27T09:59:36.658826+0000","last_clean":"2024-03-27T09:59:36.658826+0000","last_became_active":"2024-03-27T09:59:29.154671+0000","last_became_peered":"2024-03-27T09:59:29.154671+0000","last_unstale":"2024-03-27T09:59:36.658826+0000","last_undegraded":"2024-03-27T09:59:36.658826+0000","last_fullsized":"2024-03-27T09:59:36.658826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:45:14.005415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.791187+0000","last_change":"2024-03-27T09:59:28.121148+0000","last_active":"2024-03-27T09:59:36.791187+0000","last_peered":"2024-03-27T09:59:36.791187+0000","last_clean":"2024-03-27T09:59:36.791187+0000","last_became_active":"2024-03-27T09:59:28.120840+0000","last_became_peered":"2024-03-27T09:59:28.120840+0000","last_unstale":"2024-03-27T09:59:36.791187+0000","last_undegraded":"2024-03-27T09:59:36.791187+0000","last_fullsized":"2024-03-27T09:59:36.791187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:40:42.254670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.660494+0000","last_change":"2024-03-27T09:59:33.229618+0000","last_active":"2024-03-27T09:59:36.660494+0000","last_peered":"2024-03-27T09:59:36.660494+0000","last_clean":"2024-03-27T09:59:36.660494+0000","last_became_active":"2024-03-27T09:59:33.228741+0000","last_became_peered":"2024-03-27T09:59:33.228741+0000","last_unstale":"2024-03-27T09:59:36.660494+0000","last_undegraded":"2024-03-27T09:59:36.660494+0000","last_fullsized":"2024-03-27T09:59:36.660494+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T21:18:02.752241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.797279+0000","last_change":"2024-03-27T09:59:29.156381+0000","last_active":"2024-03-27T09:59:35.797279+0000","last_peered":"2024-03-27T09:59:35.797279+0000","last_clean":"2024-03-27T09:59:35.797279+0000","last_became_active":"2024-03-27T09:59:29.156084+0000","last_became_peered":"2024-03-27T09:59:29.156084+0000","last_unstale":"2024-03-27T09:59:35.797279+0000","last_undegraded":"2024-03-27T09:59:35.797279+0000","last_fullsized":"2024-03-27T09:59:35.797279+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:31:01.574841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.727058+0000","last_change":"2024-03-27T09:59:28.130798+0000","last_active":"2024-03-27T09:59:36.727058+0000","last_peered":"2024-03-27T09:59:36.727058+0000","last_clean":"2024-03-27T09:59:36.727058+0000","last_became_active":"2024-03-27T09:59:28.130023+0000","last_became_peered":"2024-03-27T09:59:28.130023+0000","last_unstale":"2024-03-27T09:59:36.727058+0000","last_undegraded":"2024-03-27T09:59:36.727058+0000","last_fullsized":"2024-03-27T09:59:36.727058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:20:35.358265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.798067+0000","last_change":"2024-03-27T09:59:33.708547+0000","last_active":"2024-03-27T09:59:35.798067+0000","last_peered":"2024-03-27T09:59:35.798067+0000","last_clean":"2024-03-27T09:59:35.798067+0000","last_became_active":"2024-03-27T09:59:33.707071+0000","last_became_peered":"2024-03-27T09:59:33.707071+0000","last_unstale":"2024-03-27T09:59:35.798067+0000","last_undegraded":"2024-03-27T09:59:35.798067+0000","last_fullsized":"2024-03-27T09:59:35.798067+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:58:34.321312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.599551+0000","last_change":"2024-03-27T09:59:29.149027+0000","last_active":"2024-03-27T09:59:35.599551+0000","last_peered":"2024-03-27T09:59:35.599551+0000","last_clean":"2024-03-27T09:59:35.599551+0000","last_became_active":"2024-03-27T09:59:29.148746+0000","last_became_peered":"2024-03-27T09:59:29.148746+0000","last_unstale":"2024-03-27T09:59:35.599551+0000","last_undegraded":"2024-03-27T09:59:35.599551+0000","last_fullsized":"2024-03-27T09:59:35.599551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:20:50.555376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.232120+0000","last_change":"2024-03-27T09:59:28.126435+0000","last_active":"2024-03-27T09:59:35.232120+0000","last_peered":"2024-03-27T09:59:35.232120+0000","last_clean":"2024-03-27T09:59:35.232120+0000","last_became_active":"2024-03-27T09:59:28.126154+0000","last_became_peered":"2024-03-27T09:59:28.126154+0000","last_unstale":"2024-03-27T09:59:35.232120+0000","last_undegraded":"2024-03-27T09:59:35.232120+0000","last_fullsized":"2024-03-27T09:59:35.232120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:20:35.358265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":180,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.727156+0000","last_change":"2024-03-27T09:59:19.234906+0000","last_active":"2024-03-27T09:59:36.727156+0000","last_peered":"2024-03-27T09:59:36.727156+0000","last_clean":"2024-03-27T09:59:36.727156+0000","last_became_active":"2024-03-27T09:59:19.234124+0000","last_became_peered":"2024-03-27T09:59:19.234124+0000","last_unstale":"2024-03-27T09:59:36.727156+0000","last_undegraded":"2024-03-27T09:59:36.727156+0000","last_fullsized":"2024-03-27T09:59:36.727156+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:17.974760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:17.974760+0000","last_clean_scrub_stamp":"2024-03-27T09:59:17.974760+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:24:35.357325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.230468+0000","last_change":"2024-03-27T09:59:33.707287+0000","last_active":"2024-03-27T09:59:35.230468+0000","last_peered":"2024-03-27T09:59:35.230468+0000","last_clean":"2024-03-27T09:59:35.230468+0000","last_became_active":"2024-03-27T09:59:33.706791+0000","last_became_peered":"2024-03-27T09:59:33.706791+0000","last_unstale":"2024-03-27T09:59:35.230468+0000","last_undegraded":"2024-03-27T09:59:35.230468+0000","last_fullsized":"2024-03-27T09:59:35.230468+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:03:49.254833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.728483+0000","last_change":"2024-03-27T09:59:29.150091+0000","last_active":"2024-03-27T09:59:36.728483+0000","last_peered":"2024-03-27T09:59:36.728483+0000","last_clean":"2024-03-27T09:59:36.728483+0000","last_became_active":"2024-03-27T09:59:29.149700+0000","last_became_peered":"2024-03-27T09:59:29.149700+0000","last_unstale":"2024-03-27T09:59:36.728483+0000","last_undegraded":"2024-03-27T09:59:36.728483+0000","last_fullsized":"2024-03-27T09:59:36.728483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:25:26.474648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.791238+0000","last_change":"2024-03-27T09:59:28.126811+0000","last_active":"2024-03-27T09:59:36.791238+0000","last_peered":"2024-03-27T09:59:36.791238+0000","last_clean":"2024-03-27T09:59:36.791238+0000","last_became_active":"2024-03-27T09:59:28.126359+0000","last_became_peered":"2024-03-27T09:59:28.126359+0000","last_unstale":"2024-03-27T09:59:36.791238+0000","last_undegraded":"2024-03-27T09:59:36.791238+0000","last_fullsized":"2024-03-27T09:59:36.791238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:35:50.131290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.231647+0000","last_change":"2024-03-27T09:59:33.699402+0000","last_active":"2024-03-27T09:59:35.231647+0000","last_peered":"2024-03-27T09:59:35.231647+0000","last_clean":"2024-03-27T09:59:35.231647+0000","last_became_active":"2024-03-27T09:59:33.697898+0000","last_became_peered":"2024-03-27T09:59:33.697898+0000","last_unstale":"2024-03-27T09:59:35.231647+0000","last_undegraded":"2024-03-27T09:59:35.231647+0000","last_fullsized":"2024-03-27T09:59:35.231647+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:07:54.369342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.231265+0000","last_change":"2024-03-27T09:59:29.148952+0000","last_active":"2024-03-27T09:59:35.231265+0000","last_peered":"2024-03-27T09:59:35.231265+0000","last_clean":"2024-03-27T09:59:35.231265+0000","last_became_active":"2024-03-27T09:59:29.148176+0000","last_became_peered":"2024-03-27T09:59:29.148176+0000","last_unstale":"2024-03-27T09:59:35.231265+0000","last_undegraded":"2024-03-27T09:59:35.231265+0000","last_fullsized":"2024-03-27T09:59:35.231265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T20:25:54.732855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.657787+0000","last_change":"2024-03-27T09:59:28.126237+0000","last_active":"2024-03-27T09:59:36.657787+0000","last_peered":"2024-03-27T09:59:36.657787+0000","last_clean":"2024-03-27T09:59:36.657787+0000","last_became_active":"2024-03-27T09:59:28.125955+0000","last_became_peered":"2024-03-27T09:59:28.125955+0000","last_unstale":"2024-03-27T09:59:36.657787+0000","last_undegraded":"2024-03-27T09:59:36.657787+0000","last_fullsized":"2024-03-27T09:59:36.657787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:55:33.304260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.797749+0000","last_change":"2024-03-27T09:59:33.223667+0000","last_active":"2024-03-27T09:59:35.797749+0000","last_peered":"2024-03-27T09:59:35.797749+0000","last_clean":"2024-03-27T09:59:35.797749+0000","last_became_active":"2024-03-27T09:59:33.223275+0000","last_became_peered":"2024-03-27T09:59:33.223275+0000","last_unstale":"2024-03-27T09:59:35.797749+0000","last_undegraded":"2024-03-27T09:59:35.797749+0000","last_fullsized":"2024-03-27T09:59:35.797749+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T21:18:02.752241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.729264+0000","last_change":"2024-03-27T09:59:29.159775+0000","last_active":"2024-03-27T09:59:36.729264+0000","last_peered":"2024-03-27T09:59:36.729264+0000","last_clean":"2024-03-27T09:59:36.729264+0000","last_became_active":"2024-03-27T09:59:29.159484+0000","last_became_peered":"2024-03-27T09:59:29.159484+0000","last_unstale":"2024-03-27T09:59:36.729264+0000","last_undegraded":"2024-03-27T09:59:36.729264+0000","last_fullsized":"2024-03-27T09:59:36.729264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:03:45.164612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.791343+0000","last_change":"2024-03-27T09:59:28.121073+0000","last_active":"2024-03-27T09:59:36.791343+0000","last_peered":"2024-03-27T09:59:36.791343+0000","last_clean":"2024-03-27T09:59:36.791343+0000","last_became_active":"2024-03-27T09:59:28.120712+0000","last_became_peered":"2024-03-27T09:59:28.120712+0000","last_unstale":"2024-03-27T09:59:36.791343+0000","last_undegraded":"2024-03-27T09:59:36.791343+0000","last_fullsized":"2024-03-27T09:59:36.791343+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:13:29.201574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.230245+0000","last_change":"2024-03-27T09:59:33.707551+0000","last_active":"2024-03-27T09:59:35.230245+0000","last_peered":"2024-03-27T09:59:35.230245+0000","last_clean":"2024-03-27T09:59:35.230245+0000","last_became_active":"2024-03-27T09:59:33.702666+0000","last_became_peered":"2024-03-27T09:59:33.702666+0000","last_unstale":"2024-03-27T09:59:35.230245+0000","last_undegraded":"2024-03-27T09:59:35.230245+0000","last_fullsized":"2024-03-27T09:59:35.230245+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T21:18:02.752241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.728829+0000","last_change":"2024-03-27T09:59:29.165375+0000","last_active":"2024-03-27T09:59:36.728829+0000","last_peered":"2024-03-27T09:59:36.728829+0000","last_clean":"2024-03-27T09:59:36.728829+0000","last_became_active":"2024-03-27T09:59:29.164965+0000","last_became_peered":"2024-03-27T09:59:29.164965+0000","last_unstale":"2024-03-27T09:59:36.728829+0000","last_undegraded":"2024-03-27T09:59:36.728829+0000","last_fullsized":"2024-03-27T09:59:36.728829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:07:50.279121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.233583+0000","last_change":"2024-03-27T09:59:28.126548+0000","last_active":"2024-03-27T09:59:35.233583+0000","last_peered":"2024-03-27T09:59:35.233583+0000","last_clean":"2024-03-27T09:59:35.233583+0000","last_became_active":"2024-03-27T09:59:28.125963+0000","last_became_peered":"2024-03-27T09:59:28.125963+0000","last_unstale":"2024-03-27T09:59:35.233583+0000","last_undegraded":"2024-03-27T09:59:35.233583+0000","last_fullsized":"2024-03-27T09:59:35.233583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:59:55.319685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.228379+0000","last_change":"2024-03-27T09:59:33.220384+0000","last_active":"2024-03-27T09:59:35.228379+0000","last_peered":"2024-03-27T09:59:35.228379+0000","last_clean":"2024-03-27T09:59:35.228379+0000","last_became_active":"2024-03-27T09:59:33.219238+0000","last_became_peered":"2024-03-27T09:59:33.219238+0000","last_unstale":"2024-03-27T09:59:35.228379+0000","last_undegraded":"2024-03-27T09:59:35.228379+0000","last_fullsized":"2024-03-27T09:59:35.228379+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:03:34.498032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.727816+0000","last_change":"2024-03-27T09:59:29.159404+0000","last_active":"2024-03-27T09:59:36.727816+0000","last_peered":"2024-03-27T09:59:36.727816+0000","last_clean":"2024-03-27T09:59:36.727816+0000","last_became_active":"2024-03-27T09:59:29.159116+0000","last_became_peered":"2024-03-27T09:59:29.159116+0000","last_unstale":"2024-03-27T09:59:36.727816+0000","last_undegraded":"2024-03-27T09:59:36.727816+0000","last_fullsized":"2024-03-27T09:59:36.727816+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T20:51:12.586643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.791612+0000","last_change":"2024-03-27T09:59:28.130732+0000","last_active":"2024-03-27T09:59:36.791612+0000","last_peered":"2024-03-27T09:59:36.791612+0000","last_clean":"2024-03-27T09:59:36.791612+0000","last_became_active":"2024-03-27T09:59:28.128808+0000","last_became_peered":"2024-03-27T09:59:28.128808+0000","last_unstale":"2024-03-27T09:59:36.791612+0000","last_undegraded":"2024-03-27T09:59:36.791612+0000","last_fullsized":"2024-03-27T09:59:36.791612+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:23:46.050666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.798116+0000","last_change":"2024-03-27T09:59:33.208864+0000","last_active":"2024-03-27T09:59:35.798116+0000","last_peered":"2024-03-27T09:59:35.798116+0000","last_clean":"2024-03-27T09:59:35.798116+0000","last_became_active":"2024-03-27T09:59:33.208354+0000","last_became_peered":"2024-03-27T09:59:33.208354+0000","last_unstale":"2024-03-27T09:59:35.798116+0000","last_undegraded":"2024-03-27T09:59:35.798116+0000","last_fullsized":"2024-03-27T09:59:35.798116+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T20:00:16.571694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.229822+0000","last_change":"2024-03-27T09:59:29.158524+0000","last_active":"2024-03-27T09:59:35.229822+0000","last_peered":"2024-03-27T09:59:35.229822+0000","last_clean":"2024-03-27T09:59:35.229822+0000","last_became_active":"2024-03-27T09:59:29.157925+0000","last_became_peered":"2024-03-27T09:59:29.157925+0000","last_unstale":"2024-03-27T09:59:35.229822+0000","last_undegraded":"2024-03-27T09:59:35.229822+0000","last_fullsized":"2024-03-27T09:59:35.229822+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:53:03.077046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.231047+0000","last_change":"2024-03-27T09:59:28.115802+0000","last_active":"2024-03-27T09:59:35.231047+0000","last_peered":"2024-03-27T09:59:35.231047+0000","last_clean":"2024-03-27T09:59:35.231047+0000","last_became_active":"2024-03-27T09:59:28.115435+0000","last_became_peered":"2024-03-27T09:59:28.115435+0000","last_unstale":"2024-03-27T09:59:35.231047+0000","last_undegraded":"2024-03-27T09:59:35.231047+0000","last_fullsized":"2024-03-27T09:59:35.231047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:40:42.254670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.600958+0000","last_change":"2024-03-27T09:59:33.706037+0000","last_active":"2024-03-27T09:59:35.600958+0000","last_peered":"2024-03-27T09:59:35.600958+0000","last_clean":"2024-03-27T09:59:35.600958+0000","last_became_active":"2024-03-27T09:59:33.705650+0000","last_became_peered":"2024-03-27T09:59:33.705650+0000","last_unstale":"2024-03-27T09:59:35.600958+0000","last_undegraded":"2024-03-27T09:59:35.600958+0000","last_fullsized":"2024-03-27T09:59:35.600958+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:02:05.101162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.728065+0000","last_change":"2024-03-27T09:59:29.160438+0000","last_active":"2024-03-27T09:59:36.728065+0000","last_peered":"2024-03-27T09:59:36.728065+0000","last_clean":"2024-03-27T09:59:36.728065+0000","last_became_active":"2024-03-27T09:59:29.160087+0000","last_became_peered":"2024-03-27T09:59:29.160087+0000","last_unstale":"2024-03-27T09:59:36.728065+0000","last_undegraded":"2024-03-27T09:59:36.728065+0000","last_fullsized":"2024-03-27T09:59:36.728065+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:00:09.092063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.231089+0000","last_change":"2024-03-27T09:59:28.118112+0000","last_active":"2024-03-27T09:59:35.231089+0000","last_peered":"2024-03-27T09:59:35.231089+0000","last_clean":"2024-03-27T09:59:35.231089+0000","last_became_active":"2024-03-27T09:59:28.117828+0000","last_became_peered":"2024-03-27T09:59:28.117828+0000","last_unstale":"2024-03-27T09:59:35.231089+0000","last_undegraded":"2024-03-27T09:59:35.231089+0000","last_fullsized":"2024-03-27T09:59:35.231089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:13:29.201574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.599830+0000","last_change":"2024-03-27T09:59:33.700858+0000","last_active":"2024-03-27T09:59:35.599830+0000","last_peered":"2024-03-27T09:59:35.599830+0000","last_clean":"2024-03-27T09:59:35.599830+0000","last_became_active":"2024-03-27T09:59:33.700373+0000","last_became_peered":"2024-03-27T09:59:33.700373+0000","last_unstale":"2024-03-27T09:59:35.599830+0000","last_undegraded":"2024-03-27T09:59:35.599830+0000","last_fullsized":"2024-03-27T09:59:35.599830+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:25:25.072673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.798196+0000","last_change":"2024-03-27T09:59:29.169989+0000","last_active":"2024-03-27T09:59:35.798196+0000","last_peered":"2024-03-27T09:59:35.798196+0000","last_clean":"2024-03-27T09:59:35.798196+0000","last_became_active":"2024-03-27T09:59:29.169681+0000","last_became_peered":"2024-03-27T09:59:29.169681+0000","last_unstale":"2024-03-27T09:59:35.798196+0000","last_undegraded":"2024-03-27T09:59:35.798196+0000","last_fullsized":"2024-03-27T09:59:35.798196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:16:28.449509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.798374+0000","last_change":"2024-03-27T09:59:28.129054+0000","last_active":"2024-03-27T09:59:35.798374+0000","last_peered":"2024-03-27T09:59:35.798374+0000","last_clean":"2024-03-27T09:59:35.798374+0000","last_became_active":"2024-03-27T09:59:28.128808+0000","last_became_peered":"2024-03-27T09:59:28.128808+0000","last_unstale":"2024-03-27T09:59:35.798374+0000","last_undegraded":"2024-03-27T09:59:35.798374+0000","last_fullsized":"2024-03-27T09:59:35.798374+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:03:46.932809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.232702+0000","last_change":"2024-03-27T09:59:33.703875+0000","last_active":"2024-03-27T09:59:35.232702+0000","last_peered":"2024-03-27T09:59:35.232702+0000","last_clean":"2024-03-27T09:59:35.232702+0000","last_became_active":"2024-03-27T09:59:33.702585+0000","last_became_peered":"2024-03-27T09:59:33.702585+0000","last_unstale":"2024-03-27T09:59:35.232702+0000","last_undegraded":"2024-03-27T09:59:35.232702+0000","last_fullsized":"2024-03-27T09:59:35.232702+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:58:34.321312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.728323+0000","last_change":"2024-03-27T09:59:29.158099+0000","last_active":"2024-03-27T09:59:36.728323+0000","last_peered":"2024-03-27T09:59:36.728323+0000","last_clean":"2024-03-27T09:59:36.728323+0000","last_became_active":"2024-03-27T09:59:29.157758+0000","last_became_peered":"2024-03-27T09:59:29.157758+0000","last_unstale":"2024-03-27T09:59:36.728323+0000","last_undegraded":"2024-03-27T09:59:36.728323+0000","last_fullsized":"2024-03-27T09:59:36.728323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:01:42.254664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'10","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:47.450737+0000","last_change":"2024-03-27T09:59:28.113383+0000","last_active":"2024-03-27T09:59:47.450737+0000","last_peered":"2024-03-27T09:59:47.450737+0000","last_clean":"2024-03-27T09:59:47.450737+0000","last_became_active":"2024-03-27T09:59:28.113082+0000","last_became_peered":"2024-03-27T09:59:28.113082+0000","last_unstale":"2024-03-27T09:59:47.450737+0000","last_undegraded":"2024-03-27T09:59:47.450737+0000","last_fullsized":"2024-03-27T09:59:47.450737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:13:29.201574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.659224+0000","last_change":"2024-03-27T09:59:33.216434+0000","last_active":"2024-03-27T09:59:36.659224+0000","last_peered":"2024-03-27T09:59:36.659224+0000","last_clean":"2024-03-27T09:59:36.659224+0000","last_became_active":"2024-03-27T09:59:33.215962+0000","last_became_peered":"2024-03-27T09:59:33.215962+0000","last_unstale":"2024-03-27T09:59:36.659224+0000","last_undegraded":"2024-03-27T09:59:36.659224+0000","last_fullsized":"2024-03-27T09:59:36.659224+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:21:56.509459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.233348+0000","last_change":"2024-03-27T09:59:29.148504+0000","last_active":"2024-03-27T09:59:35.233348+0000","last_peered":"2024-03-27T09:59:35.233348+0000","last_clean":"2024-03-27T09:59:35.233348+0000","last_became_active":"2024-03-27T09:59:29.148235+0000","last_became_peered":"2024-03-27T09:59:29.148235+0000","last_unstale":"2024-03-27T09:59:35.233348+0000","last_undegraded":"2024-03-27T09:59:35.233348+0000","last_fullsized":"2024-03-27T09:59:35.233348+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T12:53:31.902336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.657788+0000","last_change":"2024-03-27T09:59:28.119784+0000","last_active":"2024-03-27T09:59:36.657788+0000","last_peered":"2024-03-27T09:59:36.657788+0000","last_clean":"2024-03-27T09:59:36.657788+0000","last_became_active":"2024-03-27T09:59:28.119487+0000","last_became_peered":"2024-03-27T09:59:28.119487+0000","last_unstale":"2024-03-27T09:59:36.657788+0000","last_undegraded":"2024-03-27T09:59:36.657788+0000","last_fullsized":"2024-03-27T09:59:36.657788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:20:35.358265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.233153+0000","last_change":"2024-03-27T09:59:33.225724+0000","last_active":"2024-03-27T09:59:35.233153+0000","last_peered":"2024-03-27T09:59:35.233153+0000","last_clean":"2024-03-27T09:59:35.233153+0000","last_became_active":"2024-03-27T09:59:33.224979+0000","last_became_peered":"2024-03-27T09:59:33.224979+0000","last_unstale":"2024-03-27T09:59:35.233153+0000","last_undegraded":"2024-03-27T09:59:35.233153+0000","last_fullsized":"2024-03-27T09:59:35.233153+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:26:40.882057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.798367+0000","last_change":"2024-03-27T09:59:29.154101+0000","last_active":"2024-03-27T09:59:35.798367+0000","last_peered":"2024-03-27T09:59:35.798367+0000","last_clean":"2024-03-27T09:59:35.798367+0000","last_became_active":"2024-03-27T09:59:29.152850+0000","last_became_peered":"2024-03-27T09:59:29.152850+0000","last_unstale":"2024-03-27T09:59:35.798367+0000","last_undegraded":"2024-03-27T09:59:35.798367+0000","last_fullsized":"2024-03-27T09:59:35.798367+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T20:48:05.564784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.231860+0000","last_change":"2024-03-27T09:59:28.114582+0000","last_active":"2024-03-27T09:59:35.231860+0000","last_peered":"2024-03-27T09:59:35.231860+0000","last_clean":"2024-03-27T09:59:35.231860+0000","last_became_active":"2024-03-27T09:59:28.114287+0000","last_became_peered":"2024-03-27T09:59:28.114287+0000","last_unstale":"2024-03-27T09:59:35.231860+0000","last_undegraded":"2024-03-27T09:59:35.231860+0000","last_fullsized":"2024-03-27T09:59:35.231860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:55:33.304260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.599079+0000","last_change":"2024-03-27T09:59:33.225015+0000","last_active":"2024-03-27T09:59:35.599079+0000","last_peered":"2024-03-27T09:59:35.599079+0000","last_clean":"2024-03-27T09:59:35.599079+0000","last_became_active":"2024-03-27T09:59:33.224660+0000","last_became_peered":"2024-03-27T09:59:33.224660+0000","last_unstale":"2024-03-27T09:59:35.599079+0000","last_undegraded":"2024-03-27T09:59:35.599079+0000","last_fullsized":"2024-03-27T09:59:35.599079+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:22:38.863947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.231769+0000","last_change":"2024-03-27T09:59:29.168539+0000","last_active":"2024-03-27T09:59:35.231769+0000","last_peered":"2024-03-27T09:59:35.231769+0000","last_clean":"2024-03-27T09:59:35.231769+0000","last_became_active":"2024-03-27T09:59:29.168233+0000","last_became_peered":"2024-03-27T09:59:29.168233+0000","last_unstale":"2024-03-27T09:59:35.231769+0000","last_undegraded":"2024-03-27T09:59:35.231769+0000","last_fullsized":"2024-03-27T09:59:35.231769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:25:26.474648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.232327+0000","last_change":"2024-03-27T09:59:28.118980+0000","last_active":"2024-03-27T09:59:35.232327+0000","last_peered":"2024-03-27T09:59:35.232327+0000","last_clean":"2024-03-27T09:59:35.232327+0000","last_became_active":"2024-03-27T09:59:28.118617+0000","last_became_peered":"2024-03-27T09:59:28.118617+0000","last_unstale":"2024-03-27T09:59:35.232327+0000","last_undegraded":"2024-03-27T09:59:35.232327+0000","last_fullsized":"2024-03-27T09:59:35.232327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:20:35.358265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.599375+0000","last_change":"2024-03-27T09:59:33.703257+0000","last_active":"2024-03-27T09:59:35.599375+0000","last_peered":"2024-03-27T09:59:35.599375+0000","last_clean":"2024-03-27T09:59:35.599375+0000","last_became_active":"2024-03-27T09:59:33.702264+0000","last_became_peered":"2024-03-27T09:59:33.702264+0000","last_unstale":"2024-03-27T09:59:35.599375+0000","last_undegraded":"2024-03-27T09:59:35.599375+0000","last_fullsized":"2024-03-27T09:59:35.599375+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:04:06.406267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.797590+0000","last_change":"2024-03-27T09:59:33.707371+0000","last_active":"2024-03-27T09:59:35.797590+0000","last_peered":"2024-03-27T09:59:35.797590+0000","last_clean":"2024-03-27T09:59:35.797590+0000","last_became_active":"2024-03-27T09:59:33.706609+0000","last_became_peered":"2024-03-27T09:59:33.706609+0000","last_unstale":"2024-03-27T09:59:35.797590+0000","last_undegraded":"2024-03-27T09:59:35.797590+0000","last_fullsized":"2024-03-27T09:59:35.797590+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:06:12.744793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.658398+0000","last_change":"2024-03-27T09:59:29.150732+0000","last_active":"2024-03-27T09:59:36.658398+0000","last_peered":"2024-03-27T09:59:36.658398+0000","last_clean":"2024-03-27T09:59:36.658398+0000","last_became_active":"2024-03-27T09:59:29.147814+0000","last_became_peered":"2024-03-27T09:59:29.147814+0000","last_unstale":"2024-03-27T09:59:36.658398+0000","last_undegraded":"2024-03-27T09:59:36.658398+0000","last_fullsized":"2024-03-27T09:59:36.658398+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:40:55.546423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.230076+0000","last_change":"2024-03-27T09:59:28.121927+0000","last_active":"2024-03-27T09:59:35.230076+0000","last_peered":"2024-03-27T09:59:35.230076+0000","last_clean":"2024-03-27T09:59:35.230076+0000","last_became_active":"2024-03-27T09:59:28.121549+0000","last_became_peered":"2024-03-27T09:59:28.121549+0000","last_unstale":"2024-03-27T09:59:35.230076+0000","last_undegraded":"2024-03-27T09:59:35.230076+0000","last_fullsized":"2024-03-27T09:59:35.230076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:40:42.254670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.232144+0000","last_change":"2024-03-27T09:59:33.224491+0000","last_active":"2024-03-27T09:59:35.232144+0000","last_peered":"2024-03-27T09:59:35.232144+0000","last_clean":"2024-03-27T09:59:35.232144+0000","last_became_active":"2024-03-27T09:59:33.223841+0000","last_became_peered":"2024-03-27T09:59:33.223841+0000","last_unstale":"2024-03-27T09:59:35.232144+0000","last_undegraded":"2024-03-27T09:59:35.232144+0000","last_fullsized":"2024-03-27T09:59:35.232144+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:02:21.892888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.599193+0000","last_change":"2024-03-27T09:59:29.161642+0000","last_active":"2024-03-27T09:59:35.599193+0000","last_peered":"2024-03-27T09:59:35.599193+0000","last_clean":"2024-03-27T09:59:35.599193+0000","last_became_active":"2024-03-27T09:59:29.155700+0000","last_became_peered":"2024-03-27T09:59:29.155700+0000","last_unstale":"2024-03-27T09:59:35.599193+0000","last_undegraded":"2024-03-27T09:59:35.599193+0000","last_fullsized":"2024-03-27T09:59:35.599193+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T21:36:52.561523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.599835+0000","last_change":"2024-03-27T09:59:28.111747+0000","last_active":"2024-03-27T09:59:35.599835+0000","last_peered":"2024-03-27T09:59:35.599835+0000","last_clean":"2024-03-27T09:59:35.599835+0000","last_became_active":"2024-03-27T09:59:28.111334+0000","last_became_peered":"2024-03-27T09:59:28.111334+0000","last_unstale":"2024-03-27T09:59:35.599835+0000","last_undegraded":"2024-03-27T09:59:35.599835+0000","last_fullsized":"2024-03-27T09:59:35.599835+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:35:50.131290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.232266+0000","last_change":"2024-03-27T09:59:28.115303+0000","last_active":"2024-03-27T09:59:35.232266+0000","last_peered":"2024-03-27T09:59:35.232266+0000","last_clean":"2024-03-27T09:59:35.232266+0000","last_became_active":"2024-03-27T09:59:28.113900+0000","last_became_peered":"2024-03-27T09:59:28.113900+0000","last_unstale":"2024-03-27T09:59:35.232266+0000","last_undegraded":"2024-03-27T09:59:35.232266+0000","last_fullsized":"2024-03-27T09:59:35.232266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:23:46.050666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.797870+0000","last_change":"2024-03-27T09:59:29.157943+0000","last_active":"2024-03-27T09:59:35.797870+0000","last_peered":"2024-03-27T09:59:35.797870+0000","last_clean":"2024-03-27T09:59:35.797870+0000","last_became_active":"2024-03-27T09:59:29.157663+0000","last_became_peered":"2024-03-27T09:59:29.157663+0000","last_unstale":"2024-03-27T09:59:35.797870+0000","last_undegraded":"2024-03-27T09:59:35.797870+0000","last_fullsized":"2024-03-27T09:59:35.797870+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:20:50.555376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.792577+0000","last_change":"2024-03-27T09:59:33.219540+0000","last_active":"2024-03-27T09:59:36.792577+0000","last_peered":"2024-03-27T09:59:36.792577+0000","last_clean":"2024-03-27T09:59:36.792577+0000","last_became_active":"2024-03-27T09:59:33.219085+0000","last_became_peered":"2024-03-27T09:59:33.219085+0000","last_unstale":"2024-03-27T09:59:36.792577+0000","last_undegraded":"2024-03-27T09:59:36.792577+0000","last_fullsized":"2024-03-27T09:59:36.792577+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:16:32.539730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.600218+0000","last_change":"2024-03-27T09:59:28.113237+0000","last_active":"2024-03-27T09:59:35.600218+0000","last_peered":"2024-03-27T09:59:35.600218+0000","last_clean":"2024-03-27T09:59:35.600218+0000","last_became_active":"2024-03-27T09:59:28.112995+0000","last_became_peered":"2024-03-27T09:59:28.112995+0000","last_unstale":"2024-03-27T09:59:35.600218+0000","last_undegraded":"2024-03-27T09:59:35.600218+0000","last_fullsized":"2024-03-27T09:59:35.600218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:03:46.932809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.229942+0000","last_change":"2024-03-27T09:59:29.142949+0000","last_active":"2024-03-27T09:59:35.229942+0000","last_peered":"2024-03-27T09:59:35.229942+0000","last_clean":"2024-03-27T09:59:35.229942+0000","last_became_active":"2024-03-27T09:59:29.142626+0000","last_became_peered":"2024-03-27T09:59:29.142626+0000","last_unstale":"2024-03-27T09:59:35.229942+0000","last_undegraded":"2024-03-27T09:59:35.229942+0000","last_fullsized":"2024-03-27T09:59:35.229942+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:20:36.372242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.600394+0000","last_change":"2024-03-27T09:59:33.226673+0000","last_active":"2024-03-27T09:59:35.600394+0000","last_peered":"2024-03-27T09:59:35.600394+0000","last_clean":"2024-03-27T09:59:35.600394+0000","last_became_active":"2024-03-27T09:59:33.226185+0000","last_became_peered":"2024-03-27T09:59:33.226185+0000","last_unstale":"2024-03-27T09:59:35.600394+0000","last_undegraded":"2024-03-27T09:59:35.600394+0000","last_fullsized":"2024-03-27T09:59:35.600394+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:17:46.912834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.229527+0000","last_change":"2024-03-27T09:59:29.159064+0000","last_active":"2024-03-27T09:59:35.229527+0000","last_peered":"2024-03-27T09:59:35.229527+0000","last_clean":"2024-03-27T09:59:35.229527+0000","last_became_active":"2024-03-27T09:59:29.158263+0000","last_became_peered":"2024-03-27T09:59:29.158263+0000","last_unstale":"2024-03-27T09:59:35.229527+0000","last_undegraded":"2024-03-27T09:59:35.229527+0000","last_fullsized":"2024-03-27T09:59:35.229527+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T21:36:52.561523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.791954+0000","last_change":"2024-03-27T09:59:29.148971+0000","last_active":"2024-03-27T09:59:36.791954+0000","last_peered":"2024-03-27T09:59:36.791954+0000","last_clean":"2024-03-27T09:59:36.791954+0000","last_became_active":"2024-03-27T09:59:29.148701+0000","last_became_peered":"2024-03-27T09:59:29.148701+0000","last_unstale":"2024-03-27T09:59:36.791954+0000","last_undegraded":"2024-03-27T09:59:36.791954+0000","last_fullsized":"2024-03-27T09:59:36.791954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T12:53:31.902336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.230981+0000","last_change":"2024-03-27T09:59:29.145218+0000","last_active":"2024-03-27T09:59:35.230981+0000","last_peered":"2024-03-27T09:59:35.230981+0000","last_clean":"2024-03-27T09:59:35.230981+0000","last_became_active":"2024-03-27T09:59:29.144927+0000","last_became_peered":"2024-03-27T09:59:29.144927+0000","last_unstale":"2024-03-27T09:59:35.230981+0000","last_undegraded":"2024-03-27T09:59:35.230981+0000","last_fullsized":"2024-03-27T09:59:35.230981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:12:08.142213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.797876+0000","last_change":"2024-03-27T09:59:29.155091+0000","last_active":"2024-03-27T09:59:35.797876+0000","last_peered":"2024-03-27T09:59:35.797876+0000","last_clean":"2024-03-27T09:59:35.797876+0000","last_became_active":"2024-03-27T09:59:29.153115+0000","last_became_peered":"2024-03-27T09:59:29.153115+0000","last_unstale":"2024-03-27T09:59:35.797876+0000","last_undegraded":"2024-03-27T09:59:35.797876+0000","last_fullsized":"2024-03-27T09:59:35.797876+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:40:55.546423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.600252+0000","last_change":"2024-03-27T09:59:29.139530+0000","last_active":"2024-03-27T09:59:35.600252+0000","last_peered":"2024-03-27T09:59:35.600252+0000","last_clean":"2024-03-27T09:59:35.600252+0000","last_became_active":"2024-03-27T09:59:29.135340+0000","last_became_peered":"2024-03-27T09:59:29.135340+0000","last_unstale":"2024-03-27T09:59:35.600252+0000","last_undegraded":"2024-03-27T09:59:35.600252+0000","last_fullsized":"2024-03-27T09:59:35.600252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T20:48:05.564784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.659487+0000","last_change":"2024-03-27T09:59:29.160480+0000","last_active":"2024-03-27T09:59:36.659487+0000","last_peered":"2024-03-27T09:59:36.659487+0000","last_clean":"2024-03-27T09:59:36.659487+0000","last_became_active":"2024-03-27T09:59:29.153116+0000","last_became_peered":"2024-03-27T09:59:29.153116+0000","last_unstale":"2024-03-27T09:59:36.659487+0000","last_undegraded":"2024-03-27T09:59:36.659487+0000","last_fullsized":"2024-03-27T09:59:36.659487+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:57:26.770369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.234256+0000","last_change":"2024-03-27T09:59:29.165741+0000","last_active":"2024-03-27T09:59:35.234256+0000","last_peered":"2024-03-27T09:59:35.234256+0000","last_clean":"2024-03-27T09:59:35.234256+0000","last_became_active":"2024-03-27T09:59:29.165448+0000","last_became_peered":"2024-03-27T09:59:29.165448+0000","last_unstale":"2024-03-27T09:59:35.234256+0000","last_undegraded":"2024-03-27T09:59:35.234256+0000","last_fullsized":"2024-03-27T09:59:35.234256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T20:48:05.564784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.601055+0000","last_change":"2024-03-27T09:59:29.128048+0000","last_active":"2024-03-27T09:59:35.601055+0000","last_peered":"2024-03-27T09:59:35.601055+0000","last_clean":"2024-03-27T09:59:35.601055+0000","last_became_active":"2024-03-27T09:59:29.127194+0000","last_became_peered":"2024-03-27T09:59:29.127194+0000","last_unstale":"2024-03-27T09:59:35.601055+0000","last_undegraded":"2024-03-27T09:59:35.601055+0000","last_fullsized":"2024-03-27T09:59:35.601055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T20:51:12.586643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.229823+0000","last_change":"2024-03-27T09:59:29.149715+0000","last_active":"2024-03-27T09:59:35.229823+0000","last_peered":"2024-03-27T09:59:35.229823+0000","last_clean":"2024-03-27T09:59:35.229823+0000","last_became_active":"2024-03-27T09:59:29.147816+0000","last_became_peered":"2024-03-27T09:59:29.147816+0000","last_unstale":"2024-03-27T09:59:35.229823+0000","last_undegraded":"2024-03-27T09:59:35.229823+0000","last_fullsized":"2024-03-27T09:59:35.229823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T20:48:05.564784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.599722+0000","last_change":"2024-03-27T09:59:29.127532+0000","last_active":"2024-03-27T09:59:35.599722+0000","last_peered":"2024-03-27T09:59:35.599722+0000","last_clean":"2024-03-27T09:59:35.599722+0000","last_became_active":"2024-03-27T09:59:29.126384+0000","last_became_peered":"2024-03-27T09:59:29.126384+0000","last_unstale":"2024-03-27T09:59:35.599722+0000","last_undegraded":"2024-03-27T09:59:35.599722+0000","last_fullsized":"2024-03-27T09:59:35.599722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:40:55.546423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.230828+0000","last_change":"2024-03-27T09:59:29.168460+0000","last_active":"2024-03-27T09:59:35.230828+0000","last_peered":"2024-03-27T09:59:35.230828+0000","last_clean":"2024-03-27T09:59:35.230828+0000","last_became_active":"2024-03-27T09:59:29.168082+0000","last_became_peered":"2024-03-27T09:59:29.168082+0000","last_unstale":"2024-03-27T09:59:35.230828+0000","last_undegraded":"2024-03-27T09:59:35.230828+0000","last_fullsized":"2024-03-27T09:59:35.230828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:00:09.092063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.797561+0000","last_change":"2024-03-27T09:59:29.169976+0000","last_active":"2024-03-27T09:59:35.797561+0000","last_peered":"2024-03-27T09:59:35.797561+0000","last_clean":"2024-03-27T09:59:35.797561+0000","last_became_active":"2024-03-27T09:59:29.169553+0000","last_became_peered":"2024-03-27T09:59:29.169553+0000","last_unstale":"2024-03-27T09:59:35.797561+0000","last_undegraded":"2024-03-27T09:59:35.797561+0000","last_fullsized":"2024-03-27T09:59:35.797561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T21:36:52.561523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.232376+0000","last_change":"2024-03-27T09:59:29.151159+0000","last_active":"2024-03-27T09:59:35.232376+0000","last_peered":"2024-03-27T09:59:35.232376+0000","last_clean":"2024-03-27T09:59:35.232376+0000","last_became_active":"2024-03-27T09:59:29.150521+0000","last_became_peered":"2024-03-27T09:59:29.150521+0000","last_unstale":"2024-03-27T09:59:35.232376+0000","last_undegraded":"2024-03-27T09:59:35.232376+0000","last_fullsized":"2024-03-27T09:59:35.232376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:20:50.555376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.728796+0000","last_change":"2024-03-27T09:59:29.159754+0000","last_active":"2024-03-27T09:59:36.728796+0000","last_peered":"2024-03-27T09:59:36.728796+0000","last_clean":"2024-03-27T09:59:36.728796+0000","last_became_active":"2024-03-27T09:59:29.159451+0000","last_became_peered":"2024-03-27T09:59:29.159451+0000","last_unstale":"2024-03-27T09:59:36.728796+0000","last_undegraded":"2024-03-27T09:59:36.728796+0000","last_fullsized":"2024-03-27T09:59:36.728796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:27:19.913918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.793121+0000","last_change":"2024-03-27T09:59:29.146745+0000","last_active":"2024-03-27T09:59:36.793121+0000","last_peered":"2024-03-27T09:59:36.793121+0000","last_clean":"2024-03-27T09:59:36.793121+0000","last_became_active":"2024-03-27T09:59:29.146399+0000","last_became_peered":"2024-03-27T09:59:29.146399+0000","last_unstale":"2024-03-27T09:59:36.793121+0000","last_undegraded":"2024-03-27T09:59:36.793121+0000","last_fullsized":"2024-03-27T09:59:36.793121+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:31:21.514709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.232127+0000","last_change":"2024-03-27T09:59:29.170756+0000","last_active":"2024-03-27T09:59:35.232127+0000","last_peered":"2024-03-27T09:59:35.232127+0000","last_clean":"2024-03-27T09:59:35.232127+0000","last_became_active":"2024-03-27T09:59:29.170483+0000","last_became_peered":"2024-03-27T09:59:29.170483+0000","last_unstale":"2024-03-27T09:59:35.232127+0000","last_undegraded":"2024-03-27T09:59:35.232127+0000","last_fullsized":"2024-03-27T09:59:35.232127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:01:42.254664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.229573+0000","last_change":"2024-03-27T09:59:29.156761+0000","last_active":"2024-03-27T09:59:35.229573+0000","last_peered":"2024-03-27T09:59:35.229573+0000","last_clean":"2024-03-27T09:59:35.229573+0000","last_became_active":"2024-03-27T09:59:29.156448+0000","last_became_peered":"2024-03-27T09:59:29.156448+0000","last_unstale":"2024-03-27T09:59:35.229573+0000","last_undegraded":"2024-03-27T09:59:35.229573+0000","last_fullsized":"2024-03-27T09:59:35.229573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:45:14.005415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.658573+0000","last_change":"2024-03-27T09:59:29.159241+0000","last_active":"2024-03-27T09:59:36.658573+0000","last_peered":"2024-03-27T09:59:36.658573+0000","last_clean":"2024-03-27T09:59:36.658573+0000","last_became_active":"2024-03-27T09:59:29.158935+0000","last_became_peered":"2024-03-27T09:59:29.158935+0000","last_unstale":"2024-03-27T09:59:36.658573+0000","last_undegraded":"2024-03-27T09:59:36.658573+0000","last_fullsized":"2024-03-27T09:59:36.658573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:53:03.077046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.798122+0000","last_change":"2024-03-27T09:59:29.150820+0000","last_active":"2024-03-27T09:59:35.798122+0000","last_peered":"2024-03-27T09:59:35.798122+0000","last_clean":"2024-03-27T09:59:35.798122+0000","last_became_active":"2024-03-27T09:59:29.150536+0000","last_became_peered":"2024-03-27T09:59:29.150536+0000","last_unstale":"2024-03-27T09:59:35.798122+0000","last_undegraded":"2024-03-27T09:59:35.798122+0000","last_fullsized":"2024-03-27T09:59:35.798122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:53:03.077046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.599935+0000","last_change":"2024-03-27T09:59:29.148510+0000","last_active":"2024-03-27T09:59:35.599935+0000","last_peered":"2024-03-27T09:59:35.599935+0000","last_clean":"2024-03-27T09:59:35.599935+0000","last_became_active":"2024-03-27T09:59:29.146776+0000","last_became_peered":"2024-03-27T09:59:29.146776+0000","last_unstale":"2024-03-27T09:59:35.599935+0000","last_undegraded":"2024-03-27T09:59:35.599935+0000","last_fullsized":"2024-03-27T09:59:35.599935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:45:14.005415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.233211+0000","last_change":"2024-03-27T09:59:29.149815+0000","last_active":"2024-03-27T09:59:35.233211+0000","last_peered":"2024-03-27T09:59:35.233211+0000","last_clean":"2024-03-27T09:59:35.233211+0000","last_became_active":"2024-03-27T09:59:29.147082+0000","last_became_peered":"2024-03-27T09:59:29.147082+0000","last_unstale":"2024-03-27T09:59:35.233211+0000","last_undegraded":"2024-03-27T09:59:35.233211+0000","last_fullsized":"2024-03-27T09:59:35.233211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:31:21.514709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.230648+0000","last_change":"2024-03-27T09:59:29.147375+0000","last_active":"2024-03-27T09:59:35.230648+0000","last_peered":"2024-03-27T09:59:35.230648+0000","last_clean":"2024-03-27T09:59:35.230648+0000","last_became_active":"2024-03-27T09:59:29.147012+0000","last_became_peered":"2024-03-27T09:59:29.147012+0000","last_unstale":"2024-03-27T09:59:35.230648+0000","last_undegraded":"2024-03-27T09:59:35.230648+0000","last_fullsized":"2024-03-27T09:59:35.230648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:40:55.546423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.234176+0000","last_change":"2024-03-27T09:59:29.156417+0000","last_active":"2024-03-27T09:59:35.234176+0000","last_peered":"2024-03-27T09:59:35.234176+0000","last_clean":"2024-03-27T09:59:35.234176+0000","last_became_active":"2024-03-27T09:59:29.156124+0000","last_became_peered":"2024-03-27T09:59:29.156124+0000","last_unstale":"2024-03-27T09:59:35.234176+0000","last_undegraded":"2024-03-27T09:59:35.234176+0000","last_fullsized":"2024-03-27T09:59:35.234176+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:45:14.005415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.729121+0000","last_change":"2024-03-27T09:59:29.169092+0000","last_active":"2024-03-27T09:59:36.729121+0000","last_peered":"2024-03-27T09:59:36.729121+0000","last_clean":"2024-03-27T09:59:36.729121+0000","last_became_active":"2024-03-27T09:59:29.168788+0000","last_became_peered":"2024-03-27T09:59:29.168788+0000","last_unstale":"2024-03-27T09:59:36.729121+0000","last_undegraded":"2024-03-27T09:59:36.729121+0000","last_fullsized":"2024-03-27T09:59:36.729121+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T20:25:54.732855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.598901+0000","last_change":"2024-03-27T09:59:29.157524+0000","last_active":"2024-03-27T09:59:35.598901+0000","last_peered":"2024-03-27T09:59:35.598901+0000","last_clean":"2024-03-27T09:59:35.598901+0000","last_became_active":"2024-03-27T09:59:29.153615+0000","last_became_peered":"2024-03-27T09:59:29.153615+0000","last_unstale":"2024-03-27T09:59:35.598901+0000","last_undegraded":"2024-03-27T09:59:35.598901+0000","last_fullsized":"2024-03-27T09:59:35.598901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:53:03.077046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.727620+0000","last_change":"2024-03-27T09:59:29.165201+0000","last_active":"2024-03-27T09:59:36.727620+0000","last_peered":"2024-03-27T09:59:36.727620+0000","last_clean":"2024-03-27T09:59:36.727620+0000","last_became_active":"2024-03-27T09:59:29.164845+0000","last_became_peered":"2024-03-27T09:59:29.164845+0000","last_unstale":"2024-03-27T09:59:36.727620+0000","last_undegraded":"2024-03-27T09:59:36.727620+0000","last_fullsized":"2024-03-27T09:59:36.727620+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:34:04.348561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.230702+0000","last_change":"2024-03-27T09:59:29.159124+0000","last_active":"2024-03-27T09:59:35.230702+0000","last_peered":"2024-03-27T09:59:35.230702+0000","last_clean":"2024-03-27T09:59:35.230702+0000","last_became_active":"2024-03-27T09:59:29.158654+0000","last_became_peered":"2024-03-27T09:59:29.158654+0000","last_unstale":"2024-03-27T09:59:35.230702+0000","last_undegraded":"2024-03-27T09:59:35.230702+0000","last_fullsized":"2024-03-27T09:59:35.230702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:34:04.348561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.727714+0000","last_change":"2024-03-27T09:59:29.150329+0000","last_active":"2024-03-27T09:59:36.727714+0000","last_peered":"2024-03-27T09:59:36.727714+0000","last_clean":"2024-03-27T09:59:36.727714+0000","last_became_active":"2024-03-27T09:59:29.150095+0000","last_became_peered":"2024-03-27T09:59:29.150095+0000","last_unstale":"2024-03-27T09:59:36.727714+0000","last_undegraded":"2024-03-27T09:59:36.727714+0000","last_fullsized":"2024-03-27T09:59:36.727714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:12:08.142213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.230685+0000","last_change":"2024-03-27T09:59:29.149230+0000","last_active":"2024-03-27T09:59:35.230685+0000","last_peered":"2024-03-27T09:59:35.230685+0000","last_clean":"2024-03-27T09:59:35.230685+0000","last_became_active":"2024-03-27T09:59:29.148669+0000","last_became_peered":"2024-03-27T09:59:29.148669+0000","last_unstale":"2024-03-27T09:59:35.230685+0000","last_undegraded":"2024-03-27T09:59:35.230685+0000","last_fullsized":"2024-03-27T09:59:35.230685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:27:19.913918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.798736+0000","last_change":"2024-03-27T09:59:29.151084+0000","last_active":"2024-03-27T09:59:35.798736+0000","last_peered":"2024-03-27T09:59:35.798736+0000","last_clean":"2024-03-27T09:59:35.798736+0000","last_became_active":"2024-03-27T09:59:29.149050+0000","last_became_peered":"2024-03-27T09:59:29.149050+0000","last_unstale":"2024-03-27T09:59:35.798736+0000","last_undegraded":"2024-03-27T09:59:35.798736+0000","last_fullsized":"2024-03-27T09:59:35.798736+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:40:55.617775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.660424+0000","last_change":"2024-03-27T09:59:29.160100+0000","last_active":"2024-03-27T09:59:36.660424+0000","last_peered":"2024-03-27T09:59:36.660424+0000","last_clean":"2024-03-27T09:59:36.660424+0000","last_became_active":"2024-03-27T09:59:29.158340+0000","last_became_peered":"2024-03-27T09:59:29.158340+0000","last_unstale":"2024-03-27T09:59:36.660424+0000","last_undegraded":"2024-03-27T09:59:36.660424+0000","last_fullsized":"2024-03-27T09:59:36.660424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:20:50.555376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.728983+0000","last_change":"2024-03-27T09:59:29.157565+0000","last_active":"2024-03-27T09:59:36.728983+0000","last_peered":"2024-03-27T09:59:36.728983+0000","last_clean":"2024-03-27T09:59:36.728983+0000","last_became_active":"2024-03-27T09:59:29.157278+0000","last_became_peered":"2024-03-27T09:59:29.157278+0000","last_unstale":"2024-03-27T09:59:36.728983+0000","last_undegraded":"2024-03-27T09:59:36.728983+0000","last_fullsized":"2024-03-27T09:59:36.728983+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:03:30.407810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":14,"seq":60129542153,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":286720,"data_stored":114786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542153,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":110944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542152,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":282624,"data_stored":111104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542152,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32040,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339800,"statfs":{"total":96636764160,"available":96603955200,"internally_reserved":0,"allocated":880640,"data_stored":701950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574859,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32036,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339804,"statfs":{"total":96636764160,"available":96603959296,"internally_reserved":0,"allocated":872448,"data_stored":701894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":286720,"data_stored":114786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":278528,"data_stored":111034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31460,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340380,"statfs":{"total":96636764160,"available":96604549120,"internally_reserved":0,"allocated":286720,"data_stored":111070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-27T09:59:58.385 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-03-27T09:59:58.385 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-03-27T09:59:58.385 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-03-27T09:59:58.386 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-03-27T09:59:58.386 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-03-27T09:59:58.647 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.657+0000 7f5ea3200640 1 Processor -- start 2024-03-27T09:59:58.647 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.657+0000 7f5ea3200640 1 -- start start 2024-03-27T09:59:58.649 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.658+0000 7f5ea3200640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5ea41455a0 0x7f5ea4071010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:58.649 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.658+0000 7f5ea3200640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f5ea4071550 0x7f5ea406dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:58.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.658+0000 7f5ea3200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5ea40cecd0 0x7f5ea406e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:58.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.658+0000 7f5ea3200640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f5ea406f2d0 con 0x7f5ea41455a0 2024-03-27T09:59:58.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.658+0000 7f5ea3200640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f5ea40cf570 con 0x7f5ea4071550 2024-03-27T09:59:58.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.658+0000 7f5ea3200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f5ea40cf290 con 0x7f5ea40cecd0 2024-03-27T09:59:58.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.659+0000 7f5ea1e00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5ea41455a0 0x7f5ea4071010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:58.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.659+0000 7f5ea1400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f5ea4071550 0x7f5ea406dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:58.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.659+0000 7f5ea1e00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5ea41455a0 0x7f5ea4071010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:48692/0 (socket says 172.21.15.57:48692) 2024-03-27T09:59:58.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.659+0000 7f5ea1e00640 1 -- 172.21.15.57:0/1547261735 learned_addr learned my addr 172.21.15.57:0/1547261735 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T09:59:58.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.659+0000 7f5ea2800640 1 --2- 172.21.15.57:0/1547261735 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5ea40cecd0 0x7f5ea406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:58.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.659+0000 7f5ea1e00640 1 -- 172.21.15.57:0/1547261735 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5ea40cecd0 msgr2=0x7f5ea406e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T09:59:58.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.659+0000 7f5ea1e00640 1 --2- 172.21.15.57:0/1547261735 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5ea40cecd0 0x7f5ea406e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:58.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.659+0000 7f5ea1e00640 1 -- 172.21.15.57:0/1547261735 >> v2:172.21.15.118:3300/0 conn(0x7f5ea4071550 msgr2=0x7f5ea406dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T09:59:58.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.659+0000 7f5ea1e00640 1 --2- 172.21.15.57:0/1547261735 >> v2:172.21.15.118:3300/0 conn(0x7f5ea4071550 0x7f5ea406dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:58.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.659+0000 7f5ea1e00640 1 -- 172.21.15.57:0/1547261735 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ea406d300 con 0x7f5ea41455a0 2024-03-27T09:59:58.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.660+0000 7f5ea1e00640 1 --2- 172.21.15.57:0/1547261735 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ea41455a0 0x7f5ea4071010 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5ea406ef00 tx=0x7f5e9402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=101d21441071bbd6 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:58.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.661+0000 7f5ea0a00640 1 -- 172.21.15.57:0/1547261735 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e94035020 con 0x7f5ea41455a0 2024-03-27T09:59:58.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.661+0000 7f5ea0a00640 1 -- 172.21.15.57:0/1547261735 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e94031870 con 0x7f5ea41455a0 2024-03-27T09:59:58.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.661+0000 7f5ea0a00640 1 -- 172.21.15.57:0/1547261735 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e94031c40 con 0x7f5ea41455a0 2024-03-27T09:59:58.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.661+0000 7f5ea3200640 1 -- 172.21.15.57:0/1547261735 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ea41455a0 msgr2=0x7f5ea4071010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:58.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.661+0000 7f5ea3200640 1 --2- 172.21.15.57:0/1547261735 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ea41455a0 0x7f5ea4071010 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5ea406ef00 tx=0x7f5e9402b910 comp rx=0 tx=0).stop 2024-03-27T09:59:58.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.661+0000 7f5ea3200640 1 -- 172.21.15.57:0/1547261735 shutdown_connections 2024-03-27T09:59:58.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.661+0000 7f5ea3200640 1 --2- 172.21.15.57:0/1547261735 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5ea40cecd0 0x7f5ea406e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:58.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.661+0000 7f5ea3200640 1 --2- 172.21.15.57:0/1547261735 >> v2:172.21.15.118:3300/0 conn(0x7f5ea4071550 0x7f5ea406dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:58.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.661+0000 7f5ea3200640 1 --2- 172.21.15.57:0/1547261735 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ea41455a0 0x7f5ea4071010 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:58.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.661+0000 7f5ea3200640 1 -- 172.21.15.57:0/1547261735 >> 172.21.15.57:0/1547261735 conn(0x7f5ea40b1770 msgr2=0x7f5ea40b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:58.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.661+0000 7f5ea3200640 1 -- 172.21.15.57:0/1547261735 shutdown_connections 2024-03-27T09:59:58.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.661+0000 7f5ea3200640 1 -- 172.21.15.57:0/1547261735 wait complete. 2024-03-27T09:59:58.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.663+0000 7f5ea3200640 1 Processor -- start 2024-03-27T09:59:58.656 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.663+0000 7f5ea3200640 1 -- start start 2024-03-27T09:59:58.656 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.664+0000 7f5ea3200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ea4071550 0x7f5ea4159040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:58.656 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.664+0000 7f5ea3200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5ea40cecd0 0x7f5ea415d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:58.657 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.664+0000 7f5ea3200640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ea41455a0 0x7f5ea415d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:58.657 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.664+0000 7f5ea3200640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f5ea4145980 con 0x7f5ea41455a0 2024-03-27T09:59:58.657 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.664+0000 7f5ea3200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f5ea406d8c0 con 0x7f5ea4071550 2024-03-27T09:59:58.657 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.664+0000 7f5ea3200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f5ea415fa10 con 0x7f5ea40cecd0 2024-03-27T09:59:58.657 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.665+0000 7f5ea2800640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ea41455a0 0x7f5ea415d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:58.657 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.665+0000 7f5ea2800640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ea41455a0 0x7f5ea415d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:48706/0 (socket says 172.21.15.57:48706) 2024-03-27T09:59:58.657 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.665+0000 7f5ea2800640 1 -- 172.21.15.57:0/3136703288 learned_addr learned my addr 172.21.15.57:0/3136703288 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T09:59:58.657 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.665+0000 7f5ea1400640 1 --2- 172.21.15.57:0/3136703288 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5ea40cecd0 0x7f5ea415d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:58.657 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.665+0000 7f5ea1e00640 1 --2- 172.21.15.57:0/3136703288 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ea4071550 0x7f5ea4159040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:58.658 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.665+0000 7f5ea2800640 1 -- 172.21.15.57:0/3136703288 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5ea40cecd0 msgr2=0x7f5ea415d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:58.658 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.665+0000 7f5ea2800640 1 --2- 172.21.15.57:0/3136703288 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5ea40cecd0 0x7f5ea415d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:58.658 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.665+0000 7f5ea2800640 1 -- 172.21.15.57:0/3136703288 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ea4071550 msgr2=0x7f5ea4159040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:58.658 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.665+0000 7f5ea2800640 1 --2- 172.21.15.57:0/3136703288 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ea4071550 0x7f5ea4159040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:58.658 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.665+0000 7f5ea2800640 1 -- 172.21.15.57:0/3136703288 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ea415df30 con 0x7f5ea41455a0 2024-03-27T09:59:58.659 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.665+0000 7f5ea2800640 1 --2- 172.21.15.57:0/3136703288 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ea41455a0 0x7f5ea415d860 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5e9c007d80 tx=0x7f5e9c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:58.659 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.666+0000 7f5e9a000640 1 -- 172.21.15.57:0/3136703288 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e9c014420 con 0x7f5ea41455a0 2024-03-27T09:59:58.659 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.666+0000 7f5e9a000640 1 -- 172.21.15.57:0/3136703288 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e9c019070 con 0x7f5ea41455a0 2024-03-27T09:59:58.659 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.666+0000 7f5ea3200640 1 -- 172.21.15.57:0/3136703288 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ea415e210 con 0x7f5ea41455a0 2024-03-27T09:59:58.659 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.666+0000 7f5e9a000640 1 -- 172.21.15.57:0/3136703288 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e9c014800 con 0x7f5ea41455a0 2024-03-27T09:59:58.659 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.666+0000 7f5ea3200640 1 -- 172.21.15.57:0/3136703288 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ea4141a60 con 0x7f5ea41455a0 2024-03-27T09:59:58.661 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.667+0000 7f5ea3200640 1 -- 172.21.15.57:0/3136703288 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ea4141c60 con 0x7f5ea41455a0 2024-03-27T09:59:58.661 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.668+0000 7f5e9a000640 1 -- 172.21.15.57:0/3136703288 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f5e9c0149a0 con 0x7f5ea41455a0 2024-03-27T09:59:58.662 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.669+0000 7f5e9a000640 1 --2- 172.21.15.57:0/3136703288 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f5e8406c530 0x7f5e8406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:58.662 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.669+0000 7f5e9a000640 1 -- 172.21.15.57:0/3136703288 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f5e9c08c2f0 con 0x7f5ea41455a0 2024-03-27T09:59:58.662 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.669+0000 7f5ea1e00640 1 --2- 172.21.15.57:0/3136703288 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f5e8406c530 0x7f5e8406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:58.662 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.670+0000 7f5ea1e00640 1 --2- 172.21.15.57:0/3136703288 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f5e8406c530 0x7f5e8406e9f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5e94036000 tx=0x7f5e9403c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:58.663 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.674+0000 7f5e9a000640 1 -- 172.21.15.57:0/3136703288 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f5ea4141c60 con 0x7f5ea41455a0 2024-03-27T09:59:58.921 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.931+0000 7f5ea3200640 1 -- 172.21.15.57:0/3136703288 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f5ea4141570 con 0x7f5ea41455a0 2024-03-27T09:59:58.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.935+0000 7f5e9a000640 1 -- 172.21.15.57:0/3136703288 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+173730 (secure 0 0 0) 0x7f5e9c05a530 con 0x7f5ea41455a0 2024-03-27T09:59:58.928 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T09:59:58.930 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.940+0000 7f5ea3200640 1 -- 172.21.15.57:0/3136703288 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f5e8406c530 msgr2=0x7f5e8406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:58.930 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.940+0000 7f5ea3200640 1 --2- 172.21.15.57:0/3136703288 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f5e8406c530 0x7f5e8406e9f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5e94036000 tx=0x7f5e9403c040 comp rx=0 tx=0).stop 2024-03-27T09:59:58.930 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.940+0000 7f5ea3200640 1 -- 172.21.15.57:0/3136703288 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ea41455a0 msgr2=0x7f5ea415d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:58.930 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.940+0000 7f5ea3200640 1 --2- 172.21.15.57:0/3136703288 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ea41455a0 0x7f5ea415d860 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5e9c007d80 tx=0x7f5e9c00e4b0 comp rx=0 tx=0).stop 2024-03-27T09:59:58.931 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.940+0000 7f5ea3200640 1 -- 172.21.15.57:0/3136703288 shutdown_connections 2024-03-27T09:59:58.931 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.940+0000 7f5ea3200640 1 --2- 172.21.15.57:0/3136703288 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ea41455a0 0x7f5ea415d860 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:58.931 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.940+0000 7f5ea3200640 1 --2- 172.21.15.57:0/3136703288 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5ea40cecd0 0x7f5ea415d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:58.931 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.940+0000 7f5ea3200640 1 --2- 172.21.15.57:0/3136703288 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f5e8406c530 0x7f5e8406e9f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:58.931 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.940+0000 7f5ea3200640 1 --2- 172.21.15.57:0/3136703288 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ea4071550 0x7f5ea4159040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:58.931 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.940+0000 7f5ea3200640 1 -- 172.21.15.57:0/3136703288 >> 172.21.15.57:0/3136703288 conn(0x7f5ea40b1770 msgr2=0x7f5ea40b4550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:58.931 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.940+0000 7f5ea3200640 1 -- 172.21.15.57:0/3136703288 shutdown_connections 2024-03-27T09:59:58.931 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:58.940+0000 7f5ea3200640 1 -- 172.21.15.57:0/3136703288 wait complete. 2024-03-27T09:59:58.950 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":5,"flags":0,"active_gid":4103,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6832","nonce":485397065},{"type":"v1","addr":"172.21.15.57:6833","nonce":485397065}]},"active_addr":"172.21.15.57:6833/485397065","active_change":"2024-03-27T09:59:09.191583+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4108,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.57:0","nonce":4147661561}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.57:0","nonce":3332838281}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.57:0","nonce":3784554014}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.57:0","nonce":87173651}]}]} 2024-03-27T09:59:58.953 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-03-27T09:59:58.953 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-03-27T09:59:58.954 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-27T09:59:59.181 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.191+0000 7f8e29800640 1 Processor -- start 2024-03-27T09:59:59.181 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.191+0000 7f8e29800640 1 -- start start 2024-03-27T09:59:59.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.193+0000 7f8e29800640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8e240b3380 0x7f8e240d2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:59.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.193+0000 7f8e29800640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f8e240b3760 0x7f8e240b3d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:59.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.193+0000 7f8e29800640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e240b42b0 con 0x7f8e240d3db0 2024-03-27T09:59:59.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.193+0000 7f8e29800640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f8e240b4550 con 0x7f8e240b3760 2024-03-27T09:59:59.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.193+0000 7f8e29800640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f8e240b4830 con 0x7f8e240b3380 2024-03-27T09:59:59.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.193+0000 7f8e22000640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f8e240b3760 0x7f8e240b3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:59.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.193+0000 7f8e22000640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f8e240b3760 0x7f8e240b3d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.57:52666/0 (socket says 172.21.15.57:52666) 2024-03-27T09:59:59.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.193+0000 7f8e22a00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8e240b3380 0x7f8e240d2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:59.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.193+0000 7f8e22000640 1 -- 172.21.15.57:0/261657744 learned_addr learned my addr 172.21.15.57:0/261657744 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T09:59:59.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.194+0000 7f8e22000640 1 -- 172.21.15.57:0/261657744 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8e240b3380 msgr2=0x7f8e240d2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T09:59:59.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.194+0000 7f8e22000640 1 --2- 172.21.15.57:0/261657744 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8e240b3380 0x7f8e240d2cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:59.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.194+0000 7f8e22000640 1 -- 172.21.15.57:0/261657744 >> v1:172.21.15.118:6789/0 conn(0x7f8e240d3db0 legacy=0x7f8e240d4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:59.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.194+0000 7f8e22000640 1 -- 172.21.15.57:0/261657744 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e240b4b10 con 0x7f8e240b3760 2024-03-27T09:59:59.187 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.195+0000 7f8e22000640 1 --2- 172.21.15.57:0/261657744 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8e240b3760 0x7f8e240b3d70 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8e10009870 tx=0x7f8e1002b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8bbade3703bcbbc5 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:59.187 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.196+0000 7f8e21600640 1 -- 172.21.15.57:0/261657744 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e10034070 con 0x7f8e240b3760 2024-03-27T09:59:59.188 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.196+0000 7f8e21600640 1 -- 172.21.15.57:0/261657744 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e10030840 con 0x7f8e240b3760 2024-03-27T09:59:59.188 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.196+0000 7f8e21600640 1 -- 172.21.15.57:0/261657744 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e10030c10 con 0x7f8e240b3760 2024-03-27T09:59:59.188 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.197+0000 7f8e29800640 1 -- 172.21.15.57:0/261657744 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8e240b3760 msgr2=0x7f8e240b3d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:59.188 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.197+0000 7f8e29800640 1 --2- 172.21.15.57:0/261657744 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8e240b3760 0x7f8e240b3d70 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8e10009870 tx=0x7f8e1002b980 comp rx=0 tx=0).stop 2024-03-27T09:59:59.188 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.197+0000 7f8e29800640 1 -- 172.21.15.57:0/261657744 shutdown_connections 2024-03-27T09:59:59.188 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.197+0000 7f8e29800640 1 --2- 172.21.15.57:0/261657744 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8e240b3760 0x7f8e240b3d70 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:59.188 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.197+0000 7f8e29800640 1 --2- 172.21.15.57:0/261657744 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8e240b3380 0x7f8e240d2cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:59.188 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.197+0000 7f8e29800640 1 -- 172.21.15.57:0/261657744 >> 172.21.15.57:0/261657744 conn(0x7f8e24067c00 msgr2=0x7f8e2409d440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:59.189 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.197+0000 7f8e29800640 1 -- 172.21.15.57:0/261657744 shutdown_connections 2024-03-27T09:59:59.189 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.197+0000 7f8e29800640 1 -- 172.21.15.57:0/261657744 wait complete. 2024-03-27T09:59:59.189 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.199+0000 7f8e29800640 1 Processor -- start 2024-03-27T09:59:59.190 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.199+0000 7f8e29800640 1 -- start start 2024-03-27T09:59:59.193 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.200+0000 7f8e29800640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e240b3380 0x7f8e2414f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:59.193 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.200+0000 7f8e29800640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8e240b3760 0x7f8e240cd460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:59.194 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.200+0000 7f8e29800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8e240d3db0 0x7f8e240b9660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:59.194 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.200+0000 7f8e29800640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f8e240cee10 con 0x7f8e240b3380 2024-03-27T09:59:59.194 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.200+0000 7f8e29800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f8e240b50d0 con 0x7f8e240d3db0 2024-03-27T09:59:59.194 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.200+0000 7f8e29800640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f8e240cef90 con 0x7f8e240b3760 2024-03-27T09:59:59.194 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.201+0000 7f8e22a00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e240b3380 0x7f8e2414f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:59.194 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.201+0000 7f8e22a00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e240b3380 0x7f8e2414f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:48716/0 (socket says 172.21.15.57:48716) 2024-03-27T09:59:59.194 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.201+0000 7f8e22a00640 1 -- 172.21.15.57:0/3064184374 learned_addr learned my addr 172.21.15.57:0/3064184374 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T09:59:59.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.201+0000 7f8e22000640 1 --2- 172.21.15.57:0/3064184374 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8e240b3760 0x7f8e240cd460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:59.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.201+0000 7f8e23400640 1 --2- 172.21.15.57:0/3064184374 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8e240d3db0 0x7f8e240b9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:59.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.201+0000 7f8e22a00640 1 -- 172.21.15.57:0/3064184374 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8e240b3760 msgr2=0x7f8e240cd460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:59.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.201+0000 7f8e22a00640 1 --2- 172.21.15.57:0/3064184374 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8e240b3760 0x7f8e240cd460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:59.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.201+0000 7f8e22a00640 1 -- 172.21.15.57:0/3064184374 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8e240d3db0 msgr2=0x7f8e240b9660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:59.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.201+0000 7f8e22a00640 1 --2- 172.21.15.57:0/3064184374 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8e240d3db0 0x7f8e240b9660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:59.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.201+0000 7f8e22a00640 1 -- 172.21.15.57:0/3064184374 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e2414fa90 con 0x7f8e240b3380 2024-03-27T09:59:59.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.201+0000 7f8e23400640 1 --2- 172.21.15.57:0/3064184374 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8e240d3db0 0x7f8e240b9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T09:59:59.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.202+0000 7f8e22a00640 1 --2- 172.21.15.57:0/3064184374 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e240b3380 0x7f8e2414f550 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8e1400e9e0 tx=0x7f8e1400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:59.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.202+0000 7f8e1aa00640 1 -- 172.21.15.57:0/3064184374 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e14017070 con 0x7f8e240b3380 2024-03-27T09:59:59.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.202+0000 7f8e1aa00640 1 -- 172.21.15.57:0/3064184374 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e1400c970 con 0x7f8e240b3380 2024-03-27T09:59:59.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.202+0000 7f8e29800640 1 -- 172.21.15.57:0/3064184374 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e240cc3c0 con 0x7f8e240b3380 2024-03-27T09:59:59.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.202+0000 7f8e1aa00640 1 -- 172.21.15.57:0/3064184374 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e1400cd60 con 0x7f8e240b3380 2024-03-27T09:59:59.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.202+0000 7f8e29800640 1 -- 172.21.15.57:0/3064184374 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e240cc980 con 0x7f8e240b3380 2024-03-27T09:59:59.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.203+0000 7f8e29800640 1 -- 172.21.15.57:0/3064184374 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e24068c50 con 0x7f8e240b3380 2024-03-27T09:59:59.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.204+0000 7f8e1aa00640 1 -- 172.21.15.57:0/3064184374 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f8e1401a070 con 0x7f8e240b3380 2024-03-27T09:59:59.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.205+0000 7f8e1aa00640 1 --2- 172.21.15.57:0/3064184374 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f8e0406c530 0x7f8e0406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:59.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.205+0000 7f8e1aa00640 1 -- 172.21.15.57:0/3064184374 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f8e1408b9c0 con 0x7f8e240b3380 2024-03-27T09:59:59.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.206+0000 7f8e22000640 1 --2- 172.21.15.57:0/3064184374 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f8e0406c530 0x7f8e0406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:59.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.206+0000 7f8e22000640 1 --2- 172.21.15.57:0/3064184374 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f8e0406c530 0x7f8e0406e9f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8e10036000 tx=0x7f8e10008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:59.200 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.210+0000 7f8e1aa00640 1 -- 172.21.15.57:0/3064184374 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f8e2414fa90 con 0x7f8e240b3380 2024-03-27T09:59:59.407 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.417+0000 7f8e29800640 1 -- 172.21.15.57:0/3064184374 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8e2406d930 con 0x7f8e240b3380 2024-03-27T09:59:59.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.420+0000 7f8e1aa00640 1 -- 172.21.15.57:0/3064184374 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18502 (secure 0 0 0) 0x7f8e140595b0 con 0x7f8e240b3380 2024-03-27T09:59:59.410 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T09:59:59.411 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":26,"fsid":"7ac43f86-2c16-4a97-98fb-715d3cebc75c","created":"2024-03-27T09:59:04.033417+0000","modified":"2024-03-27T09:59:35.208743+0000","last_up_change":"2024-03-27T09:59:16.969624+0000","last_in_change":"2024-03-27T09:59:07.421690+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-27T09:59:17.253008+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-27T09:59:26.690365+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-27T09:59:27.559059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-27T09:59:31.187596+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"47b44362-7302-4f2a-b735-582c6c3850cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6801","nonce":2020036298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6803","nonce":2020036298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6807","nonce":2020036298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6805","nonce":2020036298}]},"public_addr":"172.21.15.57:6801/2020036298","cluster_addr":"172.21.15.57:6803/2020036298","heartbeat_back_addr":"172.21.15.57:6807/2020036298","heartbeat_front_addr":"172.21.15.57:6805/2020036298","state":["exists","up"]},{"osd":1,"uuid":"feaf96f0-9431-4188-9a09-da505b40e934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6809","nonce":3190929242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6811","nonce":3190929242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6815","nonce":3190929242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6813","nonce":3190929242}]},"public_addr":"172.21.15.57:6809/3190929242","cluster_addr":"172.21.15.57:6811/3190929242","heartbeat_back_addr":"172.21.15.57:6815/3190929242","heartbeat_front_addr":"172.21.15.57:6813/3190929242","state":["exists","up"]},{"osd":2,"uuid":"21e406e6-cfbc-4fe7-a816-e2420487c95d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6817","nonce":4065849973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6819","nonce":4065849973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6823","nonce":4065849973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6821","nonce":4065849973}]},"public_addr":"172.21.15.57:6817/4065849973","cluster_addr":"172.21.15.57:6819/4065849973","heartbeat_back_addr":"172.21.15.57:6823/4065849973","heartbeat_front_addr":"172.21.15.57:6821/4065849973","state":["exists","up"]},{"osd":3,"uuid":"a389af1d-76c4-4dfc-b215-f983f4931257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6825","nonce":158084809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6827","nonce":158084809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6831","nonce":158084809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6829","nonce":158084809}]},"public_addr":"172.21.15.57:6825/158084809","cluster_addr":"172.21.15.57:6827/158084809","heartbeat_back_addr":"172.21.15.57:6831/158084809","heartbeat_front_addr":"172.21.15.57:6829/158084809","state":["exists","up"]},{"osd":4,"uuid":"e9b05dca-557a-43ee-b43f-9ce5b7d28304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6823","nonce":108719401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6827","nonce":108719401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6831","nonce":108719401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6829","nonce":108719401}]},"public_addr":"172.21.15.118:6823/108719401","cluster_addr":"172.21.15.118:6827/108719401","heartbeat_back_addr":"172.21.15.118:6831/108719401","heartbeat_front_addr":"172.21.15.118:6829/108719401","state":["exists","up"]},{"osd":5,"uuid":"d968177d-44ff-499a-b00a-b147ed879253","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6817","nonce":2704605866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6819","nonce":2704605866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6826","nonce":2704605866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6822","nonce":2704605866}]},"public_addr":"172.21.15.118:6817/2704605866","cluster_addr":"172.21.15.118:6819/2704605866","heartbeat_back_addr":"172.21.15.118:6826/2704605866","heartbeat_front_addr":"172.21.15.118:6822/2704605866","state":["exists","up"]},{"osd":6,"uuid":"e8f98052-e6ad-4cfe-a4a9-0b17a434d54e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6801","nonce":1963659095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6803","nonce":1963659095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6807","nonce":1963659095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6805","nonce":1963659095}]},"public_addr":"172.21.15.118:6801/1963659095","cluster_addr":"172.21.15.118:6803/1963659095","heartbeat_back_addr":"172.21.15.118:6807/1963659095","heartbeat_front_addr":"172.21.15.118:6805/1963659095","state":["exists","up"]},{"osd":7,"uuid":"eccff987-8e51-4a63-845a-cf0a3196d7fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6809","nonce":1955879596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6811","nonce":1955879596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6815","nonce":1955879596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6813","nonce":1955879596}]},"public_addr":"172.21.15.118:6809/1955879596","cluster_addr":"172.21.15.118:6811/1955879596","heartbeat_back_addr":"172.21.15.118:6815/1955879596","heartbeat_front_addr":"172.21.15.118:6813/1955879596","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.721258+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.696610+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.777895+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.806769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.743259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.845687+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:13.020165+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.722294+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-27T09:59:59.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.423+0000 7f8e29800640 1 -- 172.21.15.57:0/3064184374 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f8e0406c530 msgr2=0x7f8e0406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:59.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.423+0000 7f8e29800640 1 --2- 172.21.15.57:0/3064184374 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f8e0406c530 0x7f8e0406e9f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8e10036000 tx=0x7f8e10008030 comp rx=0 tx=0).stop 2024-03-27T09:59:59.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.423+0000 7f8e29800640 1 -- 172.21.15.57:0/3064184374 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e240b3380 msgr2=0x7f8e2414f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:59.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.423+0000 7f8e29800640 1 --2- 172.21.15.57:0/3064184374 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e240b3380 0x7f8e2414f550 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8e1400e9e0 tx=0x7f8e1400eea0 comp rx=0 tx=0).stop 2024-03-27T09:59:59.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.423+0000 7f8e29800640 1 -- 172.21.15.57:0/3064184374 shutdown_connections 2024-03-27T09:59:59.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.423+0000 7f8e29800640 1 --2- 172.21.15.57:0/3064184374 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f8e0406c530 0x7f8e0406e9f0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:59.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.423+0000 7f8e29800640 1 --2- 172.21.15.57:0/3064184374 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8e240d3db0 0x7f8e240b9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:59.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.423+0000 7f8e29800640 1 --2- 172.21.15.57:0/3064184374 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8e240b3760 0x7f8e240cd460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:59.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.423+0000 7f8e29800640 1 --2- 172.21.15.57:0/3064184374 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8e240b3380 0x7f8e2414f550 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:59.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.423+0000 7f8e29800640 1 -- 172.21.15.57:0/3064184374 >> 172.21.15.57:0/3064184374 conn(0x7f8e24067c00 msgr2=0x7f8e2406d050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:59.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.423+0000 7f8e29800640 1 -- 172.21.15.57:0/3064184374 shutdown_connections 2024-03-27T09:59:59.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.423+0000 7f8e29800640 1 -- 172.21.15.57:0/3064184374 wait complete. 2024-03-27T09:59:59.432 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-03-27T09:59:59.432 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-27T09:59:59.657 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.667+0000 7f7051e00640 1 Processor -- start 2024-03-27T09:59:59.657 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.667+0000 7f7051e00640 1 -- start start 2024-03-27T09:59:59.660 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.669+0000 7f7051e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f704c161830 0x7f704c0cf970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:59.660 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.669+0000 7f7051e00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f704c0d0e90 0x7f704c0c7b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:59.660 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.669+0000 7f7051e00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f704c0d2d90 con 0x7f704c0cfeb0 2024-03-27T09:59:59.660 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.669+0000 7f7051e00640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f704c0cf4e0 con 0x7f704c0d0e90 2024-03-27T09:59:59.660 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.669+0000 7f7051e00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f704c0cee90 con 0x7f704c161830 2024-03-27T09:59:59.660 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.669+0000 7f7051400640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f704c0d0e90 0x7f704c0c7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:59.660 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.669+0000 7f7051400640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f704c0d0e90 0x7f704c0c7b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:48730/0 (socket says 172.21.15.57:48730) 2024-03-27T09:59:59.660 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.669+0000 7f7051400640 1 -- 172.21.15.57:0/598703302 learned_addr learned my addr 172.21.15.57:0/598703302 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T09:59:59.660 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.670+0000 7f7050a00640 1 --2- 172.21.15.57:0/598703302 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f704c161830 0x7f704c0cf970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:59.660 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.670+0000 7f7051400640 1 -- 172.21.15.57:0/598703302 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f704c161830 msgr2=0x7f704c0cf970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T09:59:59.660 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.670+0000 7f7051400640 1 --2- 172.21.15.57:0/598703302 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f704c161830 0x7f704c0cf970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:59.661 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.670+0000 7f7051400640 1 -- 172.21.15.57:0/598703302 >> v1:172.21.15.118:6789/0 conn(0x7f704c0cfeb0 legacy=0x7f704c0d0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:59.661 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.670+0000 7f7051400640 1 -- 172.21.15.57:0/598703302 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f704c0cf170 con 0x7f704c0d0e90 2024-03-27T09:59:59.661 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.671+0000 7f7051400640 1 --2- 172.21.15.57:0/598703302 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f704c0d0e90 0x7f704c0c7b80 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7044009e50 tx=0x7f704402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ea031f9f3e21364 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:59.661 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.671+0000 7f704b400640 1 -- 172.21.15.57:0/598703302 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f704402ca70 con 0x7f704c0d0e90 2024-03-27T09:59:59.662 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.672+0000 7f704b400640 1 -- 172.21.15.57:0/598703302 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f704402cc10 con 0x7f704c0d0e90 2024-03-27T09:59:59.662 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.672+0000 7f704b400640 1 -- 172.21.15.57:0/598703302 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70440343f0 con 0x7f704c0d0e90 2024-03-27T09:59:59.662 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.672+0000 7f7051e00640 1 -- 172.21.15.57:0/598703302 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f704c0d0e90 msgr2=0x7f704c0c7b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:59.663 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.672+0000 7f7051e00640 1 --2- 172.21.15.57:0/598703302 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f704c0d0e90 0x7f704c0c7b80 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f7044009e50 tx=0x7f704402bed0 comp rx=0 tx=0).stop 2024-03-27T09:59:59.663 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.672+0000 7f7051e00640 1 -- 172.21.15.57:0/598703302 shutdown_connections 2024-03-27T09:59:59.663 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.672+0000 7f7051e00640 1 --2- 172.21.15.57:0/598703302 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f704c0d0e90 0x7f704c0c7b80 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:59.663 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.672+0000 7f7051e00640 1 --2- 172.21.15.57:0/598703302 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f704c161830 0x7f704c0cf970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:59.663 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.672+0000 7f7051e00640 1 -- 172.21.15.57:0/598703302 >> 172.21.15.57:0/598703302 conn(0x7f704c0d4030 msgr2=0x7f704c0d4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:59.663 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.672+0000 7f7051e00640 1 -- 172.21.15.57:0/598703302 shutdown_connections 2024-03-27T09:59:59.663 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.673+0000 7f7051e00640 1 -- 172.21.15.57:0/598703302 wait complete. 2024-03-27T09:59:59.664 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.674+0000 7f7051e00640 1 Processor -- start 2024-03-27T09:59:59.664 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.674+0000 7f7051e00640 1 -- start start 2024-03-27T09:59:59.666 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.675+0000 7f7051e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f704c0cfeb0 0x7f704c14c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:59.667 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.675+0000 7f7051e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f704c0d0e90 0x7f704c1e7680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:59.667 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.675+0000 7f7051e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f704c161830 0x7f704c0c99d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:59.667 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.675+0000 7f7051e00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f704c0ce4b0 con 0x7f704c161830 2024-03-27T09:59:59.667 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.675+0000 7f7051e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f704c0ce330 con 0x7f704c0d0e90 2024-03-27T09:59:59.667 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.675+0000 7f7051e00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f704c161c10 con 0x7f704c0cfeb0 2024-03-27T09:59:59.667 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.676+0000 7f7051400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f704c161830 0x7f704c0c99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:59.667 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.676+0000 7f7051400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f704c161830 0x7f704c0c99d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:48738/0 (socket says 172.21.15.57:48738) 2024-03-27T09:59:59.667 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.676+0000 7f7051400640 1 -- 172.21.15.57:0/1254283134 learned_addr learned my addr 172.21.15.57:0/1254283134 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T09:59:59.667 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.676+0000 7f7050a00640 1 --2- 172.21.15.57:0/1254283134 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f704c0cfeb0 0x7f704c14c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:59.667 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.676+0000 7f704be00640 1 --2- 172.21.15.57:0/1254283134 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f704c0d0e90 0x7f704c1e7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:59.668 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.676+0000 7f7051400640 1 -- 172.21.15.57:0/1254283134 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f704c0cfeb0 msgr2=0x7f704c14c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:59.668 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.676+0000 7f7051400640 1 --2- 172.21.15.57:0/1254283134 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f704c0cfeb0 0x7f704c14c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:59.668 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.676+0000 7f7051400640 1 -- 172.21.15.57:0/1254283134 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f704c0d0e90 msgr2=0x7f704c1e7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:59.668 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.676+0000 7f7051400640 1 --2- 172.21.15.57:0/1254283134 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f704c0d0e90 0x7f704c1e7680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:59.668 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.676+0000 7f7051400640 1 -- 172.21.15.57:0/1254283134 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f704c14ca70 con 0x7f704c161830 2024-03-27T09:59:59.668 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.676+0000 7f7050a00640 1 --2- 172.21.15.57:0/1254283134 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f704c0cfeb0 0x7f704c14c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T09:59:59.668 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.677+0000 7f7051400640 1 --2- 172.21.15.57:0/1254283134 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f704c161830 0x7f704c0c99d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7044036040 tx=0x7f7044004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:59.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.677+0000 7f7048c00640 1 -- 172.21.15.57:0/1254283134 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7044043020 con 0x7f704c161830 2024-03-27T09:59:59.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.677+0000 7f7048c00640 1 -- 172.21.15.57:0/1254283134 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f704403e450 con 0x7f704c161830 2024-03-27T09:59:59.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.677+0000 7f7048c00640 1 -- 172.21.15.57:0/1254283134 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f704403e840 con 0x7f704c161830 2024-03-27T09:59:59.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.677+0000 7f7051e00640 1 -- 172.21.15.57:0/1254283134 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f704c09fbe0 con 0x7f704c161830 2024-03-27T09:59:59.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.677+0000 7f7051e00640 1 -- 172.21.15.57:0/1254283134 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f704c0a01a0 con 0x7f704c161830 2024-03-27T09:59:59.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.679+0000 7f7051e00640 1 -- 172.21.15.57:0/1254283134 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f704c068540 con 0x7f704c161830 2024-03-27T09:59:59.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.679+0000 7f7048c00640 1 -- 172.21.15.57:0/1254283134 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f7044046020 con 0x7f704c161830 2024-03-27T09:59:59.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.680+0000 7f7048c00640 1 --2- 172.21.15.57:0/1254283134 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f702c06c530 0x7f702c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T09:59:59.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.680+0000 7f7048c00640 1 -- 172.21.15.57:0/1254283134 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f70440ae210 con 0x7f704c161830 2024-03-27T09:59:59.671 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.681+0000 7f7050a00640 1 --2- 172.21.15.57:0/1254283134 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f702c06c530 0x7f702c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T09:59:59.671 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.681+0000 7f7050a00640 1 --2- 172.21.15.57:0/1254283134 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f702c06c530 0x7f702c06e9f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7040006fd0 tx=0x7f7040008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T09:59:59.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.685+0000 7f7048c00640 1 -- 172.21.15.57:0/1254283134 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f704404d030 con 0x7f704c161830 2024-03-27T09:59:59.884 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.894+0000 7f7051e00640 1 -- 172.21.15.57:0/1254283134 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f704c0d46c0 con 0x7f704c161830 2024-03-27T09:59:59.887 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.897+0000 7f7048c00640 1 -- 172.21.15.57:0/1254283134 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18502 (secure 0 0 0) 0x7f704407c450 con 0x7f704c161830 2024-03-27T09:59:59.888 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T09:59:59.888 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":26,"fsid":"7ac43f86-2c16-4a97-98fb-715d3cebc75c","created":"2024-03-27T09:59:04.033417+0000","modified":"2024-03-27T09:59:35.208743+0000","last_up_change":"2024-03-27T09:59:16.969624+0000","last_in_change":"2024-03-27T09:59:07.421690+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-27T09:59:17.253008+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-27T09:59:26.690365+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-27T09:59:27.559059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-27T09:59:31.187596+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"47b44362-7302-4f2a-b735-582c6c3850cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6801","nonce":2020036298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6803","nonce":2020036298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6807","nonce":2020036298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6805","nonce":2020036298}]},"public_addr":"172.21.15.57:6801/2020036298","cluster_addr":"172.21.15.57:6803/2020036298","heartbeat_back_addr":"172.21.15.57:6807/2020036298","heartbeat_front_addr":"172.21.15.57:6805/2020036298","state":["exists","up"]},{"osd":1,"uuid":"feaf96f0-9431-4188-9a09-da505b40e934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6809","nonce":3190929242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6811","nonce":3190929242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6815","nonce":3190929242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6813","nonce":3190929242}]},"public_addr":"172.21.15.57:6809/3190929242","cluster_addr":"172.21.15.57:6811/3190929242","heartbeat_back_addr":"172.21.15.57:6815/3190929242","heartbeat_front_addr":"172.21.15.57:6813/3190929242","state":["exists","up"]},{"osd":2,"uuid":"21e406e6-cfbc-4fe7-a816-e2420487c95d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6817","nonce":4065849973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6819","nonce":4065849973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6823","nonce":4065849973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6821","nonce":4065849973}]},"public_addr":"172.21.15.57:6817/4065849973","cluster_addr":"172.21.15.57:6819/4065849973","heartbeat_back_addr":"172.21.15.57:6823/4065849973","heartbeat_front_addr":"172.21.15.57:6821/4065849973","state":["exists","up"]},{"osd":3,"uuid":"a389af1d-76c4-4dfc-b215-f983f4931257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6825","nonce":158084809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6827","nonce":158084809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6831","nonce":158084809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6829","nonce":158084809}]},"public_addr":"172.21.15.57:6825/158084809","cluster_addr":"172.21.15.57:6827/158084809","heartbeat_back_addr":"172.21.15.57:6831/158084809","heartbeat_front_addr":"172.21.15.57:6829/158084809","state":["exists","up"]},{"osd":4,"uuid":"e9b05dca-557a-43ee-b43f-9ce5b7d28304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6823","nonce":108719401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6827","nonce":108719401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6831","nonce":108719401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6829","nonce":108719401}]},"public_addr":"172.21.15.118:6823/108719401","cluster_addr":"172.21.15.118:6827/108719401","heartbeat_back_addr":"172.21.15.118:6831/108719401","heartbeat_front_addr":"172.21.15.118:6829/108719401","state":["exists","up"]},{"osd":5,"uuid":"d968177d-44ff-499a-b00a-b147ed879253","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6817","nonce":2704605866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6819","nonce":2704605866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6826","nonce":2704605866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6822","nonce":2704605866}]},"public_addr":"172.21.15.118:6817/2704605866","cluster_addr":"172.21.15.118:6819/2704605866","heartbeat_back_addr":"172.21.15.118:6826/2704605866","heartbeat_front_addr":"172.21.15.118:6822/2704605866","state":["exists","up"]},{"osd":6,"uuid":"e8f98052-e6ad-4cfe-a4a9-0b17a434d54e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6801","nonce":1963659095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6803","nonce":1963659095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6807","nonce":1963659095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6805","nonce":1963659095}]},"public_addr":"172.21.15.118:6801/1963659095","cluster_addr":"172.21.15.118:6803/1963659095","heartbeat_back_addr":"172.21.15.118:6807/1963659095","heartbeat_front_addr":"172.21.15.118:6805/1963659095","state":["exists","up"]},{"osd":7,"uuid":"eccff987-8e51-4a63-845a-cf0a3196d7fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6809","nonce":1955879596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6811","nonce":1955879596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6815","nonce":1955879596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6813","nonce":1955879596}]},"public_addr":"172.21.15.118:6809/1955879596","cluster_addr":"172.21.15.118:6811/1955879596","heartbeat_back_addr":"172.21.15.118:6815/1955879596","heartbeat_front_addr":"172.21.15.118:6813/1955879596","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.721258+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.696610+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.777895+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.806769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.743259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.845687+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:13.020165+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.722294+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-27T09:59:59.891 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.900+0000 7f7051e00640 1 -- 172.21.15.57:0/1254283134 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f702c06c530 msgr2=0x7f702c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:59.891 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.900+0000 7f7051e00640 1 --2- 172.21.15.57:0/1254283134 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f702c06c530 0x7f702c06e9f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7040006fd0 tx=0x7f7040008040 comp rx=0 tx=0).stop 2024-03-27T09:59:59.891 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.900+0000 7f7051e00640 1 -- 172.21.15.57:0/1254283134 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f704c161830 msgr2=0x7f704c0c99d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T09:59:59.891 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.900+0000 7f7051e00640 1 --2- 172.21.15.57:0/1254283134 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f704c161830 0x7f704c0c99d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7044036040 tx=0x7f7044004a40 comp rx=0 tx=0).stop 2024-03-27T09:59:59.891 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.901+0000 7f7051e00640 1 -- 172.21.15.57:0/1254283134 shutdown_connections 2024-03-27T09:59:59.891 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.901+0000 7f7051e00640 1 --2- 172.21.15.57:0/1254283134 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f704c161830 0x7f704c0c99d0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:59.891 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.901+0000 7f7051e00640 1 --2- 172.21.15.57:0/1254283134 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f702c06c530 0x7f702c06e9f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:59.892 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.901+0000 7f7051e00640 1 --2- 172.21.15.57:0/1254283134 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f704c0d0e90 0x7f704c1e7680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:59.892 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.901+0000 7f7051e00640 1 --2- 172.21.15.57:0/1254283134 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f704c0cfeb0 0x7f704c14c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T09:59:59.892 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.901+0000 7f7051e00640 1 -- 172.21.15.57:0/1254283134 >> 172.21.15.57:0/1254283134 conn(0x7f704c0d4030 msgr2=0x7f704c0c75c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T09:59:59.892 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.901+0000 7f7051e00640 1 -- 172.21.15.57:0/1254283134 shutdown_connections 2024-03-27T09:59:59.892 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T09:59:59.901+0000 7f7051e00640 1 -- 172.21.15.57:0/1254283134 wait complete. 2024-03-27T09:59:59.911 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-03-27T09:59:59.912 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-03-27T09:59:59.912 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-03-27T09:59:59.913 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-03-27T09:59:59.913 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-03-27T09:59:59.913 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-03-27T09:59:59.914 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-03-27T09:59:59.914 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-03-27T10:00:00.239 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.249+0000 7f90f1600640 1 Processor -- start 2024-03-27T10:00:00.240 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.249+0000 7f90f1600640 1 -- start start 2024-03-27T10:00:00.240 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.250+0000 7f055ca00640 1 Processor -- start 2024-03-27T10:00:00.240 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.250+0000 7f055ca00640 1 -- start start 2024-03-27T10:00:00.240 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.251+0000 7ff416000640 1 Processor -- start 2024-03-27T10:00:00.241 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.251+0000 7f82b3200640 1 Processor -- start 2024-03-27T10:00:00.241 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.251+0000 7f3e96400640 1 Processor -- start 2024-03-27T10:00:00.241 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.251+0000 7ff416000640 1 -- start start 2024-03-27T10:00:00.242 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.252+0000 7f90f1600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f90ec161910 0x7f90ec0d1030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:00.242 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.251+0000 7f82b3200640 1 -- start start 2024-03-27T10:00:00.242 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.252+0000 7f90f1600640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f90ec0b0c50 0x7f90ec06c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:00.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.252+0000 7efd4f000640 1 Processor -- start 2024-03-27T10:00:00.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.251+0000 7f3e96400640 1 -- start start 2024-03-27T10:00:00.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.252+0000 7f90ebe00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f90ec161910 0x7f90ec0d1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:00.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.253+0000 7f89b3e00640 1 Processor -- start 2024-03-27T10:00:00.244 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.253+0000 7f90f0c00640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f90ec0d1570 0x7f90ec0d2ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:60874/0 (socket says 172.21.15.57:60874) 2024-03-27T10:00:00.244 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.253+0000 7efd4f000640 1 -- start start 2024-03-27T10:00:00.244 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.253+0000 7f82b3200640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f82ac0d2820 0x7f82ac0d0780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:00.245 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.253+0000 7f82b3200640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82ac0d2d90 con 0x7f82ac0d4b50 2024-03-27T10:00:00.245 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.253+0000 7f82b3200640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82ac0cee90 con 0x7f82ac161830 2024-03-27T10:00:00.245 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.253+0000 7f82b3200640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f82ac0cf4e0 con 0x7f82ac0d2820 2024-03-27T10:00:00.245 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.253+0000 7f90f0c00640 1 -- 172.21.15.57:0/1600290397 learned_addr learned my addr 172.21.15.57:0/1600290397 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T10:00:00.245 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.253+0000 7f3e96400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3e9015e4a0 0x7f3e900d14f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:00.246 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.254+0000 7f3e96400640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3e900d3fe0 0x7f3e900d4440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:00.246 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.253+0000 7ff416000640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ff41006d1b0 0x7ff4101635c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:00.246 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.253+0000 7ff416000640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff41006d660 con 0x7ff41006b7a0 2024-03-27T10:00:00.246 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.253+0000 7ff416000640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff41006dea0 con 0x7ff4101631e0 2024-03-27T10:00:00.246 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.253+0000 7ff416000640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7ff4101666b0 con 0x7ff41006d1b0 2024-03-27T10:00:00.246 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.254+0000 7f3e96400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f3e900ceee0 0x7f3e900cf370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:00.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.254+0000 7ff40f400640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7ff4101631e0 0x7ff410166b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.57:33384/0 (socket says 172.21.15.57:33384) 2024-03-27T10:00:00.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.254+0000 7ff40f400640 1 -- 172.21.15.57:0/4031808376 learned_addr learned my addr 172.21.15.57:0/4031808376 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T10:00:00.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.254+0000 7f82b1e00640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f82ac161830 0x7f82ac0cf970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.57:33376/0 (socket says 172.21.15.57:33376) 2024-03-27T10:00:00.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.254+0000 7f82b1400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f82ac0d2820 0x7f82ac0d0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:00.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.254+0000 7f90f1600640 1 -- 172.21.15.57:0/1600290397 --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90ec0d1e80 con 0x7f90ec0d1570 2024-03-27T10:00:00.248 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.254+0000 7f82b1400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f82ac0d2820 0x7f82ac0d0780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.57:52700/0 (socket says 172.21.15.57:52700) 2024-03-27T10:00:00.248 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.254+0000 7f90f1600640 1 -- 172.21.15.57:0/1600290397 --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f90ec0d2120 con 0x7f90ec0b0c50 2024-03-27T10:00:00.248 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.254+0000 7f90f1600640 1 -- 172.21.15.57:0/1600290397 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f90ec0d2400 con 0x7f90ec161910 2024-03-27T10:00:00.249 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.254+0000 7f82b1400640 1 -- 172.21.15.57:0/2780710820 learned_addr learned my addr 172.21.15.57:0/2780710820 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:00.249 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.255+0000 7f3e96400640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f3e9015f850 con 0x7f3e900d3fe0 2024-03-27T10:00:00.249 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.255+0000 7f3e96400640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f3e900d0a10 con 0x7f3e900ceee0 2024-03-27T10:00:00.249 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.255+0000 7f3e96400640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f3e900d0cf0 con 0x7f3e9015e4a0 2024-03-27T10:00:00.249 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.254+0000 7f3e8f400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3e9015e4a0 0x7f3e900d14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:00.250 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.255+0000 7ff40ea00640 1 --2- 172.21.15.57:0/4031808376 >> v2:172.21.15.118:3300/0 conn(0x7ff41006d1b0 0x7ff4101635c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:00.250 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.255+0000 7ff40e000640 1 -- 172.21.15.57:0/4031808376 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1773832601 0 0) 0x7ff41006dea0 con 0x7ff4101631e0 2024-03-27T10:00:00.250 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.255+0000 7ff40e000640 1 -- 172.21.15.57:0/4031808376 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff3f4003520 con 0x7ff4101631e0 2024-03-27T10:00:00.250 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.255+0000 7ff40e000640 1 -- 172.21.15.57:0/4031808376 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2402791785 0 0) 0x7ff400001040 con 0x7ff41006b7a0 2024-03-27T10:00:00.250 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.255+0000 7ff40e000640 1 -- 172.21.15.57:0/4031808376 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff41006dea0 con 0x7ff41006b7a0 2024-03-27T10:00:00.250 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.255+0000 7efd4f000640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7efd480d0ac0 0x7efd480b4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:00.250 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.255+0000 7efd4f000640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7efd480d0ea0 0x7efd480d1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:00.250 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.255+0000 7efd4f000640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efd48162150 0x7efd481625c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:00.251 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.255+0000 7f75db400640 1 Processor -- start 2024-03-27T10:00:00.251 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.255+0000 7f3e8f400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3e9015e4a0 0x7f3e900d14f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.57:33436/0 (socket says 172.21.15.57:33436) 2024-03-27T10:00:00.251 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.255+0000 7f3e8fe00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f3e900ceee0 0x7f3e900cf370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:00.251 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.256+0000 7efd4dc00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7efd480d0ac0 0x7efd480b4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:00.251 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.256+0000 7efd4f000640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7efd480d2600 con 0x7efd480d0ac0 2024-03-27T10:00:00.251 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.256+0000 7efd4f000640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7efd480d28a0 con 0x7efd480d0ea0 2024-03-27T10:00:00.252 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.256+0000 7efd4f000640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7efd480d2b80 con 0x7efd48162150 2024-03-27T10:00:00.252 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.256+0000 7f82b0a00640 1 -- 172.21.15.57:0/2780710820 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 240820968 0 0) 0x7f82ac0d2d90 con 0x7f82ac0d4b50 2024-03-27T10:00:00.252 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.255+0000 7f3e8fe00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f3e900ceee0 0x7f3e900cf370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.57:52704/0 (socket says 172.21.15.57:52704) 2024-03-27T10:00:00.252 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.256+0000 7f3e8fe00640 1 -- 172.21.15.57:0/2225070797 learned_addr learned my addr 172.21.15.57:0/2225070797 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:00.252 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.255+0000 7f90eaa00640 1 -- 172.21.15.57:0/1600290397 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2050297534 0 0) 0x7f90ec0d1e80 con 0x7f90ec0d1570 2024-03-27T10:00:00.253 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.255+0000 7f90eaa00640 1 -- 172.21.15.57:0/1600290397 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f90d0003520 con 0x7f90ec0d1570 2024-03-27T10:00:00.253 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.256+0000 7efd4dc00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7efd480d0ac0 0x7efd480b4db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:48752/0 (socket says 172.21.15.57:48752) 2024-03-27T10:00:00.253 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.256+0000 7efd4dc00640 1 -- 172.21.15.57:0/2168832607 learned_addr learned my addr 172.21.15.57:0/2168832607 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:00.253 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.256+0000 7f82b1400640 1 -- 172.21.15.57:0/2780710820 >> v1:172.21.15.118:6789/0 conn(0x7f82ac161830 legacy=0x7f82ac0cf970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:00.254 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.256+0000 7f75db400640 1 -- start start 2024-03-27T10:00:00.254 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.256+0000 7ff40ea00640 1 -- 172.21.15.57:0/4031808376 >> v1:172.21.15.118:6789/0 conn(0x7ff4101631e0 legacy=0x7ff410166b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:00.254 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.256+0000 7ff40ea00640 1 -- 172.21.15.57:0/4031808376 >> v1:172.21.15.57:6789/0 conn(0x7ff41006b7a0 legacy=0x7ff410071710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:00.255 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.256+0000 7ff40ea00640 1 -- 172.21.15.57:0/4031808376 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff41006d8e0 con 0x7ff41006d1b0 2024-03-27T10:00:00.255 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.256+0000 7efd4e600640 1 --2- 172.21.15.57:0/2168832607 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efd48162150 0x7efd481625c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:00.255 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.256+0000 7f82b1400640 1 -- 172.21.15.57:0/2780710820 >> v1:172.21.15.57:6789/0 conn(0x7f82ac0d4b50 legacy=0x7f82ac0c7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:00.256 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.256+0000 7f3e8ea00640 1 --2- 172.21.15.57:0/2225070797 >> v2:172.21.15.57:3300/0 conn(0x7f3e900d3fe0 0x7f3e900d4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:00.256 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.256+0000 7f90eaa00640 1 -- 172.21.15.57:0/1600290397 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 170145529 0 0) 0x7f90d0003520 con 0x7f90ec0d1570 2024-03-27T10:00:00.256 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.256+0000 7f90eaa00640 1 -- 172.21.15.57:0/1600290397 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f90ec161910 msgr2=0x7f90ec0d1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:00.257 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.256+0000 7f90eaa00640 1 --2- 172.21.15.57:0/1600290397 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f90ec161910 0x7f90ec0d1030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:00.257 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.256+0000 7f055ca00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f055806bf90 0x7f05580b30a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:00.257 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.256+0000 7f90eaa00640 1 -- 172.21.15.57:0/1600290397 >> v2:172.21.15.57:3300/0 conn(0x7f90ec0b0c50 msgr2=0x7f90ec06c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:00.258 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.256+0000 7efd4dc00640 1 -- 172.21.15.57:0/2168832607 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efd48162150 msgr2=0x7efd481625c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:00.258 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.256+0000 7efd4dc00640 1 --2- 172.21.15.57:0/2168832607 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efd48162150 0x7efd481625c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:00.258 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.256+0000 7efd4dc00640 1 -- 172.21.15.57:0/2168832607 >> v2:172.21.15.118:3300/0 conn(0x7efd480d0ea0 msgr2=0x7efd480d1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:00.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.256+0000 7f90eaa00640 1 --2- 172.21.15.57:0/1600290397 >> v2:172.21.15.57:3300/0 conn(0x7f90ec0b0c50 0x7f90ec06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:00.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.256+0000 7f90eaa00640 1 -- 172.21.15.57:0/1600290397 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90ec0d26e0 con 0x7f90ec0d1570 2024-03-27T10:00:00.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.257+0000 7f90eaa00640 1 -- 172.21.15.57:0/1600290397 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4227751516 0 0) 0x7f90e40019d0 con 0x7f90ec0d1570 2024-03-27T10:00:00.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.257+0000 7f90eaa00640 1 -- 172.21.15.57:0/1600290397 >> v1:172.21.15.57:6789/0 conn(0x7f90ec0d1570 legacy=0x7f90ec0d2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:00.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.257+0000 7f90eaa00640 1 --2- 172.21.15.57:0/1600290397 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f90d00039d0 0x7f90d0003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:00.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.257+0000 7f90eaa00640 1 --2- 172.21.15.57:0/1600290397 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f90d0004390 0x7f90d0004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:00.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.257+0000 7f90eaa00640 1 --2- 172.21.15.57:0/1600290397 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f90d0005100 0x7f90d00141d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:00.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.257+0000 7f90eaa00640 1 -- 172.21.15.57:0/1600290397 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f90ec0d2120 con 0x7f90d0005100 2024-03-27T10:00:00.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.257+0000 7f90eaa00640 1 -- 172.21.15.57:0/1600290397 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f90ec0d2400 con 0x7f90d0004390 2024-03-27T10:00:00.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.257+0000 7f90eaa00640 1 -- 172.21.15.57:0/1600290397 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f90d00148a0 con 0x7f90d00039d0 2024-03-27T10:00:00.260 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.257+0000 7f055ca00640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05580b37d0 con 0x7f0558071200 2024-03-27T10:00:00.260 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.257+0000 7f055ca00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05580b3ab0 con 0x7f055815a1b0 2024-03-27T10:00:00.260 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.257+0000 7f0555e00640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f055815a1b0 0x7f055806b880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.57:33386/0 (socket says 172.21.15.57:33386) 2024-03-27T10:00:00.260 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.257+0000 7f0555e00640 1 -- 172.21.15.57:0/1545074839 learned_addr learned my addr 172.21.15.57:0/1545074839 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T10:00:00.260 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.257+0000 7f055ca00640 1 -- 172.21.15.57:0/1545074839 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f05580cf4a0 con 0x7f055806bf90 2024-03-27T10:00:00.261 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.257+0000 7f0556800640 1 --1- 172.21.15.57:0/1545074839 >> v1:172.21.15.57:6789/0 conn(0x7f0558071200 0x7f05580cc700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:60910/0 (socket says 172.21.15.57:60910) 2024-03-27T10:00:00.261 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.257+0000 7efd4d200640 1 --2- 172.21.15.57:0/2168832607 >> v2:172.21.15.118:3300/0 conn(0x7efd480d0ea0 0x7efd480d1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:00.261 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.258+0000 7efd4dc00640 1 --2- 172.21.15.57:0/2168832607 >> v2:172.21.15.118:3300/0 conn(0x7efd480d0ea0 0x7efd480d1460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:00.261 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.256+0000 7f82b1400640 1 -- 172.21.15.57:0/2780710820 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82ac0cf170 con 0x7f82ac0d2820 2024-03-27T10:00:00.262 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.258+0000 7f3e8fe00640 1 -- 172.21.15.57:0/2225070797 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3e9015e4a0 msgr2=0x7f3e900d14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:00.262 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.258+0000 7f3e8fe00640 1 --2- 172.21.15.57:0/2225070797 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3e9015e4a0 0x7f3e900d14f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:00.262 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.258+0000 7f3e8fe00640 1 -- 172.21.15.57:0/2225070797 >> v2:172.21.15.57:3300/0 conn(0x7f3e900d3fe0 msgr2=0x7f3e900d4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:00.262 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.258+0000 7f3e8fe00640 1 --2- 172.21.15.57:0/2225070797 >> v2:172.21.15.57:3300/0 conn(0x7f3e900d3fe0 0x7f3e900d4440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:00.262 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.258+0000 7f3e8fe00640 1 -- 172.21.15.57:0/2225070797 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e900d4980 con 0x7f3e900ceee0 2024-03-27T10:00:00.262 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.253+0000 7f89b3e00640 1 -- start start 2024-03-27T10:00:00.263 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.256+0000 7f89b3e00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f89ac15e4a0 0x7f89ac0d14f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:00.263 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.256+0000 7f89b3e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f89ac0ceee0 0x7f89ac0cf370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:00.263 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.256+0000 7f89b3e00640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89ac15f850 con 0x7f89ac0d3fe0 2024-03-27T10:00:00.263 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.256+0000 7f89b3e00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f89ac0d0a10 con 0x7f89ac15e4a0 2024-03-27T10:00:00.263 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.256+0000 7f89b3e00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f89ac0d0cf0 con 0x7f89ac0ceee0 2024-03-27T10:00:00.263 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.256+0000 7f89b1400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f89ac15e4a0 0x7f89ac0d14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:00.263 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.256+0000 7f89b1400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f89ac15e4a0 0x7f89ac0d14f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.57:52720/0 (socket says 172.21.15.57:52720) 2024-03-27T10:00:00.263 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.256+0000 7f89b1400640 1 -- 172.21.15.57:0/2742365409 learned_addr learned my addr 172.21.15.57:0/2742365409 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:00.263 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.257+0000 7f89b1400640 1 -- 172.21.15.57:0/2742365409 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f89ac0ceee0 msgr2=0x7f89ac0cf370 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-27T10:00:00.263 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.257+0000 7f89b1400640 1 --2- 172.21.15.57:0/2742365409 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f89ac0ceee0 0x7f89ac0cf370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:00.263 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.257+0000 7f89b1400640 1 -- 172.21.15.57:0/2742365409 >> v1:172.21.15.57:6789/0 conn(0x7f89ac0d3fe0 legacy=0x7f89ac0d4440 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-27T10:00:00.263 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.257+0000 7f89b1400640 1 -- 172.21.15.57:0/2742365409 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89ac0d1a30 con 0x7f89ac15e4a0 2024-03-27T10:00:00.264 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.258+0000 7f90f0c00640 1 --2- 172.21.15.57:0/1600290397 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f90d0005100 0x7f90d00141d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:00.264 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.258+0000 7f90ebe00640 1 --2- 172.21.15.57:0/1600290397 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f90d00039d0 0x7f90d0003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:00.264 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.258+0000 7f3e8f400640 1 --2- 172.21.15.57:0/2225070797 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3e9015e4a0 0x7f3e900d14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T10:00:00.265 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.258+0000 7f0555400640 1 --2- 172.21.15.57:0/1545074839 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f055806bf90 0x7f05580b30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:00.265 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.258+0000 7f82b1400640 1 --2- 172.21.15.57:0/2780710820 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f82ac0d2820 0x7f82ac0d0780 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f829c0097f0 tx=0x7f829c02b770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3fd524758545b0e3 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:00.265 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.258+0000 7f75db400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f75d415e4a0 0x7f75d40d14f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:00.265 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.258+0000 7f75db400640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f75d40ceee0 0x7f75d40cf370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:00.266 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.258+0000 7f75db400640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75d415f850 con 0x7f75d40d3fe0 2024-03-27T10:00:00.266 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.258+0000 7f75db400640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f75d40d0a10 con 0x7f75d40ceee0 2024-03-27T10:00:00.266 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.258+0000 7f75db400640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f75d40d0cf0 con 0x7f75d415e4a0 2024-03-27T10:00:00.266 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.258+0000 7f75d9400640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f75d40ceee0 0x7f75d40cf370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:00.266 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.259+0000 7f75d9400640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f75d40ceee0 0x7f75d40cf370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:48770/0 (socket says 172.21.15.57:48770) 2024-03-27T10:00:00.266 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.259+0000 7f75d9400640 1 -- 172.21.15.57:0/1966279259 learned_addr learned my addr 172.21.15.57:0/1966279259 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:00.266 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.258+0000 7efd4dc00640 1 -- 172.21.15.57:0/2168832607 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd480d2e60 con 0x7efd480d0ac0 2024-03-27T10:00:00.267 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.259+0000 7f90eb400640 1 --2- 172.21.15.57:0/1600290397 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f90d0004390 0x7f90d0004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:00.267 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.259+0000 7f3e8ea00640 1 --2- 172.21.15.57:0/2225070797 >> v2:172.21.15.57:3300/0 conn(0x7f3e900d3fe0 0x7f3e900d4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T10:00:00.267 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.259+0000 7f75d8a00640 1 --2- 172.21.15.57:0/1966279259 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f75d415e4a0 0x7f75d40d14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:00.267 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.259+0000 7f75d9400640 1 -- 172.21.15.57:0/1966279259 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f75d415e4a0 msgr2=0x7f75d40d14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:00.267 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.259+0000 7f75d9400640 1 --2- 172.21.15.57:0/1966279259 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f75d415e4a0 0x7f75d40d14f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:00.267 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.259+0000 7f75d9400640 1 -- 172.21.15.57:0/1966279259 >> v1:172.21.15.118:6789/0 conn(0x7f75d40d3fe0 legacy=0x7f75d40d4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:00.268 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.259+0000 7f0554a00640 1 -- 172.21.15.57:0/1545074839 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1087102461 0 0) 0x7f05580b3ab0 con 0x7f055815a1b0 2024-03-27T10:00:00.268 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.259+0000 7f0554a00640 1 -- 172.21.15.57:0/1545074839 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f053c005730 con 0x7f055815a1b0 2024-03-27T10:00:00.268 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.259+0000 7f0554a00640 1 -- 172.21.15.57:0/1545074839 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 547721688 0 0) 0x7f05580b37d0 con 0x7f0558071200 2024-03-27T10:00:00.268 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.259+0000 7f0554a00640 1 -- 172.21.15.57:0/1545074839 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f05580b3ab0 con 0x7f0558071200 2024-03-27T10:00:00.268 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.259+0000 7ff40ea00640 1 --2- 172.21.15.57:0/4031808376 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff41006d1b0 0x7ff4101635c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff410166830 tx=0x7ff3f802b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=768e027c70542f57 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:00.268 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.259+0000 7f82b0a00640 1 -- 172.21.15.57:0/2780710820 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f829c039070 con 0x7f82ac0d2820 2024-03-27T10:00:00.269 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.260+0000 7f89b1400640 1 --2- 172.21.15.57:0/2742365409 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f89ac15e4a0 0x7f89ac0d14f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f89a4009e50 tx=0x7f89a402bf00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=597192d6f8f9d97e server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:00.269 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.260+0000 7f75d9400640 1 -- 172.21.15.57:0/1966279259 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75d40d1a30 con 0x7f75d40ceee0 2024-03-27T10:00:00.269 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.260+0000 7f82b0a00640 1 -- 172.21.15.57:0/2780710820 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f829c030070 con 0x7f82ac0d2820 2024-03-27T10:00:00.270 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.260+0000 7f82b0a00640 1 -- 172.21.15.57:0/2780710820 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f829c0318f0 con 0x7f82ac0d2820 2024-03-27T10:00:00.270 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.259+0000 7f0555400640 1 -- 172.21.15.57:0/1545074839 >> v1:172.21.15.118:6789/0 conn(0x7f055815a1b0 legacy=0x7f055806b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:00.270 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.259+0000 7f0555400640 1 -- 172.21.15.57:0/1545074839 >> v1:172.21.15.57:6789/0 conn(0x7f0558071200 legacy=0x7f05580cc700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:00.270 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.259+0000 7f0555400640 1 -- 172.21.15.57:0/1545074839 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05580b3d90 con 0x7f055806bf90 2024-03-27T10:00:00.270 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.260+0000 7ff40e000640 1 -- 172.21.15.57:0/4031808376 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3f8035020 con 0x7ff41006d1b0 2024-03-27T10:00:00.271 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.260+0000 7ff40e000640 1 -- 172.21.15.57:0/4031808376 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3f8031810 con 0x7ff41006d1b0 2024-03-27T10:00:00.271 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.260+0000 7f75d8a00640 1 --2- 172.21.15.57:0/1966279259 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f75d415e4a0 0x7f75d40d14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T10:00:00.271 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.260+0000 7ff40e000640 1 -- 172.21.15.57:0/4031808376 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3f8031be0 con 0x7ff41006d1b0 2024-03-27T10:00:00.272 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.260+0000 7f89abe00640 1 -- 172.21.15.57:0/2742365409 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89a402caa0 con 0x7f89ac15e4a0 2024-03-27T10:00:00.272 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.260+0000 7efd4dc00640 1 --2- 172.21.15.57:0/2168832607 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd480d0ac0 0x7efd480b4db0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7efd4808c6a0 tx=0x7efd3402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d27d39aeecbaa1fc server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:00.272 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.261+0000 7f89abe00640 1 -- 172.21.15.57:0/2742365409 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89a402cc40 con 0x7f89ac15e4a0 2024-03-27T10:00:00.272 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.261+0000 7f89abe00640 1 -- 172.21.15.57:0/2742365409 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89a40343f0 con 0x7f89ac15e4a0 2024-03-27T10:00:00.273 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.261+0000 7ff416000640 1 -- 172.21.15.57:0/4031808376 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff41006d1b0 msgr2=0x7ff4101635c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:00.273 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.261+0000 7ff416000640 1 --2- 172.21.15.57:0/4031808376 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff41006d1b0 0x7ff4101635c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff410166830 tx=0x7ff3f802b8b0 comp rx=0 tx=0).stop 2024-03-27T10:00:00.273 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.261+0000 7f82b3200640 1 -- 172.21.15.57:0/2780710820 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f82ac0d2820 msgr2=0x7f82ac0d0780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:00.273 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.261+0000 7f82b3200640 1 --2- 172.21.15.57:0/2780710820 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f82ac0d2820 0x7f82ac0d0780 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f829c0097f0 tx=0x7f829c02b770 comp rx=0 tx=0).stop 2024-03-27T10:00:00.274 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.259+0000 7f90f0c00640 1 -- 172.21.15.57:0/1600290397 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f90d00039d0 msgr2=0x7f90d0003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:00.274 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.261+0000 7ff416000640 1 -- 172.21.15.57:0/4031808376 shutdown_connections 2024-03-27T10:00:00.274 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.261+0000 7ff416000640 1 --2- 172.21.15.57:0/4031808376 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff41006d1b0 0x7ff4101635c0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:00.275 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.261+0000 7ff416000640 1 -- 172.21.15.57:0/4031808376 >> 172.21.15.57:0/4031808376 conn(0x7ff4100b1c60 msgr2=0x7ff4100b2070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:00.275 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.261+0000 7f82b3200640 1 -- 172.21.15.57:0/2780710820 shutdown_connections 2024-03-27T10:00:00.275 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.261+0000 7f82b3200640 1 --2- 172.21.15.57:0/2780710820 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f82ac0d2820 0x7f82ac0d0780 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:00.275 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.261+0000 7f82b3200640 1 -- 172.21.15.57:0/2780710820 >> 172.21.15.57:0/2780710820 conn(0x7f82ac0d4030 msgr2=0x7f82ac0d4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:00.276 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.261+0000 7f3e8fe00640 1 --2- 172.21.15.57:0/2225070797 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3e900ceee0 0x7f3e900cf370 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3e9006e140 tx=0x7f3e8802bee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4fabe41b7d6b5ac5 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:00.276 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.259+0000 7f90f0c00640 1 --2- 172.21.15.57:0/1600290397 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f90d00039d0 0x7f90d0003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:00.276 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.259+0000 7f90f0c00640 1 -- 172.21.15.57:0/1600290397 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f90d0004390 msgr2=0x7f90d0004860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:00.276 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.259+0000 7f90f0c00640 1 --2- 172.21.15.57:0/1600290397 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f90d0004390 0x7f90d0004860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:00.276 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.259+0000 7f90f0c00640 1 -- 172.21.15.57:0/1600290397 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90ec0d26e0 con 0x7f90d0005100 2024-03-27T10:00:00.276 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.259+0000 7f90eb400640 1 --2- 172.21.15.57:0/1600290397 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f90d0004390 0x7f90d0004860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T10:00:00.276 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.259+0000 7f90ebe00640 1 --2- 172.21.15.57:0/1600290397 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f90d00039d0 0x7f90d0003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T10:00:00.277 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.261+0000 7ff416000640 1 -- 172.21.15.57:0/4031808376 shutdown_connections 2024-03-27T10:00:00.277 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.261+0000 7ff416000640 1 -- 172.21.15.57:0/4031808376 wait complete. 2024-03-27T10:00:00.277 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.261+0000 7efd47e00640 1 -- 172.21.15.57:0/2168832607 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd34035020 con 0x7efd480d0ac0 2024-03-27T10:00:00.277 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.261+0000 7efd47e00640 1 -- 172.21.15.57:0/2168832607 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd34031870 con 0x7efd480d0ac0 2024-03-27T10:00:00.278 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.261+0000 7efd47e00640 1 -- 172.21.15.57:0/2168832607 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd34031c40 con 0x7efd480d0ac0 2024-03-27T10:00:00.278 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.261+0000 7f82b3200640 1 -- 172.21.15.57:0/2780710820 shutdown_connections 2024-03-27T10:00:00.278 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.262+0000 7f3e8e000640 1 -- 172.21.15.57:0/2225070797 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e8802ca80 con 0x7f3e900ceee0 2024-03-27T10:00:00.278 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.262+0000 7f3e8e000640 1 -- 172.21.15.57:0/2225070797 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e8802cc20 con 0x7f3e900ceee0 2024-03-27T10:00:00.278 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.262+0000 7f3e8e000640 1 -- 172.21.15.57:0/2225070797 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e880343f0 con 0x7f3e900ceee0 2024-03-27T10:00:00.279 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.262+0000 7f0555400640 1 --2- 172.21.15.57:0/1545074839 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f055806bf90 0x7f05580b30a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0548009b40 tx=0x7f054802c1b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90cae4212d65349a server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:00.279 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.262+0000 7f89b3e00640 1 -- 172.21.15.57:0/2742365409 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f89ac15e4a0 msgr2=0x7f89ac0d14f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:00.279 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.262+0000 7f89b3e00640 1 --2- 172.21.15.57:0/2742365409 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f89ac15e4a0 0x7f89ac0d14f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f89a4009e50 tx=0x7f89a402bf00 comp rx=0 tx=0).stop 2024-03-27T10:00:00.279 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.262+0000 7f90f0c00640 1 --2- 172.21.15.57:0/1600290397 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f90d0005100 0x7f90d00141d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f90e400a940 tx=0x7f90d0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1024d4cf038bc30c server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:00.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.262+0000 7f82b3200640 1 -- 172.21.15.57:0/2780710820 wait complete. 2024-03-27T10:00:00.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.262+0000 7efd4f000640 1 -- 172.21.15.57:0/2168832607 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd480d0ac0 msgr2=0x7efd480b4db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:00.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.262+0000 7efd4f000640 1 --2- 172.21.15.57:0/2168832607 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd480d0ac0 0x7efd480b4db0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7efd4808c6a0 tx=0x7efd3402b910 comp rx=0 tx=0).stop 2024-03-27T10:00:00.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.262+0000 7f75d9400640 1 --2- 172.21.15.57:0/1966279259 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f75d40ceee0 0x7f75d40cf370 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f75cc014a00 tx=0x7f75cc034a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e607f1dc0f133baf server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:00.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.262+0000 7f89b3e00640 1 -- 172.21.15.57:0/2742365409 shutdown_connections 2024-03-27T10:00:00.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.262+0000 7f89b3e00640 1 --2- 172.21.15.57:0/2742365409 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f89ac0ceee0 0x7f89ac0cf370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:00.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.262+0000 7f89b3e00640 1 --2- 172.21.15.57:0/2742365409 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f89ac15e4a0 0x7f89ac0d14f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:00.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.262+0000 7f89b3e00640 1 -- 172.21.15.57:0/2742365409 >> 172.21.15.57:0/2742365409 conn(0x7f89ac08db50 msgr2=0x7f89ac09d470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:00.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.262+0000 7f0554a00640 1 -- 172.21.15.57:0/1545074839 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0548039070 con 0x7f055806bf90 2024-03-27T10:00:00.282 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.262+0000 7f90eaa00640 1 -- 172.21.15.57:0/1600290397 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90e400a540 con 0x7f90d0005100 2024-03-27T10:00:00.282 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.263+0000 7efd4f000640 1 -- 172.21.15.57:0/2168832607 shutdown_connections 2024-03-27T10:00:00.282 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.263+0000 7efd4f000640 1 --2- 172.21.15.57:0/2168832607 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efd48162150 0x7efd481625c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:00.282 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.263+0000 7efd4f000640 1 --2- 172.21.15.57:0/2168832607 >> v2:172.21.15.118:3300/0 conn(0x7efd480d0ea0 0x7efd480d1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:00.283 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.263+0000 7f90eaa00640 1 -- 172.21.15.57:0/1600290397 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90e4034630 con 0x7f90d0005100 2024-03-27T10:00:00.283 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.263+0000 7efd4f000640 1 --2- 172.21.15.57:0/2168832607 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd480d0ac0 0x7efd480b4db0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:00.283 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.263+0000 7efd4f000640 1 -- 172.21.15.57:0/2168832607 >> 172.21.15.57:0/2168832607 conn(0x7efd480d3f80 msgr2=0x7efd480d4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:00.284 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.263+0000 7f3e96400640 1 -- 172.21.15.57:0/2225070797 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3e900ceee0 msgr2=0x7f3e900cf370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:00.284 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.263+0000 7f3e96400640 1 --2- 172.21.15.57:0/2225070797 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3e900ceee0 0x7f3e900cf370 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3e9006e140 tx=0x7f3e8802bee0 comp rx=0 tx=0).stop 2024-03-27T10:00:00.284 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.263+0000 7f90eaa00640 1 -- 172.21.15.57:0/1600290397 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90e4034aa0 con 0x7f90d0005100 2024-03-27T10:00:00.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.262+0000 7f0554a00640 1 -- 172.21.15.57:0/1545074839 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0548034440 con 0x7f055806bf90 2024-03-27T10:00:00.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.263+0000 7f0554a00640 1 -- 172.21.15.57:0/1545074839 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05480347f0 con 0x7f055806bf90 2024-03-27T10:00:00.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.263+0000 7f75d3400640 1 -- 172.21.15.57:0/1966279259 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75cc03c070 con 0x7f75d40ceee0 2024-03-27T10:00:00.286 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.263+0000 7f75d3400640 1 -- 172.21.15.57:0/1966279259 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75cc0114e0 con 0x7f75d40ceee0 2024-03-27T10:00:00.286 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.263+0000 7f75d3400640 1 -- 172.21.15.57:0/1966279259 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75cc0118b0 con 0x7f75d40ceee0 2024-03-27T10:00:00.286 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.263+0000 7f3e96400640 1 -- 172.21.15.57:0/2225070797 shutdown_connections 2024-03-27T10:00:00.286 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.263+0000 7f3e96400640 1 --2- 172.21.15.57:0/2225070797 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3e900ceee0 0x7f3e900cf370 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:00.286 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.263+0000 7f3e96400640 1 --2- 172.21.15.57:0/2225070797 >> v2:172.21.15.57:3300/0 conn(0x7f3e900d3fe0 0x7f3e900d4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:00.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.263+0000 7f3e96400640 1 --2- 172.21.15.57:0/2225070797 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3e9015e4a0 0x7f3e900d14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:00.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.263+0000 7f3e96400640 1 -- 172.21.15.57:0/2225070797 >> 172.21.15.57:0/2225070797 conn(0x7f3e9008db50 msgr2=0x7f3e9009d470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:00.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.264+0000 7efd4f000640 1 -- 172.21.15.57:0/2168832607 shutdown_connections 2024-03-27T10:00:00.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.264+0000 7f3e96400640 1 -- 172.21.15.57:0/2225070797 shutdown_connections 2024-03-27T10:00:00.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.264+0000 7f055ca00640 1 -- 172.21.15.57:0/1545074839 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f055806bf90 msgr2=0x7f05580b30a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:00.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.264+0000 7f90f1600640 1 -- 172.21.15.57:0/1600290397 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f90d0005100 msgr2=0x7f90d00141d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:00.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.264+0000 7f90f1600640 1 --2- 172.21.15.57:0/1600290397 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f90d0005100 0x7f90d00141d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f90e400a940 tx=0x7f90d0005830 comp rx=0 tx=0).stop 2024-03-27T10:00:00.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.264+0000 7f82b3200640 1 Processor -- start 2024-03-27T10:00:00.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.264+0000 7ff416000640 1 Processor -- start 2024-03-27T10:00:00.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.264+0000 7f90f0c00640 1 -- 172.21.15.57:0/1600290397 reap_dead start 2024-03-27T10:00:00.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.264+0000 7f90f1600640 1 -- 172.21.15.57:0/1600290397 shutdown_connections 2024-03-27T10:00:00.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.264+0000 7f90f1600640 1 -- 172.21.15.57:0/1600290397 >> 172.21.15.57:0/1600290397 conn(0x7f90ec0d3f80 msgr2=0x7f90ec0d4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:00.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.264+0000 7f82b3200640 1 -- start start 2024-03-27T10:00:00.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.263+0000 7f89b3e00640 1 -- 172.21.15.57:0/2742365409 shutdown_connections 2024-03-27T10:00:00.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.263+0000 7f89b3e00640 1 -- 172.21.15.57:0/2742365409 wait complete. 2024-03-27T10:00:00.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.264+0000 7ff416000640 1 -- start start 2024-03-27T10:00:00.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.264+0000 7f75db400640 1 -- 172.21.15.57:0/1966279259 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f75d40ceee0 msgr2=0x7f75d40cf370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:00.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.265+0000 7f75db400640 1 --2- 172.21.15.57:0/1966279259 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f75d40ceee0 0x7f75d40cf370 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f75cc014a00 tx=0x7f75cc034a90 comp rx=0 tx=0).stop 2024-03-27T10:00:00.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.264+0000 7f3e96400640 1 -- 172.21.15.57:0/2225070797 wait complete. 2024-03-27T10:00:00.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.264+0000 7f055ca00640 1 --2- 172.21.15.57:0/1545074839 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f055806bf90 0x7f05580b30a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0548009b40 tx=0x7f054802c1b0 comp rx=0 tx=0).stop 2024-03-27T10:00:00.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.264+0000 7f90f1600640 1 -- 172.21.15.57:0/1600290397 shutdown_connections 2024-03-27T10:00:00.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.265+0000 7f90f1600640 1 -- 172.21.15.57:0/1600290397 wait complete. 2024-03-27T10:00:00.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.265+0000 7f055ca00640 1 -- 172.21.15.57:0/1545074839 shutdown_connections 2024-03-27T10:00:00.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.265+0000 7f055ca00640 1 --2- 172.21.15.57:0/1545074839 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f055806bf90 0x7f05580b30a0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:00.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.265+0000 7f055ca00640 1 -- 172.21.15.57:0/1545074839 >> 172.21.15.57:0/1545074839 conn(0x7f05580b1c60 msgr2=0x7f05580b2070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:00.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.264+0000 7efd4f000640 1 -- 172.21.15.57:0/2168832607 wait complete. 2024-03-27T10:00:00.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.266+0000 7f89b3e00640 1 Processor -- start 2024-03-27T10:00:00.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.266+0000 7efd4f000640 1 Processor -- start 2024-03-27T10:00:00.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.266+0000 7ff416000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff41006b7a0 0x7ff4101548e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:00.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.266+0000 7f055ca00640 1 -- 172.21.15.57:0/1545074839 shutdown_connections 2024-03-27T10:00:00.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.266+0000 7f75db400640 1 -- 172.21.15.57:0/1966279259 shutdown_connections 2024-03-27T10:00:00.295 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.266+0000 7f75db400640 1 --2- 172.21.15.57:0/1966279259 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f75d40ceee0 0x7f75d40cf370 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:00.295 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.266+0000 7f75db400640 1 --2- 172.21.15.57:0/1966279259 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f75d415e4a0 0x7f75d40d14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:00.295 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.266+0000 7f75db400640 1 -- 172.21.15.57:0/1966279259 >> 172.21.15.57:0/1966279259 conn(0x7f75d408db50 msgr2=0x7f75d409d470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:00.295 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.266+0000 7ff416000640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff41006d1b0 0x7ff41015d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:00.295 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.266+0000 7f82b3200640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f82ac0d2820 0x7f82ac1f8510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:00.296 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.266+0000 7f89b3e00640 1 -- start start 2024-03-27T10:00:00.296 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.266+0000 7efd4f000640 1 -- start start 2024-03-27T10:00:00.296 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.267+0000 7ff416000640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff4101631e0 0x7ff4100b35a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:00.296 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.267+0000 7f055ca00640 1 -- 172.21.15.57:0/1545074839 wait complete. 2024-03-27T10:00:00.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.267+0000 7ff40f400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff41006b7a0 0x7ff4101548e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:00.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.267+0000 7ff416000640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7ff410163b00 con 0x7ff4101631e0 2024-03-27T10:00:00.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.267+0000 7ff416000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7ff410166340 con 0x7ff41006b7a0 2024-03-27T10:00:00.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.267+0000 7ff40f400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff41006b7a0 0x7ff4101548e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.57:52750/0 (socket says 172.21.15.57:52750) 2024-03-27T10:00:00.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.267+0000 7ff416000640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7ff410071e20 con 0x7ff41006d1b0 2024-03-27T10:00:00.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.267+0000 7ff40f400640 1 -- 172.21.15.57:0/2048038801 learned_addr learned my addr 172.21.15.57:0/2048038801 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:00.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.267+0000 7f75db400640 1 -- 172.21.15.57:0/1966279259 shutdown_connections 2024-03-27T10:00:00.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.267+0000 7f82b1e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f82ac0d2820 0x7f82ac1f8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:00.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.267+0000 7f82b1e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f82ac0d2820 0x7f82ac1f8510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:48786/0 (socket says 172.21.15.57:48786) 2024-03-27T10:00:00.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.267+0000 7f82b1e00640 1 -- 172.21.15.57:0/1740533524 learned_addr learned my addr 172.21.15.57:0/1740533524 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:00.299 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.267+0000 7f82b3200640 1 --2- 172.21.15.57:0/1740533524 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f82ac0d4b50 0x7f82ac155400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:00.299 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.267+0000 7f82b3200640 1 --2- 172.21.15.57:0/1740533524 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f82ac161830 0x7f82ac157840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:00.299 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.267+0000 7f82b3200640 1 -- 172.21.15.57:0/1740533524 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f82ac0ce330 con 0x7f82ac0d2820 2024-03-27T10:00:00.299 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.267+0000 7f82b3200640 1 -- 172.21.15.57:0/1740533524 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f82ac0d3070 con 0x7f82ac161830 2024-03-27T10:00:00.299 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.267+0000 7f82b3200640 1 -- 172.21.15.57:0/1740533524 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f82ac0ce4b0 con 0x7f82ac0d4b50 2024-03-27T10:00:00.299 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.267+0000 7f75db400640 1 -- 172.21.15.57:0/1966279259 wait complete. 2024-03-27T10:00:00.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.267+0000 7f3e96400640 1 Processor -- start 2024-03-27T10:00:00.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.267+0000 7f90f1600640 1 Processor -- start 2024-03-27T10:00:00.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.268+0000 7f3e96400640 1 -- start start 2024-03-27T10:00:00.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.268+0000 7f82b1400640 1 --2- 172.21.15.57:0/1740533524 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f82ac0d4b50 0x7f82ac155400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:00.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.268+0000 7f89b3e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f89ac0ceee0 0x7f89ac0b8e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:00.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.268+0000 7f90f1600640 1 -- start start 2024-03-27T10:00:00.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.268+0000 7f82b2800640 1 --2- 172.21.15.57:0/1740533524 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f82ac161830 0x7f82ac157840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:00.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.268+0000 7f82b1e00640 1 -- 172.21.15.57:0/1740533524 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f82ac0d4b50 msgr2=0x7f82ac155400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:00.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.268+0000 7f82b1e00640 1 --2- 172.21.15.57:0/1740533524 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f82ac0d4b50 0x7f82ac155400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:00.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.268+0000 7f82b1e00640 1 -- 172.21.15.57:0/1740533524 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f82ac161830 msgr2=0x7f82ac157840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:00.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.268+0000 7f89b3e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f89ac0d3fe0 0x7f89ac200b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:00.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.268+0000 7f89b3e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f89ac15e4a0 0x7f89ac0c9780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:00.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.268+0000 7f89b3e00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f89ac0b3000 con 0x7f89ac0ceee0 2024-03-27T10:00:00.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.268+0000 7f89b3e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f89ac0b2e80 con 0x7f89ac15e4a0 2024-03-27T10:00:00.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.268+0000 7f89b3e00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f89ac0b3180 con 0x7f89ac0d3fe0 2024-03-27T10:00:00.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.268+0000 7efd4f000640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efd480d0ac0 0x7efd481f5370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:00.303 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.268+0000 7efd4f000640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd480d0ea0 0x7efd481f58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:00.303 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.268+0000 7efd4f000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efd48162150 0x7efd481f5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:00.303 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.268+0000 7efd4f000640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7efd48162c80 con 0x7efd480d0ea0 2024-03-27T10:00:00.303 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.268+0000 7efd4f000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7efd48162b00 con 0x7efd48162150 2024-03-27T10:00:00.303 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.268+0000 7efd4f000640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7efd48162e00 con 0x7efd480d0ac0 2024-03-27T10:00:00.303 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.267+0000 7ff40fe00640 1 --2- 172.21.15.57:0/2048038801 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff4101631e0 0x7ff4100b35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:00.303 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.268+0000 7ff40f400640 1 -- 172.21.15.57:0/2048038801 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff41006d1b0 msgr2=0x7ff41015d250 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-27T10:00:00.304 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.268+0000 7ff40f400640 1 --2- 172.21.15.57:0/2048038801 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff41006d1b0 0x7ff41015d250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:00.304 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.269+0000 7f055ca00640 1 Processor -- start 2024-03-27T10:00:00.304 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.268+0000 7ff40f400640 1 -- 172.21.15.57:0/2048038801 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff4101631e0 msgr2=0x7ff4100b35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:00.304 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.269+0000 7ff40f400640 1 --2- 172.21.15.57:0/2048038801 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff4101631e0 0x7ff4100b35a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:00.304 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.269+0000 7ff40f400640 1 -- 172.21.15.57:0/2048038801 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff410155780 con 0x7ff41006b7a0 2024-03-27T10:00:00.304 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.269+0000 7ff40fe00640 1 --2- 172.21.15.57:0/2048038801 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff4101631e0 0x7ff4100b35a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T10:00:00.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.269+0000 7f82b1e00640 1 --2- 172.21.15.57:0/1740533524 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f82ac161830 0x7f82ac157840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:00.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.269+0000 7f82b1e00640 1 -- 172.21.15.57:0/1740533524 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82ac1f8a50 con 0x7f82ac0d2820 2024-03-27T10:00:00.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.269+0000 7f90f1600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f90d0005100 0x7f90ec1f01e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:00.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.269+0000 7f90f1600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f90ec0ca8e0 0x7f90ec0b6460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:00.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.269+0000 7f90f1600640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f90ec1f2f30 0x7f90ec0cd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:00.306 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.270+0000 7f82b2800640 1 --2- 172.21.15.57:0/1740533524 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f82ac161830 0x7f82ac157840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T10:00:00.306 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.270+0000 7ff40f400640 1 --2- 172.21.15.57:0/2048038801 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff41006b7a0 0x7ff4101548e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff40800cb40 tx=0x7ff40800a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:00.306 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.270+0000 7efd4e600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efd48162150 0x7efd481f5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:00.306 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.270+0000 7efd4e600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efd48162150 0x7efd481f5df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.57:52772/0 (socket says 172.21.15.57:52772) 2024-03-27T10:00:00.306 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.270+0000 7efd4e600640 1 -- 172.21.15.57:0/2621764796 learned_addr learned my addr 172.21.15.57:0/2621764796 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:00.306 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.270+0000 7efd4dc00640 1 --2- 172.21.15.57:0/2621764796 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efd480d0ac0 0x7efd481f5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:00.307 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.270+0000 7f3e96400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3e900ceee0 0x7f3e900cb360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:00.307 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.270+0000 7f90f1600640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f90ec0d4ca0 con 0x7f90ec1f2f30 2024-03-27T10:00:00.307 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.270+0000 7f90f1600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f90ec161cf0 con 0x7f90d0005100 2024-03-27T10:00:00.307 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.270+0000 7f90f1600640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f90ec0d1030 con 0x7f90ec0ca8e0 2024-03-27T10:00:00.308 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.270+0000 7f75db400640 1 Processor -- start 2024-03-27T10:00:00.308 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.270+0000 7f90f0c00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f90ec1f2f30 0x7f90ec0cd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:00.308 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.270+0000 7f3e96400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3e900d3fe0 0x7f3e90155260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:00.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.270+0000 7f89b0a00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f89ac0d3fe0 0x7f89ac200b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:00.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.270+0000 7f89b1e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f89ac15e4a0 0x7f89ac0c9780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:00.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.270+0000 7f89b1e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f89ac15e4a0 0x7f89ac0c9780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.57:52760/0 (socket says 172.21.15.57:52760) 2024-03-27T10:00:00.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.270+0000 7f89b1e00640 1 -- 172.21.15.57:0/2383447535 learned_addr learned my addr 172.21.15.57:0/2383447535 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:00.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.270+0000 7ff407400640 1 -- 172.21.15.57:0/2048038801 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff408017070 con 0x7ff41006b7a0 2024-03-27T10:00:00.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.270+0000 7f89b1400640 1 --2- 172.21.15.57:0/2383447535 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f89ac0ceee0 0x7f89ac0b8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:00.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.270+0000 7ff407400640 1 -- 172.21.15.57:0/2048038801 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff40800aca0 con 0x7ff41006b7a0 2024-03-27T10:00:00.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.270+0000 7ff416000640 1 -- 172.21.15.57:0/2048038801 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4100cd5f0 con 0x7ff41006b7a0 2024-03-27T10:00:00.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.269+0000 7f055ca00640 1 -- start start 2024-03-27T10:00:00.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.270+0000 7efd4d200640 1 --2- 172.21.15.57:0/2621764796 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd480d0ea0 0x7efd481f58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:00.311 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.270+0000 7f3e96400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e9015e4a0 0x7f3e900cbee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:00.311 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.271+0000 7ff416000640 1 -- 172.21.15.57:0/2048038801 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4100ce0a0 con 0x7ff41006b7a0 2024-03-27T10:00:00.311 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.271+0000 7ff407400640 1 -- 172.21.15.57:0/2048038801 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff408021060 con 0x7ff41006b7a0 2024-03-27T10:00:00.311 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.271+0000 7f3e96400640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f3e900cfa30 con 0x7f3e9015e4a0 2024-03-27T10:00:00.312 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.271+0000 7f90ebe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f90d0005100 0x7f90ec1f01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:00.312 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.271+0000 7f90eb400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f90ec0ca8e0 0x7f90ec0b6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:00.312 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.271+0000 7f90f0c00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f90ec1f2f30 0x7f90ec0cd430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:48824/0 (socket says 172.21.15.57:48824) 2024-03-27T10:00:00.312 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.271+0000 7f90f0c00640 1 -- 172.21.15.57:0/3024026798 learned_addr learned my addr 172.21.15.57:0/3024026798 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:00.312 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.271+0000 7efd4e600640 1 -- 172.21.15.57:0/2621764796 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efd480d0ac0 msgr2=0x7efd481f5370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:00.312 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.271+0000 7efd4e600640 1 --2- 172.21.15.57:0/2621764796 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efd480d0ac0 0x7efd481f5370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:00.312 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.271+0000 7efd4e600640 1 -- 172.21.15.57:0/2621764796 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd480d0ea0 msgr2=0x7efd481f58b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:00.313 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.271+0000 7f3e8f400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3e900ceee0 0x7f3e900cb360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:00.313 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.271+0000 7efd4e600640 1 --2- 172.21.15.57:0/2621764796 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd480d0ea0 0x7efd481f58b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:00.313 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.271+0000 7f75db400640 1 -- start start 2024-03-27T10:00:00.314 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.271+0000 7f3e8f400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3e900ceee0 0x7f3e900cb360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.57:52794/0 (socket says 172.21.15.57:52794) 2024-03-27T10:00:00.314 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.271+0000 7f3e96400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f3e900cf8b0 con 0x7f3e900ceee0 2024-03-27T10:00:00.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.271+0000 7f3e96400640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f3e900b2e80 con 0x7f3e900d3fe0 2024-03-27T10:00:00.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.271+0000 7f3e8ea00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3e900d3fe0 0x7f3e90155260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:00.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.271+0000 7f3e8f400640 1 -- 172.21.15.57:0/2495989815 learned_addr learned my addr 172.21.15.57:0/2495989815 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:00.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.271+0000 7f3e8fe00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e9015e4a0 0x7f3e900cbee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:00.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.271+0000 7efd4e600640 1 -- 172.21.15.57:0/2621764796 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd481f42d0 con 0x7efd48162150 2024-03-27T10:00:00.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.271+0000 7f82b1e00640 1 --2- 172.21.15.57:0/1740533524 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f82ac0d2820 0x7f82ac1f8510 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f82a000c540 tx=0x7f82a000ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:00.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.272+0000 7efd4d200640 1 --2- 172.21.15.57:0/2621764796 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efd480d0ea0 0x7efd481f58b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T10:00:00.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.272+0000 7f89b1400640 1 -- 172.21.15.57:0/2383447535 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f89ac0d3fe0 msgr2=0x7f89ac200b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:00.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.272+0000 7f82a6000640 1 -- 172.21.15.57:0/1740533524 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82a0018070 con 0x7f82ac0d2820 2024-03-27T10:00:00.317 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.272+0000 7f82a6000640 1 -- 172.21.15.57:0/1740533524 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82a0007500 con 0x7f82ac0d2820 2024-03-27T10:00:00.317 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.272+0000 7f82a6000640 1 -- 172.21.15.57:0/1740533524 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82a0004a20 con 0x7f82ac0d2820 2024-03-27T10:00:00.317 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.272+0000 7f82b3200640 1 -- 172.21.15.57:0/1740533524 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82ac154360 con 0x7f82ac0d2820 2024-03-27T10:00:00.317 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.272+0000 7f82b3200640 1 -- 172.21.15.57:0/1740533524 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82ac154920 con 0x7f82ac0d2820 2024-03-27T10:00:00.317 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.272+0000 7f89b1400640 1 --2- 172.21.15.57:0/2383447535 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f89ac0d3fe0 0x7f89ac200b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:00.317 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.272+0000 7f89b1400640 1 -- 172.21.15.57:0/2383447535 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f89ac15e4a0 msgr2=0x7f89ac0c9780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:00.317 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.272+0000 7f89b1400640 1 --2- 172.21.15.57:0/2383447535 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f89ac15e4a0 0x7f89ac0c9780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:00.317 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.272+0000 7f89b1400640 1 -- 172.21.15.57:0/2383447535 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89ac201080 con 0x7f89ac0ceee0 2024-03-27T10:00:00.317 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.272+0000 7f89b0a00640 1 --2- 172.21.15.57:0/2383447535 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f89ac0d3fe0 0x7f89ac200b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T10:00:00.318 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.272+0000 7f75db400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f75d40ceee0 0x7f75d40b6e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:00.318 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.272+0000 7f75db400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f75d40d3fe0 0x7f75d415bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:00.318 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.272+0000 7f75db400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f75d415e4a0 0x7f75d414c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:00.318 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.272+0000 7f75db400640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f75d40b3000 con 0x7f75d415e4a0 2024-03-27T10:00:00.318 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.272+0000 7f75db400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f75d40b2e80 con 0x7f75d40ceee0 2024-03-27T10:00:00.318 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.272+0000 7f75db400640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f75d40b3180 con 0x7f75d40d3fe0 2024-03-27T10:00:00.318 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.273+0000 7f89b1400640 1 --2- 172.21.15.57:0/2383447535 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f89ac0ceee0 0x7f89ac0b8e10 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f89a4032000 tx=0x7f89a4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:00.319 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.272+0000 7f055ca00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f055806bf90 0x7f0558151420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:00.319 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.273+0000 7f055ca00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0558071200 0x7f0558155350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:00.319 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.273+0000 7f055ca00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f055815a1b0 0x7f05580cc700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:00.319 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.273+0000 7f055ca00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f05580b4870 con 0x7f0558071200 2024-03-27T10:00:00.319 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.273+0000 7f055ca00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f05580b4350 con 0x7f055815a1b0 2024-03-27T10:00:00.319 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.273+0000 7f055ca00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f055815a590 con 0x7f055806bf90 2024-03-27T10:00:00.320 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.272+0000 7f90f0c00640 1 -- 172.21.15.57:0/3024026798 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f90ec0ca8e0 msgr2=0x7f90ec0b6460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:00.320 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.272+0000 7f90f0c00640 1 --2- 172.21.15.57:0/3024026798 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f90ec0ca8e0 0x7f90ec0b6460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:00.320 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.272+0000 7f90f0c00640 1 -- 172.21.15.57:0/3024026798 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f90d0005100 msgr2=0x7f90ec1f01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:00.320 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.272+0000 7f90f0c00640 1 --2- 172.21.15.57:0/3024026798 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f90d0005100 0x7f90ec1f01e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:00.320 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.273+0000 7f90f0c00640 1 -- 172.21.15.57:0/3024026798 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90ec0cbdb0 con 0x7f90ec1f2f30 2024-03-27T10:00:00.320 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.273+0000 7f3e8ea00640 1 -- 172.21.15.57:0/2495989815 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3e900ceee0 msgr2=0x7f3e900cb360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:00.320 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.273+0000 7f3e8ea00640 1 --2- 172.21.15.57:0/2495989815 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3e900ceee0 0x7f3e900cb360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:00.320 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.273+0000 7f3e8ea00640 1 -- 172.21.15.57:0/2495989815 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e9015e4a0 msgr2=0x7f3e900cbee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:00.321 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.273+0000 7f0555e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f055806bf90 0x7f0558151420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:00.321 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.273+0000 7ff416000640 1 -- 172.21.15.57:0/2048038801 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff410068620 con 0x7ff41006b7a0 2024-03-27T10:00:00.321 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.273+0000 7f0555e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f055806bf90 0x7f0558151420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.57:33562/0 (socket says 172.21.15.57:33562) 2024-03-27T10:00:00.321 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.273+0000 7f0555e00640 1 -- 172.21.15.57:0/2384438750 learned_addr learned my addr 172.21.15.57:0/2384438750 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:00.322 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.273+0000 7f75d3e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f75d40d3fe0 0x7f75d415bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:00.322 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.273+0000 7f75d8a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f75d40ceee0 0x7f75d40b6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:00.322 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.273+0000 7f75d8a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f75d40ceee0 0x7f75d40b6e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.57:52800/0 (socket says 172.21.15.57:52800) 2024-03-27T10:00:00.322 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.273+0000 7f75d8a00640 1 -- 172.21.15.57:0/3439568189 learned_addr learned my addr 172.21.15.57:0/3439568189 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:00.322 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.273+0000 7f3e8ea00640 1 --2- 172.21.15.57:0/2495989815 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e9015e4a0 0x7f3e900cbee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:00.322 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.273+0000 7f3e8ea00640 1 -- 172.21.15.57:0/2495989815 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e900b3d80 con 0x7f3e900d3fe0 2024-03-27T10:00:00.323 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.273+0000 7f0555400640 1 --2- 172.21.15.57:0/2384438750 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0558071200 0x7f0558155350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:00.323 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.273+0000 7efd4e600640 1 --2- 172.21.15.57:0/2621764796 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efd48162150 0x7efd481f5df0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7efd4000c550 tx=0x7efd4000ca10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:00.323 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.274+0000 7f75d9400640 1 --2- 172.21.15.57:0/3439568189 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f75d415e4a0 0x7f75d414c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:00.324 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.274+0000 7f3e8fe00640 1 --2- 172.21.15.57:0/2495989815 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e9015e4a0 0x7f3e900cbee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T10:00:00.324 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.274+0000 7f3e8ea00640 1 --2- 172.21.15.57:0/2495989815 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3e900d3fe0 0x7f3e90155260 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f3e7c00e610 tx=0x7f3e7c00ead0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:00.324 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.274+0000 7f90f0c00640 1 --2- 172.21.15.57:0/3024026798 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f90ec1f2f30 0x7f90ec0cd430 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f90e400a940 tx=0x7f90e4001da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:00.324 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.274+0000 7f82b3200640 1 -- 172.21.15.57:0/1740533524 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f82ac068540 con 0x7f82ac0d2820 2024-03-27T10:00:00.325 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.274+0000 7f0556800640 1 --2- 172.21.15.57:0/2384438750 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f055815a1b0 0x7f05580cc700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:00.325 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.274+0000 7f0555e00640 1 -- 172.21.15.57:0/2384438750 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f055815a1b0 msgr2=0x7f05580cc700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:00.325 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.274+0000 7f75d3e00640 1 -- 172.21.15.57:0/3439568189 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f75d40ceee0 msgr2=0x7f75d40b6e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:00.325 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.274+0000 7f75d3e00640 1 --2- 172.21.15.57:0/3439568189 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f75d40ceee0 0x7f75d40b6e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:00.325 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.274+0000 7f75d3e00640 1 -- 172.21.15.57:0/3439568189 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f75d415e4a0 msgr2=0x7f75d414c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:00.325 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.274+0000 7f75d3e00640 1 --2- 172.21.15.57:0/3439568189 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f75d415e4a0 0x7f75d414c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:00.325 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.274+0000 7f75d3e00640 1 -- 172.21.15.57:0/3439568189 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75d4158b10 con 0x7f75d40d3fe0 2024-03-27T10:00:00.326 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.274+0000 7f75d8a00640 1 --2- 172.21.15.57:0/3439568189 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f75d40ceee0 0x7f75d40b6e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T10:00:00.326 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.275+0000 7f3e87400640 1 -- 172.21.15.57:0/2495989815 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e7c00f040 con 0x7f3e900d3fe0 2024-03-27T10:00:00.326 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.274+0000 7f89a9600640 1 -- 172.21.15.57:0/2383447535 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89a4043020 con 0x7f89ac0ceee0 2024-03-27T10:00:00.326 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.274+0000 7f89a9600640 1 -- 172.21.15.57:0/2383447535 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89a403e450 con 0x7f89ac0ceee0 2024-03-27T10:00:00.326 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.275+0000 7f89a9600640 1 -- 172.21.15.57:0/2383447535 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89a4009510 con 0x7f89ac0ceee0 2024-03-27T10:00:00.326 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.275+0000 7f89b3e00640 1 -- 172.21.15.57:0/2383447535 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89ac0ca000 con 0x7f89ac0ceee0 2024-03-27T10:00:00.327 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.275+0000 7f89b3e00640 1 -- 172.21.15.57:0/2383447535 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89ac0ca5c0 con 0x7f89ac0ceee0 2024-03-27T10:00:00.327 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.274+0000 7f0555e00640 1 --2- 172.21.15.57:0/2384438750 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f055815a1b0 0x7f05580cc700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:00.327 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.274+0000 7f0555e00640 1 -- 172.21.15.57:0/2384438750 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0558071200 msgr2=0x7f0558155350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:00.327 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.274+0000 7f0555e00640 1 --2- 172.21.15.57:0/2384438750 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0558071200 0x7f0558155350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:00.327 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.275+0000 7efd45600640 1 -- 172.21.15.57:0/2621764796 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd40015070 con 0x7efd48162150 2024-03-27T10:00:00.328 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.275+0000 7efd45600640 1 -- 172.21.15.57:0/2621764796 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd40004220 con 0x7efd48162150 2024-03-27T10:00:00.328 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.275+0000 7efd45600640 1 -- 172.21.15.57:0/2621764796 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd40003610 con 0x7efd48162150 2024-03-27T10:00:00.328 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.274+0000 7f0555e00640 1 -- 172.21.15.57:0/2384438750 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0558151d00 con 0x7f055806bf90 2024-03-27T10:00:00.328 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.275+0000 7f0556800640 1 --2- 172.21.15.57:0/2384438750 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f055815a1b0 0x7f05580cc700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T10:00:00.328 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.275+0000 7f0555400640 1 --2- 172.21.15.57:0/2384438750 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0558071200 0x7f0558155350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T10:00:00.328 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.275+0000 7efd4f000640 1 -- 172.21.15.57:0/2621764796 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd481f45b0 con 0x7efd48162150 2024-03-27T10:00:00.328 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.275+0000 7efd4f000640 1 -- 172.21.15.57:0/2621764796 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd481f4b70 con 0x7efd48162150 2024-03-27T10:00:00.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.277+0000 7efd4f000640 1 -- 172.21.15.57:0/2621764796 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7efd481f4f50 con 0x7efd48162150 2024-03-27T10:00:00.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.276+0000 7f75d3e00640 1 --2- 172.21.15.57:0/3439568189 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f75d40d3fe0 0x7f75d415bf60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f75c000c340 tx=0x7f75c000c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:00.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.276+0000 7f75d0c00640 1 -- 172.21.15.57:0/3439568189 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75c00052d0 con 0x7f75d40d3fe0 2024-03-27T10:00:00.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.277+0000 7f75d0c00640 1 -- 172.21.15.57:0/3439568189 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75c0005490 con 0x7f75d40d3fe0 2024-03-27T10:00:00.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.277+0000 7f75d0c00640 1 -- 172.21.15.57:0/3439568189 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75c0007260 con 0x7f75d40d3fe0 2024-03-27T10:00:00.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.277+0000 7f75db400640 1 -- 172.21.15.57:0/3439568189 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75d40b7500 con 0x7f75d40d3fe0 2024-03-27T10:00:00.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.277+0000 7f75db400640 1 -- 172.21.15.57:0/3439568189 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f75d40b7ac0 con 0x7f75d40d3fe0 2024-03-27T10:00:00.330 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.275+0000 7f3e87400640 1 -- 172.21.15.57:0/2495989815 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e7c004230 con 0x7f3e900d3fe0 2024-03-27T10:00:00.330 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.275+0000 7f3e87400640 1 -- 172.21.15.57:0/2495989815 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e7c003610 con 0x7f3e900d3fe0 2024-03-27T10:00:00.330 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.276+0000 7f3e96400640 1 -- 172.21.15.57:0/2495989815 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e9015c900 con 0x7f3e900d3fe0 2024-03-27T10:00:00.330 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.276+0000 7f3e96400640 1 -- 172.21.15.57:0/2495989815 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e901557a0 con 0x7f3e900d3fe0 2024-03-27T10:00:00.330 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.276+0000 7f89b3e00640 1 -- 172.21.15.57:0/2383447535 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f89ac0cac80 con 0x7f89ac0ceee0 2024-03-27T10:00:00.330 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.276+0000 7f0555e00640 1 --2- 172.21.15.57:0/2384438750 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f055806bf90 0x7f0558151420 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f055000c530 tx=0x7f055000c9f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:00.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.277+0000 7f3e84c00640 1 -- 172.21.15.57:0/2495989815 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3e64001030 con 0x7f3e900d3fe0 2024-03-27T10:00:00.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.277+0000 7f90e3e00640 1 -- 172.21.15.57:0/3024026798 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90e4002080 con 0x7f90ec1f2f30 2024-03-27T10:00:00.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.278+0000 7f054e000640 1 -- 172.21.15.57:0/2384438750 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0550017070 con 0x7f055806bf90 2024-03-27T10:00:00.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.278+0000 7f054e000640 1 -- 172.21.15.57:0/2384438750 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0550005ce0 con 0x7f055806bf90 2024-03-27T10:00:00.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.278+0000 7f054e000640 1 -- 172.21.15.57:0/2384438750 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0550007290 con 0x7f055806bf90 2024-03-27T10:00:00.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.278+0000 7f055ca00640 1 -- 172.21.15.57:0/2384438750 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f055815aba0 con 0x7f055806bf90 2024-03-27T10:00:00.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.275+0000 7ff407400640 1 -- 172.21.15.57:0/2048038801 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7ff40801a070 con 0x7ff41006b7a0 2024-03-27T10:00:00.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.277+0000 7ff407400640 1 --2- 172.21.15.57:0/2048038801 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7ff3ec06c530 0x7ff3ec06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:00.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.277+0000 7ff407400640 1 -- 172.21.15.57:0/2048038801 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7ff40808b9e0 con 0x7ff41006b7a0 2024-03-27T10:00:00.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.277+0000 7ff407400640 1 --2- 172.21.15.57:0/2048038801 >> [v2:172.21.15.57:6800/2020036298,v1:172.21.15.57:6801/2020036298] conn(0x7ff3ec075ba0 0x7ff3ec077fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:00.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.277+0000 7ff407400640 1 -- 172.21.15.57:0/2048038801 --> [v2:172.21.15.57:6800/2020036298,v1:172.21.15.57:6801/2020036298] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff3ec0786b0 con 0x7ff3ec075ba0 2024-03-27T10:00:00.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.278+0000 7ff407400640 1 -- 172.21.15.57:0/2048038801 <== mon.1 v2:172.21.15.118:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7ff40808be70 con 0x7ff41006b7a0 2024-03-27T10:00:00.333 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.278+0000 7f75db400640 1 -- 172.21.15.57:0/3439568189 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f75b0001030 con 0x7f75d40d3fe0 2024-03-27T10:00:00.333 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.278+0000 7f055ca00640 1 -- 172.21.15.57:0/2384438750 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f055815b230 con 0x7f055806bf90 2024-03-27T10:00:00.333 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.279+0000 7f90f1600640 1 -- 172.21.15.57:0/3024026798 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90ec0b46d0 con 0x7f90ec1f2f30 2024-03-27T10:00:00.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.279+0000 7f90f1600640 1 -- 172.21.15.57:0/3024026798 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90ec0b4c90 con 0x7f90ec1f2f30 2024-03-27T10:00:00.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.279+0000 7ff40fe00640 1 --2- 172.21.15.57:0/2048038801 >> [v2:172.21.15.57:6800/2020036298,v1:172.21.15.57:6801/2020036298] conn(0x7ff3ec075ba0 0x7ff3ec077fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:00.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.279+0000 7ff40ea00640 1 --2- 172.21.15.57:0/2048038801 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7ff3ec06c530 0x7ff3ec06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:00.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.278+0000 7f89a9600640 1 -- 172.21.15.57:0/2383447535 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f89a4046020 con 0x7f89ac0ceee0 2024-03-27T10:00:00.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.279+0000 7f055ca00640 1 -- 172.21.15.57:0/2384438750 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f055815ae40 con 0x7f055806bf90 2024-03-27T10:00:00.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.278+0000 7f82a6000640 1 -- 172.21.15.57:0/1740533524 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f82a001b070 con 0x7f82ac0d2820 2024-03-27T10:00:00.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.280+0000 7f89a9600640 1 --2- 172.21.15.57:0/2383447535 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f898c06c580 0x7f898c06ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:00.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.280+0000 7f82a6000640 1 --2- 172.21.15.57:0/1740533524 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f829006c580 0x7f829006ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:00.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.280+0000 7f89a9600640 1 -- 172.21.15.57:0/2383447535 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f89a40ae560 con 0x7f89ac0ceee0 2024-03-27T10:00:00.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.280+0000 7f90e3e00640 1 -- 172.21.15.57:0/3024026798 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90e4044070 con 0x7f90ec1f2f30 2024-03-27T10:00:00.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.280+0000 7f90e3e00640 1 -- 172.21.15.57:0/3024026798 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90e4002080 con 0x7f90ec1f2f30 2024-03-27T10:00:00.337 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.280+0000 7f89a9600640 1 --2- 172.21.15.57:0/2383447535 >> [v2:172.21.15.118:6816/2704605866,v1:172.21.15.118:6817/2704605866] conn(0x7f898c075cf0 0x7f898c078130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:00.337 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.280+0000 7f82a6000640 1 -- 172.21.15.57:0/1740533524 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f82a008b5a0 con 0x7f82ac0d2820 2024-03-27T10:00:00.337 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.280+0000 7f89a9600640 1 -- 172.21.15.57:0/2383447535 --> [v2:172.21.15.118:6816/2704605866,v1:172.21.15.118:6817/2704605866] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f89a400ae60 con 0x7f898c075cf0 2024-03-27T10:00:00.337 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.280+0000 7f89a9600640 1 -- 172.21.15.57:0/2383447535 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f89a40ae910 con 0x7f89ac0ceee0 2024-03-27T10:00:00.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.281+0000 7f82a6000640 1 --2- 172.21.15.57:0/1740533524 >> [v2:172.21.15.57:6824/158084809,v1:172.21.15.57:6825/158084809] conn(0x7f8290075d00 0x7f8290078140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:00.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.281+0000 7f82a6000640 1 -- 172.21.15.57:0/1740533524 --> [v2:172.21.15.57:6824/158084809,v1:172.21.15.57:6825/158084809] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8290078810 con 0x7f8290075d00 2024-03-27T10:00:00.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.281+0000 7f82a6000640 1 -- 172.21.15.57:0/1740533524 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f82a008b950 con 0x7f82ac0d2820 2024-03-27T10:00:00.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.281+0000 7f82b1400640 1 --2- 172.21.15.57:0/1740533524 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f829006c580 0x7f829006ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:00.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.281+0000 7f89b1e00640 1 --2- 172.21.15.57:0/2383447535 >> [v2:172.21.15.118:6816/2704605866,v1:172.21.15.118:6817/2704605866] conn(0x7f898c075cf0 0x7f898c078130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:00.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.281+0000 7f90f1600640 1 -- 172.21.15.57:0/3024026798 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f90c4001030 con 0x7f90ec1f2f30 2024-03-27T10:00:00.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.281+0000 7efd45600640 1 -- 172.21.15.57:0/2621764796 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7efd400037b0 con 0x7efd48162150 2024-03-27T10:00:00.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.281+0000 7f82b2800640 1 --2- 172.21.15.57:0/1740533524 >> [v2:172.21.15.57:6824/158084809,v1:172.21.15.57:6825/158084809] conn(0x7f8290075d00 0x7f8290078140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:00.340 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.282+0000 7f89b1e00640 1 --2- 172.21.15.57:0/2383447535 >> [v2:172.21.15.118:6816/2704605866,v1:172.21.15.118:6817/2704605866] conn(0x7f898c075cf0 0x7f898c078130 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:00.340 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.283+0000 7efd45600640 1 --2- 172.21.15.57:0/2621764796 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7efd2806c630 0x7efd2806eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:00.341 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.282+0000 7f75d0c00640 1 -- 172.21.15.57:0/3439568189 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f75c0007400 con 0x7f75d40d3fe0 2024-03-27T10:00:00.341 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.283+0000 7f75d0c00640 1 --2- 172.21.15.57:0/3439568189 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f75b406c600 0x7f75b406eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:00.341 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.283+0000 7f75d0c00640 1 -- 172.21.15.57:0/3439568189 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f75c008b670 con 0x7f75d40d3fe0 2024-03-27T10:00:00.341 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.283+0000 7efd45600640 1 -- 172.21.15.57:0/2621764796 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7efd4008bd20 con 0x7efd48162150 2024-03-27T10:00:00.341 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.283+0000 7efd45600640 1 --2- 172.21.15.57:0/2621764796 >> [v2:172.21.15.57:6808/3190929242,v1:172.21.15.57:6809/3190929242] conn(0x7efd28075db0 0x7efd280781f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:00.341 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.283+0000 7efd45600640 1 -- 172.21.15.57:0/2621764796 --> [v2:172.21.15.57:6808/3190929242,v1:172.21.15.57:6809/3190929242] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efd40020e50 con 0x7efd28075db0 2024-03-27T10:00:00.341 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.283+0000 7efd45600640 1 -- 172.21.15.57:0/2621764796 <== mon.1 v2:172.21.15.118:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7efd4008c110 con 0x7efd48162150 2024-03-27T10:00:00.342 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.283+0000 7f82b1400640 1 --2- 172.21.15.57:0/1740533524 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f829006c580 0x7f829006ea40 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f829c036000 tx=0x7f829c008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:00.342 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.283+0000 7f82b2800640 1 --2- 172.21.15.57:0/1740533524 >> [v2:172.21.15.57:6824/158084809,v1:172.21.15.57:6825/158084809] conn(0x7f8290075d00 0x7f8290078140 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:00.342 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.283+0000 7f3e87400640 1 -- 172.21.15.57:0/2495989815 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f3e7c0037b0 con 0x7f3e900d3fe0 2024-03-27T10:00:00.343 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.283+0000 7f75d0c00640 1 --2- 172.21.15.57:0/3439568189 >> [v2:172.21.15.57:6816/4065849973,v1:172.21.15.57:6817/4065849973] conn(0x7f75b4075d80 0x7f75b40781c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:00.343 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.283+0000 7f75d0c00640 1 -- 172.21.15.57:0/3439568189 --> [v2:172.21.15.57:6816/4065849973,v1:172.21.15.57:6817/4065849973] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f75c0009e50 con 0x7f75b4075d80 2024-03-27T10:00:00.343 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.283+0000 7f75d0c00640 1 -- 172.21.15.57:0/3439568189 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f75c008ba60 con 0x7f75d40d3fe0 2024-03-27T10:00:00.343 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.284+0000 7f75d9400640 1 --2- 172.21.15.57:0/3439568189 >> [v2:172.21.15.57:6816/4065849973,v1:172.21.15.57:6817/4065849973] conn(0x7f75b4075d80 0x7f75b40781c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:00.344 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.284+0000 7efd4d200640 1 --2- 172.21.15.57:0/2621764796 >> [v2:172.21.15.57:6808/3190929242,v1:172.21.15.57:6809/3190929242] conn(0x7efd28075db0 0x7efd280781f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:00.344 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.284+0000 7efd4dc00640 1 --2- 172.21.15.57:0/2621764796 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7efd2806c630 0x7efd2806eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:00.344 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.284+0000 7f89a9600640 1 -- 172.21.15.57:0/2383447535 <== osd.5 v2:172.21.15.118:6816/2704605866 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f89a400ae60 con 0x7f898c075cf0 2024-03-27T10:00:00.344 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.284+0000 7f75d8a00640 1 --2- 172.21.15.57:0/3439568189 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f75b406c600 0x7f75b406eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:00.344 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.285+0000 7f75d9400640 1 --2- 172.21.15.57:0/3439568189 >> [v2:172.21.15.57:6816/4065849973,v1:172.21.15.57:6817/4065849973] conn(0x7f75b4075d80 0x7f75b40781c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:00.345 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.285+0000 7f3e87400640 1 --2- 172.21.15.57:0/2495989815 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f3e7006c530 0x7f3e7006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:00.345 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.285+0000 7f3e87400640 1 -- 172.21.15.57:0/2495989815 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f3e7c08b810 con 0x7f3e900d3fe0 2024-03-27T10:00:00.345 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.285+0000 7f3e8f400640 1 --2- 172.21.15.57:0/2495989815 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f3e7006c530 0x7f3e7006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:00.345 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.285+0000 7f054e000640 1 -- 172.21.15.57:0/2384438750 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f055001a070 con 0x7f055806bf90 2024-03-27T10:00:00.346 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.285+0000 7f3e87400640 1 --2- 172.21.15.57:0/2495989815 >> [v2:172.21.15.118:6821/108719401,v1:172.21.15.118:6823/108719401] conn(0x7f3e70075ca0 0x7f3e700780e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:00.346 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.285+0000 7f3e87400640 1 -- 172.21.15.57:0/2495989815 --> [v2:172.21.15.118:6821/108719401,v1:172.21.15.118:6823/108719401] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3e7c019e70 con 0x7f3e70075ca0 2024-03-27T10:00:00.346 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.285+0000 7f3e87400640 1 -- 172.21.15.57:0/2495989815 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f3e7c08bc00 con 0x7f3e900d3fe0 2024-03-27T10:00:00.346 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.286+0000 7f89b0a00640 1 --2- 172.21.15.57:0/2383447535 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f898c06c580 0x7f898c06ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:00.346 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.286+0000 7f82a6000640 1 -- 172.21.15.57:0/1740533524 <== osd.3 v2:172.21.15.57:6824/158084809 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8290078810 con 0x7f8290075d00 2024-03-27T10:00:00.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.286+0000 7f75d0c00640 1 -- 172.21.15.57:0/3439568189 <== osd.2 v2:172.21.15.57:6816/4065849973 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f75c0009e50 con 0x7f75b4075d80 2024-03-27T10:00:00.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.285+0000 7efd4d200640 1 --2- 172.21.15.57:0/2621764796 >> [v2:172.21.15.57:6808/3190929242,v1:172.21.15.57:6809/3190929242] conn(0x7efd28075db0 0x7efd280781f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:00.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.287+0000 7f054e000640 1 --2- 172.21.15.57:0/2384438750 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f053406c600 0x7f053406eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:00.348 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.287+0000 7f90e3e00640 1 -- 172.21.15.57:0/3024026798 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f90e403c070 con 0x7f90ec1f2f30 2024-03-27T10:00:00.348 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.287+0000 7efd4dc00640 1 --2- 172.21.15.57:0/2621764796 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7efd2806c630 0x7efd2806eaf0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7efd34036000 tx=0x7efd3403c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:00.348 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.287+0000 7f054e000640 1 -- 172.21.15.57:0/2384438750 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f055008b470 con 0x7f055806bf90 2024-03-27T10:00:00.349 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.285+0000 7ff40fe00640 1 --2- 172.21.15.57:0/2048038801 >> [v2:172.21.15.57:6800/2020036298,v1:172.21.15.57:6801/2020036298] conn(0x7ff3ec075ba0 0x7ff3ec077fe0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:00.349 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.285+0000 7ff40ea00640 1 --2- 172.21.15.57:0/2048038801 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7ff3ec06c530 0x7ff3ec06e9f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff3f8036000 tx=0x7ff3f8008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:00.349 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.287+0000 7efd45600640 1 -- 172.21.15.57:0/2621764796 <== osd.1 v2:172.21.15.57:6808/3190929242 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7efd40020e50 con 0x7efd28075db0 2024-03-27T10:00:00.349 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.287+0000 7f054e000640 1 --2- 172.21.15.57:0/2384438750 >> [v2:172.21.15.118:6800/1963659095,v1:172.21.15.118:6801/1963659095] conn(0x7f0534075d80 0x7f05340781c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:00.349 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.287+0000 7f054e000640 1 -- 172.21.15.57:0/2384438750 --> [v2:172.21.15.118:6800/1963659095,v1:172.21.15.118:6801/1963659095] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f055001ae50 con 0x7f0534075d80 2024-03-27T10:00:00.349 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.287+0000 7f054e000640 1 -- 172.21.15.57:0/2384438750 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f055008b860 con 0x7f055806bf90 2024-03-27T10:00:00.350 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.287+0000 7f3e8fe00640 1 --2- 172.21.15.57:0/2495989815 >> [v2:172.21.15.118:6821/108719401,v1:172.21.15.118:6823/108719401] conn(0x7f3e70075ca0 0x7f3e700780e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:00.350 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.287+0000 7f0555400640 1 --2- 172.21.15.57:0/2384438750 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f053406c600 0x7f053406eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:00.350 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.288+0000 7ff407400640 1 -- 172.21.15.57:0/2048038801 <== osd.0 v2:172.21.15.57:6800/2020036298 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff3ec0786b0 con 0x7ff3ec075ba0 2024-03-27T10:00:00.351 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.288+0000 7f75d8a00640 1 --2- 172.21.15.57:0/3439568189 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f75b406c600 0x7f75b406eac0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f75c800af50 tx=0x7f75c8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:00.351 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.288+0000 7f0556800640 1 --2- 172.21.15.57:0/2384438750 >> [v2:172.21.15.118:6800/1963659095,v1:172.21.15.118:6801/1963659095] conn(0x7f0534075d80 0x7f05340781c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:00.351 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.288+0000 7f90e3e00640 1 --2- 172.21.15.57:0/3024026798 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f90cc06c760 0x7f90cc06ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:00.351 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.288+0000 7f90e3e00640 1 -- 172.21.15.57:0/3024026798 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f90e40ad860 con 0x7f90ec1f2f30 2024-03-27T10:00:00.352 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.288+0000 7f3e8f400640 1 --2- 172.21.15.57:0/2495989815 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f3e7006c530 0x7f3e7006e9f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3e80006d40 tx=0x7f3e80008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:00.352 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.289+0000 7f3e8fe00640 1 --2- 172.21.15.57:0/2495989815 >> [v2:172.21.15.118:6821/108719401,v1:172.21.15.118:6823/108719401] conn(0x7f3e70075ca0 0x7f3e700780e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:00.352 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.288+0000 7f90e3e00640 1 --2- 172.21.15.57:0/3024026798 >> [v2:172.21.15.118:6808/1955879596,v1:172.21.15.118:6809/1955879596] conn(0x7f90cc075ee0 0x7f90cc078320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:00.352 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.289+0000 7f89b0a00640 1 --2- 172.21.15.57:0/2383447535 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f898c06c580 0x7f898c06ea40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f89a0006fd0 tx=0x7f89a0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:00.353 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.289+0000 7f0555400640 1 --2- 172.21.15.57:0/2384438750 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f053406c600 0x7f053406eac0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0548036000 tx=0x7f0548030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:00.353 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.288+0000 7f90e3e00640 1 -- 172.21.15.57:0/3024026798 --> [v2:172.21.15.118:6808/1955879596,v1:172.21.15.118:6809/1955879596] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f90e404ee50 con 0x7f90cc075ee0 2024-03-27T10:00:00.353 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.288+0000 7f90e3e00640 1 -- 172.21.15.57:0/3024026798 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f90e40adc50 con 0x7f90ec1f2f30 2024-03-27T10:00:00.353 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.289+0000 7f90eb400640 1 --2- 172.21.15.57:0/3024026798 >> [v2:172.21.15.118:6808/1955879596,v1:172.21.15.118:6809/1955879596] conn(0x7f90cc075ee0 0x7f90cc078320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:00.354 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.290+0000 7f0556800640 1 --2- 172.21.15.57:0/2384438750 >> [v2:172.21.15.118:6800/1963659095,v1:172.21.15.118:6801/1963659095] conn(0x7f0534075d80 0x7f05340781c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:00.354 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.289+0000 7f90ebe00640 1 --2- 172.21.15.57:0/3024026798 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f90cc06c760 0x7f90cc06ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:00.354 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.290+0000 7f90eb400640 1 --2- 172.21.15.57:0/3024026798 >> [v2:172.21.15.118:6808/1955879596,v1:172.21.15.118:6809/1955879596] conn(0x7f90cc075ee0 0x7f90cc078320 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:00.354 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.291+0000 7f3e87400640 1 -- 172.21.15.57:0/2495989815 <== osd.4 v2:172.21.15.118:6821/108719401 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3e7c019e70 con 0x7f3e70075ca0 2024-03-27T10:00:00.355 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.291+0000 7f90ebe00640 1 --2- 172.21.15.57:0/3024026798 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f90cc06c760 0x7f90cc06ec20 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f90ec08c870 tx=0x7f90dc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:00.355 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.292+0000 7f054e000640 1 -- 172.21.15.57:0/2384438750 <== osd.6 v2:172.21.15.118:6800/1963659095 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f055001ae50 con 0x7f0534075d80 2024-03-27T10:00:00.355 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.292+0000 7f90e3e00640 1 -- 172.21.15.57:0/3024026798 <== osd.7 v2:172.21.15.118:6808/1955879596 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f90e404ee50 con 0x7f90cc075ee0 2024-03-27T10:00:00.356 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.305+0000 7f75db400640 1 -- 172.21.15.57:0/3439568189 --> [v2:172.21.15.57:6816/4065849973,v1:172.21.15.57:6817/4065849973] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f75b0002dd0 con 0x7f75b4075d80 2024-03-27T10:00:00.356 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.306+0000 7f75d0c00640 1 -- 172.21.15.57:0/3439568189 <== osd.2 v2:172.21.15.57:6816/4065849973 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f75b0002dd0 con 0x7f75b4075d80 2024-03-27T10:00:00.357 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.307+0000 7f75db400640 1 -- 172.21.15.57:0/3439568189 >> [v2:172.21.15.57:6816/4065849973,v1:172.21.15.57:6817/4065849973] conn(0x7f75b4075d80 msgr2=0x7f75b40781c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:00.357 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.307+0000 7f75db400640 1 --2- 172.21.15.57:0/3439568189 >> [v2:172.21.15.57:6816/4065849973,v1:172.21.15.57:6817/4065849973] conn(0x7f75b4075d80 0x7f75b40781c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:00.357 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.308+0000 7f75db400640 1 -- 172.21.15.57:0/3439568189 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f75b406c600 msgr2=0x7f75b406eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:00.357 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.308+0000 7f75db400640 1 --2- 172.21.15.57:0/3439568189 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f75b406c600 0x7f75b406eac0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f75c800af50 tx=0x7f75c8008040 comp rx=0 tx=0).stop 2024-03-27T10:00:00.357 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.308+0000 7f75db400640 1 -- 172.21.15.57:0/3439568189 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f75d40d3fe0 msgr2=0x7f75d415bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:00.357 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.308+0000 7f75db400640 1 --2- 172.21.15.57:0/3439568189 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f75d40d3fe0 0x7f75d415bf60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f75c000c340 tx=0x7f75c000c800 comp rx=0 tx=0).stop 2024-03-27T10:00:00.357 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.308+0000 7f75d9400640 1 -- 172.21.15.57:0/3439568189 reap_dead start 2024-03-27T10:00:00.357 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.308+0000 7f75db400640 1 -- 172.21.15.57:0/3439568189 shutdown_connections 2024-03-27T10:00:00.357 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.308+0000 7f75db400640 1 -- 172.21.15.57:0/3439568189 >> 172.21.15.57:0/3439568189 conn(0x7f75d408db50 msgr2=0x7f75d40d43c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:00.357 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.308+0000 7f75db400640 1 -- 172.21.15.57:0/3439568189 shutdown_connections 2024-03-27T10:00:00.357 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.312+0000 7f75db400640 1 -- 172.21.15.57:0/3439568189 wait complete. 2024-03-27T10:00:00.358 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.315+0000 7f89b3e00640 1 -- 172.21.15.57:0/2383447535 --> [v2:172.21.15.118:6816/2704605866,v1:172.21.15.118:6817/2704605866] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f89ac068620 con 0x7f898c075cf0 2024-03-27T10:00:00.358 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.316+0000 7f89a9600640 1 -- 172.21.15.57:0/2383447535 <== osd.5 v2:172.21.15.118:6816/2704605866 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f89ac068620 con 0x7f898c075cf0 2024-03-27T10:00:00.359 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.317+0000 7f89b3e00640 1 -- 172.21.15.57:0/2383447535 >> [v2:172.21.15.118:6816/2704605866,v1:172.21.15.118:6817/2704605866] conn(0x7f898c075cf0 msgr2=0x7f898c078130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:00.359 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.317+0000 7f89b3e00640 1 --2- 172.21.15.57:0/2383447535 >> [v2:172.21.15.118:6816/2704605866,v1:172.21.15.118:6817/2704605866] conn(0x7f898c075cf0 0x7f898c078130 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:00.359 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.317+0000 7f89b3e00640 1 -- 172.21.15.57:0/2383447535 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f898c06c580 msgr2=0x7f898c06ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:00.359 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.317+0000 7f89b3e00640 1 --2- 172.21.15.57:0/2383447535 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f898c06c580 0x7f898c06ea40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f89a0006fd0 tx=0x7f89a0008040 comp rx=0 tx=0).stop 2024-03-27T10:00:00.359 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.317+0000 7f89b3e00640 1 -- 172.21.15.57:0/2383447535 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f89ac0ceee0 msgr2=0x7f89ac0b8e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:00.359 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.317+0000 7f89b3e00640 1 --2- 172.21.15.57:0/2383447535 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f89ac0ceee0 0x7f89ac0b8e10 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f89a4032000 tx=0x7f89a4004a40 comp rx=0 tx=0).stop 2024-03-27T10:00:00.359 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.317+0000 7f89b1e00640 1 -- 172.21.15.57:0/2383447535 reap_dead start 2024-03-27T10:00:00.359 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.318+0000 7f89b3e00640 1 -- 172.21.15.57:0/2383447535 shutdown_connections 2024-03-27T10:00:00.360 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.318+0000 7f89b3e00640 1 -- 172.21.15.57:0/2383447535 >> 172.21.15.57:0/2383447535 conn(0x7f89ac08db50 msgr2=0x7f89ac0d2800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:00.360 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.318+0000 7f89b3e00640 1 -- 172.21.15.57:0/2383447535 shutdown_connections 2024-03-27T10:00:00.360 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.318+0000 7f89b3e00640 1 -- 172.21.15.57:0/2383447535 wait complete. 2024-03-27T10:00:00.360 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.321+0000 7efd4f000640 1 -- 172.21.15.57:0/2621764796 --> [v2:172.21.15.57:6808/3190929242,v1:172.21.15.57:6809/3190929242] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7efd481f6580 con 0x7efd28075db0 2024-03-27T10:00:00.360 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.322+0000 7efd45600640 1 -- 172.21.15.57:0/2621764796 <== osd.1 v2:172.21.15.57:6808/3190929242 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7efd481f6580 con 0x7efd28075db0 2024-03-27T10:00:00.361 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.322+0000 7efd4f000640 1 -- 172.21.15.57:0/2621764796 >> [v2:172.21.15.57:6808/3190929242,v1:172.21.15.57:6809/3190929242] conn(0x7efd28075db0 msgr2=0x7efd280781f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:00.361 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.322+0000 7efd4f000640 1 --2- 172.21.15.57:0/2621764796 >> [v2:172.21.15.57:6808/3190929242,v1:172.21.15.57:6809/3190929242] conn(0x7efd28075db0 0x7efd280781f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:00.361 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.323+0000 7efd4f000640 1 -- 172.21.15.57:0/2621764796 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7efd2806c630 msgr2=0x7efd2806eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:00.361 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.323+0000 7efd4f000640 1 --2- 172.21.15.57:0/2621764796 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7efd2806c630 0x7efd2806eaf0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7efd34036000 tx=0x7efd3403c040 comp rx=0 tx=0).stop 2024-03-27T10:00:00.361 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.323+0000 7efd4f000640 1 -- 172.21.15.57:0/2621764796 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efd48162150 msgr2=0x7efd481f5df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:00.361 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.323+0000 7efd4f000640 1 --2- 172.21.15.57:0/2621764796 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efd48162150 0x7efd481f5df0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7efd4000c550 tx=0x7efd4000ca10 comp rx=0 tx=0).stop 2024-03-27T10:00:00.361 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.323+0000 7efd4e600640 1 -- 172.21.15.57:0/2621764796 reap_dead start 2024-03-27T10:00:00.362 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.323+0000 7f82b3200640 1 -- 172.21.15.57:0/1740533524 --> [v2:172.21.15.57:6824/158084809,v1:172.21.15.57:6825/158084809] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f82ac155bc0 con 0x7f8290075d00 2024-03-27T10:00:00.362 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.325+0000 7efd4f000640 1 -- 172.21.15.57:0/2621764796 shutdown_connections 2024-03-27T10:00:00.362 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.325+0000 7efd4f000640 1 -- 172.21.15.57:0/2621764796 >> 172.21.15.57:0/2621764796 conn(0x7efd480d3f80 msgr2=0x7efd4806d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:00.362 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.325+0000 7f82a6000640 1 -- 172.21.15.57:0/1740533524 <== osd.3 v2:172.21.15.57:6824/158084809 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f82ac155bc0 con 0x7f8290075d00 2024-03-27T10:00:00.363 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.325+0000 7f055ca00640 1 -- 172.21.15.57:0/2384438750 --> [v2:172.21.15.118:6800/1963659095,v1:172.21.15.118:6801/1963659095] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f055815ae40 con 0x7f0534075d80 2024-03-27T10:00:00.363 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.326+0000 7f054e000640 1 -- 172.21.15.57:0/2384438750 <== osd.6 v2:172.21.15.118:6800/1963659095 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0540001350 con 0x7f0534075d80 2024-03-27T10:00:00.363 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.326+0000 7efd4f000640 1 -- 172.21.15.57:0/2621764796 shutdown_connections 2024-03-27T10:00:00.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.326+0000 7efd4f000640 1 -- 172.21.15.57:0/2621764796 wait complete. 2024-03-27T10:00:00.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.326+0000 7f90f1600640 1 -- 172.21.15.57:0/3024026798 --> [v2:172.21.15.118:6808/1955879596,v1:172.21.15.118:6809/1955879596] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f90c4002dd0 con 0x7f90cc075ee0 2024-03-27T10:00:00.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.327+0000 7f055ca00640 1 -- 172.21.15.57:0/2384438750 >> [v2:172.21.15.118:6800/1963659095,v1:172.21.15.118:6801/1963659095] conn(0x7f0534075d80 msgr2=0x7f05340781c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:00.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.327+0000 7f055ca00640 1 --2- 172.21.15.57:0/2384438750 >> [v2:172.21.15.118:6800/1963659095,v1:172.21.15.118:6801/1963659095] conn(0x7f0534075d80 0x7f05340781c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:00.365 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.327+0000 7f82b3200640 1 -- 172.21.15.57:0/1740533524 >> [v2:172.21.15.57:6824/158084809,v1:172.21.15.57:6825/158084809] conn(0x7f8290075d00 msgr2=0x7f8290078140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:00.365 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.327+0000 7f82b3200640 1 --2- 172.21.15.57:0/1740533524 >> [v2:172.21.15.57:6824/158084809,v1:172.21.15.57:6825/158084809] conn(0x7f8290075d00 0x7f8290078140 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:00.365 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.327+0000 7f055ca00640 1 -- 172.21.15.57:0/2384438750 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f053406c600 msgr2=0x7f053406eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:00.365 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.327+0000 7f055ca00640 1 --2- 172.21.15.57:0/2384438750 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f053406c600 0x7f053406eac0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0548036000 tx=0x7f0548030000 comp rx=0 tx=0).stop 2024-03-27T10:00:00.365 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.327+0000 7f055ca00640 1 -- 172.21.15.57:0/2384438750 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f055806bf90 msgr2=0x7f0558151420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:00.365 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.327+0000 7f055ca00640 1 --2- 172.21.15.57:0/2384438750 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f055806bf90 0x7f0558151420 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f055000c530 tx=0x7f055000c9f0 comp rx=0 tx=0).stop 2024-03-27T10:00:00.366 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.327+0000 7f0556800640 1 -- 172.21.15.57:0/2384438750 reap_dead start 2024-03-27T10:00:00.366 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.327+0000 7f90e3e00640 1 -- 172.21.15.57:0/3024026798 <== osd.7 v2:172.21.15.118:6808/1955879596 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f90c4002dd0 con 0x7f90cc075ee0 2024-03-27T10:00:00.366 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.327+0000 7f055ca00640 1 -- 172.21.15.57:0/2384438750 shutdown_connections 2024-03-27T10:00:00.366 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.327+0000 7f055ca00640 1 -- 172.21.15.57:0/2384438750 >> 172.21.15.57:0/2384438750 conn(0x7f05580b1c60 msgr2=0x7f0558153760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:00.366 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.328+0000 7f82b3200640 1 -- 172.21.15.57:0/1740533524 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f829006c580 msgr2=0x7f829006ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:00.367 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.328+0000 7f82b3200640 1 --2- 172.21.15.57:0/1740533524 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f829006c580 0x7f829006ea40 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f829c036000 tx=0x7f829c008030 comp rx=0 tx=0).stop 2024-03-27T10:00:00.367 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.328+0000 7f82b3200640 1 -- 172.21.15.57:0/1740533524 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f82ac0d2820 msgr2=0x7f82ac1f8510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:00.367 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.328+0000 7f82b3200640 1 --2- 172.21.15.57:0/1740533524 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f82ac0d2820 0x7f82ac1f8510 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f82a000c540 tx=0x7f82a000ca00 comp rx=0 tx=0).stop 2024-03-27T10:00:00.367 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.328+0000 7f82b2800640 1 -- 172.21.15.57:0/1740533524 reap_dead start 2024-03-27T10:00:00.367 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.328+0000 7f82b3200640 1 -- 172.21.15.57:0/1740533524 shutdown_connections 2024-03-27T10:00:00.367 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.328+0000 7f82b3200640 1 -- 172.21.15.57:0/1740533524 >> 172.21.15.57:0/1740533524 conn(0x7f82ac0d4030 msgr2=0x7f82ac06d060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:00.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.328+0000 7f90f1600640 1 -- 172.21.15.57:0/3024026798 >> [v2:172.21.15.118:6808/1955879596,v1:172.21.15.118:6809/1955879596] conn(0x7f90cc075ee0 msgr2=0x7f90cc078320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:00.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.328+0000 7f90f1600640 1 --2- 172.21.15.57:0/3024026798 >> [v2:172.21.15.118:6808/1955879596,v1:172.21.15.118:6809/1955879596] conn(0x7f90cc075ee0 0x7f90cc078320 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:00.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.328+0000 7f82b3200640 1 -- 172.21.15.57:0/1740533524 shutdown_connections 2024-03-27T10:00:00.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.328+0000 7f82b3200640 1 -- 172.21.15.57:0/1740533524 wait complete. 2024-03-27T10:00:00.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.328+0000 7ff416000640 1 -- 172.21.15.57:0/2048038801 --> [v2:172.21.15.57:6800/2020036298,v1:172.21.15.57:6801/2020036298] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff4100cdba0 con 0x7ff3ec075ba0 2024-03-27T10:00:00.369 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.329+0000 7f055ca00640 1 -- 172.21.15.57:0/2384438750 shutdown_connections 2024-03-27T10:00:00.369 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.329+0000 7f90f1600640 1 -- 172.21.15.57:0/3024026798 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f90cc06c760 msgr2=0x7f90cc06ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:00.369 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.329+0000 7f90f1600640 1 --2- 172.21.15.57:0/3024026798 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f90cc06c760 0x7f90cc06ec20 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f90ec08c870 tx=0x7f90dc008040 comp rx=0 tx=0).stop 2024-03-27T10:00:00.369 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.329+0000 7f90f1600640 1 -- 172.21.15.57:0/3024026798 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f90ec1f2f30 msgr2=0x7f90ec0cd430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:00.369 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.329+0000 7f90f1600640 1 --2- 172.21.15.57:0/3024026798 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f90ec1f2f30 0x7f90ec0cd430 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f90e400a940 tx=0x7f90e4001da0 comp rx=0 tx=0).stop 2024-03-27T10:00:00.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.329+0000 7f90f0c00640 1 -- 172.21.15.57:0/3024026798 reap_dead start 2024-03-27T10:00:00.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.329+0000 7f90f1600640 1 -- 172.21.15.57:0/3024026798 shutdown_connections 2024-03-27T10:00:00.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.329+0000 7f90f1600640 1 -- 172.21.15.57:0/3024026798 >> 172.21.15.57:0/3024026798 conn(0x7f90ec0d3f80 msgr2=0x7f90ec0d4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:00.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.329+0000 7f3e84c00640 1 -- 172.21.15.57:0/2495989815 --> [v2:172.21.15.118:6821/108719401,v1:172.21.15.118:6823/108719401] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3e64002dd0 con 0x7f3e70075ca0 2024-03-27T10:00:00.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.329+0000 7ff407400640 1 -- 172.21.15.57:0/2048038801 <== osd.0 v2:172.21.15.57:6800/2020036298 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff4100cdba0 con 0x7ff3ec075ba0 2024-03-27T10:00:00.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.329+0000 7f90f1600640 1 -- 172.21.15.57:0/3024026798 shutdown_connections 2024-03-27T10:00:00.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.329+0000 7f90f1600640 1 -- 172.21.15.57:0/3024026798 wait complete. 2024-03-27T10:00:00.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.330+0000 7f055ca00640 1 -- 172.21.15.57:0/2384438750 wait complete. 2024-03-27T10:00:00.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.330+0000 7f3e87400640 1 -- 172.21.15.57:0/2495989815 <== osd.4 v2:172.21.15.118:6821/108719401 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3e64002dd0 con 0x7f3e70075ca0 2024-03-27T10:00:00.372 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.331+0000 7ff416000640 1 -- 172.21.15.57:0/2048038801 >> [v2:172.21.15.57:6800/2020036298,v1:172.21.15.57:6801/2020036298] conn(0x7ff3ec075ba0 msgr2=0x7ff3ec077fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:00.372 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.331+0000 7ff416000640 1 --2- 172.21.15.57:0/2048038801 >> [v2:172.21.15.57:6800/2020036298,v1:172.21.15.57:6801/2020036298] conn(0x7ff3ec075ba0 0x7ff3ec077fe0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:00.372 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.331+0000 7ff416000640 1 -- 172.21.15.57:0/2048038801 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7ff3ec06c530 msgr2=0x7ff3ec06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:00.372 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.331+0000 7ff416000640 1 --2- 172.21.15.57:0/2048038801 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7ff3ec06c530 0x7ff3ec06e9f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff3f8036000 tx=0x7ff3f8008030 comp rx=0 tx=0).stop 2024-03-27T10:00:00.372 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.331+0000 7ff416000640 1 -- 172.21.15.57:0/2048038801 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff41006b7a0 msgr2=0x7ff4101548e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:00.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.331+0000 7ff416000640 1 --2- 172.21.15.57:0/2048038801 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff41006b7a0 0x7ff4101548e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff40800cb40 tx=0x7ff40800a060 comp rx=0 tx=0).stop 2024-03-27T10:00:00.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.331+0000 7f3e84c00640 1 -- 172.21.15.57:0/2495989815 >> [v2:172.21.15.118:6821/108719401,v1:172.21.15.118:6823/108719401] conn(0x7f3e70075ca0 msgr2=0x7f3e700780e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:00.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.331+0000 7f3e84c00640 1 --2- 172.21.15.57:0/2495989815 >> [v2:172.21.15.118:6821/108719401,v1:172.21.15.118:6823/108719401] conn(0x7f3e70075ca0 0x7f3e700780e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:00.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.331+0000 7f3e84c00640 1 -- 172.21.15.57:0/2495989815 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f3e7006c530 msgr2=0x7f3e7006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:00.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.331+0000 7f3e84c00640 1 --2- 172.21.15.57:0/2495989815 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f3e7006c530 0x7f3e7006e9f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3e80006d40 tx=0x7f3e80008040 comp rx=0 tx=0).stop 2024-03-27T10:00:00.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.331+0000 7f3e84c00640 1 -- 172.21.15.57:0/2495989815 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3e900d3fe0 msgr2=0x7f3e90155260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:00.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.331+0000 7f3e84c00640 1 --2- 172.21.15.57:0/2495989815 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3e900d3fe0 0x7f3e90155260 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f3e7c00e610 tx=0x7f3e7c00ead0 comp rx=0 tx=0).stop 2024-03-27T10:00:00.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.331+0000 7f3e8fe00640 1 -- 172.21.15.57:0/2495989815 reap_dead start 2024-03-27T10:00:00.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.331+0000 7f3e84c00640 1 -- 172.21.15.57:0/2495989815 shutdown_connections 2024-03-27T10:00:00.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.331+0000 7f3e84c00640 1 -- 172.21.15.57:0/2495989815 >> 172.21.15.57:0/2495989815 conn(0x7f3e9008db50 msgr2=0x7f3e900cfc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:00.374 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.332+0000 7ff40fe00640 1 -- 172.21.15.57:0/2048038801 reap_dead start 2024-03-27T10:00:00.374 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.332+0000 7ff416000640 1 -- 172.21.15.57:0/2048038801 shutdown_connections 2024-03-27T10:00:00.374 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.332+0000 7ff416000640 1 -- 172.21.15.57:0/2048038801 >> 172.21.15.57:0/2048038801 conn(0x7ff4100b1c60 msgr2=0x7ff410162070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:00.374 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.334+0000 7ff416000640 1 -- 172.21.15.57:0/2048038801 shutdown_connections 2024-03-27T10:00:00.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.334+0000 7f3e84c00640 1 -- 172.21.15.57:0/2495989815 shutdown_connections 2024-03-27T10:00:00.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.334+0000 7f3e84c00640 1 -- 172.21.15.57:0/2495989815 wait complete. 2024-03-27T10:00:00.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.334+0000 7ff416000640 1 -- 172.21.15.57:0/2048038801 wait complete. 2024-03-27T10:00:00.376 INFO:teuthology.orchestra.run.smithi057.stdout:60129542155 2024-03-27T10:00:00.376 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-03-27T10:00:00.377 INFO:teuthology.orchestra.run.smithi057.stdout:55834574858 2024-03-27T10:00:00.377 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-03-27T10:00:00.378 INFO:teuthology.orchestra.run.smithi057.stdout:55834574859 2024-03-27T10:00:00.378 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-03-27T10:00:00.379 INFO:teuthology.orchestra.run.smithi057.stdout:60129542155 2024-03-27T10:00:00.379 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-03-27T10:00:00.380 INFO:teuthology.orchestra.run.smithi057.stdout:55834574860 2024-03-27T10:00:00.380 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-03-27T10:00:00.381 INFO:teuthology.orchestra.run.smithi057.stdout:60129542154 2024-03-27T10:00:00.381 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-03-27T10:00:00.382 INFO:teuthology.orchestra.run.smithi057.stdout:55834574859 2024-03-27T10:00:00.382 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-03-27T10:00:00.383 INFO:teuthology.orchestra.run.smithi057.stdout:60129542154 2024-03-27T10:00:00.384 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-03-27T10:00:00.712 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.721+0000 7f04ffe00640 1 Processor -- start 2024-03-27T10:00:00.712 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.722+0000 7f04ffe00640 1 -- start start 2024-03-27T10:00:00.714 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.723+0000 7f04ffe00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f04f80e3160 0x7f04f80e7780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:00.714 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.723+0000 7f04ffe00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f04f8053cb0 0x7f04f8054100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:00.714 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.723+0000 7f04ffe00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04f8058810 con 0x7f04f803c0a0 2024-03-27T10:00:00.714 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.724+0000 7f04ffe00640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f04f8007b70 con 0x7f04f80e3160 2024-03-27T10:00:00.714 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.724+0000 7f04ffe00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f04f8058af0 con 0x7f04f8053cb0 2024-03-27T10:00:00.714 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.724+0000 7f04fea00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f04f80e3160 0x7f04f80e7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:00.715 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.725+0000 7f04ff400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f04f8053cb0 0x7f04f8054100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:00.715 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.725+0000 7f04ff400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f04f8053cb0 0x7f04f8054100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.57:52826/0 (socket says 172.21.15.57:52826) 2024-03-27T10:00:00.715 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.725+0000 7f04ff400640 1 -- 172.21.15.57:0/3661979268 learned_addr learned my addr 172.21.15.57:0/3661979268 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:00.715 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.726+0000 7f04fea00640 1 -- 172.21.15.57:0/3661979268 >> v2:172.21.15.118:3300/0 conn(0x7f04f8053cb0 msgr2=0x7f04f8054100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:00.717 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.726+0000 7f04fea00640 1 --2- 172.21.15.57:0/3661979268 >> v2:172.21.15.118:3300/0 conn(0x7f04f8053cb0 0x7f04f8054100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:00.717 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.726+0000 7f04fea00640 1 -- 172.21.15.57:0/3661979268 >> v1:172.21.15.118:6789/0 conn(0x7f04f803c0a0 legacy=0x7f04f8058050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:00.717 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.726+0000 7f04fea00640 1 -- 172.21.15.57:0/3661979268 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04f8006360 con 0x7f04f80e3160 2024-03-27T10:00:00.718 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.728+0000 7f04fea00640 1 --2- 172.21.15.57:0/3661979268 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f04f80e3160 0x7f04f80e7780 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f04f8008660 tx=0x7f04f002b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e667a833250c7637 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:00.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.729+0000 7f04fd600640 1 -- 172.21.15.57:0/3661979268 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04f0038070 con 0x7f04f80e3160 2024-03-27T10:00:00.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.729+0000 7f04fd600640 1 -- 172.21.15.57:0/3661979268 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04f0031700 con 0x7f04f80e3160 2024-03-27T10:00:00.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.729+0000 7f04fd600640 1 -- 172.21.15.57:0/3661979268 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04f0031b10 con 0x7f04f80e3160 2024-03-27T10:00:00.721 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.731+0000 7f04ffe00640 1 -- 172.21.15.57:0/3661979268 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f04f80e3160 msgr2=0x7f04f80e7780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:00.721 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.731+0000 7f04ffe00640 1 --2- 172.21.15.57:0/3661979268 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f04f80e3160 0x7f04f80e7780 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f04f8008660 tx=0x7f04f002b7a0 comp rx=0 tx=0).stop 2024-03-27T10:00:00.722 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.732+0000 7f04ffe00640 1 -- 172.21.15.57:0/3661979268 shutdown_connections 2024-03-27T10:00:00.722 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.732+0000 7f04ffe00640 1 --2- 172.21.15.57:0/3661979268 >> v2:172.21.15.118:3300/0 conn(0x7f04f8053cb0 0x7f04f8054100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:00.722 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.732+0000 7f04ffe00640 1 --2- 172.21.15.57:0/3661979268 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f04f80e3160 0x7f04f80e7780 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:00.722 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.732+0000 7f04ffe00640 1 -- 172.21.15.57:0/3661979268 >> 172.21.15.57:0/3661979268 conn(0x7f04f8058ee0 msgr2=0x7f04f80592c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:00.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.733+0000 7f04ffe00640 1 -- 172.21.15.57:0/3661979268 shutdown_connections 2024-03-27T10:00:00.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.733+0000 7f04ffe00640 1 -- 172.21.15.57:0/3661979268 wait complete. 2024-03-27T10:00:00.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.734+0000 7f0740000640 1 Processor -- start 2024-03-27T10:00:00.726 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.736+0000 7f04ffe00640 1 Processor -- start 2024-03-27T10:00:00.726 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.736+0000 7f04ffe00640 1 -- start start 2024-03-27T10:00:00.726 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.734+0000 7f0740000640 1 -- start start 2024-03-27T10:00:00.726 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.736+0000 7f0740000640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f073806d1b0 0x7f07381635c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:00.726 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.736+0000 7f0740000640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f073806dea0 con 0x7f073806b7a0 2024-03-27T10:00:00.726 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.736+0000 7f0740000640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f073806d630 con 0x7f07381631e0 2024-03-27T10:00:00.726 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.736+0000 7f0740000640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f07381666b0 con 0x7f073806d1b0 2024-03-27T10:00:00.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.737+0000 7f073d600640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f07381631e0 0x7f0738166b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.57:33422/0 (socket says 172.21.15.57:33422) 2024-03-27T10:00:00.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.737+0000 7f073e000640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f073806b7a0 0x7f0738071710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:60926/0 (socket says 172.21.15.57:60926) 2024-03-27T10:00:00.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.737+0000 7f073e000640 1 -- 172.21.15.57:0/102252918 learned_addr learned my addr 172.21.15.57:0/102252918 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T10:00:00.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.735+0000 7f79a9600640 1 Processor -- start 2024-03-27T10:00:00.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.735+0000 7f79a9600640 1 -- start start 2024-03-27T10:00:00.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.737+0000 7f79a9600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f79a40b3700 0x7f79a40d0b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:00.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.737+0000 7f79a9600640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f79a40d1070 0x7f79a40d2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:00.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.738+0000 7f79a9600640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79a40d15b0 con 0x7f79a40d3000 2024-03-27T10:00:00.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.738+0000 7f79a9600640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f79a40b3ae0 con 0x7f79a40d1070 2024-03-27T10:00:00.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.738+0000 7f79a9600640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f79a40d2630 con 0x7f79a40b3700 2024-03-27T10:00:00.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.738+0000 7f073cc00640 1 --2- 172.21.15.57:0/102252918 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f073806d1b0 0x7f07381635c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:00.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.738+0000 7f0737e00640 1 -- 172.21.15.57:0/102252918 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4217597085 0 0) 0x7f073806dea0 con 0x7f073806b7a0 2024-03-27T10:00:00.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.739+0000 7f79a2000640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f79a40d1070 0x7f79a40d2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:00.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.738+0000 7f0737e00640 1 -- 172.21.15.57:0/102252918 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0720003520 con 0x7f073806b7a0 2024-03-27T10:00:00.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.739+0000 7f79a3400640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f79a40d3000 0x7f79a406cab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.57:33428/0 (socket says 172.21.15.57:33428) 2024-03-27T10:00:00.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.739+0000 7f79a3400640 1 -- 172.21.15.57:0/2828328080 learned_addr learned my addr 172.21.15.57:0/2828328080 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T10:00:00.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.739+0000 7f04ffe00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f04f803c0a0 0x7f04f80ddd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:00.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.739+0000 7f04ffe00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f04f8053cb0 0x7f04f80e6c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:00.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.739+0000 7f04ffe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f04f80e3160 0x7f04f80e7190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:00.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.739+0000 7f04ffe00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f04f80e3540 con 0x7f04f803c0a0 2024-03-27T10:00:00.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.739+0000 7f04ffe00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f04f8054640 con 0x7f04f80e3160 2024-03-27T10:00:00.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.739+0000 7f04ffe00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f04f8006b60 con 0x7f04f8053cb0 2024-03-27T10:00:00.731 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.739+0000 7f79a2a00640 1 --2- 172.21.15.57:0/2828328080 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f79a40b3700 0x7f79a40d0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:00.731 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.739+0000 7f0737e00640 1 -- 172.21.15.57:0/102252918 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4055465395 0 0) 0x7f073806d630 con 0x7f07381631e0 2024-03-27T10:00:00.731 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.740+0000 7f04fe000640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f04f8053cb0 0x7f04f80e6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:00.731 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.740+0000 7f04fe000640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f04f8053cb0 0x7f04f80e6c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.57:33592/0 (socket says 172.21.15.57:33592) 2024-03-27T10:00:00.731 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.740+0000 7f04fe000640 1 -- 172.21.15.57:0/1243364643 learned_addr learned my addr 172.21.15.57:0/1243364643 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:00.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.740+0000 7f04ff400640 1 --2- 172.21.15.57:0/1243364643 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f04f80e3160 0x7f04f80e7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:00.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.740+0000 7f073cc00640 1 -- 172.21.15.57:0/102252918 >> v1:172.21.15.118:6789/0 conn(0x7f07381631e0 legacy=0x7f0738166b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:00.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.740+0000 7f79a2000640 1 -- 172.21.15.57:0/2828328080 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f79a40b3700 msgr2=0x7f79a40d0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:00.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.740+0000 7f79a2000640 1 --2- 172.21.15.57:0/2828328080 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f79a40b3700 0x7f79a40d0b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:00.733 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.740+0000 7f04fea00640 1 --2- 172.21.15.57:0/1243364643 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f04f803c0a0 0x7f04f80ddd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:00.733 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.740+0000 7f79a2000640 1 -- 172.21.15.57:0/2828328080 >> v1:172.21.15.118:6789/0 conn(0x7f79a40d3000 legacy=0x7f79a406cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:00.733 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.740+0000 7f79a2000640 1 -- 172.21.15.57:0/2828328080 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79a40d1890 con 0x7f79a40d1070 2024-03-27T10:00:00.733 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.741+0000 7f04ff400640 1 -- 172.21.15.57:0/1243364643 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f04f8053cb0 msgr2=0x7f04f80e6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:00.733 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.741+0000 7f04ff400640 1 --2- 172.21.15.57:0/1243364643 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f04f8053cb0 0x7f04f80e6c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:00.733 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.741+0000 7f04ff400640 1 -- 172.21.15.57:0/1243364643 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f04f803c0a0 msgr2=0x7f04f80ddd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:00.734 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.741+0000 7f4418a00640 1 Processor -- start 2024-03-27T10:00:00.734 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.741+0000 7f4458400640 1 Processor -- start 2024-03-27T10:00:00.734 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.741+0000 7f04ff400640 1 --2- 172.21.15.57:0/1243364643 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f04f803c0a0 0x7f04f80ddd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:00.735 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.742+0000 7f4418a00640 1 -- start start 2024-03-27T10:00:00.735 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.741+0000 7f04ff400640 1 -- 172.21.15.57:0/1243364643 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04f80511a0 con 0x7f04f80e3160 2024-03-27T10:00:00.735 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.742+0000 7f4458400640 1 -- start start 2024-03-27T10:00:00.735 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.742+0000 7f073cc00640 1 -- 172.21.15.57:0/102252918 >> v1:172.21.15.57:6789/0 conn(0x7f073806b7a0 legacy=0x7f0738071710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:00.736 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.742+0000 7f04fea00640 1 --2- 172.21.15.57:0/1243364643 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f04f803c0a0 0x7f04f80ddd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T10:00:00.736 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.742+0000 7f04ff400640 1 --2- 172.21.15.57:0/1243364643 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f04f80e3160 0x7f04f80e7190 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0500064b70 tx=0x7f05000682f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:00.736 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.742+0000 7f073cc00640 1 -- 172.21.15.57:0/102252918 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f073806d8e0 con 0x7f073806d1b0 2024-03-27T10:00:00.737 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.742+0000 7f04f7400640 1 -- 172.21.15.57:0/1243364643 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f050006cdb0 con 0x7f04f80e3160 2024-03-27T10:00:00.737 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.742+0000 7f04f7400640 1 -- 172.21.15.57:0/1243364643 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05000744e0 con 0x7f04f80e3160 2024-03-27T10:00:00.737 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.742+0000 7f04f7400640 1 -- 172.21.15.57:0/1243364643 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0500095640 con 0x7f04f80e3160 2024-03-27T10:00:00.737 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.742+0000 7f04ffe00640 1 -- 172.21.15.57:0/1243364643 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04f8051440 con 0x7f04f80e3160 2024-03-27T10:00:00.737 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.743+0000 7f04ffe00640 1 -- 172.21.15.57:0/1243364643 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04f8051a00 con 0x7f04f80e3160 2024-03-27T10:00:00.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.743+0000 7f79a2000640 1 --2- 172.21.15.57:0/2828328080 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f79a40d1070 0x7f79a40d2ac0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f79900097a0 tx=0x7f799002b660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=751dcb5819ac8fd0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:00.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.743+0000 7f79a1600640 1 -- 172.21.15.57:0/2828328080 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7990037070 con 0x7f79a40d1070 2024-03-27T10:00:00.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.744+0000 7f79a1600640 1 -- 172.21.15.57:0/2828328080 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7990030710 con 0x7f79a40d1070 2024-03-27T10:00:00.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.744+0000 7f79a1600640 1 -- 172.21.15.57:0/2828328080 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f799002be60 con 0x7f79a40d1070 2024-03-27T10:00:00.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.744+0000 7f04ffe00640 1 -- 172.21.15.57:0/1243364643 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04f8005390 con 0x7f04f80e3160 2024-03-27T10:00:00.739 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.744+0000 7f4458400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f44501631e0 0x7f445006d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:00.739 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.744+0000 7f073cc00640 1 --2- 172.21.15.57:0/102252918 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f073806d1b0 0x7f07381635c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f07240097d0 tx=0x7f072402b690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f7dbfc5737bb882c server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:00.739 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.744+0000 7f4418a00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4414072310 0x7f44140726f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:00.739 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.744+0000 7f4418a00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f441406b540 0x7f441406b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:00.740 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.744+0000 7f4458400640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f445006dea0 con 0x7f4450166b40 2024-03-27T10:00:00.740 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.744+0000 7f4458400640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f445006d8e0 con 0x7f445006b7a0 2024-03-27T10:00:00.740 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.745+0000 7f0737e00640 1 -- 172.21.15.57:0/102252918 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0724037070 con 0x7f073806d1b0 2024-03-27T10:00:00.740 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.744+0000 7f4458400640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f44501666b0 con 0x7f44501631e0 2024-03-27T10:00:00.740 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.745+0000 7f4455a00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f44501631e0 0x7f445006d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:00.741 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.745+0000 7f79a9600640 1 -- 172.21.15.57:0/2828328080 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f79a40d1070 msgr2=0x7f79a40d2ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:00.741 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.745+0000 7f79a9600640 1 --2- 172.21.15.57:0/2828328080 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f79a40d1070 0x7f79a40d2ac0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f79900097a0 tx=0x7f799002b660 comp rx=0 tx=0).stop 2024-03-27T10:00:00.741 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.746+0000 7f0737e00640 1 -- 172.21.15.57:0/102252918 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0724030510 con 0x7f073806d1b0 2024-03-27T10:00:00.741 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.744+0000 7f4418a00640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4414072c30 con 0x7f44140aed10 2024-03-27T10:00:00.742 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.744+0000 7f4418a00640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f441415c820 con 0x7f4414072310 2024-03-27T10:00:00.742 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.744+0000 7f4418a00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f44140af2a0 con 0x7f441406b540 2024-03-27T10:00:00.742 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.745+0000 7f4411e00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4414072310 0x7f44140726f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:00.742 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.745+0000 7f4455a00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f44501631e0 0x7f445006d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.57:52844/0 (socket says 172.21.15.57:52844) 2024-03-27T10:00:00.742 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.745+0000 7f4455a00640 1 -- 172.21.15.57:0/2120138113 learned_addr learned my addr 172.21.15.57:0/2120138113 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:00.742 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.745+0000 7f4411e00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4414072310 0x7f44140726f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:48874/0 (socket says 172.21.15.57:48874) 2024-03-27T10:00:00.742 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.746+0000 7f4411e00640 1 -- 172.21.15.57:0/2382948069 learned_addr learned my addr 172.21.15.57:0/2382948069 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:00.743 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.746+0000 7f79a9600640 1 -- 172.21.15.57:0/2828328080 shutdown_connections 2024-03-27T10:00:00.743 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.746+0000 7f79a9600640 1 --2- 172.21.15.57:0/2828328080 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f79a40d1070 0x7f79a40d2ac0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:00.743 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.746+0000 7f79a9600640 1 --2- 172.21.15.57:0/2828328080 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f79a40b3700 0x7f79a40d0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:00.743 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.746+0000 7f4455a00640 1 -- 172.21.15.57:0/2120138113 >> v1:172.21.15.118:6789/0 conn(0x7f445006b7a0 legacy=0x7f4450071710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:00.744 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.746+0000 7f79a9600640 1 -- 172.21.15.57:0/2828328080 >> 172.21.15.57:0/2828328080 conn(0x7f79a408db50 msgr2=0x7f79a409d470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:00.744 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.746+0000 7f1bd4e00640 1 Processor -- start 2024-03-27T10:00:00.744 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.746+0000 7f0737e00640 1 -- 172.21.15.57:0/102252918 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07300019f0 con 0x7f073806d1b0 2024-03-27T10:00:00.744 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.746+0000 7f79a9600640 1 -- 172.21.15.57:0/2828328080 shutdown_connections 2024-03-27T10:00:00.745 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.746+0000 7f4412800640 1 --2- 172.21.15.57:0/2382948069 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f441406b540 0x7f441406b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:00.745 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.746+0000 7f4455a00640 1 -- 172.21.15.57:0/2120138113 >> v1:172.21.15.57:6789/0 conn(0x7f4450166b40 legacy=0x7f44501635c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:00.745 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.746+0000 7f4455a00640 1 -- 172.21.15.57:0/2120138113 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f445006dbc0 con 0x7f44501631e0 2024-03-27T10:00:00.745 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.746+0000 7f04f7400640 1 -- 172.21.15.57:0/1243364643 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f05000958a0 con 0x7f04f80e3160 2024-03-27T10:00:00.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.747+0000 7f79a9600640 1 -- 172.21.15.57:0/2828328080 wait complete. 2024-03-27T10:00:00.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.747+0000 7f4412800640 1 -- 172.21.15.57:0/2382948069 >> v2:172.21.15.57:3300/0 conn(0x7f4414072310 msgr2=0x7f44140726f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:00.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.747+0000 7f1bd4e00640 1 -- start start 2024-03-27T10:00:00.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.747+0000 7f4412800640 1 --2- 172.21.15.57:0/2382948069 >> v2:172.21.15.57:3300/0 conn(0x7f4414072310 0x7f44140726f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:00.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.747+0000 7f4412800640 1 -- 172.21.15.57:0/2382948069 >> v1:172.21.15.57:6789/0 conn(0x7f44140aed10 legacy=0x7f441415c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:00.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.747+0000 7f4412800640 1 -- 172.21.15.57:0/2382948069 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44140af580 con 0x7f441406b540 2024-03-27T10:00:00.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.747+0000 7f0740000640 1 -- 172.21.15.57:0/102252918 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f073806d1b0 msgr2=0x7f07381635c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:00.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.747+0000 7f0740000640 1 --2- 172.21.15.57:0/102252918 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f073806d1b0 0x7f07381635c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f07240097d0 tx=0x7f072402b690 comp rx=0 tx=0).stop 2024-03-27T10:00:00.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.748+0000 7f04f7400640 1 --2- 172.21.15.57:0/1243364643 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f04e006c600 0x7f04e006eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:00.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.748+0000 7f04f7400640 1 -- 172.21.15.57:0/1243364643 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f0500106bb0 con 0x7f04f80e3160 2024-03-27T10:00:00.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.748+0000 7f4455a00640 1 --2- 172.21.15.57:0/2120138113 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44501631e0 0x7f445006d1b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4444009870 tx=0x7f444402b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=999f7e7105d2946 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:00.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.748+0000 7f04fea00640 1 --2- 172.21.15.57:0/1243364643 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f04e006c600 0x7f04e006eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:00.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.749+0000 7f1bd4e00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1bd00b3140 0x7f1bd015e840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:00.749 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.749+0000 7f0740000640 1 -- 172.21.15.57:0/102252918 shutdown_connections 2024-03-27T10:00:00.749 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.749+0000 7f0740000640 1 --2- 172.21.15.57:0/102252918 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f073806d1b0 0x7f07381635c0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:00.749 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.749+0000 7f0740000640 1 -- 172.21.15.57:0/102252918 >> 172.21.15.57:0/102252918 conn(0x7f07380b1c60 msgr2=0x7f07380b2070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:00.749 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.749+0000 7f1bd4e00640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1bd00b35a0 con 0x7f1bd00d0950 2024-03-27T10:00:00.749 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.749+0000 7f0740000640 1 -- 172.21.15.57:0/102252918 shutdown_connections 2024-03-27T10:00:00.750 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.749+0000 7f1bcde00640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f1bd00d0950 0x7f1bd006db50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:60962/0 (socket says 172.21.15.57:60962) 2024-03-27T10:00:00.750 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.749+0000 7f1bcde00640 1 -- 172.21.15.57:0/1132232609 learned_addr learned my addr 172.21.15.57:0/1132232609 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T10:00:00.750 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.749+0000 7f1bd4e00640 1 -- 172.21.15.57:0/1132232609 --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1bd00cf5c0 con 0x7f1bd006e260 2024-03-27T10:00:00.750 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.749+0000 7f1bd4e00640 1 -- 172.21.15.57:0/1132232609 --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f1bd00cf8a0 con 0x7f1bd00b3140 2024-03-27T10:00:00.751 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.749+0000 7f0740000640 1 -- 172.21.15.57:0/102252918 wait complete. 2024-03-27T10:00:00.751 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.749+0000 7f4412800640 1 --2- 172.21.15.57:0/2382948069 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f441406b540 0x7f441406b9d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f440c0097a0 tx=0x7f440c02b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d1d4d78011d032b9 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:00.751 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.750+0000 7f79a9600640 1 Processor -- start 2024-03-27T10:00:00.751 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.750+0000 7f1bcd400640 1 --2- 172.21.15.57:0/1132232609 >> v2:172.21.15.57:3300/0 conn(0x7f1bd00b3140 0x7f1bd015e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:00.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.750+0000 7f1bcca00640 1 -- 172.21.15.57:0/1132232609 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 150659723 0 0) 0x7f1bd00b35a0 con 0x7f1bd00d0950 2024-03-27T10:00:00.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.750+0000 7f79a9600640 1 -- start start 2024-03-27T10:00:00.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.750+0000 7f1bcca00640 1 -- 172.21.15.57:0/1132232609 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1bb4003520 con 0x7f1bd00d0950 2024-03-27T10:00:00.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.750+0000 7f1bcd400640 1 -- 172.21.15.57:0/1132232609 >> v1:172.21.15.118:6789/0 conn(0x7f1bd006e260 legacy=0x7f1bd01651c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:00.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.750+0000 7f1bcd400640 1 -- 172.21.15.57:0/1132232609 >> v1:172.21.15.57:6789/0 conn(0x7f1bd00d0950 legacy=0x7f1bd006db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:00.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.750+0000 7f1bcd400640 1 -- 172.21.15.57:0/1132232609 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bd006d350 con 0x7f1bd00b3140 2024-03-27T10:00:00.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.751+0000 7f04fea00640 1 --2- 172.21.15.57:0/1243364643 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f04e006c600 0x7f04e006eac0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f04f0035000 tx=0x7f04f0008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:00.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.751+0000 7f4410a00640 1 -- 172.21.15.57:0/2382948069 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f440c031780 con 0x7f441406b540 2024-03-27T10:00:00.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.751+0000 7f4410a00640 1 -- 172.21.15.57:0/2382948069 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f440c037070 con 0x7f441406b540 2024-03-27T10:00:00.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.751+0000 7f4410a00640 1 -- 172.21.15.57:0/2382948069 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f440c031b40 con 0x7f441406b540 2024-03-27T10:00:00.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.752+0000 7f4418a00640 1 -- 172.21.15.57:0/2382948069 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f441406b540 msgr2=0x7f441406b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:00.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.752+0000 7f4418a00640 1 --2- 172.21.15.57:0/2382948069 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f441406b540 0x7f441406b9d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f440c0097a0 tx=0x7f440c02b820 comp rx=0 tx=0).stop 2024-03-27T10:00:00.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.752+0000 7f1bcd400640 1 --2- 172.21.15.57:0/1132232609 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1bd00b3140 0x7f1bd015e840 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc0097a0 tx=0x7f1bbc02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dfb9088e5ae4302 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:00.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.752+0000 7f4418a00640 1 -- 172.21.15.57:0/2382948069 shutdown_connections 2024-03-27T10:00:00.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.752+0000 7f4418a00640 1 --2- 172.21.15.57:0/2382948069 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f441406b540 0x7f441406b9d0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:00.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.752+0000 7f0740000640 1 Processor -- start 2024-03-27T10:00:00.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.752+0000 7f4418a00640 1 --2- 172.21.15.57:0/2382948069 >> v2:172.21.15.57:3300/0 conn(0x7f4414072310 0x7f44140726f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:00.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.752+0000 7f4418a00640 1 -- 172.21.15.57:0/2382948069 >> 172.21.15.57:0/2382948069 conn(0x7f44140d13c0 msgr2=0x7f44140cd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:00.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.752+0000 7f79a9600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f79a40b3700 0x7f79a40cd680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:00.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.752+0000 7f79a9600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f79a40d1070 0x7f79a41f9260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:00.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.752+0000 7f4418a00640 1 -- 172.21.15.57:0/2382948069 shutdown_connections 2024-03-27T10:00:00.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.752+0000 7f1bcca00640 1 -- 172.21.15.57:0/1132232609 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bbc034070 con 0x7f1bd00b3140 2024-03-27T10:00:00.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.752+0000 7f79a9600640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f79a40d3000 0x7f79a40ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:00.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.752+0000 7f79a9600640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f79a40c7910 con 0x7f79a40d3000 2024-03-27T10:00:00.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.752+0000 7f79a9600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f79a40c7790 con 0x7f79a40b3700 2024-03-27T10:00:00.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.752+0000 7f79a9600640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f79a406d1c0 con 0x7f79a40d1070 2024-03-27T10:00:00.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.752+0000 7f1bcca00640 1 -- 172.21.15.57:0/1132232609 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bbc030610 con 0x7f1bd00b3140 2024-03-27T10:00:00.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.752+0000 7f1bcca00640 1 -- 172.21.15.57:0/1132232609 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bbc0309c0 con 0x7f1bd00b3140 2024-03-27T10:00:00.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.752+0000 7f0740000640 1 -- start start 2024-03-27T10:00:00.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.753+0000 7f79a2000640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f79a40d1070 0x7f79a41f9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:00.758 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.752+0000 7f4418a00640 1 -- 172.21.15.57:0/2382948069 wait complete. 2024-03-27T10:00:00.758 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.753+0000 7f79a3400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f79a40d3000 0x7f79a40ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:00.758 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.753+0000 7f79a2a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f79a40b3700 0x7f79a40cd680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:00.758 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.753+0000 7f79a2000640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f79a40d1070 0x7f79a41f9260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.57:33604/0 (socket says 172.21.15.57:33604) 2024-03-27T10:00:00.758 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.753+0000 7f79a2000640 1 -- 172.21.15.57:0/2350197186 learned_addr learned my addr 172.21.15.57:0/2350197186 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:00.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.753+0000 7f1bd4e00640 1 -- 172.21.15.57:0/1132232609 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1bd00b3140 msgr2=0x7f1bd015e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:00.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.753+0000 7f1bd4e00640 1 --2- 172.21.15.57:0/1132232609 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1bd00b3140 0x7f1bd015e840 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1bbc0097a0 tx=0x7f1bbc02b960 comp rx=0 tx=0).stop 2024-03-27T10:00:00.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.753+0000 7f79a2a00640 1 -- 172.21.15.57:0/2350197186 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f79a40d1070 msgr2=0x7f79a41f9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:00.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.753+0000 7f79a2a00640 1 --2- 172.21.15.57:0/2350197186 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f79a40d1070 0x7f79a41f9260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:00.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.753+0000 7f79a2a00640 1 -- 172.21.15.57:0/2350197186 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f79a40d3000 msgr2=0x7f79a40ccf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:00.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.753+0000 7f79a2a00640 1 --2- 172.21.15.57:0/2350197186 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f79a40d3000 0x7f79a40ccf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:00.760 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.753+0000 7f1bd4e00640 1 -- 172.21.15.57:0/1132232609 shutdown_connections 2024-03-27T10:00:00.760 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.753+0000 7f1bd4e00640 1 --2- 172.21.15.57:0/1132232609 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1bd00b3140 0x7f1bd015e840 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:00.760 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.753+0000 7f1bd4e00640 1 -- 172.21.15.57:0/1132232609 >> 172.21.15.57:0/1132232609 conn(0x7f1bd00cfe60 msgr2=0x7f1bd00d0240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:00.760 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.754+0000 7f79a2a00640 1 -- 172.21.15.57:0/2350197186 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79a40cb390 con 0x7f79a40b3700 2024-03-27T10:00:00.760 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.754+0000 7f0740000640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f073806b7a0 0x7f073815dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:00.761 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.754+0000 7f1bd4e00640 1 -- 172.21.15.57:0/1132232609 shutdown_connections 2024-03-27T10:00:00.761 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.754+0000 7f1bd4e00640 1 -- 172.21.15.57:0/1132232609 wait complete. 2024-03-27T10:00:00.761 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.754+0000 7f0740000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f073806d1b0 0x7f073815a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:00.761 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.754+0000 7f0740000640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f07381631e0 0x7f073815a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:00.761 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.754+0000 7f0740000640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f0738163b00 con 0x7f07381631e0 2024-03-27T10:00:00.762 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.754+0000 7f0740000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f0738166340 con 0x7f073806d1b0 2024-03-27T10:00:00.762 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.754+0000 7f0740000640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f0738071e20 con 0x7f073806b7a0 2024-03-27T10:00:00.762 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.754+0000 7f073d600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f073806b7a0 0x7f073815dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:00.762 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.754+0000 7f073d600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f073806b7a0 0x7f073815dca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.57:33612/0 (socket says 172.21.15.57:33612) 2024-03-27T10:00:00.762 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.755+0000 7f79a2a00640 1 --2- 172.21.15.57:0/2350197186 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f79a40b3700 0x7f79a40cd680 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f799400d5f0 tx=0x7f799400dab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:00.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.755+0000 7f073d600640 1 -- 172.21.15.57:0/1234069942 learned_addr learned my addr 172.21.15.57:0/1234069942 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:00.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.755+0000 7f073cc00640 1 --2- 172.21.15.57:0/1234069942 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f073806d1b0 0x7f073815a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:00.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.755+0000 7f073e000640 1 --2- 172.21.15.57:0/1234069942 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f07381631e0 0x7f073815a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:00.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.755+0000 7f073e000640 1 -- 172.21.15.57:0/1234069942 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f073806b7a0 msgr2=0x7f073815dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:00.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.755+0000 7f073e000640 1 --2- 172.21.15.57:0/1234069942 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f073806b7a0 0x7f073815dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:00.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.755+0000 7f073e000640 1 -- 172.21.15.57:0/1234069942 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f073806d1b0 msgr2=0x7f073815a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:00.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.756+0000 7f1bd4e00640 1 Processor -- start 2024-03-27T10:00:00.764 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.756+0000 7f4418a00640 1 Processor -- start 2024-03-27T10:00:00.764 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.756+0000 7f4418a00640 1 -- start start 2024-03-27T10:00:00.764 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.756+0000 7f1bd4e00640 1 -- start start 2024-03-27T10:00:00.765 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.755+0000 7f073e000640 1 --2- 172.21.15.57:0/1234069942 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f073806d1b0 0x7f073815a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:00.765 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.755+0000 7f073e000640 1 -- 172.21.15.57:0/1234069942 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07380ccb20 con 0x7f07381631e0 2024-03-27T10:00:00.765 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.756+0000 7f073e000640 1 --2- 172.21.15.57:0/1234069942 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f07381631e0 0x7f073815a590 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0730001560 tx=0x7f073000ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:00.765 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.757+0000 7f0735600640 1 -- 172.21.15.57:0/1234069942 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0730018070 con 0x7f07381631e0 2024-03-27T10:00:00.765 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.757+0000 7f0740000640 1 -- 172.21.15.57:0/1234069942 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07380cce00 con 0x7f07381631e0 2024-03-27T10:00:00.765 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.757+0000 7f0740000640 1 -- 172.21.15.57:0/1234069942 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07380cd3c0 con 0x7f07381631e0 2024-03-27T10:00:00.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.757+0000 7f1bd4e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1bd006e260 0x7f1bd015c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:00.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.757+0000 7f1bd4e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1bd00b3140 0x7f1bd015cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:00.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.757+0000 7f0735600640 1 -- 172.21.15.57:0/1234069942 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f073000a760 con 0x7f07381631e0 2024-03-27T10:00:00.767 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.757+0000 7f0735600640 1 -- 172.21.15.57:0/1234069942 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f073000ab50 con 0x7f07381631e0 2024-03-27T10:00:00.767 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.757+0000 7f4418a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f441406b540 0x7f4414155590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:00.767 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.757+0000 7f1bd4e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1bd00d0950 0x7f1bd0153530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:00.767 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.757+0000 7f1bd4e00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f1bd00729d0 con 0x7f1bd006e260 2024-03-27T10:00:00.768 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.757+0000 7f1bd4e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f1bd00cf290 con 0x7f1bd00b3140 2024-03-27T10:00:00.768 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.757+0000 7f1bd4e00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f1bd0072dc0 con 0x7f1bd00d0950 2024-03-27T10:00:00.768 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.757+0000 7f4418a00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4414072310 0x7f441415e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:00.768 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.757+0000 7f4418a00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f44140aed10 0x7f44141f8980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:00.768 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.757+0000 7f4411e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f441406b540 0x7f4414155590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:00.768 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.757+0000 7f4418a00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f44140afe20 con 0x7f4414072310 2024-03-27T10:00:00.768 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.757+0000 7f4418a00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f44140afb40 con 0x7f441406b540 2024-03-27T10:00:00.769 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.758+0000 7f1bce800640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1bd00d0950 0x7f1bd0153530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:00.769 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.758+0000 7f4418a00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f441415b360 con 0x7f44140aed10 2024-03-27T10:00:00.769 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.758+0000 7f4411e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f441406b540 0x7f4414155590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.57:52884/0 (socket says 172.21.15.57:52884) 2024-03-27T10:00:00.769 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.758+0000 7f4411e00640 1 -- 172.21.15.57:0/346904547 learned_addr learned my addr 172.21.15.57:0/346904547 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:00.769 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.758+0000 7f4412800640 1 --2- 172.21.15.57:0/346904547 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f44140aed10 0x7f44141f8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:00.770 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.758+0000 7f1bce800640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1bd00d0950 0x7f1bd0153530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.57:33616/0 (socket says 172.21.15.57:33616) 2024-03-27T10:00:00.770 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.758+0000 7f1bce800640 1 -- 172.21.15.57:0/1695515969 learned_addr learned my addr 172.21.15.57:0/1695515969 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:00.770 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.758+0000 7f1bcd400640 1 --2- 172.21.15.57:0/1695515969 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1bd00b3140 0x7f1bd015cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:00.770 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.758+0000 7f0740000640 1 -- 172.21.15.57:0/1234069942 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0714005290 con 0x7f07381631e0 2024-03-27T10:00:00.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.758+0000 7f4411e00640 1 -- 172.21.15.57:0/346904547 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f44140aed10 msgr2=0x7f44141f8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:00.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.758+0000 7f4411e00640 1 --2- 172.21.15.57:0/346904547 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f44140aed10 0x7f44141f8980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:00.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.758+0000 7f4411e00640 1 -- 172.21.15.57:0/346904547 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4414072310 msgr2=0x7f441415e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:00.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.758+0000 7f4411e00640 1 --2- 172.21.15.57:0/346904547 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4414072310 0x7f441415e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:00.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.758+0000 7f4411e00640 1 -- 172.21.15.57:0/346904547 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f441415d700 con 0x7f441406b540 2024-03-27T10:00:00.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.759+0000 7f1bcde00640 1 --2- 172.21.15.57:0/1695515969 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1bd006e260 0x7f1bd015c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:00.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.759+0000 7f1bce800640 1 -- 172.21.15.57:0/1695515969 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1bd00b3140 msgr2=0x7f1bd015cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:00.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.759+0000 7f1bce800640 1 --2- 172.21.15.57:0/1695515969 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1bd00b3140 0x7f1bd015cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:00.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.759+0000 7f1bce800640 1 -- 172.21.15.57:0/1695515969 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1bd006e260 msgr2=0x7f1bd015c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:00.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.759+0000 7f1bce800640 1 --2- 172.21.15.57:0/1695515969 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1bd006e260 0x7f1bd015c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:00.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.759+0000 7f1bce800640 1 -- 172.21.15.57:0/1695515969 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bd00b1270 con 0x7f1bd00d0950 2024-03-27T10:00:00.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.759+0000 7f1bcde00640 1 --2- 172.21.15.57:0/1695515969 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1bd006e260 0x7f1bd015c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T10:00:00.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.759+0000 7f4411e00640 1 --2- 172.21.15.57:0/346904547 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f441406b540 0x7f4414155590 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f44040095b0 tx=0x7f4404009a70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:00.773 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.759+0000 7f1bce800640 1 --2- 172.21.15.57:0/1695515969 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1bd00d0950 0x7f1bd0153530 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1bc800c6b0 tx=0x7f1bc800cb70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:00.773 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.760+0000 7faf68400640 1 Processor -- start 2024-03-27T10:00:00.773 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.760+0000 7faf68400640 1 -- start start 2024-03-27T10:00:00.774 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.760+0000 7f1bc6000640 1 -- 172.21.15.57:0/1695515969 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc8003b70 con 0x7f1bd00d0950 2024-03-27T10:00:00.774 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.760+0000 7f1bc6000640 1 -- 172.21.15.57:0/1695515969 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bc8003d30 con 0x7f1bd00d0950 2024-03-27T10:00:00.774 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.760+0000 7f1bc6000640 1 -- 172.21.15.57:0/1695515969 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc8005310 con 0x7f1bd00d0950 2024-03-27T10:00:00.774 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.760+0000 7f1bd4e00640 1 -- 172.21.15.57:0/1695515969 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bd0151f60 con 0x7f1bd00d0950 2024-03-27T10:00:00.774 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.760+0000 7f1bd4e00640 1 -- 172.21.15.57:0/1695515969 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bd0152520 con 0x7f1bd00d0950 2024-03-27T10:00:00.774 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.761+0000 7f0735600640 1 -- 172.21.15.57:0/1234069942 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f073001b070 con 0x7f07381631e0 2024-03-27T10:00:00.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.761+0000 7f1bd4e00640 1 -- 172.21.15.57:0/1695515969 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bd0068620 con 0x7f1bd00d0950 2024-03-27T10:00:00.776 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.762+0000 7faf68400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7faf6006b750 0x7faf6006bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:00.776 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.762+0000 7faf68400640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7faf600ce740 0x7faf600ceb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:00.776 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.762+0000 7faf68400640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf6015fc70 con 0x7faf60145820 2024-03-27T10:00:00.776 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.762+0000 7faf68400640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7faf60160b60 con 0x7faf600ce740 2024-03-27T10:00:00.776 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.762+0000 7faf65000640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7faf6006b750 0x7faf6006bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:00.776 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.762+0000 7faf68400640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7faf6006c0d0 con 0x7faf6006b750 2024-03-27T10:00:00.776 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.762+0000 7faf66400640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7faf600ce740 0x7faf600ceb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:00.776 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.762+0000 7faf65000640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7faf6006b750 0x7faf6006bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.57:52904/0 (socket says 172.21.15.57:52904) 2024-03-27T10:00:00.776 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.762+0000 7faf65000640 1 -- 172.21.15.57:0/2003045729 learned_addr learned my addr 172.21.15.57:0/2003045729 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:00.776 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.762+0000 7faf66400640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7faf600ce740 0x7faf600ceb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:48938/0 (socket says 172.21.15.57:48938) 2024-03-27T10:00:00.777 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.762+0000 7f0735600640 1 --2- 172.21.15.57:0/1234069942 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f071806c530 0x7f071806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:00.777 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.762+0000 7f0735600640 1 -- 172.21.15.57:0/1234069942 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f073008b410 con 0x7f07381631e0 2024-03-27T10:00:00.777 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.763+0000 7f073d600640 1 --2- 172.21.15.57:0/1234069942 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f071806c530 0x7f071806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:00.777 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.763+0000 7faf65000640 1 -- 172.21.15.57:0/2003045729 >> v2:172.21.15.57:3300/0 conn(0x7faf600ce740 msgr2=0x7faf600ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:00.777 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.763+0000 7faf65000640 1 --2- 172.21.15.57:0/2003045729 >> v2:172.21.15.57:3300/0 conn(0x7faf600ce740 0x7faf600ceb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:00.778 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.763+0000 7faf65000640 1 -- 172.21.15.57:0/2003045729 >> v1:172.21.15.118:6789/0 conn(0x7faf60145820 legacy=0x7faf600cc950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:00.778 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.763+0000 7faf65000640 1 -- 172.21.15.57:0/2003045729 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf6015ff50 con 0x7faf6006b750 2024-03-27T10:00:00.778 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.764+0000 7f073d600640 1 --2- 172.21.15.57:0/1234069942 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f071806c530 0x7f071806e9f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f072c007c40 tx=0x7f072c007b90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:00.778 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.764+0000 7f6f4fe00640 1 Processor -- start 2024-03-27T10:00:00.778 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.764+0000 7f6f4fe00640 1 -- start start 2024-03-27T10:00:00.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.765+0000 7faf65000640 1 --2- 172.21.15.57:0/2003045729 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faf6006b750 0x7faf6006bb90 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7faf600af7b0 tx=0x7faf4c02b9b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c6ba15ecab2ae74 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:00.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.765+0000 7f1bc6000640 1 -- 172.21.15.57:0/1695515969 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f1bc80054b0 con 0x7f1bd00d0950 2024-03-27T10:00:00.780 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.765+0000 7f6f4fe00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6f4815e510 0x7f6f480d28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:00.780 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.765+0000 7f6f4fe00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f6f480d2de0 0x7f6f480d3db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:00.780 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.765+0000 7f6f4fe00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f480d47a0 con 0x7f6f480d42f0 2024-03-27T10:00:00.780 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.765+0000 7f6f4fe00640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f6f4815e8f0 con 0x7f6f4815e510 2024-03-27T10:00:00.780 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.765+0000 7f6f4fe00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f6f480b4110 con 0x7f6f480d2de0 2024-03-27T10:00:00.780 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.766+0000 7f6f4d400640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6f4815e510 0x7f6f480d28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:00.780 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.766+0000 7f6f4d400640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f6f4815e510 0x7f6f480d28a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:48942/0 (socket says 172.21.15.57:48942) 2024-03-27T10:00:00.780 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.766+0000 7f6f4d400640 1 -- 172.21.15.57:0/17523778 learned_addr learned my addr 172.21.15.57:0/17523778 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:00.780 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.766+0000 7f6f4ca00640 1 --2- 172.21.15.57:0/17523778 >> v2:172.21.15.118:3300/0 conn(0x7f6f480d2de0 0x7f6f480d3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:00.780 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.766+0000 7f6f4d400640 1 -- 172.21.15.57:0/17523778 >> v2:172.21.15.118:3300/0 conn(0x7f6f480d2de0 msgr2=0x7f6f480d3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:00.781 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.766+0000 7f6f4d400640 1 --2- 172.21.15.57:0/17523778 >> v2:172.21.15.118:3300/0 conn(0x7f6f480d2de0 0x7f6f480d3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:00.781 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.766+0000 7f1bc6000640 1 --2- 172.21.15.57:0/1695515969 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f1bb006c530 0x7f1bb006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:00.781 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.766+0000 7f1bc6000640 1 -- 172.21.15.57:0/1695515969 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f1bc808c190 con 0x7f1bd00d0950 2024-03-27T10:00:00.781 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.766+0000 7f6f4d400640 1 -- 172.21.15.57:0/17523778 >> v1:172.21.15.118:6789/0 conn(0x7f6f480d42f0 legacy=0x7f6f480d0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:00.781 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.766+0000 7f6f4d400640 1 -- 172.21.15.57:0/17523778 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f480b43f0 con 0x7f6f4815e510 2024-03-27T10:00:00.782 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.766+0000 7f6f4ca00640 1 --2- 172.21.15.57:0/17523778 >> v2:172.21.15.118:3300/0 conn(0x7f6f480d2de0 0x7f6f480d3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T10:00:00.782 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.767+0000 7f1bcde00640 1 --2- 172.21.15.57:0/1695515969 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f1bb006c530 0x7f1bb006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:00.782 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.767+0000 7f1bcde00640 1 --2- 172.21.15.57:0/1695515969 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f1bb006c530 0x7f1bb006e9f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1bc00011e0 tx=0x7f1bc0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:00.783 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.768+0000 7f6f4d400640 1 --2- 172.21.15.57:0/17523778 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6f4815e510 0x7f6f480d28a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6f480d3740 tx=0x7f6f3c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae4870af729d2131 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:00.783 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.768+0000 7f6f47e00640 1 -- 172.21.15.57:0/17523778 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f3c035020 con 0x7f6f4815e510 2024-03-27T10:00:00.783 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.768+0000 7f6f47e00640 1 -- 172.21.15.57:0/17523778 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f3c031870 con 0x7f6f4815e510 2024-03-27T10:00:00.783 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.768+0000 7f6f47e00640 1 -- 172.21.15.57:0/17523778 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f3c031c40 con 0x7f6f4815e510 2024-03-27T10:00:00.783 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.768+0000 7f0735600640 1 -- 172.21.15.57:0/1234069942 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f0730059000 con 0x7f07381631e0 2024-03-27T10:00:00.783 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.769+0000 7f444fe00640 1 -- 172.21.15.57:0/2120138113 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4444035020 con 0x7f44501631e0 2024-03-27T10:00:00.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.769+0000 7f799aa00640 1 -- 172.21.15.57:0/2350197186 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79940125f0 con 0x7f79a40b3700 2024-03-27T10:00:00.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.769+0000 7f6f4fe00640 1 -- 172.21.15.57:0/17523778 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6f4815e510 msgr2=0x7f6f480d28a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:00.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.769+0000 7f6f4fe00640 1 --2- 172.21.15.57:0/17523778 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6f4815e510 0x7f6f480d28a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6f480d3740 tx=0x7f6f3c02b910 comp rx=0 tx=0).stop 2024-03-27T10:00:00.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.769+0000 7f440a000640 1 -- 172.21.15.57:0/346904547 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f440401b070 con 0x7f441406b540 2024-03-27T10:00:00.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.769+0000 7faf5fe00640 1 -- 172.21.15.57:0/2003045729 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf4c034070 con 0x7faf6006b750 2024-03-27T10:00:00.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.769+0000 7f79a9600640 1 -- 172.21.15.57:0/2350197186 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79a40cb670 con 0x7f79a40b3700 2024-03-27T10:00:00.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.769+0000 7f4418a00640 1 -- 172.21.15.57:0/346904547 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f441415d9e0 con 0x7f441406b540 2024-03-27T10:00:00.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.769+0000 7f444fe00640 1 -- 172.21.15.57:0/2120138113 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4444031870 con 0x7f44501631e0 2024-03-27T10:00:00.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.769+0000 7f444fe00640 1 -- 172.21.15.57:0/2120138113 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4444031c40 con 0x7f44501631e0 2024-03-27T10:00:00.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.769+0000 7f04f7400640 1 -- 172.21.15.57:0/1243364643 <== mon.1 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f05000d4e70 con 0x7f04f80e3160 2024-03-27T10:00:00.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.769+0000 7f6f4fe00640 1 -- 172.21.15.57:0/17523778 shutdown_connections 2024-03-27T10:00:00.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.769+0000 7f6f4fe00640 1 --2- 172.21.15.57:0/17523778 >> v2:172.21.15.118:3300/0 conn(0x7f6f480d2de0 0x7f6f480d3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:00.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.769+0000 7f6f4fe00640 1 --2- 172.21.15.57:0/17523778 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6f4815e510 0x7f6f480d28a0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:00.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.769+0000 7f6f4fe00640 1 -- 172.21.15.57:0/17523778 >> 172.21.15.57:0/17523778 conn(0x7f6f48067c00 msgr2=0x7f6f4809d440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:00.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.769+0000 7faf5fe00640 1 -- 172.21.15.57:0/2003045729 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf4c030870 con 0x7faf6006b750 2024-03-27T10:00:00.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.769+0000 7faf5fe00640 1 -- 172.21.15.57:0/2003045729 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf4c030c40 con 0x7faf6006b750 2024-03-27T10:00:00.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.770+0000 7f4418a00640 1 -- 172.21.15.57:0/346904547 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f441415dfa0 con 0x7f441406b540 2024-03-27T10:00:00.788 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.770+0000 7f440a000640 1 -- 172.21.15.57:0/346904547 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f440400d0d0 con 0x7f441406b540 2024-03-27T10:00:00.788 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.770+0000 7f440a000640 1 -- 172.21.15.57:0/346904547 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f440400d4c0 con 0x7f441406b540 2024-03-27T10:00:00.788 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.770+0000 7f6f4fe00640 1 -- 172.21.15.57:0/17523778 shutdown_connections 2024-03-27T10:00:00.788 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.770+0000 7f4458400640 1 -- 172.21.15.57:0/2120138113 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44501631e0 msgr2=0x7f445006d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:00.789 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.770+0000 7f4458400640 1 --2- 172.21.15.57:0/2120138113 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44501631e0 0x7f445006d1b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4444009870 tx=0x7f444402b910 comp rx=0 tx=0).stop 2024-03-27T10:00:00.789 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.770+0000 7f4458400640 1 -- 172.21.15.57:0/2120138113 shutdown_connections 2024-03-27T10:00:00.789 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.770+0000 7f4458400640 1 --2- 172.21.15.57:0/2120138113 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44501631e0 0x7f445006d1b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:00.789 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.770+0000 7f4458400640 1 -- 172.21.15.57:0/2120138113 >> 172.21.15.57:0/2120138113 conn(0x7f44500b1c60 msgr2=0x7f44500b2070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:00.789 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.770+0000 7faf68400640 1 -- 172.21.15.57:0/2003045729 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faf6006b750 msgr2=0x7faf6006bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:00.789 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.770+0000 7faf68400640 1 --2- 172.21.15.57:0/2003045729 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faf6006b750 0x7faf6006bb90 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7faf600af7b0 tx=0x7faf4c02b9b0 comp rx=0 tx=0).stop 2024-03-27T10:00:00.790 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.771+0000 7f4458400640 1 -- 172.21.15.57:0/2120138113 shutdown_connections 2024-03-27T10:00:00.790 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.771+0000 7f4458400640 1 -- 172.21.15.57:0/2120138113 wait complete. 2024-03-27T10:00:00.790 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.771+0000 7faf68400640 1 -- 172.21.15.57:0/2003045729 shutdown_connections 2024-03-27T10:00:00.790 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.771+0000 7faf68400640 1 --2- 172.21.15.57:0/2003045729 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faf6006b750 0x7faf6006bb90 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:00.790 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.771+0000 7faf68400640 1 --2- 172.21.15.57:0/2003045729 >> v2:172.21.15.57:3300/0 conn(0x7faf600ce740 0x7faf600ceb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:00.791 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.771+0000 7faf68400640 1 -- 172.21.15.57:0/2003045729 >> 172.21.15.57:0/2003045729 conn(0x7faf600b1c60 msgr2=0x7faf600b2070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:00.791 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.771+0000 7faf68400640 1 -- 172.21.15.57:0/2003045729 shutdown_connections 2024-03-27T10:00:00.791 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.771+0000 7faf68400640 1 -- 172.21.15.57:0/2003045729 wait complete. 2024-03-27T10:00:00.791 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.769+0000 7f799aa00640 1 -- 172.21.15.57:0/2350197186 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7994019070 con 0x7f79a40b3700 2024-03-27T10:00:00.791 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.769+0000 7f799aa00640 1 -- 172.21.15.57:0/2350197186 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79940129b0 con 0x7f79a40b3700 2024-03-27T10:00:00.791 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.771+0000 7f79a9600640 1 -- 172.21.15.57:0/2350197186 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79a40cbc30 con 0x7f79a40b3700 2024-03-27T10:00:00.791 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.770+0000 7f6f4fe00640 1 -- 172.21.15.57:0/17523778 wait complete. 2024-03-27T10:00:00.792 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.772+0000 7f4418a00640 1 -- 172.21.15.57:0/346904547 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43ec005290 con 0x7f441406b540 2024-03-27T10:00:00.792 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.773+0000 7f4458400640 1 Processor -- start 2024-03-27T10:00:00.792 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.773+0000 7f4458400640 1 -- start start 2024-03-27T10:00:00.793 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.774+0000 7f799aa00640 1 -- 172.21.15.57:0/2350197186 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f7994012b50 con 0x7f79a40b3700 2024-03-27T10:00:00.793 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.774+0000 7f6f4fe00640 1 Processor -- start 2024-03-27T10:00:00.794 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.774+0000 7f4458400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f445006b7a0 0x7f44500ccf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:00.794 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.774+0000 7f4458400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44501631e0 0x7f445015d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:00.794 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.774+0000 7f4458400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4450166b40 0x7f445015d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:00.794 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.774+0000 7f4458400640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f4450071e20 con 0x7f445006b7a0 2024-03-27T10:00:00.794 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.774+0000 7f4458400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f4450166ff0 con 0x7f44501631e0 2024-03-27T10:00:00.794 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.774+0000 7f4458400640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f4450071fa0 con 0x7f4450166b40 2024-03-27T10:00:00.795 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.774+0000 7faf68400640 1 Processor -- start 2024-03-27T10:00:00.795 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.775+0000 7faf68400640 1 -- start start 2024-03-27T10:00:00.795 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.775+0000 7f4455000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44501631e0 0x7f445015d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:00.795 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.775+0000 7f4456400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4450166b40 0x7f445015d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:00.795 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.775+0000 7f4455000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44501631e0 0x7f445015d270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.57:52918/0 (socket says 172.21.15.57:52918) 2024-03-27T10:00:00.795 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.775+0000 7f4455000640 1 -- 172.21.15.57:0/2991144620 learned_addr learned my addr 172.21.15.57:0/2991144620 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:00.796 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.775+0000 7f79a9600640 1 -- 172.21.15.57:0/2350197186 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79a40d0190 con 0x7f79a40b3700 2024-03-27T10:00:00.796 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.776+0000 7f4455000640 1 -- 172.21.15.57:0/2991144620 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4450166b40 msgr2=0x7f445015d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:00.796 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.776+0000 7f4455000640 1 --2- 172.21.15.57:0/2991144620 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4450166b40 0x7f445015d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:00.796 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.776+0000 7f4455000640 1 -- 172.21.15.57:0/2991144620 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f445006b7a0 msgr2=0x7f44500ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:00.796 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.776+0000 7f4455000640 1 --2- 172.21.15.57:0/2991144620 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f445006b7a0 0x7f44500ccf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:00.796 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.776+0000 7f4455000640 1 -- 172.21.15.57:0/2991144620 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44501f8c20 con 0x7f44501631e0 2024-03-27T10:00:00.796 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.776+0000 7f4456400640 1 --2- 172.21.15.57:0/2991144620 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4450166b40 0x7f445015d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T10:00:00.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.774+0000 7f6f4fe00640 1 -- start start 2024-03-27T10:00:00.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.777+0000 7f799aa00640 1 --2- 172.21.15.57:0/2350197186 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f798406c530 0x7f798406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:00.798 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.776+0000 7f6f4fe00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6f480d2de0 0x7f6f480ca190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:00.798 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.776+0000 7f6f4fe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6f480d42f0 0x7f6f481f7e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:00.798 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.776+0000 7f6f4fe00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6f4815e510 0x7f6f4806d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:00.798 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.776+0000 7f6f4fe00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f6f480b4c90 con 0x7f6f4815e510 2024-03-27T10:00:00.798 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.776+0000 7f6f4fe00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f6f480b49b0 con 0x7f6f480d42f0 2024-03-27T10:00:00.798 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.776+0000 7f6f4fe00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f6f480b3d70 con 0x7f6f480d2de0 2024-03-27T10:00:00.798 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.777+0000 7f6f4ca00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6f480d42f0 0x7f6f481f7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:00.798 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.777+0000 7f6f4ca00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6f480d42f0 0x7f6f481f7e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.57:52920/0 (socket says 172.21.15.57:52920) 2024-03-27T10:00:00.798 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.777+0000 7f6f4ca00640 1 -- 172.21.15.57:0/2932842070 learned_addr learned my addr 172.21.15.57:0/2932842070 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:00.798 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.777+0000 7f1bc6000640 1 -- 172.21.15.57:0/1695515969 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f1bd00b1270 con 0x7f1bd00d0950 2024-03-27T10:00:00.799 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.777+0000 7f799aa00640 1 -- 172.21.15.57:0/2350197186 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f799408bac0 con 0x7f79a40b3700 2024-03-27T10:00:00.799 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.777+0000 7f79a2000640 1 --2- 172.21.15.57:0/2350197186 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f798406c530 0x7f798406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:00.800 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.777+0000 7faf68400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf6006b750 0x7faf60132430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:00.800 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.777+0000 7faf68400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faf600ce740 0x7faf6012f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:00.800 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.776+0000 7f440a000640 1 -- 172.21.15.57:0/346904547 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f4404005d10 con 0x7f441406b540 2024-03-27T10:00:00.800 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.777+0000 7f6f4d400640 1 --2- 172.21.15.57:0/2932842070 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6f480d2de0 0x7f6f480ca190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:00.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.778+0000 7f4455000640 1 --2- 172.21.15.57:0/2991144620 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44501631e0 0x7f445015d270 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f443c00b3e0 tx=0x7f443c00b8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:00.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.778+0000 7faf68400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faf60145820 0x7faf60131060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:00.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.778+0000 7faf65a00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf6006b750 0x7faf60132430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:00.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.778+0000 7faf65a00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf6006b750 0x7faf60132430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:48952/0 (socket says 172.21.15.57:48952) 2024-03-27T10:00:00.802 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.778+0000 7f440a000640 1 --2- 172.21.15.57:0/346904547 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f43f406c530 0x7f43f406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:00.802 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.778+0000 7f440a000640 1 -- 172.21.15.57:0/346904547 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f440408b9e0 con 0x7f441406b540 2024-03-27T10:00:00.802 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.778+0000 7faf65a00640 1 -- 172.21.15.57:0/1882005267 learned_addr learned my addr 172.21.15.57:0/1882005267 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:00.802 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.778+0000 7f6f4ca00640 1 -- 172.21.15.57:0/2932842070 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6f480d2de0 msgr2=0x7f6f480ca190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:00.802 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.778+0000 7f6f4ca00640 1 --2- 172.21.15.57:0/2932842070 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6f480d2de0 0x7f6f480ca190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:00.803 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.778+0000 7f6f4ca00640 1 -- 172.21.15.57:0/2932842070 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6f4815e510 msgr2=0x7f6f4806d1e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-27T10:00:00.803 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.778+0000 7faf68400640 1 -- 172.21.15.57:0/1882005267 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7faf601607f0 con 0x7faf6006b750 2024-03-27T10:00:00.803 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.779+0000 7faf68400640 1 -- 172.21.15.57:0/1882005267 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7faf60160510 con 0x7faf600ce740 2024-03-27T10:00:00.803 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.779+0000 7faf68400640 1 -- 172.21.15.57:0/1882005267 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7faf60145c00 con 0x7faf60145820 2024-03-27T10:00:00.803 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.778+0000 7faf65000640 1 --2- 172.21.15.57:0/1882005267 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faf600ce740 0x7faf6012f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:00.804 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.779+0000 7f6f4de00640 1 --2- 172.21.15.57:0/2932842070 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6f4815e510 0x7f6f4806d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:00.804 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.779+0000 7f6f4ca00640 1 --2- 172.21.15.57:0/2932842070 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6f4815e510 0x7f6f4806d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:00.804 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.779+0000 7f6f4ca00640 1 -- 172.21.15.57:0/2932842070 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f480b7040 con 0x7f6f480d42f0 2024-03-27T10:00:00.804 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.779+0000 7f6f4de00640 1 --2- 172.21.15.57:0/2932842070 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6f4815e510 0x7f6f4806d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T10:00:00.804 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.779+0000 7faf66400640 1 --2- 172.21.15.57:0/1882005267 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faf60145820 0x7faf60131060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:00.804 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.779+0000 7faf65a00640 1 -- 172.21.15.57:0/1882005267 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faf60145820 msgr2=0x7faf60131060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:00.805 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.779+0000 7f79a2000640 1 --2- 172.21.15.57:0/2350197186 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f798406c530 0x7f798406e9f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f799002b6a0 tx=0x7f7990008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:00.805 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.779+0000 7f4411400640 1 --2- 172.21.15.57:0/346904547 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f43f406c530 0x7f43f406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:00.805 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.779+0000 7faf65a00640 1 --2- 172.21.15.57:0/1882005267 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faf60145820 0x7faf60131060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:00.805 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.779+0000 7faf65a00640 1 -- 172.21.15.57:0/1882005267 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faf600ce740 msgr2=0x7faf6012f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:00.805 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.779+0000 7faf65a00640 1 --2- 172.21.15.57:0/1882005267 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faf600ce740 0x7faf6012f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:00.806 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.779+0000 7faf65a00640 1 -- 172.21.15.57:0/1882005267 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf6012ffe0 con 0x7faf6006b750 2024-03-27T10:00:00.806 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.779+0000 7f6f4ca00640 1 --2- 172.21.15.57:0/2932842070 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6f480d42f0 0x7f6f481f7e40 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6f3400d7d0 tx=0x7f6f3400dc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:00.806 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.780+0000 7faf65000640 1 --2- 172.21.15.57:0/1882005267 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faf600ce740 0x7faf6012f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T10:00:00.806 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.780+0000 7faf66400640 1 --2- 172.21.15.57:0/1882005267 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faf60145820 0x7faf60131060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T10:00:00.806 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.780+0000 7faf65a00640 1 --2- 172.21.15.57:0/1882005267 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf6006b750 0x7faf60132430 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7faf5400c400 tx=0x7faf5400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:00.807 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.780+0000 7f4411400640 1 --2- 172.21.15.57:0/346904547 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f43f406c530 0x7f43f406e9f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4400000f60 tx=0x7f44000079b0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:00.808 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.780+0000 7faf5d600640 1 -- 172.21.15.57:0/1882005267 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf54017070 con 0x7faf6006b750 2024-03-27T10:00:00.808 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.780+0000 7faf5d600640 1 -- 172.21.15.57:0/1882005267 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf540052d0 con 0x7faf6006b750 2024-03-27T10:00:00.808 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.780+0000 7faf5d600640 1 -- 172.21.15.57:0/1882005267 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf540037f0 con 0x7faf6006b750 2024-03-27T10:00:00.808 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.781+0000 7faf68400640 1 -- 172.21.15.57:0/1882005267 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf601302c0 con 0x7faf6006b750 2024-03-27T10:00:00.808 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.781+0000 7faf68400640 1 -- 172.21.15.57:0/1882005267 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf60130880 con 0x7faf6006b750 2024-03-27T10:00:00.808 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.782+0000 7faf68400640 1 -- 172.21.15.57:0/1882005267 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf60068620 con 0x7faf6006b750 2024-03-27T10:00:00.809 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.784+0000 7faf5d600640 1 -- 172.21.15.57:0/1882005267 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7faf5401a070 con 0x7faf6006b750 2024-03-27T10:00:00.809 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.786+0000 7faf5d600640 1 --2- 172.21.15.57:0/1882005267 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7faf4006c530 0x7faf4006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:00.809 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.786+0000 7faf5d600640 1 -- 172.21.15.57:0/1882005267 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7faf5408ac20 con 0x7faf6006b750 2024-03-27T10:00:00.809 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.786+0000 7faf65000640 1 --2- 172.21.15.57:0/1882005267 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7faf4006c530 0x7faf4006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:00.809 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.787+0000 7faf65000640 1 --2- 172.21.15.57:0/1882005267 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7faf4006c530 0x7faf4006e9f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7faf4c036000 tx=0x7faf4c03b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:00.809 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.789+0000 7f440a000640 1 -- 172.21.15.57:0/346904547 <== mon.1 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f44040596e0 con 0x7f441406b540 2024-03-27T10:00:00.810 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.791+0000 7faf5d600640 1 -- 172.21.15.57:0/1882005267 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7faf540588a0 con 0x7faf6006b750 2024-03-27T10:00:00.810 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.803+0000 7f444d600640 1 -- 172.21.15.57:0/2991144620 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f443c015020 con 0x7f44501631e0 2024-03-27T10:00:00.810 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.803+0000 7f444d600640 1 -- 172.21.15.57:0/2991144620 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f443c011850 con 0x7f44501631e0 2024-03-27T10:00:00.810 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.803+0000 7f444d600640 1 -- 172.21.15.57:0/2991144620 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f443c011c40 con 0x7f44501631e0 2024-03-27T10:00:00.810 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.803+0000 7f4458400640 1 -- 172.21.15.57:0/2991144620 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44501f8f00 con 0x7f44501631e0 2024-03-27T10:00:00.811 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.803+0000 7f799aa00640 1 -- 172.21.15.57:0/2350197186 <== mon.1 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f79a40d0190 con 0x7f79a40b3700 2024-03-27T10:00:00.811 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.803+0000 7f4458400640 1 -- 172.21.15.57:0/2991144620 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44500cc730 con 0x7f44501631e0 2024-03-27T10:00:00.811 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.805+0000 7f4458400640 1 -- 172.21.15.57:0/2991144620 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4450068620 con 0x7f44501631e0 2024-03-27T10:00:00.812 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.806+0000 7f6f45600640 1 -- 172.21.15.57:0/2932842070 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f340096a0 con 0x7f6f480d42f0 2024-03-27T10:00:00.812 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.806+0000 7f6f45600640 1 -- 172.21.15.57:0/2932842070 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f34019070 con 0x7f6f480d42f0 2024-03-27T10:00:00.812 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.806+0000 7f6f45600640 1 -- 172.21.15.57:0/2932842070 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f34009a80 con 0x7f6f480d42f0 2024-03-27T10:00:00.812 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.807+0000 7f6f4fe00640 1 -- 172.21.15.57:0/2932842070 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f480b7320 con 0x7f6f480d42f0 2024-03-27T10:00:00.812 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.807+0000 7f6f4fe00640 1 -- 172.21.15.57:0/2932842070 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f480b78e0 con 0x7f6f480d42f0 2024-03-27T10:00:00.812 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.808+0000 7f6f4fe00640 1 -- 172.21.15.57:0/2932842070 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f48068c50 con 0x7f6f480d42f0 2024-03-27T10:00:00.813 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.807+0000 7f444d600640 1 -- 172.21.15.57:0/2991144620 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f443c018020 con 0x7f44501631e0 2024-03-27T10:00:00.813 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.809+0000 7f444d600640 1 --2- 172.21.15.57:0/2991144620 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f443006c580 0x7f443006ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:00.813 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.809+0000 7f444d600640 1 -- 172.21.15.57:0/2991144620 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f443c011de0 con 0x7f44501631e0 2024-03-27T10:00:00.813 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.810+0000 7f4455a00640 1 --2- 172.21.15.57:0/2991144620 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f443006c580 0x7f443006ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:00.813 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.811+0000 7f4455a00640 1 --2- 172.21.15.57:0/2991144620 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f443006c580 0x7f443006ea40 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4444036000 tx=0x7f4444030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:00.813 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.819+0000 7f444d600640 1 -- 172.21.15.57:0/2991144620 <== mon.1 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f443c01f020 con 0x7f44501631e0 2024-03-27T10:00:00.814 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.821+0000 7f6f45600640 1 -- 172.21.15.57:0/2932842070 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f6f34009c20 con 0x7f6f480d42f0 2024-03-27T10:00:00.814 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.823+0000 7f6f45600640 1 --2- 172.21.15.57:0/2932842070 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f6f2806c580 0x7f6f2806ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:00.814 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.823+0000 7f6f45600640 1 -- 172.21.15.57:0/2932842070 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f6f3408c860 con 0x7f6f480d42f0 2024-03-27T10:00:00.815 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.825+0000 7f6f4d400640 1 --2- 172.21.15.57:0/2932842070 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f6f2806c580 0x7f6f2806ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:00.816 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.826+0000 7f6f4d400640 1 --2- 172.21.15.57:0/2932842070 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f6f2806c580 0x7f6f2806ea40 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c036000 tx=0x7f6f3c03c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:00.820 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:00.831+0000 7f6f45600640 1 -- 172.21.15.57:0/2932842070 <== mon.1 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f6f3405ab20 con 0x7f6f480d42f0 2024-03-27T10:00:01.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.205+0000 7f04ffe00640 1 -- 172.21.15.57:0/1243364643 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f04f8056bf0 con 0x7f04f80e3160 2024-03-27T10:00:01.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.206+0000 7f04f7400640 1 -- 172.21.15.57:0/1243364643 <== mon.1 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f05000d4770 con 0x7f04f80e3160 2024-03-27T10:00:01.199 INFO:teuthology.orchestra.run.smithi057.stdout:60129542154 2024-03-27T10:00:01.199 INFO:teuthology.orchestra.run.smithi057.stdout:55834574858 2024-03-27T10:00:01.199 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.207+0000 7f0740000640 1 -- 172.21.15.57:0/1234069942 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f0714005580 con 0x7f07381631e0 2024-03-27T10:00:01.200 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.208+0000 7f0735600640 1 -- 172.21.15.57:0/1234069942 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f073005d300 con 0x7f07381631e0 2024-03-27T10:00:01.200 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.210+0000 7f1bd4e00640 1 -- 172.21.15.57:0/1695515969 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f1bd00719d0 con 0x7f1bd00d0950 2024-03-27T10:00:01.200 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.211+0000 7f04ffe00640 1 -- 172.21.15.57:0/1243364643 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f04e006c600 msgr2=0x7f04e006eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:01.201 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.211+0000 7f0740000640 1 -- 172.21.15.57:0/1234069942 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f071806c530 msgr2=0x7f071806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:01.201 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.211+0000 7f0740000640 1 --2- 172.21.15.57:0/1234069942 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f071806c530 0x7f071806e9f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f072c007c40 tx=0x7f072c007b90 comp rx=0 tx=0).stop 2024-03-27T10:00:01.201 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.211+0000 7f04ffe00640 1 --2- 172.21.15.57:0/1243364643 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f04e006c600 0x7f04e006eac0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f04f0035000 tx=0x7f04f0008030 comp rx=0 tx=0).stop 2024-03-27T10:00:01.202 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.211+0000 7f0740000640 1 -- 172.21.15.57:0/1234069942 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f07381631e0 msgr2=0x7f073815a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:01.202 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.211+0000 7f0740000640 1 --2- 172.21.15.57:0/1234069942 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f07381631e0 0x7f073815a590 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0730001560 tx=0x7f073000ced0 comp rx=0 tx=0).stop 2024-03-27T10:00:01.202 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.212+0000 7f04ffe00640 1 -- 172.21.15.57:0/1243364643 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f04f80e3160 msgr2=0x7f04f80e7190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:01.202 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.212+0000 7f1bc6000640 1 -- 172.21.15.57:0/1695515969 <== mon.2 v2:172.21.15.118:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1bc805a5e0 con 0x7f1bd00d0950 2024-03-27T10:00:01.203 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.212+0000 7f04ffe00640 1 --2- 172.21.15.57:0/1243364643 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f04f80e3160 0x7f04f80e7190 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0500064b70 tx=0x7f05000682f0 comp rx=0 tx=0).stop 2024-03-27T10:00:01.203 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.212+0000 7f0740000640 1 -- 172.21.15.57:0/1234069942 shutdown_connections 2024-03-27T10:00:01.203 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.212+0000 7f0740000640 1 --2- 172.21.15.57:0/1234069942 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f07381631e0 0x7f073815a590 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:01.203 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.212+0000 7f0740000640 1 --2- 172.21.15.57:0/1234069942 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f071806c530 0x7f071806e9f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:01.203 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.212+0000 7f0740000640 1 --2- 172.21.15.57:0/1234069942 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f073806d1b0 0x7f073815a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:01.203 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.212+0000 7f0740000640 1 --2- 172.21.15.57:0/1234069942 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f073806b7a0 0x7f073815dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:01.203 INFO:teuthology.orchestra.run.smithi057.stdout:60129542153 2024-03-27T10:00:01.204 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.212+0000 7f0740000640 1 -- 172.21.15.57:0/1234069942 >> 172.21.15.57:0/1234069942 conn(0x7f07380b1c60 msgr2=0x7f07380b2040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:01.204 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.214+0000 7f0740000640 1 -- 172.21.15.57:0/1234069942 shutdown_connections 2024-03-27T10:00:01.204 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.214+0000 7f04ffe00640 1 -- 172.21.15.57:0/1243364643 shutdown_connections 2024-03-27T10:00:01.204 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.214+0000 7f04ffe00640 1 --2- 172.21.15.57:0/1243364643 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f04e006c600 0x7f04e006eac0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:01.205 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.214+0000 7f0740000640 1 -- 172.21.15.57:0/1234069942 wait complete. 2024-03-27T10:00:01.205 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.214+0000 7f04ffe00640 1 --2- 172.21.15.57:0/1243364643 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f04f80e3160 0x7f04f80e7190 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:01.205 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.214+0000 7f04ffe00640 1 --2- 172.21.15.57:0/1243364643 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f04f8053cb0 0x7f04f80e6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:01.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.214+0000 7f04ffe00640 1 --2- 172.21.15.57:0/1243364643 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f04f803c0a0 0x7f04f80ddd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:01.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.214+0000 7f04ffe00640 1 -- 172.21.15.57:0/1243364643 >> 172.21.15.57:0/1243364643 conn(0x7f04f8058ee0 msgr2=0x7f04f8058030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:01.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.215+0000 7f04ffe00640 1 -- 172.21.15.57:0/1243364643 shutdown_connections 2024-03-27T10:00:01.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.215+0000 7f04ffe00640 1 -- 172.21.15.57:0/1243364643 wait complete. 2024-03-27T10:00:01.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.216+0000 7f1bd4e00640 1 -- 172.21.15.57:0/1695515969 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f1bb006c530 msgr2=0x7f1bb006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:01.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.216+0000 7f1bd4e00640 1 --2- 172.21.15.57:0/1695515969 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f1bb006c530 0x7f1bb006e9f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1bc00011e0 tx=0x7f1bc0009040 comp rx=0 tx=0).stop 2024-03-27T10:00:01.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.216+0000 7f1bd4e00640 1 -- 172.21.15.57:0/1695515969 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1bd00d0950 msgr2=0x7f1bd0153530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:01.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.216+0000 7f1bd4e00640 1 --2- 172.21.15.57:0/1695515969 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1bd00d0950 0x7f1bd0153530 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1bc800c6b0 tx=0x7f1bc800cb70 comp rx=0 tx=0).stop 2024-03-27T10:00:01.207 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.217+0000 7f1bd4e00640 1 -- 172.21.15.57:0/1695515969 shutdown_connections 2024-03-27T10:00:01.207 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.217+0000 7f1bd4e00640 1 --2- 172.21.15.57:0/1695515969 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1bd00d0950 0x7f1bd0153530 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:01.207 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.217+0000 7f1bd4e00640 1 --2- 172.21.15.57:0/1695515969 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f1bb006c530 0x7f1bb006e9f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:01.207 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.217+0000 7f1bd4e00640 1 --2- 172.21.15.57:0/1695515969 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1bd00b3140 0x7f1bd015cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:01.207 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.217+0000 7f1bd4e00640 1 --2- 172.21.15.57:0/1695515969 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1bd006e260 0x7f1bd015c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:01.207 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.217+0000 7f1bd4e00640 1 -- 172.21.15.57:0/1695515969 >> 172.21.15.57:0/1695515969 conn(0x7f1bd00cfe60 msgr2=0x7f1bd00cd1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:01.208 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.218+0000 7f1bd4e00640 1 -- 172.21.15.57:0/1695515969 shutdown_connections 2024-03-27T10:00:01.208 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.218+0000 7f1bd4e00640 1 -- 172.21.15.57:0/1695515969 wait complete. 2024-03-27T10:00:01.226 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.236+0000 7faf68400640 1 -- 172.21.15.57:0/1882005267 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7faf600b4a70 con 0x7faf6006b750 2024-03-27T10:00:01.228 INFO:teuthology.orchestra.run.smithi057.stdout:55834574858 2024-03-27T10:00:01.228 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.237+0000 7faf5d600640 1 -- 172.21.15.57:0/1882005267 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7faf5405cba0 con 0x7faf6006b750 2024-03-27T10:00:01.231 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.241+0000 7faf68400640 1 -- 172.21.15.57:0/1882005267 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7faf4006c530 msgr2=0x7faf4006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:01.231 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.241+0000 7faf68400640 1 --2- 172.21.15.57:0/1882005267 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7faf4006c530 0x7faf4006e9f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7faf4c036000 tx=0x7faf4c03b040 comp rx=0 tx=0).stop 2024-03-27T10:00:01.231 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.241+0000 7faf68400640 1 -- 172.21.15.57:0/1882005267 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf6006b750 msgr2=0x7faf60132430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:01.231 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.241+0000 7faf68400640 1 --2- 172.21.15.57:0/1882005267 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf6006b750 0x7faf60132430 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7faf5400c400 tx=0x7faf5400c8c0 comp rx=0 tx=0).stop 2024-03-27T10:00:01.232 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.6 2024-03-27T10:00:01.233 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.242+0000 7faf68400640 1 -- 172.21.15.57:0/1882005267 shutdown_connections 2024-03-27T10:00:01.233 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.242+0000 7faf68400640 1 --2- 172.21.15.57:0/1882005267 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faf60145820 0x7faf60131060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:01.233 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.242+0000 7faf68400640 1 --2- 172.21.15.57:0/1882005267 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7faf4006c530 0x7faf4006e9f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:01.233 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.242+0000 7faf68400640 1 --2- 172.21.15.57:0/1882005267 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faf600ce740 0x7faf6012f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:01.233 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.242+0000 7faf68400640 1 --2- 172.21.15.57:0/1882005267 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faf6006b750 0x7faf60132430 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:01.233 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.242+0000 7faf68400640 1 -- 172.21.15.57:0/1882005267 >> 172.21.15.57:0/1882005267 conn(0x7faf600b1c60 msgr2=0x7faf600b2040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:01.233 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.242+0000 7faf68400640 1 -- 172.21.15.57:0/1882005267 shutdown_connections 2024-03-27T10:00:01.233 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.242+0000 7faf68400640 1 -- 172.21.15.57:0/1882005267 wait complete. 2024-03-27T10:00:01.234 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542154 for osd.2 2024-03-27T10:00:01.235 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542153 for osd.1 2024-03-27T10:00:01.239 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.249+0000 7f79a9600640 1 -- 172.21.15.57:0/2350197186 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f79a4068620 con 0x7f79a40b3700 2024-03-27T10:00:01.240 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.250+0000 7f799aa00640 1 -- 172.21.15.57:0/2350197186 <== mon.1 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7994059740 con 0x7f79a40b3700 2024-03-27T10:00:01.240 INFO:teuthology.orchestra.run.smithi057.stdout:55834574857 2024-03-27T10:00:01.241 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.252+0000 7f4418a00640 1 -- 172.21.15.57:0/346904547 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f43ec005850 con 0x7f441406b540 2024-03-27T10:00:01.242 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.252+0000 7f440a000640 1 -- 172.21.15.57:0/346904547 <== mon.1 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f440405d9e0 con 0x7f441406b540 2024-03-27T10:00:01.242 INFO:teuthology.orchestra.run.smithi057.stdout:60129542154 2024-03-27T10:00:01.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.253+0000 7f79a9600640 1 -- 172.21.15.57:0/2350197186 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f798406c530 msgr2=0x7f798406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:01.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.253+0000 7f79a9600640 1 --2- 172.21.15.57:0/2350197186 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f798406c530 0x7f798406e9f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f799002b6a0 tx=0x7f7990008030 comp rx=0 tx=0).stop 2024-03-27T10:00:01.244 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.253+0000 7f79a9600640 1 -- 172.21.15.57:0/2350197186 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f79a40b3700 msgr2=0x7f79a40cd680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:01.244 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.253+0000 7f79a9600640 1 --2- 172.21.15.57:0/2350197186 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f79a40b3700 0x7f79a40cd680 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f799400d5f0 tx=0x7f799400dab0 comp rx=0 tx=0).stop 2024-03-27T10:00:01.244 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.253+0000 7f79a9600640 1 -- 172.21.15.57:0/2350197186 shutdown_connections 2024-03-27T10:00:01.244 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.253+0000 7f79a9600640 1 --2- 172.21.15.57:0/2350197186 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f79a40d3000 0x7f79a40ccf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:01.244 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.253+0000 7f79a9600640 1 --2- 172.21.15.57:0/2350197186 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f79a40d1070 0x7f79a41f9260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:01.244 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.253+0000 7f79a9600640 1 --2- 172.21.15.57:0/2350197186 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f798406c530 0x7f798406e9f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:01.244 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.253+0000 7f79a9600640 1 --2- 172.21.15.57:0/2350197186 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f79a40b3700 0x7f79a40cd680 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:01.244 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.253+0000 7f79a9600640 1 -- 172.21.15.57:0/2350197186 >> 172.21.15.57:0/2350197186 conn(0x7f79a408db50 msgr2=0x7f79a40cfa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:01.244 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.253+0000 7f79a9600640 1 -- 172.21.15.57:0/2350197186 shutdown_connections 2024-03-27T10:00:01.244 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.253+0000 7f79a9600640 1 -- 172.21.15.57:0/2350197186 wait complete. 2024-03-27T10:00:01.245 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.254+0000 7f4458400640 1 -- 172.21.15.57:0/2991144620 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f44500b4cf0 con 0x7f44501631e0 2024-03-27T10:00:01.245 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.255+0000 7f444d600640 1 -- 172.21.15.57:0/2991144620 <== mon.1 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f443c059f60 con 0x7f44501631e0 2024-03-27T10:00:01.245 INFO:teuthology.orchestra.run.smithi057.stdout:55834574859 2024-03-27T10:00:01.246 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.256+0000 7f4418a00640 1 -- 172.21.15.57:0/346904547 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f43f406c530 msgr2=0x7f43f406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:01.246 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.256+0000 7f4418a00640 1 --2- 172.21.15.57:0/346904547 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f43f406c530 0x7f43f406e9f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4400000f60 tx=0x7f44000079b0 comp rx=0 tx=0).stop 2024-03-27T10:00:01.246 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.256+0000 7f4418a00640 1 -- 172.21.15.57:0/346904547 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f441406b540 msgr2=0x7f4414155590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:01.246 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.256+0000 7f4418a00640 1 --2- 172.21.15.57:0/346904547 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f441406b540 0x7f4414155590 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f44040095b0 tx=0x7f4404009a70 comp rx=0 tx=0).stop 2024-03-27T10:00:01.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.256+0000 7f4418a00640 1 -- 172.21.15.57:0/346904547 shutdown_connections 2024-03-27T10:00:01.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.256+0000 7f4418a00640 1 --2- 172.21.15.57:0/346904547 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f44140aed10 0x7f44141f8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:01.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.256+0000 7f4418a00640 1 --2- 172.21.15.57:0/346904547 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4414072310 0x7f441415e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:01.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.256+0000 7f4418a00640 1 --2- 172.21.15.57:0/346904547 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f43f406c530 0x7f43f406e9f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:01.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.256+0000 7f4418a00640 1 --2- 172.21.15.57:0/346904547 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f441406b540 0x7f4414155590 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:01.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.256+0000 7f4418a00640 1 -- 172.21.15.57:0/346904547 >> 172.21.15.57:0/346904547 conn(0x7f44140d13c0 msgr2=0x7f4414159f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:01.248 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.257+0000 7f4418a00640 1 -- 172.21.15.57:0/346904547 shutdown_connections 2024-03-27T10:00:01.248 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.257+0000 7f4418a00640 1 -- 172.21.15.57:0/346904547 wait complete. 2024-03-27T10:00:01.249 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.257+0000 7f6f4fe00640 1 -- 172.21.15.57:0/2932842070 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f6f480c7580 con 0x7f6f480d42f0 2024-03-27T10:00:01.250 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.257+0000 7f4458400640 1 -- 172.21.15.57:0/2991144620 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f443006c580 msgr2=0x7f443006ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:01.250 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.257+0000 7f4458400640 1 --2- 172.21.15.57:0/2991144620 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f443006c580 0x7f443006ea40 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4444036000 tx=0x7f4444030000 comp rx=0 tx=0).stop 2024-03-27T10:00:01.251 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.257+0000 7f4458400640 1 -- 172.21.15.57:0/2991144620 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44501631e0 msgr2=0x7f445015d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:01.251 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.257+0000 7f4458400640 1 --2- 172.21.15.57:0/2991144620 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44501631e0 0x7f445015d270 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f443c00b3e0 tx=0x7f443c00b8a0 comp rx=0 tx=0).stop 2024-03-27T10:00:01.251 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.258+0000 7f4458400640 1 -- 172.21.15.57:0/2991144620 shutdown_connections 2024-03-27T10:00:01.251 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.258+0000 7f4458400640 1 --2- 172.21.15.57:0/2991144620 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4450166b40 0x7f445015d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:01.251 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.258+0000 7f4458400640 1 --2- 172.21.15.57:0/2991144620 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f443006c580 0x7f443006ea40 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:01.251 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.258+0000 7f4458400640 1 --2- 172.21.15.57:0/2991144620 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44501631e0 0x7f445015d270 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:01.252 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.258+0000 7f4458400640 1 --2- 172.21.15.57:0/2991144620 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f445006b7a0 0x7f44500ccf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:01.252 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.258+0000 7f4458400640 1 -- 172.21.15.57:0/2991144620 >> 172.21.15.57:0/2991144620 conn(0x7f44500b1c60 msgr2=0x7f44500722f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:01.252 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.258+0000 7f4458400640 1 -- 172.21.15.57:0/2991144620 shutdown_connections 2024-03-27T10:00:01.252 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.258+0000 7f4458400640 1 -- 172.21.15.57:0/2991144620 wait complete. 2024-03-27T10:00:01.253 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.258+0000 7f6f45600640 1 -- 172.21.15.57:0/2932842070 <== mon.1 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6f3405a420 con 0x7f6f480d42f0 2024-03-27T10:00:01.253 INFO:teuthology.orchestra.run.smithi057.stdout:60129542153 2024-03-27T10:00:01.255 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.261+0000 7f6f4fe00640 1 -- 172.21.15.57:0/2932842070 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f6f2806c580 msgr2=0x7f6f2806ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:01.255 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.261+0000 7f6f4fe00640 1 --2- 172.21.15.57:0/2932842070 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f6f2806c580 0x7f6f2806ea40 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c036000 tx=0x7f6f3c03c040 comp rx=0 tx=0).stop 2024-03-27T10:00:01.255 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.261+0000 7f6f4fe00640 1 -- 172.21.15.57:0/2932842070 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6f480d42f0 msgr2=0x7f6f481f7e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:01.255 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.261+0000 7f6f4fe00640 1 --2- 172.21.15.57:0/2932842070 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6f480d42f0 0x7f6f481f7e40 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6f3400d7d0 tx=0x7f6f3400dc90 comp rx=0 tx=0).stop 2024-03-27T10:00:01.255 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.261+0000 7f6f4fe00640 1 -- 172.21.15.57:0/2932842070 shutdown_connections 2024-03-27T10:00:01.255 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.261+0000 7f6f4fe00640 1 --2- 172.21.15.57:0/2932842070 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6f4815e510 0x7f6f4806d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:01.256 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.261+0000 7f6f4fe00640 1 --2- 172.21.15.57:0/2932842070 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f6f2806c580 0x7f6f2806ea40 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:01.256 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.261+0000 7f6f4fe00640 1 --2- 172.21.15.57:0/2932842070 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6f480d42f0 0x7f6f481f7e40 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:01.256 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.261+0000 7f6f4fe00640 1 --2- 172.21.15.57:0/2932842070 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6f480d2de0 0x7f6f480ca190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:01.256 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.261+0000 7f6f4fe00640 1 -- 172.21.15.57:0/2932842070 >> 172.21.15.57:0/2932842070 conn(0x7f6f48067c00 msgr2=0x7f6f480d0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:01.256 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.262+0000 7f6f4fe00640 1 -- 172.21.15.57:0/2932842070 shutdown_connections 2024-03-27T10:00:01.256 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:01.262+0000 7f6f4fe00640 1 -- 172.21.15.57:0/2932842070 wait complete. 2024-03-27T10:00:01.258 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.4 2024-03-27T10:00:01.265 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.5 2024-03-27T10:00:01.270 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574859 for osd.7 2024-03-27T10:00:01.271 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542154 for osd.3 2024-03-27T10:00:01.272 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542153 for osd.0 2024-03-27T10:00:02.233 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-03-27T10:00:02.235 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-03-27T10:00:02.236 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-03-27T10:00:02.259 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-03-27T10:00:02.266 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-03-27T10:00:02.271 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-03-27T10:00:02.271 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-03-27T10:00:02.273 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-03-27T10:00:02.504 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.514+0000 7fbcb2600640 1 Processor -- start 2024-03-27T10:00:02.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.514+0000 7fbcb2600640 1 -- start start 2024-03-27T10:00:02.507 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.517+0000 7fbcb2600640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbcac13ecc0 0x7fbcac0ce120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:02.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.517+0000 7fbcb2600640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcac13f0a0 con 0x7fbcac160040 2024-03-27T10:00:02.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.517+0000 7fbcb2600640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcac0cece0 con 0x7fbcac0ce660 2024-03-27T10:00:02.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.517+0000 7fbcb2600640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7fbcac0cf8f0 con 0x7fbcac13ecc0 2024-03-27T10:00:02.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.518+0000 7fbcabe00640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fbcac0ce660 0x7fbcac15f930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.57:38590/0 (socket says 172.21.15.57:38590) 2024-03-27T10:00:02.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.518+0000 7fbcabe00640 1 -- 172.21.15.57:0/53961421 learned_addr learned my addr 172.21.15.57:0/53961421 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T10:00:02.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.518+0000 7fbcb1200640 1 --2- 172.21.15.57:0/53961421 >> v2:172.21.15.57:3300/0 conn(0x7fbcac13ecc0 0x7fbcac0ce120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:02.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.519+0000 7fbcab400640 1 -- 172.21.15.57:0/53961421 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2969265661 0 0) 0x7fbcac13f0a0 con 0x7fbcac160040 2024-03-27T10:00:02.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.519+0000 7fbcab400640 1 -- 172.21.15.57:0/53961421 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbc90003520 con 0x7fbcac160040 2024-03-27T10:00:02.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.519+0000 7fbcab400640 1 -- 172.21.15.57:0/53961421 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2835799416 0 0) 0x7fbcac0cece0 con 0x7fbcac0ce660 2024-03-27T10:00:02.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.520+0000 7fbcab400640 1 -- 172.21.15.57:0/53961421 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbcac13f0a0 con 0x7fbcac0ce660 2024-03-27T10:00:02.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.520+0000 7fbcab400640 1 -- 172.21.15.57:0/53961421 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2560149627 0 0) 0x7fbc90003520 con 0x7fbcac160040 2024-03-27T10:00:02.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.520+0000 7fbcab400640 1 -- 172.21.15.57:0/53961421 >> v2:172.21.15.57:3300/0 conn(0x7fbcac13ecc0 msgr2=0x7fbcac0ce120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:02.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.520+0000 7fbcab400640 1 --2- 172.21.15.57:0/53961421 >> v2:172.21.15.57:3300/0 conn(0x7fbcac13ecc0 0x7fbcac0ce120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:02.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.520+0000 7fbcab400640 1 -- 172.21.15.57:0/53961421 >> v1:172.21.15.118:6789/0 conn(0x7fbcac0ce660 legacy=0x7fbcac15f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:02.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.521+0000 7fbcab400640 1 -- 172.21.15.57:0/53961421 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcac0cefc0 con 0x7fbcac160040 2024-03-27T10:00:02.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.521+0000 7fbcab400640 1 -- 172.21.15.57:0/53961421 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4227751516 0 0) 0x7fbc98001670 con 0x7fbcac160040 2024-03-27T10:00:02.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.521+0000 7fbcab400640 1 -- 172.21.15.57:0/53961421 >> v1:172.21.15.57:6789/0 conn(0x7fbcac160040 legacy=0x7fbcac0b30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:02.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.521+0000 7fbcab400640 1 --2- 172.21.15.57:0/53961421 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbc90003b40 0x7fbc90003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:02.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.521+0000 7fbcab400640 1 --2- 172.21.15.57:0/53961421 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc90004800 0x7fbc90004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:02.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.521+0000 7fbcab400640 1 --2- 172.21.15.57:0/53961421 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbc900051c0 0x7fbc900145c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:02.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.521+0000 7fbcab400640 1 -- 172.21.15.57:0/53961421 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fbcac0cf8f0 con 0x7fbc900051c0 2024-03-27T10:00:02.513 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.521+0000 7fbcab400640 1 -- 172.21.15.57:0/53961421 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fbc90009b90 con 0x7fbc90004800 2024-03-27T10:00:02.513 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.521+0000 7fbcab400640 1 -- 172.21.15.57:0/53961421 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fbc90014b00 con 0x7fbc90003b40 2024-03-27T10:00:02.513 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.521+0000 7fbcb1200640 1 --2- 172.21.15.57:0/53961421 >> v2:172.21.15.57:3300/0 conn(0x7fbcac13ecc0 0x7fbcac0ce120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T10:00:02.513 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.523+0000 7fbcb1c00640 1 --2- 172.21.15.57:0/53961421 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbc900051c0 0x7fbc900145c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:02.513 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.523+0000 7fbcabe00640 1 --2- 172.21.15.57:0/53961421 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc90004800 0x7fbc90004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:02.513 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.523+0000 7fbcb1200640 1 --2- 172.21.15.57:0/53961421 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbc90003b40 0x7fbc90003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:02.513 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.523+0000 7f066ce00640 1 Processor -- start 2024-03-27T10:00:02.514 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.524+0000 7fbcb1c00640 1 -- 172.21.15.57:0/53961421 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbc90003b40 msgr2=0x7fbc90003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:02.514 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.524+0000 7fbcb1c00640 1 --2- 172.21.15.57:0/53961421 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbc90003b40 0x7fbc90003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:02.514 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.524+0000 7fbcb1c00640 1 -- 172.21.15.57:0/53961421 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc90004800 msgr2=0x7fbc90004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:02.514 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.524+0000 7fbcb1c00640 1 --2- 172.21.15.57:0/53961421 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbc90004800 0x7fbc90004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:02.514 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.524+0000 7fbcb1c00640 1 -- 172.21.15.57:0/53961421 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcac0cefc0 con 0x7fbc900051c0 2024-03-27T10:00:02.514 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.523+0000 7f066ce00640 1 -- start start 2024-03-27T10:00:02.515 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.524+0000 7fb323200640 1 Processor -- start 2024-03-27T10:00:02.515 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.525+0000 7fb323200640 1 -- start start 2024-03-27T10:00:02.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.525+0000 7f066ce00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f06680d3fe0 0x7f06680d4440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:02.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.526+0000 7fbcb1c00640 1 -- 172.21.15.57:0/53961421 reap_dead start 2024-03-27T10:00:02.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.525+0000 7f066ce00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f06680ceee0 0x7f06680cf370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:02.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.525+0000 7f066ce00640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f066815f850 con 0x7f066815e4a0 2024-03-27T10:00:02.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.526+0000 7f066ce00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f06680d0a10 con 0x7f06680d3fe0 2024-03-27T10:00:02.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.526+0000 7f066ce00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f06680d0cf0 con 0x7f06680ceee0 2024-03-27T10:00:02.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.526+0000 7fbcb1c00640 1 --2- 172.21.15.57:0/53961421 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbc900051c0 0x7fbc900145c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fbc9800c1c0 tx=0x7fbc90005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a6344d44cebb42e server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:02.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.527+0000 7fb323200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb324071720 0x7fb324143410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:02.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.527+0000 7fb323200640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fb32406f100 0x7fb32406cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:02.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.527+0000 7fb323200640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb32406d2d0 0x7fb32406d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:02.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.527+0000 7fb323200640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7fb324072ca0 con 0x7fb32406d2d0 2024-03-27T10:00:02.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.527+0000 7fb323200640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7fb324071c00 con 0x7fb32406f100 2024-03-27T10:00:02.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.527+0000 7fb323200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fb324071ee0 con 0x7fb324071720 2024-03-27T10:00:02.519 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.527+0000 7f0665e00640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f066815e4a0 0x7f06680d14f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:56712/0 (socket says 172.21.15.57:56712) 2024-03-27T10:00:02.519 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.527+0000 7f0665400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f06680d3fe0 0x7f06680d4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:02.519 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.527+0000 7f0666800640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f06680ceee0 0x7f06680cf370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:02.519 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.528+0000 7f0666800640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f06680ceee0 0x7f06680cf370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.57:48162/0 (socket says 172.21.15.57:48162) 2024-03-27T10:00:02.519 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.528+0000 7f0666800640 1 -- 172.21.15.57:0/365759704 learned_addr learned my addr 172.21.15.57:0/365759704 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:02.520 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.528+0000 7fb322800640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb32406d2d0 0x7fb32406d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:02.520 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.528+0000 7fbcab400640 1 -- 172.21.15.57:0/53961421 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc98007c30 con 0x7fbc900051c0 2024-03-27T10:00:02.520 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.528+0000 7fbcab400640 1 -- 172.21.15.57:0/53961421 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc98030070 con 0x7fbc900051c0 2024-03-27T10:00:02.520 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.528+0000 7fbcab400640 1 -- 172.21.15.57:0/53961421 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc980074b0 con 0x7fbc900051c0 2024-03-27T10:00:02.520 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.528+0000 7fb321400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fb32406f100 0x7fb32406cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:02.520 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.528+0000 7fb322800640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb32406d2d0 0x7fb32406d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:54894/0 (socket says 172.21.15.57:54894) 2024-03-27T10:00:02.520 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.528+0000 7fb322800640 1 -- 172.21.15.57:0/1246195099 learned_addr learned my addr 172.21.15.57:0/1246195099 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:02.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.528+0000 7fb321e00640 1 --2- 172.21.15.57:0/1246195099 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb324071720 0x7fb324143410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:02.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.528+0000 7fb322800640 1 -- 172.21.15.57:0/1246195099 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb324071720 msgr2=0x7fb324143410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:02.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.528+0000 7fb322800640 1 --2- 172.21.15.57:0/1246195099 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb324071720 0x7fb324143410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:02.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.528+0000 7fb322800640 1 -- 172.21.15.57:0/1246195099 >> v2:172.21.15.118:3300/0 conn(0x7fb32406f100 msgr2=0x7fb32406cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:02.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.528+0000 7fb322800640 1 --2- 172.21.15.57:0/1246195099 >> v2:172.21.15.118:3300/0 conn(0x7fb32406f100 0x7fb32406cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:02.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.528+0000 7fb322800640 1 -- 172.21.15.57:0/1246195099 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3240721c0 con 0x7fb32406d2d0 2024-03-27T10:00:02.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.529+0000 7f0666800640 1 -- 172.21.15.57:0/365759704 >> v2:172.21.15.118:3300/0 conn(0x7f06680d3fe0 msgr2=0x7f06680d4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:02.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.529+0000 7f0666800640 1 --2- 172.21.15.57:0/365759704 >> v2:172.21.15.118:3300/0 conn(0x7f06680d3fe0 0x7f06680d4440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:02.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.529+0000 7f0666800640 1 -- 172.21.15.57:0/365759704 >> v1:172.21.15.57:6789/0 conn(0x7f066815e4a0 legacy=0x7f06680d14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:02.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.529+0000 7f0666800640 1 -- 172.21.15.57:0/365759704 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06680d4980 con 0x7f06680ceee0 2024-03-27T10:00:02.522 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.530+0000 7fbcb2600640 1 -- 172.21.15.57:0/53961421 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbc900051c0 msgr2=0x7fbc900145c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:02.522 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.530+0000 7fbcb2600640 1 --2- 172.21.15.57:0/53961421 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbc900051c0 0x7fbc900145c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fbc9800c1c0 tx=0x7fbc90005830 comp rx=0 tx=0).stop 2024-03-27T10:00:02.523 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.530+0000 7fbcb2600640 1 -- 172.21.15.57:0/53961421 shutdown_connections 2024-03-27T10:00:02.523 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.530+0000 7fbcb2600640 1 --2- 172.21.15.57:0/53961421 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbc900051c0 0x7fbc900145c0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:02.523 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.530+0000 7fbcb2600640 1 -- 172.21.15.57:0/53961421 >> 172.21.15.57:0/53961421 conn(0x7fbcac0b1770 msgr2=0x7fbcac0b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:02.523 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.530+0000 7fbcb2600640 1 -- 172.21.15.57:0/53961421 shutdown_connections 2024-03-27T10:00:02.523 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.531+0000 7fbcb2600640 1 -- 172.21.15.57:0/53961421 wait complete. 2024-03-27T10:00:02.523 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.531+0000 7fb322800640 1 --2- 172.21.15.57:0/1246195099 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb32406d2d0 0x7fb32406d760 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb32406de20 tx=0x7fb31002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=532a4166a9afb708 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:02.523 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.532+0000 7fb320a00640 1 -- 172.21.15.57:0/1246195099 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb310035020 con 0x7fb32406d2d0 2024-03-27T10:00:02.524 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.532+0000 7fb320a00640 1 -- 172.21.15.57:0/1246195099 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb310031870 con 0x7fb32406d2d0 2024-03-27T10:00:02.524 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.532+0000 7fb320a00640 1 -- 172.21.15.57:0/1246195099 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb310031c40 con 0x7fb32406d2d0 2024-03-27T10:00:02.524 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.532+0000 7f0666800640 1 --2- 172.21.15.57:0/365759704 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f06680ceee0 0x7f06680cf370 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0654009870 tx=0x7f065402b9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f10c7cb31175541 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:02.524 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.532+0000 7f0664a00640 1 -- 172.21.15.57:0/365759704 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0654034070 con 0x7f06680ceee0 2024-03-27T10:00:02.524 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.532+0000 7f0664a00640 1 -- 172.21.15.57:0/365759704 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0654030860 con 0x7f06680ceee0 2024-03-27T10:00:02.524 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.532+0000 7f0664a00640 1 -- 172.21.15.57:0/365759704 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0654030c70 con 0x7f06680ceee0 2024-03-27T10:00:02.525 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.533+0000 7fbcb2600640 1 Processor -- start 2024-03-27T10:00:02.525 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.533+0000 7fb323200640 1 -- 172.21.15.57:0/1246195099 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb32406d2d0 msgr2=0x7fb32406d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:02.525 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.533+0000 7fb323200640 1 --2- 172.21.15.57:0/1246195099 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb32406d2d0 0x7fb32406d760 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb32406de20 tx=0x7fb31002b910 comp rx=0 tx=0).stop 2024-03-27T10:00:02.525 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.534+0000 7fb323200640 1 -- 172.21.15.57:0/1246195099 shutdown_connections 2024-03-27T10:00:02.525 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.534+0000 7fb323200640 1 --2- 172.21.15.57:0/1246195099 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb32406d2d0 0x7fb32406d760 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:02.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.534+0000 7fb323200640 1 --2- 172.21.15.57:0/1246195099 >> v2:172.21.15.118:3300/0 conn(0x7fb32406f100 0x7fb32406cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:02.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.534+0000 7fb323200640 1 --2- 172.21.15.57:0/1246195099 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb324071720 0x7fb324143410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:02.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.534+0000 7fb323200640 1 -- 172.21.15.57:0/1246195099 >> 172.21.15.57:0/1246195099 conn(0x7fb32406b990 msgr2=0x7fb32406bda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:02.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.533+0000 7fbcb2600640 1 -- start start 2024-03-27T10:00:02.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.534+0000 7fb323200640 1 -- 172.21.15.57:0/1246195099 shutdown_connections 2024-03-27T10:00:02.527 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.535+0000 7fb323200640 1 -- 172.21.15.57:0/1246195099 wait complete. 2024-03-27T10:00:02.527 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.535+0000 7f066ce00640 1 -- 172.21.15.57:0/365759704 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f06680ceee0 msgr2=0x7f06680cf370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:02.527 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.535+0000 7f066ce00640 1 --2- 172.21.15.57:0/365759704 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f06680ceee0 0x7f06680cf370 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0654009870 tx=0x7f065402b9a0 comp rx=0 tx=0).stop 2024-03-27T10:00:02.527 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.535+0000 7f066ce00640 1 -- 172.21.15.57:0/365759704 shutdown_connections 2024-03-27T10:00:02.527 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.535+0000 7f066ce00640 1 --2- 172.21.15.57:0/365759704 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f06680ceee0 0x7f06680cf370 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:02.527 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.535+0000 7f066ce00640 1 --2- 172.21.15.57:0/365759704 >> v2:172.21.15.118:3300/0 conn(0x7f06680d3fe0 0x7f06680d4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:02.527 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.535+0000 7f066ce00640 1 -- 172.21.15.57:0/365759704 >> 172.21.15.57:0/365759704 conn(0x7f066808db50 msgr2=0x7f066809d470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:02.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.535+0000 7fbcb2600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbc900051c0 0x7fbcac0b0520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:02.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.535+0000 7fbcb2600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbcac0b0a60 0x7fbcac1f2860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:02.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.535+0000 7fbcb2600640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbcac1f2da0 0x7fbcac151c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:02.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.535+0000 7fbcb2600640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fbcac06f850 con 0x7fbcac1f2da0 2024-03-27T10:00:02.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.535+0000 7fbcb2600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fbcac0cf580 con 0x7fbcac0b0a60 2024-03-27T10:00:02.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.535+0000 7fbcb2600640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fbcac0ce120 con 0x7fbc900051c0 2024-03-27T10:00:02.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.535+0000 7f066ce00640 1 -- 172.21.15.57:0/365759704 shutdown_connections 2024-03-27T10:00:02.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.536+0000 7fbcb1c00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbcac1f2da0 0x7fbcac151c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:02.530 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.536+0000 7fbcb1200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbc900051c0 0x7fbcac0b0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:02.530 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.536+0000 7fbcb1200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbc900051c0 0x7fbcac0b0520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.57:48188/0 (socket says 172.21.15.57:48188) 2024-03-27T10:00:02.530 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.536+0000 7fbcb1200640 1 -- 172.21.15.57:0/4005771351 learned_addr learned my addr 172.21.15.57:0/4005771351 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:02.530 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.537+0000 7fbcb1200640 1 -- 172.21.15.57:0/4005771351 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbcac0b0a60 msgr2=0x7fbcac1f2860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:02.530 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.536+0000 7fbcabe00640 1 --2- 172.21.15.57:0/4005771351 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbcac0b0a60 0x7fbcac1f2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:02.530 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.537+0000 7fb323200640 1 Processor -- start 2024-03-27T10:00:02.531 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.538+0000 7fb323200640 1 -- start start 2024-03-27T10:00:02.531 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.538+0000 7fbcb1200640 1 --2- 172.21.15.57:0/4005771351 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbcac0b0a60 0x7fbcac1f2860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:02.531 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.538+0000 7fbcb1200640 1 -- 172.21.15.57:0/4005771351 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbcac1f2da0 msgr2=0x7fbcac151c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:02.531 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.538+0000 7fbcb1200640 1 --2- 172.21.15.57:0/4005771351 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbcac1f2da0 0x7fbcac151c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:02.531 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.538+0000 7fbcb1200640 1 -- 172.21.15.57:0/4005771351 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcac0af760 con 0x7fbc900051c0 2024-03-27T10:00:02.531 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.536+0000 7f066ce00640 1 -- 172.21.15.57:0/365759704 wait complete. 2024-03-27T10:00:02.531 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.538+0000 7f066ce00640 1 Processor -- start 2024-03-27T10:00:02.532 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.538+0000 7fbcb1c00640 1 --2- 172.21.15.57:0/4005771351 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbcac1f2da0 0x7fbcac151c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T10:00:02.532 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.538+0000 7fbcabe00640 1 --2- 172.21.15.57:0/4005771351 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbcac0b0a60 0x7fbcac1f2860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T10:00:02.532 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.539+0000 7f066ce00640 1 -- start start 2024-03-27T10:00:02.533 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.539+0000 7fbcb1200640 1 --2- 172.21.15.57:0/4005771351 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbc900051c0 0x7fbcac0b0520 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fbca4009f70 tx=0x7fbca40105f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:02.533 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.539+0000 7fbca8c00640 1 -- 172.21.15.57:0/4005771351 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbca4003990 con 0x7fbc900051c0 2024-03-27T10:00:02.533 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.540+0000 7fbca8c00640 1 -- 172.21.15.57:0/4005771351 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbca4003b30 con 0x7fbc900051c0 2024-03-27T10:00:02.533 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.540+0000 7fbca8c00640 1 -- 172.21.15.57:0/4005771351 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbca4003d20 con 0x7fbc900051c0 2024-03-27T10:00:02.533 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.540+0000 7fb323200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb32406d2d0 0x7fb324203980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:02.533 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.540+0000 7fb323200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb32406f100 0x7fb324200c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:02.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.540+0000 7fb323200640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb324071720 0x7fb3241f2e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:02.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.540+0000 7fbcb2600640 1 -- 172.21.15.57:0/4005771351 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcac0afa40 con 0x7fbc900051c0 2024-03-27T10:00:02.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.540+0000 7fbcb2600640 1 -- 172.21.15.57:0/4005771351 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcac0b0000 con 0x7fbc900051c0 2024-03-27T10:00:02.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.541+0000 7f066ce00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f06680ceee0 0x7f06680cb2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:02.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.541+0000 7fb321400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb32406f100 0x7fb324200c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:02.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.541+0000 7fb321400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb32406f100 0x7fb324200c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.57:48200/0 (socket says 172.21.15.57:48200) 2024-03-27T10:00:02.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.541+0000 7fb321400640 1 -- 172.21.15.57:0/4265134006 learned_addr learned my addr 172.21.15.57:0/4265134006 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:02.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.541+0000 7fb323200640 1 -- 172.21.15.57:0/4265134006 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fb324143950 con 0x7fb324071720 2024-03-27T10:00:02.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.541+0000 7f066ce00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f06680d3fe0 0x7f066815cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:02.536 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.541+0000 7fb323200640 1 -- 172.21.15.57:0/4265134006 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fb324072780 con 0x7fb32406d2d0 2024-03-27T10:00:02.536 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.541+0000 7f066ce00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f066815e4a0 0x7f066815b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:02.536 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.541+0000 7fb323200640 1 -- 172.21.15.57:0/4265134006 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fb324203ec0 con 0x7fb32406f100 2024-03-27T10:00:02.536 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.542+0000 7fb322800640 1 --2- 172.21.15.57:0/4265134006 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb324071720 0x7fb3241f2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:02.537 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.542+0000 7f0665400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f06680d3fe0 0x7f066815cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:02.537 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.543+0000 7f066ce00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f06680b3000 con 0x7f066815e4a0 2024-03-27T10:00:02.537 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.543+0000 7f066ce00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f06680b2e80 con 0x7f06680d3fe0 2024-03-27T10:00:02.537 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.543+0000 7f066ce00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f06680b3180 con 0x7f06680ceee0 2024-03-27T10:00:02.537 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.542+0000 7f0665e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f06680ceee0 0x7f06680cb2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:02.537 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.542+0000 7f0665400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f06680d3fe0 0x7f066815cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.57:60048/0 (socket says 172.21.15.57:60048) 2024-03-27T10:00:02.538 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.542+0000 7f0666800640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f066815e4a0 0x7f066815b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:02.538 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.543+0000 7f0666800640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f066815e4a0 0x7f066815b5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:54928/0 (socket says 172.21.15.57:54928) 2024-03-27T10:00:02.538 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.543+0000 7fb321e00640 1 --2- 172.21.15.57:0/4265134006 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb32406d2d0 0x7fb324203980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:02.538 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.543+0000 7fb322800640 1 -- 172.21.15.57:0/4265134006 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb32406f100 msgr2=0x7fb324200c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:02.538 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.543+0000 7fb322800640 1 --2- 172.21.15.57:0/4265134006 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb32406f100 0x7fb324200c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:02.538 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.543+0000 7fb322800640 1 -- 172.21.15.57:0/4265134006 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb32406d2d0 msgr2=0x7fb324203980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:02.538 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.543+0000 7fb322800640 1 --2- 172.21.15.57:0/4265134006 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb32406d2d0 0x7fb324203980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:02.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.543+0000 7fb322800640 1 -- 172.21.15.57:0/4265134006 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3240acc60 con 0x7fb324071720 2024-03-27T10:00:02.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.543+0000 7fb321400640 1 --2- 172.21.15.57:0/4265134006 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb32406f100 0x7fb324200c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T10:00:02.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.543+0000 7f0665400640 1 -- 172.21.15.57:0/3072677075 learned_addr learned my addr 172.21.15.57:0/3072677075 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:02.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.544+0000 7fb321e00640 1 --2- 172.21.15.57:0/4265134006 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb32406d2d0 0x7fb324203980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T10:00:02.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.544+0000 7fb322800640 1 --2- 172.21.15.57:0/4265134006 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb324071720 0x7fb3241f2e70 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb310033000 tx=0x7fb3100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:02.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.544+0000 7f0665400640 1 -- 172.21.15.57:0/3072677075 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f06680ceee0 msgr2=0x7f06680cb2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:02.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.544+0000 7f0665400640 1 --2- 172.21.15.57:0/3072677075 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f06680ceee0 0x7f06680cb2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:02.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.544+0000 7f0665400640 1 -- 172.21.15.57:0/3072677075 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f066815e4a0 msgr2=0x7f066815b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:02.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.544+0000 7f0665400640 1 --2- 172.21.15.57:0/3072677075 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f066815e4a0 0x7f066815b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:02.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.544+0000 7f0665400640 1 -- 172.21.15.57:0/3072677075 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0668173920 con 0x7f06680d3fe0 2024-03-27T10:00:02.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.544+0000 7f0666800640 1 --2- 172.21.15.57:0/3072677075 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f066815e4a0 0x7f066815b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T10:00:02.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.545+0000 7fb31a000640 1 -- 172.21.15.57:0/4265134006 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb310035040 con 0x7fb324071720 2024-03-27T10:00:02.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.545+0000 7f0665400640 1 --2- 172.21.15.57:0/3072677075 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f06680d3fe0 0x7f066815cd10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f065800d830 tx=0x7f065800dcf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:02.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.546+0000 7fb31a000640 1 -- 172.21.15.57:0/4265134006 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb310030d70 con 0x7fb324071720 2024-03-27T10:00:02.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.546+0000 7f065e000640 1 -- 172.21.15.57:0/3072677075 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f065800b6c0 con 0x7f06680d3fe0 2024-03-27T10:00:02.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.546+0000 7fb323200640 1 -- 172.21.15.57:0/4265134006 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3241f20b0 con 0x7fb324071720 2024-03-27T10:00:02.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.546+0000 7fbca8c00640 1 -- 172.21.15.57:0/4005771351 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fbca401e020 con 0x7fbc900051c0 2024-03-27T10:00:02.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.546+0000 7fb323200640 1 -- 172.21.15.57:0/4265134006 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3241f2670 con 0x7fb324071720 2024-03-27T10:00:02.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.547+0000 7f066ce00640 1 -- 172.21.15.57:0/3072677075 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06680cdc40 con 0x7f06680d3fe0 2024-03-27T10:00:02.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.547+0000 7f066ce00640 1 -- 172.21.15.57:0/3072677075 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06680ce200 con 0x7f06680d3fe0 2024-03-27T10:00:02.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.548+0000 7fbcb2600640 1 -- 172.21.15.57:0/4005771351 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcac068540 con 0x7fbc900051c0 2024-03-27T10:00:02.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.547+0000 7f065e000640 1 -- 172.21.15.57:0/3072677075 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0658019070 con 0x7f06680d3fe0 2024-03-27T10:00:02.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.547+0000 7f065e000640 1 -- 172.21.15.57:0/3072677075 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f065800ba60 con 0x7f06680d3fe0 2024-03-27T10:00:02.544 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.547+0000 7fb31a000640 1 -- 172.21.15.57:0/4265134006 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3100456c0 con 0x7fb324071720 2024-03-27T10:00:02.544 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.548+0000 7fbca8c00640 1 --2- 172.21.15.57:0/4005771351 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fbc8c06c530 0x7fbc8c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:02.544 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.548+0000 7fbca8c00640 1 -- 172.21.15.57:0/4005771351 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fbca408c2f0 con 0x7fbc900051c0 2024-03-27T10:00:02.544 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.549+0000 7fbcabe00640 1 --2- 172.21.15.57:0/4005771351 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fbc8c06c530 0x7fbc8c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:02.544 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.550+0000 7fbcabe00640 1 --2- 172.21.15.57:0/4005771351 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fbc8c06c530 0x7fbc8c06e9f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fbcac136030 tx=0x7fbc9c007c00 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:02.545 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.551+0000 7f065e000640 1 -- 172.21.15.57:0/3072677075 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f065800bc00 con 0x7f06680d3fe0 2024-03-27T10:00:02.545 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.552+0000 7f066ce00640 1 -- 172.21.15.57:0/3072677075 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0640005290 con 0x7f06680d3fe0 2024-03-27T10:00:02.545 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.553+0000 7f065e000640 1 --2- 172.21.15.57:0/3072677075 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f064806c530 0x7f064806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:02.545 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.554+0000 7f065e000640 1 -- 172.21.15.57:0/3072677075 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f065808be60 con 0x7f06680d3fe0 2024-03-27T10:00:02.545 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.554+0000 7f0665e00640 1 --2- 172.21.15.57:0/3072677075 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f064806c530 0x7f064806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:02.546 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.556+0000 7f0665e00640 1 --2- 172.21.15.57:0/3072677075 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f064806c530 0x7f064806e9f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f06600012e0 tx=0x7f0660001650 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:02.546 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.551+0000 7fb31a000640 1 -- 172.21.15.57:0/4265134006 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fb310038020 con 0x7fb324071720 2024-03-27T10:00:02.546 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.551+0000 7fb323200640 1 -- 172.21.15.57:0/4265134006 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2fc005290 con 0x7fb324071720 2024-03-27T10:00:02.547 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.554+0000 7fb31a000640 1 --2- 172.21.15.57:0/4265134006 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fb30406c530 0x7fb30406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:02.547 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.554+0000 7fb31a000640 1 -- 172.21.15.57:0/4265134006 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fb3100adba0 con 0x7fb324071720 2024-03-27T10:00:02.547 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.555+0000 7fb321e00640 1 --2- 172.21.15.57:0/4265134006 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fb30406c530 0x7fb30406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:02.547 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.556+0000 7fb321e00640 1 --2- 172.21.15.57:0/4265134006 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fb30406c530 0x7fb30406e9f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb31c009aa0 tx=0x7fb31c003990 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:02.552 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.562+0000 7fb31a000640 1 -- 172.21.15.57:0/4265134006 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7fb31007be80 con 0x7fb324071720 2024-03-27T10:00:02.553 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.563+0000 7fbca8c00640 1 -- 172.21.15.57:0/4005771351 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7fbca405a4a0 con 0x7fbc900051c0 2024-03-27T10:00:02.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.568+0000 7f065e000640 1 -- 172.21.15.57:0/3072677075 <== mon.1 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f065805a0a0 con 0x7f06680d3fe0 2024-03-27T10:00:02.606 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.616+0000 7fb10f200640 1 Processor -- start 2024-03-27T10:00:02.608 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.617+0000 7fb10f200640 1 -- start start 2024-03-27T10:00:02.609 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.619+0000 7fb10f200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1100d2820 0x7fb1100d0780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:02.609 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.619+0000 7fb10f200640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fb1100d4b50 0x7fb1100d0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:02.609 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.619+0000 7fb10f200640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1100d2d90 con 0x7fb110161830 2024-03-27T10:00:02.609 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.619+0000 7fb10f200640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7fb1100cf4e0 con 0x7fb1100d4b50 2024-03-27T10:00:02.609 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.619+0000 7fb10f200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fb1100cee90 con 0x7fb1100d2820 2024-03-27T10:00:02.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.620+0000 7fb10e800640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fb1100d4b50 0x7fb1100d0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:02.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.620+0000 7fb10de00640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7fb110161830 0x7fb1100cf970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.57:38594/0 (socket says 172.21.15.57:38594) 2024-03-27T10:00:02.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.620+0000 7fb10de00640 1 -- 172.21.15.57:0/1699710512 learned_addr learned my addr 172.21.15.57:0/1699710512 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T10:00:02.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.620+0000 7f3e6de00640 1 Processor -- start 2024-03-27T10:00:02.611 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.620+0000 7f8c2d200640 1 Processor -- start 2024-03-27T10:00:02.611 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.620+0000 7f3e6de00640 1 -- start start 2024-03-27T10:00:02.611 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.621+0000 7f8c2d200640 1 -- start start 2024-03-27T10:00:02.611 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.621+0000 7fb10d400640 1 --2- 172.21.15.57:0/1699710512 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1100d2820 0x7fb1100d0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:02.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.622+0000 7fb10d400640 1 -- 172.21.15.57:0/1699710512 >> v2:172.21.15.118:3300/0 conn(0x7fb1100d4b50 msgr2=0x7fb1100d0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:02.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.622+0000 7fb10d400640 1 --2- 172.21.15.57:0/1699710512 >> v2:172.21.15.118:3300/0 conn(0x7fb1100d4b50 0x7fb1100d0cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:02.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.622+0000 7fb10d400640 1 -- 172.21.15.57:0/1699710512 >> v1:172.21.15.118:6789/0 conn(0x7fb110161830 legacy=0x7fb1100cf970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:02.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.622+0000 7fb10d400640 1 -- 172.21.15.57:0/1699710512 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1100cf170 con 0x7fb1100d2820 2024-03-27T10:00:02.613 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.623+0000 7f8c2d200640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f8c281631e0 0x7f8c2806d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:02.613 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.622+0000 7f3e6de00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3e6003c0a0 0x7f3e600e7780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:02.613 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.622+0000 7f3e6de00640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e60058810 con 0x7f3e600e3160 2024-03-27T10:00:02.614 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.622+0000 7f3e6de00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e60058af0 con 0x7f3e60053cb0 2024-03-27T10:00:02.614 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.622+0000 7f3e6de00640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f3e60007b70 con 0x7f3e6003c0a0 2024-03-27T10:00:02.614 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.623+0000 7f3e6d400640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f3e60053cb0 0x7f3e60054100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.57:38598/0 (socket says 172.21.15.57:38598) 2024-03-27T10:00:02.614 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.623+0000 7f3e6d400640 1 -- 172.21.15.57:0/1372582713 learned_addr learned my addr 172.21.15.57:0/1372582713 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T10:00:02.614 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.624+0000 7fde03c00640 1 Processor -- start 2024-03-27T10:00:02.614 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.624+0000 7f8c2d200640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f8c2806b7a0 0x7f8c2806bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:02.615 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.624+0000 7fb10d400640 1 --2- 172.21.15.57:0/1699710512 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1100d2820 0x7fb1100d0780 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb100009d90 tx=0x7fb10002be40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d20befbcd32da6f server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:02.615 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.624+0000 7fde03c00640 1 -- start start 2024-03-27T10:00:02.615 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.624+0000 7f3e67400640 1 -- 172.21.15.57:0/1372582713 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1757118880 0 0) 0x7f3e60058af0 con 0x7f3e60053cb0 2024-03-27T10:00:02.615 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.624+0000 7f3e67400640 1 -- 172.21.15.57:0/1372582713 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3e50003520 con 0x7f3e60053cb0 2024-03-27T10:00:02.616 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.624+0000 7f8c2d200640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c2806dea0 con 0x7f8c28166b40 2024-03-27T10:00:02.616 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.624+0000 7f8c2d200640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f8c2806c150 con 0x7f8c2806b7a0 2024-03-27T10:00:02.616 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.625+0000 7f8c2d200640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f8c281666b0 con 0x7f8c281631e0 2024-03-27T10:00:02.616 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.625+0000 7f8c25400640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f8c28166b40 0x7f8c281635c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.57:38606/0 (socket says 172.21.15.57:38606) 2024-03-27T10:00:02.616 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.625+0000 7f8c25400640 1 -- 172.21.15.57:0/994034048 learned_addr learned my addr 172.21.15.57:0/994034048 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T10:00:02.617 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.625+0000 7f3e67e00640 1 --2- 172.21.15.57:0/1372582713 >> v2:172.21.15.57:3300/0 conn(0x7f3e6003c0a0 0x7f3e600e7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:02.617 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.625+0000 7fb10ca00640 1 -- 172.21.15.57:0/1699710512 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb100039070 con 0x7fb1100d2820 2024-03-27T10:00:02.617 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.625+0000 7fb10ca00640 1 -- 172.21.15.57:0/1699710512 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb10002cbf0 con 0x7fb1100d2820 2024-03-27T10:00:02.617 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.625+0000 7fb10ca00640 1 -- 172.21.15.57:0/1699710512 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb100034440 con 0x7fb1100d2820 2024-03-27T10:00:02.617 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.624+0000 7f8c25e00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f8c281631e0 0x7f8c2806d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:02.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.625+0000 7f3e67400640 1 -- 172.21.15.57:0/1372582713 <== mon.1 v1:172.21.15.118:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 123547898 0 0) 0x7f3e50003520 con 0x7f3e60053cb0 2024-03-27T10:00:02.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.625+0000 7f3e67400640 1 -- 172.21.15.57:0/1372582713 >> v2:172.21.15.57:3300/0 conn(0x7f3e6003c0a0 msgr2=0x7f3e600e7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:02.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.625+0000 7f3e67400640 1 --2- 172.21.15.57:0/1372582713 >> v2:172.21.15.57:3300/0 conn(0x7f3e6003c0a0 0x7f3e600e7780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:02.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.625+0000 7f3e67400640 1 -- 172.21.15.57:0/1372582713 >> v1:172.21.15.57:6789/0 conn(0x7f3e600e3160 legacy=0x7f3e60058050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:02.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.625+0000 7f3e67400640 1 -- 172.21.15.57:0/1372582713 --> v1:172.21.15.118:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e60006360 con 0x7f3e60053cb0 2024-03-27T10:00:02.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.625+0000 7f3e67400640 1 -- 172.21.15.57:0/1372582713 <== mon.1 v1:172.21.15.118:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4227751516 0 0) 0x7f3e54001670 con 0x7f3e60053cb0 2024-03-27T10:00:02.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.625+0000 7f3e67400640 1 -- 172.21.15.57:0/1372582713 >> v1:172.21.15.118:6789/0 conn(0x7f3e60053cb0 legacy=0x7f3e60054100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:02.619 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.626+0000 7f8c26800640 1 --2- 172.21.15.57:0/994034048 >> v2:172.21.15.57:3300/0 conn(0x7f8c2806b7a0 0x7f8c2806bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:02.619 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.626+0000 7fde03c00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fddfc15e510 0x7fddfc0d28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:02.619 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.626+0000 7f8c24a00640 1 -- 172.21.15.57:0/994034048 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2409056080 0 0) 0x7f8c2806dea0 con 0x7f8c28166b40 2024-03-27T10:00:02.619 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.626+0000 7f8c24a00640 1 -- 172.21.15.57:0/994034048 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8c0c003520 con 0x7f8c28166b40 2024-03-27T10:00:02.620 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.626+0000 7f3e67400640 1 --2- 172.21.15.57:0/1372582713 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3e500039b0 0x7f3e50003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:02.620 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.626+0000 7f3e67400640 1 --2- 172.21.15.57:0/1372582713 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3e50004800 0x7f3e50004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:02.620 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.626+0000 7f3e67400640 1 --2- 172.21.15.57:0/1372582713 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e500051c0 0x7f3e5000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:02.620 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.626+0000 7f3e67400640 1 -- 172.21.15.57:0/1372582713 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f3e5000c090 con 0x7f3e500051c0 2024-03-27T10:00:02.620 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.626+0000 7f3e67400640 1 -- 172.21.15.57:0/1372582713 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f3e5000c240 con 0x7f3e50004800 2024-03-27T10:00:02.620 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.626+0000 7f3e67400640 1 -- 172.21.15.57:0/1372582713 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f3e5000c440 con 0x7f3e500039b0 2024-03-27T10:00:02.620 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.626+0000 7f3e67e00640 1 --2- 172.21.15.57:0/1372582713 >> v2:172.21.15.57:3300/0 conn(0x7f3e6003c0a0 0x7f3e600e7780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T10:00:02.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.627+0000 7fde03c00640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fddfc0b4110 con 0x7fddfc0d2de0 2024-03-27T10:00:02.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.627+0000 7fde03c00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fddfc0b43f0 con 0x7fddfc0d44c0 2024-03-27T10:00:02.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.627+0000 7fb10f200640 1 -- 172.21.15.57:0/1699710512 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1100d2820 msgr2=0x7fb1100d0780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:02.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.627+0000 7fb10f200640 1 --2- 172.21.15.57:0/1699710512 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1100d2820 0x7fb1100d0780 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb100009d90 tx=0x7fb10002be40 comp rx=0 tx=0).stop 2024-03-27T10:00:02.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.627+0000 7f3e67e00640 1 --2- 172.21.15.57:0/1372582713 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3e50004800 0x7f3e50004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:02.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.627+0000 7f3e6ca00640 1 --2- 172.21.15.57:0/1372582713 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3e500039b0 0x7f3e50003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:02.622 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.627+0000 7fde03c00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7fddfc15e8f0 con 0x7fddfc15e510 2024-03-27T10:00:02.622 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.627+0000 7fde01200640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fddfc15e510 0x7fddfc0d28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:02.622 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.627+0000 7fde01200640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fddfc15e510 0x7fddfc0d28a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.57:60090/0 (socket says 172.21.15.57:60090) 2024-03-27T10:00:02.622 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.627+0000 7fde01200640 1 -- 172.21.15.57:0/860525682 learned_addr learned my addr 172.21.15.57:0/860525682 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:02.623 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.627+0000 7f8c25e00640 1 -- 172.21.15.57:0/994034048 >> v2:172.21.15.57:3300/0 conn(0x7f8c2806b7a0 msgr2=0x7f8c2806bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:02.623 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.627+0000 7f8c25e00640 1 --2- 172.21.15.57:0/994034048 >> v2:172.21.15.57:3300/0 conn(0x7f8c2806b7a0 0x7f8c2806bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:02.623 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.627+0000 7f8c25e00640 1 -- 172.21.15.57:0/994034048 >> v1:172.21.15.118:6789/0 conn(0x7f8c28166b40 legacy=0x7f8c281635c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:02.623 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.627+0000 7f8c25e00640 1 -- 172.21.15.57:0/994034048 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c2806d8e0 con 0x7f8c281631e0 2024-03-27T10:00:02.623 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.628+0000 7f3e6d400640 1 --2- 172.21.15.57:0/1372582713 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e500051c0 0x7f3e5000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:02.623 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.628+0000 7fb10f200640 1 -- 172.21.15.57:0/1699710512 shutdown_connections 2024-03-27T10:00:02.624 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.628+0000 7fb10f200640 1 --2- 172.21.15.57:0/1699710512 >> v2:172.21.15.118:3300/0 conn(0x7fb1100d4b50 0x7fb1100d0cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:02.624 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.628+0000 7fb10f200640 1 --2- 172.21.15.57:0/1699710512 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1100d2820 0x7fb1100d0780 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:02.624 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.628+0000 7fb10f200640 1 -- 172.21.15.57:0/1699710512 >> 172.21.15.57:0/1699710512 conn(0x7fb1100d4030 msgr2=0x7fb1100d4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:02.624 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.628+0000 7f3e6ca00640 1 -- 172.21.15.57:0/1372582713 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3e50004800 msgr2=0x7f3e50004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:02.624 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.628+0000 7f3e6ca00640 1 --2- 172.21.15.57:0/1372582713 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3e50004800 0x7f3e50004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:02.624 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.628+0000 7f3e6ca00640 1 -- 172.21.15.57:0/1372582713 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e500051c0 msgr2=0x7f3e5000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:02.624 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.628+0000 7f3e6ca00640 1 --2- 172.21.15.57:0/1372582713 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e500051c0 0x7f3e5000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:02.624 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.628+0000 7f3e6ca00640 1 -- 172.21.15.57:0/1372582713 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e60006360 con 0x7f3e500039b0 2024-03-27T10:00:02.624 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.628+0000 7f3e6d400640 1 --2- 172.21.15.57:0/1372582713 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e500051c0 0x7f3e5000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T10:00:02.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.628+0000 7f3e6d400640 1 -- 172.21.15.57:0/1372582713 reap_dead start 2024-03-27T10:00:02.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.628+0000 7fde01200640 1 -- 172.21.15.57:0/860525682 >> v1:172.21.15.118:6789/0 conn(0x7fddfc0d44c0 legacy=0x7fddfc0cec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:02.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.628+0000 7fde01200640 1 -- 172.21.15.57:0/860525682 >> v1:172.21.15.57:6789/0 conn(0x7fddfc0d2de0 legacy=0x7fddfc0d3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:02.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.629+0000 7fde01200640 1 -- 172.21.15.57:0/860525682 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddfc0b46d0 con 0x7fddfc15e510 2024-03-27T10:00:02.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.629+0000 7fb10f200640 1 -- 172.21.15.57:0/1699710512 shutdown_connections 2024-03-27T10:00:02.626 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.629+0000 7f8c25e00640 1 --2- 172.21.15.57:0/994034048 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c281631e0 0x7f8c2806d1b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8c28166830 tx=0x7f8c2002be20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=409285a0a4bd0aba server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:02.626 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.630+0000 7fb10f200640 1 -- 172.21.15.57:0/1699710512 wait complete. 2024-03-27T10:00:02.626 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.630+0000 7f3e6ca00640 1 --2- 172.21.15.57:0/1372582713 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3e500039b0 0x7f3e50003dd0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3e6806a3d0 tx=0x7f3e50005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca6d48c86fd90396 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:02.627 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.630+0000 7f8c24a00640 1 -- 172.21.15.57:0/994034048 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c20039070 con 0x7f8c281631e0 2024-03-27T10:00:02.627 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.630+0000 7f3e67400640 1 -- 172.21.15.57:0/1372582713 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e680b4070 con 0x7f3e500039b0 2024-03-27T10:00:02.627 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.630+0000 7f3e67400640 1 -- 172.21.15.57:0/1372582713 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e680a7880 con 0x7f3e500039b0 2024-03-27T10:00:02.627 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.630+0000 7f3e67400640 1 -- 172.21.15.57:0/1372582713 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e6804fe80 con 0x7f3e500039b0 2024-03-27T10:00:02.627 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.630+0000 7f8c24a00640 1 -- 172.21.15.57:0/994034048 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c2002cbd0 con 0x7f8c281631e0 2024-03-27T10:00:02.628 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.630+0000 7f8c24a00640 1 -- 172.21.15.57:0/994034048 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c20034440 con 0x7f8c281631e0 2024-03-27T10:00:02.628 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.631+0000 7f58c0a00640 1 Processor -- start 2024-03-27T10:00:02.628 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.631+0000 7fde01200640 1 --2- 172.21.15.57:0/860525682 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fddfc15e510 0x7fddfc0d28a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fddec009870 tx=0x7fddec02b990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b938996b80ecb0f server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:02.629 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.631+0000 7f58c0a00640 1 -- start start 2024-03-27T10:00:02.629 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.631+0000 7f8c2d200640 1 -- 172.21.15.57:0/994034048 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c281631e0 msgr2=0x7f8c2806d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:02.629 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.631+0000 7f8c2d200640 1 --2- 172.21.15.57:0/994034048 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c281631e0 0x7f8c2806d1b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8c28166830 tx=0x7f8c2002be20 comp rx=0 tx=0).stop 2024-03-27T10:00:02.629 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.631+0000 7f3e6de00640 1 -- 172.21.15.57:0/1372582713 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3e500039b0 msgr2=0x7f3e50003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:02.629 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.631+0000 7fddfb400640 1 -- 172.21.15.57:0/860525682 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddec034070 con 0x7fddfc15e510 2024-03-27T10:00:02.630 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.631+0000 7f3e6de00640 1 --2- 172.21.15.57:0/1372582713 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3e500039b0 0x7f3e50003dd0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3e6806a3d0 tx=0x7f3e50005830 comp rx=0 tx=0).stop 2024-03-27T10:00:02.630 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.632+0000 7fddfb400640 1 -- 172.21.15.57:0/860525682 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddec030850 con 0x7fddfc15e510 2024-03-27T10:00:02.630 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.632+0000 7f3e6de00640 1 -- 172.21.15.57:0/1372582713 shutdown_connections 2024-03-27T10:00:02.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.632+0000 7f3e6de00640 1 --2- 172.21.15.57:0/1372582713 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3e500039b0 0x7f3e50003dd0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:02.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.632+0000 7f3e6de00640 1 -- 172.21.15.57:0/1372582713 >> 172.21.15.57:0/1372582713 conn(0x7f3e60058ee0 msgr2=0x7f3e600592c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:02.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.632+0000 7fddfb400640 1 -- 172.21.15.57:0/860525682 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddec030c20 con 0x7fddfc15e510 2024-03-27T10:00:02.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.632+0000 7f8c2d200640 1 -- 172.21.15.57:0/994034048 shutdown_connections 2024-03-27T10:00:02.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.632+0000 7f8c2d200640 1 --2- 172.21.15.57:0/994034048 >> v2:172.21.15.57:3300/0 conn(0x7f8c2806b7a0 0x7f8c2806bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:02.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.632+0000 7f8c2d200640 1 --2- 172.21.15.57:0/994034048 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c281631e0 0x7f8c2806d1b0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:02.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.632+0000 7f8c2d200640 1 -- 172.21.15.57:0/994034048 >> 172.21.15.57:0/994034048 conn(0x7f8c280b1c60 msgr2=0x7f8c280b2070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:02.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.632+0000 7f8c2d200640 1 -- 172.21.15.57:0/994034048 shutdown_connections 2024-03-27T10:00:02.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.632+0000 7fb10f200640 1 Processor -- start 2024-03-27T10:00:02.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.632+0000 7f8c2d200640 1 -- 172.21.15.57:0/994034048 wait complete. 2024-03-27T10:00:02.633 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.632+0000 7fb10f200640 1 -- start start 2024-03-27T10:00:02.633 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.633+0000 7f3e6de00640 1 -- 172.21.15.57:0/1372582713 shutdown_connections 2024-03-27T10:00:02.633 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.633+0000 7fde03c00640 1 -- 172.21.15.57:0/860525682 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fddfc15e510 msgr2=0x7fddfc0d28a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:02.633 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.633+0000 7fde03c00640 1 --2- 172.21.15.57:0/860525682 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fddfc15e510 0x7fddfc0d28a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fddec009870 tx=0x7fddec02b990 comp rx=0 tx=0).stop 2024-03-27T10:00:02.633 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.633+0000 7f3e6de00640 1 -- 172.21.15.57:0/1372582713 wait complete. 2024-03-27T10:00:02.634 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.633+0000 7fde03c00640 1 -- 172.21.15.57:0/860525682 shutdown_connections 2024-03-27T10:00:02.634 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.633+0000 7fde03c00640 1 --2- 172.21.15.57:0/860525682 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fddfc15e510 0x7fddfc0d28a0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:02.634 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.633+0000 7fde03c00640 1 -- 172.21.15.57:0/860525682 >> 172.21.15.57:0/860525682 conn(0x7fddfc067c00 msgr2=0x7fddfc09d440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:02.634 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.633+0000 7f58c0a00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f58b40078e0 0x7f58b40edd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:02.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.634+0000 7fb10f200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1100d2820 0x7fb1101609b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:02.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.634+0000 7f58c0a00640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58b4058570 con 0x7f58b403e840 2024-03-27T10:00:02.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.634+0000 7f58c0a00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58b4058850 con 0x7f58b40e30c0 2024-03-27T10:00:02.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.634+0000 7f58c0a00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f58b4058b30 con 0x7f58b40078e0 2024-03-27T10:00:02.636 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.634+0000 7fb10f200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb1100d4b50 0x7fb1101527d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:02.636 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.634+0000 7fb10f200640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb110161830 0x7fb1101565b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:02.636 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.634+0000 7fb10f200640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fb1100ce330 con 0x7fb110161830 2024-03-27T10:00:02.636 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.634+0000 7fb10f200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fb1100d3070 con 0x7fb1100d4b50 2024-03-27T10:00:02.636 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.634+0000 7fb10f200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fb1100ce4b0 con 0x7fb1100d2820 2024-03-27T10:00:02.636 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.634+0000 7f8c2d200640 1 Processor -- start 2024-03-27T10:00:02.637 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.635+0000 7f8c2d200640 1 -- start start 2024-03-27T10:00:02.637 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.635+0000 7f58ba800640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f58b40e30c0 0x7f58b4057d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.57:38624/0 (socket says 172.21.15.57:38624) 2024-03-27T10:00:02.638 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.635+0000 7f58ba800640 1 -- 172.21.15.57:0/4523004 learned_addr learned my addr 172.21.15.57:0/4523004 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T10:00:02.638 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.635+0000 7f58bb200640 1 --2- 172.21.15.57:0/4523004 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f58b40078e0 0x7f58b40edd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:02.639 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.635+0000 7fb10d400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb1100d4b50 0x7fb1101527d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:02.639 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.635+0000 7fb10d400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb1100d4b50 0x7fb1101527d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.57:60092/0 (socket says 172.21.15.57:60092) 2024-03-27T10:00:02.639 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.635+0000 7fb10d400640 1 -- 172.21.15.57:0/3321801251 learned_addr learned my addr 172.21.15.57:0/3321801251 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:02.639 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.635+0000 7fb10de00640 1 --2- 172.21.15.57:0/3321801251 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1100d2820 0x7fb1101609b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:02.639 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.635+0000 7fb10e800640 1 --2- 172.21.15.57:0/3321801251 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb110161830 0x7fb1101565b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:02.640 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.636+0000 7f3e6de00640 1 Processor -- start 2024-03-27T10:00:02.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.636+0000 7f8c2d200640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8c2806b7a0 0x7f8c28152e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:02.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.636+0000 7f8c2d200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c281631e0 0x7f8c2815d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:02.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.636+0000 7f8c2d200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8c28166b40 0x7f8c28164e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:02.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.636+0000 7f8c2d200640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f8c28166ff0 con 0x7f8c2806b7a0 2024-03-27T10:00:02.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.636+0000 7f8c2d200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f8c28166340 con 0x7f8c281631e0 2024-03-27T10:00:02.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.636+0000 7f8c2d200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f8c28071710 con 0x7f8c28166b40 2024-03-27T10:00:02.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.636+0000 7f8c25e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8c2806b7a0 0x7f8c28152e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:02.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.636+0000 7f8c25e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8c2806b7a0 0x7f8c28152e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:54976/0 (socket says 172.21.15.57:54976) 2024-03-27T10:00:02.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.636+0000 7f8c25e00640 1 -- 172.21.15.57:0/1145464806 learned_addr learned my addr 172.21.15.57:0/1145464806 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:02.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.636+0000 7fb10de00640 1 -- 172.21.15.57:0/3321801251 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb1100d4b50 msgr2=0x7fb1101527d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:02.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.636+0000 7fb10de00640 1 --2- 172.21.15.57:0/3321801251 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb1100d4b50 0x7fb1101527d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:02.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.636+0000 7fb10de00640 1 -- 172.21.15.57:0/3321801251 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb110161830 msgr2=0x7fb1101565b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:02.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.636+0000 7f3e6de00640 1 -- start start 2024-03-27T10:00:02.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.636+0000 7fb10de00640 1 --2- 172.21.15.57:0/3321801251 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb110161830 0x7fb1101565b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:02.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.637+0000 7fb10de00640 1 -- 172.21.15.57:0/3321801251 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb11015aaa0 con 0x7fb1100d2820 2024-03-27T10:00:02.646 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.637+0000 7fde03c00640 1 -- 172.21.15.57:0/860525682 shutdown_connections 2024-03-27T10:00:02.647 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.636+0000 7f8c26800640 1 --2- 172.21.15.57:0/1145464806 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8c28166b40 0x7f8c28164e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:02.647 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.637+0000 7f8c25e00640 1 -- 172.21.15.57:0/1145464806 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8c28166b40 msgr2=0x7f8c28164e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:02.647 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.637+0000 7f8c25e00640 1 --2- 172.21.15.57:0/1145464806 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8c28166b40 0x7f8c28164e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:02.647 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.637+0000 7fb10e800640 1 --2- 172.21.15.57:0/3321801251 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb110161830 0x7fb1101565b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T10:00:02.648 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.637+0000 7f8c25e00640 1 -- 172.21.15.57:0/1145464806 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c281631e0 msgr2=0x7f8c2815d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:02.648 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.637+0000 7fde03c00640 1 -- 172.21.15.57:0/860525682 wait complete. 2024-03-27T10:00:02.649 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.638+0000 7f8c25400640 1 --2- 172.21.15.57:0/1145464806 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c281631e0 0x7f8c2815d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:02.649 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.637+0000 7f58bb200640 1 -- 172.21.15.57:0/4523004 >> v1:172.21.15.118:6789/0 conn(0x7f58b40e30c0 legacy=0x7f58b4057d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:02.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.637+0000 7f58bb200640 1 -- 172.21.15.57:0/4523004 >> v1:172.21.15.57:6789/0 conn(0x7f58b403e840 legacy=0x7f58b4053bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:02.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.637+0000 7f58bb200640 1 -- 172.21.15.57:0/4523004 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58b40063b0 con 0x7f58b40078e0 2024-03-27T10:00:02.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.638+0000 7f8c25e00640 1 --2- 172.21.15.57:0/1145464806 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c281631e0 0x7f8c2815d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:02.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.638+0000 7f8c25e00640 1 -- 172.21.15.57:0/1145464806 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c2815dce0 con 0x7f8c2806b7a0 2024-03-27T10:00:02.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.638+0000 7f3e6de00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3e500039b0 0x7f3e600d70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:02.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.638+0000 7f8c25e00640 1 --2- 172.21.15.57:0/1145464806 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8c2806b7a0 0x7f8c28152e60 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8c2002c430 tx=0x7f8c20004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:02.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.638+0000 7f58bb200640 1 --2- 172.21.15.57:0/4523004 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f58b40078e0 0x7f58b40edd90 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f58bc000b60 tx=0x7f58bc0652e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dad364eeedc4eb09 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:02.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.638+0000 7f3e6de00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3e60052bc0 0x7f3e6004ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:02.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.638+0000 7fb10de00640 1 --2- 172.21.15.57:0/3321801251 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1100d2820 0x7fb1101609b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb0f800c470 tx=0x7fb0f800c930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:02.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.638+0000 7f3e6de00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e60179af0 0x7f3e60179f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:02.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.639+0000 7f3e6de00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f3e600e7780 con 0x7f3e60179af0 2024-03-27T10:00:02.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.639+0000 7f3e6de00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f3e600e3540 con 0x7f3e60052bc0 2024-03-27T10:00:02.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.639+0000 7f3e6de00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f3e600e7900 con 0x7f3e500039b0 2024-03-27T10:00:02.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.639+0000 7fb106000640 1 -- 172.21.15.57:0/3321801251 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0f8017070 con 0x7fb1100d2820 2024-03-27T10:00:02.656 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.639+0000 7fb106000640 1 -- 172.21.15.57:0/3321801251 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0f8005ce0 con 0x7fb1100d2820 2024-03-27T10:00:02.656 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.639+0000 7fb106000640 1 -- 172.21.15.57:0/3321801251 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0f80072d0 con 0x7fb1100d2820 2024-03-27T10:00:02.657 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.639+0000 7f8c1e000640 1 -- 172.21.15.57:0/1145464806 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c20044020 con 0x7f8c2806b7a0 2024-03-27T10:00:02.657 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.638+0000 7f8c25400640 1 --2- 172.21.15.57:0/1145464806 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c281631e0 0x7f8c2815d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T10:00:02.657 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.639+0000 7f8c1e000640 1 -- 172.21.15.57:0/1145464806 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c2003f470 con 0x7f8c2806b7a0 2024-03-27T10:00:02.657 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.639+0000 7f8c1e000640 1 -- 172.21.15.57:0/1145464806 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c20039040 con 0x7f8c2806b7a0 2024-03-27T10:00:02.657 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.639+0000 7f8c2d200640 1 -- 172.21.15.57:0/1145464806 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c2815dfc0 con 0x7f8c2806b7a0 2024-03-27T10:00:02.658 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.639+0000 7f3e6ca00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3e500039b0 0x7f3e600d70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:02.658 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.639+0000 7f3e6ca00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3e500039b0 0x7f3e600d70c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.57:48254/0 (socket says 172.21.15.57:48254) 2024-03-27T10:00:02.658 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.639+0000 7f3e6ca00640 1 -- 172.21.15.57:0/3402660317 learned_addr learned my addr 172.21.15.57:0/3402660317 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:02.658 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.639+0000 7f3e67e00640 1 --2- 172.21.15.57:0/3402660317 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3e60052bc0 0x7f3e6004ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:02.659 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.639+0000 7f58b9400640 1 -- 172.21.15.57:0/4523004 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58bc0a89b0 con 0x7f58b40078e0 2024-03-27T10:00:02.659 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.639+0000 7f58b9400640 1 -- 172.21.15.57:0/4523004 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58bc0a8b90 con 0x7f58b40078e0 2024-03-27T10:00:02.659 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.639+0000 7f58b9400640 1 -- 172.21.15.57:0/4523004 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58bc0b0420 con 0x7f58b40078e0 2024-03-27T10:00:02.660 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.639+0000 7fb10f200640 1 -- 172.21.15.57:0/3321801251 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb11015db40 con 0x7fb1100d2820 2024-03-27T10:00:02.660 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.639+0000 7fb10f200640 1 -- 172.21.15.57:0/3321801251 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb11015a6c0 con 0x7fb1100d2820 2024-03-27T10:00:02.660 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.639+0000 7f3e6d400640 1 --2- 172.21.15.57:0/3402660317 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e60179af0 0x7f3e60179f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:02.660 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.640+0000 7f58c0a00640 1 -- 172.21.15.57:0/4523004 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f58b40078e0 msgr2=0x7f58b40edd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:02.660 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.640+0000 7f58c0a00640 1 --2- 172.21.15.57:0/4523004 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f58b40078e0 0x7f58b40edd90 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f58bc000b60 tx=0x7f58bc0652e0 comp rx=0 tx=0).stop 2024-03-27T10:00:02.661 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.639+0000 7f8c2d200640 1 -- 172.21.15.57:0/1145464806 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c280cce60 con 0x7f8c2806b7a0 2024-03-27T10:00:02.661 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.641+0000 7f58c0a00640 1 -- 172.21.15.57:0/4523004 shutdown_connections 2024-03-27T10:00:02.661 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.641+0000 7fde03c00640 1 Processor -- start 2024-03-27T10:00:02.662 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.640+0000 7f3e6ca00640 1 -- 172.21.15.57:0/3402660317 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3e60052bc0 msgr2=0x7f3e6004ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:02.662 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.640+0000 7f3e6ca00640 1 --2- 172.21.15.57:0/3402660317 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3e60052bc0 0x7f3e6004ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:02.662 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.640+0000 7f3e6ca00640 1 -- 172.21.15.57:0/3402660317 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e60179af0 msgr2=0x7f3e60179f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:02.662 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.641+0000 7f3e6ca00640 1 --2- 172.21.15.57:0/3402660317 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e60179af0 0x7f3e60179f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:02.662 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.641+0000 7f3e6ca00640 1 -- 172.21.15.57:0/3402660317 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e600d7600 con 0x7f3e500039b0 2024-03-27T10:00:02.662 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.641+0000 7f58c0a00640 1 --2- 172.21.15.57:0/4523004 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f58b40078e0 0x7f58b40edd90 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:02.663 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.641+0000 7f58c0a00640 1 -- 172.21.15.57:0/4523004 >> 172.21.15.57:0/4523004 conn(0x7f58b40559e0 msgr2=0x7f58b4055df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:02.663 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.641+0000 7f3e6d400640 1 --2- 172.21.15.57:0/3402660317 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e60179af0 0x7f3e60179f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T10:00:02.663 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.642+0000 7f3e6ca00640 1 --2- 172.21.15.57:0/3402660317 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3e500039b0 0x7f3e600d70c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3e6807a6d0 tx=0x7f3e680652e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:02.663 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.642+0000 7fde03c00640 1 -- start start 2024-03-27T10:00:02.664 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.642+0000 7fb10f200640 1 -- 172.21.15.57:0/3321801251 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb110067db0 con 0x7fb1100d2820 2024-03-27T10:00:02.664 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.642+0000 7f8c13400640 1 -- 172.21.15.57:0/1145464806 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c280cd060 con 0x7f8c2806b7a0 2024-03-27T10:00:02.665 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.642+0000 7f3e64c00640 1 -- 172.21.15.57:0/3402660317 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e680b4040 con 0x7f3e500039b0 2024-03-27T10:00:02.665 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.642+0000 7f3e64c00640 1 -- 172.21.15.57:0/3402660317 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e680afa40 con 0x7f3e500039b0 2024-03-27T10:00:02.665 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.642+0000 7f3e64c00640 1 -- 172.21.15.57:0/3402660317 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e6804fe80 con 0x7f3e500039b0 2024-03-27T10:00:02.665 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.642+0000 7f3e6de00640 1 -- 172.21.15.57:0/3402660317 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e60050920 con 0x7f3e500039b0 2024-03-27T10:00:02.665 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.643+0000 7f3e6de00640 1 -- 172.21.15.57:0/3402660317 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e60050ee0 con 0x7f3e500039b0 2024-03-27T10:00:02.665 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.644+0000 7f3e6de00640 1 -- 172.21.15.57:0/3402660317 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e60005390 con 0x7f3e500039b0 2024-03-27T10:00:02.666 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.645+0000 7fde03c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fddfc0d2de0 0x7fddfc1595f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:02.666 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.645+0000 7fde03c00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fddfc0d44c0 0x7fddfc0c81d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:02.666 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.645+0000 7fde03c00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fddfc15e510 0x7fddfc0cd640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:02.666 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.645+0000 7fde01200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fddfc0d2de0 0x7fddfc1595f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:02.666 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.645+0000 7fddfbe00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fddfc0d44c0 0x7fddfc0c81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:02.666 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.646+0000 7fde01200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fddfc0d2de0 0x7fddfc1595f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.57:60136/0 (socket says 172.21.15.57:60136) 2024-03-27T10:00:02.666 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.646+0000 7fde01200640 1 -- 172.21.15.57:0/1693496161 learned_addr learned my addr 172.21.15.57:0/1693496161 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:02.667 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.644+0000 7fb106000640 1 -- 172.21.15.57:0/3321801251 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fb0f801a070 con 0x7fb1100d2820 2024-03-27T10:00:02.667 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.645+0000 7fb106000640 1 --2- 172.21.15.57:0/3321801251 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fb0ec06c600 0x7fb0ec06eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:02.667 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.646+0000 7fb106000640 1 -- 172.21.15.57:0/3321801251 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fb0f808abe0 con 0x7fb1100d2820 2024-03-27T10:00:02.667 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.646+0000 7fde03c00640 1 -- 172.21.15.57:0/1693496161 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fddfc0b3d70 con 0x7fddfc0d44c0 2024-03-27T10:00:02.667 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.646+0000 7fde03c00640 1 -- 172.21.15.57:0/1693496161 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fddfc0b4c90 con 0x7fddfc0d2de0 2024-03-27T10:00:02.668 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.646+0000 7fde03c00640 1 -- 172.21.15.57:0/1693496161 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fddfc0b3ef0 con 0x7fddfc15e510 2024-03-27T10:00:02.668 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.646+0000 7fde01c00640 1 --2- 172.21.15.57:0/1693496161 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fddfc15e510 0x7fddfc0cd640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:02.668 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.647+0000 7fb10d400640 1 --2- 172.21.15.57:0/3321801251 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fb0ec06c600 0x7fb0ec06eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:02.668 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.647+0000 7fddfbe00640 1 -- 172.21.15.57:0/1693496161 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fddfc15e510 msgr2=0x7fddfc0cd640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:02.668 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.647+0000 7fddfbe00640 1 --2- 172.21.15.57:0/1693496161 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fddfc15e510 0x7fddfc0cd640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:02.668 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.647+0000 7fddfbe00640 1 -- 172.21.15.57:0/1693496161 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fddfc0d2de0 msgr2=0x7fddfc1595f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:02.668 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.647+0000 7fddfbe00640 1 --2- 172.21.15.57:0/1693496161 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fddfc0d2de0 0x7fddfc1595f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:02.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.647+0000 7fddfbe00640 1 -- 172.21.15.57:0/1693496161 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddfc0ce200 con 0x7fddfc0d44c0 2024-03-27T10:00:02.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.645+0000 7f8c1e000640 1 -- 172.21.15.57:0/1145464806 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f8c20047020 con 0x7f8c2806b7a0 2024-03-27T10:00:02.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.646+0000 7f8c1e000640 1 --2- 172.21.15.57:0/1145464806 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f8c0806c580 0x7f8c0806ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:02.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.647+0000 7f8c1e000640 1 -- 172.21.15.57:0/1145464806 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f8c200ae8b0 con 0x7f8c2806b7a0 2024-03-27T10:00:02.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.647+0000 7f8c25400640 1 --2- 172.21.15.57:0/1145464806 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f8c0806c580 0x7f8c0806ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:02.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.647+0000 7fddfbe00640 1 --2- 172.21.15.57:0/1693496161 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fddfc0d44c0 0x7fddfc0c81d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fddfc08e2f0 tx=0x7fddf000c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:02.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.648+0000 7f58c0a00640 1 -- 172.21.15.57:0/4523004 shutdown_connections 2024-03-27T10:00:02.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.648+0000 7f58c0a00640 1 -- 172.21.15.57:0/4523004 wait complete. 2024-03-27T10:00:02.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.649+0000 7fb10d400640 1 --2- 172.21.15.57:0/3321801251 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fb0ec06c600 0x7fb0ec06eac0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb1100a1f40 tx=0x7fb100030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:02.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.649+0000 7f8c25400640 1 --2- 172.21.15.57:0/1145464806 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f8c0806c580 0x7f8c0806ea40 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8c14007fd0 tx=0x7f8c14009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:02.671 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.650+0000 7f58c0a00640 1 Processor -- start 2024-03-27T10:00:02.671 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.650+0000 7f58c0a00640 1 -- start start 2024-03-27T10:00:02.671 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.650+0000 7fddf8c00640 1 -- 172.21.15.57:0/1693496161 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddf0005220 con 0x7fddfc0d44c0 2024-03-27T10:00:02.671 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.650+0000 7fddf8c00640 1 -- 172.21.15.57:0/1693496161 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddf00053c0 con 0x7fddfc0d44c0 2024-03-27T10:00:02.671 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.650+0000 7fddf8c00640 1 -- 172.21.15.57:0/1693496161 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddf0007250 con 0x7fddfc0d44c0 2024-03-27T10:00:02.672 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.650+0000 7fde03c00640 1 -- 172.21.15.57:0/1693496161 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddfc1ec340 con 0x7fddfc0d44c0 2024-03-27T10:00:02.672 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.650+0000 7fde03c00640 1 -- 172.21.15.57:0/1693496161 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddfc1ec900 con 0x7fddfc0d44c0 2024-03-27T10:00:02.672 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.651+0000 7f58c0a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f58b40078e0 0x7f58b417b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:02.672 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.651+0000 7f58c0a00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f58b403e840 0x7f58b404ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:02.672 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.651+0000 7f58c0a00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f58b40e30c0 0x7f58b40d5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:02.672 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.652+0000 7f58bb200640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f58b40e30c0 0x7f58b40d5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:02.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.652+0000 7f58ba800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f58b40078e0 0x7f58b417b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:02.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.652+0000 7f58bb200640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f58b40e30c0 0x7f58b40d5290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55022/0 (socket says 172.21.15.57:55022) 2024-03-27T10:00:02.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.652+0000 7f8c1e000640 1 -- 172.21.15.57:0/1145464806 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f8c2004e030 con 0x7f8c2806b7a0 2024-03-27T10:00:02.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.652+0000 7f58c0a00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f58b4054300 con 0x7f58b40e30c0 2024-03-27T10:00:02.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.652+0000 7f58c0a00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f58b40e34a0 con 0x7f58b40078e0 2024-03-27T10:00:02.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.652+0000 7f58c0a00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f58b4054480 con 0x7f58b403e840 2024-03-27T10:00:02.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.652+0000 7f58b9e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f58b403e840 0x7f58b404ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:02.674 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.652+0000 7f58bb200640 1 -- 172.21.15.57:0/727258671 learned_addr learned my addr 172.21.15.57:0/727258671 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:02.674 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.652+0000 7fde03c00640 1 -- 172.21.15.57:0/1693496161 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddfc1ecb00 con 0x7fddfc0d44c0 2024-03-27T10:00:02.674 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.652+0000 7f58b9e00640 1 -- 172.21.15.57:0/727258671 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f58b40078e0 msgr2=0x7f58b417b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:02.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.652+0000 7f58b9e00640 1 --2- 172.21.15.57:0/727258671 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f58b40078e0 0x7f58b417b290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:02.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.652+0000 7f58b9e00640 1 -- 172.21.15.57:0/727258671 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f58b40e30c0 msgr2=0x7f58b40d5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:02.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.652+0000 7f58b9e00640 1 --2- 172.21.15.57:0/727258671 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f58b40e30c0 0x7f58b40d5290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:02.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.652+0000 7f58b9e00640 1 -- 172.21.15.57:0/727258671 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58b40d57d0 con 0x7f58b403e840 2024-03-27T10:00:02.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.653+0000 7f58bb200640 1 --2- 172.21.15.57:0/727258671 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f58b40e30c0 0x7f58b40d5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T10:00:02.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.653+0000 7f58b9e00640 1 --2- 172.21.15.57:0/727258671 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f58b403e840 0x7f58b404ffa0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f58a800c440 tx=0x7f58a800c840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:02.676 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.654+0000 7fddf8c00640 1 -- 172.21.15.57:0/1693496161 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fddf0019020 con 0x7fddfc0d44c0 2024-03-27T10:00:02.676 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.655+0000 7fddf8c00640 1 --2- 172.21.15.57:0/1693496161 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fdde006c600 0x7fdde006eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:02.676 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.655+0000 7fddf8c00640 1 -- 172.21.15.57:0/1693496161 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fddf008ad00 con 0x7fddfc0d44c0 2024-03-27T10:00:02.676 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.656+0000 7fde01200640 1 --2- 172.21.15.57:0/1693496161 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fdde006c600 0x7fdde006eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:02.676 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.657+0000 7fde01200640 1 --2- 172.21.15.57:0/1693496161 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fdde006c600 0x7fdde006eac0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fddec009870 tx=0x7fddec03b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:02.676 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.660+0000 7fddf8c00640 1 -- 172.21.15.57:0/1693496161 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7fddfc1ecb00 con 0x7fddfc0d44c0 2024-03-27T10:00:02.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.663+0000 7f58b2a00640 1 -- 172.21.15.57:0/727258671 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58a8017070 con 0x7f58b403e840 2024-03-27T10:00:02.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.663+0000 7f58b2a00640 1 -- 172.21.15.57:0/727258671 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58a80035f0 con 0x7f58b403e840 2024-03-27T10:00:02.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.663+0000 7f58b2a00640 1 -- 172.21.15.57:0/727258671 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58a80039e0 con 0x7f58b403e840 2024-03-27T10:00:02.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.663+0000 7fb106000640 1 -- 172.21.15.57:0/3321801251 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7fb110067db0 con 0x7fb1100d2820 2024-03-27T10:00:02.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.663+0000 7f58c0a00640 1 -- 172.21.15.57:0/727258671 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58b4050710 con 0x7f58b403e840 2024-03-27T10:00:02.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.663+0000 7f58c0a00640 1 -- 172.21.15.57:0/727258671 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f58b4052970 con 0x7f58b403e840 2024-03-27T10:00:02.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.665+0000 7f58c0a00640 1 -- 172.21.15.57:0/727258671 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58b40057e0 con 0x7f58b403e840 2024-03-27T10:00:02.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.667+0000 7f3e64c00640 1 -- 172.21.15.57:0/3402660317 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f3e680a7880 con 0x7f3e500039b0 2024-03-27T10:00:02.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.668+0000 7f3e64c00640 1 --2- 172.21.15.57:0/3402660317 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f3e4806c580 0x7f3e4806ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:02.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.668+0000 7f3e64c00640 1 -- 172.21.15.57:0/3402660317 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f3e68127b30 con 0x7f3e500039b0 2024-03-27T10:00:02.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.669+0000 7f3e67e00640 1 --2- 172.21.15.57:0/3402660317 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f3e4806c580 0x7f3e4806ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:02.680 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.672+0000 7f3e67e00640 1 --2- 172.21.15.57:0/3402660317 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f3e4806c580 0x7f3e4806ea40 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f3e6003e4c0 tx=0x7f3e5c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:02.680 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.682+0000 7f3e64c00640 1 -- 172.21.15.57:0/3402660317 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f3e680f5930 con 0x7f3e500039b0 2024-03-27T10:00:02.680 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.686+0000 7f58b2a00640 1 -- 172.21.15.57:0/727258671 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f58a801a070 con 0x7f58b403e840 2024-03-27T10:00:02.680 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.687+0000 7f58b2a00640 1 --2- 172.21.15.57:0/727258671 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f589c06c580 0x7f589c06ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:02.680 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.687+0000 7f58b2a00640 1 -- 172.21.15.57:0/727258671 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f58a808b560 con 0x7f58b403e840 2024-03-27T10:00:02.680 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.689+0000 7f58ba800640 1 --2- 172.21.15.57:0/727258671 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f589c06c580 0x7f589c06ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:02.681 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.690+0000 7f58ba800640 1 --2- 172.21.15.57:0/727258671 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f589c06c580 0x7f589c06ea40 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f58ac000f60 tx=0x7f58ac009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:02.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.701+0000 7f58b2a00640 1 -- 172.21.15.57:0/727258671 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f58a80591d0 con 0x7f58b403e840 2024-03-27T10:00:02.981 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.991+0000 7fb323200640 1 -- 172.21.15.57:0/4265134006 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fb2fc005580 con 0x7fb324071720 2024-03-27T10:00:02.982 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.992+0000 7fb31a000640 1 -- 172.21.15.57:0/4265134006 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb3100ad020 con 0x7fb324071720 2024-03-27T10:00:02.982 INFO:teuthology.orchestra.run.smithi057.stdout:60129542155 2024-03-27T10:00:02.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.996+0000 7fb323200640 1 -- 172.21.15.57:0/4265134006 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fb30406c530 msgr2=0x7fb30406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:02.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.996+0000 7fb323200640 1 --2- 172.21.15.57:0/4265134006 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fb30406c530 0x7fb30406e9f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb31c009aa0 tx=0x7fb31c003990 comp rx=0 tx=0).stop 2024-03-27T10:00:02.987 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.996+0000 7fb323200640 1 -- 172.21.15.57:0/4265134006 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb324071720 msgr2=0x7fb3241f2e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:02.987 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.996+0000 7fb323200640 1 --2- 172.21.15.57:0/4265134006 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb324071720 0x7fb3241f2e70 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb310033000 tx=0x7fb3100046c0 comp rx=0 tx=0).stop 2024-03-27T10:00:02.987 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.997+0000 7fb323200640 1 -- 172.21.15.57:0/4265134006 shutdown_connections 2024-03-27T10:00:02.987 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.997+0000 7fb323200640 1 --2- 172.21.15.57:0/4265134006 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb324071720 0x7fb3241f2e70 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:02.987 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.997+0000 7fb323200640 1 --2- 172.21.15.57:0/4265134006 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb32406f100 0x7fb324200c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:02.987 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.997+0000 7fb323200640 1 --2- 172.21.15.57:0/4265134006 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fb30406c530 0x7fb30406e9f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:02.988 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.997+0000 7fb323200640 1 --2- 172.21.15.57:0/4265134006 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb32406d2d0 0x7fb324203980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:02.988 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.997+0000 7fb323200640 1 -- 172.21.15.57:0/4265134006 >> 172.21.15.57:0/4265134006 conn(0x7fb32406b990 msgr2=0x7fb3240d0030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:02.988 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.998+0000 7fb323200640 1 -- 172.21.15.57:0/4265134006 shutdown_connections 2024-03-27T10:00:02.989 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:02.998+0000 7fb323200640 1 -- 172.21.15.57:0/4265134006 wait complete. 2024-03-27T10:00:03.001 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.011+0000 7fbcb2600640 1 -- 172.21.15.57:0/4005771351 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fbcac068e90 con 0x7fbc900051c0 2024-03-27T10:00:03.002 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.012+0000 7fbca8c00640 1 -- 172.21.15.57:0/4005771351 <== mon.2 v2:172.21.15.118:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fbca4059da0 con 0x7fbc900051c0 2024-03-27T10:00:03.004 INFO:teuthology.orchestra.run.smithi057.stdout:55834574859 2024-03-27T10:00:03.004 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.015+0000 7f066ce00640 1 -- 172.21.15.57:0/3072677075 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f0640005580 con 0x7f06680d3fe0 2024-03-27T10:00:03.006 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.016+0000 7fbcb2600640 1 -- 172.21.15.57:0/4005771351 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fbc8c06c530 msgr2=0x7fbc8c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:03.006 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.016+0000 7fbcb2600640 1 --2- 172.21.15.57:0/4005771351 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fbc8c06c530 0x7fbc8c06e9f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fbcac136030 tx=0x7fbc9c007c00 comp rx=0 tx=0).stop 2024-03-27T10:00:03.006 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.016+0000 7fbcb2600640 1 -- 172.21.15.57:0/4005771351 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbc900051c0 msgr2=0x7fbcac0b0520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:03.006 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.016+0000 7fbcb2600640 1 --2- 172.21.15.57:0/4005771351 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbc900051c0 0x7fbcac0b0520 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fbca4009f70 tx=0x7fbca40105f0 comp rx=0 tx=0).stop 2024-03-27T10:00:03.006 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.016+0000 7fbcb2600640 1 -- 172.21.15.57:0/4005771351 shutdown_connections 2024-03-27T10:00:03.007 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.016+0000 7fbcb2600640 1 --2- 172.21.15.57:0/4005771351 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbcac1f2da0 0x7fbcac151c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:03.007 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.016+0000 7fbcb2600640 1 --2- 172.21.15.57:0/4005771351 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fbc8c06c530 0x7fbc8c06e9f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:03.007 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.016+0000 7fbcb2600640 1 --2- 172.21.15.57:0/4005771351 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbcac0b0a60 0x7fbcac1f2860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:03.007 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.016+0000 7fbcb2600640 1 --2- 172.21.15.57:0/4005771351 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbc900051c0 0x7fbcac0b0520 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:03.007 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.016+0000 7fbcb2600640 1 -- 172.21.15.57:0/4005771351 >> 172.21.15.57:0/4005771351 conn(0x7fbcac0b1770 msgr2=0x7fbcac152b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:03.007 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.016+0000 7fbcb2600640 1 -- 172.21.15.57:0/4005771351 shutdown_connections 2024-03-27T10:00:03.007 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.016+0000 7fbcb2600640 1 -- 172.21.15.57:0/4005771351 wait complete. 2024-03-27T10:00:03.007 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.017+0000 7f065e000640 1 -- 172.21.15.57:0/3072677075 <== mon.1 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f06580599a0 con 0x7f06680d3fe0 2024-03-27T10:00:03.008 INFO:teuthology.orchestra.run.smithi057.stdout:60129542154 2024-03-27T10:00:03.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.024+0000 7f066ce00640 1 -- 172.21.15.57:0/3072677075 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f064806c530 msgr2=0x7f064806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:03.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.024+0000 7f066ce00640 1 --2- 172.21.15.57:0/3072677075 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f064806c530 0x7f064806e9f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f06600012e0 tx=0x7f0660001650 comp rx=0 tx=0).stop 2024-03-27T10:00:03.015 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.024+0000 7f066ce00640 1 -- 172.21.15.57:0/3072677075 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f06680d3fe0 msgr2=0x7f066815cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:03.015 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.024+0000 7f066ce00640 1 --2- 172.21.15.57:0/3072677075 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f06680d3fe0 0x7f066815cd10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f065800d830 tx=0x7f065800dcf0 comp rx=0 tx=0).stop 2024-03-27T10:00:03.015 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.025+0000 7f066ce00640 1 -- 172.21.15.57:0/3072677075 shutdown_connections 2024-03-27T10:00:03.015 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.025+0000 7f066ce00640 1 --2- 172.21.15.57:0/3072677075 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f066815e4a0 0x7f066815b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:03.016 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.025+0000 7f066ce00640 1 --2- 172.21.15.57:0/3072677075 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f064806c530 0x7f064806e9f0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:03.016 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.025+0000 7f066ce00640 1 --2- 172.21.15.57:0/3072677075 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f06680d3fe0 0x7f066815cd10 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:03.016 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.025+0000 7f066ce00640 1 --2- 172.21.15.57:0/3072677075 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f06680ceee0 0x7f06680cb2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:03.016 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.025+0000 7f066ce00640 1 -- 172.21.15.57:0/3072677075 >> 172.21.15.57:0/3072677075 conn(0x7f066808db50 msgr2=0x7f06680b1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:03.016 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542155 for osd.2 2024-03-27T10:00:03.017 DEBUG:teuthology.parallel:result is None 2024-03-27T10:00:03.017 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.025+0000 7f066ce00640 1 -- 172.21.15.57:0/3072677075 shutdown_connections 2024-03-27T10:00:03.017 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.025+0000 7f066ce00640 1 -- 172.21.15.57:0/3072677075 wait complete. 2024-03-27T10:00:03.031 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.6 2024-03-27T10:00:03.032 DEBUG:teuthology.parallel:result is None 2024-03-27T10:00:03.036 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542154 for osd.1 2024-03-27T10:00:03.036 DEBUG:teuthology.parallel:result is None 2024-03-27T10:00:03.043 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.053+0000 7f8c13400640 1 -- 172.21.15.57:0/1145464806 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f8c28068620 con 0x7f8c2806b7a0 2024-03-27T10:00:03.044 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.054+0000 7f8c1e000640 1 -- 172.21.15.57:0/1145464806 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8c2007cc00 con 0x7f8c2806b7a0 2024-03-27T10:00:03.044 INFO:teuthology.orchestra.run.smithi057.stdout:55834574858 2024-03-27T10:00:03.046 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.056+0000 7f8c13400640 1 -- 172.21.15.57:0/1145464806 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f8c0806c580 msgr2=0x7f8c0806ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:03.046 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.056+0000 7f8c13400640 1 --2- 172.21.15.57:0/1145464806 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f8c0806c580 0x7f8c0806ea40 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8c14007fd0 tx=0x7f8c14009040 comp rx=0 tx=0).stop 2024-03-27T10:00:03.046 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.056+0000 7f8c13400640 1 -- 172.21.15.57:0/1145464806 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8c2806b7a0 msgr2=0x7f8c28152e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:03.046 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.056+0000 7f8c13400640 1 --2- 172.21.15.57:0/1145464806 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8c2806b7a0 0x7f8c28152e60 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8c2002c430 tx=0x7f8c20004a40 comp rx=0 tx=0).stop 2024-03-27T10:00:03.046 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.056+0000 7f8c13400640 1 -- 172.21.15.57:0/1145464806 shutdown_connections 2024-03-27T10:00:03.046 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.056+0000 7f8c13400640 1 --2- 172.21.15.57:0/1145464806 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8c28166b40 0x7f8c28164e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:03.046 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.056+0000 7f8c13400640 1 --2- 172.21.15.57:0/1145464806 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f8c0806c580 0x7f8c0806ea40 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:03.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.056+0000 7f8c13400640 1 --2- 172.21.15.57:0/1145464806 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8c281631e0 0x7f8c2815d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:03.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.056+0000 7f8c13400640 1 --2- 172.21.15.57:0/1145464806 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8c2806b7a0 0x7f8c28152e60 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:03.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.056+0000 7f8c13400640 1 -- 172.21.15.57:0/1145464806 >> 172.21.15.57:0/1145464806 conn(0x7f8c280b1c60 msgr2=0x7f8c280b2040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:03.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.057+0000 7f8c13400640 1 -- 172.21.15.57:0/1145464806 shutdown_connections 2024-03-27T10:00:03.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.057+0000 7f8c13400640 1 -- 172.21.15.57:0/1145464806 wait complete. 2024-03-27T10:00:03.054 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.065+0000 7fde03c00640 1 -- 172.21.15.57:0/1693496161 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fddfc068c50 con 0x7fddfc0d44c0 2024-03-27T10:00:03.055 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.065+0000 7fddf8c00640 1 -- 172.21.15.57:0/1693496161 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fddf0058fc0 con 0x7fddfc0d44c0 2024-03-27T10:00:03.055 INFO:teuthology.orchestra.run.smithi057.stdout:60129542155 2024-03-27T10:00:03.058 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.068+0000 7fde03c00640 1 -- 172.21.15.57:0/1693496161 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fdde006c600 msgr2=0x7fdde006eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:03.058 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.068+0000 7fde03c00640 1 --2- 172.21.15.57:0/1693496161 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fdde006c600 0x7fdde006eac0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fddec009870 tx=0x7fddec03b040 comp rx=0 tx=0).stop 2024-03-27T10:00:03.058 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.068+0000 7fde03c00640 1 -- 172.21.15.57:0/1693496161 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fddfc0d44c0 msgr2=0x7fddfc0c81d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:03.059 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.068+0000 7fde03c00640 1 --2- 172.21.15.57:0/1693496161 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fddfc0d44c0 0x7fddfc0c81d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fddfc08e2f0 tx=0x7fddf000c820 comp rx=0 tx=0).stop 2024-03-27T10:00:03.059 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.068+0000 7fde03c00640 1 -- 172.21.15.57:0/1693496161 shutdown_connections 2024-03-27T10:00:03.059 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.068+0000 7fde03c00640 1 --2- 172.21.15.57:0/1693496161 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fddfc15e510 0x7fddfc0cd640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:03.059 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.068+0000 7fde03c00640 1 --2- 172.21.15.57:0/1693496161 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fddfc0d44c0 0x7fddfc0c81d0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:03.059 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.068+0000 7fde03c00640 1 --2- 172.21.15.57:0/1693496161 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fdde006c600 0x7fdde006eac0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:03.059 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.068+0000 7fde03c00640 1 --2- 172.21.15.57:0/1693496161 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fddfc0d2de0 0x7fddfc1595f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:03.059 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.068+0000 7fde03c00640 1 -- 172.21.15.57:0/1693496161 >> 172.21.15.57:0/1693496161 conn(0x7fddfc067c00 msgr2=0x7fddfc0cff50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:03.059 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.069+0000 7fde03c00640 1 -- 172.21.15.57:0/1693496161 shutdown_connections 2024-03-27T10:00:03.059 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.069+0000 7fde03c00640 1 -- 172.21.15.57:0/1693496161 wait complete. 2024-03-27T10:00:03.069 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.5 2024-03-27T10:00:03.069 DEBUG:teuthology.parallel:result is None 2024-03-27T10:00:03.075 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542155 for osd.3 2024-03-27T10:00:03.075 DEBUG:teuthology.parallel:result is None 2024-03-27T10:00:03.086 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.096+0000 7fb10f200640 1 -- 172.21.15.57:0/3321801251 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fb110068540 con 0x7fb1100d2820 2024-03-27T10:00:03.086 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.097+0000 7fb106000640 1 -- 172.21.15.57:0/3321801251 <== mon.2 v2:172.21.15.118:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb0f80588e0 con 0x7fb1100d2820 2024-03-27T10:00:03.087 INFO:teuthology.orchestra.run.smithi057.stdout:55834574859 2024-03-27T10:00:03.087 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.097+0000 7f58c0a00640 1 -- 172.21.15.57:0/727258671 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f58b40df690 con 0x7f58b403e840 2024-03-27T10:00:03.087 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.098+0000 7f58b2a00640 1 -- 172.21.15.57:0/727258671 <== mon.2 v2:172.21.15.118:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f58a805d4d0 con 0x7f58b403e840 2024-03-27T10:00:03.087 INFO:teuthology.orchestra.run.smithi057.stdout:60129542154 2024-03-27T10:00:03.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.100+0000 7fb10f200640 1 -- 172.21.15.57:0/3321801251 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fb0ec06c600 msgr2=0x7fb0ec06eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:03.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.100+0000 7fb10f200640 1 --2- 172.21.15.57:0/3321801251 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fb0ec06c600 0x7fb0ec06eac0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb1100a1f40 tx=0x7fb100030000 comp rx=0 tx=0).stop 2024-03-27T10:00:03.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.100+0000 7fb10f200640 1 -- 172.21.15.57:0/3321801251 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1100d2820 msgr2=0x7fb1101609b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:03.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.100+0000 7fb10f200640 1 --2- 172.21.15.57:0/3321801251 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1100d2820 0x7fb1101609b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb0f800c470 tx=0x7fb0f800c930 comp rx=0 tx=0).stop 2024-03-27T10:00:03.091 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.100+0000 7f58c0a00640 1 -- 172.21.15.57:0/727258671 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f589c06c580 msgr2=0x7f589c06ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:03.091 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.100+0000 7f58c0a00640 1 --2- 172.21.15.57:0/727258671 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f589c06c580 0x7f589c06ea40 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f58ac000f60 tx=0x7f58ac009040 comp rx=0 tx=0).stop 2024-03-27T10:00:03.091 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.100+0000 7f58c0a00640 1 -- 172.21.15.57:0/727258671 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f58b403e840 msgr2=0x7f58b404ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:03.091 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.100+0000 7f58c0a00640 1 --2- 172.21.15.57:0/727258671 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f58b403e840 0x7f58b404ffa0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f58a800c440 tx=0x7f58a800c840 comp rx=0 tx=0).stop 2024-03-27T10:00:03.091 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.100+0000 7f58c0a00640 1 -- 172.21.15.57:0/727258671 shutdown_connections 2024-03-27T10:00:03.091 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.100+0000 7f58c0a00640 1 --2- 172.21.15.57:0/727258671 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f58b40e30c0 0x7f58b40d5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:03.091 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.100+0000 7f58c0a00640 1 --2- 172.21.15.57:0/727258671 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f58b403e840 0x7f58b404ffa0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:03.091 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.100+0000 7f58c0a00640 1 --2- 172.21.15.57:0/727258671 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f589c06c580 0x7f589c06ea40 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:03.091 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.100+0000 7f58c0a00640 1 --2- 172.21.15.57:0/727258671 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f58b40078e0 0x7f58b417b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:03.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.100+0000 7fb10f200640 1 -- 172.21.15.57:0/3321801251 shutdown_connections 2024-03-27T10:00:03.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.100+0000 7f58c0a00640 1 -- 172.21.15.57:0/727258671 >> 172.21.15.57:0/727258671 conn(0x7f58b40559e0 msgr2=0x7f58b403aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:03.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.100+0000 7fb10f200640 1 --2- 172.21.15.57:0/3321801251 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb110161830 0x7fb1101565b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:03.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.100+0000 7fb10f200640 1 --2- 172.21.15.57:0/3321801251 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fb0ec06c600 0x7fb0ec06eac0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:03.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.100+0000 7fb10f200640 1 --2- 172.21.15.57:0/3321801251 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb1100d4b50 0x7fb1101527d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:03.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.100+0000 7fb10f200640 1 --2- 172.21.15.57:0/3321801251 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1100d2820 0x7fb1101609b0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:03.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.100+0000 7fb10f200640 1 -- 172.21.15.57:0/3321801251 >> 172.21.15.57:0/3321801251 conn(0x7fb1100d4030 msgr2=0x7fb1100cd7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:03.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.100+0000 7fb10f200640 1 -- 172.21.15.57:0/3321801251 shutdown_connections 2024-03-27T10:00:03.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.100+0000 7f58c0a00640 1 -- 172.21.15.57:0/727258671 shutdown_connections 2024-03-27T10:00:03.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.100+0000 7fb10f200640 1 -- 172.21.15.57:0/3321801251 wait complete. 2024-03-27T10:00:03.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.100+0000 7f58c0a00640 1 -- 172.21.15.57:0/727258671 wait complete. 2024-03-27T10:00:03.107 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542154 for osd.0 2024-03-27T10:00:03.107 DEBUG:teuthology.parallel:result is None 2024-03-27T10:00:03.114 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.4 2024-03-27T10:00:03.114 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.124+0000 7f3e6de00640 1 -- 172.21.15.57:0/3402660317 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f3e60055630 con 0x7f3e500039b0 2024-03-27T10:00:03.114 DEBUG:teuthology.parallel:result is None 2024-03-27T10:00:03.115 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.124+0000 7f3e64c00640 1 -- 172.21.15.57:0/3402660317 <== mon.2 v2:172.21.15.118:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3e680f9c30 con 0x7f3e500039b0 2024-03-27T10:00:03.115 INFO:teuthology.orchestra.run.smithi057.stdout:55834574860 2024-03-27T10:00:03.117 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.127+0000 7f3e6de00640 1 -- 172.21.15.57:0/3402660317 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f3e4806c580 msgr2=0x7f3e4806ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:03.117 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.127+0000 7f3e6de00640 1 --2- 172.21.15.57:0/3402660317 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f3e4806c580 0x7f3e4806ea40 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f3e6003e4c0 tx=0x7f3e5c008040 comp rx=0 tx=0).stop 2024-03-27T10:00:03.118 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.127+0000 7f3e6de00640 1 -- 172.21.15.57:0/3402660317 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3e500039b0 msgr2=0x7f3e600d70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:03.118 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.127+0000 7f3e6de00640 1 --2- 172.21.15.57:0/3402660317 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3e500039b0 0x7f3e600d70c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3e6807a6d0 tx=0x7f3e680652e0 comp rx=0 tx=0).stop 2024-03-27T10:00:03.118 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.127+0000 7f3e6de00640 1 -- 172.21.15.57:0/3402660317 shutdown_connections 2024-03-27T10:00:03.118 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.127+0000 7f3e6de00640 1 --2- 172.21.15.57:0/3402660317 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e60179af0 0x7f3e60179f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:03.118 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.127+0000 7f3e6de00640 1 --2- 172.21.15.57:0/3402660317 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f3e4806c580 0x7f3e4806ea40 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:03.118 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.127+0000 7f3e6de00640 1 --2- 172.21.15.57:0/3402660317 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3e60052bc0 0x7f3e6004ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:03.118 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.127+0000 7f3e6de00640 1 --2- 172.21.15.57:0/3402660317 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3e500039b0 0x7f3e600d70c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:03.118 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.127+0000 7f3e6de00640 1 -- 172.21.15.57:0/3402660317 >> 172.21.15.57:0/3402660317 conn(0x7f3e60058ee0 msgr2=0x7f3e600e6c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:03.118 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.127+0000 7f3e6de00640 1 -- 172.21.15.57:0/3402660317 shutdown_connections 2024-03-27T10:00:03.118 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.127+0000 7f3e6de00640 1 -- 172.21.15.57:0/3402660317 wait complete. 2024-03-27T10:00:03.133 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574860 for osd.7 2024-03-27T10:00:03.133 DEBUG:teuthology.parallel:result is None 2024-03-27T10:00:03.133 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-03-27T10:00:03.133 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-27T10:00:03.393 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.403+0000 7fbfaf200640 1 Processor -- start 2024-03-27T10:00:03.394 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.404+0000 7fbfaf200640 1 -- start start 2024-03-27T10:00:03.395 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.405+0000 7fbfaf200640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbfb0161830 0x7fbfb00cf970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:03.395 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.405+0000 7fbfaf200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbfb00d0e90 0x7fbfb00c7b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:03.395 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.405+0000 7fbfaf200640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbfb00d2d90 con 0x7fbfb00cfeb0 2024-03-27T10:00:03.395 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.405+0000 7fbfaf200640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7fbfb00cf4e0 con 0x7fbfb0161830 2024-03-27T10:00:03.395 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.405+0000 7fbfaf200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fbfb00cee90 con 0x7fbfb00d0e90 2024-03-27T10:00:03.396 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.406+0000 7fbfade00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbfb0161830 0x7fbfb00cf970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:03.396 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.406+0000 7fbfade00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbfb0161830 0x7fbfb00cf970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55026/0 (socket says 172.21.15.57:55026) 2024-03-27T10:00:03.396 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.406+0000 7fbfade00640 1 -- 172.21.15.57:0/3773968682 learned_addr learned my addr 172.21.15.57:0/3773968682 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:03.396 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.406+0000 7fbfae800640 1 --2- 172.21.15.57:0/3773968682 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbfb00d0e90 0x7fbfb00c7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:03.396 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.406+0000 7fbfade00640 1 -- 172.21.15.57:0/3773968682 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbfb00d0e90 msgr2=0x7fbfb00c7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:03.396 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.406+0000 7fbfade00640 1 --2- 172.21.15.57:0/3773968682 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbfb00d0e90 0x7fbfb00c7b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:03.396 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.406+0000 7fbfade00640 1 -- 172.21.15.57:0/3773968682 >> v1:172.21.15.118:6789/0 conn(0x7fbfb00cfeb0 legacy=0x7fbfb00d0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:03.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.406+0000 7fbfade00640 1 -- 172.21.15.57:0/3773968682 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfb00cf170 con 0x7fbfb0161830 2024-03-27T10:00:03.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.407+0000 7fbfade00640 1 --2- 172.21.15.57:0/3773968682 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbfb0161830 0x7fbfb00cf970 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fbfa0009870 tx=0x7fbfa002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3740bdfe99f0e30a server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:03.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.407+0000 7fbfad400640 1 -- 172.21.15.57:0/3773968682 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfa00317c0 con 0x7fbfb0161830 2024-03-27T10:00:03.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.407+0000 7fbfad400640 1 -- 172.21.15.57:0/3773968682 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfa0037070 con 0x7fbfb0161830 2024-03-27T10:00:03.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.407+0000 7fbfad400640 1 -- 172.21.15.57:0/3773968682 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfa0031b80 con 0x7fbfb0161830 2024-03-27T10:00:03.398 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.408+0000 7fbfaf200640 1 -- 172.21.15.57:0/3773968682 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbfb0161830 msgr2=0x7fbfb00cf970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:03.398 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.408+0000 7fbfaf200640 1 --2- 172.21.15.57:0/3773968682 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbfb0161830 0x7fbfb00cf970 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fbfa0009870 tx=0x7fbfa002b860 comp rx=0 tx=0).stop 2024-03-27T10:00:03.398 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.408+0000 7fbfaf200640 1 -- 172.21.15.57:0/3773968682 shutdown_connections 2024-03-27T10:00:03.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.408+0000 7fbfaf200640 1 --2- 172.21.15.57:0/3773968682 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbfb00d0e90 0x7fbfb00c7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:03.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.408+0000 7fbfaf200640 1 --2- 172.21.15.57:0/3773968682 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbfb0161830 0x7fbfb00cf970 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:03.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.408+0000 7fbfaf200640 1 -- 172.21.15.57:0/3773968682 >> 172.21.15.57:0/3773968682 conn(0x7fbfb00d4030 msgr2=0x7fbfb00d4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:03.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.408+0000 7fbfaf200640 1 -- 172.21.15.57:0/3773968682 shutdown_connections 2024-03-27T10:00:03.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.408+0000 7fbfaf200640 1 -- 172.21.15.57:0/3773968682 wait complete. 2024-03-27T10:00:03.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.410+0000 7fbfaf200640 1 Processor -- start 2024-03-27T10:00:03.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.410+0000 7fbfaf200640 1 -- start start 2024-03-27T10:00:03.402 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.411+0000 7fbfaf200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbfb00cfeb0 0x7fbfb015d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:03.402 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.411+0000 7fbfaf200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbfb00d0e90 0x7fbfb0156400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:03.402 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.411+0000 7fbfaf200640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbfb0161830 0x7fbfb0156940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:03.403 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.411+0000 7fbfaf200640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb00ce4b0 con 0x7fbfb0161830 2024-03-27T10:00:03.403 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.411+0000 7fbfaf200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb00ce330 con 0x7fbfb00d0e90 2024-03-27T10:00:03.403 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.411+0000 7fbfaf200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fbfb0161c10 con 0x7fbfb00cfeb0 2024-03-27T10:00:03.403 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.411+0000 7fbfae800640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbfb0161830 0x7fbfb0156940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:03.403 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.411+0000 7fbfae800640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbfb0161830 0x7fbfb0156940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55030/0 (socket says 172.21.15.57:55030) 2024-03-27T10:00:03.403 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.411+0000 7fbfae800640 1 -- 172.21.15.57:0/3494680977 learned_addr learned my addr 172.21.15.57:0/3494680977 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:03.403 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.412+0000 7fbfa7e00640 1 --2- 172.21.15.57:0/3494680977 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbfb00d0e90 0x7fbfb0156400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:03.403 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.412+0000 7fbfae800640 1 -- 172.21.15.57:0/3494680977 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbfb00cfeb0 msgr2=0x7fbfb015d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:03.403 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.412+0000 7fbfade00640 1 --2- 172.21.15.57:0/3494680977 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbfb00cfeb0 0x7fbfb015d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:03.403 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.412+0000 7fbfae800640 1 --2- 172.21.15.57:0/3494680977 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbfb00cfeb0 0x7fbfb015d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:03.403 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.412+0000 7fbfae800640 1 -- 172.21.15.57:0/3494680977 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbfb00d0e90 msgr2=0x7fbfb0156400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:03.403 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.412+0000 7fbfae800640 1 --2- 172.21.15.57:0/3494680977 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbfb00d0e90 0x7fbfb0156400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:03.403 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.412+0000 7fbfae800640 1 -- 172.21.15.57:0/3494680977 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfb015de50 con 0x7fbfb0161830 2024-03-27T10:00:03.403 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.412+0000 7fbfa7e00640 1 --2- 172.21.15.57:0/3494680977 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbfb00d0e90 0x7fbfb0156400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T10:00:03.404 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.412+0000 7fbfae800640 1 --2- 172.21.15.57:0/3494680977 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbfb0161830 0x7fbfb0156940 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fbfa800cd70 tx=0x7fbfa800a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:03.404 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.412+0000 7fbfa6000640 1 -- 172.21.15.57:0/3494680977 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfa8003b90 con 0x7fbfb0161830 2024-03-27T10:00:03.404 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.412+0000 7fbfa6000640 1 -- 172.21.15.57:0/3494680977 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfa8003d30 con 0x7fbfb0161830 2024-03-27T10:00:03.404 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.412+0000 7fbfa6000640 1 -- 172.21.15.57:0/3494680977 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfa8004240 con 0x7fbfb0161830 2024-03-27T10:00:03.404 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.412+0000 7fbfaf200640 1 -- 172.21.15.57:0/3494680977 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfb015e0f0 con 0x7fbfb0161830 2024-03-27T10:00:03.404 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.413+0000 7fbfaf200640 1 -- 172.21.15.57:0/3494680977 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfb015e6b0 con 0x7fbfb0161830 2024-03-27T10:00:03.404 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.414+0000 7fbfaf200640 1 -- 172.21.15.57:0/3494680977 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfb0068540 con 0x7fbfb0161830 2024-03-27T10:00:03.405 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.414+0000 7fbfa6000640 1 -- 172.21.15.57:0/3494680977 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fbfa80043e0 con 0x7fbfb0161830 2024-03-27T10:00:03.405 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.415+0000 7fbfa6000640 1 --2- 172.21.15.57:0/3494680977 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fbf8c06c530 0x7fbf8c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:03.405 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.415+0000 7fbfa6000640 1 -- 172.21.15.57:0/3494680977 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fbfa808c590 con 0x7fbfb0161830 2024-03-27T10:00:03.405 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.416+0000 7fbfade00640 1 --2- 172.21.15.57:0/3494680977 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fbf8c06c530 0x7fbf8c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:03.406 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.416+0000 7fbfade00640 1 --2- 172.21.15.57:0/3494680977 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fbf8c06c530 0x7fbf8c06e9f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fbfa0036000 tx=0x7fbfa0008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:03.409 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.420+0000 7fbfa6000640 1 -- 172.21.15.57:0/3494680977 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7fbfa801d340 con 0x7fbfb0161830 2024-03-27T10:00:03.599 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.609+0000 7fbfaf200640 1 -- 172.21.15.57:0/3494680977 --> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbfb00c73a0 con 0x7fbf8c06c530 2024-03-27T10:00:03.624 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.635+0000 7fbfa6000640 1 -- 172.21.15.57:0/3494680977 <== mgr.4103 v2:172.21.15.57:6832/485397065 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332537 (secure 0 0 0) 0x7fbfb00c73a0 con 0x7fbf8c06c530 2024-03-27T10:00:03.629 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:00:03.631 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-03-27T10:00:03.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.640+0000 7fbfaf200640 1 -- 172.21.15.57:0/3494680977 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fbf8c06c530 msgr2=0x7fbf8c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:03.633 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.641+0000 7fbfaf200640 1 --2- 172.21.15.57:0/3494680977 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fbf8c06c530 0x7fbf8c06e9f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fbfa0036000 tx=0x7fbfa0008030 comp rx=0 tx=0).stop 2024-03-27T10:00:03.633 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.641+0000 7fbfaf200640 1 -- 172.21.15.57:0/3494680977 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbfb0161830 msgr2=0x7fbfb0156940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:03.633 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.641+0000 7fbfaf200640 1 --2- 172.21.15.57:0/3494680977 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbfb0161830 0x7fbfb0156940 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fbfa800cd70 tx=0x7fbfa800a660 comp rx=0 tx=0).stop 2024-03-27T10:00:03.633 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.641+0000 7fbfaf200640 1 -- 172.21.15.57:0/3494680977 shutdown_connections 2024-03-27T10:00:03.633 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.641+0000 7fbfaf200640 1 --2- 172.21.15.57:0/3494680977 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbfb0161830 0x7fbfb0156940 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:03.633 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.641+0000 7fbfaf200640 1 --2- 172.21.15.57:0/3494680977 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fbf8c06c530 0x7fbf8c06e9f0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:03.633 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.641+0000 7fbfaf200640 1 --2- 172.21.15.57:0/3494680977 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbfb00d0e90 0x7fbfb0156400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:03.633 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.641+0000 7fbfaf200640 1 --2- 172.21.15.57:0/3494680977 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbfb00cfeb0 0x7fbfb015d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:03.633 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.641+0000 7fbfaf200640 1 -- 172.21.15.57:0/3494680977 >> 172.21.15.57:0/3494680977 conn(0x7fbfb00d4030 msgr2=0x7fbfb00c90c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:03.633 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.641+0000 7fbfaf200640 1 -- 172.21.15.57:0/3494680977 shutdown_connections 2024-03-27T10:00:03.633 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.641+0000 7fbfaf200640 1 -- 172.21.15.57:0/3494680977 wait complete. 2024-03-27T10:00:03.650 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":43,"stamp":"2024-03-27T10:00:03.237039+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236172,"kb_used_data":3368,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738548,"statfs":{"total":773094113280,"available":772852273152,"internally_reserved":0,"allocated":3448832,"data_stored":2077568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.008820"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.798582+0000","last_change":"2024-03-27T09:59:28.132620+0000","last_active":"2024-03-27T09:59:35.798582+0000","last_peered":"2024-03-27T09:59:35.798582+0000","last_clean":"2024-03-27T09:59:35.798582+0000","last_became_active":"2024-03-27T09:59:28.132360+0000","last_became_peered":"2024-03-27T09:59:28.132360+0000","last_unstale":"2024-03-27T09:59:35.798582+0000","last_undegraded":"2024-03-27T09:59:35.798582+0000","last_fullsized":"2024-03-27T09:59:35.798582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T20:35:52.312192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.600893+0000","last_change":"2024-03-27T09:59:29.147335+0000","last_active":"2024-03-27T09:59:35.600893+0000","last_peered":"2024-03-27T09:59:35.600893+0000","last_clean":"2024-03-27T09:59:35.600893+0000","last_became_active":"2024-03-27T09:59:29.147015+0000","last_became_peered":"2024-03-27T09:59:29.147015+0000","last_unstale":"2024-03-27T09:59:35.600893+0000","last_undegraded":"2024-03-27T09:59:35.600893+0000","last_fullsized":"2024-03-27T09:59:35.600893+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:12:08.142213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.599213+0000","last_change":"2024-03-27T09:59:33.703543+0000","last_active":"2024-03-27T09:59:35.599213+0000","last_peered":"2024-03-27T09:59:35.599213+0000","last_clean":"2024-03-27T09:59:35.599213+0000","last_became_active":"2024-03-27T09:59:33.702853+0000","last_became_peered":"2024-03-27T09:59:33.702853+0000","last_unstale":"2024-03-27T09:59:35.599213+0000","last_undegraded":"2024-03-27T09:59:35.599213+0000","last_fullsized":"2024-03-27T09:59:35.599213+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T20:31:50.071081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.601154+0000","last_change":"2024-03-27T09:59:28.119506+0000","last_active":"2024-03-27T09:59:35.601154+0000","last_peered":"2024-03-27T09:59:35.601154+0000","last_clean":"2024-03-27T09:59:35.601154+0000","last_became_active":"2024-03-27T09:59:28.119120+0000","last_became_peered":"2024-03-27T09:59:28.119120+0000","last_unstale":"2024-03-27T09:59:35.601154+0000","last_undegraded":"2024-03-27T09:59:35.601154+0000","last_fullsized":"2024-03-27T09:59:35.601154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:40:42.254670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.797783+0000","last_change":"2024-03-27T09:59:29.152285+0000","last_active":"2024-03-27T09:59:35.797783+0000","last_peered":"2024-03-27T09:59:35.797783+0000","last_clean":"2024-03-27T09:59:35.797783+0000","last_became_active":"2024-03-27T09:59:29.150250+0000","last_became_peered":"2024-03-27T09:59:29.150250+0000","last_unstale":"2024-03-27T09:59:35.797783+0000","last_undegraded":"2024-03-27T09:59:35.797783+0000","last_fullsized":"2024-03-27T09:59:35.797783+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:45:14.005415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.228593+0000","last_change":"2024-03-27T09:59:33.227161+0000","last_active":"2024-03-27T09:59:35.228593+0000","last_peered":"2024-03-27T09:59:35.228593+0000","last_clean":"2024-03-27T09:59:35.228593+0000","last_became_active":"2024-03-27T09:59:33.225987+0000","last_became_peered":"2024-03-27T09:59:33.225987+0000","last_unstale":"2024-03-27T09:59:35.228593+0000","last_undegraded":"2024-03-27T09:59:35.228593+0000","last_fullsized":"2024-03-27T09:59:35.228593+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T20:25:58.823076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.726381+0000","last_change":"2024-03-27T09:59:28.131417+0000","last_active":"2024-03-27T09:59:36.726381+0000","last_peered":"2024-03-27T09:59:36.726381+0000","last_clean":"2024-03-27T09:59:36.726381+0000","last_became_active":"2024-03-27T09:59:28.131134+0000","last_became_peered":"2024-03-27T09:59:28.131134+0000","last_unstale":"2024-03-27T09:59:36.726381+0000","last_undegraded":"2024-03-27T09:59:36.726381+0000","last_fullsized":"2024-03-27T09:59:36.726381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:55:33.304260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.230980+0000","last_change":"2024-03-27T09:59:29.159330+0000","last_active":"2024-03-27T09:59:35.230980+0000","last_peered":"2024-03-27T09:59:35.230980+0000","last_clean":"2024-03-27T09:59:35.230980+0000","last_became_active":"2024-03-27T09:59:29.159006+0000","last_became_peered":"2024-03-27T09:59:29.159006+0000","last_unstale":"2024-03-27T09:59:35.230980+0000","last_undegraded":"2024-03-27T09:59:35.230980+0000","last_fullsized":"2024-03-27T09:59:35.230980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:03:30.407810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.232767+0000","last_change":"2024-03-27T09:59:33.224598+0000","last_active":"2024-03-27T09:59:35.232767+0000","last_peered":"2024-03-27T09:59:35.232767+0000","last_clean":"2024-03-27T09:59:35.232767+0000","last_became_active":"2024-03-27T09:59:33.224114+0000","last_became_peered":"2024-03-27T09:59:33.224114+0000","last_unstale":"2024-03-27T09:59:35.232767+0000","last_undegraded":"2024-03-27T09:59:35.232767+0000","last_fullsized":"2024-03-27T09:59:35.232767+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:02:21.892888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.726198+0000","last_change":"2024-03-27T09:59:28.129485+0000","last_active":"2024-03-27T09:59:36.726198+0000","last_peered":"2024-03-27T09:59:36.726198+0000","last_clean":"2024-03-27T09:59:36.726198+0000","last_became_active":"2024-03-27T09:59:28.129171+0000","last_became_peered":"2024-03-27T09:59:28.129171+0000","last_unstale":"2024-03-27T09:59:36.726198+0000","last_undegraded":"2024-03-27T09:59:36.726198+0000","last_fullsized":"2024-03-27T09:59:36.726198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:31:20.500733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.231419+0000","last_change":"2024-03-27T09:59:29.161577+0000","last_active":"2024-03-27T09:59:35.231419+0000","last_peered":"2024-03-27T09:59:35.231419+0000","last_clean":"2024-03-27T09:59:35.231419+0000","last_became_active":"2024-03-27T09:59:29.161395+0000","last_became_peered":"2024-03-27T09:59:29.161395+0000","last_unstale":"2024-03-27T09:59:35.231419+0000","last_undegraded":"2024-03-27T09:59:35.231419+0000","last_fullsized":"2024-03-27T09:59:35.231419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T20:51:12.586643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.229598+0000","last_change":"2024-03-27T09:59:33.213426+0000","last_active":"2024-03-27T09:59:35.229598+0000","last_peered":"2024-03-27T09:59:35.229598+0000","last_clean":"2024-03-27T09:59:35.229598+0000","last_became_active":"2024-03-27T09:59:33.212985+0000","last_became_peered":"2024-03-27T09:59:33.212985+0000","last_unstale":"2024-03-27T09:59:35.229598+0000","last_undegraded":"2024-03-27T09:59:35.229598+0000","last_fullsized":"2024-03-27T09:59:35.229598+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:03:49.254833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.231790+0000","last_change":"2024-03-27T09:59:29.153065+0000","last_active":"2024-03-27T09:59:35.231790+0000","last_peered":"2024-03-27T09:59:35.231790+0000","last_clean":"2024-03-27T09:59:35.231790+0000","last_became_active":"2024-03-27T09:59:29.152709+0000","last_became_peered":"2024-03-27T09:59:29.152709+0000","last_unstale":"2024-03-27T09:59:35.231790+0000","last_undegraded":"2024-03-27T09:59:35.231790+0000","last_fullsized":"2024-03-27T09:59:35.231790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:57:26.770369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.726196+0000","last_change":"2024-03-27T09:59:28.132199+0000","last_active":"2024-03-27T09:59:36.726196+0000","last_peered":"2024-03-27T09:59:36.726196+0000","last_clean":"2024-03-27T09:59:36.726196+0000","last_became_active":"2024-03-27T09:59:28.131839+0000","last_became_peered":"2024-03-27T09:59:28.131839+0000","last_unstale":"2024-03-27T09:59:36.726196+0000","last_undegraded":"2024-03-27T09:59:36.726196+0000","last_fullsized":"2024-03-27T09:59:36.726196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:04:46.361989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.233050+0000","last_change":"2024-03-27T09:59:33.225488+0000","last_active":"2024-03-27T09:59:35.233050+0000","last_peered":"2024-03-27T09:59:35.233050+0000","last_clean":"2024-03-27T09:59:35.233050+0000","last_became_active":"2024-03-27T09:59:33.223781+0000","last_became_peered":"2024-03-27T09:59:33.223781+0000","last_unstale":"2024-03-27T09:59:35.233050+0000","last_undegraded":"2024-03-27T09:59:35.233050+0000","last_fullsized":"2024-03-27T09:59:35.233050+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:45:04.448005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.599916+0000","last_change":"2024-03-27T09:59:29.152084+0000","last_active":"2024-03-27T09:59:35.599916+0000","last_peered":"2024-03-27T09:59:35.599916+0000","last_clean":"2024-03-27T09:59:35.599916+0000","last_became_active":"2024-03-27T09:59:29.151816+0000","last_became_peered":"2024-03-27T09:59:29.151816+0000","last_unstale":"2024-03-27T09:59:35.599916+0000","last_undegraded":"2024-03-27T09:59:35.599916+0000","last_fullsized":"2024-03-27T09:59:35.599916+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:34:04.348561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.657754+0000","last_change":"2024-03-27T09:59:28.113836+0000","last_active":"2024-03-27T09:59:36.657754+0000","last_peered":"2024-03-27T09:59:36.657754+0000","last_clean":"2024-03-27T09:59:36.657754+0000","last_became_active":"2024-03-27T09:59:28.113517+0000","last_became_peered":"2024-03-27T09:59:28.113517+0000","last_unstale":"2024-03-27T09:59:36.657754+0000","last_undegraded":"2024-03-27T09:59:36.657754+0000","last_fullsized":"2024-03-27T09:59:36.657754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:40:42.254670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.233128+0000","last_change":"2024-03-27T09:59:33.219685+0000","last_active":"2024-03-27T09:59:35.233128+0000","last_peered":"2024-03-27T09:59:35.233128+0000","last_clean":"2024-03-27T09:59:35.233128+0000","last_became_active":"2024-03-27T09:59:33.219163+0000","last_became_peered":"2024-03-27T09:59:33.219163+0000","last_unstale":"2024-03-27T09:59:35.233128+0000","last_undegraded":"2024-03-27T09:59:35.233128+0000","last_fullsized":"2024-03-27T09:59:35.233128+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:21:56.509459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.599966+0000","last_change":"2024-03-27T09:59:29.162032+0000","last_active":"2024-03-27T09:59:35.599966+0000","last_peered":"2024-03-27T09:59:35.599966+0000","last_clean":"2024-03-27T09:59:35.599966+0000","last_became_active":"2024-03-27T09:59:29.154157+0000","last_became_peered":"2024-03-27T09:59:29.154157+0000","last_unstale":"2024-03-27T09:59:35.599966+0000","last_undegraded":"2024-03-27T09:59:35.599966+0000","last_fullsized":"2024-03-27T09:59:35.599966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:57:26.770369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.658673+0000","last_change":"2024-03-27T09:59:28.129073+0000","last_active":"2024-03-27T09:59:36.658673+0000","last_peered":"2024-03-27T09:59:36.658673+0000","last_clean":"2024-03-27T09:59:36.658673+0000","last_became_active":"2024-03-27T09:59:28.128568+0000","last_became_peered":"2024-03-27T09:59:28.128568+0000","last_unstale":"2024-03-27T09:59:36.658673+0000","last_undegraded":"2024-03-27T09:59:36.658673+0000","last_fullsized":"2024-03-27T09:59:36.658673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:13:29.201574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.660426+0000","last_change":"2024-03-27T09:59:33.708504+0000","last_active":"2024-03-27T09:59:36.660426+0000","last_peered":"2024-03-27T09:59:36.660426+0000","last_clean":"2024-03-27T09:59:36.660426+0000","last_became_active":"2024-03-27T09:59:33.703606+0000","last_became_peered":"2024-03-27T09:59:33.703606+0000","last_unstale":"2024-03-27T09:59:36.660426+0000","last_undegraded":"2024-03-27T09:59:36.660426+0000","last_fullsized":"2024-03-27T09:59:36.660426+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:06:12.744793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.230009+0000","last_change":"2024-03-27T09:59:29.136122+0000","last_active":"2024-03-27T09:59:35.230009+0000","last_peered":"2024-03-27T09:59:35.230009+0000","last_clean":"2024-03-27T09:59:35.230009+0000","last_became_active":"2024-03-27T09:59:29.134653+0000","last_became_peered":"2024-03-27T09:59:29.134653+0000","last_unstale":"2024-03-27T09:59:35.230009+0000","last_undegraded":"2024-03-27T09:59:35.230009+0000","last_fullsized":"2024-03-27T09:59:35.230009+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:23:47.064643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.726161+0000","last_change":"2024-03-27T09:59:28.130295+0000","last_active":"2024-03-27T09:59:36.726161+0000","last_peered":"2024-03-27T09:59:36.726161+0000","last_clean":"2024-03-27T09:59:36.726161+0000","last_became_active":"2024-03-27T09:59:28.129719+0000","last_became_peered":"2024-03-27T09:59:28.129719+0000","last_unstale":"2024-03-27T09:59:36.726161+0000","last_undegraded":"2024-03-27T09:59:36.726161+0000","last_fullsized":"2024-03-27T09:59:36.726161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:23:46.050666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.233646+0000","last_change":"2024-03-27T09:59:33.225859+0000","last_active":"2024-03-27T09:59:35.233646+0000","last_peered":"2024-03-27T09:59:35.233646+0000","last_clean":"2024-03-27T09:59:35.233646+0000","last_became_active":"2024-03-27T09:59:33.224011+0000","last_became_peered":"2024-03-27T09:59:33.224011+0000","last_unstale":"2024-03-27T09:59:35.233646+0000","last_undegraded":"2024-03-27T09:59:35.233646+0000","last_fullsized":"2024-03-27T09:59:35.233646+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:06:12.744793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.798261+0000","last_change":"2024-03-27T09:59:29.155479+0000","last_active":"2024-03-27T09:59:35.798261+0000","last_peered":"2024-03-27T09:59:35.798261+0000","last_clean":"2024-03-27T09:59:35.798261+0000","last_became_active":"2024-03-27T09:59:29.151680+0000","last_became_peered":"2024-03-27T09:59:29.151680+0000","last_unstale":"2024-03-27T09:59:35.798261+0000","last_undegraded":"2024-03-27T09:59:35.798261+0000","last_fullsized":"2024-03-27T09:59:35.798261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:57:26.770369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.232591+0000","last_change":"2024-03-27T09:59:28.128710+0000","last_active":"2024-03-27T09:59:35.232591+0000","last_peered":"2024-03-27T09:59:35.232591+0000","last_clean":"2024-03-27T09:59:35.232591+0000","last_became_active":"2024-03-27T09:59:28.128323+0000","last_became_peered":"2024-03-27T09:59:28.128323+0000","last_unstale":"2024-03-27T09:59:35.232591+0000","last_undegraded":"2024-03-27T09:59:35.232591+0000","last_fullsized":"2024-03-27T09:59:35.232591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:55:33.304260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.232711+0000","last_change":"2024-03-27T09:59:33.705209+0000","last_active":"2024-03-27T09:59:35.232711+0000","last_peered":"2024-03-27T09:59:35.232711+0000","last_clean":"2024-03-27T09:59:35.232711+0000","last_became_active":"2024-03-27T09:59:33.704637+0000","last_became_peered":"2024-03-27T09:59:33.704637+0000","last_unstale":"2024-03-27T09:59:35.232711+0000","last_undegraded":"2024-03-27T09:59:35.232711+0000","last_fullsized":"2024-03-27T09:59:35.232711+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:07:54.369342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.601058+0000","last_change":"2024-03-27T09:59:29.160579+0000","last_active":"2024-03-27T09:59:35.601058+0000","last_peered":"2024-03-27T09:59:35.601058+0000","last_clean":"2024-03-27T09:59:35.601058+0000","last_became_active":"2024-03-27T09:59:29.160256+0000","last_became_peered":"2024-03-27T09:59:29.160256+0000","last_unstale":"2024-03-27T09:59:35.601058+0000","last_undegraded":"2024-03-27T09:59:35.601058+0000","last_fullsized":"2024-03-27T09:59:35.601058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:00:09.092063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.657792+0000","last_change":"2024-03-27T09:59:28.113830+0000","last_active":"2024-03-27T09:59:36.657792+0000","last_peered":"2024-03-27T09:59:36.657792+0000","last_clean":"2024-03-27T09:59:36.657792+0000","last_became_active":"2024-03-27T09:59:28.112951+0000","last_became_peered":"2024-03-27T09:59:28.112951+0000","last_unstale":"2024-03-27T09:59:36.657792+0000","last_undegraded":"2024-03-27T09:59:36.657792+0000","last_fullsized":"2024-03-27T09:59:36.657792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:31:20.500733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.598982+0000","last_change":"2024-03-27T09:59:33.698681+0000","last_active":"2024-03-27T09:59:35.598982+0000","last_peered":"2024-03-27T09:59:35.598982+0000","last_clean":"2024-03-27T09:59:35.598982+0000","last_became_active":"2024-03-27T09:59:33.697706+0000","last_became_peered":"2024-03-27T09:59:33.697706+0000","last_unstale":"2024-03-27T09:59:35.598982+0000","last_undegraded":"2024-03-27T09:59:35.598982+0000","last_fullsized":"2024-03-27T09:59:35.598982+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:40:22.426786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.660127+0000","last_change":"2024-03-27T09:59:29.150475+0000","last_active":"2024-03-27T09:59:36.660127+0000","last_peered":"2024-03-27T09:59:36.660127+0000","last_clean":"2024-03-27T09:59:36.660127+0000","last_became_active":"2024-03-27T09:59:29.150150+0000","last_became_peered":"2024-03-27T09:59:29.150150+0000","last_unstale":"2024-03-27T09:59:36.660127+0000","last_undegraded":"2024-03-27T09:59:36.660127+0000","last_fullsized":"2024-03-27T09:59:36.660127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T21:36:52.561523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.726237+0000","last_change":"2024-03-27T09:59:28.131581+0000","last_active":"2024-03-27T09:59:36.726237+0000","last_peered":"2024-03-27T09:59:36.726237+0000","last_clean":"2024-03-27T09:59:36.726237+0000","last_became_active":"2024-03-27T09:59:28.131279+0000","last_became_peered":"2024-03-27T09:59:28.131279+0000","last_unstale":"2024-03-27T09:59:36.726237+0000","last_undegraded":"2024-03-27T09:59:36.726237+0000","last_fullsized":"2024-03-27T09:59:36.726237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T12:53:30.888359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.797439+0000","last_change":"2024-03-27T09:59:33.702376+0000","last_active":"2024-03-27T09:59:35.797439+0000","last_peered":"2024-03-27T09:59:35.797439+0000","last_clean":"2024-03-27T09:59:35.797439+0000","last_became_active":"2024-03-27T09:59:33.698666+0000","last_became_peered":"2024-03-27T09:59:33.698666+0000","last_unstale":"2024-03-27T09:59:35.797439+0000","last_undegraded":"2024-03-27T09:59:35.797439+0000","last_fullsized":"2024-03-27T09:59:35.797439+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:26:40.882057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.231562+0000","last_change":"2024-03-27T09:59:29.156291+0000","last_active":"2024-03-27T09:59:35.231562+0000","last_peered":"2024-03-27T09:59:35.231562+0000","last_clean":"2024-03-27T09:59:35.231562+0000","last_became_active":"2024-03-27T09:59:29.156028+0000","last_became_peered":"2024-03-27T09:59:29.156028+0000","last_unstale":"2024-03-27T09:59:35.231562+0000","last_undegraded":"2024-03-27T09:59:35.231562+0000","last_fullsized":"2024-03-27T09:59:35.231562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:03:45.164612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.657738+0000","last_change":"2024-03-27T09:59:28.115841+0000","last_active":"2024-03-27T09:59:36.657738+0000","last_peered":"2024-03-27T09:59:36.657738+0000","last_clean":"2024-03-27T09:59:36.657738+0000","last_became_active":"2024-03-27T09:59:28.115592+0000","last_became_peered":"2024-03-27T09:59:28.115592+0000","last_unstale":"2024-03-27T09:59:36.657738+0000","last_undegraded":"2024-03-27T09:59:36.657738+0000","last_fullsized":"2024-03-27T09:59:36.657738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:23:46.050666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.658425+0000","last_change":"2024-03-27T09:59:33.224089+0000","last_active":"2024-03-27T09:59:36.658425+0000","last_peered":"2024-03-27T09:59:36.658425+0000","last_clean":"2024-03-27T09:59:36.658425+0000","last_became_active":"2024-03-27T09:59:33.223558+0000","last_became_peered":"2024-03-27T09:59:33.223558+0000","last_unstale":"2024-03-27T09:59:36.658425+0000","last_undegraded":"2024-03-27T09:59:36.658425+0000","last_fullsized":"2024-03-27T09:59:36.658425+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:45:04.448005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.233512+0000","last_change":"2024-03-27T09:59:29.161017+0000","last_active":"2024-03-27T09:59:35.233512+0000","last_peered":"2024-03-27T09:59:35.233512+0000","last_clean":"2024-03-27T09:59:35.233512+0000","last_became_active":"2024-03-27T09:59:29.160567+0000","last_became_peered":"2024-03-27T09:59:29.160567+0000","last_unstale":"2024-03-27T09:59:35.233512+0000","last_undegraded":"2024-03-27T09:59:35.233512+0000","last_fullsized":"2024-03-27T09:59:35.233512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:55:34.318236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.231117+0000","last_change":"2024-03-27T09:59:28.124425+0000","last_active":"2024-03-27T09:59:35.231117+0000","last_peered":"2024-03-27T09:59:35.231117+0000","last_clean":"2024-03-27T09:59:35.231117+0000","last_became_active":"2024-03-27T09:59:28.123984+0000","last_became_peered":"2024-03-27T09:59:28.123984+0000","last_unstale":"2024-03-27T09:59:35.231117+0000","last_undegraded":"2024-03-27T09:59:35.231117+0000","last_fullsized":"2024-03-27T09:59:35.231117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:23:46.050666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.660006+0000","last_change":"2024-03-27T09:59:33.226956+0000","last_active":"2024-03-27T09:59:36.660006+0000","last_peered":"2024-03-27T09:59:36.660006+0000","last_clean":"2024-03-27T09:59:36.660006+0000","last_became_active":"2024-03-27T09:59:33.223863+0000","last_became_peered":"2024-03-27T09:59:33.223863+0000","last_unstale":"2024-03-27T09:59:36.660006+0000","last_undegraded":"2024-03-27T09:59:36.660006+0000","last_fullsized":"2024-03-27T09:59:36.660006+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:26:40.882057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.658826+0000","last_change":"2024-03-27T09:59:29.155035+0000","last_active":"2024-03-27T09:59:36.658826+0000","last_peered":"2024-03-27T09:59:36.658826+0000","last_clean":"2024-03-27T09:59:36.658826+0000","last_became_active":"2024-03-27T09:59:29.154671+0000","last_became_peered":"2024-03-27T09:59:29.154671+0000","last_unstale":"2024-03-27T09:59:36.658826+0000","last_undegraded":"2024-03-27T09:59:36.658826+0000","last_fullsized":"2024-03-27T09:59:36.658826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:45:14.005415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.791187+0000","last_change":"2024-03-27T09:59:28.121148+0000","last_active":"2024-03-27T09:59:36.791187+0000","last_peered":"2024-03-27T09:59:36.791187+0000","last_clean":"2024-03-27T09:59:36.791187+0000","last_became_active":"2024-03-27T09:59:28.120840+0000","last_became_peered":"2024-03-27T09:59:28.120840+0000","last_unstale":"2024-03-27T09:59:36.791187+0000","last_undegraded":"2024-03-27T09:59:36.791187+0000","last_fullsized":"2024-03-27T09:59:36.791187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:40:42.254670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.660494+0000","last_change":"2024-03-27T09:59:33.229618+0000","last_active":"2024-03-27T09:59:36.660494+0000","last_peered":"2024-03-27T09:59:36.660494+0000","last_clean":"2024-03-27T09:59:36.660494+0000","last_became_active":"2024-03-27T09:59:33.228741+0000","last_became_peered":"2024-03-27T09:59:33.228741+0000","last_unstale":"2024-03-27T09:59:36.660494+0000","last_undegraded":"2024-03-27T09:59:36.660494+0000","last_fullsized":"2024-03-27T09:59:36.660494+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T21:18:02.752241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.797279+0000","last_change":"2024-03-27T09:59:29.156381+0000","last_active":"2024-03-27T09:59:35.797279+0000","last_peered":"2024-03-27T09:59:35.797279+0000","last_clean":"2024-03-27T09:59:35.797279+0000","last_became_active":"2024-03-27T09:59:29.156084+0000","last_became_peered":"2024-03-27T09:59:29.156084+0000","last_unstale":"2024-03-27T09:59:35.797279+0000","last_undegraded":"2024-03-27T09:59:35.797279+0000","last_fullsized":"2024-03-27T09:59:35.797279+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:31:01.574841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.727058+0000","last_change":"2024-03-27T09:59:28.130798+0000","last_active":"2024-03-27T09:59:36.727058+0000","last_peered":"2024-03-27T09:59:36.727058+0000","last_clean":"2024-03-27T09:59:36.727058+0000","last_became_active":"2024-03-27T09:59:28.130023+0000","last_became_peered":"2024-03-27T09:59:28.130023+0000","last_unstale":"2024-03-27T09:59:36.727058+0000","last_undegraded":"2024-03-27T09:59:36.727058+0000","last_fullsized":"2024-03-27T09:59:36.727058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:20:35.358265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.798067+0000","last_change":"2024-03-27T09:59:33.708547+0000","last_active":"2024-03-27T09:59:35.798067+0000","last_peered":"2024-03-27T09:59:35.798067+0000","last_clean":"2024-03-27T09:59:35.798067+0000","last_became_active":"2024-03-27T09:59:33.707071+0000","last_became_peered":"2024-03-27T09:59:33.707071+0000","last_unstale":"2024-03-27T09:59:35.798067+0000","last_undegraded":"2024-03-27T09:59:35.798067+0000","last_fullsized":"2024-03-27T09:59:35.798067+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:58:34.321312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.599551+0000","last_change":"2024-03-27T09:59:29.149027+0000","last_active":"2024-03-27T09:59:35.599551+0000","last_peered":"2024-03-27T09:59:35.599551+0000","last_clean":"2024-03-27T09:59:35.599551+0000","last_became_active":"2024-03-27T09:59:29.148746+0000","last_became_peered":"2024-03-27T09:59:29.148746+0000","last_unstale":"2024-03-27T09:59:35.599551+0000","last_undegraded":"2024-03-27T09:59:35.599551+0000","last_fullsized":"2024-03-27T09:59:35.599551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:20:50.555376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.232120+0000","last_change":"2024-03-27T09:59:28.126435+0000","last_active":"2024-03-27T09:59:35.232120+0000","last_peered":"2024-03-27T09:59:35.232120+0000","last_clean":"2024-03-27T09:59:35.232120+0000","last_became_active":"2024-03-27T09:59:28.126154+0000","last_became_peered":"2024-03-27T09:59:28.126154+0000","last_unstale":"2024-03-27T09:59:35.232120+0000","last_undegraded":"2024-03-27T09:59:35.232120+0000","last_fullsized":"2024-03-27T09:59:35.232120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:20:35.358265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":180,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.727156+0000","last_change":"2024-03-27T09:59:19.234906+0000","last_active":"2024-03-27T09:59:36.727156+0000","last_peered":"2024-03-27T09:59:36.727156+0000","last_clean":"2024-03-27T09:59:36.727156+0000","last_became_active":"2024-03-27T09:59:19.234124+0000","last_became_peered":"2024-03-27T09:59:19.234124+0000","last_unstale":"2024-03-27T09:59:36.727156+0000","last_undegraded":"2024-03-27T09:59:36.727156+0000","last_fullsized":"2024-03-27T09:59:36.727156+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:17.974760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:17.974760+0000","last_clean_scrub_stamp":"2024-03-27T09:59:17.974760+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:24:35.357325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.230468+0000","last_change":"2024-03-27T09:59:33.707287+0000","last_active":"2024-03-27T09:59:35.230468+0000","last_peered":"2024-03-27T09:59:35.230468+0000","last_clean":"2024-03-27T09:59:35.230468+0000","last_became_active":"2024-03-27T09:59:33.706791+0000","last_became_peered":"2024-03-27T09:59:33.706791+0000","last_unstale":"2024-03-27T09:59:35.230468+0000","last_undegraded":"2024-03-27T09:59:35.230468+0000","last_fullsized":"2024-03-27T09:59:35.230468+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:03:49.254833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.728483+0000","last_change":"2024-03-27T09:59:29.150091+0000","last_active":"2024-03-27T09:59:36.728483+0000","last_peered":"2024-03-27T09:59:36.728483+0000","last_clean":"2024-03-27T09:59:36.728483+0000","last_became_active":"2024-03-27T09:59:29.149700+0000","last_became_peered":"2024-03-27T09:59:29.149700+0000","last_unstale":"2024-03-27T09:59:36.728483+0000","last_undegraded":"2024-03-27T09:59:36.728483+0000","last_fullsized":"2024-03-27T09:59:36.728483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:25:26.474648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.791238+0000","last_change":"2024-03-27T09:59:28.126811+0000","last_active":"2024-03-27T09:59:36.791238+0000","last_peered":"2024-03-27T09:59:36.791238+0000","last_clean":"2024-03-27T09:59:36.791238+0000","last_became_active":"2024-03-27T09:59:28.126359+0000","last_became_peered":"2024-03-27T09:59:28.126359+0000","last_unstale":"2024-03-27T09:59:36.791238+0000","last_undegraded":"2024-03-27T09:59:36.791238+0000","last_fullsized":"2024-03-27T09:59:36.791238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:35:50.131290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.231647+0000","last_change":"2024-03-27T09:59:33.699402+0000","last_active":"2024-03-27T09:59:35.231647+0000","last_peered":"2024-03-27T09:59:35.231647+0000","last_clean":"2024-03-27T09:59:35.231647+0000","last_became_active":"2024-03-27T09:59:33.697898+0000","last_became_peered":"2024-03-27T09:59:33.697898+0000","last_unstale":"2024-03-27T09:59:35.231647+0000","last_undegraded":"2024-03-27T09:59:35.231647+0000","last_fullsized":"2024-03-27T09:59:35.231647+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:07:54.369342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.231265+0000","last_change":"2024-03-27T09:59:29.148952+0000","last_active":"2024-03-27T09:59:35.231265+0000","last_peered":"2024-03-27T09:59:35.231265+0000","last_clean":"2024-03-27T09:59:35.231265+0000","last_became_active":"2024-03-27T09:59:29.148176+0000","last_became_peered":"2024-03-27T09:59:29.148176+0000","last_unstale":"2024-03-27T09:59:35.231265+0000","last_undegraded":"2024-03-27T09:59:35.231265+0000","last_fullsized":"2024-03-27T09:59:35.231265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T20:25:54.732855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.657787+0000","last_change":"2024-03-27T09:59:28.126237+0000","last_active":"2024-03-27T09:59:36.657787+0000","last_peered":"2024-03-27T09:59:36.657787+0000","last_clean":"2024-03-27T09:59:36.657787+0000","last_became_active":"2024-03-27T09:59:28.125955+0000","last_became_peered":"2024-03-27T09:59:28.125955+0000","last_unstale":"2024-03-27T09:59:36.657787+0000","last_undegraded":"2024-03-27T09:59:36.657787+0000","last_fullsized":"2024-03-27T09:59:36.657787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:55:33.304260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.797749+0000","last_change":"2024-03-27T09:59:33.223667+0000","last_active":"2024-03-27T09:59:35.797749+0000","last_peered":"2024-03-27T09:59:35.797749+0000","last_clean":"2024-03-27T09:59:35.797749+0000","last_became_active":"2024-03-27T09:59:33.223275+0000","last_became_peered":"2024-03-27T09:59:33.223275+0000","last_unstale":"2024-03-27T09:59:35.797749+0000","last_undegraded":"2024-03-27T09:59:35.797749+0000","last_fullsized":"2024-03-27T09:59:35.797749+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T21:18:02.752241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.729264+0000","last_change":"2024-03-27T09:59:29.159775+0000","last_active":"2024-03-27T09:59:36.729264+0000","last_peered":"2024-03-27T09:59:36.729264+0000","last_clean":"2024-03-27T09:59:36.729264+0000","last_became_active":"2024-03-27T09:59:29.159484+0000","last_became_peered":"2024-03-27T09:59:29.159484+0000","last_unstale":"2024-03-27T09:59:36.729264+0000","last_undegraded":"2024-03-27T09:59:36.729264+0000","last_fullsized":"2024-03-27T09:59:36.729264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:03:45.164612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.791343+0000","last_change":"2024-03-27T09:59:28.121073+0000","last_active":"2024-03-27T09:59:36.791343+0000","last_peered":"2024-03-27T09:59:36.791343+0000","last_clean":"2024-03-27T09:59:36.791343+0000","last_became_active":"2024-03-27T09:59:28.120712+0000","last_became_peered":"2024-03-27T09:59:28.120712+0000","last_unstale":"2024-03-27T09:59:36.791343+0000","last_undegraded":"2024-03-27T09:59:36.791343+0000","last_fullsized":"2024-03-27T09:59:36.791343+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:13:29.201574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.230245+0000","last_change":"2024-03-27T09:59:33.707551+0000","last_active":"2024-03-27T09:59:35.230245+0000","last_peered":"2024-03-27T09:59:35.230245+0000","last_clean":"2024-03-27T09:59:35.230245+0000","last_became_active":"2024-03-27T09:59:33.702666+0000","last_became_peered":"2024-03-27T09:59:33.702666+0000","last_unstale":"2024-03-27T09:59:35.230245+0000","last_undegraded":"2024-03-27T09:59:35.230245+0000","last_fullsized":"2024-03-27T09:59:35.230245+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T21:18:02.752241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.728829+0000","last_change":"2024-03-27T09:59:29.165375+0000","last_active":"2024-03-27T09:59:36.728829+0000","last_peered":"2024-03-27T09:59:36.728829+0000","last_clean":"2024-03-27T09:59:36.728829+0000","last_became_active":"2024-03-27T09:59:29.164965+0000","last_became_peered":"2024-03-27T09:59:29.164965+0000","last_unstale":"2024-03-27T09:59:36.728829+0000","last_undegraded":"2024-03-27T09:59:36.728829+0000","last_fullsized":"2024-03-27T09:59:36.728829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:07:50.279121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.233583+0000","last_change":"2024-03-27T09:59:28.126548+0000","last_active":"2024-03-27T09:59:35.233583+0000","last_peered":"2024-03-27T09:59:35.233583+0000","last_clean":"2024-03-27T09:59:35.233583+0000","last_became_active":"2024-03-27T09:59:28.125963+0000","last_became_peered":"2024-03-27T09:59:28.125963+0000","last_unstale":"2024-03-27T09:59:35.233583+0000","last_undegraded":"2024-03-27T09:59:35.233583+0000","last_fullsized":"2024-03-27T09:59:35.233583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:59:55.319685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.228379+0000","last_change":"2024-03-27T09:59:33.220384+0000","last_active":"2024-03-27T09:59:35.228379+0000","last_peered":"2024-03-27T09:59:35.228379+0000","last_clean":"2024-03-27T09:59:35.228379+0000","last_became_active":"2024-03-27T09:59:33.219238+0000","last_became_peered":"2024-03-27T09:59:33.219238+0000","last_unstale":"2024-03-27T09:59:35.228379+0000","last_undegraded":"2024-03-27T09:59:35.228379+0000","last_fullsized":"2024-03-27T09:59:35.228379+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:03:34.498032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.727816+0000","last_change":"2024-03-27T09:59:29.159404+0000","last_active":"2024-03-27T09:59:36.727816+0000","last_peered":"2024-03-27T09:59:36.727816+0000","last_clean":"2024-03-27T09:59:36.727816+0000","last_became_active":"2024-03-27T09:59:29.159116+0000","last_became_peered":"2024-03-27T09:59:29.159116+0000","last_unstale":"2024-03-27T09:59:36.727816+0000","last_undegraded":"2024-03-27T09:59:36.727816+0000","last_fullsized":"2024-03-27T09:59:36.727816+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T20:51:12.586643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.791612+0000","last_change":"2024-03-27T09:59:28.130732+0000","last_active":"2024-03-27T09:59:36.791612+0000","last_peered":"2024-03-27T09:59:36.791612+0000","last_clean":"2024-03-27T09:59:36.791612+0000","last_became_active":"2024-03-27T09:59:28.128808+0000","last_became_peered":"2024-03-27T09:59:28.128808+0000","last_unstale":"2024-03-27T09:59:36.791612+0000","last_undegraded":"2024-03-27T09:59:36.791612+0000","last_fullsized":"2024-03-27T09:59:36.791612+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:23:46.050666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.798116+0000","last_change":"2024-03-27T09:59:33.208864+0000","last_active":"2024-03-27T09:59:35.798116+0000","last_peered":"2024-03-27T09:59:35.798116+0000","last_clean":"2024-03-27T09:59:35.798116+0000","last_became_active":"2024-03-27T09:59:33.208354+0000","last_became_peered":"2024-03-27T09:59:33.208354+0000","last_unstale":"2024-03-27T09:59:35.798116+0000","last_undegraded":"2024-03-27T09:59:35.798116+0000","last_fullsized":"2024-03-27T09:59:35.798116+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T20:00:16.571694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.229822+0000","last_change":"2024-03-27T09:59:29.158524+0000","last_active":"2024-03-27T09:59:35.229822+0000","last_peered":"2024-03-27T09:59:35.229822+0000","last_clean":"2024-03-27T09:59:35.229822+0000","last_became_active":"2024-03-27T09:59:29.157925+0000","last_became_peered":"2024-03-27T09:59:29.157925+0000","last_unstale":"2024-03-27T09:59:35.229822+0000","last_undegraded":"2024-03-27T09:59:35.229822+0000","last_fullsized":"2024-03-27T09:59:35.229822+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:53:03.077046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.231047+0000","last_change":"2024-03-27T09:59:28.115802+0000","last_active":"2024-03-27T09:59:35.231047+0000","last_peered":"2024-03-27T09:59:35.231047+0000","last_clean":"2024-03-27T09:59:35.231047+0000","last_became_active":"2024-03-27T09:59:28.115435+0000","last_became_peered":"2024-03-27T09:59:28.115435+0000","last_unstale":"2024-03-27T09:59:35.231047+0000","last_undegraded":"2024-03-27T09:59:35.231047+0000","last_fullsized":"2024-03-27T09:59:35.231047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:40:42.254670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.600958+0000","last_change":"2024-03-27T09:59:33.706037+0000","last_active":"2024-03-27T09:59:35.600958+0000","last_peered":"2024-03-27T09:59:35.600958+0000","last_clean":"2024-03-27T09:59:35.600958+0000","last_became_active":"2024-03-27T09:59:33.705650+0000","last_became_peered":"2024-03-27T09:59:33.705650+0000","last_unstale":"2024-03-27T09:59:35.600958+0000","last_undegraded":"2024-03-27T09:59:35.600958+0000","last_fullsized":"2024-03-27T09:59:35.600958+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:02:05.101162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.728065+0000","last_change":"2024-03-27T09:59:29.160438+0000","last_active":"2024-03-27T09:59:36.728065+0000","last_peered":"2024-03-27T09:59:36.728065+0000","last_clean":"2024-03-27T09:59:36.728065+0000","last_became_active":"2024-03-27T09:59:29.160087+0000","last_became_peered":"2024-03-27T09:59:29.160087+0000","last_unstale":"2024-03-27T09:59:36.728065+0000","last_undegraded":"2024-03-27T09:59:36.728065+0000","last_fullsized":"2024-03-27T09:59:36.728065+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:00:09.092063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.231089+0000","last_change":"2024-03-27T09:59:28.118112+0000","last_active":"2024-03-27T09:59:35.231089+0000","last_peered":"2024-03-27T09:59:35.231089+0000","last_clean":"2024-03-27T09:59:35.231089+0000","last_became_active":"2024-03-27T09:59:28.117828+0000","last_became_peered":"2024-03-27T09:59:28.117828+0000","last_unstale":"2024-03-27T09:59:35.231089+0000","last_undegraded":"2024-03-27T09:59:35.231089+0000","last_fullsized":"2024-03-27T09:59:35.231089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:13:29.201574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.599830+0000","last_change":"2024-03-27T09:59:33.700858+0000","last_active":"2024-03-27T09:59:35.599830+0000","last_peered":"2024-03-27T09:59:35.599830+0000","last_clean":"2024-03-27T09:59:35.599830+0000","last_became_active":"2024-03-27T09:59:33.700373+0000","last_became_peered":"2024-03-27T09:59:33.700373+0000","last_unstale":"2024-03-27T09:59:35.599830+0000","last_undegraded":"2024-03-27T09:59:35.599830+0000","last_fullsized":"2024-03-27T09:59:35.599830+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:25:25.072673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.798196+0000","last_change":"2024-03-27T09:59:29.169989+0000","last_active":"2024-03-27T09:59:35.798196+0000","last_peered":"2024-03-27T09:59:35.798196+0000","last_clean":"2024-03-27T09:59:35.798196+0000","last_became_active":"2024-03-27T09:59:29.169681+0000","last_became_peered":"2024-03-27T09:59:29.169681+0000","last_unstale":"2024-03-27T09:59:35.798196+0000","last_undegraded":"2024-03-27T09:59:35.798196+0000","last_fullsized":"2024-03-27T09:59:35.798196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:16:28.449509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.798374+0000","last_change":"2024-03-27T09:59:28.129054+0000","last_active":"2024-03-27T09:59:35.798374+0000","last_peered":"2024-03-27T09:59:35.798374+0000","last_clean":"2024-03-27T09:59:35.798374+0000","last_became_active":"2024-03-27T09:59:28.128808+0000","last_became_peered":"2024-03-27T09:59:28.128808+0000","last_unstale":"2024-03-27T09:59:35.798374+0000","last_undegraded":"2024-03-27T09:59:35.798374+0000","last_fullsized":"2024-03-27T09:59:35.798374+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:03:46.932809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.232702+0000","last_change":"2024-03-27T09:59:33.703875+0000","last_active":"2024-03-27T09:59:35.232702+0000","last_peered":"2024-03-27T09:59:35.232702+0000","last_clean":"2024-03-27T09:59:35.232702+0000","last_became_active":"2024-03-27T09:59:33.702585+0000","last_became_peered":"2024-03-27T09:59:33.702585+0000","last_unstale":"2024-03-27T09:59:35.232702+0000","last_undegraded":"2024-03-27T09:59:35.232702+0000","last_fullsized":"2024-03-27T09:59:35.232702+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:58:34.321312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.728323+0000","last_change":"2024-03-27T09:59:29.158099+0000","last_active":"2024-03-27T09:59:36.728323+0000","last_peered":"2024-03-27T09:59:36.728323+0000","last_clean":"2024-03-27T09:59:36.728323+0000","last_became_active":"2024-03-27T09:59:29.157758+0000","last_became_peered":"2024-03-27T09:59:29.157758+0000","last_unstale":"2024-03-27T09:59:36.728323+0000","last_undegraded":"2024-03-27T09:59:36.728323+0000","last_fullsized":"2024-03-27T09:59:36.728323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:01:42.254664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'10","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:47.450737+0000","last_change":"2024-03-27T09:59:28.113383+0000","last_active":"2024-03-27T09:59:47.450737+0000","last_peered":"2024-03-27T09:59:47.450737+0000","last_clean":"2024-03-27T09:59:47.450737+0000","last_became_active":"2024-03-27T09:59:28.113082+0000","last_became_peered":"2024-03-27T09:59:28.113082+0000","last_unstale":"2024-03-27T09:59:47.450737+0000","last_undegraded":"2024-03-27T09:59:47.450737+0000","last_fullsized":"2024-03-27T09:59:47.450737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:13:29.201574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.659224+0000","last_change":"2024-03-27T09:59:33.216434+0000","last_active":"2024-03-27T09:59:36.659224+0000","last_peered":"2024-03-27T09:59:36.659224+0000","last_clean":"2024-03-27T09:59:36.659224+0000","last_became_active":"2024-03-27T09:59:33.215962+0000","last_became_peered":"2024-03-27T09:59:33.215962+0000","last_unstale":"2024-03-27T09:59:36.659224+0000","last_undegraded":"2024-03-27T09:59:36.659224+0000","last_fullsized":"2024-03-27T09:59:36.659224+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:21:56.509459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.233348+0000","last_change":"2024-03-27T09:59:29.148504+0000","last_active":"2024-03-27T09:59:35.233348+0000","last_peered":"2024-03-27T09:59:35.233348+0000","last_clean":"2024-03-27T09:59:35.233348+0000","last_became_active":"2024-03-27T09:59:29.148235+0000","last_became_peered":"2024-03-27T09:59:29.148235+0000","last_unstale":"2024-03-27T09:59:35.233348+0000","last_undegraded":"2024-03-27T09:59:35.233348+0000","last_fullsized":"2024-03-27T09:59:35.233348+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T12:53:31.902336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.657788+0000","last_change":"2024-03-27T09:59:28.119784+0000","last_active":"2024-03-27T09:59:36.657788+0000","last_peered":"2024-03-27T09:59:36.657788+0000","last_clean":"2024-03-27T09:59:36.657788+0000","last_became_active":"2024-03-27T09:59:28.119487+0000","last_became_peered":"2024-03-27T09:59:28.119487+0000","last_unstale":"2024-03-27T09:59:36.657788+0000","last_undegraded":"2024-03-27T09:59:36.657788+0000","last_fullsized":"2024-03-27T09:59:36.657788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:20:35.358265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.233153+0000","last_change":"2024-03-27T09:59:33.225724+0000","last_active":"2024-03-27T09:59:35.233153+0000","last_peered":"2024-03-27T09:59:35.233153+0000","last_clean":"2024-03-27T09:59:35.233153+0000","last_became_active":"2024-03-27T09:59:33.224979+0000","last_became_peered":"2024-03-27T09:59:33.224979+0000","last_unstale":"2024-03-27T09:59:35.233153+0000","last_undegraded":"2024-03-27T09:59:35.233153+0000","last_fullsized":"2024-03-27T09:59:35.233153+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:26:40.882057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.798367+0000","last_change":"2024-03-27T09:59:29.154101+0000","last_active":"2024-03-27T09:59:35.798367+0000","last_peered":"2024-03-27T09:59:35.798367+0000","last_clean":"2024-03-27T09:59:35.798367+0000","last_became_active":"2024-03-27T09:59:29.152850+0000","last_became_peered":"2024-03-27T09:59:29.152850+0000","last_unstale":"2024-03-27T09:59:35.798367+0000","last_undegraded":"2024-03-27T09:59:35.798367+0000","last_fullsized":"2024-03-27T09:59:35.798367+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T20:48:05.564784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.231860+0000","last_change":"2024-03-27T09:59:28.114582+0000","last_active":"2024-03-27T09:59:35.231860+0000","last_peered":"2024-03-27T09:59:35.231860+0000","last_clean":"2024-03-27T09:59:35.231860+0000","last_became_active":"2024-03-27T09:59:28.114287+0000","last_became_peered":"2024-03-27T09:59:28.114287+0000","last_unstale":"2024-03-27T09:59:35.231860+0000","last_undegraded":"2024-03-27T09:59:35.231860+0000","last_fullsized":"2024-03-27T09:59:35.231860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:55:33.304260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.599079+0000","last_change":"2024-03-27T09:59:33.225015+0000","last_active":"2024-03-27T09:59:35.599079+0000","last_peered":"2024-03-27T09:59:35.599079+0000","last_clean":"2024-03-27T09:59:35.599079+0000","last_became_active":"2024-03-27T09:59:33.224660+0000","last_became_peered":"2024-03-27T09:59:33.224660+0000","last_unstale":"2024-03-27T09:59:35.599079+0000","last_undegraded":"2024-03-27T09:59:35.599079+0000","last_fullsized":"2024-03-27T09:59:35.599079+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:22:38.863947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.231769+0000","last_change":"2024-03-27T09:59:29.168539+0000","last_active":"2024-03-27T09:59:35.231769+0000","last_peered":"2024-03-27T09:59:35.231769+0000","last_clean":"2024-03-27T09:59:35.231769+0000","last_became_active":"2024-03-27T09:59:29.168233+0000","last_became_peered":"2024-03-27T09:59:29.168233+0000","last_unstale":"2024-03-27T09:59:35.231769+0000","last_undegraded":"2024-03-27T09:59:35.231769+0000","last_fullsized":"2024-03-27T09:59:35.231769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:25:26.474648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.232327+0000","last_change":"2024-03-27T09:59:28.118980+0000","last_active":"2024-03-27T09:59:35.232327+0000","last_peered":"2024-03-27T09:59:35.232327+0000","last_clean":"2024-03-27T09:59:35.232327+0000","last_became_active":"2024-03-27T09:59:28.118617+0000","last_became_peered":"2024-03-27T09:59:28.118617+0000","last_unstale":"2024-03-27T09:59:35.232327+0000","last_undegraded":"2024-03-27T09:59:35.232327+0000","last_fullsized":"2024-03-27T09:59:35.232327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:20:35.358265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.599375+0000","last_change":"2024-03-27T09:59:33.703257+0000","last_active":"2024-03-27T09:59:35.599375+0000","last_peered":"2024-03-27T09:59:35.599375+0000","last_clean":"2024-03-27T09:59:35.599375+0000","last_became_active":"2024-03-27T09:59:33.702264+0000","last_became_peered":"2024-03-27T09:59:33.702264+0000","last_unstale":"2024-03-27T09:59:35.599375+0000","last_undegraded":"2024-03-27T09:59:35.599375+0000","last_fullsized":"2024-03-27T09:59:35.599375+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:04:06.406267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.797590+0000","last_change":"2024-03-27T09:59:33.707371+0000","last_active":"2024-03-27T09:59:35.797590+0000","last_peered":"2024-03-27T09:59:35.797590+0000","last_clean":"2024-03-27T09:59:35.797590+0000","last_became_active":"2024-03-27T09:59:33.706609+0000","last_became_peered":"2024-03-27T09:59:33.706609+0000","last_unstale":"2024-03-27T09:59:35.797590+0000","last_undegraded":"2024-03-27T09:59:35.797590+0000","last_fullsized":"2024-03-27T09:59:35.797590+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:06:12.744793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.658398+0000","last_change":"2024-03-27T09:59:29.150732+0000","last_active":"2024-03-27T09:59:36.658398+0000","last_peered":"2024-03-27T09:59:36.658398+0000","last_clean":"2024-03-27T09:59:36.658398+0000","last_became_active":"2024-03-27T09:59:29.147814+0000","last_became_peered":"2024-03-27T09:59:29.147814+0000","last_unstale":"2024-03-27T09:59:36.658398+0000","last_undegraded":"2024-03-27T09:59:36.658398+0000","last_fullsized":"2024-03-27T09:59:36.658398+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:40:55.546423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.230076+0000","last_change":"2024-03-27T09:59:28.121927+0000","last_active":"2024-03-27T09:59:35.230076+0000","last_peered":"2024-03-27T09:59:35.230076+0000","last_clean":"2024-03-27T09:59:35.230076+0000","last_became_active":"2024-03-27T09:59:28.121549+0000","last_became_peered":"2024-03-27T09:59:28.121549+0000","last_unstale":"2024-03-27T09:59:35.230076+0000","last_undegraded":"2024-03-27T09:59:35.230076+0000","last_fullsized":"2024-03-27T09:59:35.230076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:40:42.254670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.232144+0000","last_change":"2024-03-27T09:59:33.224491+0000","last_active":"2024-03-27T09:59:35.232144+0000","last_peered":"2024-03-27T09:59:35.232144+0000","last_clean":"2024-03-27T09:59:35.232144+0000","last_became_active":"2024-03-27T09:59:33.223841+0000","last_became_peered":"2024-03-27T09:59:33.223841+0000","last_unstale":"2024-03-27T09:59:35.232144+0000","last_undegraded":"2024-03-27T09:59:35.232144+0000","last_fullsized":"2024-03-27T09:59:35.232144+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:02:21.892888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.599193+0000","last_change":"2024-03-27T09:59:29.161642+0000","last_active":"2024-03-27T09:59:35.599193+0000","last_peered":"2024-03-27T09:59:35.599193+0000","last_clean":"2024-03-27T09:59:35.599193+0000","last_became_active":"2024-03-27T09:59:29.155700+0000","last_became_peered":"2024-03-27T09:59:29.155700+0000","last_unstale":"2024-03-27T09:59:35.599193+0000","last_undegraded":"2024-03-27T09:59:35.599193+0000","last_fullsized":"2024-03-27T09:59:35.599193+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T21:36:52.561523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.599835+0000","last_change":"2024-03-27T09:59:28.111747+0000","last_active":"2024-03-27T09:59:35.599835+0000","last_peered":"2024-03-27T09:59:35.599835+0000","last_clean":"2024-03-27T09:59:35.599835+0000","last_became_active":"2024-03-27T09:59:28.111334+0000","last_became_peered":"2024-03-27T09:59:28.111334+0000","last_unstale":"2024-03-27T09:59:35.599835+0000","last_undegraded":"2024-03-27T09:59:35.599835+0000","last_fullsized":"2024-03-27T09:59:35.599835+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:35:50.131290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.232266+0000","last_change":"2024-03-27T09:59:28.115303+0000","last_active":"2024-03-27T09:59:35.232266+0000","last_peered":"2024-03-27T09:59:35.232266+0000","last_clean":"2024-03-27T09:59:35.232266+0000","last_became_active":"2024-03-27T09:59:28.113900+0000","last_became_peered":"2024-03-27T09:59:28.113900+0000","last_unstale":"2024-03-27T09:59:35.232266+0000","last_undegraded":"2024-03-27T09:59:35.232266+0000","last_fullsized":"2024-03-27T09:59:35.232266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:23:46.050666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.797870+0000","last_change":"2024-03-27T09:59:29.157943+0000","last_active":"2024-03-27T09:59:35.797870+0000","last_peered":"2024-03-27T09:59:35.797870+0000","last_clean":"2024-03-27T09:59:35.797870+0000","last_became_active":"2024-03-27T09:59:29.157663+0000","last_became_peered":"2024-03-27T09:59:29.157663+0000","last_unstale":"2024-03-27T09:59:35.797870+0000","last_undegraded":"2024-03-27T09:59:35.797870+0000","last_fullsized":"2024-03-27T09:59:35.797870+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:20:50.555376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.792577+0000","last_change":"2024-03-27T09:59:33.219540+0000","last_active":"2024-03-27T09:59:36.792577+0000","last_peered":"2024-03-27T09:59:36.792577+0000","last_clean":"2024-03-27T09:59:36.792577+0000","last_became_active":"2024-03-27T09:59:33.219085+0000","last_became_peered":"2024-03-27T09:59:33.219085+0000","last_unstale":"2024-03-27T09:59:36.792577+0000","last_undegraded":"2024-03-27T09:59:36.792577+0000","last_fullsized":"2024-03-27T09:59:36.792577+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:16:32.539730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.600218+0000","last_change":"2024-03-27T09:59:28.113237+0000","last_active":"2024-03-27T09:59:35.600218+0000","last_peered":"2024-03-27T09:59:35.600218+0000","last_clean":"2024-03-27T09:59:35.600218+0000","last_became_active":"2024-03-27T09:59:28.112995+0000","last_became_peered":"2024-03-27T09:59:28.112995+0000","last_unstale":"2024-03-27T09:59:35.600218+0000","last_undegraded":"2024-03-27T09:59:35.600218+0000","last_fullsized":"2024-03-27T09:59:35.600218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:03:46.932809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.229942+0000","last_change":"2024-03-27T09:59:29.142949+0000","last_active":"2024-03-27T09:59:35.229942+0000","last_peered":"2024-03-27T09:59:35.229942+0000","last_clean":"2024-03-27T09:59:35.229942+0000","last_became_active":"2024-03-27T09:59:29.142626+0000","last_became_peered":"2024-03-27T09:59:29.142626+0000","last_unstale":"2024-03-27T09:59:35.229942+0000","last_undegraded":"2024-03-27T09:59:35.229942+0000","last_fullsized":"2024-03-27T09:59:35.229942+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:20:36.372242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.600394+0000","last_change":"2024-03-27T09:59:33.226673+0000","last_active":"2024-03-27T09:59:35.600394+0000","last_peered":"2024-03-27T09:59:35.600394+0000","last_clean":"2024-03-27T09:59:35.600394+0000","last_became_active":"2024-03-27T09:59:33.226185+0000","last_became_peered":"2024-03-27T09:59:33.226185+0000","last_unstale":"2024-03-27T09:59:35.600394+0000","last_undegraded":"2024-03-27T09:59:35.600394+0000","last_fullsized":"2024-03-27T09:59:35.600394+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:17:46.912834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.229527+0000","last_change":"2024-03-27T09:59:29.159064+0000","last_active":"2024-03-27T09:59:35.229527+0000","last_peered":"2024-03-27T09:59:35.229527+0000","last_clean":"2024-03-27T09:59:35.229527+0000","last_became_active":"2024-03-27T09:59:29.158263+0000","last_became_peered":"2024-03-27T09:59:29.158263+0000","last_unstale":"2024-03-27T09:59:35.229527+0000","last_undegraded":"2024-03-27T09:59:35.229527+0000","last_fullsized":"2024-03-27T09:59:35.229527+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T21:36:52.561523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.791954+0000","last_change":"2024-03-27T09:59:29.148971+0000","last_active":"2024-03-27T09:59:36.791954+0000","last_peered":"2024-03-27T09:59:36.791954+0000","last_clean":"2024-03-27T09:59:36.791954+0000","last_became_active":"2024-03-27T09:59:29.148701+0000","last_became_peered":"2024-03-27T09:59:29.148701+0000","last_unstale":"2024-03-27T09:59:36.791954+0000","last_undegraded":"2024-03-27T09:59:36.791954+0000","last_fullsized":"2024-03-27T09:59:36.791954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T12:53:31.902336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.230981+0000","last_change":"2024-03-27T09:59:29.145218+0000","last_active":"2024-03-27T09:59:35.230981+0000","last_peered":"2024-03-27T09:59:35.230981+0000","last_clean":"2024-03-27T09:59:35.230981+0000","last_became_active":"2024-03-27T09:59:29.144927+0000","last_became_peered":"2024-03-27T09:59:29.144927+0000","last_unstale":"2024-03-27T09:59:35.230981+0000","last_undegraded":"2024-03-27T09:59:35.230981+0000","last_fullsized":"2024-03-27T09:59:35.230981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:12:08.142213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.797876+0000","last_change":"2024-03-27T09:59:29.155091+0000","last_active":"2024-03-27T09:59:35.797876+0000","last_peered":"2024-03-27T09:59:35.797876+0000","last_clean":"2024-03-27T09:59:35.797876+0000","last_became_active":"2024-03-27T09:59:29.153115+0000","last_became_peered":"2024-03-27T09:59:29.153115+0000","last_unstale":"2024-03-27T09:59:35.797876+0000","last_undegraded":"2024-03-27T09:59:35.797876+0000","last_fullsized":"2024-03-27T09:59:35.797876+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:40:55.546423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.600252+0000","last_change":"2024-03-27T09:59:29.139530+0000","last_active":"2024-03-27T09:59:35.600252+0000","last_peered":"2024-03-27T09:59:35.600252+0000","last_clean":"2024-03-27T09:59:35.600252+0000","last_became_active":"2024-03-27T09:59:29.135340+0000","last_became_peered":"2024-03-27T09:59:29.135340+0000","last_unstale":"2024-03-27T09:59:35.600252+0000","last_undegraded":"2024-03-27T09:59:35.600252+0000","last_fullsized":"2024-03-27T09:59:35.600252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T20:48:05.564784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.659487+0000","last_change":"2024-03-27T09:59:29.160480+0000","last_active":"2024-03-27T09:59:36.659487+0000","last_peered":"2024-03-27T09:59:36.659487+0000","last_clean":"2024-03-27T09:59:36.659487+0000","last_became_active":"2024-03-27T09:59:29.153116+0000","last_became_peered":"2024-03-27T09:59:29.153116+0000","last_unstale":"2024-03-27T09:59:36.659487+0000","last_undegraded":"2024-03-27T09:59:36.659487+0000","last_fullsized":"2024-03-27T09:59:36.659487+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:57:26.770369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.234256+0000","last_change":"2024-03-27T09:59:29.165741+0000","last_active":"2024-03-27T09:59:35.234256+0000","last_peered":"2024-03-27T09:59:35.234256+0000","last_clean":"2024-03-27T09:59:35.234256+0000","last_became_active":"2024-03-27T09:59:29.165448+0000","last_became_peered":"2024-03-27T09:59:29.165448+0000","last_unstale":"2024-03-27T09:59:35.234256+0000","last_undegraded":"2024-03-27T09:59:35.234256+0000","last_fullsized":"2024-03-27T09:59:35.234256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T20:48:05.564784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.601055+0000","last_change":"2024-03-27T09:59:29.128048+0000","last_active":"2024-03-27T09:59:35.601055+0000","last_peered":"2024-03-27T09:59:35.601055+0000","last_clean":"2024-03-27T09:59:35.601055+0000","last_became_active":"2024-03-27T09:59:29.127194+0000","last_became_peered":"2024-03-27T09:59:29.127194+0000","last_unstale":"2024-03-27T09:59:35.601055+0000","last_undegraded":"2024-03-27T09:59:35.601055+0000","last_fullsized":"2024-03-27T09:59:35.601055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T20:51:12.586643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.229823+0000","last_change":"2024-03-27T09:59:29.149715+0000","last_active":"2024-03-27T09:59:35.229823+0000","last_peered":"2024-03-27T09:59:35.229823+0000","last_clean":"2024-03-27T09:59:35.229823+0000","last_became_active":"2024-03-27T09:59:29.147816+0000","last_became_peered":"2024-03-27T09:59:29.147816+0000","last_unstale":"2024-03-27T09:59:35.229823+0000","last_undegraded":"2024-03-27T09:59:35.229823+0000","last_fullsized":"2024-03-27T09:59:35.229823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T20:48:05.564784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.599722+0000","last_change":"2024-03-27T09:59:29.127532+0000","last_active":"2024-03-27T09:59:35.599722+0000","last_peered":"2024-03-27T09:59:35.599722+0000","last_clean":"2024-03-27T09:59:35.599722+0000","last_became_active":"2024-03-27T09:59:29.126384+0000","last_became_peered":"2024-03-27T09:59:29.126384+0000","last_unstale":"2024-03-27T09:59:35.599722+0000","last_undegraded":"2024-03-27T09:59:35.599722+0000","last_fullsized":"2024-03-27T09:59:35.599722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:40:55.546423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.230828+0000","last_change":"2024-03-27T09:59:29.168460+0000","last_active":"2024-03-27T09:59:35.230828+0000","last_peered":"2024-03-27T09:59:35.230828+0000","last_clean":"2024-03-27T09:59:35.230828+0000","last_became_active":"2024-03-27T09:59:29.168082+0000","last_became_peered":"2024-03-27T09:59:29.168082+0000","last_unstale":"2024-03-27T09:59:35.230828+0000","last_undegraded":"2024-03-27T09:59:35.230828+0000","last_fullsized":"2024-03-27T09:59:35.230828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:00:09.092063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.797561+0000","last_change":"2024-03-27T09:59:29.169976+0000","last_active":"2024-03-27T09:59:35.797561+0000","last_peered":"2024-03-27T09:59:35.797561+0000","last_clean":"2024-03-27T09:59:35.797561+0000","last_became_active":"2024-03-27T09:59:29.169553+0000","last_became_peered":"2024-03-27T09:59:29.169553+0000","last_unstale":"2024-03-27T09:59:35.797561+0000","last_undegraded":"2024-03-27T09:59:35.797561+0000","last_fullsized":"2024-03-27T09:59:35.797561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T21:36:52.561523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.232376+0000","last_change":"2024-03-27T09:59:29.151159+0000","last_active":"2024-03-27T09:59:35.232376+0000","last_peered":"2024-03-27T09:59:35.232376+0000","last_clean":"2024-03-27T09:59:35.232376+0000","last_became_active":"2024-03-27T09:59:29.150521+0000","last_became_peered":"2024-03-27T09:59:29.150521+0000","last_unstale":"2024-03-27T09:59:35.232376+0000","last_undegraded":"2024-03-27T09:59:35.232376+0000","last_fullsized":"2024-03-27T09:59:35.232376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:20:50.555376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.728796+0000","last_change":"2024-03-27T09:59:29.159754+0000","last_active":"2024-03-27T09:59:36.728796+0000","last_peered":"2024-03-27T09:59:36.728796+0000","last_clean":"2024-03-27T09:59:36.728796+0000","last_became_active":"2024-03-27T09:59:29.159451+0000","last_became_peered":"2024-03-27T09:59:29.159451+0000","last_unstale":"2024-03-27T09:59:36.728796+0000","last_undegraded":"2024-03-27T09:59:36.728796+0000","last_fullsized":"2024-03-27T09:59:36.728796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:27:19.913918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.793121+0000","last_change":"2024-03-27T09:59:29.146745+0000","last_active":"2024-03-27T09:59:36.793121+0000","last_peered":"2024-03-27T09:59:36.793121+0000","last_clean":"2024-03-27T09:59:36.793121+0000","last_became_active":"2024-03-27T09:59:29.146399+0000","last_became_peered":"2024-03-27T09:59:29.146399+0000","last_unstale":"2024-03-27T09:59:36.793121+0000","last_undegraded":"2024-03-27T09:59:36.793121+0000","last_fullsized":"2024-03-27T09:59:36.793121+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:31:21.514709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.232127+0000","last_change":"2024-03-27T09:59:29.170756+0000","last_active":"2024-03-27T09:59:35.232127+0000","last_peered":"2024-03-27T09:59:35.232127+0000","last_clean":"2024-03-27T09:59:35.232127+0000","last_became_active":"2024-03-27T09:59:29.170483+0000","last_became_peered":"2024-03-27T09:59:29.170483+0000","last_unstale":"2024-03-27T09:59:35.232127+0000","last_undegraded":"2024-03-27T09:59:35.232127+0000","last_fullsized":"2024-03-27T09:59:35.232127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:01:42.254664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.229573+0000","last_change":"2024-03-27T09:59:29.156761+0000","last_active":"2024-03-27T09:59:35.229573+0000","last_peered":"2024-03-27T09:59:35.229573+0000","last_clean":"2024-03-27T09:59:35.229573+0000","last_became_active":"2024-03-27T09:59:29.156448+0000","last_became_peered":"2024-03-27T09:59:29.156448+0000","last_unstale":"2024-03-27T09:59:35.229573+0000","last_undegraded":"2024-03-27T09:59:35.229573+0000","last_fullsized":"2024-03-27T09:59:35.229573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:45:14.005415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.658573+0000","last_change":"2024-03-27T09:59:29.159241+0000","last_active":"2024-03-27T09:59:36.658573+0000","last_peered":"2024-03-27T09:59:36.658573+0000","last_clean":"2024-03-27T09:59:36.658573+0000","last_became_active":"2024-03-27T09:59:29.158935+0000","last_became_peered":"2024-03-27T09:59:29.158935+0000","last_unstale":"2024-03-27T09:59:36.658573+0000","last_undegraded":"2024-03-27T09:59:36.658573+0000","last_fullsized":"2024-03-27T09:59:36.658573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:53:03.077046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.798122+0000","last_change":"2024-03-27T09:59:29.150820+0000","last_active":"2024-03-27T09:59:35.798122+0000","last_peered":"2024-03-27T09:59:35.798122+0000","last_clean":"2024-03-27T09:59:35.798122+0000","last_became_active":"2024-03-27T09:59:29.150536+0000","last_became_peered":"2024-03-27T09:59:29.150536+0000","last_unstale":"2024-03-27T09:59:35.798122+0000","last_undegraded":"2024-03-27T09:59:35.798122+0000","last_fullsized":"2024-03-27T09:59:35.798122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:53:03.077046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.599935+0000","last_change":"2024-03-27T09:59:29.148510+0000","last_active":"2024-03-27T09:59:35.599935+0000","last_peered":"2024-03-27T09:59:35.599935+0000","last_clean":"2024-03-27T09:59:35.599935+0000","last_became_active":"2024-03-27T09:59:29.146776+0000","last_became_peered":"2024-03-27T09:59:29.146776+0000","last_unstale":"2024-03-27T09:59:35.599935+0000","last_undegraded":"2024-03-27T09:59:35.599935+0000","last_fullsized":"2024-03-27T09:59:35.599935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:45:14.005415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.233211+0000","last_change":"2024-03-27T09:59:29.149815+0000","last_active":"2024-03-27T09:59:35.233211+0000","last_peered":"2024-03-27T09:59:35.233211+0000","last_clean":"2024-03-27T09:59:35.233211+0000","last_became_active":"2024-03-27T09:59:29.147082+0000","last_became_peered":"2024-03-27T09:59:29.147082+0000","last_unstale":"2024-03-27T09:59:35.233211+0000","last_undegraded":"2024-03-27T09:59:35.233211+0000","last_fullsized":"2024-03-27T09:59:35.233211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:31:21.514709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.230648+0000","last_change":"2024-03-27T09:59:29.147375+0000","last_active":"2024-03-27T09:59:35.230648+0000","last_peered":"2024-03-27T09:59:35.230648+0000","last_clean":"2024-03-27T09:59:35.230648+0000","last_became_active":"2024-03-27T09:59:29.147012+0000","last_became_peered":"2024-03-27T09:59:29.147012+0000","last_unstale":"2024-03-27T09:59:35.230648+0000","last_undegraded":"2024-03-27T09:59:35.230648+0000","last_fullsized":"2024-03-27T09:59:35.230648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:40:55.546423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.234176+0000","last_change":"2024-03-27T09:59:29.156417+0000","last_active":"2024-03-27T09:59:35.234176+0000","last_peered":"2024-03-27T09:59:35.234176+0000","last_clean":"2024-03-27T09:59:35.234176+0000","last_became_active":"2024-03-27T09:59:29.156124+0000","last_became_peered":"2024-03-27T09:59:29.156124+0000","last_unstale":"2024-03-27T09:59:35.234176+0000","last_undegraded":"2024-03-27T09:59:35.234176+0000","last_fullsized":"2024-03-27T09:59:35.234176+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:45:14.005415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.729121+0000","last_change":"2024-03-27T09:59:29.169092+0000","last_active":"2024-03-27T09:59:36.729121+0000","last_peered":"2024-03-27T09:59:36.729121+0000","last_clean":"2024-03-27T09:59:36.729121+0000","last_became_active":"2024-03-27T09:59:29.168788+0000","last_became_peered":"2024-03-27T09:59:29.168788+0000","last_unstale":"2024-03-27T09:59:36.729121+0000","last_undegraded":"2024-03-27T09:59:36.729121+0000","last_fullsized":"2024-03-27T09:59:36.729121+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T20:25:54.732855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.598901+0000","last_change":"2024-03-27T09:59:29.157524+0000","last_active":"2024-03-27T09:59:35.598901+0000","last_peered":"2024-03-27T09:59:35.598901+0000","last_clean":"2024-03-27T09:59:35.598901+0000","last_became_active":"2024-03-27T09:59:29.153615+0000","last_became_peered":"2024-03-27T09:59:29.153615+0000","last_unstale":"2024-03-27T09:59:35.598901+0000","last_undegraded":"2024-03-27T09:59:35.598901+0000","last_fullsized":"2024-03-27T09:59:35.598901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:53:03.077046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.727620+0000","last_change":"2024-03-27T09:59:29.165201+0000","last_active":"2024-03-27T09:59:36.727620+0000","last_peered":"2024-03-27T09:59:36.727620+0000","last_clean":"2024-03-27T09:59:36.727620+0000","last_became_active":"2024-03-27T09:59:29.164845+0000","last_became_peered":"2024-03-27T09:59:29.164845+0000","last_unstale":"2024-03-27T09:59:36.727620+0000","last_undegraded":"2024-03-27T09:59:36.727620+0000","last_fullsized":"2024-03-27T09:59:36.727620+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:34:04.348561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.230702+0000","last_change":"2024-03-27T09:59:29.159124+0000","last_active":"2024-03-27T09:59:35.230702+0000","last_peered":"2024-03-27T09:59:35.230702+0000","last_clean":"2024-03-27T09:59:35.230702+0000","last_became_active":"2024-03-27T09:59:29.158654+0000","last_became_peered":"2024-03-27T09:59:29.158654+0000","last_unstale":"2024-03-27T09:59:35.230702+0000","last_undegraded":"2024-03-27T09:59:35.230702+0000","last_fullsized":"2024-03-27T09:59:35.230702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:34:04.348561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.727714+0000","last_change":"2024-03-27T09:59:29.150329+0000","last_active":"2024-03-27T09:59:36.727714+0000","last_peered":"2024-03-27T09:59:36.727714+0000","last_clean":"2024-03-27T09:59:36.727714+0000","last_became_active":"2024-03-27T09:59:29.150095+0000","last_became_peered":"2024-03-27T09:59:29.150095+0000","last_unstale":"2024-03-27T09:59:36.727714+0000","last_undegraded":"2024-03-27T09:59:36.727714+0000","last_fullsized":"2024-03-27T09:59:36.727714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:12:08.142213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.230685+0000","last_change":"2024-03-27T09:59:29.149230+0000","last_active":"2024-03-27T09:59:35.230685+0000","last_peered":"2024-03-27T09:59:35.230685+0000","last_clean":"2024-03-27T09:59:35.230685+0000","last_became_active":"2024-03-27T09:59:29.148669+0000","last_became_peered":"2024-03-27T09:59:29.148669+0000","last_unstale":"2024-03-27T09:59:35.230685+0000","last_undegraded":"2024-03-27T09:59:35.230685+0000","last_fullsized":"2024-03-27T09:59:35.230685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:27:19.913918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.798736+0000","last_change":"2024-03-27T09:59:29.151084+0000","last_active":"2024-03-27T09:59:35.798736+0000","last_peered":"2024-03-27T09:59:35.798736+0000","last_clean":"2024-03-27T09:59:35.798736+0000","last_became_active":"2024-03-27T09:59:29.149050+0000","last_became_peered":"2024-03-27T09:59:29.149050+0000","last_unstale":"2024-03-27T09:59:35.798736+0000","last_undegraded":"2024-03-27T09:59:35.798736+0000","last_fullsized":"2024-03-27T09:59:35.798736+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:40:55.617775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.660424+0000","last_change":"2024-03-27T09:59:29.160100+0000","last_active":"2024-03-27T09:59:36.660424+0000","last_peered":"2024-03-27T09:59:36.660424+0000","last_clean":"2024-03-27T09:59:36.660424+0000","last_became_active":"2024-03-27T09:59:29.158340+0000","last_became_peered":"2024-03-27T09:59:29.158340+0000","last_unstale":"2024-03-27T09:59:36.660424+0000","last_undegraded":"2024-03-27T09:59:36.660424+0000","last_fullsized":"2024-03-27T09:59:36.660424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:20:50.555376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.728983+0000","last_change":"2024-03-27T09:59:29.157565+0000","last_active":"2024-03-27T09:59:36.728983+0000","last_peered":"2024-03-27T09:59:36.728983+0000","last_clean":"2024-03-27T09:59:36.728983+0000","last_became_active":"2024-03-27T09:59:29.157278+0000","last_became_peered":"2024-03-27T09:59:29.157278+0000","last_unstale":"2024-03-27T09:59:36.728983+0000","last_undegraded":"2024-03-27T09:59:36.728983+0000","last_fullsized":"2024-03-27T09:59:36.728983+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:03:30.407810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":14,"seq":60129542156,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":286720,"data_stored":114786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542156,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":110944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542155,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":282624,"data_stored":111104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542155,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32040,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339800,"statfs":{"total":96636764160,"available":96603955200,"internally_reserved":0,"allocated":880640,"data_stored":701950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574861,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32036,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339804,"statfs":{"total":96636764160,"available":96603959296,"internally_reserved":0,"allocated":872448,"data_stored":701894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574860,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":286720,"data_stored":114786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":278528,"data_stored":111034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574860,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31460,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340380,"statfs":{"total":96636764160,"available":96604549120,"internally_reserved":0,"allocated":286720,"data_stored":111070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-27T10:00:03.656 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-27T10:00:03.914 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.924+0000 7f5a4d600640 1 Processor -- start 2024-03-27T10:00:03.915 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.925+0000 7f5a4d600640 1 -- start start 2024-03-27T10:00:03.916 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.926+0000 7f5a4d600640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f5a4815ded0 0x7f5a4815e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:03.916 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.926+0000 7f5a4d600640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a48162a30 con 0x7f5a480b4260 2024-03-27T10:00:03.916 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.926+0000 7f5a4d600640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a480b3780 con 0x7f5a4806f2f0 2024-03-27T10:00:03.917 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.926+0000 7f5a4d600640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f5a48162d10 con 0x7f5a4815ded0 2024-03-27T10:00:03.917 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.927+0000 7f5a46000640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f5a480b4260 0x7f5a4806ebe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:56754/0 (socket says 172.21.15.57:56754) 2024-03-27T10:00:03.917 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.927+0000 7f5a46000640 1 -- 172.21.15.57:0/904839888 learned_addr learned my addr 172.21.15.57:0/904839888 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T10:00:03.919 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.927+0000 7f5a46a00640 1 --2- 172.21.15.57:0/904839888 >> v2:172.21.15.118:3300/0 conn(0x7f5a4815ded0 0x7f5a4815e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:03.919 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.927+0000 7f5a45600640 1 -- 172.21.15.57:0/904839888 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2954512738 0 0) 0x7f5a48162a30 con 0x7f5a480b4260 2024-03-27T10:00:03.919 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.927+0000 7f5a45600640 1 -- 172.21.15.57:0/904839888 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a2c003520 con 0x7f5a480b4260 2024-03-27T10:00:03.919 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.927+0000 7f5a45600640 1 -- 172.21.15.57:0/904839888 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2610202665 0 0) 0x7f5a2c003520 con 0x7f5a480b4260 2024-03-27T10:00:03.919 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.927+0000 7f5a45600640 1 -- 172.21.15.57:0/904839888 >> v2:172.21.15.118:3300/0 conn(0x7f5a4815ded0 msgr2=0x7f5a4815e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:03.919 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.927+0000 7f5a45600640 1 --2- 172.21.15.57:0/904839888 >> v2:172.21.15.118:3300/0 conn(0x7f5a4815ded0 0x7f5a4815e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:03.919 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.928+0000 7f5a45600640 1 -- 172.21.15.57:0/904839888 >> v1:172.21.15.118:6789/0 conn(0x7f5a4806f2f0 legacy=0x7f5a48161d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:03.919 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.928+0000 7f5a45600640 1 -- 172.21.15.57:0/904839888 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a480b3a60 con 0x7f5a480b4260 2024-03-27T10:00:03.920 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.928+0000 7f5a45600640 1 -- 172.21.15.57:0/904839888 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4227751516 0 0) 0x7f5a30001670 con 0x7f5a480b4260 2024-03-27T10:00:03.920 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.928+0000 7f5a45600640 1 -- 172.21.15.57:0/904839888 >> v1:172.21.15.57:6789/0 conn(0x7f5a480b4260 legacy=0x7f5a4806ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:03.920 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.928+0000 7f5a45600640 1 --2- 172.21.15.57:0/904839888 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5a2c0039b0 0x7f5a2c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:03.920 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.928+0000 7f5a45600640 1 --2- 172.21.15.57:0/904839888 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a2c004800 0x7f5a2c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:03.920 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.928+0000 7f5a45600640 1 --2- 172.21.15.57:0/904839888 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a2c0051c0 0x7f5a2c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:03.920 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.928+0000 7f5a45600640 1 -- 172.21.15.57:0/904839888 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f5a2c00c030 con 0x7f5a2c004800 2024-03-27T10:00:03.920 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.928+0000 7f5a45600640 1 -- 172.21.15.57:0/904839888 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f5a2c00c1e0 con 0x7f5a2c0051c0 2024-03-27T10:00:03.920 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.928+0000 7f5a45600640 1 -- 172.21.15.57:0/904839888 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f5a2c00c3e0 con 0x7f5a2c0039b0 2024-03-27T10:00:03.920 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.928+0000 7f5a46000640 1 --2- 172.21.15.57:0/904839888 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a2c004800 0x7f5a2c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:03.920 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.928+0000 7f5a47400640 1 --2- 172.21.15.57:0/904839888 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a2c0051c0 0x7f5a2c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:03.920 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.928+0000 7f5a46000640 1 -- 172.21.15.57:0/904839888 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5a2c0039b0 msgr2=0x7f5a2c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:03.920 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.928+0000 7f5a46000640 1 --2- 172.21.15.57:0/904839888 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5a2c0039b0 0x7f5a2c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:03.921 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.928+0000 7f5a46000640 1 -- 172.21.15.57:0/904839888 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a2c0051c0 msgr2=0x7f5a2c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:03.921 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.928+0000 7f5a46000640 1 --2- 172.21.15.57:0/904839888 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a2c0051c0 0x7f5a2c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:03.921 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.928+0000 7f5a46000640 1 -- 172.21.15.57:0/904839888 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a2c003520 con 0x7f5a2c004800 2024-03-27T10:00:03.921 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.928+0000 7f5a47400640 1 --2- 172.21.15.57:0/904839888 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a2c0051c0 0x7f5a2c00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T10:00:03.921 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.928+0000 7f5a47400640 1 -- 172.21.15.57:0/904839888 reap_dead start 2024-03-27T10:00:03.929 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.930+0000 7f5a46000640 1 --2- 172.21.15.57:0/904839888 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a2c004800 0x7f5a2c004c80 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5a3000c240 tx=0x7f5a2c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22b93fb455262cf2 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:03.930 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.930+0000 7f5a45600640 1 -- 172.21.15.57:0/904839888 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a30007cf0 con 0x7f5a2c004800 2024-03-27T10:00:03.930 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.930+0000 7f5a45600640 1 -- 172.21.15.57:0/904839888 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a30030070 con 0x7f5a2c004800 2024-03-27T10:00:03.930 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.930+0000 7f5a45600640 1 -- 172.21.15.57:0/904839888 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a30005db0 con 0x7f5a2c004800 2024-03-27T10:00:03.930 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.930+0000 7f5a4d600640 1 -- 172.21.15.57:0/904839888 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a2c004800 msgr2=0x7f5a2c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:03.930 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.930+0000 7f5a4d600640 1 --2- 172.21.15.57:0/904839888 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a2c004800 0x7f5a2c004c80 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5a3000c240 tx=0x7f5a2c005830 comp rx=0 tx=0).stop 2024-03-27T10:00:03.930 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.931+0000 7f5a4d600640 1 -- 172.21.15.57:0/904839888 shutdown_connections 2024-03-27T10:00:03.930 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.931+0000 7f5a4d600640 1 --2- 172.21.15.57:0/904839888 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a2c004800 0x7f5a2c004c80 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:03.930 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.931+0000 7f5a4d600640 1 -- 172.21.15.57:0/904839888 >> 172.21.15.57:0/904839888 conn(0x7f5a480b1c60 msgr2=0x7f5a480b2070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:03.931 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.931+0000 7f5a4d600640 1 -- 172.21.15.57:0/904839888 shutdown_connections 2024-03-27T10:00:03.931 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.931+0000 7f5a4d600640 1 -- 172.21.15.57:0/904839888 wait complete. 2024-03-27T10:00:03.931 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.932+0000 7f5a4d600640 1 Processor -- start 2024-03-27T10:00:03.931 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.933+0000 7f5a4d600640 1 -- start start 2024-03-27T10:00:03.931 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.934+0000 7f5a4d600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5a2c004800 0x7f5a481f46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:03.931 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.934+0000 7f5a4d600640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a480cc060 0x7f5a481f0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:03.931 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.934+0000 7f5a4d600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a480ce310 0x7f5a480ce7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:03.931 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.934+0000 7f5a4d600640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f5a4815e2b0 con 0x7f5a480cc060 2024-03-27T10:00:03.931 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.934+0000 7f5a4d600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f5a480b3dd0 con 0x7f5a480ce310 2024-03-27T10:00:03.931 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.934+0000 7f5a4d600640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f5a4815e430 con 0x7f5a2c004800 2024-03-27T10:00:03.931 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.934+0000 7f5a46000640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a480cc060 0x7f5a481f0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:03.931 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.934+0000 7f5a46000640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a480cc060 0x7f5a481f0fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55052/0 (socket says 172.21.15.57:55052) 2024-03-27T10:00:03.932 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.934+0000 7f5a46000640 1 -- 172.21.15.57:0/3379121034 learned_addr learned my addr 172.21.15.57:0/3379121034 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:03.932 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.934+0000 7f5a46a00640 1 --2- 172.21.15.57:0/3379121034 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5a2c004800 0x7f5a481f46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:03.932 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.934+0000 7f5a47400640 1 --2- 172.21.15.57:0/3379121034 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a480ce310 0x7f5a480ce7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:03.932 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.934+0000 7f5a46000640 1 -- 172.21.15.57:0/3379121034 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5a2c004800 msgr2=0x7f5a481f46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:03.932 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.934+0000 7f5a46000640 1 --2- 172.21.15.57:0/3379121034 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5a2c004800 0x7f5a481f46e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:03.932 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.934+0000 7f5a46000640 1 -- 172.21.15.57:0/3379121034 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a480ce310 msgr2=0x7f5a480ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:03.932 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.934+0000 7f5a46000640 1 --2- 172.21.15.57:0/3379121034 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a480ce310 0x7f5a480ce7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:03.932 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.934+0000 7f5a46000640 1 -- 172.21.15.57:0/3379121034 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a480ae4b0 con 0x7f5a480cc060 2024-03-27T10:00:03.932 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.934+0000 7f5a47400640 1 --2- 172.21.15.57:0/3379121034 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a480ce310 0x7f5a480ce7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T10:00:03.932 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.935+0000 7f5a46000640 1 --2- 172.21.15.57:0/3379121034 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a480cc060 0x7f5a481f0fe0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f5a3000c240 tx=0x7f5a480b3c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:03.932 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.935+0000 7f5a3ea00640 1 -- 172.21.15.57:0/3379121034 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a30007cf0 con 0x7f5a480cc060 2024-03-27T10:00:03.932 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.935+0000 7f5a3ea00640 1 -- 172.21.15.57:0/3379121034 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a30004bf0 con 0x7f5a480cc060 2024-03-27T10:00:03.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.935+0000 7f5a3ea00640 1 -- 172.21.15.57:0/3379121034 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a30007070 con 0x7f5a480cc060 2024-03-27T10:00:03.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.935+0000 7f5a4d600640 1 -- 172.21.15.57:0/3379121034 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a481f4c20 con 0x7f5a480cc060 2024-03-27T10:00:03.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.935+0000 7f5a4d600640 1 -- 172.21.15.57:0/3379121034 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a480cc800 con 0x7f5a480cc060 2024-03-27T10:00:03.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.936+0000 7f5a4d600640 1 -- 172.21.15.57:0/3379121034 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a48068620 con 0x7f5a480cc060 2024-03-27T10:00:03.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.937+0000 7f5a3ea00640 1 -- 172.21.15.57:0/3379121034 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f5a30007210 con 0x7f5a480cc060 2024-03-27T10:00:03.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.938+0000 7f5a3ea00640 1 --2- 172.21.15.57:0/3379121034 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f5a2406c530 0x7f5a2406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:03.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.938+0000 7f5a3ea00640 1 -- 172.21.15.57:0/3379121034 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f5a300ace40 con 0x7f5a480cc060 2024-03-27T10:00:03.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.938+0000 7f5a46a00640 1 --2- 172.21.15.57:0/3379121034 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f5a2406c530 0x7f5a2406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:03.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.939+0000 7f5a46a00640 1 --2- 172.21.15.57:0/3379121034 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f5a2406c530 0x7f5a2406e9f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5a38007520 tx=0x7f5a3800b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:03.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:03.943+0000 7f5a3ea00640 1 -- 172.21.15.57:0/3379121034 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f5a481f4c20 con 0x7f5a480cc060 2024-03-27T10:00:04.124 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.135+0000 7f5a4d600640 1 -- 172.21.15.57:0/3379121034 --> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5a480713a0 con 0x7f5a2406c530 2024-03-27T10:00:04.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.158+0000 7f5a3ea00640 1 -- 172.21.15.57:0/3379121034 <== mgr.4103 v2:172.21.15.57:6832/485397065 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332537 (secure 0 0 0) 0x7f5a480713a0 con 0x7f5a2406c530 2024-03-27T10:00:04.151 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:00:04.155 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-03-27T10:00:04.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.166+0000 7f5a4d600640 1 -- 172.21.15.57:0/3379121034 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f5a2406c530 msgr2=0x7f5a2406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:04.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.166+0000 7f5a4d600640 1 --2- 172.21.15.57:0/3379121034 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f5a2406c530 0x7f5a2406e9f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5a38007520 tx=0x7f5a3800b040 comp rx=0 tx=0).stop 2024-03-27T10:00:04.157 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.166+0000 7f5a4d600640 1 -- 172.21.15.57:0/3379121034 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a480cc060 msgr2=0x7f5a481f0fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:04.157 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.166+0000 7f5a4d600640 1 --2- 172.21.15.57:0/3379121034 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a480cc060 0x7f5a481f0fe0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f5a3000c240 tx=0x7f5a480b3c30 comp rx=0 tx=0).stop 2024-03-27T10:00:04.157 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.166+0000 7f5a4d600640 1 -- 172.21.15.57:0/3379121034 shutdown_connections 2024-03-27T10:00:04.157 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.166+0000 7f5a4d600640 1 --2- 172.21.15.57:0/3379121034 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f5a2406c530 0x7f5a2406e9f0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:04.157 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.166+0000 7f5a4d600640 1 --2- 172.21.15.57:0/3379121034 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5a480ce310 0x7f5a480ce7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:04.157 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.166+0000 7f5a4d600640 1 --2- 172.21.15.57:0/3379121034 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5a480cc060 0x7f5a481f0fe0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:04.157 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.166+0000 7f5a4d600640 1 --2- 172.21.15.57:0/3379121034 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5a2c004800 0x7f5a481f46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:04.157 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.166+0000 7f5a4d600640 1 -- 172.21.15.57:0/3379121034 >> 172.21.15.57:0/3379121034 conn(0x7f5a480b1c60 msgr2=0x7f5a481588b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:04.157 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.166+0000 7f5a4d600640 1 -- 172.21.15.57:0/3379121034 shutdown_connections 2024-03-27T10:00:04.157 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.167+0000 7f5a4d600640 1 -- 172.21.15.57:0/3379121034 wait complete. 2024-03-27T10:00:04.176 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":43,"stamp":"2024-03-27T10:00:03.237039+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236172,"kb_used_data":3368,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738548,"statfs":{"total":773094113280,"available":772852273152,"internally_reserved":0,"allocated":3448832,"data_stored":2077568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.008820"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.798582+0000","last_change":"2024-03-27T09:59:28.132620+0000","last_active":"2024-03-27T09:59:35.798582+0000","last_peered":"2024-03-27T09:59:35.798582+0000","last_clean":"2024-03-27T09:59:35.798582+0000","last_became_active":"2024-03-27T09:59:28.132360+0000","last_became_peered":"2024-03-27T09:59:28.132360+0000","last_unstale":"2024-03-27T09:59:35.798582+0000","last_undegraded":"2024-03-27T09:59:35.798582+0000","last_fullsized":"2024-03-27T09:59:35.798582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T20:35:52.312192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.600893+0000","last_change":"2024-03-27T09:59:29.147335+0000","last_active":"2024-03-27T09:59:35.600893+0000","last_peered":"2024-03-27T09:59:35.600893+0000","last_clean":"2024-03-27T09:59:35.600893+0000","last_became_active":"2024-03-27T09:59:29.147015+0000","last_became_peered":"2024-03-27T09:59:29.147015+0000","last_unstale":"2024-03-27T09:59:35.600893+0000","last_undegraded":"2024-03-27T09:59:35.600893+0000","last_fullsized":"2024-03-27T09:59:35.600893+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:12:08.142213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.599213+0000","last_change":"2024-03-27T09:59:33.703543+0000","last_active":"2024-03-27T09:59:35.599213+0000","last_peered":"2024-03-27T09:59:35.599213+0000","last_clean":"2024-03-27T09:59:35.599213+0000","last_became_active":"2024-03-27T09:59:33.702853+0000","last_became_peered":"2024-03-27T09:59:33.702853+0000","last_unstale":"2024-03-27T09:59:35.599213+0000","last_undegraded":"2024-03-27T09:59:35.599213+0000","last_fullsized":"2024-03-27T09:59:35.599213+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T20:31:50.071081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.601154+0000","last_change":"2024-03-27T09:59:28.119506+0000","last_active":"2024-03-27T09:59:35.601154+0000","last_peered":"2024-03-27T09:59:35.601154+0000","last_clean":"2024-03-27T09:59:35.601154+0000","last_became_active":"2024-03-27T09:59:28.119120+0000","last_became_peered":"2024-03-27T09:59:28.119120+0000","last_unstale":"2024-03-27T09:59:35.601154+0000","last_undegraded":"2024-03-27T09:59:35.601154+0000","last_fullsized":"2024-03-27T09:59:35.601154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:40:42.254670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.797783+0000","last_change":"2024-03-27T09:59:29.152285+0000","last_active":"2024-03-27T09:59:35.797783+0000","last_peered":"2024-03-27T09:59:35.797783+0000","last_clean":"2024-03-27T09:59:35.797783+0000","last_became_active":"2024-03-27T09:59:29.150250+0000","last_became_peered":"2024-03-27T09:59:29.150250+0000","last_unstale":"2024-03-27T09:59:35.797783+0000","last_undegraded":"2024-03-27T09:59:35.797783+0000","last_fullsized":"2024-03-27T09:59:35.797783+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:45:14.005415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.228593+0000","last_change":"2024-03-27T09:59:33.227161+0000","last_active":"2024-03-27T09:59:35.228593+0000","last_peered":"2024-03-27T09:59:35.228593+0000","last_clean":"2024-03-27T09:59:35.228593+0000","last_became_active":"2024-03-27T09:59:33.225987+0000","last_became_peered":"2024-03-27T09:59:33.225987+0000","last_unstale":"2024-03-27T09:59:35.228593+0000","last_undegraded":"2024-03-27T09:59:35.228593+0000","last_fullsized":"2024-03-27T09:59:35.228593+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T20:25:58.823076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.726381+0000","last_change":"2024-03-27T09:59:28.131417+0000","last_active":"2024-03-27T09:59:36.726381+0000","last_peered":"2024-03-27T09:59:36.726381+0000","last_clean":"2024-03-27T09:59:36.726381+0000","last_became_active":"2024-03-27T09:59:28.131134+0000","last_became_peered":"2024-03-27T09:59:28.131134+0000","last_unstale":"2024-03-27T09:59:36.726381+0000","last_undegraded":"2024-03-27T09:59:36.726381+0000","last_fullsized":"2024-03-27T09:59:36.726381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:55:33.304260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.230980+0000","last_change":"2024-03-27T09:59:29.159330+0000","last_active":"2024-03-27T09:59:35.230980+0000","last_peered":"2024-03-27T09:59:35.230980+0000","last_clean":"2024-03-27T09:59:35.230980+0000","last_became_active":"2024-03-27T09:59:29.159006+0000","last_became_peered":"2024-03-27T09:59:29.159006+0000","last_unstale":"2024-03-27T09:59:35.230980+0000","last_undegraded":"2024-03-27T09:59:35.230980+0000","last_fullsized":"2024-03-27T09:59:35.230980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:03:30.407810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.232767+0000","last_change":"2024-03-27T09:59:33.224598+0000","last_active":"2024-03-27T09:59:35.232767+0000","last_peered":"2024-03-27T09:59:35.232767+0000","last_clean":"2024-03-27T09:59:35.232767+0000","last_became_active":"2024-03-27T09:59:33.224114+0000","last_became_peered":"2024-03-27T09:59:33.224114+0000","last_unstale":"2024-03-27T09:59:35.232767+0000","last_undegraded":"2024-03-27T09:59:35.232767+0000","last_fullsized":"2024-03-27T09:59:35.232767+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:02:21.892888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.726198+0000","last_change":"2024-03-27T09:59:28.129485+0000","last_active":"2024-03-27T09:59:36.726198+0000","last_peered":"2024-03-27T09:59:36.726198+0000","last_clean":"2024-03-27T09:59:36.726198+0000","last_became_active":"2024-03-27T09:59:28.129171+0000","last_became_peered":"2024-03-27T09:59:28.129171+0000","last_unstale":"2024-03-27T09:59:36.726198+0000","last_undegraded":"2024-03-27T09:59:36.726198+0000","last_fullsized":"2024-03-27T09:59:36.726198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:31:20.500733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.231419+0000","last_change":"2024-03-27T09:59:29.161577+0000","last_active":"2024-03-27T09:59:35.231419+0000","last_peered":"2024-03-27T09:59:35.231419+0000","last_clean":"2024-03-27T09:59:35.231419+0000","last_became_active":"2024-03-27T09:59:29.161395+0000","last_became_peered":"2024-03-27T09:59:29.161395+0000","last_unstale":"2024-03-27T09:59:35.231419+0000","last_undegraded":"2024-03-27T09:59:35.231419+0000","last_fullsized":"2024-03-27T09:59:35.231419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T20:51:12.586643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.229598+0000","last_change":"2024-03-27T09:59:33.213426+0000","last_active":"2024-03-27T09:59:35.229598+0000","last_peered":"2024-03-27T09:59:35.229598+0000","last_clean":"2024-03-27T09:59:35.229598+0000","last_became_active":"2024-03-27T09:59:33.212985+0000","last_became_peered":"2024-03-27T09:59:33.212985+0000","last_unstale":"2024-03-27T09:59:35.229598+0000","last_undegraded":"2024-03-27T09:59:35.229598+0000","last_fullsized":"2024-03-27T09:59:35.229598+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:03:49.254833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.231790+0000","last_change":"2024-03-27T09:59:29.153065+0000","last_active":"2024-03-27T09:59:35.231790+0000","last_peered":"2024-03-27T09:59:35.231790+0000","last_clean":"2024-03-27T09:59:35.231790+0000","last_became_active":"2024-03-27T09:59:29.152709+0000","last_became_peered":"2024-03-27T09:59:29.152709+0000","last_unstale":"2024-03-27T09:59:35.231790+0000","last_undegraded":"2024-03-27T09:59:35.231790+0000","last_fullsized":"2024-03-27T09:59:35.231790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:57:26.770369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.726196+0000","last_change":"2024-03-27T09:59:28.132199+0000","last_active":"2024-03-27T09:59:36.726196+0000","last_peered":"2024-03-27T09:59:36.726196+0000","last_clean":"2024-03-27T09:59:36.726196+0000","last_became_active":"2024-03-27T09:59:28.131839+0000","last_became_peered":"2024-03-27T09:59:28.131839+0000","last_unstale":"2024-03-27T09:59:36.726196+0000","last_undegraded":"2024-03-27T09:59:36.726196+0000","last_fullsized":"2024-03-27T09:59:36.726196+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:04:46.361989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.233050+0000","last_change":"2024-03-27T09:59:33.225488+0000","last_active":"2024-03-27T09:59:35.233050+0000","last_peered":"2024-03-27T09:59:35.233050+0000","last_clean":"2024-03-27T09:59:35.233050+0000","last_became_active":"2024-03-27T09:59:33.223781+0000","last_became_peered":"2024-03-27T09:59:33.223781+0000","last_unstale":"2024-03-27T09:59:35.233050+0000","last_undegraded":"2024-03-27T09:59:35.233050+0000","last_fullsized":"2024-03-27T09:59:35.233050+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:45:04.448005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.599916+0000","last_change":"2024-03-27T09:59:29.152084+0000","last_active":"2024-03-27T09:59:35.599916+0000","last_peered":"2024-03-27T09:59:35.599916+0000","last_clean":"2024-03-27T09:59:35.599916+0000","last_became_active":"2024-03-27T09:59:29.151816+0000","last_became_peered":"2024-03-27T09:59:29.151816+0000","last_unstale":"2024-03-27T09:59:35.599916+0000","last_undegraded":"2024-03-27T09:59:35.599916+0000","last_fullsized":"2024-03-27T09:59:35.599916+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:34:04.348561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.657754+0000","last_change":"2024-03-27T09:59:28.113836+0000","last_active":"2024-03-27T09:59:36.657754+0000","last_peered":"2024-03-27T09:59:36.657754+0000","last_clean":"2024-03-27T09:59:36.657754+0000","last_became_active":"2024-03-27T09:59:28.113517+0000","last_became_peered":"2024-03-27T09:59:28.113517+0000","last_unstale":"2024-03-27T09:59:36.657754+0000","last_undegraded":"2024-03-27T09:59:36.657754+0000","last_fullsized":"2024-03-27T09:59:36.657754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:40:42.254670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.233128+0000","last_change":"2024-03-27T09:59:33.219685+0000","last_active":"2024-03-27T09:59:35.233128+0000","last_peered":"2024-03-27T09:59:35.233128+0000","last_clean":"2024-03-27T09:59:35.233128+0000","last_became_active":"2024-03-27T09:59:33.219163+0000","last_became_peered":"2024-03-27T09:59:33.219163+0000","last_unstale":"2024-03-27T09:59:35.233128+0000","last_undegraded":"2024-03-27T09:59:35.233128+0000","last_fullsized":"2024-03-27T09:59:35.233128+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:21:56.509459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.599966+0000","last_change":"2024-03-27T09:59:29.162032+0000","last_active":"2024-03-27T09:59:35.599966+0000","last_peered":"2024-03-27T09:59:35.599966+0000","last_clean":"2024-03-27T09:59:35.599966+0000","last_became_active":"2024-03-27T09:59:29.154157+0000","last_became_peered":"2024-03-27T09:59:29.154157+0000","last_unstale":"2024-03-27T09:59:35.599966+0000","last_undegraded":"2024-03-27T09:59:35.599966+0000","last_fullsized":"2024-03-27T09:59:35.599966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:57:26.770369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.658673+0000","last_change":"2024-03-27T09:59:28.129073+0000","last_active":"2024-03-27T09:59:36.658673+0000","last_peered":"2024-03-27T09:59:36.658673+0000","last_clean":"2024-03-27T09:59:36.658673+0000","last_became_active":"2024-03-27T09:59:28.128568+0000","last_became_peered":"2024-03-27T09:59:28.128568+0000","last_unstale":"2024-03-27T09:59:36.658673+0000","last_undegraded":"2024-03-27T09:59:36.658673+0000","last_fullsized":"2024-03-27T09:59:36.658673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:13:29.201574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.660426+0000","last_change":"2024-03-27T09:59:33.708504+0000","last_active":"2024-03-27T09:59:36.660426+0000","last_peered":"2024-03-27T09:59:36.660426+0000","last_clean":"2024-03-27T09:59:36.660426+0000","last_became_active":"2024-03-27T09:59:33.703606+0000","last_became_peered":"2024-03-27T09:59:33.703606+0000","last_unstale":"2024-03-27T09:59:36.660426+0000","last_undegraded":"2024-03-27T09:59:36.660426+0000","last_fullsized":"2024-03-27T09:59:36.660426+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:06:12.744793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.230009+0000","last_change":"2024-03-27T09:59:29.136122+0000","last_active":"2024-03-27T09:59:35.230009+0000","last_peered":"2024-03-27T09:59:35.230009+0000","last_clean":"2024-03-27T09:59:35.230009+0000","last_became_active":"2024-03-27T09:59:29.134653+0000","last_became_peered":"2024-03-27T09:59:29.134653+0000","last_unstale":"2024-03-27T09:59:35.230009+0000","last_undegraded":"2024-03-27T09:59:35.230009+0000","last_fullsized":"2024-03-27T09:59:35.230009+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:23:47.064643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.726161+0000","last_change":"2024-03-27T09:59:28.130295+0000","last_active":"2024-03-27T09:59:36.726161+0000","last_peered":"2024-03-27T09:59:36.726161+0000","last_clean":"2024-03-27T09:59:36.726161+0000","last_became_active":"2024-03-27T09:59:28.129719+0000","last_became_peered":"2024-03-27T09:59:28.129719+0000","last_unstale":"2024-03-27T09:59:36.726161+0000","last_undegraded":"2024-03-27T09:59:36.726161+0000","last_fullsized":"2024-03-27T09:59:36.726161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:23:46.050666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.233646+0000","last_change":"2024-03-27T09:59:33.225859+0000","last_active":"2024-03-27T09:59:35.233646+0000","last_peered":"2024-03-27T09:59:35.233646+0000","last_clean":"2024-03-27T09:59:35.233646+0000","last_became_active":"2024-03-27T09:59:33.224011+0000","last_became_peered":"2024-03-27T09:59:33.224011+0000","last_unstale":"2024-03-27T09:59:35.233646+0000","last_undegraded":"2024-03-27T09:59:35.233646+0000","last_fullsized":"2024-03-27T09:59:35.233646+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:06:12.744793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.798261+0000","last_change":"2024-03-27T09:59:29.155479+0000","last_active":"2024-03-27T09:59:35.798261+0000","last_peered":"2024-03-27T09:59:35.798261+0000","last_clean":"2024-03-27T09:59:35.798261+0000","last_became_active":"2024-03-27T09:59:29.151680+0000","last_became_peered":"2024-03-27T09:59:29.151680+0000","last_unstale":"2024-03-27T09:59:35.798261+0000","last_undegraded":"2024-03-27T09:59:35.798261+0000","last_fullsized":"2024-03-27T09:59:35.798261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:57:26.770369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.232591+0000","last_change":"2024-03-27T09:59:28.128710+0000","last_active":"2024-03-27T09:59:35.232591+0000","last_peered":"2024-03-27T09:59:35.232591+0000","last_clean":"2024-03-27T09:59:35.232591+0000","last_became_active":"2024-03-27T09:59:28.128323+0000","last_became_peered":"2024-03-27T09:59:28.128323+0000","last_unstale":"2024-03-27T09:59:35.232591+0000","last_undegraded":"2024-03-27T09:59:35.232591+0000","last_fullsized":"2024-03-27T09:59:35.232591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:55:33.304260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.232711+0000","last_change":"2024-03-27T09:59:33.705209+0000","last_active":"2024-03-27T09:59:35.232711+0000","last_peered":"2024-03-27T09:59:35.232711+0000","last_clean":"2024-03-27T09:59:35.232711+0000","last_became_active":"2024-03-27T09:59:33.704637+0000","last_became_peered":"2024-03-27T09:59:33.704637+0000","last_unstale":"2024-03-27T09:59:35.232711+0000","last_undegraded":"2024-03-27T09:59:35.232711+0000","last_fullsized":"2024-03-27T09:59:35.232711+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:07:54.369342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.601058+0000","last_change":"2024-03-27T09:59:29.160579+0000","last_active":"2024-03-27T09:59:35.601058+0000","last_peered":"2024-03-27T09:59:35.601058+0000","last_clean":"2024-03-27T09:59:35.601058+0000","last_became_active":"2024-03-27T09:59:29.160256+0000","last_became_peered":"2024-03-27T09:59:29.160256+0000","last_unstale":"2024-03-27T09:59:35.601058+0000","last_undegraded":"2024-03-27T09:59:35.601058+0000","last_fullsized":"2024-03-27T09:59:35.601058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:00:09.092063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.657792+0000","last_change":"2024-03-27T09:59:28.113830+0000","last_active":"2024-03-27T09:59:36.657792+0000","last_peered":"2024-03-27T09:59:36.657792+0000","last_clean":"2024-03-27T09:59:36.657792+0000","last_became_active":"2024-03-27T09:59:28.112951+0000","last_became_peered":"2024-03-27T09:59:28.112951+0000","last_unstale":"2024-03-27T09:59:36.657792+0000","last_undegraded":"2024-03-27T09:59:36.657792+0000","last_fullsized":"2024-03-27T09:59:36.657792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:31:20.500733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.598982+0000","last_change":"2024-03-27T09:59:33.698681+0000","last_active":"2024-03-27T09:59:35.598982+0000","last_peered":"2024-03-27T09:59:35.598982+0000","last_clean":"2024-03-27T09:59:35.598982+0000","last_became_active":"2024-03-27T09:59:33.697706+0000","last_became_peered":"2024-03-27T09:59:33.697706+0000","last_unstale":"2024-03-27T09:59:35.598982+0000","last_undegraded":"2024-03-27T09:59:35.598982+0000","last_fullsized":"2024-03-27T09:59:35.598982+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:40:22.426786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.660127+0000","last_change":"2024-03-27T09:59:29.150475+0000","last_active":"2024-03-27T09:59:36.660127+0000","last_peered":"2024-03-27T09:59:36.660127+0000","last_clean":"2024-03-27T09:59:36.660127+0000","last_became_active":"2024-03-27T09:59:29.150150+0000","last_became_peered":"2024-03-27T09:59:29.150150+0000","last_unstale":"2024-03-27T09:59:36.660127+0000","last_undegraded":"2024-03-27T09:59:36.660127+0000","last_fullsized":"2024-03-27T09:59:36.660127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T21:36:52.561523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.726237+0000","last_change":"2024-03-27T09:59:28.131581+0000","last_active":"2024-03-27T09:59:36.726237+0000","last_peered":"2024-03-27T09:59:36.726237+0000","last_clean":"2024-03-27T09:59:36.726237+0000","last_became_active":"2024-03-27T09:59:28.131279+0000","last_became_peered":"2024-03-27T09:59:28.131279+0000","last_unstale":"2024-03-27T09:59:36.726237+0000","last_undegraded":"2024-03-27T09:59:36.726237+0000","last_fullsized":"2024-03-27T09:59:36.726237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T12:53:30.888359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.797439+0000","last_change":"2024-03-27T09:59:33.702376+0000","last_active":"2024-03-27T09:59:35.797439+0000","last_peered":"2024-03-27T09:59:35.797439+0000","last_clean":"2024-03-27T09:59:35.797439+0000","last_became_active":"2024-03-27T09:59:33.698666+0000","last_became_peered":"2024-03-27T09:59:33.698666+0000","last_unstale":"2024-03-27T09:59:35.797439+0000","last_undegraded":"2024-03-27T09:59:35.797439+0000","last_fullsized":"2024-03-27T09:59:35.797439+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:26:40.882057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.231562+0000","last_change":"2024-03-27T09:59:29.156291+0000","last_active":"2024-03-27T09:59:35.231562+0000","last_peered":"2024-03-27T09:59:35.231562+0000","last_clean":"2024-03-27T09:59:35.231562+0000","last_became_active":"2024-03-27T09:59:29.156028+0000","last_became_peered":"2024-03-27T09:59:29.156028+0000","last_unstale":"2024-03-27T09:59:35.231562+0000","last_undegraded":"2024-03-27T09:59:35.231562+0000","last_fullsized":"2024-03-27T09:59:35.231562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:03:45.164612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.657738+0000","last_change":"2024-03-27T09:59:28.115841+0000","last_active":"2024-03-27T09:59:36.657738+0000","last_peered":"2024-03-27T09:59:36.657738+0000","last_clean":"2024-03-27T09:59:36.657738+0000","last_became_active":"2024-03-27T09:59:28.115592+0000","last_became_peered":"2024-03-27T09:59:28.115592+0000","last_unstale":"2024-03-27T09:59:36.657738+0000","last_undegraded":"2024-03-27T09:59:36.657738+0000","last_fullsized":"2024-03-27T09:59:36.657738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:23:46.050666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.658425+0000","last_change":"2024-03-27T09:59:33.224089+0000","last_active":"2024-03-27T09:59:36.658425+0000","last_peered":"2024-03-27T09:59:36.658425+0000","last_clean":"2024-03-27T09:59:36.658425+0000","last_became_active":"2024-03-27T09:59:33.223558+0000","last_became_peered":"2024-03-27T09:59:33.223558+0000","last_unstale":"2024-03-27T09:59:36.658425+0000","last_undegraded":"2024-03-27T09:59:36.658425+0000","last_fullsized":"2024-03-27T09:59:36.658425+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:45:04.448005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.233512+0000","last_change":"2024-03-27T09:59:29.161017+0000","last_active":"2024-03-27T09:59:35.233512+0000","last_peered":"2024-03-27T09:59:35.233512+0000","last_clean":"2024-03-27T09:59:35.233512+0000","last_became_active":"2024-03-27T09:59:29.160567+0000","last_became_peered":"2024-03-27T09:59:29.160567+0000","last_unstale":"2024-03-27T09:59:35.233512+0000","last_undegraded":"2024-03-27T09:59:35.233512+0000","last_fullsized":"2024-03-27T09:59:35.233512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:55:34.318236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.231117+0000","last_change":"2024-03-27T09:59:28.124425+0000","last_active":"2024-03-27T09:59:35.231117+0000","last_peered":"2024-03-27T09:59:35.231117+0000","last_clean":"2024-03-27T09:59:35.231117+0000","last_became_active":"2024-03-27T09:59:28.123984+0000","last_became_peered":"2024-03-27T09:59:28.123984+0000","last_unstale":"2024-03-27T09:59:35.231117+0000","last_undegraded":"2024-03-27T09:59:35.231117+0000","last_fullsized":"2024-03-27T09:59:35.231117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:23:46.050666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.660006+0000","last_change":"2024-03-27T09:59:33.226956+0000","last_active":"2024-03-27T09:59:36.660006+0000","last_peered":"2024-03-27T09:59:36.660006+0000","last_clean":"2024-03-27T09:59:36.660006+0000","last_became_active":"2024-03-27T09:59:33.223863+0000","last_became_peered":"2024-03-27T09:59:33.223863+0000","last_unstale":"2024-03-27T09:59:36.660006+0000","last_undegraded":"2024-03-27T09:59:36.660006+0000","last_fullsized":"2024-03-27T09:59:36.660006+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:26:40.882057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.658826+0000","last_change":"2024-03-27T09:59:29.155035+0000","last_active":"2024-03-27T09:59:36.658826+0000","last_peered":"2024-03-27T09:59:36.658826+0000","last_clean":"2024-03-27T09:59:36.658826+0000","last_became_active":"2024-03-27T09:59:29.154671+0000","last_became_peered":"2024-03-27T09:59:29.154671+0000","last_unstale":"2024-03-27T09:59:36.658826+0000","last_undegraded":"2024-03-27T09:59:36.658826+0000","last_fullsized":"2024-03-27T09:59:36.658826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:45:14.005415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.791187+0000","last_change":"2024-03-27T09:59:28.121148+0000","last_active":"2024-03-27T09:59:36.791187+0000","last_peered":"2024-03-27T09:59:36.791187+0000","last_clean":"2024-03-27T09:59:36.791187+0000","last_became_active":"2024-03-27T09:59:28.120840+0000","last_became_peered":"2024-03-27T09:59:28.120840+0000","last_unstale":"2024-03-27T09:59:36.791187+0000","last_undegraded":"2024-03-27T09:59:36.791187+0000","last_fullsized":"2024-03-27T09:59:36.791187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:40:42.254670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.660494+0000","last_change":"2024-03-27T09:59:33.229618+0000","last_active":"2024-03-27T09:59:36.660494+0000","last_peered":"2024-03-27T09:59:36.660494+0000","last_clean":"2024-03-27T09:59:36.660494+0000","last_became_active":"2024-03-27T09:59:33.228741+0000","last_became_peered":"2024-03-27T09:59:33.228741+0000","last_unstale":"2024-03-27T09:59:36.660494+0000","last_undegraded":"2024-03-27T09:59:36.660494+0000","last_fullsized":"2024-03-27T09:59:36.660494+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T21:18:02.752241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.797279+0000","last_change":"2024-03-27T09:59:29.156381+0000","last_active":"2024-03-27T09:59:35.797279+0000","last_peered":"2024-03-27T09:59:35.797279+0000","last_clean":"2024-03-27T09:59:35.797279+0000","last_became_active":"2024-03-27T09:59:29.156084+0000","last_became_peered":"2024-03-27T09:59:29.156084+0000","last_unstale":"2024-03-27T09:59:35.797279+0000","last_undegraded":"2024-03-27T09:59:35.797279+0000","last_fullsized":"2024-03-27T09:59:35.797279+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:31:01.574841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.727058+0000","last_change":"2024-03-27T09:59:28.130798+0000","last_active":"2024-03-27T09:59:36.727058+0000","last_peered":"2024-03-27T09:59:36.727058+0000","last_clean":"2024-03-27T09:59:36.727058+0000","last_became_active":"2024-03-27T09:59:28.130023+0000","last_became_peered":"2024-03-27T09:59:28.130023+0000","last_unstale":"2024-03-27T09:59:36.727058+0000","last_undegraded":"2024-03-27T09:59:36.727058+0000","last_fullsized":"2024-03-27T09:59:36.727058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:20:35.358265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.798067+0000","last_change":"2024-03-27T09:59:33.708547+0000","last_active":"2024-03-27T09:59:35.798067+0000","last_peered":"2024-03-27T09:59:35.798067+0000","last_clean":"2024-03-27T09:59:35.798067+0000","last_became_active":"2024-03-27T09:59:33.707071+0000","last_became_peered":"2024-03-27T09:59:33.707071+0000","last_unstale":"2024-03-27T09:59:35.798067+0000","last_undegraded":"2024-03-27T09:59:35.798067+0000","last_fullsized":"2024-03-27T09:59:35.798067+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:58:34.321312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.599551+0000","last_change":"2024-03-27T09:59:29.149027+0000","last_active":"2024-03-27T09:59:35.599551+0000","last_peered":"2024-03-27T09:59:35.599551+0000","last_clean":"2024-03-27T09:59:35.599551+0000","last_became_active":"2024-03-27T09:59:29.148746+0000","last_became_peered":"2024-03-27T09:59:29.148746+0000","last_unstale":"2024-03-27T09:59:35.599551+0000","last_undegraded":"2024-03-27T09:59:35.599551+0000","last_fullsized":"2024-03-27T09:59:35.599551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:20:50.555376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.232120+0000","last_change":"2024-03-27T09:59:28.126435+0000","last_active":"2024-03-27T09:59:35.232120+0000","last_peered":"2024-03-27T09:59:35.232120+0000","last_clean":"2024-03-27T09:59:35.232120+0000","last_became_active":"2024-03-27T09:59:28.126154+0000","last_became_peered":"2024-03-27T09:59:28.126154+0000","last_unstale":"2024-03-27T09:59:35.232120+0000","last_undegraded":"2024-03-27T09:59:35.232120+0000","last_fullsized":"2024-03-27T09:59:35.232120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:20:35.358265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":180,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.727156+0000","last_change":"2024-03-27T09:59:19.234906+0000","last_active":"2024-03-27T09:59:36.727156+0000","last_peered":"2024-03-27T09:59:36.727156+0000","last_clean":"2024-03-27T09:59:36.727156+0000","last_became_active":"2024-03-27T09:59:19.234124+0000","last_became_peered":"2024-03-27T09:59:19.234124+0000","last_unstale":"2024-03-27T09:59:36.727156+0000","last_undegraded":"2024-03-27T09:59:36.727156+0000","last_fullsized":"2024-03-27T09:59:36.727156+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:17.974760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:17.974760+0000","last_clean_scrub_stamp":"2024-03-27T09:59:17.974760+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:24:35.357325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.230468+0000","last_change":"2024-03-27T09:59:33.707287+0000","last_active":"2024-03-27T09:59:35.230468+0000","last_peered":"2024-03-27T09:59:35.230468+0000","last_clean":"2024-03-27T09:59:35.230468+0000","last_became_active":"2024-03-27T09:59:33.706791+0000","last_became_peered":"2024-03-27T09:59:33.706791+0000","last_unstale":"2024-03-27T09:59:35.230468+0000","last_undegraded":"2024-03-27T09:59:35.230468+0000","last_fullsized":"2024-03-27T09:59:35.230468+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:03:49.254833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.728483+0000","last_change":"2024-03-27T09:59:29.150091+0000","last_active":"2024-03-27T09:59:36.728483+0000","last_peered":"2024-03-27T09:59:36.728483+0000","last_clean":"2024-03-27T09:59:36.728483+0000","last_became_active":"2024-03-27T09:59:29.149700+0000","last_became_peered":"2024-03-27T09:59:29.149700+0000","last_unstale":"2024-03-27T09:59:36.728483+0000","last_undegraded":"2024-03-27T09:59:36.728483+0000","last_fullsized":"2024-03-27T09:59:36.728483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:25:26.474648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.791238+0000","last_change":"2024-03-27T09:59:28.126811+0000","last_active":"2024-03-27T09:59:36.791238+0000","last_peered":"2024-03-27T09:59:36.791238+0000","last_clean":"2024-03-27T09:59:36.791238+0000","last_became_active":"2024-03-27T09:59:28.126359+0000","last_became_peered":"2024-03-27T09:59:28.126359+0000","last_unstale":"2024-03-27T09:59:36.791238+0000","last_undegraded":"2024-03-27T09:59:36.791238+0000","last_fullsized":"2024-03-27T09:59:36.791238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:35:50.131290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.231647+0000","last_change":"2024-03-27T09:59:33.699402+0000","last_active":"2024-03-27T09:59:35.231647+0000","last_peered":"2024-03-27T09:59:35.231647+0000","last_clean":"2024-03-27T09:59:35.231647+0000","last_became_active":"2024-03-27T09:59:33.697898+0000","last_became_peered":"2024-03-27T09:59:33.697898+0000","last_unstale":"2024-03-27T09:59:35.231647+0000","last_undegraded":"2024-03-27T09:59:35.231647+0000","last_fullsized":"2024-03-27T09:59:35.231647+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:07:54.369342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.231265+0000","last_change":"2024-03-27T09:59:29.148952+0000","last_active":"2024-03-27T09:59:35.231265+0000","last_peered":"2024-03-27T09:59:35.231265+0000","last_clean":"2024-03-27T09:59:35.231265+0000","last_became_active":"2024-03-27T09:59:29.148176+0000","last_became_peered":"2024-03-27T09:59:29.148176+0000","last_unstale":"2024-03-27T09:59:35.231265+0000","last_undegraded":"2024-03-27T09:59:35.231265+0000","last_fullsized":"2024-03-27T09:59:35.231265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T20:25:54.732855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.657787+0000","last_change":"2024-03-27T09:59:28.126237+0000","last_active":"2024-03-27T09:59:36.657787+0000","last_peered":"2024-03-27T09:59:36.657787+0000","last_clean":"2024-03-27T09:59:36.657787+0000","last_became_active":"2024-03-27T09:59:28.125955+0000","last_became_peered":"2024-03-27T09:59:28.125955+0000","last_unstale":"2024-03-27T09:59:36.657787+0000","last_undegraded":"2024-03-27T09:59:36.657787+0000","last_fullsized":"2024-03-27T09:59:36.657787+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:55:33.304260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.797749+0000","last_change":"2024-03-27T09:59:33.223667+0000","last_active":"2024-03-27T09:59:35.797749+0000","last_peered":"2024-03-27T09:59:35.797749+0000","last_clean":"2024-03-27T09:59:35.797749+0000","last_became_active":"2024-03-27T09:59:33.223275+0000","last_became_peered":"2024-03-27T09:59:33.223275+0000","last_unstale":"2024-03-27T09:59:35.797749+0000","last_undegraded":"2024-03-27T09:59:35.797749+0000","last_fullsized":"2024-03-27T09:59:35.797749+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T21:18:02.752241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.729264+0000","last_change":"2024-03-27T09:59:29.159775+0000","last_active":"2024-03-27T09:59:36.729264+0000","last_peered":"2024-03-27T09:59:36.729264+0000","last_clean":"2024-03-27T09:59:36.729264+0000","last_became_active":"2024-03-27T09:59:29.159484+0000","last_became_peered":"2024-03-27T09:59:29.159484+0000","last_unstale":"2024-03-27T09:59:36.729264+0000","last_undegraded":"2024-03-27T09:59:36.729264+0000","last_fullsized":"2024-03-27T09:59:36.729264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:03:45.164612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.791343+0000","last_change":"2024-03-27T09:59:28.121073+0000","last_active":"2024-03-27T09:59:36.791343+0000","last_peered":"2024-03-27T09:59:36.791343+0000","last_clean":"2024-03-27T09:59:36.791343+0000","last_became_active":"2024-03-27T09:59:28.120712+0000","last_became_peered":"2024-03-27T09:59:28.120712+0000","last_unstale":"2024-03-27T09:59:36.791343+0000","last_undegraded":"2024-03-27T09:59:36.791343+0000","last_fullsized":"2024-03-27T09:59:36.791343+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:13:29.201574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.230245+0000","last_change":"2024-03-27T09:59:33.707551+0000","last_active":"2024-03-27T09:59:35.230245+0000","last_peered":"2024-03-27T09:59:35.230245+0000","last_clean":"2024-03-27T09:59:35.230245+0000","last_became_active":"2024-03-27T09:59:33.702666+0000","last_became_peered":"2024-03-27T09:59:33.702666+0000","last_unstale":"2024-03-27T09:59:35.230245+0000","last_undegraded":"2024-03-27T09:59:35.230245+0000","last_fullsized":"2024-03-27T09:59:35.230245+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T21:18:02.752241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.728829+0000","last_change":"2024-03-27T09:59:29.165375+0000","last_active":"2024-03-27T09:59:36.728829+0000","last_peered":"2024-03-27T09:59:36.728829+0000","last_clean":"2024-03-27T09:59:36.728829+0000","last_became_active":"2024-03-27T09:59:29.164965+0000","last_became_peered":"2024-03-27T09:59:29.164965+0000","last_unstale":"2024-03-27T09:59:36.728829+0000","last_undegraded":"2024-03-27T09:59:36.728829+0000","last_fullsized":"2024-03-27T09:59:36.728829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:07:50.279121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.233583+0000","last_change":"2024-03-27T09:59:28.126548+0000","last_active":"2024-03-27T09:59:35.233583+0000","last_peered":"2024-03-27T09:59:35.233583+0000","last_clean":"2024-03-27T09:59:35.233583+0000","last_became_active":"2024-03-27T09:59:28.125963+0000","last_became_peered":"2024-03-27T09:59:28.125963+0000","last_unstale":"2024-03-27T09:59:35.233583+0000","last_undegraded":"2024-03-27T09:59:35.233583+0000","last_fullsized":"2024-03-27T09:59:35.233583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:59:55.319685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.228379+0000","last_change":"2024-03-27T09:59:33.220384+0000","last_active":"2024-03-27T09:59:35.228379+0000","last_peered":"2024-03-27T09:59:35.228379+0000","last_clean":"2024-03-27T09:59:35.228379+0000","last_became_active":"2024-03-27T09:59:33.219238+0000","last_became_peered":"2024-03-27T09:59:33.219238+0000","last_unstale":"2024-03-27T09:59:35.228379+0000","last_undegraded":"2024-03-27T09:59:35.228379+0000","last_fullsized":"2024-03-27T09:59:35.228379+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:03:34.498032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.727816+0000","last_change":"2024-03-27T09:59:29.159404+0000","last_active":"2024-03-27T09:59:36.727816+0000","last_peered":"2024-03-27T09:59:36.727816+0000","last_clean":"2024-03-27T09:59:36.727816+0000","last_became_active":"2024-03-27T09:59:29.159116+0000","last_became_peered":"2024-03-27T09:59:29.159116+0000","last_unstale":"2024-03-27T09:59:36.727816+0000","last_undegraded":"2024-03-27T09:59:36.727816+0000","last_fullsized":"2024-03-27T09:59:36.727816+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T20:51:12.586643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.791612+0000","last_change":"2024-03-27T09:59:28.130732+0000","last_active":"2024-03-27T09:59:36.791612+0000","last_peered":"2024-03-27T09:59:36.791612+0000","last_clean":"2024-03-27T09:59:36.791612+0000","last_became_active":"2024-03-27T09:59:28.128808+0000","last_became_peered":"2024-03-27T09:59:28.128808+0000","last_unstale":"2024-03-27T09:59:36.791612+0000","last_undegraded":"2024-03-27T09:59:36.791612+0000","last_fullsized":"2024-03-27T09:59:36.791612+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:23:46.050666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.798116+0000","last_change":"2024-03-27T09:59:33.208864+0000","last_active":"2024-03-27T09:59:35.798116+0000","last_peered":"2024-03-27T09:59:35.798116+0000","last_clean":"2024-03-27T09:59:35.798116+0000","last_became_active":"2024-03-27T09:59:33.208354+0000","last_became_peered":"2024-03-27T09:59:33.208354+0000","last_unstale":"2024-03-27T09:59:35.798116+0000","last_undegraded":"2024-03-27T09:59:35.798116+0000","last_fullsized":"2024-03-27T09:59:35.798116+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T20:00:16.571694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.229822+0000","last_change":"2024-03-27T09:59:29.158524+0000","last_active":"2024-03-27T09:59:35.229822+0000","last_peered":"2024-03-27T09:59:35.229822+0000","last_clean":"2024-03-27T09:59:35.229822+0000","last_became_active":"2024-03-27T09:59:29.157925+0000","last_became_peered":"2024-03-27T09:59:29.157925+0000","last_unstale":"2024-03-27T09:59:35.229822+0000","last_undegraded":"2024-03-27T09:59:35.229822+0000","last_fullsized":"2024-03-27T09:59:35.229822+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:53:03.077046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.231047+0000","last_change":"2024-03-27T09:59:28.115802+0000","last_active":"2024-03-27T09:59:35.231047+0000","last_peered":"2024-03-27T09:59:35.231047+0000","last_clean":"2024-03-27T09:59:35.231047+0000","last_became_active":"2024-03-27T09:59:28.115435+0000","last_became_peered":"2024-03-27T09:59:28.115435+0000","last_unstale":"2024-03-27T09:59:35.231047+0000","last_undegraded":"2024-03-27T09:59:35.231047+0000","last_fullsized":"2024-03-27T09:59:35.231047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:40:42.254670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.600958+0000","last_change":"2024-03-27T09:59:33.706037+0000","last_active":"2024-03-27T09:59:35.600958+0000","last_peered":"2024-03-27T09:59:35.600958+0000","last_clean":"2024-03-27T09:59:35.600958+0000","last_became_active":"2024-03-27T09:59:33.705650+0000","last_became_peered":"2024-03-27T09:59:33.705650+0000","last_unstale":"2024-03-27T09:59:35.600958+0000","last_undegraded":"2024-03-27T09:59:35.600958+0000","last_fullsized":"2024-03-27T09:59:35.600958+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:02:05.101162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.728065+0000","last_change":"2024-03-27T09:59:29.160438+0000","last_active":"2024-03-27T09:59:36.728065+0000","last_peered":"2024-03-27T09:59:36.728065+0000","last_clean":"2024-03-27T09:59:36.728065+0000","last_became_active":"2024-03-27T09:59:29.160087+0000","last_became_peered":"2024-03-27T09:59:29.160087+0000","last_unstale":"2024-03-27T09:59:36.728065+0000","last_undegraded":"2024-03-27T09:59:36.728065+0000","last_fullsized":"2024-03-27T09:59:36.728065+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:00:09.092063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.231089+0000","last_change":"2024-03-27T09:59:28.118112+0000","last_active":"2024-03-27T09:59:35.231089+0000","last_peered":"2024-03-27T09:59:35.231089+0000","last_clean":"2024-03-27T09:59:35.231089+0000","last_became_active":"2024-03-27T09:59:28.117828+0000","last_became_peered":"2024-03-27T09:59:28.117828+0000","last_unstale":"2024-03-27T09:59:35.231089+0000","last_undegraded":"2024-03-27T09:59:35.231089+0000","last_fullsized":"2024-03-27T09:59:35.231089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:13:29.201574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.599830+0000","last_change":"2024-03-27T09:59:33.700858+0000","last_active":"2024-03-27T09:59:35.599830+0000","last_peered":"2024-03-27T09:59:35.599830+0000","last_clean":"2024-03-27T09:59:35.599830+0000","last_became_active":"2024-03-27T09:59:33.700373+0000","last_became_peered":"2024-03-27T09:59:33.700373+0000","last_unstale":"2024-03-27T09:59:35.599830+0000","last_undegraded":"2024-03-27T09:59:35.599830+0000","last_fullsized":"2024-03-27T09:59:35.599830+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:25:25.072673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.798196+0000","last_change":"2024-03-27T09:59:29.169989+0000","last_active":"2024-03-27T09:59:35.798196+0000","last_peered":"2024-03-27T09:59:35.798196+0000","last_clean":"2024-03-27T09:59:35.798196+0000","last_became_active":"2024-03-27T09:59:29.169681+0000","last_became_peered":"2024-03-27T09:59:29.169681+0000","last_unstale":"2024-03-27T09:59:35.798196+0000","last_undegraded":"2024-03-27T09:59:35.798196+0000","last_fullsized":"2024-03-27T09:59:35.798196+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:16:28.449509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.798374+0000","last_change":"2024-03-27T09:59:28.129054+0000","last_active":"2024-03-27T09:59:35.798374+0000","last_peered":"2024-03-27T09:59:35.798374+0000","last_clean":"2024-03-27T09:59:35.798374+0000","last_became_active":"2024-03-27T09:59:28.128808+0000","last_became_peered":"2024-03-27T09:59:28.128808+0000","last_unstale":"2024-03-27T09:59:35.798374+0000","last_undegraded":"2024-03-27T09:59:35.798374+0000","last_fullsized":"2024-03-27T09:59:35.798374+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:03:46.932809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.232702+0000","last_change":"2024-03-27T09:59:33.703875+0000","last_active":"2024-03-27T09:59:35.232702+0000","last_peered":"2024-03-27T09:59:35.232702+0000","last_clean":"2024-03-27T09:59:35.232702+0000","last_became_active":"2024-03-27T09:59:33.702585+0000","last_became_peered":"2024-03-27T09:59:33.702585+0000","last_unstale":"2024-03-27T09:59:35.232702+0000","last_undegraded":"2024-03-27T09:59:35.232702+0000","last_fullsized":"2024-03-27T09:59:35.232702+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:58:34.321312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.728323+0000","last_change":"2024-03-27T09:59:29.158099+0000","last_active":"2024-03-27T09:59:36.728323+0000","last_peered":"2024-03-27T09:59:36.728323+0000","last_clean":"2024-03-27T09:59:36.728323+0000","last_became_active":"2024-03-27T09:59:29.157758+0000","last_became_peered":"2024-03-27T09:59:29.157758+0000","last_unstale":"2024-03-27T09:59:36.728323+0000","last_undegraded":"2024-03-27T09:59:36.728323+0000","last_fullsized":"2024-03-27T09:59:36.728323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:01:42.254664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'10","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:47.450737+0000","last_change":"2024-03-27T09:59:28.113383+0000","last_active":"2024-03-27T09:59:47.450737+0000","last_peered":"2024-03-27T09:59:47.450737+0000","last_clean":"2024-03-27T09:59:47.450737+0000","last_became_active":"2024-03-27T09:59:28.113082+0000","last_became_peered":"2024-03-27T09:59:28.113082+0000","last_unstale":"2024-03-27T09:59:47.450737+0000","last_undegraded":"2024-03-27T09:59:47.450737+0000","last_fullsized":"2024-03-27T09:59:47.450737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:13:29.201574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.659224+0000","last_change":"2024-03-27T09:59:33.216434+0000","last_active":"2024-03-27T09:59:36.659224+0000","last_peered":"2024-03-27T09:59:36.659224+0000","last_clean":"2024-03-27T09:59:36.659224+0000","last_became_active":"2024-03-27T09:59:33.215962+0000","last_became_peered":"2024-03-27T09:59:33.215962+0000","last_unstale":"2024-03-27T09:59:36.659224+0000","last_undegraded":"2024-03-27T09:59:36.659224+0000","last_fullsized":"2024-03-27T09:59:36.659224+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:21:56.509459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.233348+0000","last_change":"2024-03-27T09:59:29.148504+0000","last_active":"2024-03-27T09:59:35.233348+0000","last_peered":"2024-03-27T09:59:35.233348+0000","last_clean":"2024-03-27T09:59:35.233348+0000","last_became_active":"2024-03-27T09:59:29.148235+0000","last_became_peered":"2024-03-27T09:59:29.148235+0000","last_unstale":"2024-03-27T09:59:35.233348+0000","last_undegraded":"2024-03-27T09:59:35.233348+0000","last_fullsized":"2024-03-27T09:59:35.233348+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T12:53:31.902336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.657788+0000","last_change":"2024-03-27T09:59:28.119784+0000","last_active":"2024-03-27T09:59:36.657788+0000","last_peered":"2024-03-27T09:59:36.657788+0000","last_clean":"2024-03-27T09:59:36.657788+0000","last_became_active":"2024-03-27T09:59:28.119487+0000","last_became_peered":"2024-03-27T09:59:28.119487+0000","last_unstale":"2024-03-27T09:59:36.657788+0000","last_undegraded":"2024-03-27T09:59:36.657788+0000","last_fullsized":"2024-03-27T09:59:36.657788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:20:35.358265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.233153+0000","last_change":"2024-03-27T09:59:33.225724+0000","last_active":"2024-03-27T09:59:35.233153+0000","last_peered":"2024-03-27T09:59:35.233153+0000","last_clean":"2024-03-27T09:59:35.233153+0000","last_became_active":"2024-03-27T09:59:33.224979+0000","last_became_peered":"2024-03-27T09:59:33.224979+0000","last_unstale":"2024-03-27T09:59:35.233153+0000","last_undegraded":"2024-03-27T09:59:35.233153+0000","last_fullsized":"2024-03-27T09:59:35.233153+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:26:40.882057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.798367+0000","last_change":"2024-03-27T09:59:29.154101+0000","last_active":"2024-03-27T09:59:35.798367+0000","last_peered":"2024-03-27T09:59:35.798367+0000","last_clean":"2024-03-27T09:59:35.798367+0000","last_became_active":"2024-03-27T09:59:29.152850+0000","last_became_peered":"2024-03-27T09:59:29.152850+0000","last_unstale":"2024-03-27T09:59:35.798367+0000","last_undegraded":"2024-03-27T09:59:35.798367+0000","last_fullsized":"2024-03-27T09:59:35.798367+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T20:48:05.564784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.231860+0000","last_change":"2024-03-27T09:59:28.114582+0000","last_active":"2024-03-27T09:59:35.231860+0000","last_peered":"2024-03-27T09:59:35.231860+0000","last_clean":"2024-03-27T09:59:35.231860+0000","last_became_active":"2024-03-27T09:59:28.114287+0000","last_became_peered":"2024-03-27T09:59:28.114287+0000","last_unstale":"2024-03-27T09:59:35.231860+0000","last_undegraded":"2024-03-27T09:59:35.231860+0000","last_fullsized":"2024-03-27T09:59:35.231860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:55:33.304260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.599079+0000","last_change":"2024-03-27T09:59:33.225015+0000","last_active":"2024-03-27T09:59:35.599079+0000","last_peered":"2024-03-27T09:59:35.599079+0000","last_clean":"2024-03-27T09:59:35.599079+0000","last_became_active":"2024-03-27T09:59:33.224660+0000","last_became_peered":"2024-03-27T09:59:33.224660+0000","last_unstale":"2024-03-27T09:59:35.599079+0000","last_undegraded":"2024-03-27T09:59:35.599079+0000","last_fullsized":"2024-03-27T09:59:35.599079+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:22:38.863947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.231769+0000","last_change":"2024-03-27T09:59:29.168539+0000","last_active":"2024-03-27T09:59:35.231769+0000","last_peered":"2024-03-27T09:59:35.231769+0000","last_clean":"2024-03-27T09:59:35.231769+0000","last_became_active":"2024-03-27T09:59:29.168233+0000","last_became_peered":"2024-03-27T09:59:29.168233+0000","last_unstale":"2024-03-27T09:59:35.231769+0000","last_undegraded":"2024-03-27T09:59:35.231769+0000","last_fullsized":"2024-03-27T09:59:35.231769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:25:26.474648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.232327+0000","last_change":"2024-03-27T09:59:28.118980+0000","last_active":"2024-03-27T09:59:35.232327+0000","last_peered":"2024-03-27T09:59:35.232327+0000","last_clean":"2024-03-27T09:59:35.232327+0000","last_became_active":"2024-03-27T09:59:28.118617+0000","last_became_peered":"2024-03-27T09:59:28.118617+0000","last_unstale":"2024-03-27T09:59:35.232327+0000","last_undegraded":"2024-03-27T09:59:35.232327+0000","last_fullsized":"2024-03-27T09:59:35.232327+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:20:35.358265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.599375+0000","last_change":"2024-03-27T09:59:33.703257+0000","last_active":"2024-03-27T09:59:35.599375+0000","last_peered":"2024-03-27T09:59:35.599375+0000","last_clean":"2024-03-27T09:59:35.599375+0000","last_became_active":"2024-03-27T09:59:33.702264+0000","last_became_peered":"2024-03-27T09:59:33.702264+0000","last_unstale":"2024-03-27T09:59:35.599375+0000","last_undegraded":"2024-03-27T09:59:35.599375+0000","last_fullsized":"2024-03-27T09:59:35.599375+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:04:06.406267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.797590+0000","last_change":"2024-03-27T09:59:33.707371+0000","last_active":"2024-03-27T09:59:35.797590+0000","last_peered":"2024-03-27T09:59:35.797590+0000","last_clean":"2024-03-27T09:59:35.797590+0000","last_became_active":"2024-03-27T09:59:33.706609+0000","last_became_peered":"2024-03-27T09:59:33.706609+0000","last_unstale":"2024-03-27T09:59:35.797590+0000","last_undegraded":"2024-03-27T09:59:35.797590+0000","last_fullsized":"2024-03-27T09:59:35.797590+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:06:12.744793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.658398+0000","last_change":"2024-03-27T09:59:29.150732+0000","last_active":"2024-03-27T09:59:36.658398+0000","last_peered":"2024-03-27T09:59:36.658398+0000","last_clean":"2024-03-27T09:59:36.658398+0000","last_became_active":"2024-03-27T09:59:29.147814+0000","last_became_peered":"2024-03-27T09:59:29.147814+0000","last_unstale":"2024-03-27T09:59:36.658398+0000","last_undegraded":"2024-03-27T09:59:36.658398+0000","last_fullsized":"2024-03-27T09:59:36.658398+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:40:55.546423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.230076+0000","last_change":"2024-03-27T09:59:28.121927+0000","last_active":"2024-03-27T09:59:35.230076+0000","last_peered":"2024-03-27T09:59:35.230076+0000","last_clean":"2024-03-27T09:59:35.230076+0000","last_became_active":"2024-03-27T09:59:28.121549+0000","last_became_peered":"2024-03-27T09:59:28.121549+0000","last_unstale":"2024-03-27T09:59:35.230076+0000","last_undegraded":"2024-03-27T09:59:35.230076+0000","last_fullsized":"2024-03-27T09:59:35.230076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:40:42.254670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.232144+0000","last_change":"2024-03-27T09:59:33.224491+0000","last_active":"2024-03-27T09:59:35.232144+0000","last_peered":"2024-03-27T09:59:35.232144+0000","last_clean":"2024-03-27T09:59:35.232144+0000","last_became_active":"2024-03-27T09:59:33.223841+0000","last_became_peered":"2024-03-27T09:59:33.223841+0000","last_unstale":"2024-03-27T09:59:35.232144+0000","last_undegraded":"2024-03-27T09:59:35.232144+0000","last_fullsized":"2024-03-27T09:59:35.232144+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:02:21.892888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.599193+0000","last_change":"2024-03-27T09:59:29.161642+0000","last_active":"2024-03-27T09:59:35.599193+0000","last_peered":"2024-03-27T09:59:35.599193+0000","last_clean":"2024-03-27T09:59:35.599193+0000","last_became_active":"2024-03-27T09:59:29.155700+0000","last_became_peered":"2024-03-27T09:59:29.155700+0000","last_unstale":"2024-03-27T09:59:35.599193+0000","last_undegraded":"2024-03-27T09:59:35.599193+0000","last_fullsized":"2024-03-27T09:59:35.599193+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T21:36:52.561523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.599835+0000","last_change":"2024-03-27T09:59:28.111747+0000","last_active":"2024-03-27T09:59:35.599835+0000","last_peered":"2024-03-27T09:59:35.599835+0000","last_clean":"2024-03-27T09:59:35.599835+0000","last_became_active":"2024-03-27T09:59:28.111334+0000","last_became_peered":"2024-03-27T09:59:28.111334+0000","last_unstale":"2024-03-27T09:59:35.599835+0000","last_undegraded":"2024-03-27T09:59:35.599835+0000","last_fullsized":"2024-03-27T09:59:35.599835+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:35:50.131290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.232266+0000","last_change":"2024-03-27T09:59:28.115303+0000","last_active":"2024-03-27T09:59:35.232266+0000","last_peered":"2024-03-27T09:59:35.232266+0000","last_clean":"2024-03-27T09:59:35.232266+0000","last_became_active":"2024-03-27T09:59:28.113900+0000","last_became_peered":"2024-03-27T09:59:28.113900+0000","last_unstale":"2024-03-27T09:59:35.232266+0000","last_undegraded":"2024-03-27T09:59:35.232266+0000","last_fullsized":"2024-03-27T09:59:35.232266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:23:46.050666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.797870+0000","last_change":"2024-03-27T09:59:29.157943+0000","last_active":"2024-03-27T09:59:35.797870+0000","last_peered":"2024-03-27T09:59:35.797870+0000","last_clean":"2024-03-27T09:59:35.797870+0000","last_became_active":"2024-03-27T09:59:29.157663+0000","last_became_peered":"2024-03-27T09:59:29.157663+0000","last_unstale":"2024-03-27T09:59:35.797870+0000","last_undegraded":"2024-03-27T09:59:35.797870+0000","last_fullsized":"2024-03-27T09:59:35.797870+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:20:50.555376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.792577+0000","last_change":"2024-03-27T09:59:33.219540+0000","last_active":"2024-03-27T09:59:36.792577+0000","last_peered":"2024-03-27T09:59:36.792577+0000","last_clean":"2024-03-27T09:59:36.792577+0000","last_became_active":"2024-03-27T09:59:33.219085+0000","last_became_peered":"2024-03-27T09:59:33.219085+0000","last_unstale":"2024-03-27T09:59:36.792577+0000","last_undegraded":"2024-03-27T09:59:36.792577+0000","last_fullsized":"2024-03-27T09:59:36.792577+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:16:32.539730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.600218+0000","last_change":"2024-03-27T09:59:28.113237+0000","last_active":"2024-03-27T09:59:35.600218+0000","last_peered":"2024-03-27T09:59:35.600218+0000","last_clean":"2024-03-27T09:59:35.600218+0000","last_became_active":"2024-03-27T09:59:28.112995+0000","last_became_peered":"2024-03-27T09:59:28.112995+0000","last_unstale":"2024-03-27T09:59:35.600218+0000","last_undegraded":"2024-03-27T09:59:35.600218+0000","last_fullsized":"2024-03-27T09:59:35.600218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:27.061478+0000","last_clean_scrub_stamp":"2024-03-27T09:59:27.061478+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:03:46.932809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.229942+0000","last_change":"2024-03-27T09:59:29.142949+0000","last_active":"2024-03-27T09:59:35.229942+0000","last_peered":"2024-03-27T09:59:35.229942+0000","last_clean":"2024-03-27T09:59:35.229942+0000","last_became_active":"2024-03-27T09:59:29.142626+0000","last_became_peered":"2024-03-27T09:59:29.142626+0000","last_unstale":"2024-03-27T09:59:35.229942+0000","last_undegraded":"2024-03-27T09:59:35.229942+0000","last_fullsized":"2024-03-27T09:59:35.229942+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:20:36.372242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.600394+0000","last_change":"2024-03-27T09:59:33.226673+0000","last_active":"2024-03-27T09:59:35.600394+0000","last_peered":"2024-03-27T09:59:35.600394+0000","last_clean":"2024-03-27T09:59:35.600394+0000","last_became_active":"2024-03-27T09:59:33.226185+0000","last_became_peered":"2024-03-27T09:59:33.226185+0000","last_unstale":"2024-03-27T09:59:35.600394+0000","last_undegraded":"2024-03-27T09:59:35.600394+0000","last_fullsized":"2024-03-27T09:59:35.600394+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:32.165676+0000","last_clean_scrub_stamp":"2024-03-27T09:59:32.165676+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:17:46.912834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.229527+0000","last_change":"2024-03-27T09:59:29.159064+0000","last_active":"2024-03-27T09:59:35.229527+0000","last_peered":"2024-03-27T09:59:35.229527+0000","last_clean":"2024-03-27T09:59:35.229527+0000","last_became_active":"2024-03-27T09:59:29.158263+0000","last_became_peered":"2024-03-27T09:59:29.158263+0000","last_unstale":"2024-03-27T09:59:35.229527+0000","last_undegraded":"2024-03-27T09:59:35.229527+0000","last_fullsized":"2024-03-27T09:59:35.229527+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T21:36:52.561523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.791954+0000","last_change":"2024-03-27T09:59:29.148971+0000","last_active":"2024-03-27T09:59:36.791954+0000","last_peered":"2024-03-27T09:59:36.791954+0000","last_clean":"2024-03-27T09:59:36.791954+0000","last_became_active":"2024-03-27T09:59:29.148701+0000","last_became_peered":"2024-03-27T09:59:29.148701+0000","last_unstale":"2024-03-27T09:59:36.791954+0000","last_undegraded":"2024-03-27T09:59:36.791954+0000","last_fullsized":"2024-03-27T09:59:36.791954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T12:53:31.902336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.230981+0000","last_change":"2024-03-27T09:59:29.145218+0000","last_active":"2024-03-27T09:59:35.230981+0000","last_peered":"2024-03-27T09:59:35.230981+0000","last_clean":"2024-03-27T09:59:35.230981+0000","last_became_active":"2024-03-27T09:59:29.144927+0000","last_became_peered":"2024-03-27T09:59:29.144927+0000","last_unstale":"2024-03-27T09:59:35.230981+0000","last_undegraded":"2024-03-27T09:59:35.230981+0000","last_fullsized":"2024-03-27T09:59:35.230981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:12:08.142213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.797876+0000","last_change":"2024-03-27T09:59:29.155091+0000","last_active":"2024-03-27T09:59:35.797876+0000","last_peered":"2024-03-27T09:59:35.797876+0000","last_clean":"2024-03-27T09:59:35.797876+0000","last_became_active":"2024-03-27T09:59:29.153115+0000","last_became_peered":"2024-03-27T09:59:29.153115+0000","last_unstale":"2024-03-27T09:59:35.797876+0000","last_undegraded":"2024-03-27T09:59:35.797876+0000","last_fullsized":"2024-03-27T09:59:35.797876+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:40:55.546423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.600252+0000","last_change":"2024-03-27T09:59:29.139530+0000","last_active":"2024-03-27T09:59:35.600252+0000","last_peered":"2024-03-27T09:59:35.600252+0000","last_clean":"2024-03-27T09:59:35.600252+0000","last_became_active":"2024-03-27T09:59:29.135340+0000","last_became_peered":"2024-03-27T09:59:29.135340+0000","last_unstale":"2024-03-27T09:59:35.600252+0000","last_undegraded":"2024-03-27T09:59:35.600252+0000","last_fullsized":"2024-03-27T09:59:35.600252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T20:48:05.564784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.659487+0000","last_change":"2024-03-27T09:59:29.160480+0000","last_active":"2024-03-27T09:59:36.659487+0000","last_peered":"2024-03-27T09:59:36.659487+0000","last_clean":"2024-03-27T09:59:36.659487+0000","last_became_active":"2024-03-27T09:59:29.153116+0000","last_became_peered":"2024-03-27T09:59:29.153116+0000","last_unstale":"2024-03-27T09:59:36.659487+0000","last_undegraded":"2024-03-27T09:59:36.659487+0000","last_fullsized":"2024-03-27T09:59:36.659487+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:57:26.770369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.234256+0000","last_change":"2024-03-27T09:59:29.165741+0000","last_active":"2024-03-27T09:59:35.234256+0000","last_peered":"2024-03-27T09:59:35.234256+0000","last_clean":"2024-03-27T09:59:35.234256+0000","last_became_active":"2024-03-27T09:59:29.165448+0000","last_became_peered":"2024-03-27T09:59:29.165448+0000","last_unstale":"2024-03-27T09:59:35.234256+0000","last_undegraded":"2024-03-27T09:59:35.234256+0000","last_fullsized":"2024-03-27T09:59:35.234256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T20:48:05.564784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.601055+0000","last_change":"2024-03-27T09:59:29.128048+0000","last_active":"2024-03-27T09:59:35.601055+0000","last_peered":"2024-03-27T09:59:35.601055+0000","last_clean":"2024-03-27T09:59:35.601055+0000","last_became_active":"2024-03-27T09:59:29.127194+0000","last_became_peered":"2024-03-27T09:59:29.127194+0000","last_unstale":"2024-03-27T09:59:35.601055+0000","last_undegraded":"2024-03-27T09:59:35.601055+0000","last_fullsized":"2024-03-27T09:59:35.601055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T20:51:12.586643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.229823+0000","last_change":"2024-03-27T09:59:29.149715+0000","last_active":"2024-03-27T09:59:35.229823+0000","last_peered":"2024-03-27T09:59:35.229823+0000","last_clean":"2024-03-27T09:59:35.229823+0000","last_became_active":"2024-03-27T09:59:29.147816+0000","last_became_peered":"2024-03-27T09:59:29.147816+0000","last_unstale":"2024-03-27T09:59:35.229823+0000","last_undegraded":"2024-03-27T09:59:35.229823+0000","last_fullsized":"2024-03-27T09:59:35.229823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T20:48:05.564784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.599722+0000","last_change":"2024-03-27T09:59:29.127532+0000","last_active":"2024-03-27T09:59:35.599722+0000","last_peered":"2024-03-27T09:59:35.599722+0000","last_clean":"2024-03-27T09:59:35.599722+0000","last_became_active":"2024-03-27T09:59:29.126384+0000","last_became_peered":"2024-03-27T09:59:29.126384+0000","last_unstale":"2024-03-27T09:59:35.599722+0000","last_undegraded":"2024-03-27T09:59:35.599722+0000","last_fullsized":"2024-03-27T09:59:35.599722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:40:55.546423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.230828+0000","last_change":"2024-03-27T09:59:29.168460+0000","last_active":"2024-03-27T09:59:35.230828+0000","last_peered":"2024-03-27T09:59:35.230828+0000","last_clean":"2024-03-27T09:59:35.230828+0000","last_became_active":"2024-03-27T09:59:29.168082+0000","last_became_peered":"2024-03-27T09:59:29.168082+0000","last_unstale":"2024-03-27T09:59:35.230828+0000","last_undegraded":"2024-03-27T09:59:35.230828+0000","last_fullsized":"2024-03-27T09:59:35.230828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:00:09.092063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.797561+0000","last_change":"2024-03-27T09:59:29.169976+0000","last_active":"2024-03-27T09:59:35.797561+0000","last_peered":"2024-03-27T09:59:35.797561+0000","last_clean":"2024-03-27T09:59:35.797561+0000","last_became_active":"2024-03-27T09:59:29.169553+0000","last_became_peered":"2024-03-27T09:59:29.169553+0000","last_unstale":"2024-03-27T09:59:35.797561+0000","last_undegraded":"2024-03-27T09:59:35.797561+0000","last_fullsized":"2024-03-27T09:59:35.797561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T21:36:52.561523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.232376+0000","last_change":"2024-03-27T09:59:29.151159+0000","last_active":"2024-03-27T09:59:35.232376+0000","last_peered":"2024-03-27T09:59:35.232376+0000","last_clean":"2024-03-27T09:59:35.232376+0000","last_became_active":"2024-03-27T09:59:29.150521+0000","last_became_peered":"2024-03-27T09:59:29.150521+0000","last_unstale":"2024-03-27T09:59:35.232376+0000","last_undegraded":"2024-03-27T09:59:35.232376+0000","last_fullsized":"2024-03-27T09:59:35.232376+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:20:50.555376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.728796+0000","last_change":"2024-03-27T09:59:29.159754+0000","last_active":"2024-03-27T09:59:36.728796+0000","last_peered":"2024-03-27T09:59:36.728796+0000","last_clean":"2024-03-27T09:59:36.728796+0000","last_became_active":"2024-03-27T09:59:29.159451+0000","last_became_peered":"2024-03-27T09:59:29.159451+0000","last_unstale":"2024-03-27T09:59:36.728796+0000","last_undegraded":"2024-03-27T09:59:36.728796+0000","last_fullsized":"2024-03-27T09:59:36.728796+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:27:19.913918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.793121+0000","last_change":"2024-03-27T09:59:29.146745+0000","last_active":"2024-03-27T09:59:36.793121+0000","last_peered":"2024-03-27T09:59:36.793121+0000","last_clean":"2024-03-27T09:59:36.793121+0000","last_became_active":"2024-03-27T09:59:29.146399+0000","last_became_peered":"2024-03-27T09:59:29.146399+0000","last_unstale":"2024-03-27T09:59:36.793121+0000","last_undegraded":"2024-03-27T09:59:36.793121+0000","last_fullsized":"2024-03-27T09:59:36.793121+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:31:21.514709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.232127+0000","last_change":"2024-03-27T09:59:29.170756+0000","last_active":"2024-03-27T09:59:35.232127+0000","last_peered":"2024-03-27T09:59:35.232127+0000","last_clean":"2024-03-27T09:59:35.232127+0000","last_became_active":"2024-03-27T09:59:29.170483+0000","last_became_peered":"2024-03-27T09:59:29.170483+0000","last_unstale":"2024-03-27T09:59:35.232127+0000","last_undegraded":"2024-03-27T09:59:35.232127+0000","last_fullsized":"2024-03-27T09:59:35.232127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:01:42.254664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.229573+0000","last_change":"2024-03-27T09:59:29.156761+0000","last_active":"2024-03-27T09:59:35.229573+0000","last_peered":"2024-03-27T09:59:35.229573+0000","last_clean":"2024-03-27T09:59:35.229573+0000","last_became_active":"2024-03-27T09:59:29.156448+0000","last_became_peered":"2024-03-27T09:59:29.156448+0000","last_unstale":"2024-03-27T09:59:35.229573+0000","last_undegraded":"2024-03-27T09:59:35.229573+0000","last_fullsized":"2024-03-27T09:59:35.229573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:45:14.005415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.658573+0000","last_change":"2024-03-27T09:59:29.159241+0000","last_active":"2024-03-27T09:59:36.658573+0000","last_peered":"2024-03-27T09:59:36.658573+0000","last_clean":"2024-03-27T09:59:36.658573+0000","last_became_active":"2024-03-27T09:59:29.158935+0000","last_became_peered":"2024-03-27T09:59:29.158935+0000","last_unstale":"2024-03-27T09:59:36.658573+0000","last_undegraded":"2024-03-27T09:59:36.658573+0000","last_fullsized":"2024-03-27T09:59:36.658573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:53:03.077046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.798122+0000","last_change":"2024-03-27T09:59:29.150820+0000","last_active":"2024-03-27T09:59:35.798122+0000","last_peered":"2024-03-27T09:59:35.798122+0000","last_clean":"2024-03-27T09:59:35.798122+0000","last_became_active":"2024-03-27T09:59:29.150536+0000","last_became_peered":"2024-03-27T09:59:29.150536+0000","last_unstale":"2024-03-27T09:59:35.798122+0000","last_undegraded":"2024-03-27T09:59:35.798122+0000","last_fullsized":"2024-03-27T09:59:35.798122+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:53:03.077046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.599935+0000","last_change":"2024-03-27T09:59:29.148510+0000","last_active":"2024-03-27T09:59:35.599935+0000","last_peered":"2024-03-27T09:59:35.599935+0000","last_clean":"2024-03-27T09:59:35.599935+0000","last_became_active":"2024-03-27T09:59:29.146776+0000","last_became_peered":"2024-03-27T09:59:29.146776+0000","last_unstale":"2024-03-27T09:59:35.599935+0000","last_undegraded":"2024-03-27T09:59:35.599935+0000","last_fullsized":"2024-03-27T09:59:35.599935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:45:14.005415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.233211+0000","last_change":"2024-03-27T09:59:29.149815+0000","last_active":"2024-03-27T09:59:35.233211+0000","last_peered":"2024-03-27T09:59:35.233211+0000","last_clean":"2024-03-27T09:59:35.233211+0000","last_became_active":"2024-03-27T09:59:29.147082+0000","last_became_peered":"2024-03-27T09:59:29.147082+0000","last_unstale":"2024-03-27T09:59:35.233211+0000","last_undegraded":"2024-03-27T09:59:35.233211+0000","last_fullsized":"2024-03-27T09:59:35.233211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:31:21.514709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.230648+0000","last_change":"2024-03-27T09:59:29.147375+0000","last_active":"2024-03-27T09:59:35.230648+0000","last_peered":"2024-03-27T09:59:35.230648+0000","last_clean":"2024-03-27T09:59:35.230648+0000","last_became_active":"2024-03-27T09:59:29.147012+0000","last_became_peered":"2024-03-27T09:59:29.147012+0000","last_unstale":"2024-03-27T09:59:35.230648+0000","last_undegraded":"2024-03-27T09:59:35.230648+0000","last_fullsized":"2024-03-27T09:59:35.230648+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:40:55.546423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.234176+0000","last_change":"2024-03-27T09:59:29.156417+0000","last_active":"2024-03-27T09:59:35.234176+0000","last_peered":"2024-03-27T09:59:35.234176+0000","last_clean":"2024-03-27T09:59:35.234176+0000","last_became_active":"2024-03-27T09:59:29.156124+0000","last_became_peered":"2024-03-27T09:59:29.156124+0000","last_unstale":"2024-03-27T09:59:35.234176+0000","last_undegraded":"2024-03-27T09:59:35.234176+0000","last_fullsized":"2024-03-27T09:59:35.234176+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:45:14.005415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.729121+0000","last_change":"2024-03-27T09:59:29.169092+0000","last_active":"2024-03-27T09:59:36.729121+0000","last_peered":"2024-03-27T09:59:36.729121+0000","last_clean":"2024-03-27T09:59:36.729121+0000","last_became_active":"2024-03-27T09:59:29.168788+0000","last_became_peered":"2024-03-27T09:59:29.168788+0000","last_unstale":"2024-03-27T09:59:36.729121+0000","last_undegraded":"2024-03-27T09:59:36.729121+0000","last_fullsized":"2024-03-27T09:59:36.729121+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T20:25:54.732855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.598901+0000","last_change":"2024-03-27T09:59:29.157524+0000","last_active":"2024-03-27T09:59:35.598901+0000","last_peered":"2024-03-27T09:59:35.598901+0000","last_clean":"2024-03-27T09:59:35.598901+0000","last_became_active":"2024-03-27T09:59:29.153615+0000","last_became_peered":"2024-03-27T09:59:29.153615+0000","last_unstale":"2024-03-27T09:59:35.598901+0000","last_undegraded":"2024-03-27T09:59:35.598901+0000","last_fullsized":"2024-03-27T09:59:35.598901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:53:03.077046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.727620+0000","last_change":"2024-03-27T09:59:29.165201+0000","last_active":"2024-03-27T09:59:36.727620+0000","last_peered":"2024-03-27T09:59:36.727620+0000","last_clean":"2024-03-27T09:59:36.727620+0000","last_became_active":"2024-03-27T09:59:29.164845+0000","last_became_peered":"2024-03-27T09:59:29.164845+0000","last_unstale":"2024-03-27T09:59:36.727620+0000","last_undegraded":"2024-03-27T09:59:36.727620+0000","last_fullsized":"2024-03-27T09:59:36.727620+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:34:04.348561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.230702+0000","last_change":"2024-03-27T09:59:29.159124+0000","last_active":"2024-03-27T09:59:35.230702+0000","last_peered":"2024-03-27T09:59:35.230702+0000","last_clean":"2024-03-27T09:59:35.230702+0000","last_became_active":"2024-03-27T09:59:29.158654+0000","last_became_peered":"2024-03-27T09:59:29.158654+0000","last_unstale":"2024-03-27T09:59:35.230702+0000","last_undegraded":"2024-03-27T09:59:35.230702+0000","last_fullsized":"2024-03-27T09:59:35.230702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:34:04.348561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.727714+0000","last_change":"2024-03-27T09:59:29.150329+0000","last_active":"2024-03-27T09:59:36.727714+0000","last_peered":"2024-03-27T09:59:36.727714+0000","last_clean":"2024-03-27T09:59:36.727714+0000","last_became_active":"2024-03-27T09:59:29.150095+0000","last_became_peered":"2024-03-27T09:59:29.150095+0000","last_unstale":"2024-03-27T09:59:36.727714+0000","last_undegraded":"2024-03-27T09:59:36.727714+0000","last_fullsized":"2024-03-27T09:59:36.727714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:12:08.142213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.230685+0000","last_change":"2024-03-27T09:59:29.149230+0000","last_active":"2024-03-27T09:59:35.230685+0000","last_peered":"2024-03-27T09:59:35.230685+0000","last_clean":"2024-03-27T09:59:35.230685+0000","last_became_active":"2024-03-27T09:59:29.148669+0000","last_became_peered":"2024-03-27T09:59:29.148669+0000","last_unstale":"2024-03-27T09:59:35.230685+0000","last_undegraded":"2024-03-27T09:59:35.230685+0000","last_fullsized":"2024-03-27T09:59:35.230685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:27:19.913918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:35.798736+0000","last_change":"2024-03-27T09:59:29.151084+0000","last_active":"2024-03-27T09:59:35.798736+0000","last_peered":"2024-03-27T09:59:35.798736+0000","last_clean":"2024-03-27T09:59:35.798736+0000","last_became_active":"2024-03-27T09:59:29.149050+0000","last_became_peered":"2024-03-27T09:59:29.149050+0000","last_unstale":"2024-03-27T09:59:35.798736+0000","last_undegraded":"2024-03-27T09:59:35.798736+0000","last_fullsized":"2024-03-27T09:59:35.798736+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:40:55.617775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.660424+0000","last_change":"2024-03-27T09:59:29.160100+0000","last_active":"2024-03-27T09:59:36.660424+0000","last_peered":"2024-03-27T09:59:36.660424+0000","last_clean":"2024-03-27T09:59:36.660424+0000","last_became_active":"2024-03-27T09:59:29.158340+0000","last_became_peered":"2024-03-27T09:59:29.158340+0000","last_unstale":"2024-03-27T09:59:36.660424+0000","last_undegraded":"2024-03-27T09:59:36.660424+0000","last_fullsized":"2024-03-27T09:59:36.660424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:20:50.555376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-03-27T09:59:36.728983+0000","last_change":"2024-03-27T09:59:29.157565+0000","last_active":"2024-03-27T09:59:36.728983+0000","last_peered":"2024-03-27T09:59:36.728983+0000","last_clean":"2024-03-27T09:59:36.728983+0000","last_became_active":"2024-03-27T09:59:29.157278+0000","last_became_peered":"2024-03-27T09:59:29.157278+0000","last_unstale":"2024-03-27T09:59:36.728983+0000","last_undegraded":"2024-03-27T09:59:36.728983+0000","last_fullsized":"2024-03-27T09:59:36.728983+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:28.075454+0000","last_clean_scrub_stamp":"2024-03-27T09:59:28.075454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:03:30.407810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":14,"seq":60129542156,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31456,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340384,"statfs":{"total":96636764160,"available":96604553216,"internally_reserved":0,"allocated":286720,"data_stored":114786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542156,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":110944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542155,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":282624,"data_stored":111104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542155,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32040,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339800,"statfs":{"total":96636764160,"available":96603955200,"internally_reserved":0,"allocated":880640,"data_stored":701950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574861,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32036,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339804,"statfs":{"total":96636764160,"available":96603959296,"internally_reserved":0,"allocated":872448,"data_stored":701894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574860,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":286720,"data_stored":114786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":278528,"data_stored":111034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574860,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31460,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340380,"statfs":{"total":96636764160,"available":96604549120,"internally_reserved":0,"allocated":286720,"data_stored":111070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-27T10:00:04.181 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-03-27T10:00:04.181 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-03-27T10:00:04.181 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-03-27T10:00:04.181 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-03-27T10:00:04.439 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.449+0000 7f9dbb200640 1 Processor -- start 2024-03-27T10:00:04.440 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.450+0000 7f9dbb200640 1 -- start start 2024-03-27T10:00:04.447 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.451+0000 7f9dbb200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9dbc0d0690 0x7f9dbc168cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:04.447 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.451+0000 7f9dbb200640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9dbc0adab0 con 0x7f9dbc06db20 2024-03-27T10:00:04.448 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.451+0000 7f9dbb200640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9dbc0add90 con 0x7f9dbc1615c0 2024-03-27T10:00:04.448 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.451+0000 7f9dbb200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f9dbc0ae3e0 con 0x7f9dbc0d0690 2024-03-27T10:00:04.448 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.452+0000 7f9db3e00640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f9dbc06db20 0x7f9dbc0cff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:56760/0 (socket says 172.21.15.57:56760) 2024-03-27T10:00:04.448 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.452+0000 7f9db3e00640 1 -- 172.21.15.57:0/3573341994 learned_addr learned my addr 172.21.15.57:0/3573341994 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T10:00:04.448 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.452+0000 7f9dba800640 1 --2- 172.21.15.57:0/3573341994 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9dbc0d0690 0x7f9dbc168cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:04.448 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.452+0000 7f9db9400640 1 -- 172.21.15.57:0/3573341994 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 644744939 0 0) 0x7f9dbc0adab0 con 0x7f9dbc06db20 2024-03-27T10:00:04.449 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.452+0000 7f9db9400640 1 -- 172.21.15.57:0/3573341994 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9da0003520 con 0x7f9dbc06db20 2024-03-27T10:00:04.449 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.452+0000 7f9db9400640 1 -- 172.21.15.57:0/3573341994 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3996375107 0 0) 0x7f9da0003520 con 0x7f9dbc06db20 2024-03-27T10:00:04.449 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.452+0000 7f9db9400640 1 -- 172.21.15.57:0/3573341994 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9dbc0d0690 msgr2=0x7f9dbc168cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:04.449 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.452+0000 7f9db9400640 1 --2- 172.21.15.57:0/3573341994 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9dbc0d0690 0x7f9dbc168cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:04.449 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.452+0000 7f9db9400640 1 -- 172.21.15.57:0/3573341994 >> v1:172.21.15.118:6789/0 conn(0x7f9dbc1615c0 legacy=0x7f9dbc0b4590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:04.449 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.452+0000 7f9db9400640 1 -- 172.21.15.57:0/3573341994 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dbc0ae070 con 0x7f9dbc06db20 2024-03-27T10:00:04.450 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.452+0000 7f9db9400640 1 -- 172.21.15.57:0/3573341994 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4227751516 0 0) 0x7f9da4001670 con 0x7f9dbc06db20 2024-03-27T10:00:04.450 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.453+0000 7f9db9400640 1 -- 172.21.15.57:0/3573341994 >> v1:172.21.15.57:6789/0 conn(0x7f9dbc06db20 legacy=0x7f9dbc0cff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:04.450 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.453+0000 7f9db9400640 1 --2- 172.21.15.57:0/3573341994 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9da00039e0 0x7f9da0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:04.450 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.453+0000 7f9db9400640 1 --2- 172.21.15.57:0/3573341994 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9da0004800 0x7f9da0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:04.450 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.453+0000 7f9db9400640 1 --2- 172.21.15.57:0/3573341994 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9dbc0d0690 0x7f9da00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:04.450 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.453+0000 7f9db9400640 1 -- 172.21.15.57:0/3573341994 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f9dbc0ae3e0 con 0x7f9da00039e0 2024-03-27T10:00:04.450 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.453+0000 7f9db9400640 1 -- 172.21.15.57:0/3573341994 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f9da000bad0 con 0x7f9da0004800 2024-03-27T10:00:04.451 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.453+0000 7f9db9400640 1 -- 172.21.15.57:0/3573341994 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f9da000bcd0 con 0x7f9dbc0d0690 2024-03-27T10:00:04.451 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.453+0000 7f9db9e00640 1 --2- 172.21.15.57:0/3573341994 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9da00039e0 0x7f9da0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:04.451 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.453+0000 7f9db9e00640 1 -- 172.21.15.57:0/3573341994 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9dbc0d0690 msgr2=0x7f9da00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:04.451 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.453+0000 7f9db9e00640 1 --2- 172.21.15.57:0/3573341994 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9dbc0d0690 0x7f9da00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:04.451 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.453+0000 7f9db9e00640 1 -- 172.21.15.57:0/3573341994 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9da0004800 msgr2=0x7f9da0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:04.451 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.453+0000 7f9db9e00640 1 --2- 172.21.15.57:0/3573341994 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9da0004800 0x7f9da0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:04.451 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.453+0000 7f9db9e00640 1 -- 172.21.15.57:0/3573341994 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9da0003520 con 0x7f9da00039e0 2024-03-27T10:00:04.452 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.454+0000 7f9db9e00640 1 --2- 172.21.15.57:0/3573341994 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9da00039e0 0x7f9da0003e00 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9dac001720 tx=0x7f9da0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56657a8d670d349f server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:04.452 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.455+0000 7f9db9400640 1 -- 172.21.15.57:0/3573341994 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dac001370 con 0x7f9da00039e0 2024-03-27T10:00:04.452 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.455+0000 7f9db9400640 1 -- 172.21.15.57:0/3573341994 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dac0052d0 con 0x7f9da00039e0 2024-03-27T10:00:04.452 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.455+0000 7f9db9400640 1 -- 172.21.15.57:0/3573341994 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dac003830 con 0x7f9da00039e0 2024-03-27T10:00:04.452 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.455+0000 7f9dbb200640 1 -- 172.21.15.57:0/3573341994 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9da00039e0 msgr2=0x7f9da0003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:04.452 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.455+0000 7f9dbb200640 1 --2- 172.21.15.57:0/3573341994 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9da00039e0 0x7f9da0003e00 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9dac001720 tx=0x7f9da0005830 comp rx=0 tx=0).stop 2024-03-27T10:00:04.453 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.455+0000 7f9dba800640 1 -- 172.21.15.57:0/3573341994 reap_dead start 2024-03-27T10:00:04.453 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.455+0000 7f9dbb200640 1 -- 172.21.15.57:0/3573341994 shutdown_connections 2024-03-27T10:00:04.453 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.455+0000 7f9dbb200640 1 -- 172.21.15.57:0/3573341994 >> 172.21.15.57:0/3573341994 conn(0x7f9dbc06b990 msgr2=0x7f9dbc06bda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:04.453 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.455+0000 7f9dbb200640 1 -- 172.21.15.57:0/3573341994 shutdown_connections 2024-03-27T10:00:04.453 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.455+0000 7f9dbb200640 1 -- 172.21.15.57:0/3573341994 wait complete. 2024-03-27T10:00:04.453 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.457+0000 7f9dbb200640 1 Processor -- start 2024-03-27T10:00:04.454 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.457+0000 7f9dbb200640 1 -- start start 2024-03-27T10:00:04.459 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.458+0000 7f9dbb200640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9da00039e0 0x7f9dbc0c8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:04.459 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.458+0000 7f9dbb200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9dbc1526f0 0x7f9dbc0cbc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:04.459 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.458+0000 7f9dbb200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9dbc15f620 0x7f9dbc15faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:04.459 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.458+0000 7f9dbb200640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f9dbc0b3d80 con 0x7f9da00039e0 2024-03-27T10:00:04.459 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.458+0000 7f9dbb200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f9dbc0ae870 con 0x7f9dbc15f620 2024-03-27T10:00:04.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.458+0000 7f9dbb200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f9dbc0b3f00 con 0x7f9dbc1526f0 2024-03-27T10:00:04.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.458+0000 7f9db9e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9da00039e0 0x7f9dbc0c8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:04.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.458+0000 7f9db9e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9da00039e0 0x7f9dbc0c8dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55078/0 (socket says 172.21.15.57:55078) 2024-03-27T10:00:04.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.458+0000 7f9db9e00640 1 -- 172.21.15.57:0/2910554722 learned_addr learned my addr 172.21.15.57:0/2910554722 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:04.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.459+0000 7f9db3e00640 1 --2- 172.21.15.57:0/2910554722 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9dbc1526f0 0x7f9dbc0cbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:04.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.459+0000 7f9db9e00640 1 -- 172.21.15.57:0/2910554722 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9dbc1526f0 msgr2=0x7f9dbc0cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:04.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.459+0000 7f9dba800640 1 --2- 172.21.15.57:0/2910554722 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9dbc15f620 0x7f9dbc15faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:04.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.459+0000 7f9db9e00640 1 --2- 172.21.15.57:0/2910554722 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9dbc1526f0 0x7f9dbc0cbc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:04.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.459+0000 7f9db9e00640 1 -- 172.21.15.57:0/2910554722 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9dbc15f620 msgr2=0x7f9dbc15faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:04.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.459+0000 7f9db9e00640 1 --2- 172.21.15.57:0/2910554722 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9dbc15f620 0x7f9dbc15faa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:04.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.459+0000 7f9db9e00640 1 -- 172.21.15.57:0/2910554722 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dbc0c9300 con 0x7f9da00039e0 2024-03-27T10:00:04.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.459+0000 7f9db9e00640 1 --2- 172.21.15.57:0/2910554722 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9da00039e0 0x7f9dbc0c8dc0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f9dac008fd0 tx=0x7f9dac001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:04.462 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.459+0000 7f9db2000640 1 -- 172.21.15.57:0/2910554722 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dac041070 con 0x7f9da00039e0 2024-03-27T10:00:04.462 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.459+0000 7f9db2000640 1 -- 172.21.15.57:0/2910554722 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dac005480 con 0x7f9da00039e0 2024-03-27T10:00:04.462 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.459+0000 7f9db2000640 1 -- 172.21.15.57:0/2910554722 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dac007a30 con 0x7f9da00039e0 2024-03-27T10:00:04.462 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.459+0000 7f9dbb200640 1 -- 172.21.15.57:0/2910554722 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9dbc0cabd0 con 0x7f9da00039e0 2024-03-27T10:00:04.462 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.460+0000 7f9dbb200640 1 -- 172.21.15.57:0/2910554722 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9dbc0cb190 con 0x7f9da00039e0 2024-03-27T10:00:04.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.461+0000 7f9dbb200640 1 -- 172.21.15.57:0/2910554722 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9dbc068540 con 0x7f9da00039e0 2024-03-27T10:00:04.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.462+0000 7f9db2000640 1 -- 172.21.15.57:0/2910554722 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f9dac044070 con 0x7f9da00039e0 2024-03-27T10:00:04.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.462+0000 7f9db2000640 1 --2- 172.21.15.57:0/2910554722 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f9d9806c530 0x7f9d9806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:04.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.463+0000 7f9db2000640 1 -- 172.21.15.57:0/2910554722 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f9dac0ad680 con 0x7f9da00039e0 2024-03-27T10:00:04.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.463+0000 7f9db3e00640 1 --2- 172.21.15.57:0/2910554722 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f9d9806c530 0x7f9d9806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:04.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.463+0000 7f9db3e00640 1 --2- 172.21.15.57:0/2910554722 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f9d9806c530 0x7f9d9806e9f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc0b0eb0 tx=0x7f9da4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:04.464 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.467+0000 7f9db2000640 1 -- 172.21.15.57:0/2910554722 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f9dac07b8c0 con 0x7f9da00039e0 2024-03-27T10:00:04.700 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.710+0000 7f9dbb200640 1 -- 172.21.15.57:0/2910554722 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f9dbc0ccdf0 con 0x7f9da00039e0 2024-03-27T10:00:04.701 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.711+0000 7f9db2000640 1 -- 172.21.15.57:0/2910554722 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f9dac07b1c0 con 0x7f9da00039e0 2024-03-27T10:00:04.701 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:00:04.701 INFO:teuthology.orchestra.run.smithi057.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-03-27T10:00:04.704 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.714+0000 7f9dbb200640 1 -- 172.21.15.57:0/2910554722 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f9d9806c530 msgr2=0x7f9d9806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:04.704 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.714+0000 7f9dbb200640 1 --2- 172.21.15.57:0/2910554722 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f9d9806c530 0x7f9d9806e9f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc0b0eb0 tx=0x7f9da4009040 comp rx=0 tx=0).stop 2024-03-27T10:00:04.704 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.714+0000 7f9dbb200640 1 -- 172.21.15.57:0/2910554722 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9da00039e0 msgr2=0x7f9dbc0c8dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:04.704 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.714+0000 7f9dbb200640 1 --2- 172.21.15.57:0/2910554722 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9da00039e0 0x7f9dbc0c8dc0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f9dac008fd0 tx=0x7f9dac001120 comp rx=0 tx=0).stop 2024-03-27T10:00:04.704 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.714+0000 7f9dbb200640 1 -- 172.21.15.57:0/2910554722 shutdown_connections 2024-03-27T10:00:04.704 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.714+0000 7f9dbb200640 1 --2- 172.21.15.57:0/2910554722 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f9d9806c530 0x7f9d9806e9f0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:04.705 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.714+0000 7f9dbb200640 1 --2- 172.21.15.57:0/2910554722 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9dbc15f620 0x7f9dbc15faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:04.705 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.714+0000 7f9dbb200640 1 --2- 172.21.15.57:0/2910554722 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9dbc1526f0 0x7f9dbc0cbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:04.705 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.714+0000 7f9dbb200640 1 --2- 172.21.15.57:0/2910554722 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9da00039e0 0x7f9dbc0c8dc0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:04.705 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.714+0000 7f9dbb200640 1 -- 172.21.15.57:0/2910554722 >> 172.21.15.57:0/2910554722 conn(0x7f9dbc06b990 msgr2=0x7f9dbc0b1750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:04.705 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.714+0000 7f9dbb200640 1 -- 172.21.15.57:0/2910554722 shutdown_connections 2024-03-27T10:00:04.705 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.714+0000 7f9dbb200640 1 -- 172.21.15.57:0/2910554722 wait complete. 2024-03-27T10:00:04.724 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-03-27T10:00:04.725 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-27T10:00:04.949 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.959+0000 7f95a6a00640 1 Processor -- start 2024-03-27T10:00:04.950 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.960+0000 7f95a6a00640 1 -- start start 2024-03-27T10:00:04.951 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.961+0000 7f95a6a00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f95a015c200 0x7f95a00add70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:04.951 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.961+0000 7f95a6a00640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95a00b3ec0 con 0x7f95a006bc50 2024-03-27T10:00:04.951 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.961+0000 7f95a6a00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95a00b41a0 con 0x7f95a009ed10 2024-03-27T10:00:04.952 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.961+0000 7f95a6a00640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f95a00b4480 con 0x7f95a015c200 2024-03-27T10:00:04.952 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.962+0000 7f95a4a00640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f95a006bc50 0x7f95a00b51b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:56766/0 (socket says 172.21.15.57:56766) 2024-03-27T10:00:04.953 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.962+0000 7f95a4a00640 1 -- 172.21.15.57:0/691125204 learned_addr learned my addr 172.21.15.57:0/691125204 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T10:00:04.953 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.962+0000 7f959fe00640 1 --2- 172.21.15.57:0/691125204 >> v2:172.21.15.57:3300/0 conn(0x7f95a015c200 0x7f95a00add70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:04.953 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.962+0000 7f959ea00640 1 -- 172.21.15.57:0/691125204 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 970256823 0 0) 0x7f95a00b3ec0 con 0x7f95a006bc50 2024-03-27T10:00:04.953 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.962+0000 7f959ea00640 1 -- 172.21.15.57:0/691125204 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9584003520 con 0x7f95a006bc50 2024-03-27T10:00:04.953 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.963+0000 7f959fe00640 1 -- 172.21.15.57:0/691125204 >> v1:172.21.15.118:6789/0 conn(0x7f95a009ed10 legacy=0x7f95a006b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:04.953 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.963+0000 7f959fe00640 1 -- 172.21.15.57:0/691125204 >> v1:172.21.15.57:6789/0 conn(0x7f95a006bc50 legacy=0x7f95a00b51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:04.953 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.963+0000 7f959fe00640 1 -- 172.21.15.57:0/691125204 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95a00b4760 con 0x7f95a015c200 2024-03-27T10:00:04.954 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.964+0000 7f959fe00640 1 --2- 172.21.15.57:0/691125204 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f95a015c200 0x7f95a00add70 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f95900097a0 tx=0x7f959002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5d31e8e37acda74 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:04.954 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.965+0000 7f959ea00640 1 -- 172.21.15.57:0/691125204 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95900315a0 con 0x7f95a015c200 2024-03-27T10:00:04.954 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.965+0000 7f959ea00640 1 -- 172.21.15.57:0/691125204 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9590037070 con 0x7f95a015c200 2024-03-27T10:00:04.955 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.965+0000 7f959ea00640 1 -- 172.21.15.57:0/691125204 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9590031940 con 0x7f95a015c200 2024-03-27T10:00:04.956 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.965+0000 7f95a6a00640 1 -- 172.21.15.57:0/691125204 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f95a015c200 msgr2=0x7f95a00add70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:04.956 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.965+0000 7f95a6a00640 1 --2- 172.21.15.57:0/691125204 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f95a015c200 0x7f95a00add70 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f95900097a0 tx=0x7f959002b840 comp rx=0 tx=0).stop 2024-03-27T10:00:04.956 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.965+0000 7f95a6a00640 1 -- 172.21.15.57:0/691125204 shutdown_connections 2024-03-27T10:00:04.956 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.965+0000 7f95a6a00640 1 --2- 172.21.15.57:0/691125204 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f95a015c200 0x7f95a00add70 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:04.956 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.965+0000 7f95a6a00640 1 -- 172.21.15.57:0/691125204 >> 172.21.15.57:0/691125204 conn(0x7f95a00b2a90 msgr2=0x7f95a00b2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:04.956 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.965+0000 7f95a6a00640 1 -- 172.21.15.57:0/691125204 shutdown_connections 2024-03-27T10:00:04.956 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.965+0000 7f95a6a00640 1 -- 172.21.15.57:0/691125204 wait complete. 2024-03-27T10:00:04.957 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.967+0000 7f95a6a00640 1 Processor -- start 2024-03-27T10:00:04.957 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.967+0000 7f95a6a00640 1 -- start start 2024-03-27T10:00:04.958 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.968+0000 7f95a6a00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f95a006bc50 0x7f95a01e67f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:04.958 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.968+0000 7f95a6a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f95a009ed10 0x7f95a006eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:04.958 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.968+0000 7f95a6a00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f95a015c200 0x7f95a01e76a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:04.958 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.968+0000 7f95a6a00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f95a00ae430 con 0x7f95a006bc50 2024-03-27T10:00:04.958 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.968+0000 7f95a6a00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f95a00ae2b0 con 0x7f95a009ed10 2024-03-27T10:00:04.958 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.968+0000 7f95a6a00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f95a015c5e0 con 0x7f95a015c200 2024-03-27T10:00:04.959 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.969+0000 7f959fe00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f95a006bc50 0x7f95a01e67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:04.959 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.969+0000 7f959fe00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f95a006bc50 0x7f95a01e67f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55096/0 (socket says 172.21.15.57:55096) 2024-03-27T10:00:04.960 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.969+0000 7f959fe00640 1 -- 172.21.15.57:0/1816978936 learned_addr learned my addr 172.21.15.57:0/1816978936 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:04.960 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.969+0000 7f95a4a00640 1 --2- 172.21.15.57:0/1816978936 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f95a015c200 0x7f95a01e76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:04.960 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.969+0000 7f959f400640 1 --2- 172.21.15.57:0/1816978936 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f95a009ed10 0x7f95a006eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:04.960 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.969+0000 7f959fe00640 1 -- 172.21.15.57:0/1816978936 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f95a015c200 msgr2=0x7f95a01e76a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:04.960 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.969+0000 7f959fe00640 1 --2- 172.21.15.57:0/1816978936 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f95a015c200 0x7f95a01e76a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:04.960 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.969+0000 7f959fe00640 1 -- 172.21.15.57:0/1816978936 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f95a009ed10 msgr2=0x7f95a006eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:04.960 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.969+0000 7f959fe00640 1 --2- 172.21.15.57:0/1816978936 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f95a009ed10 0x7f95a006eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:04.960 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.969+0000 7f959fe00640 1 -- 172.21.15.57:0/1816978936 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95a01e6d30 con 0x7f95a006bc50 2024-03-27T10:00:04.960 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.970+0000 7f959fe00640 1 --2- 172.21.15.57:0/1816978936 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f95a006bc50 0x7f95a01e67f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f95900098c0 tx=0x7f95900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:04.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.970+0000 7f9597e00640 1 -- 172.21.15.57:0/1816978936 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9590006e10 con 0x7f95a006bc50 2024-03-27T10:00:04.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.970+0000 7f9597e00640 1 -- 172.21.15.57:0/1816978936 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95900315a0 con 0x7f95a006bc50 2024-03-27T10:00:04.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.970+0000 7f9597e00640 1 -- 172.21.15.57:0/1816978936 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9590031990 con 0x7f95a006bc50 2024-03-27T10:00:04.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.970+0000 7f95a6a00640 1 -- 172.21.15.57:0/1816978936 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95a01e8010 con 0x7f95a006bc50 2024-03-27T10:00:04.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.970+0000 7f95a6a00640 1 -- 172.21.15.57:0/1816978936 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95a01e62d0 con 0x7f95a006bc50 2024-03-27T10:00:04.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.972+0000 7f95a6a00640 1 -- 172.21.15.57:0/1816978936 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95a01e64d0 con 0x7f95a006bc50 2024-03-27T10:00:04.962 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.973+0000 7f9597e00640 1 -- 172.21.15.57:0/1816978936 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f9590031b30 con 0x7f95a006bc50 2024-03-27T10:00:04.963 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.973+0000 7f9597e00640 1 --2- 172.21.15.57:0/1816978936 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f957c06c560 0x7f957c06ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:04.963 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.974+0000 7f9597e00640 1 -- 172.21.15.57:0/1816978936 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f959002f030 con 0x7f95a006bc50 2024-03-27T10:00:04.963 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.974+0000 7f959f400640 1 --2- 172.21.15.57:0/1816978936 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f957c06c560 0x7f957c06ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:04.964 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.975+0000 7f959f400640 1 --2- 172.21.15.57:0/1816978936 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f957c06c560 0x7f957c06ea20 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f95a01e8c20 tx=0x7f9588009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:04.968 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:04.978+0000 7f9597e00640 1 -- 172.21.15.57:0/1816978936 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f95a01e64d0 con 0x7f95a006bc50 2024-03-27T10:00:05.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.185+0000 7f95a6a00640 1 -- 172.21.15.57:0/1816978936 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f95a0068c50 con 0x7f95a006bc50 2024-03-27T10:00:05.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.188+0000 7f9597e00640 1 -- 172.21.15.57:0/1816978936 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18502 (secure 0 0 0) 0x7f959007bea0 con 0x7f95a006bc50 2024-03-27T10:00:05.178 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:00:05.179 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":26,"fsid":"7ac43f86-2c16-4a97-98fb-715d3cebc75c","created":"2024-03-27T09:59:04.033417+0000","modified":"2024-03-27T09:59:35.208743+0000","last_up_change":"2024-03-27T09:59:16.969624+0000","last_in_change":"2024-03-27T09:59:07.421690+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-27T09:59:17.253008+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-27T09:59:26.690365+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-27T09:59:27.559059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-27T09:59:31.187596+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"47b44362-7302-4f2a-b735-582c6c3850cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6801","nonce":2020036298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6803","nonce":2020036298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6807","nonce":2020036298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6805","nonce":2020036298}]},"public_addr":"172.21.15.57:6801/2020036298","cluster_addr":"172.21.15.57:6803/2020036298","heartbeat_back_addr":"172.21.15.57:6807/2020036298","heartbeat_front_addr":"172.21.15.57:6805/2020036298","state":["exists","up"]},{"osd":1,"uuid":"feaf96f0-9431-4188-9a09-da505b40e934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6809","nonce":3190929242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6811","nonce":3190929242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6815","nonce":3190929242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6813","nonce":3190929242}]},"public_addr":"172.21.15.57:6809/3190929242","cluster_addr":"172.21.15.57:6811/3190929242","heartbeat_back_addr":"172.21.15.57:6815/3190929242","heartbeat_front_addr":"172.21.15.57:6813/3190929242","state":["exists","up"]},{"osd":2,"uuid":"21e406e6-cfbc-4fe7-a816-e2420487c95d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6817","nonce":4065849973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6819","nonce":4065849973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6823","nonce":4065849973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6821","nonce":4065849973}]},"public_addr":"172.21.15.57:6817/4065849973","cluster_addr":"172.21.15.57:6819/4065849973","heartbeat_back_addr":"172.21.15.57:6823/4065849973","heartbeat_front_addr":"172.21.15.57:6821/4065849973","state":["exists","up"]},{"osd":3,"uuid":"a389af1d-76c4-4dfc-b215-f983f4931257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6825","nonce":158084809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6827","nonce":158084809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6831","nonce":158084809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6829","nonce":158084809}]},"public_addr":"172.21.15.57:6825/158084809","cluster_addr":"172.21.15.57:6827/158084809","heartbeat_back_addr":"172.21.15.57:6831/158084809","heartbeat_front_addr":"172.21.15.57:6829/158084809","state":["exists","up"]},{"osd":4,"uuid":"e9b05dca-557a-43ee-b43f-9ce5b7d28304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6823","nonce":108719401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6827","nonce":108719401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6831","nonce":108719401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6829","nonce":108719401}]},"public_addr":"172.21.15.118:6823/108719401","cluster_addr":"172.21.15.118:6827/108719401","heartbeat_back_addr":"172.21.15.118:6831/108719401","heartbeat_front_addr":"172.21.15.118:6829/108719401","state":["exists","up"]},{"osd":5,"uuid":"d968177d-44ff-499a-b00a-b147ed879253","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6817","nonce":2704605866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6819","nonce":2704605866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6826","nonce":2704605866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6822","nonce":2704605866}]},"public_addr":"172.21.15.118:6817/2704605866","cluster_addr":"172.21.15.118:6819/2704605866","heartbeat_back_addr":"172.21.15.118:6826/2704605866","heartbeat_front_addr":"172.21.15.118:6822/2704605866","state":["exists","up"]},{"osd":6,"uuid":"e8f98052-e6ad-4cfe-a4a9-0b17a434d54e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6801","nonce":1963659095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6803","nonce":1963659095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6807","nonce":1963659095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6805","nonce":1963659095}]},"public_addr":"172.21.15.118:6801/1963659095","cluster_addr":"172.21.15.118:6803/1963659095","heartbeat_back_addr":"172.21.15.118:6807/1963659095","heartbeat_front_addr":"172.21.15.118:6805/1963659095","state":["exists","up"]},{"osd":7,"uuid":"eccff987-8e51-4a63-845a-cf0a3196d7fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6809","nonce":1955879596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6811","nonce":1955879596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6815","nonce":1955879596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6813","nonce":1955879596}]},"public_addr":"172.21.15.118:6809/1955879596","cluster_addr":"172.21.15.118:6811/1955879596","heartbeat_back_addr":"172.21.15.118:6815/1955879596","heartbeat_front_addr":"172.21.15.118:6813/1955879596","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.721258+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.696610+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.777895+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.806769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.743259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.845687+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:13.020165+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.722294+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-27T10:00:05.181 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.191+0000 7f95a6a00640 1 -- 172.21.15.57:0/1816978936 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f957c06c560 msgr2=0x7f957c06ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:05.181 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.191+0000 7f95a6a00640 1 --2- 172.21.15.57:0/1816978936 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f957c06c560 0x7f957c06ea20 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f95a01e8c20 tx=0x7f9588009040 comp rx=0 tx=0).stop 2024-03-27T10:00:05.181 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.191+0000 7f95a6a00640 1 -- 172.21.15.57:0/1816978936 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f95a006bc50 msgr2=0x7f95a01e67f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:05.182 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.191+0000 7f95a6a00640 1 --2- 172.21.15.57:0/1816978936 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f95a006bc50 0x7f95a01e67f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f95900098c0 tx=0x7f95900046c0 comp rx=0 tx=0).stop 2024-03-27T10:00:05.182 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.191+0000 7f95a6a00640 1 -- 172.21.15.57:0/1816978936 shutdown_connections 2024-03-27T10:00:05.182 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.191+0000 7f95a6a00640 1 --2- 172.21.15.57:0/1816978936 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f95a015c200 0x7f95a01e76a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:05.182 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.191+0000 7f95a6a00640 1 --2- 172.21.15.57:0/1816978936 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f957c06c560 0x7f957c06ea20 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:05.182 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.191+0000 7f95a6a00640 1 --2- 172.21.15.57:0/1816978936 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f95a009ed10 0x7f95a006eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:05.182 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.191+0000 7f95a6a00640 1 --2- 172.21.15.57:0/1816978936 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f95a006bc50 0x7f95a01e67f0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:05.182 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.191+0000 7f95a6a00640 1 -- 172.21.15.57:0/1816978936 >> 172.21.15.57:0/1816978936 conn(0x7f95a00b2a90 msgr2=0x7f95a0158b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:05.182 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.192+0000 7f95a6a00640 1 -- 172.21.15.57:0/1816978936 shutdown_connections 2024-03-27T10:00:05.182 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.192+0000 7f95a6a00640 1 -- 172.21.15.57:0/1816978936 wait complete. 2024-03-27T10:00:05.203 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-27T09:59:17.253008+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-27T09:59:26.690365+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-27T09:59:27.559059+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-27T09:59:31.187596+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-27T10:00:05.203 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-27T10:00:05.425 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.435+0000 7f3a19400640 1 Processor -- start 2024-03-27T10:00:05.425 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.435+0000 7f3a19400640 1 -- start start 2024-03-27T10:00:05.427 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.437+0000 7f3a19400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3a1415f720 0x7f3a140d28b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:05.427 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.437+0000 7f3a19400640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3a140b0d10 0x7f3a140d0370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:05.427 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.437+0000 7f3a19400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f3a140d08b0 0x7f3a140cc980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:05.427 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.437+0000 7f3a19400640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f3a1415fb00 con 0x7f3a140b0d10 2024-03-27T10:00:05.427 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.437+0000 7f3a19400640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f3a140cf6d0 con 0x7f3a140d08b0 2024-03-27T10:00:05.427 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.437+0000 7f3a19400640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f3a140cee70 con 0x7f3a1415f720 2024-03-27T10:00:05.427 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.437+0000 7f3a13400640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3a140b0d10 0x7f3a140d0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:05.428 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.437+0000 7f3a13400640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3a140b0d10 0x7f3a140d0370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55112/0 (socket says 172.21.15.57:55112) 2024-03-27T10:00:05.428 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.437+0000 7f3a13400640 1 -- 172.21.15.57:0/3382918269 learned_addr learned my addr 172.21.15.57:0/3382918269 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:05.428 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.437+0000 7f3a18a00640 1 --2- 172.21.15.57:0/3382918269 >> v2:172.21.15.118:3300/0 conn(0x7f3a140d08b0 0x7f3a140cc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:05.428 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.437+0000 7f3a13e00640 1 --2- 172.21.15.57:0/3382918269 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3a1415f720 0x7f3a140d28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:05.428 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.438+0000 7f3a13400640 1 -- 172.21.15.57:0/3382918269 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3a1415f720 msgr2=0x7f3a140d28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:05.429 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.438+0000 7f3a13400640 1 --2- 172.21.15.57:0/3382918269 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3a1415f720 0x7f3a140d28b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:05.429 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.438+0000 7f3a13400640 1 -- 172.21.15.57:0/3382918269 >> v2:172.21.15.118:3300/0 conn(0x7f3a140d08b0 msgr2=0x7f3a140cc980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:05.429 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.438+0000 7f3a13400640 1 --2- 172.21.15.57:0/3382918269 >> v2:172.21.15.118:3300/0 conn(0x7f3a140d08b0 0x7f3a140cc980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:05.429 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.438+0000 7f3a13400640 1 -- 172.21.15.57:0/3382918269 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a140aeb70 con 0x7f3a140b0d10 2024-03-27T10:00:05.429 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.438+0000 7f3a13e00640 1 --2- 172.21.15.57:0/3382918269 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3a1415f720 0x7f3a140d28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T10:00:05.429 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.439+0000 7f3a13400640 1 --2- 172.21.15.57:0/3382918269 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a140b0d10 0x7f3a140d0370 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3a14067ce0 tx=0x7f3a0002b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=500adb30314e4493 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:05.430 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.440+0000 7f3a12a00640 1 -- 172.21.15.57:0/3382918269 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a000317d0 con 0x7f3a140b0d10 2024-03-27T10:00:05.430 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.440+0000 7f3a12a00640 1 -- 172.21.15.57:0/3382918269 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a00037070 con 0x7f3a140b0d10 2024-03-27T10:00:05.430 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.440+0000 7f3a12a00640 1 -- 172.21.15.57:0/3382918269 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a00031b90 con 0x7f3a140b0d10 2024-03-27T10:00:05.431 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.441+0000 7f3a19400640 1 -- 172.21.15.57:0/3382918269 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a140b0d10 msgr2=0x7f3a140d0370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:05.431 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.441+0000 7f3a19400640 1 --2- 172.21.15.57:0/3382918269 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a140b0d10 0x7f3a140d0370 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f3a14067ce0 tx=0x7f3a0002b870 comp rx=0 tx=0).stop 2024-03-27T10:00:05.431 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.441+0000 7f3a19400640 1 -- 172.21.15.57:0/3382918269 shutdown_connections 2024-03-27T10:00:05.431 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.441+0000 7f3a19400640 1 --2- 172.21.15.57:0/3382918269 >> v2:172.21.15.118:3300/0 conn(0x7f3a140d08b0 0x7f3a140cc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:05.431 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.441+0000 7f3a19400640 1 --2- 172.21.15.57:0/3382918269 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a140b0d10 0x7f3a140d0370 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:05.431 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.441+0000 7f3a19400640 1 --2- 172.21.15.57:0/3382918269 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3a1415f720 0x7f3a140d28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:05.431 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.441+0000 7f3a19400640 1 -- 172.21.15.57:0/3382918269 >> 172.21.15.57:0/3382918269 conn(0x7f3a140d1d90 msgr2=0x7f3a140d21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:05.431 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.441+0000 7f3a19400640 1 -- 172.21.15.57:0/3382918269 shutdown_connections 2024-03-27T10:00:05.431 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.441+0000 7f3a19400640 1 -- 172.21.15.57:0/3382918269 wait complete. 2024-03-27T10:00:05.433 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.443+0000 7f3a19400640 1 Processor -- start 2024-03-27T10:00:05.433 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.443+0000 7f3a19400640 1 -- start start 2024-03-27T10:00:05.436 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.444+0000 7f3a19400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a140b0d10 0x7f3a140c58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:05.436 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.445+0000 7f3a19400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3a140d08b0 0x7f3a141f4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:05.436 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.445+0000 7f3a19400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a1415f720 0x7f3a140c6be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:05.436 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.445+0000 7f3a19400640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f3a140cfe00 con 0x7f3a140b0d10 2024-03-27T10:00:05.436 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.445+0000 7f3a19400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f3a140cf3f0 con 0x7f3a1415f720 2024-03-27T10:00:05.436 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.445+0000 7f3a19400640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f3a140ccec0 con 0x7f3a140d08b0 2024-03-27T10:00:05.437 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.445+0000 7f3a13e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a140b0d10 0x7f3a140c58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:05.437 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.445+0000 7f3a13e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a140b0d10 0x7f3a140c58c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55122/0 (socket says 172.21.15.57:55122) 2024-03-27T10:00:05.437 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.445+0000 7f3a13e00640 1 -- 172.21.15.57:0/1111374187 learned_addr learned my addr 172.21.15.57:0/1111374187 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:05.437 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.445+0000 7f3a13400640 1 --2- 172.21.15.57:0/1111374187 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3a140d08b0 0x7f3a141f4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:05.437 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.445+0000 7f3a18a00640 1 --2- 172.21.15.57:0/1111374187 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a1415f720 0x7f3a140c6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:05.437 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.445+0000 7f3a13e00640 1 -- 172.21.15.57:0/1111374187 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3a140d08b0 msgr2=0x7f3a141f4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:05.437 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.445+0000 7f3a13e00640 1 --2- 172.21.15.57:0/1111374187 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3a140d08b0 0x7f3a141f4960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:05.437 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.445+0000 7f3a13e00640 1 -- 172.21.15.57:0/1111374187 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a1415f720 msgr2=0x7f3a140c6be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:05.437 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.445+0000 7f3a13e00640 1 --2- 172.21.15.57:0/1111374187 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a1415f720 0x7f3a140c6be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:05.437 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.445+0000 7f3a13e00640 1 -- 172.21.15.57:0/1111374187 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a140c5ea0 con 0x7f3a140b0d10 2024-03-27T10:00:05.437 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.445+0000 7f3a13400640 1 --2- 172.21.15.57:0/1111374187 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3a140d08b0 0x7f3a141f4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T10:00:05.437 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.446+0000 7f3a13e00640 1 --2- 172.21.15.57:0/1111374187 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a140b0d10 0x7f3a140c58c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f3a0400d7d0 tx=0x7f3a0400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:05.437 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.446+0000 7f3a0be00640 1 -- 172.21.15.57:0/1111374187 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a04004030 con 0x7f3a140b0d10 2024-03-27T10:00:05.437 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.446+0000 7f3a0be00640 1 -- 172.21.15.57:0/1111374187 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a040041d0 con 0x7f3a140b0d10 2024-03-27T10:00:05.438 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.446+0000 7f3a19400640 1 -- 172.21.15.57:0/1111374187 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a140c6180 con 0x7f3a140b0d10 2024-03-27T10:00:05.438 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.446+0000 7f3a0be00640 1 -- 172.21.15.57:0/1111374187 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a040096a0 con 0x7f3a140b0d10 2024-03-27T10:00:05.438 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.446+0000 7f3a19400640 1 -- 172.21.15.57:0/1111374187 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a140c6740 con 0x7f3a140b0d10 2024-03-27T10:00:05.438 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.447+0000 7f3a19400640 1 -- 172.21.15.57:0/1111374187 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a14068c50 con 0x7f3a140b0d10 2024-03-27T10:00:05.438 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.448+0000 7f3a0be00640 1 -- 172.21.15.57:0/1111374187 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f3a04009840 con 0x7f3a140b0d10 2024-03-27T10:00:05.439 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.449+0000 7f3a0be00640 1 --2- 172.21.15.57:0/1111374187 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f39f406c530 0x7f39f406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:05.439 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.449+0000 7f3a0be00640 1 -- 172.21.15.57:0/1111374187 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f3a0408bd70 con 0x7f3a140b0d10 2024-03-27T10:00:05.439 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.450+0000 7f3a13400640 1 --2- 172.21.15.57:0/1111374187 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f39f406c530 0x7f39f406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:05.440 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.450+0000 7f3a13400640 1 --2- 172.21.15.57:0/1111374187 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f39f406c530 0x7f39f406e9f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3a00036000 tx=0x7f3a00008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:05.444 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.455+0000 7f3a0be00640 1 -- 172.21.15.57:0/1111374187 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f3a0405a040 con 0x7f3a140b0d10 2024-03-27T10:00:05.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.660+0000 7f3a19400640 1 -- 172.21.15.57:0/1111374187 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f3a1415c2f0 con 0x7f3a140b0d10 2024-03-27T10:00:05.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.661+0000 7f3a0be00640 1 -- 172.21.15.57:0/1111374187 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7f3a04059940 con 0x7f3a140b0d10 2024-03-27T10:00:05.651 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2024-03-27T10:00:05.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.664+0000 7f3a19400640 1 -- 172.21.15.57:0/1111374187 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f39f406c530 msgr2=0x7f39f406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:05.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.664+0000 7f3a19400640 1 --2- 172.21.15.57:0/1111374187 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f39f406c530 0x7f39f406e9f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3a00036000 tx=0x7f3a00008030 comp rx=0 tx=0).stop 2024-03-27T10:00:05.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.664+0000 7f3a19400640 1 -- 172.21.15.57:0/1111374187 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a140b0d10 msgr2=0x7f3a140c58c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:05.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.664+0000 7f3a19400640 1 --2- 172.21.15.57:0/1111374187 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a140b0d10 0x7f3a140c58c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f3a0400d7d0 tx=0x7f3a0400dc90 comp rx=0 tx=0).stop 2024-03-27T10:00:05.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.664+0000 7f3a19400640 1 -- 172.21.15.57:0/1111374187 shutdown_connections 2024-03-27T10:00:05.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.664+0000 7f3a19400640 1 --2- 172.21.15.57:0/1111374187 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f39f406c530 0x7f39f406e9f0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:05.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.664+0000 7f3a19400640 1 --2- 172.21.15.57:0/1111374187 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a1415f720 0x7f3a140c6be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:05.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.664+0000 7f3a19400640 1 --2- 172.21.15.57:0/1111374187 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3a140d08b0 0x7f3a141f4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:05.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.664+0000 7f3a19400640 1 --2- 172.21.15.57:0/1111374187 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a140b0d10 0x7f3a140c58c0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:05.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.664+0000 7f3a19400640 1 -- 172.21.15.57:0/1111374187 >> 172.21.15.57:0/1111374187 conn(0x7f3a140d1d90 msgr2=0x7f3a14070010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:05.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.665+0000 7f3a19400640 1 -- 172.21.15.57:0/1111374187 shutdown_connections 2024-03-27T10:00:05.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.665+0000 7f3a19400640 1 -- 172.21.15.57:0/1111374187 wait complete. 2024-03-27T10:00:05.674 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-27T10:00:05.898 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.908+0000 7fed6ae00640 1 Processor -- start 2024-03-27T10:00:05.899 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.909+0000 7fed6ae00640 1 -- start start 2024-03-27T10:00:05.901 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.910+0000 7fed6ae00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fed6415e430 0x7fed640711b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:05.901 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.910+0000 7fed6ae00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fed640b3d80 0x7fed640716f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:05.902 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.910+0000 7fed6ae00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed640730a0 con 0x7fed640b46f0 2024-03-27T10:00:05.902 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.910+0000 7fed6ae00640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7fed6415e810 con 0x7fed640b3d80 2024-03-27T10:00:05.902 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.910+0000 7fed6ae00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7fed640b2eb0 con 0x7fed6415e430 2024-03-27T10:00:05.902 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.911+0000 7fed63400640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fed640b3d80 0x7fed640716f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:05.902 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.911+0000 7fed63400640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fed640b3d80 0x7fed640716f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55134/0 (socket says 172.21.15.57:55134) 2024-03-27T10:00:05.902 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.911+0000 7fed63400640 1 -- 172.21.15.57:0/3082136196 learned_addr learned my addr 172.21.15.57:0/3082136196 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:05.902 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.911+0000 7fed63e00640 1 --2- 172.21.15.57:0/3082136196 >> v2:172.21.15.118:3300/0 conn(0x7fed6415e430 0x7fed640711b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:05.902 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.911+0000 7fed63400640 1 -- 172.21.15.57:0/3082136196 >> v2:172.21.15.118:3300/0 conn(0x7fed6415e430 msgr2=0x7fed640711b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:05.902 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.911+0000 7fed63400640 1 --2- 172.21.15.57:0/3082136196 >> v2:172.21.15.118:3300/0 conn(0x7fed6415e430 0x7fed640711b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:05.902 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.911+0000 7fed63400640 1 -- 172.21.15.57:0/3082136196 >> v1:172.21.15.118:6789/0 conn(0x7fed640b46f0 legacy=0x7fed64161eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:05.903 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.911+0000 7fed63400640 1 -- 172.21.15.57:0/3082136196 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed64073320 con 0x7fed640b3d80 2024-03-27T10:00:05.903 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.911+0000 7fed63e00640 1 --2- 172.21.15.57:0/3082136196 >> v2:172.21.15.118:3300/0 conn(0x7fed6415e430 0x7fed640711b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T10:00:05.904 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.913+0000 7fed63400640 1 --2- 172.21.15.57:0/3082136196 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fed640b3d80 0x7fed640716f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fed640d0e30 tx=0x7fed4c02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df2a31be19aa51f8 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:05.904 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.913+0000 7fed62a00640 1 -- 172.21.15.57:0/3082136196 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed4c02ca80 con 0x7fed640b3d80 2024-03-27T10:00:05.904 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.913+0000 7fed62a00640 1 -- 172.21.15.57:0/3082136196 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed4c02cc20 con 0x7fed640b3d80 2024-03-27T10:00:05.904 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.913+0000 7fed62a00640 1 -- 172.21.15.57:0/3082136196 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed4c0343f0 con 0x7fed640b3d80 2024-03-27T10:00:05.904 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.914+0000 7fed6ae00640 1 -- 172.21.15.57:0/3082136196 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fed640b3d80 msgr2=0x7fed640716f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:05.904 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.914+0000 7fed6ae00640 1 --2- 172.21.15.57:0/3082136196 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fed640b3d80 0x7fed640716f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fed640d0e30 tx=0x7fed4c02bee0 comp rx=0 tx=0).stop 2024-03-27T10:00:05.905 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.914+0000 7fed6ae00640 1 -- 172.21.15.57:0/3082136196 shutdown_connections 2024-03-27T10:00:05.905 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.914+0000 7fed6ae00640 1 --2- 172.21.15.57:0/3082136196 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fed640b3d80 0x7fed640716f0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:05.905 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.914+0000 7fed6ae00640 1 --2- 172.21.15.57:0/3082136196 >> v2:172.21.15.118:3300/0 conn(0x7fed6415e430 0x7fed640711b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:05.905 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.914+0000 7fed6ae00640 1 -- 172.21.15.57:0/3082136196 >> 172.21.15.57:0/3082136196 conn(0x7fed640b18a0 msgr2=0x7fed640b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:05.905 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.914+0000 7fed6ae00640 1 -- 172.21.15.57:0/3082136196 shutdown_connections 2024-03-27T10:00:05.905 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.914+0000 7fed6ae00640 1 -- 172.21.15.57:0/3082136196 wait complete. 2024-03-27T10:00:05.905 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.916+0000 7fed6ae00640 1 Processor -- start 2024-03-27T10:00:05.906 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.916+0000 7fed6ae00640 1 -- start start 2024-03-27T10:00:05.909 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.917+0000 7fed6ae00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fed640b3d80 0x7fed6415a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:05.909 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.917+0000 7fed6ae00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fed640b46f0 0x7fed6415c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:05.909 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.917+0000 7fed6ae00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed6415e430 0x7fed6415cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:05.909 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.917+0000 7fed6ae00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fed640b3100 con 0x7fed640b46f0 2024-03-27T10:00:05.909 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.917+0000 7fed6ae00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fed6406d340 con 0x7fed6415e430 2024-03-27T10:00:05.909 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.917+0000 7fed6ae00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fed6406eeb0 con 0x7fed640b3d80 2024-03-27T10:00:05.909 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.917+0000 7fed63400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fed640b46f0 0x7fed6415c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:05.909 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.917+0000 7fed63400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fed640b46f0 0x7fed6415c750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55148/0 (socket says 172.21.15.57:55148) 2024-03-27T10:00:05.909 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.917+0000 7fed63400640 1 -- 172.21.15.57:0/3018154387 learned_addr learned my addr 172.21.15.57:0/3018154387 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:05.909 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.917+0000 7fed68e00640 1 --2- 172.21.15.57:0/3018154387 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed6415e430 0x7fed6415cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:05.909 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.918+0000 7fed63400640 1 -- 172.21.15.57:0/3018154387 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fed640b3d80 msgr2=0x7fed6415a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:05.910 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.918+0000 7fed63e00640 1 --2- 172.21.15.57:0/3018154387 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fed640b3d80 0x7fed6415a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:05.910 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.918+0000 7fed63400640 1 --2- 172.21.15.57:0/3018154387 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fed640b3d80 0x7fed6415a3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:05.910 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.918+0000 7fed63400640 1 -- 172.21.15.57:0/3018154387 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed6415e430 msgr2=0x7fed6415cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:05.910 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.918+0000 7fed63400640 1 --2- 172.21.15.57:0/3018154387 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed6415e430 0x7fed6415cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:05.910 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.918+0000 7fed63400640 1 -- 172.21.15.57:0/3018154387 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed6414c720 con 0x7fed640b46f0 2024-03-27T10:00:05.910 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.918+0000 7fed63400640 1 --2- 172.21.15.57:0/3018154387 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fed640b46f0 0x7fed6415c750 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fed4c000f80 tx=0x7fed4c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:05.910 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.918+0000 7fed5be00640 1 -- 172.21.15.57:0/3018154387 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed4c043020 con 0x7fed640b46f0 2024-03-27T10:00:05.910 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.918+0000 7fed5be00640 1 -- 172.21.15.57:0/3018154387 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed4c03e450 con 0x7fed640b46f0 2024-03-27T10:00:05.910 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.918+0000 7fed5be00640 1 -- 172.21.15.57:0/3018154387 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed4c009510 con 0x7fed640b46f0 2024-03-27T10:00:05.910 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.918+0000 7fed6ae00640 1 -- 172.21.15.57:0/3018154387 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed6414ca00 con 0x7fed640b46f0 2024-03-27T10:00:05.910 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.918+0000 7fed6ae00640 1 -- 172.21.15.57:0/3018154387 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed6414cfc0 con 0x7fed640b46f0 2024-03-27T10:00:05.911 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.919+0000 7fed6ae00640 1 -- 172.21.15.57:0/3018154387 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed640757d0 con 0x7fed640b46f0 2024-03-27T10:00:05.911 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.920+0000 7fed5be00640 1 -- 172.21.15.57:0/3018154387 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fed4c046020 con 0x7fed640b46f0 2024-03-27T10:00:05.911 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.921+0000 7fed5be00640 1 --2- 172.21.15.57:0/3018154387 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fed4006c530 0x7fed4006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:05.911 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.921+0000 7fed5be00640 1 -- 172.21.15.57:0/3018154387 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fed4c0ae2c0 con 0x7fed640b46f0 2024-03-27T10:00:05.912 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.922+0000 7fed63e00640 1 --2- 172.21.15.57:0/3018154387 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fed4006c530 0x7fed4006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:05.912 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.922+0000 7fed63e00640 1 --2- 172.21.15.57:0/3018154387 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fed4006c530 0x7fed4006e9f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fed5400d8b0 tx=0x7fed54008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:05.916 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:05.926+0000 7fed5be00640 1 -- 172.21.15.57:0/3018154387 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7fed4c04d030 con 0x7fed640b46f0 2024-03-27T10:00:06.125 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.135+0000 7fed6ae00640 1 -- 172.21.15.57:0/3018154387 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fed64068540 con 0x7fed640b46f0 2024-03-27T10:00:06.126 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.136+0000 7fed5be00640 1 -- 172.21.15.57:0/3018154387 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7fed4c07c590 con 0x7fed640b46f0 2024-03-27T10:00:06.126 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2024-03-27T10:00:06.129 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.139+0000 7fed6ae00640 1 -- 172.21.15.57:0/3018154387 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fed4006c530 msgr2=0x7fed4006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:06.129 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.139+0000 7fed6ae00640 1 --2- 172.21.15.57:0/3018154387 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fed4006c530 0x7fed4006e9f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fed5400d8b0 tx=0x7fed54008040 comp rx=0 tx=0).stop 2024-03-27T10:00:06.129 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.139+0000 7fed6ae00640 1 -- 172.21.15.57:0/3018154387 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fed640b46f0 msgr2=0x7fed6415c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:06.130 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.139+0000 7fed6ae00640 1 --2- 172.21.15.57:0/3018154387 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fed640b46f0 0x7fed6415c750 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fed4c000f80 tx=0x7fed4c004a40 comp rx=0 tx=0).stop 2024-03-27T10:00:06.130 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.139+0000 7fed6ae00640 1 -- 172.21.15.57:0/3018154387 shutdown_connections 2024-03-27T10:00:06.130 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.139+0000 7fed6ae00640 1 --2- 172.21.15.57:0/3018154387 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fed4006c530 0x7fed4006e9f0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:06.130 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.139+0000 7fed6ae00640 1 --2- 172.21.15.57:0/3018154387 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fed6415e430 0x7fed6415cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:06.130 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.139+0000 7fed6ae00640 1 --2- 172.21.15.57:0/3018154387 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fed640b46f0 0x7fed6415c750 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:06.130 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.139+0000 7fed6ae00640 1 --2- 172.21.15.57:0/3018154387 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fed640b3d80 0x7fed6415a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:06.130 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.139+0000 7fed6ae00640 1 -- 172.21.15.57:0/3018154387 >> 172.21.15.57:0/3018154387 conn(0x7fed640b18a0 msgr2=0x7fed640b1c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:06.130 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.140+0000 7fed6ae00640 1 -- 172.21.15.57:0/3018154387 shutdown_connections 2024-03-27T10:00:06.130 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.140+0000 7fed6ae00640 1 -- 172.21.15.57:0/3018154387 wait complete. 2024-03-27T10:00:06.147 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-27T10:00:06.374 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.384+0000 7f5642600640 1 Processor -- start 2024-03-27T10:00:06.374 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.384+0000 7f5642600640 1 -- start start 2024-03-27T10:00:06.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.386+0000 7f5642600640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f563c0ca6e0 0x7f563c0c4e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:06.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.386+0000 7f5642600640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f563c0cbb50 0x7f563c0caac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:06.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.386+0000 7f5642600640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f563c0cb720 con 0x7f563c0cb000 2024-03-27T10:00:06.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.386+0000 7f5642600640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f563c0c5570 con 0x7f563c0ca6e0 2024-03-27T10:00:06.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.386+0000 7f5642600640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f563c0c5850 con 0x7f563c0cbb50 2024-03-27T10:00:06.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.387+0000 7f5641c00640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f563c0cb000 0x7f563c0ad8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:56776/0 (socket says 172.21.15.57:56776) 2024-03-27T10:00:06.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.387+0000 7f5641c00640 1 -- 172.21.15.57:0/1155945857 learned_addr learned my addr 172.21.15.57:0/1155945857 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T10:00:06.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.387+0000 7f5641200640 1 --2- 172.21.15.57:0/1155945857 >> v2:172.21.15.57:3300/0 conn(0x7f563c0ca6e0 0x7f563c0c4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:06.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.387+0000 7f563be00640 1 --2- 172.21.15.57:0/1155945857 >> v2:172.21.15.118:3300/0 conn(0x7f563c0cbb50 0x7f563c0caac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:06.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.387+0000 7f5641200640 1 -- 172.21.15.57:0/1155945857 >> v2:172.21.15.118:3300/0 conn(0x7f563c0cbb50 msgr2=0x7f563c0caac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:06.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.387+0000 7f5641200640 1 --2- 172.21.15.57:0/1155945857 >> v2:172.21.15.118:3300/0 conn(0x7f563c0cbb50 0x7f563c0caac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:06.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.387+0000 7f5641200640 1 -- 172.21.15.57:0/1155945857 >> v1:172.21.15.57:6789/0 conn(0x7f563c0cb000 legacy=0x7f563c0ad8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:06.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.388+0000 7f5641200640 1 -- 172.21.15.57:0/1155945857 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f563c0c5b30 con 0x7f563c0ca6e0 2024-03-27T10:00:06.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.388+0000 7f563b400640 1 -- 172.21.15.57:0/1155945857 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1475339944 0 0) 0x7f563c0cb720 con 0x7f563c0cb000 2024-03-27T10:00:06.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.388+0000 7f563be00640 1 --2- 172.21.15.57:0/1155945857 >> v2:172.21.15.118:3300/0 conn(0x7f563c0cbb50 0x7f563c0caac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T10:00:06.384 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.389+0000 7f5641200640 1 --2- 172.21.15.57:0/1155945857 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f563c0ca6e0 0x7f563c0c4e70 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f563c069220 tx=0x7f563002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8db3753bcae035f server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:06.384 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.389+0000 7f563b400640 1 -- 172.21.15.57:0/1155945857 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56300315a0 con 0x7f563c0ca6e0 2024-03-27T10:00:06.384 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.389+0000 7f563b400640 1 -- 172.21.15.57:0/1155945857 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5630037070 con 0x7f563c0ca6e0 2024-03-27T10:00:06.385 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.389+0000 7f563b400640 1 -- 172.21.15.57:0/1155945857 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5630031960 con 0x7f563c0ca6e0 2024-03-27T10:00:06.385 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.390+0000 7f5642600640 1 -- 172.21.15.57:0/1155945857 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f563c0ca6e0 msgr2=0x7f563c0c4e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:06.385 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.390+0000 7f5642600640 1 --2- 172.21.15.57:0/1155945857 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f563c0ca6e0 0x7f563c0c4e70 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f563c069220 tx=0x7f563002b840 comp rx=0 tx=0).stop 2024-03-27T10:00:06.385 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.390+0000 7f5642600640 1 -- 172.21.15.57:0/1155945857 shutdown_connections 2024-03-27T10:00:06.385 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.390+0000 7f5642600640 1 --2- 172.21.15.57:0/1155945857 >> v2:172.21.15.118:3300/0 conn(0x7f563c0cbb50 0x7f563c0caac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:06.385 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.390+0000 7f5642600640 1 --2- 172.21.15.57:0/1155945857 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f563c0ca6e0 0x7f563c0c4e70 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:06.385 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.390+0000 7f5642600640 1 -- 172.21.15.57:0/1155945857 >> 172.21.15.57:0/1155945857 conn(0x7f563c0cfb40 msgr2=0x7f563c0cff20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:06.385 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.390+0000 7f5642600640 1 -- 172.21.15.57:0/1155945857 shutdown_connections 2024-03-27T10:00:06.385 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.390+0000 7f5642600640 1 -- 172.21.15.57:0/1155945857 wait complete. 2024-03-27T10:00:06.385 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.392+0000 7f5642600640 1 Processor -- start 2024-03-27T10:00:06.385 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.392+0000 7f5642600640 1 -- start start 2024-03-27T10:00:06.385 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.393+0000 7f5642600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f563c0ca6e0 0x7f563c1537d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:06.385 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.393+0000 7f5642600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f563c0cb000 0x7f563c0b2820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:06.385 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.393+0000 7f5642600640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f563c0cbb50 0x7f563c0b03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:06.386 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.393+0000 7f5642600640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f563c0adfb0 con 0x7f563c0cbb50 2024-03-27T10:00:06.386 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.393+0000 7f5642600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f563c0c60f0 con 0x7f563c0ca6e0 2024-03-27T10:00:06.386 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.393+0000 7f5642600640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f563c0ae130 con 0x7f563c0cb000 2024-03-27T10:00:06.386 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.393+0000 7f5641c00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f563c0cbb50 0x7f563c0b03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:06.386 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.393+0000 7f5641c00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f563c0cbb50 0x7f563c0b03f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55170/0 (socket says 172.21.15.57:55170) 2024-03-27T10:00:06.386 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.393+0000 7f5641c00640 1 -- 172.21.15.57:0/825533470 learned_addr learned my addr 172.21.15.57:0/825533470 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:06.386 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.393+0000 7f563be00640 1 --2- 172.21.15.57:0/825533470 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f563c0cb000 0x7f563c0b2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:06.386 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.393+0000 7f5641200640 1 --2- 172.21.15.57:0/825533470 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f563c0ca6e0 0x7f563c1537d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:06.386 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.394+0000 7f5641c00640 1 -- 172.21.15.57:0/825533470 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f563c0cb000 msgr2=0x7f563c0b2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:06.386 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.394+0000 7f5641c00640 1 --2- 172.21.15.57:0/825533470 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f563c0cb000 0x7f563c0b2820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:06.386 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.394+0000 7f5641c00640 1 -- 172.21.15.57:0/825533470 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f563c0ca6e0 msgr2=0x7f563c1537d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:06.386 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.394+0000 7f5641c00640 1 --2- 172.21.15.57:0/825533470 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f563c0ca6e0 0x7f563c1537d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:06.386 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.394+0000 7f5641c00640 1 -- 172.21.15.57:0/825533470 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f563c0b32e0 con 0x7f563c0cbb50 2024-03-27T10:00:06.386 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.394+0000 7f563be00640 1 --2- 172.21.15.57:0/825533470 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f563c0cb000 0x7f563c0b2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T10:00:06.387 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.394+0000 7f5641c00640 1 --2- 172.21.15.57:0/825533470 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f563c0cbb50 0x7f563c0b03f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f563400c780 tx=0x7f563400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:06.387 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.394+0000 7f5638c00640 1 -- 172.21.15.57:0/825533470 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5634018070 con 0x7f563c0cbb50 2024-03-27T10:00:06.387 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.394+0000 7f5638c00640 1 -- 172.21.15.57:0/825533470 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f563400a640 con 0x7f563c0cbb50 2024-03-27T10:00:06.387 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.394+0000 7f5638c00640 1 -- 172.21.15.57:0/825533470 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f563400aab0 con 0x7f563c0cbb50 2024-03-27T10:00:06.387 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.394+0000 7f5642600640 1 -- 172.21.15.57:0/825533470 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f563c0b35c0 con 0x7f563c0cbb50 2024-03-27T10:00:06.387 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.394+0000 7f5642600640 1 -- 172.21.15.57:0/825533470 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f563c0b3b80 con 0x7f563c0cbb50 2024-03-27T10:00:06.388 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.395+0000 7f5642600640 1 -- 172.21.15.57:0/825533470 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f563c0cd0a0 con 0x7f563c0cbb50 2024-03-27T10:00:06.388 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.397+0000 7f5638c00640 1 -- 172.21.15.57:0/825533470 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f563400ac50 con 0x7f563c0cbb50 2024-03-27T10:00:06.388 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.398+0000 7f5638c00640 1 --2- 172.21.15.57:0/825533470 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f561c06c560 0x7f561c06ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:06.388 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.398+0000 7f5638c00640 1 -- 172.21.15.57:0/825533470 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f563408afe0 con 0x7f563c0cbb50 2024-03-27T10:00:06.388 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.398+0000 7f5641200640 1 --2- 172.21.15.57:0/825533470 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f561c06c560 0x7f561c06ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:06.388 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.399+0000 7f5641200640 1 --2- 172.21.15.57:0/825533470 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f561c06c560 0x7f561c06ea20 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5630036000 tx=0x7f5630008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:06.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.403+0000 7f5638c00640 1 -- 172.21.15.57:0/825533470 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f563c0cd0a0 con 0x7f563c0cbb50 2024-03-27T10:00:06.598 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.608+0000 7f5642600640 1 -- 172.21.15.57:0/825533470 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f563c067db0 con 0x7f563c0cbb50 2024-03-27T10:00:06.599 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.609+0000 7f5638c00640 1 -- 172.21.15.57:0/825533470 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7f563c067db0 con 0x7f563c0cbb50 2024-03-27T10:00:06.599 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2024-03-27T10:00:06.602 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.611+0000 7f5642600640 1 -- 172.21.15.57:0/825533470 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f561c06c560 msgr2=0x7f561c06ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:06.602 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.611+0000 7f5642600640 1 --2- 172.21.15.57:0/825533470 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f561c06c560 0x7f561c06ea20 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f5630036000 tx=0x7f5630008030 comp rx=0 tx=0).stop 2024-03-27T10:00:06.602 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.611+0000 7f5642600640 1 -- 172.21.15.57:0/825533470 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f563c0cbb50 msgr2=0x7f563c0b03f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:06.602 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.611+0000 7f5642600640 1 --2- 172.21.15.57:0/825533470 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f563c0cbb50 0x7f563c0b03f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f563400c780 tx=0x7f563400cc40 comp rx=0 tx=0).stop 2024-03-27T10:00:06.602 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.612+0000 7f5642600640 1 -- 172.21.15.57:0/825533470 shutdown_connections 2024-03-27T10:00:06.602 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.612+0000 7f5642600640 1 --2- 172.21.15.57:0/825533470 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f563c0cbb50 0x7f563c0b03f0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:06.602 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.612+0000 7f5642600640 1 --2- 172.21.15.57:0/825533470 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f563c0cb000 0x7f563c0b2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:06.602 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.612+0000 7f5642600640 1 --2- 172.21.15.57:0/825533470 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f561c06c560 0x7f561c06ea20 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:06.602 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.612+0000 7f5642600640 1 --2- 172.21.15.57:0/825533470 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f563c0ca6e0 0x7f563c1537d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:06.602 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.612+0000 7f5642600640 1 -- 172.21.15.57:0/825533470 >> 172.21.15.57:0/825533470 conn(0x7f563c0cfb40 msgr2=0x7f563c06e470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:06.603 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.612+0000 7f5642600640 1 -- 172.21.15.57:0/825533470 shutdown_connections 2024-03-27T10:00:06.603 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.612+0000 7f5642600640 1 -- 172.21.15.57:0/825533470 wait complete. 2024-03-27T10:00:06.622 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-27T10:00:06.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.859+0000 7f9ce7200640 1 Processor -- start 2024-03-27T10:00:06.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.859+0000 7f9ce7200640 1 -- start start 2024-03-27T10:00:06.851 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.861+0000 7f9ce7200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9ce8161950 0x7f9ce80ceb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:06.851 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.861+0000 7f9ce7200640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9ce80cf040 0x7f9ce80cf480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:06.851 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.861+0000 7f9ce7200640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ce80cfe40 con 0x7f9ce80d2760 2024-03-27T10:00:06.851 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.861+0000 7f9ce7200640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f9ce80cf9c0 con 0x7f9ce80cf040 2024-03-27T10:00:06.851 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.861+0000 7f9ce7200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f9ce8161d30 con 0x7f9ce8161950 2024-03-27T10:00:06.851 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.861+0000 7f9ce5400640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9ce80cf040 0x7f9ce80cf480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:06.851 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.861+0000 7f9ce6800640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f9ce80d2760 0x7f9ce80d2bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:56790/0 (socket says 172.21.15.57:56790) 2024-03-27T10:00:06.851 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.861+0000 7f9ce6800640 1 -- 172.21.15.57:0/467561474 learned_addr learned my addr 172.21.15.57:0/467561474 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T10:00:06.852 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.861+0000 7f9ce5e00640 1 --2- 172.21.15.57:0/467561474 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9ce8161950 0x7f9ce80ceb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:06.852 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.862+0000 7f9ce5400640 1 -- 172.21.15.57:0/467561474 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9ce8161950 msgr2=0x7f9ce80ceb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:06.852 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.862+0000 7f9ce5400640 1 --2- 172.21.15.57:0/467561474 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9ce8161950 0x7f9ce80ceb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:06.852 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.862+0000 7f9ce5400640 1 -- 172.21.15.57:0/467561474 >> v1:172.21.15.57:6789/0 conn(0x7f9ce80d2760 legacy=0x7f9ce80d2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:06.852 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.862+0000 7f9ce5400640 1 -- 172.21.15.57:0/467561474 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ce80d0f10 con 0x7f9ce80cf040 2024-03-27T10:00:06.853 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.862+0000 7f9ce4a00640 1 -- 172.21.15.57:0/467561474 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2489683282 0 0) 0x7f9ce80cfe40 con 0x7f9ce80d2760 2024-03-27T10:00:06.854 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.863+0000 7f9ce5400640 1 --2- 172.21.15.57:0/467561474 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ce80cf040 0x7f9ce80cf480 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9cd40097a0 tx=0x7f9cd402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa5431537197cf8c server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:06.854 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.863+0000 7f9ce4a00640 1 -- 172.21.15.57:0/467561474 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cd4034070 con 0x7f9ce80cf040 2024-03-27T10:00:06.854 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.863+0000 7f9ce4a00640 1 -- 172.21.15.57:0/467561474 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cd4030610 con 0x7f9ce80cf040 2024-03-27T10:00:06.854 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.863+0000 7f9ce4a00640 1 -- 172.21.15.57:0/467561474 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cd40309e0 con 0x7f9ce80cf040 2024-03-27T10:00:06.854 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.864+0000 7f9ce7200640 1 -- 172.21.15.57:0/467561474 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ce80cf040 msgr2=0x7f9ce80cf480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:06.854 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.864+0000 7f9ce7200640 1 --2- 172.21.15.57:0/467561474 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ce80cf040 0x7f9ce80cf480 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9cd40097a0 tx=0x7f9cd402b960 comp rx=0 tx=0).stop 2024-03-27T10:00:06.854 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.864+0000 7f9ce7200640 1 -- 172.21.15.57:0/467561474 shutdown_connections 2024-03-27T10:00:06.854 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.864+0000 7f9ce7200640 1 --2- 172.21.15.57:0/467561474 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ce80cf040 0x7f9ce80cf480 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:06.854 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.864+0000 7f9ce7200640 1 --2- 172.21.15.57:0/467561474 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9ce8161950 0x7f9ce80ceb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:06.855 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.864+0000 7f9ce7200640 1 -- 172.21.15.57:0/467561474 >> 172.21.15.57:0/467561474 conn(0x7f9ce80d3fc0 msgr2=0x7f9ce80d43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:06.855 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.864+0000 7f9ce7200640 1 -- 172.21.15.57:0/467561474 shutdown_connections 2024-03-27T10:00:06.855 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.864+0000 7f9ce7200640 1 -- 172.21.15.57:0/467561474 wait complete. 2024-03-27T10:00:06.855 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.866+0000 7f9ce7200640 1 Processor -- start 2024-03-27T10:00:06.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.866+0000 7f9ce7200640 1 -- start start 2024-03-27T10:00:06.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.867+0000 7f9ce7200640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ce80cf040 0x7f9ce815c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:06.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.867+0000 7f9ce7200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9ce80d2760 0x7f9ce809f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:06.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.867+0000 7f9ce7200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9ce8161950 0x7f9ce80ca120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:06.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.867+0000 7f9ce7200640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f9ce80d1f60 con 0x7f9ce80cf040 2024-03-27T10:00:06.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.867+0000 7f9ce7200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f9ce80d14d0 con 0x7f9ce80d2760 2024-03-27T10:00:06.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.867+0000 7f9ce7200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f9ce80d2240 con 0x7f9ce8161950 2024-03-27T10:00:06.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.867+0000 7f9ce5e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ce80cf040 0x7f9ce815c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:06.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.867+0000 7f9ce5e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ce80cf040 0x7f9ce815c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55188/0 (socket says 172.21.15.57:55188) 2024-03-27T10:00:06.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.867+0000 7f9ce5e00640 1 -- 172.21.15.57:0/1345910397 learned_addr learned my addr 172.21.15.57:0/1345910397 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:06.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.868+0000 7f9ce5400640 1 --2- 172.21.15.57:0/1345910397 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9ce80d2760 0x7f9ce809f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:06.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.868+0000 7f9ce6800640 1 --2- 172.21.15.57:0/1345910397 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9ce8161950 0x7f9ce80ca120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:06.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.868+0000 7f9ce5e00640 1 -- 172.21.15.57:0/1345910397 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9ce8161950 msgr2=0x7f9ce80ca120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:06.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.868+0000 7f9ce5e00640 1 --2- 172.21.15.57:0/1345910397 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9ce8161950 0x7f9ce80ca120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:06.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.868+0000 7f9ce5e00640 1 -- 172.21.15.57:0/1345910397 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9ce80d2760 msgr2=0x7f9ce809f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:06.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.868+0000 7f9ce5e00640 1 --2- 172.21.15.57:0/1345910397 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9ce80d2760 0x7f9ce809f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:06.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.868+0000 7f9ce5e00640 1 -- 172.21.15.57:0/1345910397 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ce80c7950 con 0x7f9ce80cf040 2024-03-27T10:00:06.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.868+0000 7f9ce5e00640 1 --2- 172.21.15.57:0/1345910397 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ce80cf040 0x7f9ce815c390 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9cd800d5f0 tx=0x7f9cd800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:06.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.869+0000 7f9cde000640 1 -- 172.21.15.57:0/1345910397 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cd80125f0 con 0x7f9ce80cf040 2024-03-27T10:00:06.860 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.869+0000 7f9cde000640 1 -- 172.21.15.57:0/1345910397 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cd8019070 con 0x7f9ce80cf040 2024-03-27T10:00:06.860 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.869+0000 7f9cde000640 1 -- 172.21.15.57:0/1345910397 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cd80129d0 con 0x7f9ce80cf040 2024-03-27T10:00:06.860 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.869+0000 7f9ce7200640 1 -- 172.21.15.57:0/1345910397 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ce80c7bf0 con 0x7f9ce80cf040 2024-03-27T10:00:06.860 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.869+0000 7f9ce7200640 1 -- 172.21.15.57:0/1345910397 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ce80c81b0 con 0x7f9ce80cf040 2024-03-27T10:00:06.860 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.870+0000 7f9ce7200640 1 -- 172.21.15.57:0/1345910397 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ce8068540 con 0x7f9ce80cf040 2024-03-27T10:00:06.860 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.871+0000 7f9cde000640 1 -- 172.21.15.57:0/1345910397 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f9cd8012b70 con 0x7f9ce80cf040 2024-03-27T10:00:06.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.872+0000 7f9cde000640 1 --2- 172.21.15.57:0/1345910397 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f9cc806c560 0x7f9cc806ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:06.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.872+0000 7f9cde000640 1 -- 172.21.15.57:0/1345910397 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f9cd808be80 con 0x7f9ce80cf040 2024-03-27T10:00:06.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.872+0000 7f9ce5400640 1 --2- 172.21.15.57:0/1345910397 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f9cc806c560 0x7f9cc806ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:06.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.873+0000 7f9ce5400640 1 --2- 172.21.15.57:0/1345910397 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f9cc806c560 0x7f9cc806ea20 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9cd4036000 tx=0x7f9cd403b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:06.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:06.876+0000 7f9cde000640 1 -- 172.21.15.57:0/1345910397 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f9cd805a0c0 con 0x7f9ce80cf040 2024-03-27T10:00:07.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.079+0000 7f9ce7200640 1 -- 172.21.15.57:0/1345910397 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f9ce806c950 con 0x7f9ce80cf040 2024-03-27T10:00:07.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.080+0000 7f9cde000640 1 -- 172.21.15.57:0/1345910397 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7f9cd80599c0 con 0x7f9ce80cf040 2024-03-27T10:00:07.070 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2024-03-27T10:00:07.073 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.083+0000 7f9ce7200640 1 -- 172.21.15.57:0/1345910397 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f9cc806c560 msgr2=0x7f9cc806ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:07.073 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.083+0000 7f9ce7200640 1 --2- 172.21.15.57:0/1345910397 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f9cc806c560 0x7f9cc806ea20 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9cd4036000 tx=0x7f9cd403b040 comp rx=0 tx=0).stop 2024-03-27T10:00:07.073 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.083+0000 7f9ce7200640 1 -- 172.21.15.57:0/1345910397 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ce80cf040 msgr2=0x7f9ce815c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:07.073 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.083+0000 7f9ce7200640 1 --2- 172.21.15.57:0/1345910397 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ce80cf040 0x7f9ce815c390 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9cd800d5f0 tx=0x7f9cd800dab0 comp rx=0 tx=0).stop 2024-03-27T10:00:07.073 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.083+0000 7f9ce7200640 1 -- 172.21.15.57:0/1345910397 shutdown_connections 2024-03-27T10:00:07.073 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.083+0000 7f9ce7200640 1 --2- 172.21.15.57:0/1345910397 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9ce8161950 0x7f9ce80ca120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:07.073 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.083+0000 7f9ce7200640 1 --2- 172.21.15.57:0/1345910397 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f9cc806c560 0x7f9cc806ea20 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:07.073 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.083+0000 7f9ce7200640 1 --2- 172.21.15.57:0/1345910397 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9ce80d2760 0x7f9ce809f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:07.074 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.083+0000 7f9ce7200640 1 --2- 172.21.15.57:0/1345910397 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ce80cf040 0x7f9ce815c390 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:07.074 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.083+0000 7f9ce7200640 1 -- 172.21.15.57:0/1345910397 >> 172.21.15.57:0/1345910397 conn(0x7f9ce80d3fc0 msgr2=0x7f9ce80b9180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:07.074 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.083+0000 7f9ce7200640 1 -- 172.21.15.57:0/1345910397 shutdown_connections 2024-03-27T10:00:07.074 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.083+0000 7f9ce7200640 1 -- 172.21.15.57:0/1345910397 wait complete. 2024-03-27T10:00:07.094 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-27T10:00:07.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.326+0000 7f571e200640 1 Processor -- start 2024-03-27T10:00:07.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.327+0000 7f571e200640 1 -- start start 2024-03-27T10:00:07.317 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.328+0000 7f571e200640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f57180723e0 0x7f57180b2b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:07.318 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.328+0000 7f571e200640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5718151b30 con 0x7f5718151750 2024-03-27T10:00:07.318 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.328+0000 7f571e200640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5718072a80 con 0x7f57180b30b0 2024-03-27T10:00:07.319 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.328+0000 7f571e200640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f571806d350 con 0x7f57180723e0 2024-03-27T10:00:07.319 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.328+0000 7f5717400640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f5718151750 0x7f57180cc010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:56798/0 (socket says 172.21.15.57:56798) 2024-03-27T10:00:07.319 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.328+0000 7f5717400640 1 -- 172.21.15.57:0/3855936163 learned_addr learned my addr 172.21.15.57:0/3855936163 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T10:00:07.319 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.328+0000 7f570fe00640 1 --2- 172.21.15.57:0/3855936163 >> v2:172.21.15.57:3300/0 conn(0x7f57180723e0 0x7f57180b2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:07.319 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.329+0000 7f5716a00640 1 -- 172.21.15.57:0/3855936163 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3714780251 0 0) 0x7f5708001110 con 0x7f5718151750 2024-03-27T10:00:07.319 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.329+0000 7f570fe00640 1 -- 172.21.15.57:0/3855936163 >> v1:172.21.15.118:6789/0 conn(0x7f57180b30b0 legacy=0x7f571806de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:07.319 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.329+0000 7f570fe00640 1 -- 172.21.15.57:0/3855936163 >> v1:172.21.15.57:6789/0 conn(0x7f5718151750 legacy=0x7f57180cc010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:07.319 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.329+0000 7f570fe00640 1 -- 172.21.15.57:0/3855936163 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f571806d630 con 0x7f57180723e0 2024-03-27T10:00:07.320 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.330+0000 7f570fe00640 1 --2- 172.21.15.57:0/3855936163 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57180723e0 0x7f57180b2b70 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f57000097a0 tx=0x7f570002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ea8ff50b7825ca5 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:07.320 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.330+0000 7f5716a00640 1 -- 172.21.15.57:0/3855936163 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5700034070 con 0x7f57180723e0 2024-03-27T10:00:07.320 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.331+0000 7f5716a00640 1 -- 172.21.15.57:0/3855936163 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5700030610 con 0x7f57180723e0 2024-03-27T10:00:07.320 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.331+0000 7f5716a00640 1 -- 172.21.15.57:0/3855936163 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57000309e0 con 0x7f57180723e0 2024-03-27T10:00:07.321 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.331+0000 7f571e200640 1 -- 172.21.15.57:0/3855936163 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57180723e0 msgr2=0x7f57180b2b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:07.321 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.331+0000 7f571e200640 1 --2- 172.21.15.57:0/3855936163 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57180723e0 0x7f57180b2b70 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f57000097a0 tx=0x7f570002b960 comp rx=0 tx=0).stop 2024-03-27T10:00:07.321 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.331+0000 7f571e200640 1 -- 172.21.15.57:0/3855936163 shutdown_connections 2024-03-27T10:00:07.321 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.331+0000 7f571e200640 1 --2- 172.21.15.57:0/3855936163 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f57180723e0 0x7f57180b2b70 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:07.321 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.331+0000 7f571e200640 1 -- 172.21.15.57:0/3855936163 >> 172.21.15.57:0/3855936163 conn(0x7f57180b1c60 msgr2=0x7f57180b2070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:07.321 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.331+0000 7f571e200640 1 -- 172.21.15.57:0/3855936163 shutdown_connections 2024-03-27T10:00:07.321 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.331+0000 7f571e200640 1 -- 172.21.15.57:0/3855936163 wait complete. 2024-03-27T10:00:07.323 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.333+0000 7f571e200640 1 Processor -- start 2024-03-27T10:00:07.323 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.333+0000 7f571e200640 1 -- start start 2024-03-27T10:00:07.325 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.334+0000 7f571e200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f57180723e0 0x7f57180ce780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:07.325 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.334+0000 7f571e200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f57180b30b0 0x7f571813e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:07.325 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.334+0000 7f571e200640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5718151750 0x7f57180cde10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:07.325 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.334+0000 7f571e200640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f571806e6c0 con 0x7f5718151750 2024-03-27T10:00:07.325 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.334+0000 7f571e200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f571806e540 con 0x7f57180b30b0 2024-03-27T10:00:07.325 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.334+0000 7f571e200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f571806b750 con 0x7f57180723e0 2024-03-27T10:00:07.325 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.334+0000 7f5717e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5718151750 0x7f57180cde10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:07.325 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.334+0000 7f5717e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5718151750 0x7f57180cde10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55216/0 (socket says 172.21.15.57:55216) 2024-03-27T10:00:07.325 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.334+0000 7f5717e00640 1 -- 172.21.15.57:0/2782890819 learned_addr learned my addr 172.21.15.57:0/2782890819 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:07.325 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.335+0000 7f570fe00640 1 --2- 172.21.15.57:0/2782890819 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f57180b30b0 0x7f571813e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:07.325 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.335+0000 7f5717400640 1 --2- 172.21.15.57:0/2782890819 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f57180723e0 0x7f57180ce780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:07.325 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.335+0000 7f5717e00640 1 -- 172.21.15.57:0/2782890819 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f57180723e0 msgr2=0x7f57180ce780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:07.325 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.335+0000 7f5717e00640 1 --2- 172.21.15.57:0/2782890819 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f57180723e0 0x7f57180ce780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:07.326 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.335+0000 7f5717e00640 1 -- 172.21.15.57:0/2782890819 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f57180b30b0 msgr2=0x7f571813e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:07.326 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.335+0000 7f5717e00640 1 --2- 172.21.15.57:0/2782890819 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f57180b30b0 0x7f571813e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:07.326 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.335+0000 7f5717e00640 1 -- 172.21.15.57:0/2782890819 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5718154570 con 0x7f5718151750 2024-03-27T10:00:07.326 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.335+0000 7f5717e00640 1 --2- 172.21.15.57:0/2782890819 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5718151750 0x7f57180cde10 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f571000c7d0 tx=0x7f571000cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:07.327 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.335+0000 7f570f400640 1 -- 172.21.15.57:0/2782890819 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5710003b70 con 0x7f5718151750 2024-03-27T10:00:07.327 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.335+0000 7f570f400640 1 -- 172.21.15.57:0/2782890819 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5710003d30 con 0x7f5718151750 2024-03-27T10:00:07.327 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.335+0000 7f570f400640 1 -- 172.21.15.57:0/2782890819 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f571000aa90 con 0x7f5718151750 2024-03-27T10:00:07.327 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.336+0000 7f571e200640 1 -- 172.21.15.57:0/2782890819 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5718154850 con 0x7f5718151750 2024-03-27T10:00:07.327 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.336+0000 7f571e200640 1 -- 172.21.15.57:0/2782890819 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5718152dc0 con 0x7f5718151750 2024-03-27T10:00:07.327 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.337+0000 7f571e200640 1 -- 172.21.15.57:0/2782890819 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5718068620 con 0x7f5718151750 2024-03-27T10:00:07.327 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.338+0000 7f570f400640 1 -- 172.21.15.57:0/2782890819 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f571000ac30 con 0x7f5718151750 2024-03-27T10:00:07.328 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.339+0000 7f570f400640 1 --2- 172.21.15.57:0/2782890819 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f56f406c530 0x7f56f406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:07.328 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.339+0000 7f570f400640 1 -- 172.21.15.57:0/2782890819 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f571008b9b0 con 0x7f5718151750 2024-03-27T10:00:07.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.339+0000 7f5717400640 1 --2- 172.21.15.57:0/2782890819 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f56f406c530 0x7f56f406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:07.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.340+0000 7f5717400640 1 --2- 172.21.15.57:0/2782890819 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f56f406c530 0x7f56f406e9f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5708000f60 tx=0x7f5708009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:07.333 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.343+0000 7f570f400640 1 -- 172.21.15.57:0/2782890819 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f5710059c80 con 0x7f5718151750 2024-03-27T10:00:07.580 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.590+0000 7f571e200640 1 -- 172.21.15.57:0/2782890819 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5718069010 con 0x7f5718151750 2024-03-27T10:00:07.581 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.591+0000 7f570f400640 1 -- 172.21.15.57:0/2782890819 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5183 (secure 0 0 0) 0x7f5710059580 con 0x7f5718151750 2024-03-27T10:00:07.581 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:00:07.581 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/1178943431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1178943431},{"type":"v1","addr":"172.21.15.118:6834","nonce":1178943431}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6836/1248533620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6835","nonce":1248533620},{"type":"v1","addr":"172.21.15.57:6836","nonce":1248533620}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6837/4133386889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":4133386889},{"type":"v1","addr":"172.21.15.57:6837","nonce":4133386889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-27T09:59:28.571425+0000","modified":"2024-03-27T09:59:55.863525+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6835/1823694233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":1823694233},{"type":"v1","addr":"172.21.15.118:6835","nonce":1823694233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4282,"qdb_cluster":[4282]},"id":1}]} 2024-03-27T10:00:07.581 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 9 2024-03-27T10:00:07.584 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.594+0000 7f571e200640 1 -- 172.21.15.57:0/2782890819 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f56f406c530 msgr2=0x7f56f406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:07.584 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.594+0000 7f571e200640 1 --2- 172.21.15.57:0/2782890819 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f56f406c530 0x7f56f406e9f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5708000f60 tx=0x7f5708009040 comp rx=0 tx=0).stop 2024-03-27T10:00:07.584 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.594+0000 7f571e200640 1 -- 172.21.15.57:0/2782890819 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5718151750 msgr2=0x7f57180cde10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:07.584 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.594+0000 7f571e200640 1 --2- 172.21.15.57:0/2782890819 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5718151750 0x7f57180cde10 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f571000c7d0 tx=0x7f571000cc90 comp rx=0 tx=0).stop 2024-03-27T10:00:07.584 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.594+0000 7f571e200640 1 -- 172.21.15.57:0/2782890819 shutdown_connections 2024-03-27T10:00:07.584 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.594+0000 7f571e200640 1 --2- 172.21.15.57:0/2782890819 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5718151750 0x7f57180cde10 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:07.584 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.594+0000 7f571e200640 1 --2- 172.21.15.57:0/2782890819 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f56f406c530 0x7f56f406e9f0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:07.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.594+0000 7f571e200640 1 --2- 172.21.15.57:0/2782890819 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f57180b30b0 0x7f571813e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:07.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.594+0000 7f571e200640 1 --2- 172.21.15.57:0/2782890819 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f57180723e0 0x7f57180ce780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:07.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.594+0000 7f571e200640 1 -- 172.21.15.57:0/2782890819 >> 172.21.15.57:0/2782890819 conn(0x7f57180b1c60 msgr2=0x7f57180b3520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:07.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.594+0000 7f571e200640 1 -- 172.21.15.57:0/2782890819 shutdown_connections 2024-03-27T10:00:07.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.595+0000 7f571e200640 1 -- 172.21.15.57:0/2782890819 wait complete. 2024-03-27T10:00:07.605 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-27T10:00:07.826 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.835+0000 7f5b1fe00640 1 Processor -- start 2024-03-27T10:00:07.826 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.836+0000 7f5b1fe00640 1 -- start start 2024-03-27T10:00:07.827 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.837+0000 7f5b1fe00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5b20161830 0x7f5b200cf970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:07.827 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.837+0000 7f5b1fe00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b200d0e90 0x7f5b200c7b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:07.827 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.837+0000 7f5b1fe00640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b200d2d90 con 0x7f5b200cfeb0 2024-03-27T10:00:07.827 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.837+0000 7f5b1fe00640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f5b200cf4e0 con 0x7f5b20161830 2024-03-27T10:00:07.827 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.837+0000 7f5b1fe00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f5b200cee90 con 0x7f5b200d0e90 2024-03-27T10:00:07.827 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.837+0000 7f5b1ea00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5b20161830 0x7f5b200cf970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:07.827 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.837+0000 7f5b1e000640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f5b200cfeb0 0x7f5b200d0780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:56802/0 (socket says 172.21.15.57:56802) 2024-03-27T10:00:07.827 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.837+0000 7f5b1e000640 1 -- 172.21.15.57:0/1363116017 learned_addr learned my addr 172.21.15.57:0/1363116017 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T10:00:07.828 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.838+0000 7f5b1f400640 1 --2- 172.21.15.57:0/1363116017 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b200d0e90 0x7f5b200c7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:07.828 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.838+0000 7f5b1ea00640 1 -- 172.21.15.57:0/1363116017 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b200d0e90 msgr2=0x7f5b200c7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:07.828 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.838+0000 7f5b1ea00640 1 --2- 172.21.15.57:0/1363116017 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b200d0e90 0x7f5b200c7b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:07.828 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.838+0000 7f5b1ea00640 1 -- 172.21.15.57:0/1363116017 >> v1:172.21.15.57:6789/0 conn(0x7f5b200cfeb0 legacy=0x7f5b200d0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:07.828 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.838+0000 7f5b1ea00640 1 -- 172.21.15.57:0/1363116017 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b200cf170 con 0x7f5b20161830 2024-03-27T10:00:07.828 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.838+0000 7f5b1d600640 1 -- 172.21.15.57:0/1363116017 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3704931766 0 0) 0x7f5b200d2d90 con 0x7f5b200cfeb0 2024-03-27T10:00:07.829 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.839+0000 7f5b1ea00640 1 --2- 172.21.15.57:0/1363116017 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5b20161830 0x7f5b200cf970 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5b100097a0 tx=0x7f5b1002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0e5ddeca305e4b0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:07.829 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.839+0000 7f5b1d600640 1 -- 172.21.15.57:0/1363116017 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b100315a0 con 0x7f5b20161830 2024-03-27T10:00:07.829 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.839+0000 7f5b1d600640 1 -- 172.21.15.57:0/1363116017 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b10037070 con 0x7f5b20161830 2024-03-27T10:00:07.829 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.839+0000 7f5b1d600640 1 -- 172.21.15.57:0/1363116017 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b10031960 con 0x7f5b20161830 2024-03-27T10:00:07.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.840+0000 7f5b1fe00640 1 -- 172.21.15.57:0/1363116017 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5b20161830 msgr2=0x7f5b200cf970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:07.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.840+0000 7f5b1fe00640 1 --2- 172.21.15.57:0/1363116017 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5b20161830 0x7f5b200cf970 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5b100097a0 tx=0x7f5b1002b840 comp rx=0 tx=0).stop 2024-03-27T10:00:07.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.840+0000 7f5b1fe00640 1 -- 172.21.15.57:0/1363116017 shutdown_connections 2024-03-27T10:00:07.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.840+0000 7f5b1fe00640 1 --2- 172.21.15.57:0/1363116017 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b200d0e90 0x7f5b200c7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:07.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.840+0000 7f5b1fe00640 1 --2- 172.21.15.57:0/1363116017 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5b20161830 0x7f5b200cf970 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:07.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.840+0000 7f5b1fe00640 1 -- 172.21.15.57:0/1363116017 >> 172.21.15.57:0/1363116017 conn(0x7f5b200d4030 msgr2=0x7f5b200d4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:07.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.840+0000 7f5b1fe00640 1 -- 172.21.15.57:0/1363116017 shutdown_connections 2024-03-27T10:00:07.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.840+0000 7f5b1fe00640 1 -- 172.21.15.57:0/1363116017 wait complete. 2024-03-27T10:00:07.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.842+0000 7f5b1fe00640 1 Processor -- start 2024-03-27T10:00:07.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.842+0000 7f5b1fe00640 1 -- start start 2024-03-27T10:00:07.832 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.843+0000 7f5b1fe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b200cfeb0 0x7f5b2009e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:07.832 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.843+0000 7f5b1fe00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5b200d0e90 0x7f5b200b0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:07.833 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.843+0000 7f5b1fe00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b20161830 0x7f5b2015fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:07.833 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.843+0000 7f5b1fe00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f5b200ce4b0 con 0x7f5b200d0e90 2024-03-27T10:00:07.833 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.843+0000 7f5b1fe00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f5b200ce330 con 0x7f5b200cfeb0 2024-03-27T10:00:07.833 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.843+0000 7f5b1fe00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f5b20161c10 con 0x7f5b20161830 2024-03-27T10:00:07.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.843+0000 7f5b1e000640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5b200d0e90 0x7f5b200b0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:07.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.843+0000 7f5b1e000640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5b200d0e90 0x7f5b200b0bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55234/0 (socket says 172.21.15.57:55234) 2024-03-27T10:00:07.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.843+0000 7f5b1e000640 1 -- 172.21.15.57:0/3609626788 learned_addr learned my addr 172.21.15.57:0/3609626788 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:07.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.843+0000 7f5b1f400640 1 --2- 172.21.15.57:0/3609626788 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b20161830 0x7f5b2015fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:07.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.844+0000 7f5b1ea00640 1 --2- 172.21.15.57:0/3609626788 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b200cfeb0 0x7f5b2009e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:07.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.844+0000 7f5b1e000640 1 -- 172.21.15.57:0/3609626788 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b20161830 msgr2=0x7f5b2015fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:07.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.844+0000 7f5b1e000640 1 --2- 172.21.15.57:0/3609626788 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b20161830 0x7f5b2015fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:07.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.844+0000 7f5b1e000640 1 -- 172.21.15.57:0/3609626788 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b200cfeb0 msgr2=0x7f5b2009e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:07.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.844+0000 7f5b1e000640 1 --2- 172.21.15.57:0/3609626788 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b200cfeb0 0x7f5b2009e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:07.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.844+0000 7f5b1e000640 1 -- 172.21.15.57:0/3609626788 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b2014cf20 con 0x7f5b200d0e90 2024-03-27T10:00:07.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.844+0000 7f5b1ea00640 1 --2- 172.21.15.57:0/3609626788 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b200cfeb0 0x7f5b2009e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T10:00:07.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.844+0000 7f5b1e000640 1 --2- 172.21.15.57:0/3609626788 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5b200d0e90 0x7f5b200b0bf0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5b0800c500 tx=0x7f5b0800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:07.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.844+0000 7f5b16a00640 1 -- 172.21.15.57:0/3609626788 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b08018070 con 0x7f5b200d0e90 2024-03-27T10:00:07.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.844+0000 7f5b16a00640 1 -- 172.21.15.57:0/3609626788 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b08007580 con 0x7f5b200d0e90 2024-03-27T10:00:07.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.844+0000 7f5b16a00640 1 -- 172.21.15.57:0/3609626788 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b08004a20 con 0x7f5b200d0e90 2024-03-27T10:00:07.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.844+0000 7f5b1fe00640 1 -- 172.21.15.57:0/3609626788 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b2014d1e0 con 0x7f5b200d0e90 2024-03-27T10:00:07.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.844+0000 7f5b1fe00640 1 -- 172.21.15.57:0/3609626788 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b2014d7a0 con 0x7f5b200d0e90 2024-03-27T10:00:07.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.846+0000 7f5b1fe00640 1 -- 172.21.15.57:0/3609626788 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b20068540 con 0x7f5b200d0e90 2024-03-27T10:00:07.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.847+0000 7f5b16a00640 1 -- 172.21.15.57:0/3609626788 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f5b0801b070 con 0x7f5b200d0e90 2024-03-27T10:00:07.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.847+0000 7f5b16a00640 1 --2- 172.21.15.57:0/3609626788 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f5afc06c530 0x7f5afc06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:07.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.848+0000 7f5b16a00640 1 -- 172.21.15.57:0/3609626788 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f5b0808ad30 con 0x7f5b200d0e90 2024-03-27T10:00:07.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.848+0000 7f5b1ea00640 1 --2- 172.21.15.57:0/3609626788 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f5afc06c530 0x7f5afc06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:07.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.848+0000 7f5b1ea00640 1 --2- 172.21.15.57:0/3609626788 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f5afc06c530 0x7f5afc06e9f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5b10036000 tx=0x7f5b10008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:07.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:07.852+0000 7f5b16a00640 1 -- 172.21.15.57:0/3609626788 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f5b08059000 con 0x7f5b200d0e90 2024-03-27T10:00:08.044 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.054+0000 7f5b1fe00640 1 -- 172.21.15.57:0/3609626788 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5b2008d780 con 0x7f5b200d0e90 2024-03-27T10:00:08.045 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.055+0000 7f5b16a00640 1 -- 172.21.15.57:0/3609626788 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18502 (secure 0 0 0) 0x7f5b08058900 con 0x7f5b200d0e90 2024-03-27T10:00:08.045 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:00:08.046 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":26,"fsid":"7ac43f86-2c16-4a97-98fb-715d3cebc75c","created":"2024-03-27T09:59:04.033417+0000","modified":"2024-03-27T09:59:35.208743+0000","last_up_change":"2024-03-27T09:59:16.969624+0000","last_in_change":"2024-03-27T09:59:07.421690+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-27T09:59:17.253008+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-27T09:59:26.690365+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-27T09:59:27.559059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-27T09:59:31.187596+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"47b44362-7302-4f2a-b735-582c6c3850cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6801","nonce":2020036298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6803","nonce":2020036298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6807","nonce":2020036298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6805","nonce":2020036298}]},"public_addr":"172.21.15.57:6801/2020036298","cluster_addr":"172.21.15.57:6803/2020036298","heartbeat_back_addr":"172.21.15.57:6807/2020036298","heartbeat_front_addr":"172.21.15.57:6805/2020036298","state":["exists","up"]},{"osd":1,"uuid":"feaf96f0-9431-4188-9a09-da505b40e934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6809","nonce":3190929242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6811","nonce":3190929242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6815","nonce":3190929242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6813","nonce":3190929242}]},"public_addr":"172.21.15.57:6809/3190929242","cluster_addr":"172.21.15.57:6811/3190929242","heartbeat_back_addr":"172.21.15.57:6815/3190929242","heartbeat_front_addr":"172.21.15.57:6813/3190929242","state":["exists","up"]},{"osd":2,"uuid":"21e406e6-cfbc-4fe7-a816-e2420487c95d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6817","nonce":4065849973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6819","nonce":4065849973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6823","nonce":4065849973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6821","nonce":4065849973}]},"public_addr":"172.21.15.57:6817/4065849973","cluster_addr":"172.21.15.57:6819/4065849973","heartbeat_back_addr":"172.21.15.57:6823/4065849973","heartbeat_front_addr":"172.21.15.57:6821/4065849973","state":["exists","up"]},{"osd":3,"uuid":"a389af1d-76c4-4dfc-b215-f983f4931257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6825","nonce":158084809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6827","nonce":158084809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6831","nonce":158084809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6829","nonce":158084809}]},"public_addr":"172.21.15.57:6825/158084809","cluster_addr":"172.21.15.57:6827/158084809","heartbeat_back_addr":"172.21.15.57:6831/158084809","heartbeat_front_addr":"172.21.15.57:6829/158084809","state":["exists","up"]},{"osd":4,"uuid":"e9b05dca-557a-43ee-b43f-9ce5b7d28304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6823","nonce":108719401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6827","nonce":108719401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6831","nonce":108719401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6829","nonce":108719401}]},"public_addr":"172.21.15.118:6823/108719401","cluster_addr":"172.21.15.118:6827/108719401","heartbeat_back_addr":"172.21.15.118:6831/108719401","heartbeat_front_addr":"172.21.15.118:6829/108719401","state":["exists","up"]},{"osd":5,"uuid":"d968177d-44ff-499a-b00a-b147ed879253","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6817","nonce":2704605866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6819","nonce":2704605866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6826","nonce":2704605866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6822","nonce":2704605866}]},"public_addr":"172.21.15.118:6817/2704605866","cluster_addr":"172.21.15.118:6819/2704605866","heartbeat_back_addr":"172.21.15.118:6826/2704605866","heartbeat_front_addr":"172.21.15.118:6822/2704605866","state":["exists","up"]},{"osd":6,"uuid":"e8f98052-e6ad-4cfe-a4a9-0b17a434d54e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6801","nonce":1963659095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6803","nonce":1963659095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6807","nonce":1963659095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6805","nonce":1963659095}]},"public_addr":"172.21.15.118:6801/1963659095","cluster_addr":"172.21.15.118:6803/1963659095","heartbeat_back_addr":"172.21.15.118:6807/1963659095","heartbeat_front_addr":"172.21.15.118:6805/1963659095","state":["exists","up"]},{"osd":7,"uuid":"eccff987-8e51-4a63-845a-cf0a3196d7fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6809","nonce":1955879596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6811","nonce":1955879596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6815","nonce":1955879596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6813","nonce":1955879596}]},"public_addr":"172.21.15.118:6809/1955879596","cluster_addr":"172.21.15.118:6811/1955879596","heartbeat_back_addr":"172.21.15.118:6815/1955879596","heartbeat_front_addr":"172.21.15.118:6813/1955879596","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.721258+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.696610+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.777895+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.806769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.743259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.845687+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:13.020165+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.722294+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-27T10:00:08.048 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.058+0000 7f5b1fe00640 1 -- 172.21.15.57:0/3609626788 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f5afc06c530 msgr2=0x7f5afc06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:08.048 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.058+0000 7f5b1fe00640 1 --2- 172.21.15.57:0/3609626788 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f5afc06c530 0x7f5afc06e9f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5b10036000 tx=0x7f5b10008030 comp rx=0 tx=0).stop 2024-03-27T10:00:08.048 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.058+0000 7f5b1fe00640 1 -- 172.21.15.57:0/3609626788 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5b200d0e90 msgr2=0x7f5b200b0bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:08.048 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.058+0000 7f5b1fe00640 1 --2- 172.21.15.57:0/3609626788 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5b200d0e90 0x7f5b200b0bf0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5b0800c500 tx=0x7f5b0800c9c0 comp rx=0 tx=0).stop 2024-03-27T10:00:08.048 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.058+0000 7f5b1fe00640 1 -- 172.21.15.57:0/3609626788 shutdown_connections 2024-03-27T10:00:08.048 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.058+0000 7f5b1fe00640 1 --2- 172.21.15.57:0/3609626788 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5b20161830 0x7f5b2015fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:08.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.058+0000 7f5b1fe00640 1 --2- 172.21.15.57:0/3609626788 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5b200d0e90 0x7f5b200b0bf0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:08.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.058+0000 7f5b1fe00640 1 --2- 172.21.15.57:0/3609626788 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f5afc06c530 0x7f5afc06e9f0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:08.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.058+0000 7f5b1fe00640 1 --2- 172.21.15.57:0/3609626788 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5b200cfeb0 0x7f5b2009e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:08.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.058+0000 7f5b1fe00640 1 -- 172.21.15.57:0/3609626788 >> 172.21.15.57:0/3609626788 conn(0x7f5b200d4030 msgr2=0x7f5b200c9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:08.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.058+0000 7f5b1fe00640 1 -- 172.21.15.57:0/3609626788 shutdown_connections 2024-03-27T10:00:08.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.058+0000 7f5b1fe00640 1 -- 172.21.15.57:0/3609626788 wait complete. 2024-03-27T10:00:08.065 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-27T09:59:17.253008+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-27T09:59:26.690365+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-27T09:59:27.559059+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-27T09:59:31.187596+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-27T10:00:08.066 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-27T10:00:08.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.300+0000 7f97e8800640 1 Processor -- start 2024-03-27T10:00:08.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.300+0000 7f97e8800640 1 -- start start 2024-03-27T10:00:08.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.301+0000 7f97e8800640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f97e015afd0 0x7f97e0071f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:08.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.301+0000 7f97e8800640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f97e00718c0 0x7f97e00724b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:08.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.301+0000 7f97e8800640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97e00ae520 con 0x7f97e015b3b0 2024-03-27T10:00:08.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.301+0000 7f97e8800640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f97e00ae800 con 0x7f97e00718c0 2024-03-27T10:00:08.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.301+0000 7f97e8800640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f97e00aeae0 con 0x7f97e015afd0 2024-03-27T10:00:08.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.302+0000 7f97e5400640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f97e015b3b0 0x7f97e00711b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:56804/0 (socket says 172.21.15.57:56804) 2024-03-27T10:00:08.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.302+0000 7f97e5400640 1 -- 172.21.15.57:0/291564062 learned_addr learned my addr 172.21.15.57:0/291564062 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T10:00:08.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.302+0000 7f97e5e00640 1 --2- 172.21.15.57:0/291564062 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f97e015afd0 0x7f97e0071f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:08.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.302+0000 7f97e6800640 1 --2- 172.21.15.57:0/291564062 >> v2:172.21.15.118:3300/0 conn(0x7f97e00718c0 0x7f97e00724b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:08.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.302+0000 7f97e4a00640 1 -- 172.21.15.57:0/291564062 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 291688697 0 0) 0x7f97e00ae520 con 0x7f97e015b3b0 2024-03-27T10:00:08.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.302+0000 7f97e4a00640 1 -- 172.21.15.57:0/291564062 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f97c8003520 con 0x7f97e015b3b0 2024-03-27T10:00:08.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.302+0000 7f97e4a00640 1 -- 172.21.15.57:0/291564062 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3838977154 0 0) 0x7f97c8003520 con 0x7f97e015b3b0 2024-03-27T10:00:08.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.303+0000 7f97e4a00640 1 -- 172.21.15.57:0/291564062 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f97e015afd0 msgr2=0x7f97e0071f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:08.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.303+0000 7f97e4a00640 1 --2- 172.21.15.57:0/291564062 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f97e015afd0 0x7f97e0071f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:08.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.303+0000 7f97e4a00640 1 -- 172.21.15.57:0/291564062 >> v2:172.21.15.118:3300/0 conn(0x7f97e00718c0 msgr2=0x7f97e00724b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:08.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.303+0000 7f97e4a00640 1 --2- 172.21.15.57:0/291564062 >> v2:172.21.15.118:3300/0 conn(0x7f97e00718c0 0x7f97e00724b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:08.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.303+0000 7f97e4a00640 1 -- 172.21.15.57:0/291564062 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97e00aedc0 con 0x7f97e015b3b0 2024-03-27T10:00:08.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.303+0000 7f97e4a00640 1 -- 172.21.15.57:0/291564062 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4227751516 0 0) 0x7f97d0001670 con 0x7f97e015b3b0 2024-03-27T10:00:08.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.303+0000 7f97e4a00640 1 -- 172.21.15.57:0/291564062 >> v1:172.21.15.57:6789/0 conn(0x7f97e015b3b0 legacy=0x7f97e00711b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:08.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.303+0000 7f97e4a00640 1 --2- 172.21.15.57:0/291564062 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97c80039b0 0x7f97c8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:08.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.303+0000 7f97e4a00640 1 --2- 172.21.15.57:0/291564062 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f97c8004800 0x7f97c8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:08.295 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.303+0000 7f97e4a00640 1 --2- 172.21.15.57:0/291564062 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f97e015afd0 0x7f97c80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:08.295 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.303+0000 7f97e4a00640 1 -- 172.21.15.57:0/291564062 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f97e00ae800 con 0x7f97c80039b0 2024-03-27T10:00:08.295 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.303+0000 7f97e4a00640 1 -- 172.21.15.57:0/291564062 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f97e00aeae0 con 0x7f97c8004800 2024-03-27T10:00:08.295 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.303+0000 7f97e4a00640 1 -- 172.21.15.57:0/291564062 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f97c800b9c0 con 0x7f97e015afd0 2024-03-27T10:00:08.295 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.303+0000 7f97e5e00640 1 --2- 172.21.15.57:0/291564062 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97c80039b0 0x7f97c8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:08.295 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.303+0000 7f97e5400640 1 --2- 172.21.15.57:0/291564062 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f97c8004800 0x7f97c8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:08.295 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.303+0000 7f97e6800640 1 --2- 172.21.15.57:0/291564062 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f97e015afd0 0x7f97c80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:08.295 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.303+0000 7f97e5e00640 1 -- 172.21.15.57:0/291564062 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f97e015afd0 msgr2=0x7f97c80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:08.295 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.303+0000 7f97e5e00640 1 --2- 172.21.15.57:0/291564062 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f97e015afd0 0x7f97c80051c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:08.295 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.303+0000 7f97e5e00640 1 -- 172.21.15.57:0/291564062 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f97c8004800 msgr2=0x7f97c8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:08.295 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.303+0000 7f97e5e00640 1 --2- 172.21.15.57:0/291564062 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f97c8004800 0x7f97c8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:08.295 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.303+0000 7f97e5e00640 1 -- 172.21.15.57:0/291564062 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97c8003520 con 0x7f97c80039b0 2024-03-27T10:00:08.295 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.304+0000 7f97e5400640 1 --2- 172.21.15.57:0/291564062 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f97c8004800 0x7f97c8004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T10:00:08.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.305+0000 7f97e5e00640 1 --2- 172.21.15.57:0/291564062 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97c80039b0 0x7f97c8003dd0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f97d4009650 tx=0x7f97c8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed7a4ae2b9af52b3 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:08.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.305+0000 7f97e4a00640 1 -- 172.21.15.57:0/291564062 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97d403b070 con 0x7f97c80039b0 2024-03-27T10:00:08.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.305+0000 7f97e4a00640 1 -- 172.21.15.57:0/291564062 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97d402e8c0 con 0x7f97c80039b0 2024-03-27T10:00:08.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.305+0000 7f97e4a00640 1 -- 172.21.15.57:0/291564062 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97d4009690 con 0x7f97c80039b0 2024-03-27T10:00:08.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.305+0000 7f97e8800640 1 -- 172.21.15.57:0/291564062 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97c80039b0 msgr2=0x7f97c8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:08.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.305+0000 7f97e8800640 1 --2- 172.21.15.57:0/291564062 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97c80039b0 0x7f97c8003dd0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f97d4009650 tx=0x7f97c8005830 comp rx=0 tx=0).stop 2024-03-27T10:00:08.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.305+0000 7f97e6800640 1 -- 172.21.15.57:0/291564062 reap_dead start 2024-03-27T10:00:08.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.306+0000 7f97e8800640 1 -- 172.21.15.57:0/291564062 shutdown_connections 2024-03-27T10:00:08.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.306+0000 7f97e8800640 1 -- 172.21.15.57:0/291564062 >> 172.21.15.57:0/291564062 conn(0x7f97e00b18a0 msgr2=0x7f97e00b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:08.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.306+0000 7f97e8800640 1 -- 172.21.15.57:0/291564062 shutdown_connections 2024-03-27T10:00:08.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.306+0000 7f97e8800640 1 -- 172.21.15.57:0/291564062 wait complete. 2024-03-27T10:00:08.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.307+0000 7f97e8800640 1 Processor -- start 2024-03-27T10:00:08.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.307+0000 7f97e8800640 1 -- start start 2024-03-27T10:00:08.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.308+0000 7f97e8800640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97c80039b0 0x7f97e009b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:08.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.308+0000 7f97e8800640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f97e009c510 0x7f97e015ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:08.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.308+0000 7f97e8800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f97e01f0410 0x7f97e015d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:08.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.308+0000 7f97e8800640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f97e006d7c0 con 0x7f97c80039b0 2024-03-27T10:00:08.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.308+0000 7f97e8800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f97e00721c0 con 0x7f97e01f0410 2024-03-27T10:00:08.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.308+0000 7f97e8800640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f97e006d940 con 0x7f97e009c510 2024-03-27T10:00:08.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.309+0000 7f97e5e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97c80039b0 0x7f97e009b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:08.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.309+0000 7f97e5e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97c80039b0 0x7f97e009b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55244/0 (socket says 172.21.15.57:55244) 2024-03-27T10:00:08.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.309+0000 7f97e5e00640 1 -- 172.21.15.57:0/3166186998 learned_addr learned my addr 172.21.15.57:0/3166186998 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:08.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.309+0000 7f97e5400640 1 --2- 172.21.15.57:0/3166186998 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f97e009c510 0x7f97e015ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:08.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.309+0000 7f97e5e00640 1 -- 172.21.15.57:0/3166186998 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f97e009c510 msgr2=0x7f97e015ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:08.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.309+0000 7f97e5e00640 1 --2- 172.21.15.57:0/3166186998 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f97e009c510 0x7f97e015ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:08.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.309+0000 7f97e5e00640 1 -- 172.21.15.57:0/3166186998 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f97e01f0410 msgr2=0x7f97e015d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:08.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.309+0000 7f97e6800640 1 --2- 172.21.15.57:0/3166186998 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f97e01f0410 0x7f97e015d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:08.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.309+0000 7f97e5e00640 1 --2- 172.21.15.57:0/3166186998 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f97e01f0410 0x7f97e015d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:08.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.309+0000 7f97e5e00640 1 -- 172.21.15.57:0/3166186998 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97e009b980 con 0x7f97c80039b0 2024-03-27T10:00:08.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.309+0000 7f97e5e00640 1 --2- 172.21.15.57:0/3166186998 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97c80039b0 0x7f97e009b440 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f97d4009bb0 tx=0x7f97d4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:08.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.310+0000 7f97da000640 1 -- 172.21.15.57:0/3166186998 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97d403b040 con 0x7f97c80039b0 2024-03-27T10:00:08.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.310+0000 7f97da000640 1 -- 172.21.15.57:0/3166186998 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97d4044070 con 0x7f97c80039b0 2024-03-27T10:00:08.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.310+0000 7f97da000640 1 -- 172.21.15.57:0/3166186998 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97d4003610 con 0x7f97c80039b0 2024-03-27T10:00:08.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.310+0000 7f97e8800640 1 -- 172.21.15.57:0/3166186998 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97e009c9a0 con 0x7f97c80039b0 2024-03-27T10:00:08.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.310+0000 7f97e8800640 1 -- 172.21.15.57:0/3166186998 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97e014c960 con 0x7f97c80039b0 2024-03-27T10:00:08.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.311+0000 7f97e8800640 1 -- 172.21.15.57:0/3166186998 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97e00757d0 con 0x7f97c80039b0 2024-03-27T10:00:08.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.312+0000 7f97da000640 1 -- 172.21.15.57:0/3166186998 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f97d40037b0 con 0x7f97c80039b0 2024-03-27T10:00:08.303 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.313+0000 7f97da000640 1 --2- 172.21.15.57:0/3166186998 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f97c406c4d0 0x7f97c406e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:08.303 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.313+0000 7f97da000640 1 -- 172.21.15.57:0/3166186998 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f97d40ad240 con 0x7f97c80039b0 2024-03-27T10:00:08.303 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.313+0000 7f97e5400640 1 --2- 172.21.15.57:0/3166186998 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f97c406c4d0 0x7f97c406e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:08.303 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.314+0000 7f97e5400640 1 --2- 172.21.15.57:0/3166186998 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f97c406c4d0 0x7f97c406e990 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f97e015e0a0 tx=0x7f97d0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:08.307 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.317+0000 7f97da000640 1 -- 172.21.15.57:0/3166186998 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f97d407b480 con 0x7f97c80039b0 2024-03-27T10:00:08.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.512+0000 7f97e8800640 1 -- 172.21.15.57:0/3166186998 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f97e006f4b0 con 0x7f97c80039b0 2024-03-27T10:00:08.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.513+0000 7f97da000640 1 -- 172.21.15.57:0/3166186998 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7f97e006f4b0 con 0x7f97c80039b0 2024-03-27T10:00:08.503 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2024-03-27T10:00:08.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.515+0000 7f97e8800640 1 -- 172.21.15.57:0/3166186998 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f97c406c4d0 msgr2=0x7f97c406e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:08.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.515+0000 7f97e8800640 1 --2- 172.21.15.57:0/3166186998 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f97c406c4d0 0x7f97c406e990 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f97e015e0a0 tx=0x7f97d0009040 comp rx=0 tx=0).stop 2024-03-27T10:00:08.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.515+0000 7f97e8800640 1 -- 172.21.15.57:0/3166186998 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97c80039b0 msgr2=0x7f97e009b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:08.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.515+0000 7f97e8800640 1 --2- 172.21.15.57:0/3166186998 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97c80039b0 0x7f97e009b440 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f97d4009bb0 tx=0x7f97d4004730 comp rx=0 tx=0).stop 2024-03-27T10:00:08.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.516+0000 7f97e8800640 1 -- 172.21.15.57:0/3166186998 shutdown_connections 2024-03-27T10:00:08.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.516+0000 7f97e8800640 1 --2- 172.21.15.57:0/3166186998 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f97c406c4d0 0x7f97c406e990 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:08.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.516+0000 7f97e8800640 1 --2- 172.21.15.57:0/3166186998 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f97e01f0410 0x7f97e015d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:08.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.516+0000 7f97e8800640 1 --2- 172.21.15.57:0/3166186998 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f97e009c510 0x7f97e015ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:08.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.516+0000 7f97e8800640 1 --2- 172.21.15.57:0/3166186998 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f97c80039b0 0x7f97e009b440 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:08.507 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.516+0000 7f97e8800640 1 -- 172.21.15.57:0/3166186998 >> 172.21.15.57:0/3166186998 conn(0x7f97e00b18a0 msgr2=0x7f97e0155dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:08.507 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.516+0000 7f97e8800640 1 -- 172.21.15.57:0/3166186998 shutdown_connections 2024-03-27T10:00:08.507 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.516+0000 7f97e8800640 1 -- 172.21.15.57:0/3166186998 wait complete. 2024-03-27T10:00:08.523 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-27T10:00:08.735 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.745+0000 7f1438c00640 1 Processor -- start 2024-03-27T10:00:08.736 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.746+0000 7f1438c00640 1 -- start start 2024-03-27T10:00:08.737 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.747+0000 7f1438c00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f143415d1a0 0x7f14340acd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:08.737 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.747+0000 7f1438c00640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f143415d630 con 0x7f14340aea20 2024-03-27T10:00:08.737 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.747+0000 7f1438c00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f143415c4c0 con 0x7f143406cf30 2024-03-27T10:00:08.737 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.747+0000 7f1438c00640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f1434072600 con 0x7f143415d1a0 2024-03-27T10:00:08.737 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.748+0000 7f1431e00640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f14340aea20 0x7f14340aee00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:56816/0 (socket says 172.21.15.57:56816) 2024-03-27T10:00:08.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.748+0000 7f1431e00640 1 -- 172.21.15.57:0/1681266584 learned_addr learned my addr 172.21.15.57:0/1681266584 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T10:00:08.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.748+0000 7f1431400640 1 --2- 172.21.15.57:0/1681266584 >> v2:172.21.15.57:3300/0 conn(0x7f143415d1a0 0x7f14340acd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:08.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.748+0000 7f1430a00640 1 -- 172.21.15.57:0/1681266584 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3737151130 0 0) 0x7f143415d630 con 0x7f14340aea20 2024-03-27T10:00:08.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.748+0000 7f1430a00640 1 -- 172.21.15.57:0/1681266584 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1418003520 con 0x7f14340aea20 2024-03-27T10:00:08.739 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.748+0000 7f1431400640 1 -- 172.21.15.57:0/1681266584 >> v1:172.21.15.118:6789/0 conn(0x7f143406cf30 legacy=0x7f143406d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:08.739 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.748+0000 7f1431400640 1 -- 172.21.15.57:0/1681266584 >> v1:172.21.15.57:6789/0 conn(0x7f14340aea20 legacy=0x7f14340aee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:08.739 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.748+0000 7f1431400640 1 -- 172.21.15.57:0/1681266584 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14340728e0 con 0x7f143415d1a0 2024-03-27T10:00:08.739 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.750+0000 7f1431400640 1 --2- 172.21.15.57:0/1681266584 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f143415d1a0 0x7f14340acd60 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f14200097a0 tx=0x7f142002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b45da05c8c227670 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:08.739 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.750+0000 7f1430a00640 1 -- 172.21.15.57:0/1681266584 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1420035020 con 0x7f143415d1a0 2024-03-27T10:00:08.740 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.750+0000 7f1430a00640 1 -- 172.21.15.57:0/1681266584 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1420031830 con 0x7f143415d1a0 2024-03-27T10:00:08.740 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.750+0000 7f1430a00640 1 -- 172.21.15.57:0/1681266584 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1420031c00 con 0x7f143415d1a0 2024-03-27T10:00:08.740 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.751+0000 7f1438c00640 1 -- 172.21.15.57:0/1681266584 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f143415d1a0 msgr2=0x7f14340acd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:08.740 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.751+0000 7f1438c00640 1 --2- 172.21.15.57:0/1681266584 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f143415d1a0 0x7f14340acd60 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f14200097a0 tx=0x7f142002b8d0 comp rx=0 tx=0).stop 2024-03-27T10:00:08.741 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.751+0000 7f1438c00640 1 -- 172.21.15.57:0/1681266584 shutdown_connections 2024-03-27T10:00:08.741 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.751+0000 7f1438c00640 1 --2- 172.21.15.57:0/1681266584 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f143415d1a0 0x7f14340acd60 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:08.741 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.751+0000 7f1438c00640 1 -- 172.21.15.57:0/1681266584 >> 172.21.15.57:0/1681266584 conn(0x7f14340b18a0 msgr2=0x7f14340b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:08.741 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.751+0000 7f1438c00640 1 -- 172.21.15.57:0/1681266584 shutdown_connections 2024-03-27T10:00:08.741 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.751+0000 7f1438c00640 1 -- 172.21.15.57:0/1681266584 wait complete. 2024-03-27T10:00:08.742 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.752+0000 7f1438c00640 1 Processor -- start 2024-03-27T10:00:08.742 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.753+0000 7f1438c00640 1 -- start start 2024-03-27T10:00:08.743 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.754+0000 7f1438c00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f143406cf30 0x7f14341f7e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:08.744 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.754+0000 7f1438c00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f14340aea20 0x7f14340b0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:08.744 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.754+0000 7f1438c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f143415d1a0 0x7f143409aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:08.744 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.754+0000 7f1438c00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f14340733c0 con 0x7f143406cf30 2024-03-27T10:00:08.744 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.754+0000 7f1438c00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f1434072ea0 con 0x7f143415d1a0 2024-03-27T10:00:08.744 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.754+0000 7f1438c00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f143406da20 con 0x7f14340aea20 2024-03-27T10:00:08.744 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.754+0000 7f1431e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f143406cf30 0x7f14341f7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:08.744 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.754+0000 7f1431e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f143406cf30 0x7f14341f7e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55274/0 (socket says 172.21.15.57:55274) 2024-03-27T10:00:08.744 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.754+0000 7f1431e00640 1 -- 172.21.15.57:0/1213291893 learned_addr learned my addr 172.21.15.57:0/1213291893 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:08.745 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.754+0000 7f1431400640 1 --2- 172.21.15.57:0/1213291893 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f14340aea20 0x7f14340b0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:08.745 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.754+0000 7f1432800640 1 --2- 172.21.15.57:0/1213291893 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f143415d1a0 0x7f143409aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:08.745 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.754+0000 7f1431e00640 1 -- 172.21.15.57:0/1213291893 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f14340aea20 msgr2=0x7f14340b0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:08.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.754+0000 7f1431e00640 1 --2- 172.21.15.57:0/1213291893 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f14340aea20 0x7f14340b0ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:08.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.754+0000 7f1431e00640 1 -- 172.21.15.57:0/1213291893 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f143415d1a0 msgr2=0x7f143409aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:08.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.754+0000 7f1431e00640 1 --2- 172.21.15.57:0/1213291893 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f143415d1a0 0x7f143409aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:08.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.754+0000 7f1431e00640 1 -- 172.21.15.57:0/1213291893 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14341f7420 con 0x7f143406cf30 2024-03-27T10:00:08.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.755+0000 7f1431e00640 1 --2- 172.21.15.57:0/1213291893 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f143406cf30 0x7f14341f7e90 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f142400c500 tx=0x7f142400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:08.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.755+0000 7f142a000640 1 -- 172.21.15.57:0/1213291893 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1424017070 con 0x7f143406cf30 2024-03-27T10:00:08.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.755+0000 7f142a000640 1 -- 172.21.15.57:0/1213291893 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1424005ce0 con 0x7f143406cf30 2024-03-27T10:00:08.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.755+0000 7f1438c00640 1 -- 172.21.15.57:0/1213291893 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f143409b3a0 con 0x7f143406cf30 2024-03-27T10:00:08.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.755+0000 7f142a000640 1 -- 172.21.15.57:0/1213291893 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1424007330 con 0x7f143406cf30 2024-03-27T10:00:08.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.755+0000 7f1438c00640 1 -- 172.21.15.57:0/1213291893 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14341f7970 con 0x7f143406cf30 2024-03-27T10:00:08.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.756+0000 7f1438c00640 1 -- 172.21.15.57:0/1213291893 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14340757d0 con 0x7f143406cf30 2024-03-27T10:00:08.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.757+0000 7f142a000640 1 -- 172.21.15.57:0/1213291893 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f142401a070 con 0x7f143406cf30 2024-03-27T10:00:08.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.758+0000 7f142a000640 1 --2- 172.21.15.57:0/1213291893 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f141406c530 0x7f141406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:08.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.758+0000 7f142a000640 1 -- 172.21.15.57:0/1213291893 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f142408aeb0 con 0x7f143406cf30 2024-03-27T10:00:08.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.758+0000 7f1431400640 1 --2- 172.21.15.57:0/1213291893 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f141406c530 0x7f141406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:08.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.759+0000 7f1431400640 1 --2- 172.21.15.57:0/1213291893 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f141406c530 0x7f141406e9f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1420036000 tx=0x7f1420008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:08.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.763+0000 7f142a000640 1 -- 172.21.15.57:0/1213291893 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f1424059240 con 0x7f143406cf30 2024-03-27T10:00:08.953 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.963+0000 7f1438c00640 1 -- 172.21.15.57:0/1213291893 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f143409dc70 con 0x7f143406cf30 2024-03-27T10:00:08.953 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.964+0000 7f142a000640 1 -- 172.21.15.57:0/1213291893 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7f1424058b40 con 0x7f143406cf30 2024-03-27T10:00:08.954 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2024-03-27T10:00:08.956 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.966+0000 7f1438c00640 1 -- 172.21.15.57:0/1213291893 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f141406c530 msgr2=0x7f141406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:08.957 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.966+0000 7f1438c00640 1 --2- 172.21.15.57:0/1213291893 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f141406c530 0x7f141406e9f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1420036000 tx=0x7f1420008030 comp rx=0 tx=0).stop 2024-03-27T10:00:08.957 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.966+0000 7f1438c00640 1 -- 172.21.15.57:0/1213291893 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f143406cf30 msgr2=0x7f14341f7e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:08.957 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.966+0000 7f1438c00640 1 --2- 172.21.15.57:0/1213291893 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f143406cf30 0x7f14341f7e90 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f142400c500 tx=0x7f142400c9c0 comp rx=0 tx=0).stop 2024-03-27T10:00:08.957 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.966+0000 7f1438c00640 1 -- 172.21.15.57:0/1213291893 shutdown_connections 2024-03-27T10:00:08.957 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.966+0000 7f1438c00640 1 --2- 172.21.15.57:0/1213291893 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f141406c530 0x7f141406e9f0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:08.957 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.966+0000 7f1438c00640 1 --2- 172.21.15.57:0/1213291893 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f143415d1a0 0x7f143409aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:08.957 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.966+0000 7f1438c00640 1 --2- 172.21.15.57:0/1213291893 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f14340aea20 0x7f14340b0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:08.957 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.966+0000 7f1438c00640 1 --2- 172.21.15.57:0/1213291893 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f143406cf30 0x7f14341f7e90 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:08.957 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.966+0000 7f1438c00640 1 -- 172.21.15.57:0/1213291893 >> 172.21.15.57:0/1213291893 conn(0x7f14340b18a0 msgr2=0x7f14340ad940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:08.957 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.967+0000 7f1438c00640 1 -- 172.21.15.57:0/1213291893 shutdown_connections 2024-03-27T10:00:08.957 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:08.967+0000 7f1438c00640 1 -- 172.21.15.57:0/1213291893 wait complete. 2024-03-27T10:00:08.976 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-27T10:00:09.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.217+0000 7f5639c00640 1 Processor -- start 2024-03-27T10:00:09.207 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.217+0000 7f5639c00640 1 -- start start 2024-03-27T10:00:09.208 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.218+0000 7f5639c00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f563415e250 0x7f56340cf9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:09.208 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.218+0000 7f5639c00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f56340cfef0 0x7f56340d0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:09.208 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.218+0000 7f5639c00640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56340d3190 con 0x7f563415e630 2024-03-27T10:00:09.208 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.218+0000 7f5639c00640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f56340d2d00 con 0x7f563415e250 2024-03-27T10:00:09.208 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.218+0000 7f5639c00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f56340d20f0 con 0x7f56340cfef0 2024-03-27T10:00:09.208 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.218+0000 7f5633400640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f563415e630 0x7f56340b92f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:56832/0 (socket says 172.21.15.57:56832) 2024-03-27T10:00:09.208 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.218+0000 7f5633400640 1 -- 172.21.15.57:0/599736406 learned_addr learned my addr 172.21.15.57:0/599736406 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T10:00:09.208 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.218+0000 7f5632a00640 1 --2- 172.21.15.57:0/599736406 >> v2:172.21.15.57:3300/0 conn(0x7f563415e250 0x7f56340cf9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:09.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.219+0000 7f562be00640 1 --2- 172.21.15.57:0/599736406 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f56340cfef0 0x7f56340d0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:09.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.219+0000 7f5632a00640 1 -- 172.21.15.57:0/599736406 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f56340cfef0 msgr2=0x7f56340d0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:09.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.219+0000 7f5632a00640 1 --2- 172.21.15.57:0/599736406 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f56340cfef0 0x7f56340d0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:09.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.219+0000 7f5632000640 1 -- 172.21.15.57:0/599736406 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 469646031 0 0) 0x7f56340d3190 con 0x7f563415e630 2024-03-27T10:00:09.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.219+0000 7f5632a00640 1 -- 172.21.15.57:0/599736406 >> v1:172.21.15.57:6789/0 conn(0x7f563415e630 legacy=0x7f56340b92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:09.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.219+0000 7f5632a00640 1 -- 172.21.15.57:0/599736406 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56340d23d0 con 0x7f563415e250 2024-03-27T10:00:09.210 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.220+0000 7f5632a00640 1 --2- 172.21.15.57:0/599736406 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f563415e250 0x7f56340cf9b0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f56240097a0 tx=0x7f562402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=103e287e80b0c261 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:09.210 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.220+0000 7f5632000640 1 -- 172.21.15.57:0/599736406 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5624035020 con 0x7f563415e250 2024-03-27T10:00:09.210 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.220+0000 7f5632000640 1 -- 172.21.15.57:0/599736406 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5624031830 con 0x7f563415e250 2024-03-27T10:00:09.210 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.220+0000 7f5632000640 1 -- 172.21.15.57:0/599736406 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5624031c00 con 0x7f563415e250 2024-03-27T10:00:09.211 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.221+0000 7f5639c00640 1 -- 172.21.15.57:0/599736406 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f563415e250 msgr2=0x7f56340cf9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:09.211 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.221+0000 7f5639c00640 1 --2- 172.21.15.57:0/599736406 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f563415e250 0x7f56340cf9b0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f56240097a0 tx=0x7f562402b8d0 comp rx=0 tx=0).stop 2024-03-27T10:00:09.211 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.221+0000 7f5639c00640 1 -- 172.21.15.57:0/599736406 shutdown_connections 2024-03-27T10:00:09.211 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.221+0000 7f5639c00640 1 --2- 172.21.15.57:0/599736406 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f56340cfef0 0x7f56340d0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:09.211 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.221+0000 7f5639c00640 1 --2- 172.21.15.57:0/599736406 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f563415e250 0x7f56340cf9b0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:09.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.221+0000 7f5639c00640 1 -- 172.21.15.57:0/599736406 >> 172.21.15.57:0/599736406 conn(0x7f563409d4a0 msgr2=0x7f56340d4160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:09.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.221+0000 7f5639c00640 1 -- 172.21.15.57:0/599736406 shutdown_connections 2024-03-27T10:00:09.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.221+0000 7f5639c00640 1 -- 172.21.15.57:0/599736406 wait complete. 2024-03-27T10:00:09.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.223+0000 7f5639c00640 1 Processor -- start 2024-03-27T10:00:09.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.223+0000 7f5639c00640 1 -- start start 2024-03-27T10:00:09.215 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.224+0000 7f5639c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f56340cfef0 0x7f56340b9930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:09.215 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.224+0000 7f5639c00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f563415e250 0x7f56340c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:09.215 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.224+0000 7f5639c00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f563415e630 0x7f56340c8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:09.215 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.224+0000 7f5639c00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f56340d1d30 con 0x7f563415e250 2024-03-27T10:00:09.215 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.224+0000 7f5639c00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f56340d2990 con 0x7f56340cfef0 2024-03-27T10:00:09.215 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.224+0000 7f5639c00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f56340d1eb0 con 0x7f563415e630 2024-03-27T10:00:09.215 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.224+0000 7f562be00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f563415e250 0x7f56340c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:09.215 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.224+0000 7f562be00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f563415e250 0x7f56340c8aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55280/0 (socket says 172.21.15.57:55280) 2024-03-27T10:00:09.215 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.224+0000 7f562be00640 1 -- 172.21.15.57:0/1523095795 learned_addr learned my addr 172.21.15.57:0/1523095795 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:09.215 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.225+0000 7f5632a00640 1 --2- 172.21.15.57:0/1523095795 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f56340cfef0 0x7f56340b9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:09.215 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.225+0000 7f5633400640 1 --2- 172.21.15.57:0/1523095795 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f563415e630 0x7f56340c8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:09.215 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.225+0000 7f562be00640 1 -- 172.21.15.57:0/1523095795 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f563415e630 msgr2=0x7f56340c8fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:09.215 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.225+0000 7f562be00640 1 --2- 172.21.15.57:0/1523095795 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f563415e630 0x7f56340c8fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:09.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.225+0000 7f562be00640 1 -- 172.21.15.57:0/1523095795 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f56340cfef0 msgr2=0x7f56340b9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:09.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.225+0000 7f562be00640 1 --2- 172.21.15.57:0/1523095795 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f56340cfef0 0x7f56340b9930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:09.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.225+0000 7f562be00640 1 -- 172.21.15.57:0/1523095795 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56340ccfc0 con 0x7f563415e250 2024-03-27T10:00:09.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.225+0000 7f5632a00640 1 --2- 172.21.15.57:0/1523095795 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f56340cfef0 0x7f56340b9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T10:00:09.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.225+0000 7f562be00640 1 --2- 172.21.15.57:0/1523095795 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f563415e250 0x7f56340c8aa0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f561c00d800 tx=0x7f561c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:09.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.225+0000 7f562aa00640 1 -- 172.21.15.57:0/1523095795 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f561c00b6c0 con 0x7f563415e250 2024-03-27T10:00:09.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.226+0000 7f562aa00640 1 -- 172.21.15.57:0/1523095795 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f561c019070 con 0x7f563415e250 2024-03-27T10:00:09.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.226+0000 7f562aa00640 1 -- 172.21.15.57:0/1523095795 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f561c00ba80 con 0x7f563415e250 2024-03-27T10:00:09.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.226+0000 7f5639c00640 1 -- 172.21.15.57:0/1523095795 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56340cd2a0 con 0x7f563415e250 2024-03-27T10:00:09.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.226+0000 7f5639c00640 1 -- 172.21.15.57:0/1523095795 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56340cd860 con 0x7f563415e250 2024-03-27T10:00:09.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.227+0000 7f5639c00640 1 -- 172.21.15.57:0/1523095795 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5634068540 con 0x7f563415e250 2024-03-27T10:00:09.219 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.229+0000 7f562aa00640 1 -- 172.21.15.57:0/1523095795 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f561c00bc20 con 0x7f563415e250 2024-03-27T10:00:09.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.230+0000 7f562aa00640 1 --2- 172.21.15.57:0/1523095795 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f561006c530 0x7f561006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:09.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.230+0000 7f562aa00640 1 -- 172.21.15.57:0/1523095795 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f561c08bf20 con 0x7f563415e250 2024-03-27T10:00:09.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.230+0000 7f5632a00640 1 --2- 172.21.15.57:0/1523095795 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f561006c530 0x7f561006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:09.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.231+0000 7f5632a00640 1 --2- 172.21.15.57:0/1523095795 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f561006c530 0x7f561006e9f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5624036000 tx=0x7f5624008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:09.225 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.235+0000 7f562aa00640 1 -- 172.21.15.57:0/1523095795 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f561c01c360 con 0x7f563415e250 2024-03-27T10:00:09.433 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.443+0000 7f5639c00640 1 -- 172.21.15.57:0/1523095795 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f56340d4870 con 0x7f563415e250 2024-03-27T10:00:09.434 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.445+0000 7f562aa00640 1 -- 172.21.15.57:0/1523095795 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7f561c05a160 con 0x7f563415e250 2024-03-27T10:00:09.434 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2024-03-27T10:00:09.438 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.447+0000 7f5639c00640 1 -- 172.21.15.57:0/1523095795 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f561006c530 msgr2=0x7f561006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:09.438 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.447+0000 7f5639c00640 1 --2- 172.21.15.57:0/1523095795 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f561006c530 0x7f561006e9f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5624036000 tx=0x7f5624008030 comp rx=0 tx=0).stop 2024-03-27T10:00:09.438 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.447+0000 7f5639c00640 1 -- 172.21.15.57:0/1523095795 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f563415e250 msgr2=0x7f56340c8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:09.438 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.447+0000 7f5639c00640 1 --2- 172.21.15.57:0/1523095795 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f563415e250 0x7f56340c8aa0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f561c00d800 tx=0x7f561c00dcc0 comp rx=0 tx=0).stop 2024-03-27T10:00:09.438 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.448+0000 7f5639c00640 1 -- 172.21.15.57:0/1523095795 shutdown_connections 2024-03-27T10:00:09.438 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.448+0000 7f5639c00640 1 --2- 172.21.15.57:0/1523095795 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f563415e630 0x7f56340c8fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:09.438 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.448+0000 7f5639c00640 1 --2- 172.21.15.57:0/1523095795 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f563415e250 0x7f56340c8aa0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:09.438 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.448+0000 7f5639c00640 1 --2- 172.21.15.57:0/1523095795 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f561006c530 0x7f561006e9f0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:09.438 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.448+0000 7f5639c00640 1 --2- 172.21.15.57:0/1523095795 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f56340cfef0 0x7f56340b9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:09.438 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.448+0000 7f5639c00640 1 -- 172.21.15.57:0/1523095795 >> 172.21.15.57:0/1523095795 conn(0x7f563409d4a0 msgr2=0x7f56340ced70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:09.438 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.448+0000 7f5639c00640 1 -- 172.21.15.57:0/1523095795 shutdown_connections 2024-03-27T10:00:09.439 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.448+0000 7f5639c00640 1 -- 172.21.15.57:0/1523095795 wait complete. 2024-03-27T10:00:09.461 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-27T10:00:09.666 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.676+0000 7f8fea400640 1 Processor -- start 2024-03-27T10:00:09.666 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.676+0000 7f8fea400640 1 -- start start 2024-03-27T10:00:09.668 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.678+0000 7f8fea400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8fe40cee30 0x7f8fe406d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:09.668 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.678+0000 7f8fea400640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8fe40ca330 con 0x7f8fe41458e0 2024-03-27T10:00:09.668 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.678+0000 7f8fea400640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8fe40ca610 con 0x7f8fe41601a0 2024-03-27T10:00:09.668 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.678+0000 7f8fea400640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f8fe40ca8f0 con 0x7f8fe40cee30 2024-03-27T10:00:09.668 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.678+0000 7f8fe9000640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f8fe41458e0 0x7f8fe415fa90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:56840/0 (socket says 172.21.15.57:56840) 2024-03-27T10:00:09.668 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.678+0000 7f8fe9000640 1 -- 172.21.15.57:0/2240455619 learned_addr learned my addr 172.21.15.57:0/2240455619 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T10:00:09.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.679+0000 7f8fe9a00640 1 --2- 172.21.15.57:0/2240455619 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8fe40cee30 0x7f8fe406d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:09.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.679+0000 7f8fe3400640 1 -- 172.21.15.57:0/2240455619 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2950507772 0 0) 0x7f8fe40ca330 con 0x7f8fe41458e0 2024-03-27T10:00:09.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.679+0000 7f8fe3400640 1 -- 172.21.15.57:0/2240455619 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8fcc003520 con 0x7f8fe41458e0 2024-03-27T10:00:09.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.679+0000 7f8fe3400640 1 -- 172.21.15.57:0/2240455619 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3636971976 0 0) 0x7f8fcc003520 con 0x7f8fe41458e0 2024-03-27T10:00:09.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.679+0000 7f8fe3400640 1 -- 172.21.15.57:0/2240455619 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8fe40cee30 msgr2=0x7f8fe406d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:09.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.679+0000 7f8fe3400640 1 --2- 172.21.15.57:0/2240455619 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8fe40cee30 0x7f8fe406d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:09.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.679+0000 7f8fe3400640 1 -- 172.21.15.57:0/2240455619 >> v1:172.21.15.118:6789/0 conn(0x7f8fe41601a0 legacy=0x7f8fe40ce720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:09.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.679+0000 7f8fe3400640 1 -- 172.21.15.57:0/2240455619 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fe40cabd0 con 0x7f8fe41458e0 2024-03-27T10:00:09.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.679+0000 7f8fe3400640 1 -- 172.21.15.57:0/2240455619 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4227751516 0 0) 0x7f8fd8001670 con 0x7f8fe41458e0 2024-03-27T10:00:09.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.679+0000 7f8fe3400640 1 -- 172.21.15.57:0/2240455619 >> v1:172.21.15.57:6789/0 conn(0x7f8fe41458e0 legacy=0x7f8fe415fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:09.671 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.679+0000 7f8fe3400640 1 --2- 172.21.15.57:0/2240455619 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8fcc0039e0 0x7f8fcc003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:09.671 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.679+0000 7f8fe3400640 1 --2- 172.21.15.57:0/2240455619 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8fcc004390 0x7f8fcc004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:09.671 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.679+0000 7f8fe3400640 1 --2- 172.21.15.57:0/2240455619 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8fe40cee30 0x7f8fcc0050c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:09.671 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.680+0000 7f8fe3400640 1 -- 172.21.15.57:0/2240455619 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f8fe40ca8f0 con 0x7f8fcc004390 2024-03-27T10:00:09.671 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.680+0000 7f8fe3400640 1 -- 172.21.15.57:0/2240455619 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f8fcc00b9c0 con 0x7f8fcc0039e0 2024-03-27T10:00:09.671 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.680+0000 7f8fe3400640 1 -- 172.21.15.57:0/2240455619 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f8fcc00bbc0 con 0x7f8fe40cee30 2024-03-27T10:00:09.671 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.680+0000 7f8fe3e00640 1 --2- 172.21.15.57:0/2240455619 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8fcc004390 0x7f8fcc004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:09.671 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.680+0000 7f8fe9a00640 1 --2- 172.21.15.57:0/2240455619 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8fe40cee30 0x7f8fcc0050c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:09.671 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.680+0000 7f8fe9000640 1 --2- 172.21.15.57:0/2240455619 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8fcc0039e0 0x7f8fcc003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:09.671 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.680+0000 7f8fe3e00640 1 -- 172.21.15.57:0/2240455619 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8fe40cee30 msgr2=0x7f8fcc0050c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:09.671 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.680+0000 7f8fe3e00640 1 --2- 172.21.15.57:0/2240455619 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8fe40cee30 0x7f8fcc0050c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:09.671 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.680+0000 7f8fe3e00640 1 -- 172.21.15.57:0/2240455619 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8fcc0039e0 msgr2=0x7f8fcc003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:09.671 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.680+0000 7f8fe3e00640 1 --2- 172.21.15.57:0/2240455619 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8fcc0039e0 0x7f8fcc003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:09.671 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.680+0000 7f8fe3e00640 1 -- 172.21.15.57:0/2240455619 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fcc003520 con 0x7f8fcc004390 2024-03-27T10:00:09.671 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.680+0000 7f8fe9a00640 1 --2- 172.21.15.57:0/2240455619 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8fe40cee30 0x7f8fcc0050c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T10:00:09.672 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.681+0000 7f8fe3e00640 1 --2- 172.21.15.57:0/2240455619 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8fcc004390 0x7f8fcc004860 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8fd0001910 tx=0x7f8fcc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4e12a65a1cb8c47 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:09.672 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.682+0000 7f8fe3400640 1 -- 172.21.15.57:0/2240455619 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fd00014e0 con 0x7f8fcc004390 2024-03-27T10:00:09.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.682+0000 7f8fe3400640 1 -- 172.21.15.57:0/2240455619 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fd0037070 con 0x7f8fcc004390 2024-03-27T10:00:09.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.682+0000 7f8fe3400640 1 -- 172.21.15.57:0/2240455619 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fd0032840 con 0x7f8fcc004390 2024-03-27T10:00:09.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.682+0000 7f8fea400640 1 -- 172.21.15.57:0/2240455619 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8fcc004390 msgr2=0x7f8fcc004860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:09.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.682+0000 7f8fea400640 1 --2- 172.21.15.57:0/2240455619 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8fcc004390 0x7f8fcc004860 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8fd0001910 tx=0x7f8fcc005830 comp rx=0 tx=0).stop 2024-03-27T10:00:09.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.682+0000 7f8fe9a00640 1 -- 172.21.15.57:0/2240455619 reap_dead start 2024-03-27T10:00:09.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.682+0000 7f8fea400640 1 -- 172.21.15.57:0/2240455619 shutdown_connections 2024-03-27T10:00:09.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.682+0000 7f8fea400640 1 -- 172.21.15.57:0/2240455619 >> 172.21.15.57:0/2240455619 conn(0x7f8fe40cfb40 msgr2=0x7f8fe40cff20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:09.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.682+0000 7f8fea400640 1 -- 172.21.15.57:0/2240455619 shutdown_connections 2024-03-27T10:00:09.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.683+0000 7f8fea400640 1 -- 172.21.15.57:0/2240455619 wait complete. 2024-03-27T10:00:09.674 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.684+0000 7f8fea400640 1 Processor -- start 2024-03-27T10:00:09.674 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.684+0000 7f8fea400640 1 -- start start 2024-03-27T10:00:09.676 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.685+0000 7f8fea400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8fcc004390 0x7f8fe4137320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:09.676 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.685+0000 7f8fea400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8fe413fac0 0x7f8fe415d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:09.676 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.685+0000 7f8fea400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8fe415d960 0x7f8fe415dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:09.676 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.685+0000 7f8fea400640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f8fe406d400 con 0x7f8fe413fac0 2024-03-27T10:00:09.676 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.685+0000 7f8fea400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f8fe406d280 con 0x7f8fe415d960 2024-03-27T10:00:09.676 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.685+0000 7f8fea400640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f8fe40cb0f0 con 0x7f8fcc004390 2024-03-27T10:00:09.676 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.686+0000 7f8fe3e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8fe413fac0 0x7f8fe415d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:09.676 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.686+0000 7f8fe3e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8fe413fac0 0x7f8fe415d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55302/0 (socket says 172.21.15.57:55302) 2024-03-27T10:00:09.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.686+0000 7f8fe3e00640 1 -- 172.21.15.57:0/3529013341 learned_addr learned my addr 172.21.15.57:0/3529013341 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:09.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.686+0000 7f8fe9000640 1 --2- 172.21.15.57:0/3529013341 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8fcc004390 0x7f8fe4137320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:09.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.686+0000 7f8fe9a00640 1 --2- 172.21.15.57:0/3529013341 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8fe415d960 0x7f8fe415dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:09.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.686+0000 7f8fe3e00640 1 -- 172.21.15.57:0/3529013341 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8fcc004390 msgr2=0x7f8fe4137320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:09.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.686+0000 7f8fe3e00640 1 --2- 172.21.15.57:0/3529013341 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8fcc004390 0x7f8fe4137320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:09.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.686+0000 7f8fe3e00640 1 -- 172.21.15.57:0/3529013341 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8fe415d960 msgr2=0x7f8fe415dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:09.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.686+0000 7f8fe3e00640 1 --2- 172.21.15.57:0/3529013341 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8fe415d960 0x7f8fe415dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:09.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.686+0000 7f8fe3e00640 1 -- 172.21.15.57:0/3529013341 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fe40b4d90 con 0x7f8fe413fac0 2024-03-27T10:00:09.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.687+0000 7f8fe3e00640 1 --2- 172.21.15.57:0/3529013341 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8fe413fac0 0x7f8fe415d420 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f8fd0001a00 tx=0x7f8fd00012b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:09.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.687+0000 7f8fe0c00640 1 -- 172.21.15.57:0/3529013341 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fd00052e0 con 0x7f8fe413fac0 2024-03-27T10:00:09.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.687+0000 7f8fe0c00640 1 -- 172.21.15.57:0/3529013341 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fd0040070 con 0x7f8fe413fac0 2024-03-27T10:00:09.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.687+0000 7f8fe0c00640 1 -- 172.21.15.57:0/3529013341 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fd0007260 con 0x7f8fe413fac0 2024-03-27T10:00:09.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.687+0000 7f8fea400640 1 -- 172.21.15.57:0/3529013341 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fe40b3120 con 0x7f8fe413fac0 2024-03-27T10:00:09.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.687+0000 7f8fea400640 1 -- 172.21.15.57:0/3529013341 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fe40b5030 con 0x7f8fe413fac0 2024-03-27T10:00:09.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.689+0000 7f8fea400640 1 -- 172.21.15.57:0/3529013341 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fe4068540 con 0x7f8fe413fac0 2024-03-27T10:00:09.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.690+0000 7f8fe0c00640 1 -- 172.21.15.57:0/3529013341 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f8fd0007400 con 0x7f8fe413fac0 2024-03-27T10:00:09.680 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.691+0000 7f8fe0c00640 1 --2- 172.21.15.57:0/3529013341 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f8fc406c530 0x7f8fc406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:09.680 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.691+0000 7f8fe0c00640 1 -- 172.21.15.57:0/3529013341 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7f8fd00ad690 con 0x7f8fe413fac0 2024-03-27T10:00:09.680 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.691+0000 7f8fe9000640 1 --2- 172.21.15.57:0/3529013341 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f8fc406c530 0x7f8fc406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:09.681 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.692+0000 7f8fe9000640 1 --2- 172.21.15.57:0/3529013341 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f8fc406c530 0x7f8fc406e9f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8fe40b2d00 tx=0x7f8fd8007040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:09.685 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.696+0000 7f8fe0c00640 1 -- 172.21.15.57:0/3529013341 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f8fd007b8a0 con 0x7f8fe413fac0 2024-03-27T10:00:09.887 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.897+0000 7f8fea400640 1 -- 172.21.15.57:0/3529013341 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f8fe40cf490 con 0x7f8fe413fac0 2024-03-27T10:00:09.888 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.898+0000 7f8fe0c00640 1 -- 172.21.15.57:0/3529013341 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7f8fd007b1a0 con 0x7f8fe413fac0 2024-03-27T10:00:09.888 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2024-03-27T10:00:09.891 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.900+0000 7f8fea400640 1 -- 172.21.15.57:0/3529013341 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f8fc406c530 msgr2=0x7f8fc406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:09.891 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.900+0000 7f8fea400640 1 --2- 172.21.15.57:0/3529013341 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f8fc406c530 0x7f8fc406e9f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8fe40b2d00 tx=0x7f8fd8007040 comp rx=0 tx=0).stop 2024-03-27T10:00:09.891 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.900+0000 7f8fea400640 1 -- 172.21.15.57:0/3529013341 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8fe413fac0 msgr2=0x7f8fe415d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:09.891 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.900+0000 7f8fea400640 1 --2- 172.21.15.57:0/3529013341 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8fe413fac0 0x7f8fe415d420 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f8fd0001a00 tx=0x7f8fd00012b0 comp rx=0 tx=0).stop 2024-03-27T10:00:09.891 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.901+0000 7f8fea400640 1 -- 172.21.15.57:0/3529013341 shutdown_connections 2024-03-27T10:00:09.891 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.901+0000 7f8fea400640 1 --2- 172.21.15.57:0/3529013341 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f8fc406c530 0x7f8fc406e9f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:09.891 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.901+0000 7f8fea400640 1 --2- 172.21.15.57:0/3529013341 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8fe415d960 0x7f8fe415dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:09.891 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.901+0000 7f8fea400640 1 --2- 172.21.15.57:0/3529013341 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8fe413fac0 0x7f8fe415d420 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:09.891 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.901+0000 7f8fea400640 1 --2- 172.21.15.57:0/3529013341 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8fcc004390 0x7f8fe4137320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:09.891 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.901+0000 7f8fea400640 1 -- 172.21.15.57:0/3529013341 >> 172.21.15.57:0/3529013341 conn(0x7f8fe40cfb40 msgr2=0x7f8fe406d580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:09.891 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.901+0000 7f8fea400640 1 -- 172.21.15.57:0/3529013341 shutdown_connections 2024-03-27T10:00:09.891 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:09.901+0000 7f8fea400640 1 -- 172.21.15.57:0/3529013341 wait complete. 2024-03-27T10:00:09.910 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-27T10:00:10.129 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.139+0000 7fab66000640 1 Processor -- start 2024-03-27T10:00:10.129 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.139+0000 7fab66000640 1 -- start start 2024-03-27T10:00:10.132 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.141+0000 7fab66000640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fab6015f5c0 0x7fab6006d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:10.132 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.141+0000 7fab66000640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fab6006d6f0 0x7fab600cd330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:10.132 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.141+0000 7fab66000640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab6015eb00 con 0x7fab6006b7a0 2024-03-27T10:00:10.132 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.141+0000 7fab66000640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7fab6015fa10 con 0x7fab6015f5c0 2024-03-27T10:00:10.132 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.141+0000 7fab66000640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fab6006dc70 con 0x7fab6006d6f0 2024-03-27T10:00:10.132 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.141+0000 7fab56a00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fab6015f5c0 0x7fab6006d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:10.132 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.142+0000 7fab56a00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fab6015f5c0 0x7fab6006d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55314/0 (socket says 172.21.15.57:55314) 2024-03-27T10:00:10.132 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.142+0000 7fab56a00640 1 -- 172.21.15.57:0/2586914367 learned_addr learned my addr 172.21.15.57:0/2586914367 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:10.132 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.142+0000 7fab5fe00640 1 --2- 172.21.15.57:0/2586914367 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fab6006d6f0 0x7fab600cd330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:10.132 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.142+0000 7fab56a00640 1 -- 172.21.15.57:0/2586914367 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fab6006d6f0 msgr2=0x7fab600cd330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:10.132 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.142+0000 7fab56a00640 1 --2- 172.21.15.57:0/2586914367 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fab6006d6f0 0x7fab600cd330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:10.133 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.142+0000 7fab56a00640 1 -- 172.21.15.57:0/2586914367 >> v1:172.21.15.118:6789/0 conn(0x7fab6006b7a0 legacy=0x7fab6006bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:10.133 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.142+0000 7fab56a00640 1 -- 172.21.15.57:0/2586914367 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab6006df50 con 0x7fab6015f5c0 2024-03-27T10:00:10.133 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.143+0000 7fab56a00640 1 --2- 172.21.15.57:0/2586914367 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fab6015f5c0 0x7fab6006d1b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fab48009870 tx=0x7fab4802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d54441279315772a server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:10.133 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.143+0000 7fab5ea00640 1 -- 172.21.15.57:0/2586914367 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab48035020 con 0x7fab6015f5c0 2024-03-27T10:00:10.133 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.144+0000 7fab5ea00640 1 -- 172.21.15.57:0/2586914367 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab48031640 con 0x7fab6015f5c0 2024-03-27T10:00:10.134 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.144+0000 7fab5ea00640 1 -- 172.21.15.57:0/2586914367 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab4802d040 con 0x7fab6015f5c0 2024-03-27T10:00:10.135 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.144+0000 7fab66000640 1 -- 172.21.15.57:0/2586914367 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fab6015f5c0 msgr2=0x7fab6006d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:10.135 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.144+0000 7fab66000640 1 --2- 172.21.15.57:0/2586914367 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fab6015f5c0 0x7fab6006d1b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fab48009870 tx=0x7fab4802b8f0 comp rx=0 tx=0).stop 2024-03-27T10:00:10.135 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.144+0000 7fab66000640 1 -- 172.21.15.57:0/2586914367 shutdown_connections 2024-03-27T10:00:10.135 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.144+0000 7fab66000640 1 --2- 172.21.15.57:0/2586914367 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fab6006d6f0 0x7fab600cd330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:10.135 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.144+0000 7fab66000640 1 --2- 172.21.15.57:0/2586914367 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fab6015f5c0 0x7fab6006d1b0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:10.135 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.144+0000 7fab66000640 1 -- 172.21.15.57:0/2586914367 >> 172.21.15.57:0/2586914367 conn(0x7fab600b1c60 msgr2=0x7fab600b2070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:10.135 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.144+0000 7fab66000640 1 -- 172.21.15.57:0/2586914367 shutdown_connections 2024-03-27T10:00:10.135 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.144+0000 7fab66000640 1 -- 172.21.15.57:0/2586914367 wait complete. 2024-03-27T10:00:10.136 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.146+0000 7fab66000640 1 Processor -- start 2024-03-27T10:00:10.136 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.146+0000 7fab66000640 1 -- start start 2024-03-27T10:00:10.138 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.147+0000 7fab66000640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fab6006b7a0 0x7fab601f4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:10.138 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.147+0000 7fab66000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fab6006d6f0 0x7fab601f7620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:10.138 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.147+0000 7fab66000640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fab6015f5c0 0x7fab6015bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:10.138 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.147+0000 7fab66000640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fab600726b0 con 0x7fab6006b7a0 2024-03-27T10:00:10.138 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.147+0000 7fab66000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fab6015f0a0 con 0x7fab6006d6f0 2024-03-27T10:00:10.138 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.147+0000 7fab66000640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fab60144b10 con 0x7fab6015f5c0 2024-03-27T10:00:10.138 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.147+0000 7fab5f400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fab6006b7a0 0x7fab601f4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:10.138 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.148+0000 7fab5f400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fab6006b7a0 0x7fab601f4740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55324/0 (socket says 172.21.15.57:55324) 2024-03-27T10:00:10.139 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.148+0000 7fab5f400640 1 -- 172.21.15.57:0/406993092 learned_addr learned my addr 172.21.15.57:0/406993092 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:10.139 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.148+0000 7fab56a00640 1 --2- 172.21.15.57:0/406993092 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fab6006d6f0 0x7fab601f7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:10.139 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.148+0000 7fab5fe00640 1 --2- 172.21.15.57:0/406993092 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fab6015f5c0 0x7fab6015bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:10.139 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.148+0000 7fab5f400640 1 -- 172.21.15.57:0/406993092 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fab6015f5c0 msgr2=0x7fab6015bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:10.139 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.148+0000 7fab5f400640 1 --2- 172.21.15.57:0/406993092 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fab6015f5c0 0x7fab6015bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:10.139 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.148+0000 7fab5f400640 1 -- 172.21.15.57:0/406993092 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fab6006d6f0 msgr2=0x7fab601f7620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:10.139 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.148+0000 7fab5f400640 1 --2- 172.21.15.57:0/406993092 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fab6006d6f0 0x7fab601f7620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:10.139 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.148+0000 7fab5f400640 1 -- 172.21.15.57:0/406993092 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab6015c2d0 con 0x7fab6006b7a0 2024-03-27T10:00:10.139 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.148+0000 7fab56a00640 1 --2- 172.21.15.57:0/406993092 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fab6006d6f0 0x7fab601f7620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T10:00:10.139 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.148+0000 7fab5fe00640 1 --2- 172.21.15.57:0/406993092 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fab6015f5c0 0x7fab6015bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T10:00:10.139 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.148+0000 7fab5f400640 1 --2- 172.21.15.57:0/406993092 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fab6006b7a0 0x7fab601f4740 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fab5000c790 tx=0x7fab5000cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:10.140 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.149+0000 7fab57e00640 1 -- 172.21.15.57:0/406993092 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab50016020 con 0x7fab6006b7a0 2024-03-27T10:00:10.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.149+0000 7fab57e00640 1 -- 172.21.15.57:0/406993092 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab50006d50 con 0x7fab6006b7a0 2024-03-27T10:00:10.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.149+0000 7fab57e00640 1 -- 172.21.15.57:0/406993092 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab50003bb0 con 0x7fab6006b7a0 2024-03-27T10:00:10.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.149+0000 7fab66000640 1 -- 172.21.15.57:0/406993092 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab6015db50 con 0x7fab6006b7a0 2024-03-27T10:00:10.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.149+0000 7fab66000640 1 -- 172.21.15.57:0/406993092 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab601f4d20 con 0x7fab6006b7a0 2024-03-27T10:00:10.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.150+0000 7fab66000640 1 -- 172.21.15.57:0/406993092 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab60068620 con 0x7fab6006b7a0 2024-03-27T10:00:10.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.151+0000 7fab57e00640 1 -- 172.21.15.57:0/406993092 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fab5000a850 con 0x7fab6006b7a0 2024-03-27T10:00:10.142 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.152+0000 7fab57e00640 1 --2- 172.21.15.57:0/406993092 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fab3c06c560 0x7fab3c06ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:10.142 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.152+0000 7fab57e00640 1 -- 172.21.15.57:0/406993092 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6735+0+0 (secure 0 0 0) 0x7fab5008b810 con 0x7fab6006b7a0 2024-03-27T10:00:10.142 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.152+0000 7fab56a00640 1 --2- 172.21.15.57:0/406993092 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fab3c06c560 0x7fab3c06ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:10.142 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.153+0000 7fab56a00640 1 --2- 172.21.15.57:0/406993092 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fab3c06c560 0x7fab3c06ea20 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fab48036000 tx=0x7fab4803c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:10.146 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.157+0000 7fab57e00640 1 -- 172.21.15.57:0/406993092 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7fab50020020 con 0x7fab6006b7a0 2024-03-27T10:00:10.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.407+0000 7fab66000640 1 -- 172.21.15.57:0/406993092 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fab60072030 con 0x7fab6006b7a0 2024-03-27T10:00:10.398 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.408+0000 7fab57e00640 1 -- 172.21.15.57:0/406993092 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5183 (secure 0 0 0) 0x7fab6015c2d0 con 0x7fab6006b7a0 2024-03-27T10:00:10.398 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:00:10.398 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/1178943431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1178943431},{"type":"v1","addr":"172.21.15.118:6834","nonce":1178943431}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6836/1248533620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6835","nonce":1248533620},{"type":"v1","addr":"172.21.15.57:6836","nonce":1248533620}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6837/4133386889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":4133386889},{"type":"v1","addr":"172.21.15.57:6837","nonce":4133386889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-27T09:59:28.571425+0000","modified":"2024-03-27T09:59:55.863525+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6835/1823694233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":1823694233},{"type":"v1","addr":"172.21.15.118:6835","nonce":1823694233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4282,"qdb_cluster":[4282]},"id":1}]} 2024-03-27T10:00:10.399 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 9 2024-03-27T10:00:10.401 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.411+0000 7fab66000640 1 -- 172.21.15.57:0/406993092 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fab3c06c560 msgr2=0x7fab3c06ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:10.401 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.411+0000 7fab66000640 1 --2- 172.21.15.57:0/406993092 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fab3c06c560 0x7fab3c06ea20 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fab48036000 tx=0x7fab4803c040 comp rx=0 tx=0).stop 2024-03-27T10:00:10.401 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.411+0000 7fab66000640 1 -- 172.21.15.57:0/406993092 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fab6006b7a0 msgr2=0x7fab601f4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:10.401 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.411+0000 7fab66000640 1 --2- 172.21.15.57:0/406993092 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fab6006b7a0 0x7fab601f4740 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fab5000c790 tx=0x7fab5000cc50 comp rx=0 tx=0).stop 2024-03-27T10:00:10.401 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.411+0000 7fab66000640 1 -- 172.21.15.57:0/406993092 shutdown_connections 2024-03-27T10:00:10.401 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.411+0000 7fab66000640 1 --2- 172.21.15.57:0/406993092 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fab6015f5c0 0x7fab6015bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:10.401 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.411+0000 7fab66000640 1 --2- 172.21.15.57:0/406993092 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fab3c06c560 0x7fab3c06ea20 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:10.402 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.411+0000 7fab66000640 1 --2- 172.21.15.57:0/406993092 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fab6006d6f0 0x7fab601f7620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:10.402 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.411+0000 7fab66000640 1 --2- 172.21.15.57:0/406993092 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fab6006b7a0 0x7fab601f4740 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:10.402 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.411+0000 7fab66000640 1 -- 172.21.15.57:0/406993092 >> 172.21.15.57:0/406993092 conn(0x7fab600b1c60 msgr2=0x7fab601432e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:10.402 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.411+0000 7fab66000640 1 -- 172.21.15.57:0/406993092 shutdown_connections 2024-03-27T10:00:10.402 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.411+0000 7fab66000640 1 -- 172.21.15.57:0/406993092 wait complete. 2024-03-27T10:00:10.421 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-27T10:00:10.626 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.636+0000 7fbba2000640 1 Processor -- start 2024-03-27T10:00:10.627 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.637+0000 7fbba2000640 1 -- start start 2024-03-27T10:00:10.628 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.638+0000 7fbba2000640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbb9c145820 0x7fbb9c0cc950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:10.628 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.638+0000 7fbba2000640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb9c0cf750 0x7fbb9c06bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:10.628 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.638+0000 7fbba2000640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb9c0cce90 con 0x7fbb9c06b750 2024-03-27T10:00:10.628 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.638+0000 7fbba2000640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7fbb9c06c100 con 0x7fbb9c145820 2024-03-27T10:00:10.629 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.638+0000 7fbba2000640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fbb9c160b60 con 0x7fbb9c0cf750 2024-03-27T10:00:10.629 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.638+0000 7fbb9b400640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbb9c145820 0x7fbb9c0cc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:10.629 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.639+0000 7fbb9b400640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbb9c145820 0x7fbb9c0cc950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55326/0 (socket says 172.21.15.57:55326) 2024-03-27T10:00:10.629 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.639+0000 7fbb9b400640 1 -- 172.21.15.57:0/469808687 learned_addr learned my addr 172.21.15.57:0/469808687 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:10.629 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.639+0000 7fbb9be00640 1 --2- 172.21.15.57:0/469808687 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb9c0cf750 0x7fbb9c06bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:10.629 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.639+0000 7fbb9b400640 1 -- 172.21.15.57:0/469808687 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb9c0cf750 msgr2=0x7fbb9c06bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:10.629 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.639+0000 7fbb9b400640 1 --2- 172.21.15.57:0/469808687 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb9c0cf750 0x7fbb9c06bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:10.629 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.639+0000 7fbb9b400640 1 -- 172.21.15.57:0/469808687 >> v1:172.21.15.118:6789/0 conn(0x7fbb9c06b750 legacy=0x7fbb9c0b2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:10.630 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.639+0000 7fbb9b400640 1 -- 172.21.15.57:0/469808687 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb9c15fc70 con 0x7fbb9c145820 2024-03-27T10:00:10.630 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.640+0000 7fbb9b400640 1 --2- 172.21.15.57:0/469808687 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbb9c145820 0x7fbb9c0cc950 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c009870 tx=0x7fbb8c02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c904f159a2f1ef0e server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:10.630 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.641+0000 7fbb9aa00640 1 -- 172.21.15.57:0/469808687 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb8c034070 con 0x7fbb9c145820 2024-03-27T10:00:10.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.641+0000 7fbb9aa00640 1 -- 172.21.15.57:0/469808687 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb8c030840 con 0x7fbb9c145820 2024-03-27T10:00:10.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.641+0000 7fbb9aa00640 1 -- 172.21.15.57:0/469808687 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb8c030c10 con 0x7fbb9c145820 2024-03-27T10:00:10.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.641+0000 7fbba2000640 1 -- 172.21.15.57:0/469808687 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbb9c145820 msgr2=0x7fbb9c0cc950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:10.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.641+0000 7fbba2000640 1 --2- 172.21.15.57:0/469808687 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbb9c145820 0x7fbb9c0cc950 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c009870 tx=0x7fbb8c02b980 comp rx=0 tx=0).stop 2024-03-27T10:00:10.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.641+0000 7fbba2000640 1 -- 172.21.15.57:0/469808687 shutdown_connections 2024-03-27T10:00:10.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.641+0000 7fbba2000640 1 --2- 172.21.15.57:0/469808687 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb9c0cf750 0x7fbb9c06bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:10.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.641+0000 7fbba2000640 1 --2- 172.21.15.57:0/469808687 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbb9c145820 0x7fbb9c0cc950 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:10.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.641+0000 7fbba2000640 1 -- 172.21.15.57:0/469808687 >> 172.21.15.57:0/469808687 conn(0x7fbb9c0b1c60 msgr2=0x7fbb9c0b2070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:10.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.642+0000 7fbba2000640 1 -- 172.21.15.57:0/469808687 shutdown_connections 2024-03-27T10:00:10.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.642+0000 7fbba2000640 1 -- 172.21.15.57:0/469808687 wait complete. 2024-03-27T10:00:10.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.643+0000 7fbba2000640 1 Processor -- start 2024-03-27T10:00:10.633 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.643+0000 7fbba2000640 1 -- start start 2024-03-27T10:00:10.634 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.644+0000 7fbba2000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb9c06b750 0x7fbb9c13f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:10.634 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.644+0000 7fbba2000640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb9c0cf750 0x7fbb9c0b0a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:10.634 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.644+0000 7fbba2000640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbb9c145820 0x7fbb9c0b0f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:10.634 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.644+0000 7fbba2000640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fbb9c160510 con 0x7fbb9c145820 2024-03-27T10:00:10.634 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.644+0000 7fbba2000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fbb9c160230 con 0x7fbb9c06b750 2024-03-27T10:00:10.634 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.644+0000 7fbba2000640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fbb9c1607f0 con 0x7fbb9c0cf750 2024-03-27T10:00:10.634 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.644+0000 7fbb9be00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbb9c145820 0x7fbb9c0b0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:10.634 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.644+0000 7fbb9be00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbb9c145820 0x7fbb9c0b0f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55328/0 (socket says 172.21.15.57:55328) 2024-03-27T10:00:10.634 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.644+0000 7fbb9be00640 1 -- 172.21.15.57:0/3339455607 learned_addr learned my addr 172.21.15.57:0/3339455607 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:10.636 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.645+0000 7fbb93e00640 1 --2- 172.21.15.57:0/3339455607 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb9c0cf750 0x7fbb9c0b0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:10.636 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.645+0000 7fbb9b400640 1 --2- 172.21.15.57:0/3339455607 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb9c06b750 0x7fbb9c13f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:10.636 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.645+0000 7fbb9be00640 1 -- 172.21.15.57:0/3339455607 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb9c0cf750 msgr2=0x7fbb9c0b0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:10.636 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.645+0000 7fbb9be00640 1 --2- 172.21.15.57:0/3339455607 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb9c0cf750 0x7fbb9c0b0a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:10.636 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.645+0000 7fbb9be00640 1 -- 172.21.15.57:0/3339455607 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb9c06b750 msgr2=0x7fbb9c13f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:10.636 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.645+0000 7fbb9be00640 1 --2- 172.21.15.57:0/3339455607 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb9c06b750 0x7fbb9c13f630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:10.636 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.645+0000 7fbb9be00640 1 -- 172.21.15.57:0/3339455607 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb9c13fb70 con 0x7fbb9c145820 2024-03-27T10:00:10.636 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.645+0000 7fbb93e00640 1 --2- 172.21.15.57:0/3339455607 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb9c0cf750 0x7fbb9c0b0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T10:00:10.636 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.645+0000 7fbb9be00640 1 --2- 172.21.15.57:0/3339455607 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbb9c145820 0x7fbb9c0b0f80 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fbb94007e70 tx=0x7fbb9400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:10.636 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.645+0000 7fbb93400640 1 -- 172.21.15.57:0/3339455607 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb94014620 con 0x7fbb9c145820 2024-03-27T10:00:10.636 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.645+0000 7fbb93400640 1 -- 172.21.15.57:0/3339455607 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb94019070 con 0x7fbb9c145820 2024-03-27T10:00:10.637 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.645+0000 7fbba2000640 1 -- 172.21.15.57:0/3339455607 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb9c140280 con 0x7fbb9c145820 2024-03-27T10:00:10.637 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.645+0000 7fbb93400640 1 -- 172.21.15.57:0/3339455607 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb94014a20 con 0x7fbb9c145820 2024-03-27T10:00:10.637 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.645+0000 7fbba2000640 1 -- 172.21.15.57:0/3339455607 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb9c140840 con 0x7fbb9c145820 2024-03-27T10:00:10.637 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.647+0000 7fbba2000640 1 -- 172.21.15.57:0/3339455607 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb9c068620 con 0x7fbb9c145820 2024-03-27T10:00:10.637 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.647+0000 7fbb93400640 1 -- 172.21.15.57:0/3339455607 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fbb94014bc0 con 0x7fbb9c145820 2024-03-27T10:00:10.638 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.648+0000 7fbb93400640 1 --2- 172.21.15.57:0/3339455607 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fbb7806c530 0x7fbb7806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:10.638 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.648+0000 7fbb93400640 1 -- 172.21.15.57:0/3339455607 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fbb9408c3e0 con 0x7fbb9c145820 2024-03-27T10:00:10.638 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.649+0000 7fbb9b400640 1 --2- 172.21.15.57:0/3339455607 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fbb7806c530 0x7fbb7806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:10.639 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.649+0000 7fbb9b400640 1 --2- 172.21.15.57:0/3339455607 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fbb7806c530 0x7fbb7806e9f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c036000 tx=0x7fbb8c03b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:10.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.653+0000 7fbb93400640 1 -- 172.21.15.57:0/3339455607 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7fbb9405a600 con 0x7fbb9c145820 2024-03-27T10:00:10.844 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.854+0000 7fbba2000640 1 -- 172.21.15.57:0/3339455607 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbb9c0b4a70 con 0x7fbb9c145820 2024-03-27T10:00:10.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.856+0000 7fbb93400640 1 -- 172.21.15.57:0/3339455607 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) ==== 74+0+18888 (secure 0 0 0) 0x7fbb94059f00 con 0x7fbb9c145820 2024-03-27T10:00:10.846 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:00:10.847 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":28,"fsid":"7ac43f86-2c16-4a97-98fb-715d3cebc75c","created":"2024-03-27T09:59:04.033417+0000","modified":"2024-03-27T10:00:10.462391+0000","last_up_change":"2024-03-27T09:59:16.969624+0000","last_in_change":"2024-03-27T09:59:07.421690+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-27T09:59:17.253008+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-27T09:59:26.690365+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-27T09:59:27.559059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-27T09:59:31.187596+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"47b44362-7302-4f2a-b735-582c6c3850cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6801","nonce":2020036298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6803","nonce":2020036298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6807","nonce":2020036298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6805","nonce":2020036298}]},"public_addr":"172.21.15.57:6801/2020036298","cluster_addr":"172.21.15.57:6803/2020036298","heartbeat_back_addr":"172.21.15.57:6807/2020036298","heartbeat_front_addr":"172.21.15.57:6805/2020036298","state":["exists","up"]},{"osd":1,"uuid":"feaf96f0-9431-4188-9a09-da505b40e934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6809","nonce":3190929242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6811","nonce":3190929242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6815","nonce":3190929242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6813","nonce":3190929242}]},"public_addr":"172.21.15.57:6809/3190929242","cluster_addr":"172.21.15.57:6811/3190929242","heartbeat_back_addr":"172.21.15.57:6815/3190929242","heartbeat_front_addr":"172.21.15.57:6813/3190929242","state":["exists","up"]},{"osd":2,"uuid":"21e406e6-cfbc-4fe7-a816-e2420487c95d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6817","nonce":4065849973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6819","nonce":4065849973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6823","nonce":4065849973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6821","nonce":4065849973}]},"public_addr":"172.21.15.57:6817/4065849973","cluster_addr":"172.21.15.57:6819/4065849973","heartbeat_back_addr":"172.21.15.57:6823/4065849973","heartbeat_front_addr":"172.21.15.57:6821/4065849973","state":["exists","up"]},{"osd":3,"uuid":"a389af1d-76c4-4dfc-b215-f983f4931257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6825","nonce":158084809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6827","nonce":158084809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6831","nonce":158084809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6829","nonce":158084809}]},"public_addr":"172.21.15.57:6825/158084809","cluster_addr":"172.21.15.57:6827/158084809","heartbeat_back_addr":"172.21.15.57:6831/158084809","heartbeat_front_addr":"172.21.15.57:6829/158084809","state":["exists","up"]},{"osd":4,"uuid":"e9b05dca-557a-43ee-b43f-9ce5b7d28304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6823","nonce":108719401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6827","nonce":108719401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6831","nonce":108719401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6829","nonce":108719401}]},"public_addr":"172.21.15.118:6823/108719401","cluster_addr":"172.21.15.118:6827/108719401","heartbeat_back_addr":"172.21.15.118:6831/108719401","heartbeat_front_addr":"172.21.15.118:6829/108719401","state":["exists","up"]},{"osd":5,"uuid":"d968177d-44ff-499a-b00a-b147ed879253","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6817","nonce":2704605866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6819","nonce":2704605866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6826","nonce":2704605866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6822","nonce":2704605866}]},"public_addr":"172.21.15.118:6817/2704605866","cluster_addr":"172.21.15.118:6819/2704605866","heartbeat_back_addr":"172.21.15.118:6826/2704605866","heartbeat_front_addr":"172.21.15.118:6822/2704605866","state":["exists","up"]},{"osd":6,"uuid":"e8f98052-e6ad-4cfe-a4a9-0b17a434d54e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6801","nonce":1963659095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6803","nonce":1963659095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6807","nonce":1963659095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6805","nonce":1963659095}]},"public_addr":"172.21.15.118:6801/1963659095","cluster_addr":"172.21.15.118:6803/1963659095","heartbeat_back_addr":"172.21.15.118:6807/1963659095","heartbeat_front_addr":"172.21.15.118:6805/1963659095","state":["exists","up"]},{"osd":7,"uuid":"eccff987-8e51-4a63-845a-cf0a3196d7fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6809","nonce":1955879596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6811","nonce":1955879596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6815","nonce":1955879596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6813","nonce":1955879596}]},"public_addr":"172.21.15.118:6809/1955879596","cluster_addr":"172.21.15.118:6811/1955879596","heartbeat_back_addr":"172.21.15.118:6815/1955879596","heartbeat_front_addr":"172.21.15.118:6813/1955879596","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.721258+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.696610+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.777895+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.806769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.743259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.845687+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:13.020165+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.722294+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.e","mappings":[{"from":7,"to":1}]},{"pgid":"3.15","mappings":[{"from":3,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-27T10:00:10.848 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.859+0000 7fbba2000640 1 -- 172.21.15.57:0/3339455607 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fbb7806c530 msgr2=0x7fbb7806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:10.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.859+0000 7fbba2000640 1 --2- 172.21.15.57:0/3339455607 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fbb7806c530 0x7fbb7806e9f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c036000 tx=0x7fbb8c03b040 comp rx=0 tx=0).stop 2024-03-27T10:00:10.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.859+0000 7fbba2000640 1 -- 172.21.15.57:0/3339455607 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbb9c145820 msgr2=0x7fbb9c0b0f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:10.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.859+0000 7fbba2000640 1 --2- 172.21.15.57:0/3339455607 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbb9c145820 0x7fbb9c0b0f80 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fbb94007e70 tx=0x7fbb9400e4b0 comp rx=0 tx=0).stop 2024-03-27T10:00:10.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.859+0000 7fbba2000640 1 -- 172.21.15.57:0/3339455607 shutdown_connections 2024-03-27T10:00:10.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.859+0000 7fbba2000640 1 --2- 172.21.15.57:0/3339455607 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbb9c145820 0x7fbb9c0b0f80 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:10.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.859+0000 7fbba2000640 1 --2- 172.21.15.57:0/3339455607 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbb9c0cf750 0x7fbb9c0b0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:10.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.859+0000 7fbba2000640 1 --2- 172.21.15.57:0/3339455607 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fbb7806c530 0x7fbb7806e9f0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:10.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.859+0000 7fbba2000640 1 --2- 172.21.15.57:0/3339455607 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbb9c06b750 0x7fbb9c13f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:10.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.859+0000 7fbba2000640 1 -- 172.21.15.57:0/3339455607 >> 172.21.15.57:0/3339455607 conn(0x7fbb9c0b1c60 msgr2=0x7fbb9c143fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:10.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.859+0000 7fbba2000640 1 -- 172.21.15.57:0/3339455607 shutdown_connections 2024-03-27T10:00:10.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:10.859+0000 7fbba2000640 1 -- 172.21.15.57:0/3339455607 wait complete. 2024-03-27T10:00:10.869 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-27T10:00:11.084 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:11.094+0000 7fa31fe00640 1 Processor -- start 2024-03-27T10:00:11.084 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:11.094+0000 7fa31fe00640 1 -- start start 2024-03-27T10:00:11.086 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:11.096+0000 7fa31fe00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fa320071b90 0x7fa320072020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:11.086 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:11.096+0000 7fa31fe00640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa32006e210 con 0x7fa32006e970 2024-03-27T10:00:11.086 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:11.096+0000 7fa31fe00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa32006e4f0 con 0x7fa320158530 2024-03-27T10:00:11.086 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:11.096+0000 7fa31fe00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7fa3200710b0 con 0x7fa320071b90 2024-03-27T10:00:11.086 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:11.096+0000 7fa31f400640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fa32006e970 0x7fa32006d440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:56846/0 (socket says 172.21.15.57:56846) 2024-03-27T10:00:11.086 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:11.096+0000 7fa31f400640 1 -- 172.21.15.57:0/1962718549 learned_addr learned my addr 172.21.15.57:0/1962718549 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T10:00:11.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:11.097+0000 7fa316000640 1 --2- 172.21.15.57:0/1962718549 >> v2:172.21.15.118:3300/0 conn(0x7fa320071b90 0x7fa320072020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:11.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:11.097+0000 7fa31e000640 1 -- 172.21.15.57:0/1962718549 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3102567165 0 0) 0x7fa32006e210 con 0x7fa32006e970 2024-03-27T10:00:11.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:11.097+0000 7fa31e000640 1 -- 172.21.15.57:0/1962718549 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa304003520 con 0x7fa32006e970 2024-03-27T10:00:11.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:11.097+0000 7fa31e000640 1 -- 172.21.15.57:0/1962718549 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1442041085 0 0) 0x7fa304003520 con 0x7fa32006e970 2024-03-27T10:00:11.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:11.097+0000 7fa31e000640 1 -- 172.21.15.57:0/1962718549 >> v2:172.21.15.118:3300/0 conn(0x7fa320071b90 msgr2=0x7fa320072020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:11.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:11.097+0000 7fa31e000640 1 --2- 172.21.15.57:0/1962718549 >> v2:172.21.15.118:3300/0 conn(0x7fa320071b90 0x7fa320072020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:11.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:11.097+0000 7fa31e000640 1 -- 172.21.15.57:0/1962718549 >> v1:172.21.15.118:6789/0 conn(0x7fa320158530 legacy=0x7fa3200ad8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:11.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:11.097+0000 7fa31e000640 1 -- 172.21.15.57:0/1962718549 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa320071390 con 0x7fa32006e970 2024-03-27T10:00:11.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:11.097+0000 7fa31e000640 1 -- 172.21.15.57:0/1962718549 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4227751516 0 0) 0x7fa318001670 con 0x7fa32006e970 2024-03-27T10:00:11.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:11.097+0000 7fa31e000640 1 -- 172.21.15.57:0/1962718549 >> v1:172.21.15.57:6789/0 conn(0x7fa32006e970 legacy=0x7fa32006d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:11.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:11.098+0000 7fa31e000640 1 --2- 172.21.15.57:0/1962718549 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3040039b0 0x7fa304003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:11.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:11.098+0000 7fa31e000640 1 --2- 172.21.15.57:0/1962718549 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa304004800 0x7fa304004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:11.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:11.098+0000 7fa31e000640 1 --2- 172.21.15.57:0/1962718549 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa3040051c0 0x7fa30400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:11.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:11.098+0000 7fa31e000640 1 -- 172.21.15.57:0/1962718549 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fa3200710b0 con 0x7fa3040051c0 2024-03-27T10:00:11.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:11.098+0000 7fa31e000640 1 -- 172.21.15.57:0/1962718549 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fa30400c060 con 0x7fa3040039b0 2024-03-27T10:00:11.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:11.098+0000 7fa31e000640 1 -- 172.21.15.57:0/1962718549 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fa30400c260 con 0x7fa304004800 2024-03-27T10:00:11.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:11.098+0000 7fa31f400640 1 --2- 172.21.15.57:0/1962718549 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa3040051c0 0x7fa30400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:11.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:11.098+0000 7fa31f400640 1 -- 172.21.15.57:0/1962718549 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa304004800 msgr2=0x7fa304004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:11.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:11.098+0000 7fa31ea00640 1 --2- 172.21.15.57:0/1962718549 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3040039b0 0x7fa304003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:11.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:11.098+0000 7fa316000640 1 --2- 172.21.15.57:0/1962718549 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa304004800 0x7fa304004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:11.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:11.098+0000 7fa31f400640 1 --2- 172.21.15.57:0/1962718549 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa304004800 0x7fa304004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:11.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:11.098+0000 7fa31f400640 1 -- 172.21.15.57:0/1962718549 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3040039b0 msgr2=0x7fa304003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:11.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:11.098+0000 7fa31f400640 1 --2- 172.21.15.57:0/1962718549 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3040039b0 0x7fa304003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:11.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:11.098+0000 7fa31f400640 1 -- 172.21.15.57:0/1962718549 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa304003520 con 0x7fa3040051c0 2024-03-27T10:00:11.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:11.098+0000 7fa31ea00640 1 --2- 172.21.15.57:0/1962718549 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3040039b0 0x7fa304003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T10:00:11.091 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:11.099+0000 7fa31f400640 1 -- 172.21.15.57:0/1962718549 reap_dead start 2024-03-27T10:00:11.091 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:11.099+0000 7fa31f400640 1 --2- 172.21.15.57:0/1962718549 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa3040051c0 0x7fa30400b9c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fa31800c210 tx=0x7fa304005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db5a9fd848016f93 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:11.091 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:11.100+0000 7fa31e000640 1 -- 172.21.15.57:0/1962718549 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa318007d30 con 0x7fa3040051c0 2024-03-27T10:00:11.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:11.100+0000 7fa31e000640 1 -- 172.21.15.57:0/1962718549 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa318030070 con 0x7fa3040051c0 2024-03-27T10:00:11.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:11.100+0000 7fa31e000640 1 -- 172.21.15.57:0/1962718549 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa31802cd60 con 0x7fa3040051c0 2024-03-27T10:00:11.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:11.100+0000 7fa31fe00640 1 -- 172.21.15.57:0/1962718549 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa3040051c0 msgr2=0x7fa30400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:11.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:11.100+0000 7fa31fe00640 1 --2- 172.21.15.57:0/1962718549 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa3040051c0 0x7fa30400b9c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fa31800c210 tx=0x7fa304005830 comp rx=0 tx=0).stop 2024-03-27T10:00:11.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:11.101+0000 7fa31fe00640 1 -- 172.21.15.57:0/1962718549 shutdown_connections 2024-03-27T10:00:11.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:11.101+0000 7fa31fe00640 1 --2- 172.21.15.57:0/1962718549 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa3040051c0 0x7fa30400b9c0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:11.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:11.101+0000 7fa31fe00640 1 -- 172.21.15.57:0/1962718549 >> 172.21.15.57:0/1962718549 conn(0x7fa3200b1770 msgr2=0x7fa3200b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:11.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:11.101+0000 7fa31fe00640 1 -- 172.21.15.57:0/1962718549 shutdown_connections 2024-03-27T10:00:11.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:11.101+0000 7fa31fe00640 1 -- 172.21.15.57:0/1962718549 wait complete. 2024-03-27T10:00:11.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:11.103+0000 7fa31fe00640 1 Processor -- start 2024-03-27T10:00:11.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:11.103+0000 7fa31fe00640 1 -- start start 2024-03-27T10:00:11.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:11.104+0000 7fa31fe00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa3040051c0 0x7fa320145f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:11.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:11.105+0000 7fa31fe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa320149c70 0x7fa320142be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:11.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:11.105+0000 7fa31fe00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa320157620 0x7fa3201453b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:11.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:11.105+0000 7fa31fe00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fa320158a90 con 0x7fa320157620 2024-03-27T10:00:11.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:11.105+0000 7fa31fe00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fa320158910 con 0x7fa320149c70 2024-03-27T10:00:11.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:11.105+0000 7fa31fe00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fa320072020 con 0x7fa3040051c0 2024-03-27T10:00:11.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:11.105+0000 7fa31f400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa320157620 0x7fa3201453b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:11.096 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:11.105+0000 7fa31f400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa320157620 0x7fa3201453b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55354/0 (socket says 172.21.15.57:55354) 2024-03-27T10:00:11.096 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:11.105+0000 7fa31f400640 1 -- 172.21.15.57:0/2756627197 learned_addr learned my addr 172.21.15.57:0/2756627197 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:11.096 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:11.105+0000 7fa316000640 1 --2- 172.21.15.57:0/2756627197 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa320149c70 0x7fa320142be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:11.096 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:11.105+0000 7fa31ea00640 1 --2- 172.21.15.57:0/2756627197 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa3040051c0 0x7fa320145f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:11.096 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:11.105+0000 7fa31f400640 1 -- 172.21.15.57:0/2756627197 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa3040051c0 msgr2=0x7fa320145f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:11.096 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:11.105+0000 7fa31f400640 1 --2- 172.21.15.57:0/2756627197 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa3040051c0 0x7fa320145f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:11.096 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:11.105+0000 7fa31f400640 1 -- 172.21.15.57:0/2756627197 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa320149c70 msgr2=0x7fa320142be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:11.096 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:11.105+0000 7fa31f400640 1 --2- 172.21.15.57:0/2756627197 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa320149c70 0x7fa320142be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:11.096 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:11.105+0000 7fa31f400640 1 -- 172.21.15.57:0/2756627197 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa320143570 con 0x7fa320157620 2024-03-27T10:00:11.096 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:11.106+0000 7fa31f400640 1 --2- 172.21.15.57:0/2756627197 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa320157620 0x7fa3201453b0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa31802c570 tx=0x7fa318001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:11.097 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:11.106+0000 7fa317400640 1 -- 172.21.15.57:0/2756627197 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa318004bf0 con 0x7fa320157620 2024-03-27T10:00:11.097 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:11.106+0000 7fa317400640 1 -- 172.21.15.57:0/2756627197 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa318004d90 con 0x7fa320157620 2024-03-27T10:00:11.097 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:11.106+0000 7fa31fe00640 1 -- 172.21.15.57:0/2756627197 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa320143850 con 0x7fa320157620 2024-03-27T10:00:11.097 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:11.106+0000 7fa317400640 1 -- 172.21.15.57:0/2756627197 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa318007290 con 0x7fa320157620 2024-03-27T10:00:11.097 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:11.106+0000 7fa31fe00640 1 -- 172.21.15.57:0/2756627197 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa320143e10 con 0x7fa320157620 2024-03-27T10:00:11.097 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:11.107+0000 7fa31fe00640 1 -- 172.21.15.57:0/2756627197 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa320144010 con 0x7fa320157620 2024-03-27T10:00:11.098 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:11.109+0000 7fa317400640 1 -- 172.21.15.57:0/2756627197 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fa318007430 con 0x7fa320157620 2024-03-27T10:00:11.099 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:11.110+0000 7fa317400640 1 --2- 172.21.15.57:0/2756627197 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fa2fc06c560 0x7fa2fc06ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:11.100 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:11.110+0000 7fa317400640 1 -- 172.21.15.57:0/2756627197 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fa3180aca20 con 0x7fa320157620 2024-03-27T10:00:11.100 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:11.110+0000 7fa31ea00640 1 --2- 172.21.15.57:0/2756627197 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fa2fc06c560 0x7fa2fc06ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:11.100 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:11.111+0000 7fa31ea00640 1 --2- 172.21.15.57:0/2756627197 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fa2fc06c560 0x7fa2fc06ea20 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa310007fd0 tx=0x7fa310009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:11.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:11.114+0000 7fa317400640 1 -- 172.21.15.57:0/2756627197 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7fa320144010 con 0x7fa320157620 2024-03-27T10:00:11.350 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:11.360+0000 7fa31fe00640 1 -- 172.21.15.57:0/2756627197 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa320068540 con 0x7fa320157620 2024-03-27T10:00:11.351 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:11.362+0000 7fa317400640 1 -- 172.21.15.57:0/2756627197 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5183 (secure 0 0 0) 0x7fa31807a5e0 con 0x7fa320157620 2024-03-27T10:00:11.352 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:00:11.352 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/1178943431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1178943431},{"type":"v1","addr":"172.21.15.118:6834","nonce":1178943431}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6836/1248533620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6835","nonce":1248533620},{"type":"v1","addr":"172.21.15.57:6836","nonce":1248533620}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6837/4133386889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":4133386889},{"type":"v1","addr":"172.21.15.57:6837","nonce":4133386889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-27T09:59:28.571425+0000","modified":"2024-03-27T09:59:55.863525+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6835/1823694233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":1823694233},{"type":"v1","addr":"172.21.15.118:6835","nonce":1823694233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4282,"qdb_cluster":[4282]},"id":1}]} 2024-03-27T10:00:11.352 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 9 2024-03-27T10:00:11.354 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:11.364+0000 7fa31fe00640 1 -- 172.21.15.57:0/2756627197 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fa2fc06c560 msgr2=0x7fa2fc06ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:11.354 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:11.364+0000 7fa31fe00640 1 --2- 172.21.15.57:0/2756627197 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fa2fc06c560 0x7fa2fc06ea20 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa310007fd0 tx=0x7fa310009040 comp rx=0 tx=0).stop 2024-03-27T10:00:11.354 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:11.364+0000 7fa31fe00640 1 -- 172.21.15.57:0/2756627197 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa320157620 msgr2=0x7fa3201453b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:11.354 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:11.364+0000 7fa31fe00640 1 --2- 172.21.15.57:0/2756627197 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa320157620 0x7fa3201453b0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa31802c570 tx=0x7fa318001a40 comp rx=0 tx=0).stop 2024-03-27T10:00:11.355 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:11.364+0000 7fa31fe00640 1 -- 172.21.15.57:0/2756627197 shutdown_connections 2024-03-27T10:00:11.355 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:11.364+0000 7fa31fe00640 1 --2- 172.21.15.57:0/2756627197 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa320157620 0x7fa3201453b0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:11.355 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:11.364+0000 7fa31fe00640 1 --2- 172.21.15.57:0/2756627197 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fa2fc06c560 0x7fa2fc06ea20 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:11.355 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:11.364+0000 7fa31fe00640 1 --2- 172.21.15.57:0/2756627197 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa320149c70 0x7fa320142be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:11.355 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:11.364+0000 7fa31fe00640 1 --2- 172.21.15.57:0/2756627197 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa3040051c0 0x7fa320145f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:11.355 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:11.364+0000 7fa31fe00640 1 -- 172.21.15.57:0/2756627197 >> 172.21.15.57:0/2756627197 conn(0x7fa3200b1770 msgr2=0x7fa3200aed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:11.355 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:11.365+0000 7fa31fe00640 1 -- 172.21.15.57:0/2756627197 shutdown_connections 2024-03-27T10:00:11.355 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:11.365+0000 7fa31fe00640 1 -- 172.21.15.57:0/2756627197 wait complete. 2024-03-27T10:00:11.775 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-27T09:59:28.571425+0000', 'modified': '2024-03-27T09:59:55.863525+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4282}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4282': {'gid': 4282, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.118:6835/1823694233', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.118:6833', 'nonce': 1823694233}, {'type': 'v1', 'addr': '172.21.15.118:6835', 'nonce': 1823694233}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4282, 'qdb_cluster': [4282]} 2024-03-27T10:00:11.775 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-03-27T10:00:11.776 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-03-27T10:00:12.008 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.018+0000 7f2836400640 1 Processor -- start 2024-03-27T10:00:12.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.019+0000 7f2836400640 1 -- start start 2024-03-27T10:00:12.010 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.020+0000 7f2836400640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f283006b7a0 0x7f283015f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:12.010 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.020+0000 7f2836400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f28300cd330 0x7f28300cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:12.010 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.020+0000 7f2836400640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f283015eb00 con 0x7f283006bb80 2024-03-27T10:00:12.010 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.020+0000 7f2836400640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f283006dc70 con 0x7f283006b7a0 2024-03-27T10:00:12.010 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.020+0000 7f2836400640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f283006df50 con 0x7f28300cd330 2024-03-27T10:00:12.011 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.021+0000 7f282ea00640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f283006bb80 0x7f283006d1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:60756/0 (socket says 172.21.15.57:60756) 2024-03-27T10:00:12.011 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.021+0000 7f282ea00640 1 -- 172.21.15.57:0/3567167458 learned_addr learned my addr 172.21.15.57:0/3567167458 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T10:00:12.011 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.021+0000 7f282f400640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f283006b7a0 0x7f283015f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:12.011 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.021+0000 7f282fe00640 1 --2- 172.21.15.57:0/3567167458 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f28300cd330 0x7f28300cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:12.011 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.021+0000 7f282f400640 1 -- 172.21.15.57:0/3567167458 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f28300cd330 msgr2=0x7f28300cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:12.012 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.021+0000 7f282f400640 1 --2- 172.21.15.57:0/3567167458 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f28300cd330 0x7f28300cd7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:12.012 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.021+0000 7f282e000640 1 -- 172.21.15.57:0/3567167458 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3723093194 0 0) 0x7f283015eb00 con 0x7f283006bb80 2024-03-27T10:00:12.012 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.021+0000 7f282f400640 1 -- 172.21.15.57:0/3567167458 >> v1:172.21.15.57:6789/0 conn(0x7f283006bb80 legacy=0x7f283006d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:12.012 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.021+0000 7f282f400640 1 -- 172.21.15.57:0/3567167458 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f283015edc0 con 0x7f283006b7a0 2024-03-27T10:00:12.013 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.023+0000 7f282f400640 1 --2- 172.21.15.57:0/3567167458 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f283006b7a0 0x7f283015f5c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f28200097a0 tx=0x7f282002b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b85a225469a1f437 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:12.013 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.023+0000 7f282e000640 1 -- 172.21.15.57:0/3567167458 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2820031780 con 0x7f283006b7a0 2024-03-27T10:00:12.013 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.023+0000 7f282e000640 1 -- 172.21.15.57:0/3567167458 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2820037070 con 0x7f283006b7a0 2024-03-27T10:00:12.013 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.023+0000 7f282e000640 1 -- 172.21.15.57:0/3567167458 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2820031b40 con 0x7f283006b7a0 2024-03-27T10:00:12.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.023+0000 7f2836400640 1 -- 172.21.15.57:0/3567167458 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f283006b7a0 msgr2=0x7f283015f5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:12.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.023+0000 7f2836400640 1 --2- 172.21.15.57:0/3567167458 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f283006b7a0 0x7f283015f5c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f28200097a0 tx=0x7f282002b820 comp rx=0 tx=0).stop 2024-03-27T10:00:12.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.024+0000 7f2836400640 1 -- 172.21.15.57:0/3567167458 shutdown_connections 2024-03-27T10:00:12.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.024+0000 7f2836400640 1 --2- 172.21.15.57:0/3567167458 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f28300cd330 0x7f28300cd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:12.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.024+0000 7f2836400640 1 --2- 172.21.15.57:0/3567167458 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f283006b7a0 0x7f283015f5c0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:12.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.024+0000 7f2836400640 1 -- 172.21.15.57:0/3567167458 >> 172.21.15.57:0/3567167458 conn(0x7f28300b1c60 msgr2=0x7f28300b2070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:12.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.024+0000 7f2836400640 1 -- 172.21.15.57:0/3567167458 shutdown_connections 2024-03-27T10:00:12.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.024+0000 7f2836400640 1 -- 172.21.15.57:0/3567167458 wait complete. 2024-03-27T10:00:12.015 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.025+0000 7f2836400640 1 Processor -- start 2024-03-27T10:00:12.015 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.026+0000 7f2836400640 1 -- start start 2024-03-27T10:00:12.017 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.026+0000 7f2836400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f283006b7a0 0x7f28301f4620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:12.017 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.026+0000 7f2836400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f283006bb80 0x7f28300ce7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:12.017 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.027+0000 7f2836400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f28300cd330 0x7f283013dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:12.017 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.027+0000 7f2836400640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f283006bfd0 con 0x7f283006bb80 2024-03-27T10:00:12.017 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.027+0000 7f2836400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f28300726b0 con 0x7f28300cd330 2024-03-27T10:00:12.017 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.027+0000 7f2836400640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f283006c150 con 0x7f283006b7a0 2024-03-27T10:00:12.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.027+0000 7f282ea00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f283006bb80 0x7f28300ce7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:12.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.027+0000 7f282ea00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f283006bb80 0x7f28300ce7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38758/0 (socket says 172.21.15.57:38758) 2024-03-27T10:00:12.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.027+0000 7f282ea00640 1 -- 172.21.15.57:0/4015095286 learned_addr learned my addr 172.21.15.57:0/4015095286 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:12.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.027+0000 7f282f400640 1 --2- 172.21.15.57:0/4015095286 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f283006b7a0 0x7f28301f4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:12.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.027+0000 7f282fe00640 1 --2- 172.21.15.57:0/4015095286 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f28300cd330 0x7f283013dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:12.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.027+0000 7f282ea00640 1 -- 172.21.15.57:0/4015095286 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f283006b7a0 msgr2=0x7f28301f4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:12.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.027+0000 7f282ea00640 1 --2- 172.21.15.57:0/4015095286 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f283006b7a0 0x7f28301f4620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:12.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.027+0000 7f282ea00640 1 -- 172.21.15.57:0/4015095286 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f28300cd330 msgr2=0x7f283013dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:12.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.027+0000 7f282ea00640 1 --2- 172.21.15.57:0/4015095286 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f28300cd330 0x7f283013dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:12.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.027+0000 7f282ea00640 1 -- 172.21.15.57:0/4015095286 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f283013c8b0 con 0x7f283006bb80 2024-03-27T10:00:12.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.027+0000 7f282fe00640 1 --2- 172.21.15.57:0/4015095286 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f28300cd330 0x7f283013dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T10:00:12.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.028+0000 7f282ea00640 1 --2- 172.21.15.57:0/4015095286 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f283006bb80 0x7f28300ce7c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f281800c890 tx=0x7f281800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:12.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.028+0000 7f2827400640 1 -- 172.21.15.57:0/4015095286 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2818018070 con 0x7f283006bb80 2024-03-27T10:00:12.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.028+0000 7f2827400640 1 -- 172.21.15.57:0/4015095286 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f281800a640 con 0x7f283006bb80 2024-03-27T10:00:12.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.028+0000 7f2836400640 1 -- 172.21.15.57:0/4015095286 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f283013cb90 con 0x7f283006bb80 2024-03-27T10:00:12.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.028+0000 7f2827400640 1 -- 172.21.15.57:0/4015095286 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f281800aa30 con 0x7f283006bb80 2024-03-27T10:00:12.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.028+0000 7f2836400640 1 -- 172.21.15.57:0/4015095286 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f283013d150 con 0x7f283006bb80 2024-03-27T10:00:12.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.031+0000 7f2827400640 1 -- 172.21.15.57:0/4015095286 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f281801b070 con 0x7f283006bb80 2024-03-27T10:00:12.021 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.031+0000 7f2827400640 1 --2- 172.21.15.57:0/4015095286 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f280c06c560 0x7f280c06ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:12.022 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.032+0000 7f2827400640 1 -- 172.21.15.57:0/4015095286 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f281808b1d0 con 0x7f283006bb80 2024-03-27T10:00:12.022 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.032+0000 7f282f400640 1 --2- 172.21.15.57:0/4015095286 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f280c06c560 0x7f280c06ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:12.022 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.032+0000 7f2839194740 1 Processor -- start 2024-03-27T10:00:12.022 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.032+0000 7f2839194740 1 -- start start 2024-03-27T10:00:12.022 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.033+0000 7f282f400640 1 --2- 172.21.15.57:0/4015095286 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f280c06c560 0x7f280c06ea20 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2820036000 tx=0x7f282003d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:12.024 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.033+0000 7f2839194740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562b28b32fd0 0x562b28b05f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:12.024 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.033+0000 7f2839194740 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x562b28b333b0 0x562b28b35d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:12.024 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.033+0000 7f2839194740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562b28b064b0 0x562b28b362a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:12.024 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.033+0000 7f2839194740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x562b28acd920 con 0x562b28b32fd0 2024-03-27T10:00:12.024 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.033+0000 7f2839194740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x562b28a1dfa0 con 0x562b28b064b0 2024-03-27T10:00:12.025 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.033+0000 7f2839194740 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x562b28a6ff90 con 0x562b28b333b0 2024-03-27T10:00:12.025 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.033+0000 7f282f400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562b28b32fd0 0x562b28b05f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:12.025 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.034+0000 7f282f400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562b28b32fd0 0x562b28b05f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38772/0 (socket says 172.21.15.57:38772) 2024-03-27T10:00:12.025 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.034+0000 7f282f400640 1 -- 172.21.15.57:0/2606758435 learned_addr learned my addr 172.21.15.57:0/2606758435 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:12.025 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.034+0000 7f282ea00640 1 --2- 172.21.15.57:0/2606758435 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x562b28b333b0 0x562b28b35d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:12.025 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.034+0000 7f282fe00640 1 --2- 172.21.15.57:0/2606758435 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562b28b064b0 0x562b28b362a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:12.025 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.034+0000 7f282f400640 1 -- 172.21.15.57:0/2606758435 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x562b28b333b0 msgr2=0x562b28b35d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:12.025 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.034+0000 7f282f400640 1 --2- 172.21.15.57:0/2606758435 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x562b28b333b0 0x562b28b35d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:12.025 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.034+0000 7f282f400640 1 -- 172.21.15.57:0/2606758435 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562b28b064b0 msgr2=0x562b28b362a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:12.025 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.034+0000 7f282f400640 1 --2- 172.21.15.57:0/2606758435 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562b28b064b0 0x562b28b362a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:12.025 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.034+0000 7f282f400640 1 -- 172.21.15.57:0/2606758435 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b287842d0 con 0x562b28b32fd0 2024-03-27T10:00:12.025 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.034+0000 7f282f400640 1 --2- 172.21.15.57:0/2606758435 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562b28b32fd0 0x562b28b05f70 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f282002be30 tx=0x7f2820030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c1ac8f974967529 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:12.026 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.035+0000 7f281fe00640 1 -- 172.21.15.57:0/2606758435 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2820054070 con 0x562b28b32fd0 2024-03-27T10:00:12.026 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.035+0000 7f281fe00640 1 -- 172.21.15.57:0/2606758435 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2820037040 con 0x562b28b32fd0 2024-03-27T10:00:12.026 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.035+0000 7f281fe00640 1 -- 172.21.15.57:0/2606758435 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2820047b60 con 0x562b28b32fd0 2024-03-27T10:00:12.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.035+0000 7f2839194740 1 -- 172.21.15.57:0/2606758435 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562b28b32fd0 msgr2=0x562b28b05f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:12.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.035+0000 7f2839194740 1 --2- 172.21.15.57:0/2606758435 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562b28b32fd0 0x562b28b05f70 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f282002be30 tx=0x7f2820030000 comp rx=0 tx=0).stop 2024-03-27T10:00:12.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.035+0000 7f2839194740 1 -- 172.21.15.57:0/2606758435 shutdown_connections 2024-03-27T10:00:12.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.035+0000 7f2839194740 1 --2- 172.21.15.57:0/2606758435 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562b28b064b0 0x562b28b362a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:12.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.035+0000 7f2839194740 1 --2- 172.21.15.57:0/2606758435 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x562b28b333b0 0x562b28b35d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:12.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.035+0000 7f2839194740 1 --2- 172.21.15.57:0/2606758435 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562b28b32fd0 0x562b28b05f70 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:12.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.035+0000 7f2839194740 1 -- 172.21.15.57:0/2606758435 >> 172.21.15.57:0/2606758435 conn(0x562b28b081e0 msgr2=0x562b28b50d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:12.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.035+0000 7f2839194740 1 -- 172.21.15.57:0/2606758435 shutdown_connections 2024-03-27T10:00:12.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.035+0000 7f2839194740 1 -- 172.21.15.57:0/2606758435 wait complete. 2024-03-27T10:00:12.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.036+0000 7f2839194740 1 -- start start 2024-03-27T10:00:12.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.036+0000 7f2839194740 1 Processor -- start 2024-03-27T10:00:12.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.037+0000 7f2839194740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562b28b32fd0 0x562b28b60910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:12.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.037+0000 7f2839194740 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x562b28b333b0 0x562b28b3a690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:12.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.037+0000 7f2839194740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562b28b639d0 0x562b28b30640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:12.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.037+0000 7f2839194740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x562b28a6bf40 con 0x562b28b639d0 2024-03-27T10:00:12.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.037+0000 7f2839194740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x562b28a18650 con 0x562b28b32fd0 2024-03-27T10:00:12.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.037+0000 7f2839194740 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x562b28a2ba10 con 0x562b28b333b0 2024-03-27T10:00:12.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.038+0000 7f2839194740 10 client.0 _ll_register_callbacks cb 0x562b28a6aff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T10:00:12.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.038+0000 7f282fe00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562b28b639d0 0x562b28b30640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:12.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.038+0000 7f282fe00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562b28b639d0 0x562b28b30640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38774/0 (socket says 172.21.15.57:38774) 2024-03-27T10:00:12.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.038+0000 7f282fe00640 1 -- 172.21.15.57:0/3975286529 learned_addr learned my addr 172.21.15.57:0/3975286529 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:12.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.038+0000 7f282f400640 1 --2- 172.21.15.57:0/3975286529 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562b28b32fd0 0x562b28b60910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:12.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.038+0000 7f282ea00640 1 --2- 172.21.15.57:0/3975286529 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x562b28b333b0 0x562b28b3a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:12.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.038+0000 7f282fe00640 1 -- 172.21.15.57:0/3975286529 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x562b28b333b0 msgr2=0x562b28b3a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:12.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.038+0000 7f282fe00640 1 --2- 172.21.15.57:0/3975286529 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x562b28b333b0 0x562b28b3a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:12.030 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.038+0000 7f282fe00640 1 -- 172.21.15.57:0/3975286529 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562b28b32fd0 msgr2=0x562b28b60910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:12.030 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.038+0000 7f282fe00640 1 --2- 172.21.15.57:0/3975286529 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562b28b32fd0 0x562b28b60910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:12.030 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.038+0000 7f282fe00640 1 -- 172.21.15.57:0/3975286529 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b2884e6b0 con 0x562b28b639d0 2024-03-27T10:00:12.031 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.039+0000 7f282fe00640 1 --2- 172.21.15.57:0/3975286529 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562b28b639d0 0x562b28b30640 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f28280102f0 tx=0x7f28280107b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1915f7ebfe37c99a server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:12.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.039+0000 7f281cc00640 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2024-03-27T10:00:12.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.039+0000 7f281cc00640 1 -- 172.21.15.57:0/3975286529 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2828019030 con 0x562b28b639d0 2024-03-27T10:00:12.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.039+0000 7f281cc00640 1 -- 172.21.15.57:0/3975286529 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f2828004020 con 0x562b28b639d0 2024-03-27T10:00:12.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.039+0000 7f2839194740 1 -- 172.21.15.57:0/3975286529 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2820037040 con 0x562b28b639d0 2024-03-27T10:00:12.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.039+0000 7f281cc00640 1 -- 172.21.15.57:0/3975286529 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f2828022050 con 0x562b28b639d0 2024-03-27T10:00:12.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.039+0000 7f2839194740 10 client.4836 fetch_fsmap learned FSMap version 9 2024-03-27T10:00:12.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.039+0000 7f2839194740 1 -- 172.21.15.57:0/3975286529 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x562b28b2f200 con 0x562b28b639d0 2024-03-27T10:00:12.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.040+0000 7f281cc00640 1 -- 172.21.15.57:0/3975286529 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2820037040 con 0x562b28b639d0 2024-03-27T10:00:12.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.040+0000 7f281cc00640 1 -- 172.21.15.57:0/3975286529 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 9) ==== 3502+0+0 (secure 0 0 0) 0x7f2828025020 con 0x562b28b639d0 2024-03-27T10:00:12.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.040+0000 7f2839194740 10 client.4836 fetch_fsmap finished waiting for FSMap version 9 2024-03-27T10:00:12.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.040+0000 7f2839194740 10 client.4836 resolve_mds: resolved name 'd' to daemon mds.d 2024-03-27T10:00:12.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.040+0000 7f2839194740 20 client.4836 populate_metadata read hostname 'smithi057' 2024-03-27T10:00:12.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.040+0000 7f2839194740 1 --2- 172.21.15.57:0/3975286529 >> [v2:172.21.15.118:6833/1823694233,v1:172.21.15.118:6835/1823694233] conn(0x562b28b384e0 0x562b28b6e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:12.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.040+0000 7f2839194740 4 client.4836 mds_command: new command op to 4282 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T10:00:12.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.040+0000 7f2839194740 1 -- 172.21.15.57:0/3975286529 --> [v2:172.21.15.118:6833/1823694233,v1:172.21.15.118:6835/1823694233] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562b28a7d4d0 con 0x562b28b384e0 2024-03-27T10:00:12.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.040+0000 7f282f400640 1 --2- 172.21.15.57:0/3975286529 >> [v2:172.21.15.118:6833/1823694233,v1:172.21.15.118:6835/1823694233] conn(0x562b28b384e0 0x562b28b6e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:12.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.041+0000 7f281cc00640 10 client.4836 ms_handle_connect on v2:172.21.15.118:6833/1823694233 2024-03-27T10:00:12.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.041+0000 7f282f400640 1 --2- 172.21.15.57:0/3975286529 >> [v2:172.21.15.118:6833/1823694233,v1:172.21.15.118:6835/1823694233] conn(0x562b28b384e0 0x562b28b6e9e0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a9998d4999b22ee7 server_cookie=99273e1f5a247c3f in_seq=0 out_seq=0 2024-03-27T10:00:12.034 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.043+0000 7f281cc00640 1 -- 172.21.15.57:0/3975286529 <== mds.0 v2:172.21.15.118:6833/1823694233 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x562b28a7d4d0 con 0x562b28b384e0 2024-03-27T10:00:12.034 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.043+0000 7f281cc00640 10 client.4836 handle_command_reply: tid=0 2024-03-27T10:00:12.034 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.044+0000 7f2839194740 1 client.4836 shutdown 2024-03-27T10:00:12.034 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.044+0000 7f2839194740 1 -- 172.21.15.57:0/3975286529 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562b28b639d0 msgr2=0x562b28b30640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:12.034 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.044+0000 7f2839194740 1 --2- 172.21.15.57:0/3975286529 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562b28b639d0 0x562b28b30640 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f28280102f0 tx=0x7f28280107b0 comp rx=0 tx=0).stop 2024-03-27T10:00:12.034 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.044+0000 7f2839194740 1 -- 172.21.15.57:0/3975286529 shutdown_connections 2024-03-27T10:00:12.034 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.044+0000 7f2839194740 1 --2- 172.21.15.57:0/3975286529 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562b28b639d0 0x562b28b30640 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:12.034 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.044+0000 7f2839194740 1 --2- 172.21.15.57:0/3975286529 >> [v2:172.21.15.118:6833/1823694233,v1:172.21.15.118:6835/1823694233] conn(0x562b28b384e0 0x562b28b6e9e0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:12.034 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.044+0000 7f2839194740 1 --2- 172.21.15.57:0/3975286529 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x562b28b333b0 0x562b28b3a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:12.035 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.044+0000 7f2839194740 1 --2- 172.21.15.57:0/3975286529 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562b28b32fd0 0x562b28b60910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:12.035 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.044+0000 7f281cc00640 0 client.4836 ms_handle_reset on v2:172.21.15.118:6833/1823694233 2024-03-27T10:00:12.035 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.044+0000 7f2839194740 1 -- 172.21.15.57:0/3975286529 >> 172.21.15.57:0/3975286529 conn(0x562b28b064b0 msgr2=0x562b28b05690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:12.035 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.044+0000 7f2839194740 1 -- 172.21.15.57:0/3975286529 shutdown_connections 2024-03-27T10:00:12.035 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.044+0000 7f2839194740 1 -- 172.21.15.57:0/3975286529 wait complete. 2024-03-27T10:00:12.035 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.044+0000 7f2839194740 20 client.4836 trim_cache size 0 max 16384 2024-03-27T10:00:12.054 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.064+0000 7f2839194740 1 Processor -- start 2024-03-27T10:00:12.054 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.064+0000 7f2839194740 1 -- start start 2024-03-27T10:00:12.056 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.065+0000 7f2839194740 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x562b28b32fd0 0x562b28b0b170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:12.056 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.065+0000 7f2839194740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562b28b333b0 0x562b28b30620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:12.056 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.065+0000 7f2839194740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562b28b639d0 0x562b28b0d210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:12.056 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.065+0000 7f2839194740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f2830200ef0 con 0x562b28b333b0 2024-03-27T10:00:12.056 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.065+0000 7f2839194740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f28302001f0 con 0x562b28b639d0 2024-03-27T10:00:12.056 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.065+0000 7f2839194740 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f2830200840 con 0x562b28b32fd0 2024-03-27T10:00:12.056 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.066+0000 7f282ea00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562b28b333b0 0x562b28b30620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:12.056 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.066+0000 7f282ea00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562b28b333b0 0x562b28b30620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38782/0 (socket says 172.21.15.57:38782) 2024-03-27T10:00:12.057 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.066+0000 7f282ea00640 1 -- 172.21.15.57:0/3163104149 learned_addr learned my addr 172.21.15.57:0/3163104149 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:12.057 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.066+0000 7f282f400640 1 --2- 172.21.15.57:0/3163104149 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x562b28b32fd0 0x562b28b0b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:12.057 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.066+0000 7f282fe00640 1 --2- 172.21.15.57:0/3163104149 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562b28b639d0 0x562b28b0d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:12.057 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.066+0000 7f282ea00640 1 -- 172.21.15.57:0/3163104149 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x562b28b32fd0 msgr2=0x562b28b0b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:12.057 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.066+0000 7f282ea00640 1 --2- 172.21.15.57:0/3163104149 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x562b28b32fd0 0x562b28b0b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:12.057 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.066+0000 7f282ea00640 1 -- 172.21.15.57:0/3163104149 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562b28b639d0 msgr2=0x562b28b0d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:12.057 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.066+0000 7f282ea00640 1 --2- 172.21.15.57:0/3163104149 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562b28b639d0 0x562b28b0d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:12.057 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.066+0000 7f282ea00640 1 -- 172.21.15.57:0/3163104149 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b28b3aa00 con 0x562b28b333b0 2024-03-27T10:00:12.057 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.066+0000 7f282ea00640 1 --2- 172.21.15.57:0/3163104149 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562b28b333b0 0x562b28b30620 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f28180892f0 tx=0x7f2818001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5b1782f95d077ea server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:12.057 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.067+0000 7f281f400640 1 -- 172.21.15.57:0/3163104149 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2818056fe0 con 0x562b28b333b0 2024-03-27T10:00:12.057 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.067+0000 7f281f400640 1 -- 172.21.15.57:0/3163104149 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2818055350 con 0x562b28b333b0 2024-03-27T10:00:12.057 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.067+0000 7f281f400640 1 -- 172.21.15.57:0/3163104149 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f281800add0 con 0x562b28b333b0 2024-03-27T10:00:12.058 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.067+0000 7f2839194740 1 -- 172.21.15.57:0/3163104149 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562b28b333b0 msgr2=0x562b28b30620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:12.058 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.067+0000 7f2839194740 1 --2- 172.21.15.57:0/3163104149 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562b28b333b0 0x562b28b30620 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f28180892f0 tx=0x7f2818001250 comp rx=0 tx=0).stop 2024-03-27T10:00:12.059 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.067+0000 7f2839194740 1 -- 172.21.15.57:0/3163104149 shutdown_connections 2024-03-27T10:00:12.059 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.067+0000 7f2839194740 1 --2- 172.21.15.57:0/3163104149 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562b28b639d0 0x562b28b0d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:12.059 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.067+0000 7f2839194740 1 --2- 172.21.15.57:0/3163104149 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562b28b333b0 0x562b28b30620 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:12.059 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.067+0000 7f2839194740 1 --2- 172.21.15.57:0/3163104149 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x562b28b32fd0 0x562b28b0b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:12.059 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.067+0000 7f2839194740 1 -- 172.21.15.57:0/3163104149 >> 172.21.15.57:0/3163104149 conn(0x562b28b064b0 msgr2=0x562b28b632c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:12.059 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.067+0000 7f2839194740 1 -- 172.21.15.57:0/3163104149 shutdown_connections 2024-03-27T10:00:12.059 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.067+0000 7f2839194740 1 -- 172.21.15.57:0/3163104149 wait complete. 2024-03-27T10:00:12.059 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.068+0000 7f2839194740 1 -- start start 2024-03-27T10:00:12.059 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.068+0000 7f2839194740 1 Processor -- start 2024-03-27T10:00:12.061 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.069+0000 7f2839194740 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x562b28b32fd0 0x562b28b31590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:12.062 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.069+0000 7f2839194740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562b28b333b0 0x562b28bcab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:12.062 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.069+0000 7f2839194740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562b28b639d0 0x562b28bcb050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:12.062 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.069+0000 7f2839194740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x562b28b38360 con 0x562b28b333b0 2024-03-27T10:00:12.062 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.069+0000 7f2839194740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x562b28b3abd0 con 0x562b28b639d0 2024-03-27T10:00:12.062 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.069+0000 7f2839194740 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x562b28b388f0 con 0x562b28b32fd0 2024-03-27T10:00:12.062 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.069+0000 7f2839194740 10 client.0 _ll_register_callbacks cb 0x7f2828009200 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T10:00:12.062 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.070+0000 7f282ea00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562b28b333b0 0x562b28bcab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:12.062 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.070+0000 7f282ea00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562b28b333b0 0x562b28bcab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38788/0 (socket says 172.21.15.57:38788) 2024-03-27T10:00:12.062 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.070+0000 7f282ea00640 1 -- 172.21.15.57:0/660376043 learned_addr learned my addr 172.21.15.57:0/660376043 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:12.062 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.070+0000 7f282fe00640 1 --2- 172.21.15.57:0/660376043 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562b28b639d0 0x562b28bcb050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:12.062 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.070+0000 7f282f400640 1 --2- 172.21.15.57:0/660376043 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x562b28b32fd0 0x562b28b31590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:12.062 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.070+0000 7f282ea00640 1 -- 172.21.15.57:0/660376043 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x562b28b32fd0 msgr2=0x562b28b31590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:12.062 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.070+0000 7f282ea00640 1 --2- 172.21.15.57:0/660376043 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x562b28b32fd0 0x562b28b31590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:12.063 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.070+0000 7f282ea00640 1 -- 172.21.15.57:0/660376043 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562b28b639d0 msgr2=0x562b28bcb050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:12.063 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.070+0000 7f282ea00640 1 --2- 172.21.15.57:0/660376043 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562b28b639d0 0x562b28bcb050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:12.063 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.070+0000 7f282ea00640 1 -- 172.21.15.57:0/660376043 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b28b0d5c0 con 0x562b28b333b0 2024-03-27T10:00:12.063 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.070+0000 7f282f400640 1 --2- 172.21.15.57:0/660376043 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x562b28b32fd0 0x562b28b31590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T10:00:12.063 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.071+0000 7f282ea00640 1 --2- 172.21.15.57:0/660376043 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562b28b333b0 0x562b28bcab10 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f2818058990 tx=0x7f2818004f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1107e1e0f4ddc129 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:12.063 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.071+0000 7f281cc00640 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2024-03-27T10:00:12.063 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.071+0000 7f281cc00640 1 -- 172.21.15.57:0/660376043 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2818058330 con 0x562b28b333b0 2024-03-27T10:00:12.063 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.071+0000 7f281cc00640 1 -- 172.21.15.57:0/660376043 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f281805f290 con 0x562b28b333b0 2024-03-27T10:00:12.063 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.071+0000 7f2839194740 1 -- 172.21.15.57:0/660376043 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2818055350 con 0x562b28b333b0 2024-03-27T10:00:12.063 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.071+0000 7f281cc00640 1 -- 172.21.15.57:0/660376043 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f281805f490 con 0x562b28b333b0 2024-03-27T10:00:12.063 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.071+0000 7f2839194740 10 client.4842 fetch_fsmap learned FSMap version 9 2024-03-27T10:00:12.063 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.071+0000 7f2839194740 1 -- 172.21.15.57:0/660376043 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x562b28bcb710 con 0x562b28b333b0 2024-03-27T10:00:12.063 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.071+0000 7f281cc00640 1 -- 172.21.15.57:0/660376043 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2818055350 con 0x562b28b333b0 2024-03-27T10:00:12.064 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.071+0000 7f281cc00640 1 -- 172.21.15.57:0/660376043 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 9) ==== 3502+0+0 (secure 0 0 0) 0x7f2818054a30 con 0x562b28b333b0 2024-03-27T10:00:12.064 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.071+0000 7f2839194740 10 client.4842 fetch_fsmap finished waiting for FSMap version 9 2024-03-27T10:00:12.064 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.071+0000 7f2839194740 10 client.4842 resolve_mds: resolved name 'd' to daemon mds.d 2024-03-27T10:00:12.064 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.071+0000 7f2839194740 20 client.4842 populate_metadata read hostname 'smithi057' 2024-03-27T10:00:12.064 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.072+0000 7f2839194740 1 --2- 172.21.15.57:0/660376043 >> [v2:172.21.15.118:6833/1823694233,v1:172.21.15.118:6835/1823694233] conn(0x562b28b5fb30 0x562b28b36b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:12.064 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.072+0000 7f2839194740 4 client.4842 mds_command: new command op to 4282 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-27T10:00:12.064 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.072+0000 7f2839194740 1 -- 172.21.15.57:0/660376043 --> [v2:172.21.15.118:6833/1823694233,v1:172.21.15.118:6835/1823694233] -- command(tid 0: {"prefix": "status"}) -- 0x562b28a77820 con 0x562b28b5fb30 2024-03-27T10:00:12.064 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.072+0000 7f282f400640 1 --2- 172.21.15.57:0/660376043 >> [v2:172.21.15.118:6833/1823694233,v1:172.21.15.118:6835/1823694233] conn(0x562b28b5fb30 0x562b28b36b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:12.065 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.073+0000 7f282f400640 1 --2- 172.21.15.57:0/660376043 >> [v2:172.21.15.118:6833/1823694233,v1:172.21.15.118:6835/1823694233] conn(0x562b28b5fb30 0x562b28b36b40 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a5e13a12340b15 server_cookie=2ec1632ff9a8ef22 in_seq=0 out_seq=0 2024-03-27T10:00:12.065 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.073+0000 7f281cc00640 10 client.4842 ms_handle_connect on v2:172.21.15.118:6833/1823694233 2024-03-27T10:00:12.066 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.074+0000 7f281cc00640 1 -- 172.21.15.57:0/660376043 <== mds.0 v2:172.21.15.118:6833/1823694233 1 ==== command_reply(tid 0: 0 ) ==== 8+0+323 (crc 0 0 0) 0x562b28a77820 con 0x562b28b5fb30 2024-03-27T10:00:12.066 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.074+0000 7f281cc00640 10 client.4842 handle_command_reply: tid=0 2024-03-27T10:00:12.066 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.074+0000 7f2839194740 1 client.4842 shutdown 2024-03-27T10:00:12.066 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.074+0000 7f2839194740 1 -- 172.21.15.57:0/660376043 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562b28b333b0 msgr2=0x562b28bcab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:12.066 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.074+0000 7f2839194740 1 --2- 172.21.15.57:0/660376043 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562b28b333b0 0x562b28bcab10 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f2818058990 tx=0x7f2818004f90 comp rx=0 tx=0).stop 2024-03-27T10:00:12.066 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.074+0000 7f2839194740 1 -- 172.21.15.57:0/660376043 shutdown_connections 2024-03-27T10:00:12.066 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.074+0000 7f2839194740 1 --2- 172.21.15.57:0/660376043 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x562b28b639d0 0x562b28bcb050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:12.066 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.074+0000 7f2839194740 1 --2- 172.21.15.57:0/660376043 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x562b28b333b0 0x562b28bcab10 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:12.066 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.074+0000 7f2839194740 1 --2- 172.21.15.57:0/660376043 >> [v2:172.21.15.118:6833/1823694233,v1:172.21.15.118:6835/1823694233] conn(0x562b28b5fb30 0x562b28b36b40 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:12.066 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.074+0000 7f2839194740 1 --2- 172.21.15.57:0/660376043 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x562b28b32fd0 0x562b28b31590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:12.066 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.074+0000 7f2839194740 1 -- 172.21.15.57:0/660376043 >> 172.21.15.57:0/660376043 conn(0x562b28b064b0 msgr2=0x562b28b301f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:12.066 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.074+0000 7f281cc00640 0 client.4842 ms_handle_reset on v2:172.21.15.118:6833/1823694233 2024-03-27T10:00:12.066 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.074+0000 7f2839194740 1 -- 172.21.15.57:0/660376043 shutdown_connections 2024-03-27T10:00:12.067 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.074+0000 7f2839194740 1 -- 172.21.15.57:0/660376043 wait complete. 2024-03-27T10:00:12.067 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.074+0000 7f2839194740 20 client.4842 trim_cache size 0 max 16384 2024-03-27T10:00:12.067 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-03-27T10:00:12.067 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_fsid": "7ac43f86-2c16-4a97-98fb-715d3cebc75c", 2024-03-27T10:00:12.067 INFO:teuthology.orchestra.run.smithi057.stdout: "whoami": 0, 2024-03-27T10:00:12.067 INFO:teuthology.orchestra.run.smithi057.stdout: "id": 4282, 2024-03-27T10:00:12.067 INFO:teuthology.orchestra.run.smithi057.stdout: "want_state": "up:active", 2024-03-27T10:00:12.067 INFO:teuthology.orchestra.run.smithi057.stdout: "state": "up:active", 2024-03-27T10:00:12.067 INFO:teuthology.orchestra.run.smithi057.stdout: "fs_name": "cephfs", 2024-03-27T10:00:12.067 INFO:teuthology.orchestra.run.smithi057.stdout: "rank_uptime": 42.929248493000003, 2024-03-27T10:00:12.068 INFO:teuthology.orchestra.run.smithi057.stdout: "mdsmap_epoch": 9, 2024-03-27T10:00:12.068 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_epoch": 28, 2024-03-27T10:00:12.068 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_epoch_barrier": 26, 2024-03-27T10:00:12.068 INFO:teuthology.orchestra.run.smithi057.stdout: "uptime": 48.44042932 2024-03-27T10:00:12.068 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-03-27T10:00:12.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.075+0000 7f2836400640 1 -- 172.21.15.57:0/4015095286 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f280c06c560 msgr2=0x7f280c06ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:12.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.075+0000 7f2836400640 1 --2- 172.21.15.57:0/4015095286 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f280c06c560 0x7f280c06ea20 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2820036000 tx=0x7f282003d040 comp rx=0 tx=0).stop 2024-03-27T10:00:12.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.075+0000 7f2836400640 1 -- 172.21.15.57:0/4015095286 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f283006bb80 msgr2=0x7f28300ce7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:12.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.075+0000 7f2836400640 1 --2- 172.21.15.57:0/4015095286 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f283006bb80 0x7f28300ce7c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f281800c890 tx=0x7f281800cd50 comp rx=0 tx=0).stop 2024-03-27T10:00:12.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.075+0000 7f2836400640 1 -- 172.21.15.57:0/4015095286 shutdown_connections 2024-03-27T10:00:12.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.075+0000 7f2836400640 1 --2- 172.21.15.57:0/4015095286 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f280c06c560 0x7f280c06ea20 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:12.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.075+0000 7f2836400640 1 --2- 172.21.15.57:0/4015095286 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f28300cd330 0x7f283013dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:12.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.075+0000 7f2836400640 1 --2- 172.21.15.57:0/4015095286 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f283006bb80 0x7f28300ce7c0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:12.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.075+0000 7f2836400640 1 --2- 172.21.15.57:0/4015095286 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f283006b7a0 0x7f28301f4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:12.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.075+0000 7f2836400640 1 -- 172.21.15.57:0/4015095286 >> 172.21.15.57:0/4015095286 conn(0x7f28300b1c60 msgr2=0x7f28300b2c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:12.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.075+0000 7f2836400640 1 -- 172.21.15.57:0/4015095286 shutdown_connections 2024-03-27T10:00:12.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.075+0000 7f2836400640 1 -- 172.21.15.57:0/4015095286 wait complete. 2024-03-27T10:00:12.083 INFO:teuthology.run_tasks:Running task sequential... 2024-03-27T10:00:12.093 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-03-27T10:00:12.093 INFO:teuthology.task.sequential:In sequential, running task print... 2024-03-27T10:00:12.094 INFO:teuthology.task.print:Enabling mgr modules 2024-03-27T10:00:12.094 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-03-27T10:00:12.169 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-03-27T10:00:12.170 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-03-27T10:00:12.170 INFO:tasks.ceph_fuse:client.0 config is {} 2024-03-27T10:00:12.170 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-27T10:00:12.170 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-27T10:00:12.170 INFO:tasks.ceph_fuse:client.2 config is {} 2024-03-27T10:00:12.170 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-27T10:00:12.170 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-03-27T10:00:12.170 INFO:tasks.ceph_fuse:client.1 config is {} 2024-03-27T10:00:12.170 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-27T10:00:12.170 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-03-27T10:00:12.171 INFO:tasks.ceph_fuse:client.3 config is {} 2024-03-27T10:00:12.171 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-27T10:00:12.171 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-03-27T10:00:12.171 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T10:00:12.171 DEBUG:teuthology.orchestra.run.smithi057:> ip netns list 2024-03-27T10:00:12.229 INFO:teuthology.orchestra.run.smithi057.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-03-27T10:00:12.230 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T10:00:12.230 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-03-27T10:00:12.326 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T10:00:12.326 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip link delete ceph-brx 2024-03-27T10:00:12.443 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T10:00:12.444 DEBUG:teuthology.orchestra.run.smithi118:> ip netns list 2024-03-27T10:00:12.503 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T10:00:12.504 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link delete ceph-brx 2024-03-27T10:00:12.599 INFO:teuthology.orchestra.run.smithi118.stderr:Cannot find device "ceph-brx" 2024-03-27T10:00:12.603 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-27T10:00:12.603 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-03-27T10:00:12.603 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-27T10:00:12.826 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.836+0000 7fa399c00640 1 Processor -- start 2024-03-27T10:00:12.826 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.836+0000 7fa399c00640 1 -- start start 2024-03-27T10:00:12.828 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.838+0000 7fa399c00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fa3940b3390 0x7fa394071fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:12.828 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.838+0000 7fa399c00640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa39415f5c0 con 0x7fa3941588d0 2024-03-27T10:00:12.828 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.838+0000 7fa399c00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3940714f0 con 0x7fa39415e900 2024-03-27T10:00:12.828 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.838+0000 7fa399c00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7fa39415f8a0 con 0x7fa3940b3390 2024-03-27T10:00:12.828 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.838+0000 7fa392a00640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fa3941588d0 0x7fa3940b2c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:60762/0 (socket says 172.21.15.57:60762) 2024-03-27T10:00:12.828 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.838+0000 7fa392a00640 1 -- 172.21.15.57:0/1523981713 learned_addr learned my addr 172.21.15.57:0/1523981713 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T10:00:12.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.839+0000 7fa392000640 1 --2- 172.21.15.57:0/1523981713 >> v2:172.21.15.118:3300/0 conn(0x7fa3940b3390 0x7fa394071fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:12.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.839+0000 7fa391600640 1 -- 172.21.15.57:0/1523981713 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1284360707 0 0) 0x7fa39415f5c0 con 0x7fa3941588d0 2024-03-27T10:00:12.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.839+0000 7fa391600640 1 -- 172.21.15.57:0/1523981713 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa378003520 con 0x7fa3941588d0 2024-03-27T10:00:12.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.839+0000 7fa391600640 1 -- 172.21.15.57:0/1523981713 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3705963708 0 0) 0x7fa378003520 con 0x7fa3941588d0 2024-03-27T10:00:12.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.839+0000 7fa391600640 1 -- 172.21.15.57:0/1523981713 >> v2:172.21.15.118:3300/0 conn(0x7fa3940b3390 msgr2=0x7fa394071fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:12.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.839+0000 7fa391600640 1 --2- 172.21.15.57:0/1523981713 >> v2:172.21.15.118:3300/0 conn(0x7fa3940b3390 0x7fa394071fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:12.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.839+0000 7fa391600640 1 -- 172.21.15.57:0/1523981713 >> v1:172.21.15.118:6789/0 conn(0x7fa39415e900 legacy=0x7fa39415ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:12.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.839+0000 7fa391600640 1 -- 172.21.15.57:0/1523981713 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3940717d0 con 0x7fa3941588d0 2024-03-27T10:00:12.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.839+0000 7fa391600640 1 -- 172.21.15.57:0/1523981713 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4227751516 0 0) 0x7fa384001670 con 0x7fa3941588d0 2024-03-27T10:00:12.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.839+0000 7fa391600640 1 -- 172.21.15.57:0/1523981713 >> v1:172.21.15.57:6789/0 conn(0x7fa3941588d0 legacy=0x7fa3940b2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:12.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.839+0000 7fa391600640 1 --2- 172.21.15.57:0/1523981713 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa3780039b0 0x7fa378003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:12.832 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.840+0000 7fa391600640 1 --2- 172.21.15.57:0/1523981713 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa378004800 0x7fa378004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:12.832 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.840+0000 7fa391600640 1 --2- 172.21.15.57:0/1523981713 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3780051c0 0x7fa37800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:12.832 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.840+0000 7fa391600640 1 -- 172.21.15.57:0/1523981713 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fa39415f8a0 con 0x7fa3780039b0 2024-03-27T10:00:12.832 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.840+0000 7fa391600640 1 -- 172.21.15.57:0/1523981713 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fa37800c160 con 0x7fa3780051c0 2024-03-27T10:00:12.832 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.840+0000 7fa391600640 1 -- 172.21.15.57:0/1523981713 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fa37800c360 con 0x7fa378004800 2024-03-27T10:00:12.832 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.840+0000 7fa392a00640 1 --2- 172.21.15.57:0/1523981713 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa3780039b0 0x7fa378003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:12.832 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.840+0000 7fa392000640 1 --2- 172.21.15.57:0/1523981713 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa378004800 0x7fa378004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:12.832 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.840+0000 7fa393400640 1 --2- 172.21.15.57:0/1523981713 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3780051c0 0x7fa37800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:12.832 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.840+0000 7fa392a00640 1 -- 172.21.15.57:0/1523981713 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa378004800 msgr2=0x7fa378004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:12.832 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.841+0000 7fa392a00640 1 --2- 172.21.15.57:0/1523981713 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa378004800 0x7fa378004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:12.832 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.841+0000 7fa392a00640 1 -- 172.21.15.57:0/1523981713 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3780051c0 msgr2=0x7fa37800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:12.833 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.841+0000 7fa392a00640 1 --2- 172.21.15.57:0/1523981713 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3780051c0 0x7fa37800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:12.833 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.841+0000 7fa392a00640 1 -- 172.21.15.57:0/1523981713 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa378003520 con 0x7fa3780039b0 2024-03-27T10:00:12.833 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.841+0000 7fa393400640 1 -- 172.21.15.57:0/1523981713 reap_dead start 2024-03-27T10:00:12.833 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.841+0000 7fa392000640 1 --2- 172.21.15.57:0/1523981713 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa378004800 0x7fa378004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T10:00:12.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.842+0000 7fa392a00640 1 --2- 172.21.15.57:0/1523981713 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa3780039b0 0x7fa378003dd0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa38400c240 tx=0x7fa378005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0fc13b886f7cf27 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:12.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.842+0000 7fa391600640 1 -- 172.21.15.57:0/1523981713 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa384007d10 con 0x7fa3780039b0 2024-03-27T10:00:12.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.842+0000 7fa391600640 1 -- 172.21.15.57:0/1523981713 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa384030070 con 0x7fa3780039b0 2024-03-27T10:00:12.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.842+0000 7fa391600640 1 -- 172.21.15.57:0/1523981713 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa38402cda0 con 0x7fa3780039b0 2024-03-27T10:00:12.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.843+0000 7fa399c00640 1 -- 172.21.15.57:0/1523981713 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa3780039b0 msgr2=0x7fa378003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:12.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.843+0000 7fa399c00640 1 --2- 172.21.15.57:0/1523981713 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa3780039b0 0x7fa378003dd0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa38400c240 tx=0x7fa378005830 comp rx=0 tx=0).stop 2024-03-27T10:00:12.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.843+0000 7fa399c00640 1 -- 172.21.15.57:0/1523981713 shutdown_connections 2024-03-27T10:00:12.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.843+0000 7fa399c00640 1 --2- 172.21.15.57:0/1523981713 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa3780039b0 0x7fa378003dd0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:12.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.843+0000 7fa399c00640 1 -- 172.21.15.57:0/1523981713 >> 172.21.15.57:0/1523981713 conn(0x7fa39406bb70 msgr2=0x7fa3940b1980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:12.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.843+0000 7fa399c00640 1 -- 172.21.15.57:0/1523981713 shutdown_connections 2024-03-27T10:00:12.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.843+0000 7fa399c00640 1 -- 172.21.15.57:0/1523981713 wait complete. 2024-03-27T10:00:12.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.846+0000 7fa399c00640 1 Processor -- start 2024-03-27T10:00:12.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.846+0000 7fa399c00640 1 -- start start 2024-03-27T10:00:12.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.847+0000 7fa399c00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa3780039b0 0x7fa3940b04e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:12.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.847+0000 7fa399c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3940b15e0 0x7fa394155640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:12.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.847+0000 7fa399c00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa39409ba00 0x7fa39409be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:12.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.847+0000 7fa399c00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fa394158cb0 con 0x7fa39409ba00 2024-03-27T10:00:12.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.847+0000 7fa399c00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fa394071fd0 con 0x7fa3940b15e0 2024-03-27T10:00:12.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.847+0000 7fa399c00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fa39409b570 con 0x7fa3780039b0 2024-03-27T10:00:12.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.848+0000 7fa393400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa39409ba00 0x7fa39409be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:12.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.848+0000 7fa392a00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa3780039b0 0x7fa3940b04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:12.839 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.848+0000 7fa392a00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa3780039b0 0x7fa3940b04e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.57:39786/0 (socket says 172.21.15.57:39786) 2024-03-27T10:00:12.839 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.848+0000 7fa392a00640 1 -- 172.21.15.57:0/1534700134 learned_addr learned my addr 172.21.15.57:0/1534700134 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:12.839 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.848+0000 7fa393400640 1 --2- 172.21.15.57:0/1534700134 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa39409ba00 0x7fa39409be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38816/0 (socket says 172.21.15.57:38816) 2024-03-27T10:00:12.839 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.848+0000 7fa392000640 1 --2- 172.21.15.57:0/1534700134 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3940b15e0 0x7fa394155640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:12.839 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.848+0000 7fa393400640 1 -- 172.21.15.57:0/1534700134 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa3780039b0 msgr2=0x7fa3940b04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:12.839 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.848+0000 7fa393400640 1 --2- 172.21.15.57:0/1534700134 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa3780039b0 0x7fa3940b04e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:12.839 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.848+0000 7fa393400640 1 -- 172.21.15.57:0/1534700134 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3940b15e0 msgr2=0x7fa394155640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:12.839 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.848+0000 7fa393400640 1 --2- 172.21.15.57:0/1534700134 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3940b15e0 0x7fa394155640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:12.839 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.848+0000 7fa393400640 1 -- 172.21.15.57:0/1534700134 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa39409ac40 con 0x7fa39409ba00 2024-03-27T10:00:12.839 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.849+0000 7fa393400640 1 --2- 172.21.15.57:0/1534700134 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa39409ba00 0x7fa39409be80 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa39415ece0 tx=0x7fa38c00fc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:12.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.849+0000 7fa38aa00640 1 -- 172.21.15.57:0/1534700134 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa38c01a070 con 0x7fa39409ba00 2024-03-27T10:00:12.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.849+0000 7fa38aa00640 1 -- 172.21.15.57:0/1534700134 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa38c006d60 con 0x7fa39409ba00 2024-03-27T10:00:12.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.849+0000 7fa38aa00640 1 -- 172.21.15.57:0/1534700134 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa38c003bb0 con 0x7fa39409ba00 2024-03-27T10:00:12.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.849+0000 7fa399c00640 1 -- 172.21.15.57:0/1534700134 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa39409af20 con 0x7fa39409ba00 2024-03-27T10:00:12.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.849+0000 7fa399c00640 1 -- 172.21.15.57:0/1534700134 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3940b1a60 con 0x7fa39409ba00 2024-03-27T10:00:12.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.850+0000 7fa399c00640 1 -- 172.21.15.57:0/1534700134 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa39409b6f0 con 0x7fa39409ba00 2024-03-27T10:00:12.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.851+0000 7fa38aa00640 1 -- 172.21.15.57:0/1534700134 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fa38c005110 con 0x7fa39409ba00 2024-03-27T10:00:12.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.852+0000 7fa38aa00640 1 --2- 172.21.15.57:0/1534700134 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fa37406c560 0x7fa37406ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:12.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.852+0000 7fa38aa00640 1 -- 172.21.15.57:0/1534700134 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fa38c08b1a0 con 0x7fa39409ba00 2024-03-27T10:00:12.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.852+0000 7fa392a00640 1 --2- 172.21.15.57:0/1534700134 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fa37406c560 0x7fa37406ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:12.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.853+0000 7fa392a00640 1 --2- 172.21.15.57:0/1534700134 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fa37406c560 0x7fa37406ea20 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa39415d9c0 tx=0x7fa384009030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:12.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:12.857+0000 7fa38aa00640 1 -- 172.21.15.57:0/1534700134 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7fa38c058d60 con 0x7fa39409ba00 2024-03-27T10:00:13.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:13.100+0000 7fa399c00640 1 -- 172.21.15.57:0/1534700134 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fa394068540 con 0x7fa39409ba00 2024-03-27T10:00:13.091 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:13.101+0000 7fa38aa00640 1 -- 172.21.15.57:0/1534700134 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7fa38c05d060 con 0x7fa39409ba00 2024-03-27T10:00:13.091 INFO:teuthology.orchestra.run.smithi057.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-03-27T10:00:13.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:13.103+0000 7fa399c00640 1 -- 172.21.15.57:0/1534700134 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fa37406c560 msgr2=0x7fa37406ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:13.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:13.103+0000 7fa399c00640 1 --2- 172.21.15.57:0/1534700134 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fa37406c560 0x7fa37406ea20 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa39415d9c0 tx=0x7fa384009030 comp rx=0 tx=0).stop 2024-03-27T10:00:13.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:13.103+0000 7fa399c00640 1 -- 172.21.15.57:0/1534700134 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa39409ba00 msgr2=0x7fa39409be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:13.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:13.103+0000 7fa399c00640 1 --2- 172.21.15.57:0/1534700134 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa39409ba00 0x7fa39409be80 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa39415ece0 tx=0x7fa38c00fc90 comp rx=0 tx=0).stop 2024-03-27T10:00:13.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:13.103+0000 7fa399c00640 1 -- 172.21.15.57:0/1534700134 shutdown_connections 2024-03-27T10:00:13.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:13.103+0000 7fa399c00640 1 --2- 172.21.15.57:0/1534700134 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa39409ba00 0x7fa39409be80 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:13.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:13.103+0000 7fa399c00640 1 --2- 172.21.15.57:0/1534700134 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fa37406c560 0x7fa37406ea20 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:13.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:13.104+0000 7fa399c00640 1 --2- 172.21.15.57:0/1534700134 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa3940b15e0 0x7fa394155640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:13.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:13.104+0000 7fa399c00640 1 --2- 172.21.15.57:0/1534700134 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa3780039b0 0x7fa3940b04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:13.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:13.104+0000 7fa399c00640 1 -- 172.21.15.57:0/1534700134 >> 172.21.15.57:0/1534700134 conn(0x7fa39406bb70 msgr2=0x7fa39406d9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:13.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:13.104+0000 7fa399c00640 1 -- 172.21.15.57:0/1534700134 shutdown_connections 2024-03-27T10:00:13.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:13.104+0000 7fa399c00640 1 -- 172.21.15.57:0/1534700134 wait complete. 2024-03-27T10:00:13.113 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-27T10:00:13.113 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-27T10:00:13.113 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi057.front.sepia.ceph.com 2024-03-27T10:00:13.114 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-03-27T10:00:13.114 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-27T10:00:13.114 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-27T10:00:13.114 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-27T10:00:13.114 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-27T10:00:13.114 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-27T10:00:13.114 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T10:00:13.114 DEBUG:teuthology.orchestra.run.smithi057:> ip addr 2024-03-27T10:00:13.168 INFO:teuthology.orchestra.run.smithi057.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-27T10:00:13.168 INFO:teuthology.orchestra.run.smithi057.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-27T10:00:13.169 INFO:teuthology.orchestra.run.smithi057.stdout: inet 127.0.0.1/8 scope host lo 2024-03-27T10:00:13.169 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2024-03-27T10:00:13.169 INFO:teuthology.orchestra.run.smithi057.stdout: inet6 ::1/128 scope host 2024-03-27T10:00:13.169 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2024-03-27T10:00:13.169 INFO:teuthology.orchestra.run.smithi057.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-27T10:00:13.169 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 0c:c4:7a:6b:ff:86 brd ff:ff:ff:ff:ff:ff 2024-03-27T10:00:13.169 INFO:teuthology.orchestra.run.smithi057.stdout: altname enp7s0f0 2024-03-27T10:00:13.169 INFO:teuthology.orchestra.run.smithi057.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-27T10:00:13.169 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 0c:c4:7a:6b:ff:87 brd ff:ff:ff:ff:ff:ff 2024-03-27T10:00:13.169 INFO:teuthology.orchestra.run.smithi057.stdout: altname enp7s0f1 2024-03-27T10:00:13.169 INFO:teuthology.orchestra.run.smithi057.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-27T10:00:13.169 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 0c:c4:7a:bd:15:62 brd ff:ff:ff:ff:ff:ff 2024-03-27T10:00:13.169 INFO:teuthology.orchestra.run.smithi057.stdout: altname enp1s0f0 2024-03-27T10:00:13.169 INFO:teuthology.orchestra.run.smithi057.stdout: inet 172.21.15.57/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-03-27T10:00:13.170 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft 42514sec preferred_lft 42514sec 2024-03-27T10:00:13.170 INFO:teuthology.orchestra.run.smithi057.stdout: inet6 fe80::ec4:7aff:febd:1562/64 scope link noprefixroute 2024-03-27T10:00:13.170 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2024-03-27T10:00:13.170 INFO:teuthology.orchestra.run.smithi057.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-27T10:00:13.170 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 0c:c4:7a:bd:15:63 brd ff:ff:ff:ff:ff:ff 2024-03-27T10:00:13.170 INFO:teuthology.orchestra.run.smithi057.stdout: altname enp1s0f1 2024-03-27T10:00:13.171 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-03-27T10:00:13.171 DEBUG:teuthology.orchestra.run.smithi057:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-27T10:00:13.171 DEBUG:teuthology.orchestra.run.smithi057:> set -e 2024-03-27T10:00:13.171 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip link add name ceph-brx type bridge 2024-03-27T10:00:13.171 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip addr flush dev ceph-brx 2024-03-27T10:00:13.171 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip link set ceph-brx up 2024-03-27T10:00:13.171 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-03-27T10:00:13.171 DEBUG:teuthology.orchestra.run.smithi057:> ') 2024-03-27T10:00:13.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-27T10:00:13.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-27T10:00:13.474 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T10:00:13.474 DEBUG:teuthology.orchestra.run.smithi057:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-27T10:00:13.552 INFO:teuthology.orchestra.run.smithi057.stdout:1 2024-03-27T10:00:13.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T10:00:13.556 DEBUG:teuthology.orchestra.run.smithi057:> route 2024-03-27T10:00:13.606 INFO:teuthology.orchestra.run.smithi057.stdout:Kernel IP routing table 2024-03-27T10:00:13.606 INFO:teuthology.orchestra.run.smithi057.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-27T10:00:13.606 INFO:teuthology.orchestra.run.smithi057.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-03-27T10:00:13.606 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-03-27T10:00:13.606 INFO:teuthology.orchestra.run.smithi057.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-27T10:00:13.607 DEBUG:teuthology.orchestra.run.smithi057:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-27T10:00:13.607 DEBUG:teuthology.orchestra.run.smithi057:> set -e 2024-03-27T10:00:13.607 DEBUG:teuthology.orchestra.run.smithi057:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-03-27T10:00:13.607 DEBUG:teuthology.orchestra.run.smithi057:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-03-27T10:00:13.607 DEBUG:teuthology.orchestra.run.smithi057:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-03-27T10:00:13.607 DEBUG:teuthology.orchestra.run.smithi057:> ') 2024-03-27T10:00:13.713 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-27T10:00:13.852 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-27T10:00:13.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T10:00:13.862 DEBUG:teuthology.orchestra.run.smithi057:> ip netns list 2024-03-27T10:00:13.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T10:00:13.918 DEBUG:teuthology.orchestra.run.smithi057:> ip netns list-id 2024-03-27T10:00:13.973 DEBUG:teuthology.orchestra.run.smithi057:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-27T10:00:13.973 DEBUG:teuthology.orchestra.run.smithi057:> set -e 2024-03-27T10:00:13.973 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-27T10:00:13.973 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-03-27T10:00:13.973 DEBUG:teuthology.orchestra.run.smithi057:> ') 2024-03-27T10:00:14.086 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-27T10:00:14.189 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-27T10:00:14.203 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-03-27T10:00:14.203 DEBUG:teuthology.orchestra.run.smithi057:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-27T10:00:14.203 DEBUG:teuthology.orchestra.run.smithi057:> set -e 2024-03-27T10:00:14.203 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-03-27T10:00:14.203 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-03-27T10:00:14.203 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-03-27T10:00:14.204 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-03-27T10:00:14.204 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-03-27T10:00:14.204 DEBUG:teuthology.orchestra.run.smithi057:> ') 2024-03-27T10:00:14.311 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-27T10:00:14.530 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-27T10:00:14.539 DEBUG:teuthology.orchestra.run.smithi057:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-27T10:00:14.539 DEBUG:teuthology.orchestra.run.smithi057:> set -e 2024-03-27T10:00:14.539 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip link set brx.0 up 2024-03-27T10:00:14.539 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip link set dev brx.0 master ceph-brx 2024-03-27T10:00:14.539 DEBUG:teuthology.orchestra.run.smithi057:> ') 2024-03-27T10:00:14.634 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-27T10:00:14.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-27T10:00:14.762 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-03-27T10:00:14.762 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-27T10:00:14.762 DEBUG:teuthology.orchestra.run.smithi057:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-03-27T10:00:14.805 INFO:teuthology.orchestra.run.smithi057.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-03-27T10:00:14.806 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-27T10:00:14.806 DEBUG:teuthology.orchestra.run.smithi057:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-03-27T10:00:14.900 DEBUG:teuthology.orchestra.run.smithi057:> sudo modprobe fuse 2024-03-27T10:00:14.989 DEBUG:teuthology.orchestra.run.smithi057:> cat /proc/self/mounts | awk '{print $2}' 2024-03-27T10:00:15.042 INFO:teuthology.orchestra.run.smithi057.stdout:/proc 2024-03-27T10:00:15.042 INFO:teuthology.orchestra.run.smithi057.stdout:/sys 2024-03-27T10:00:15.042 INFO:teuthology.orchestra.run.smithi057.stdout:/dev 2024-03-27T10:00:15.042 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/kernel/security 2024-03-27T10:00:15.042 INFO:teuthology.orchestra.run.smithi057.stdout:/dev/shm 2024-03-27T10:00:15.042 INFO:teuthology.orchestra.run.smithi057.stdout:/dev/pts 2024-03-27T10:00:15.042 INFO:teuthology.orchestra.run.smithi057.stdout:/run 2024-03-27T10:00:15.042 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/cgroup 2024-03-27T10:00:15.043 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/pstore 2024-03-27T10:00:15.043 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/bpf 2024-03-27T10:00:15.043 INFO:teuthology.orchestra.run.smithi057.stdout:/ 2024-03-27T10:00:15.043 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/selinux 2024-03-27T10:00:15.043 INFO:teuthology.orchestra.run.smithi057.stdout:/proc/sys/fs/binfmt_misc 2024-03-27T10:00:15.043 INFO:teuthology.orchestra.run.smithi057.stdout:/dev/hugepages 2024-03-27T10:00:15.043 INFO:teuthology.orchestra.run.smithi057.stdout:/dev/mqueue 2024-03-27T10:00:15.043 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/kernel/debug 2024-03-27T10:00:15.043 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/kernel/tracing 2024-03-27T10:00:15.043 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/fuse/connections 2024-03-27T10:00:15.043 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/kernel/config 2024-03-27T10:00:15.043 INFO:teuthology.orchestra.run.smithi057.stdout:/run/credentials/systemd-sysctl.service 2024-03-27T10:00:15.043 INFO:teuthology.orchestra.run.smithi057.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-27T10:00:15.043 INFO:teuthology.orchestra.run.smithi057.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-27T10:00:15.043 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/nfs/rpc_pipefs 2024-03-27T10:00:15.044 INFO:teuthology.orchestra.run.smithi057.stdout:/run/user/1000 2024-03-27T10:00:15.044 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/ceph 2024-03-27T10:00:15.044 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/ceph/osd/ceph-0 2024-03-27T10:00:15.044 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/ceph/osd/ceph-1 2024-03-27T10:00:15.044 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/ceph/osd/ceph-2 2024-03-27T10:00:15.044 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/ceph/osd/ceph-3 2024-03-27T10:00:15.044 INFO:teuthology.orchestra.run.smithi057.stdout:/run/netns 2024-03-27T10:00:15.044 INFO:teuthology.orchestra.run.smithi057.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-27T10:00:15.044 INFO:teuthology.orchestra.run.smithi057.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-27T10:00:15.045 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T10:00:15.045 DEBUG:teuthology.orchestra.run.smithi057:> ls /sys/fs/fuse/connections 2024-03-27T10:00:15.095 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-03-27T10:00:15.095 DEBUG:teuthology.orchestra.run.smithi057:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-03-27T10:00:15.100 DEBUG:teuthology.orchestra.run.smithi057:> sudo modprobe fuse 2024-03-27T10:00:15.171 DEBUG:teuthology.orchestra.run.smithi057:> cat /proc/self/mounts | awk '{print $2}' 2024-03-27T10:00:15.213 INFO:teuthology.orchestra.run.smithi057.stdout:/proc 2024-03-27T10:00:15.214 INFO:teuthology.orchestra.run.smithi057.stdout:/sys 2024-03-27T10:00:15.214 INFO:teuthology.orchestra.run.smithi057.stdout:/dev 2024-03-27T10:00:15.214 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/kernel/security 2024-03-27T10:00:15.214 INFO:teuthology.orchestra.run.smithi057.stdout:/dev/shm 2024-03-27T10:00:15.214 INFO:teuthology.orchestra.run.smithi057.stdout:/dev/pts 2024-03-27T10:00:15.214 INFO:teuthology.orchestra.run.smithi057.stdout:/run 2024-03-27T10:00:15.214 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/cgroup 2024-03-27T10:00:15.214 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/pstore 2024-03-27T10:00:15.214 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/bpf 2024-03-27T10:00:15.214 INFO:teuthology.orchestra.run.smithi057.stdout:/ 2024-03-27T10:00:15.214 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/selinux 2024-03-27T10:00:15.214 INFO:teuthology.orchestra.run.smithi057.stdout:/proc/sys/fs/binfmt_misc 2024-03-27T10:00:15.215 INFO:teuthology.orchestra.run.smithi057.stdout:/dev/hugepages 2024-03-27T10:00:15.215 INFO:teuthology.orchestra.run.smithi057.stdout:/dev/mqueue 2024-03-27T10:00:15.215 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/kernel/debug 2024-03-27T10:00:15.215 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/kernel/tracing 2024-03-27T10:00:15.215 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/fuse/connections 2024-03-27T10:00:15.215 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/kernel/config 2024-03-27T10:00:15.215 INFO:teuthology.orchestra.run.smithi057.stdout:/run/credentials/systemd-sysctl.service 2024-03-27T10:00:15.215 INFO:teuthology.orchestra.run.smithi057.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-27T10:00:15.215 INFO:teuthology.orchestra.run.smithi057.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-27T10:00:15.215 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/nfs/rpc_pipefs 2024-03-27T10:00:15.215 INFO:teuthology.orchestra.run.smithi057.stdout:/run/user/1000 2024-03-27T10:00:15.215 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/ceph 2024-03-27T10:00:15.215 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/ceph/osd/ceph-0 2024-03-27T10:00:15.215 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/ceph/osd/ceph-1 2024-03-27T10:00:15.215 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/ceph/osd/ceph-2 2024-03-27T10:00:15.215 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/ceph/osd/ceph-3 2024-03-27T10:00:15.216 INFO:teuthology.orchestra.run.smithi057.stdout:/run/netns 2024-03-27T10:00:15.216 INFO:teuthology.orchestra.run.smithi057.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-27T10:00:15.216 INFO:teuthology.orchestra.run.smithi057.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-27T10:00:15.217 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T10:00:15.217 DEBUG:teuthology.orchestra.run.smithi057:> ls /sys/fs/fuse/connections 2024-03-27T10:00:15.294 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi057.stderr:2024-03-27T10:00:15.304+0000 7f0ac16bb480 -1 init, newargv = 0x557e7860b200 newargc=15 2024-03-27T10:00:15.294 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi057.stderr:ceph-fuse[47369]: starting ceph client 2024-03-27T10:00:15.306 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi057.stderr:ceph-fuse[47369]: starting fuse 2024-03-27T10:00:16.402 DEBUG:teuthology.orchestra.run.smithi057:> sudo modprobe fuse 2024-03-27T10:00:16.512 DEBUG:teuthology.orchestra.run.smithi057:> cat /proc/self/mounts | awk '{print $2}' 2024-03-27T10:00:16.568 INFO:teuthology.orchestra.run.smithi057.stdout:/proc 2024-03-27T10:00:16.568 INFO:teuthology.orchestra.run.smithi057.stdout:/sys 2024-03-27T10:00:16.568 INFO:teuthology.orchestra.run.smithi057.stdout:/dev 2024-03-27T10:00:16.568 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/kernel/security 2024-03-27T10:00:16.568 INFO:teuthology.orchestra.run.smithi057.stdout:/dev/shm 2024-03-27T10:00:16.568 INFO:teuthology.orchestra.run.smithi057.stdout:/dev/pts 2024-03-27T10:00:16.569 INFO:teuthology.orchestra.run.smithi057.stdout:/run 2024-03-27T10:00:16.569 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/cgroup 2024-03-27T10:00:16.569 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/pstore 2024-03-27T10:00:16.569 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/bpf 2024-03-27T10:00:16.569 INFO:teuthology.orchestra.run.smithi057.stdout:/ 2024-03-27T10:00:16.569 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/selinux 2024-03-27T10:00:16.569 INFO:teuthology.orchestra.run.smithi057.stdout:/proc/sys/fs/binfmt_misc 2024-03-27T10:00:16.569 INFO:teuthology.orchestra.run.smithi057.stdout:/dev/hugepages 2024-03-27T10:00:16.569 INFO:teuthology.orchestra.run.smithi057.stdout:/dev/mqueue 2024-03-27T10:00:16.569 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/kernel/debug 2024-03-27T10:00:16.569 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/kernel/tracing 2024-03-27T10:00:16.569 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/fuse/connections 2024-03-27T10:00:16.569 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/kernel/config 2024-03-27T10:00:16.569 INFO:teuthology.orchestra.run.smithi057.stdout:/run/credentials/systemd-sysctl.service 2024-03-27T10:00:16.570 INFO:teuthology.orchestra.run.smithi057.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-27T10:00:16.570 INFO:teuthology.orchestra.run.smithi057.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-27T10:00:16.570 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/nfs/rpc_pipefs 2024-03-27T10:00:16.570 INFO:teuthology.orchestra.run.smithi057.stdout:/run/user/1000 2024-03-27T10:00:16.570 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/ceph 2024-03-27T10:00:16.570 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/ceph/osd/ceph-0 2024-03-27T10:00:16.570 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/ceph/osd/ceph-1 2024-03-27T10:00:16.570 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/ceph/osd/ceph-2 2024-03-27T10:00:16.570 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/ceph/osd/ceph-3 2024-03-27T10:00:16.570 INFO:teuthology.orchestra.run.smithi057.stdout:/run/netns 2024-03-27T10:00:16.570 INFO:teuthology.orchestra.run.smithi057.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-27T10:00:16.570 INFO:teuthology.orchestra.run.smithi057.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-27T10:00:16.570 INFO:teuthology.orchestra.run.smithi057.stdout:/home/ubuntu/cephtest/mnt.0 2024-03-27T10:00:16.571 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T10:00:16.571 DEBUG:teuthology.orchestra.run.smithi057:> ls /sys/fs/fuse/connections 2024-03-27T10:00:16.623 INFO:teuthology.orchestra.run.smithi057.stdout:42 2024-03-27T10:00:16.623 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2024-03-27T10:00:16.624 DEBUG:teuthology.orchestra.run.smithi057:> sudo stdin-killer -- python3 -c ' 2024-03-27T10:00:16.624 DEBUG:teuthology.orchestra.run.smithi057:> import glob 2024-03-27T10:00:16.624 DEBUG:teuthology.orchestra.run.smithi057:> import re 2024-03-27T10:00:16.624 DEBUG:teuthology.orchestra.run.smithi057:> import os 2024-03-27T10:00:16.624 DEBUG:teuthology.orchestra.run.smithi057:> import subprocess 2024-03-27T10:00:16.624 DEBUG:teuthology.orchestra.run.smithi057:> 2024-03-27T10:00:16.624 DEBUG:teuthology.orchestra.run.smithi057:> def _find_admin_socket(client_name): 2024-03-27T10:00:16.624 DEBUG:teuthology.orchestra.run.smithi057:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-03-27T10:00:16.624 DEBUG:teuthology.orchestra.run.smithi057:> files = glob.glob(asok_path) 2024-03-27T10:00:16.624 DEBUG:teuthology.orchestra.run.smithi057:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-03-27T10:00:16.624 DEBUG:teuthology.orchestra.run.smithi057:> 2024-03-27T10:00:16.624 DEBUG:teuthology.orchestra.run.smithi057:> # Given a non-glob path, it better be there 2024-03-27T10:00:16.624 DEBUG:teuthology.orchestra.run.smithi057:> if "*" not in asok_path: 2024-03-27T10:00:16.625 DEBUG:teuthology.orchestra.run.smithi057:> assert(len(files) == 1) 2024-03-27T10:00:16.625 DEBUG:teuthology.orchestra.run.smithi057:> return files[0] 2024-03-27T10:00:16.625 DEBUG:teuthology.orchestra.run.smithi057:> 2024-03-27T10:00:16.625 DEBUG:teuthology.orchestra.run.smithi057:> for f in files: 2024-03-27T10:00:16.625 DEBUG:teuthology.orchestra.run.smithi057:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-03-27T10:00:16.625 DEBUG:teuthology.orchestra.run.smithi057:> if os.path.exists("/proc/{0}".format(pid)): 2024-03-27T10:00:16.625 DEBUG:teuthology.orchestra.run.smithi057:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-03-27T10:00:16.625 DEBUG:teuthology.orchestra.run.smithi057:> contents = proc_f.read() 2024-03-27T10:00:16.625 DEBUG:teuthology.orchestra.run.smithi057:> if mountpoint in contents: 2024-03-27T10:00:16.625 DEBUG:teuthology.orchestra.run.smithi057:> return f 2024-03-27T10:00:16.625 DEBUG:teuthology.orchestra.run.smithi057:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-03-27T10:00:16.625 DEBUG:teuthology.orchestra.run.smithi057:> 2024-03-27T10:00:16.625 DEBUG:teuthology.orchestra.run.smithi057:> print(_find_admin_socket("client.0")) 2024-03-27T10:00:16.625 DEBUG:teuthology.orchestra.run.smithi057:> ' 2024-03-27T10:00:16.808 INFO:teuthology.orchestra.run.smithi057.stdout:/var/run/ceph/ceph-client.0.47369.asok 2024-03-27T10:00:16.813 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-27T10:00:16.827 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.47369.asok 2024-03-27T10:00:16.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T10:00:16.828 DEBUG:teuthology.orchestra.run.smithi057:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.47369.asok status 2024-03-27T10:00:17.076 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-03-27T10:00:17.076 INFO:teuthology.orchestra.run.smithi057.stdout: "metadata": { 2024-03-27T10:00:17.076 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph_sha1": "155268c4e432a12433aa833f174f9fe3b1016ae0", 2024-03-27T10:00:17.076 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph_version": "ceph version 19.0.0-2478-g155268c4 (155268c4e432a12433aa833f174f9fe3b1016ae0) squid (dev)", 2024-03-27T10:00:17.076 INFO:teuthology.orchestra.run.smithi057.stdout: "entity_id": "0", 2024-03-27T10:00:17.076 INFO:teuthology.orchestra.run.smithi057.stdout: "hostname": "smithi057", 2024-03-27T10:00:17.076 INFO:teuthology.orchestra.run.smithi057.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-03-27T10:00:17.076 INFO:teuthology.orchestra.run.smithi057.stdout: "pid": "47369", 2024-03-27T10:00:17.076 INFO:teuthology.orchestra.run.smithi057.stdout: "root": "/" 2024-03-27T10:00:17.077 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-03-27T10:00:17.077 INFO:teuthology.orchestra.run.smithi057.stdout: "dentry_count": 0, 2024-03-27T10:00:17.077 INFO:teuthology.orchestra.run.smithi057.stdout: "dentry_pinned_count": 0, 2024-03-27T10:00:17.077 INFO:teuthology.orchestra.run.smithi057.stdout: "id": 4857, 2024-03-27T10:00:17.077 INFO:teuthology.orchestra.run.smithi057.stdout: "inst": { 2024-03-27T10:00:17.077 INFO:teuthology.orchestra.run.smithi057.stdout: "name": { 2024-03-27T10:00:17.077 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "client", 2024-03-27T10:00:17.077 INFO:teuthology.orchestra.run.smithi057.stdout: "num": 4857 2024-03-27T10:00:17.077 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-03-27T10:00:17.077 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": { 2024-03-27T10:00:17.077 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-03-27T10:00:17.077 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "192.168.0.1:0", 2024-03-27T10:00:17.077 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 1778726928 2024-03-27T10:00:17.077 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-03-27T10:00:17.077 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-03-27T10:00:17.077 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": { 2024-03-27T10:00:17.078 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-03-27T10:00:17.078 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "192.168.0.1:0", 2024-03-27T10:00:17.078 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 1778726928 2024-03-27T10:00:17.078 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-03-27T10:00:17.078 INFO:teuthology.orchestra.run.smithi057.stdout: "inst_str": "client.4857 192.168.0.1:0/1778726928", 2024-03-27T10:00:17.078 INFO:teuthology.orchestra.run.smithi057.stdout: "addr_str": "192.168.0.1:0/1778726928", 2024-03-27T10:00:17.078 INFO:teuthology.orchestra.run.smithi057.stdout: "inode_count": 1, 2024-03-27T10:00:17.078 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_epoch": 9, 2024-03-27T10:00:17.078 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_epoch": 28, 2024-03-27T10:00:17.078 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_epoch_barrier": 0, 2024-03-27T10:00:17.078 INFO:teuthology.orchestra.run.smithi057.stdout: "blocklisted": false, 2024-03-27T10:00:17.078 INFO:teuthology.orchestra.run.smithi057.stdout: "fs_name": "cephfs" 2024-03-27T10:00:17.078 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-03-27T10:00:17.092 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-27T10:00:17.312 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:17.322+0000 7ff654000640 1 Processor -- start 2024-03-27T10:00:17.312 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:17.322+0000 7ff654000640 1 -- start start 2024-03-27T10:00:17.313 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:17.324+0000 7ff654000640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff64c0b4d60 0x7ff64c0acd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:17.313 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:17.324+0000 7ff654000640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff64c0ad440 con 0x7ff64c15c0e0 2024-03-27T10:00:17.313 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:17.324+0000 7ff654000640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff64c15c7e0 con 0x7ff64c0aefd0 2024-03-27T10:00:17.314 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:17.324+0000 7ff654000640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7ff64c15d5a0 con 0x7ff64c0b4d60 2024-03-27T10:00:17.314 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:17.324+0000 7ff651600640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7ff64c15c0e0 0x7ff64c0ae8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:60764/0 (socket says 172.21.15.57:60764) 2024-03-27T10:00:17.314 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:17.324+0000 7ff651600640 1 -- 172.21.15.57:0/1891102056 learned_addr learned my addr 172.21.15.57:0/1891102056 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T10:00:17.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:17.324+0000 7ff650c00640 1 --2- 172.21.15.57:0/1891102056 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff64c0b4d60 0x7ff64c0acd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:17.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:17.325+0000 7ff64be00640 1 -- 172.21.15.57:0/1891102056 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1502479182 0 0) 0x7ff64c0ad440 con 0x7ff64c15c0e0 2024-03-27T10:00:17.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:17.325+0000 7ff64be00640 1 -- 172.21.15.57:0/1891102056 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff634003520 con 0x7ff64c15c0e0 2024-03-27T10:00:17.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:17.325+0000 7ff64be00640 1 -- 172.21.15.57:0/1891102056 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 559724616 0 0) 0x7ff64c15c7e0 con 0x7ff64c0aefd0 2024-03-27T10:00:17.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:17.325+0000 7ff64be00640 1 -- 172.21.15.57:0/1891102056 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff64c0ad440 con 0x7ff64c0aefd0 2024-03-27T10:00:17.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:17.325+0000 7ff64be00640 1 -- 172.21.15.57:0/1891102056 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2907163941 0 0) 0x7ff634003520 con 0x7ff64c15c0e0 2024-03-27T10:00:17.317 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:17.325+0000 7ff64be00640 1 -- 172.21.15.57:0/1891102056 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff64c0b4d60 msgr2=0x7ff64c0acd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:17.317 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:17.325+0000 7ff64be00640 1 --2- 172.21.15.57:0/1891102056 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff64c0b4d60 0x7ff64c0acd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:17.317 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:17.325+0000 7ff64be00640 1 -- 172.21.15.57:0/1891102056 >> v1:172.21.15.118:6789/0 conn(0x7ff64c0aefd0 legacy=0x7ff64c0b3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:17.317 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:17.325+0000 7ff64be00640 1 -- 172.21.15.57:0/1891102056 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff64c15cac0 con 0x7ff64c15c0e0 2024-03-27T10:00:17.317 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:17.325+0000 7ff64be00640 1 -- 172.21.15.57:0/1891102056 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4227751516 0 0) 0x7ff640001670 con 0x7ff64c15c0e0 2024-03-27T10:00:17.317 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:17.325+0000 7ff64be00640 1 -- 172.21.15.57:0/1891102056 >> v1:172.21.15.57:6789/0 conn(0x7ff64c15c0e0 legacy=0x7ff64c0ae8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:17.317 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:17.325+0000 7ff64be00640 1 --2- 172.21.15.57:0/1891102056 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff634003b70 0x7ff634003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:17.317 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:17.325+0000 7ff64be00640 1 --2- 172.21.15.57:0/1891102056 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff634004800 0x7ff634004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:17.317 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:17.325+0000 7ff64be00640 1 --2- 172.21.15.57:0/1891102056 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff64c0b4d60 0x7ff634005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:17.317 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:17.325+0000 7ff64be00640 1 -- 172.21.15.57:0/1891102056 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7ff64c15d5a0 con 0x7ff634003b70 2024-03-27T10:00:17.317 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:17.325+0000 7ff64be00640 1 -- 172.21.15.57:0/1891102056 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7ff63400bb50 con 0x7ff634004800 2024-03-27T10:00:17.317 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:17.325+0000 7ff64be00640 1 -- 172.21.15.57:0/1891102056 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7ff63400bd20 con 0x7ff64c0b4d60 2024-03-27T10:00:17.317 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:17.326+0000 7ff651600640 1 --2- 172.21.15.57:0/1891102056 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff634003b70 0x7ff634003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:17.317 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:17.326+0000 7ff650c00640 1 --2- 172.21.15.57:0/1891102056 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff634004800 0x7ff634004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:17.318 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:17.326+0000 7ff652000640 1 --2- 172.21.15.57:0/1891102056 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff64c0b4d60 0x7ff634005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:17.318 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:17.326+0000 7ff651600640 1 -- 172.21.15.57:0/1891102056 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff64c0b4d60 msgr2=0x7ff634005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:17.318 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:17.326+0000 7ff651600640 1 --2- 172.21.15.57:0/1891102056 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff64c0b4d60 0x7ff634005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:17.318 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:17.326+0000 7ff651600640 1 -- 172.21.15.57:0/1891102056 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff634004800 msgr2=0x7ff634004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:17.318 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:17.326+0000 7ff651600640 1 --2- 172.21.15.57:0/1891102056 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff634004800 0x7ff634004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:17.318 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:17.326+0000 7ff651600640 1 -- 172.21.15.57:0/1891102056 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff634003520 con 0x7ff634003b70 2024-03-27T10:00:17.318 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:17.326+0000 7ff652000640 1 --2- 172.21.15.57:0/1891102056 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff64c0b4d60 0x7ff634005220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T10:00:17.319 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:17.327+0000 7ff651600640 1 --2- 172.21.15.57:0/1891102056 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff634003b70 0x7ff634003f70 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff64000c110 tx=0x7ff634005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55880c7857b6a2aa server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:17.319 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:17.328+0000 7ff64be00640 1 -- 172.21.15.57:0/1891102056 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff640007c40 con 0x7ff634003b70 2024-03-27T10:00:17.319 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:17.328+0000 7ff64be00640 1 -- 172.21.15.57:0/1891102056 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff640030070 con 0x7ff634003b70 2024-03-27T10:00:17.319 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:17.328+0000 7ff64be00640 1 -- 172.21.15.57:0/1891102056 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff640005d50 con 0x7ff634003b70 2024-03-27T10:00:17.319 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:17.328+0000 7ff654000640 1 -- 172.21.15.57:0/1891102056 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff634003b70 msgr2=0x7ff634003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:17.320 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:17.328+0000 7ff654000640 1 --2- 172.21.15.57:0/1891102056 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff634003b70 0x7ff634003f70 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff64000c110 tx=0x7ff634005830 comp rx=0 tx=0).stop 2024-03-27T10:00:17.320 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:17.328+0000 7ff652000640 1 -- 172.21.15.57:0/1891102056 reap_dead start 2024-03-27T10:00:17.320 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:17.328+0000 7ff654000640 1 -- 172.21.15.57:0/1891102056 shutdown_connections 2024-03-27T10:00:17.320 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:17.328+0000 7ff654000640 1 -- 172.21.15.57:0/1891102056 >> 172.21.15.57:0/1891102056 conn(0x7ff64c06bb70 msgr2=0x7ff64c0b1980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:17.320 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:17.328+0000 7ff654000640 1 -- 172.21.15.57:0/1891102056 shutdown_connections 2024-03-27T10:00:17.320 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:17.328+0000 7ff654000640 1 -- 172.21.15.57:0/1891102056 wait complete. 2024-03-27T10:00:17.322 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:17.330+0000 7ff654000640 1 Processor -- start 2024-03-27T10:00:17.322 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:17.330+0000 7ff654000640 1 -- start start 2024-03-27T10:00:17.322 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:17.331+0000 7ff654000640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff634003b70 0x7ff64c15a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:17.322 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:17.331+0000 7ff654000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff64c09b730 0x7ff64c1547e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:17.322 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:17.331+0000 7ff654000640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff64c154d20 0x7ff64c1f7b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:17.322 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:17.331+0000 7ff654000640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7ff64c15c4c0 con 0x7ff634003b70 2024-03-27T10:00:17.322 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:17.331+0000 7ff654000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7ff64c15d080 con 0x7ff64c09b730 2024-03-27T10:00:17.322 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:17.331+0000 7ff654000640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7ff64c0acd60 con 0x7ff64c154d20 2024-03-27T10:00:17.322 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:17.332+0000 7ff651600640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff634003b70 0x7ff64c15a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:17.322 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:17.332+0000 7ff651600640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff634003b70 0x7ff64c15a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38830/0 (socket says 172.21.15.57:38830) 2024-03-27T10:00:17.323 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:17.332+0000 7ff651600640 1 -- 172.21.15.57:0/82318456 learned_addr learned my addr 172.21.15.57:0/82318456 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:17.323 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:17.332+0000 7ff650c00640 1 --2- 172.21.15.57:0/82318456 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff64c09b730 0x7ff64c1547e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:17.323 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:17.332+0000 7ff652000640 1 --2- 172.21.15.57:0/82318456 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff64c154d20 0x7ff64c1f7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:17.323 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:17.332+0000 7ff651600640 1 -- 172.21.15.57:0/82318456 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff64c154d20 msgr2=0x7ff64c1f7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:17.323 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:17.332+0000 7ff651600640 1 --2- 172.21.15.57:0/82318456 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff64c154d20 0x7ff64c1f7b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:17.323 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:17.332+0000 7ff651600640 1 -- 172.21.15.57:0/82318456 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff64c09b730 msgr2=0x7ff64c1547e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:17.323 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:17.332+0000 7ff651600640 1 --2- 172.21.15.57:0/82318456 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff64c09b730 0x7ff64c1547e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:17.323 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:17.332+0000 7ff651600640 1 -- 172.21.15.57:0/82318456 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff64c152800 con 0x7ff634003b70 2024-03-27T10:00:17.323 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:17.332+0000 7ff651600640 1 --2- 172.21.15.57:0/82318456 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff634003b70 0x7ff64c15a8c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff64000c230 tx=0x7ff640001970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:17.324 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:17.333+0000 7ff649600640 1 -- 172.21.15.57:0/82318456 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff640045070 con 0x7ff634003b70 2024-03-27T10:00:17.324 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:17.333+0000 7ff649600640 1 -- 172.21.15.57:0/82318456 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff640004bf0 con 0x7ff634003b70 2024-03-27T10:00:17.324 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:17.333+0000 7ff649600640 1 -- 172.21.15.57:0/82318456 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff640007c40 con 0x7ff634003b70 2024-03-27T10:00:17.324 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:17.333+0000 7ff654000640 1 -- 172.21.15.57:0/82318456 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff64c152240 con 0x7ff634003b70 2024-03-27T10:00:17.324 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:17.333+0000 7ff654000640 1 -- 172.21.15.57:0/82318456 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff64c0ce300 con 0x7ff634003b70 2024-03-27T10:00:17.324 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:17.334+0000 7ff654000640 1 -- 172.21.15.57:0/82318456 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff64c068540 con 0x7ff634003b70 2024-03-27T10:00:17.325 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:17.335+0000 7ff649600640 1 -- 172.21.15.57:0/82318456 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7ff640007070 con 0x7ff634003b70 2024-03-27T10:00:17.325 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:17.336+0000 7ff649600640 1 --2- 172.21.15.57:0/82318456 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7ff62c06c560 0x7ff62c06ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:17.326 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:17.336+0000 7ff649600640 1 -- 172.21.15.57:0/82318456 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7ff6400aca40 con 0x7ff634003b70 2024-03-27T10:00:17.326 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:17.336+0000 7ff650c00640 1 --2- 172.21.15.57:0/82318456 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7ff62c06c560 0x7ff62c06ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:17.326 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:17.337+0000 7ff650c00640 1 --2- 172.21.15.57:0/82318456 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7ff62c06c560 0x7ff62c06ea20 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff64c15b840 tx=0x7ff638008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:17.330 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:17.341+0000 7ff649600640 1 -- 172.21.15.57:0/82318456 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7ff64007a680 con 0x7ff634003b70 2024-03-27T10:00:17.575 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:17.585+0000 7ff654000640 1 -- 172.21.15.57:0/82318456 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7ff64c06e2c0 con 0x7ff634003b70 2024-03-27T10:00:17.575 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:17.586+0000 7ff649600640 1 -- 172.21.15.57:0/82318456 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7ff64007e980 con 0x7ff634003b70 2024-03-27T10:00:17.576 INFO:teuthology.orchestra.run.smithi057.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-03-27T10:00:17.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:17.588+0000 7ff654000640 1 -- 172.21.15.57:0/82318456 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7ff62c06c560 msgr2=0x7ff62c06ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:17.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:17.588+0000 7ff654000640 1 --2- 172.21.15.57:0/82318456 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7ff62c06c560 0x7ff62c06ea20 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff64c15b840 tx=0x7ff638008040 comp rx=0 tx=0).stop 2024-03-27T10:00:17.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:17.588+0000 7ff654000640 1 -- 172.21.15.57:0/82318456 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff634003b70 msgr2=0x7ff64c15a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:17.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:17.588+0000 7ff654000640 1 --2- 172.21.15.57:0/82318456 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff634003b70 0x7ff64c15a8c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff64000c230 tx=0x7ff640001970 comp rx=0 tx=0).stop 2024-03-27T10:00:17.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:17.589+0000 7ff654000640 1 -- 172.21.15.57:0/82318456 shutdown_connections 2024-03-27T10:00:17.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:17.589+0000 7ff654000640 1 --2- 172.21.15.57:0/82318456 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff64c154d20 0x7ff64c1f7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:17.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:17.589+0000 7ff654000640 1 --2- 172.21.15.57:0/82318456 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7ff62c06c560 0x7ff62c06ea20 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:17.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:17.589+0000 7ff654000640 1 --2- 172.21.15.57:0/82318456 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff64c09b730 0x7ff64c1547e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:17.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:17.589+0000 7ff654000640 1 --2- 172.21.15.57:0/82318456 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff634003b70 0x7ff64c15a8c0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:17.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:17.589+0000 7ff654000640 1 -- 172.21.15.57:0/82318456 >> 172.21.15.57:0/82318456 conn(0x7ff64c06bb70 msgr2=0x7ff64c151980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:17.580 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:17.589+0000 7ff654000640 1 -- 172.21.15.57:0/82318456 shutdown_connections 2024-03-27T10:00:17.580 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:17.589+0000 7ff654000640 1 -- 172.21.15.57:0/82318456 wait complete. 2024-03-27T10:00:17.598 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-27T10:00:17.598 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-27T10:00:17.599 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi057.front.sepia.ceph.com 2024-03-27T10:00:17.599 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-03-27T10:00:17.599 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-03-27T10:00:17.599 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-27T10:00:17.599 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-27T10:00:17.599 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-27T10:00:17.599 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-03-27T10:00:17.599 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T10:00:17.599 DEBUG:teuthology.orchestra.run.smithi057:> ip addr 2024-03-27T10:00:17.652 INFO:teuthology.orchestra.run.smithi057.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-27T10:00:17.652 INFO:teuthology.orchestra.run.smithi057.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-27T10:00:17.653 INFO:teuthology.orchestra.run.smithi057.stdout: inet 127.0.0.1/8 scope host lo 2024-03-27T10:00:17.653 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2024-03-27T10:00:17.653 INFO:teuthology.orchestra.run.smithi057.stdout: inet6 ::1/128 scope host 2024-03-27T10:00:17.653 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2024-03-27T10:00:17.653 INFO:teuthology.orchestra.run.smithi057.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-27T10:00:17.653 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 0c:c4:7a:6b:ff:86 brd ff:ff:ff:ff:ff:ff 2024-03-27T10:00:17.654 INFO:teuthology.orchestra.run.smithi057.stdout: altname enp7s0f0 2024-03-27T10:00:17.654 INFO:teuthology.orchestra.run.smithi057.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-27T10:00:17.654 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 0c:c4:7a:6b:ff:87 brd ff:ff:ff:ff:ff:ff 2024-03-27T10:00:17.654 INFO:teuthology.orchestra.run.smithi057.stdout: altname enp7s0f1 2024-03-27T10:00:17.654 INFO:teuthology.orchestra.run.smithi057.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-27T10:00:17.655 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 0c:c4:7a:bd:15:62 brd ff:ff:ff:ff:ff:ff 2024-03-27T10:00:17.655 INFO:teuthology.orchestra.run.smithi057.stdout: altname enp1s0f0 2024-03-27T10:00:17.655 INFO:teuthology.orchestra.run.smithi057.stdout: inet 172.21.15.57/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-03-27T10:00:17.655 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft 42510sec preferred_lft 42510sec 2024-03-27T10:00:17.655 INFO:teuthology.orchestra.run.smithi057.stdout: inet6 fe80::ec4:7aff:febd:1562/64 scope link noprefixroute 2024-03-27T10:00:17.655 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2024-03-27T10:00:17.656 INFO:teuthology.orchestra.run.smithi057.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-27T10:00:17.656 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 0c:c4:7a:bd:15:63 brd ff:ff:ff:ff:ff:ff 2024-03-27T10:00:17.656 INFO:teuthology.orchestra.run.smithi057.stdout: altname enp1s0f1 2024-03-27T10:00:17.656 INFO:teuthology.orchestra.run.smithi057.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-27T10:00:17.656 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 36:b4:3c:bc:43:af brd ff:ff:ff:ff:ff:ff 2024-03-27T10:00:17.656 INFO:teuthology.orchestra.run.smithi057.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-03-27T10:00:17.657 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2024-03-27T10:00:17.657 INFO:teuthology.orchestra.run.smithi057.stdout: inet6 fe80::800d:e9ff:feb6:8b3b/64 scope link 2024-03-27T10:00:17.657 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2024-03-27T10:00:17.657 INFO:teuthology.orchestra.run.smithi057.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-27T10:00:17.657 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 36:b4:3c:bc:43:af brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-27T10:00:17.657 INFO:teuthology.orchestra.run.smithi057.stdout: inet6 fe80::34b4:3cff:febc:43af/64 scope link 2024-03-27T10:00:17.658 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2024-03-27T10:00:17.658 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T10:00:17.658 DEBUG:teuthology.orchestra.run.smithi057:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-27T10:00:17.749 INFO:teuthology.orchestra.run.smithi057.stdout:1 2024-03-27T10:00:17.754 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T10:00:17.754 DEBUG:teuthology.orchestra.run.smithi057:> route 2024-03-27T10:00:17.809 INFO:teuthology.orchestra.run.smithi057.stdout:Kernel IP routing table 2024-03-27T10:00:17.810 INFO:teuthology.orchestra.run.smithi057.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-27T10:00:17.810 INFO:teuthology.orchestra.run.smithi057.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-03-27T10:00:17.810 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-03-27T10:00:17.810 INFO:teuthology.orchestra.run.smithi057.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-27T10:00:17.810 DEBUG:teuthology.orchestra.run.smithi057:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-27T10:00:17.810 DEBUG:teuthology.orchestra.run.smithi057:> set -e 2024-03-27T10:00:17.810 DEBUG:teuthology.orchestra.run.smithi057:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-03-27T10:00:17.810 DEBUG:teuthology.orchestra.run.smithi057:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-03-27T10:00:17.810 DEBUG:teuthology.orchestra.run.smithi057:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-03-27T10:00:17.810 DEBUG:teuthology.orchestra.run.smithi057:> ') 2024-03-27T10:00:17.855 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:00:17.865 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:00:17.920 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:17 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-27T10:00:18.048 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-27T10:00:18.058 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T10:00:18.058 DEBUG:teuthology.orchestra.run.smithi057:> ip netns list 2024-03-27T10:00:18.110 INFO:teuthology.orchestra.run.smithi057.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-03-27T10:00:18.111 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T10:00:18.111 DEBUG:teuthology.orchestra.run.smithi057:> ip netns list-id 2024-03-27T10:00:18.164 INFO:teuthology.orchestra.run.smithi057.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-03-27T10:00:18.166 DEBUG:teuthology.orchestra.run.smithi057:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-27T10:00:18.166 DEBUG:teuthology.orchestra.run.smithi057:> set -e 2024-03-27T10:00:18.166 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-27T10:00:18.166 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-03-27T10:00:18.166 DEBUG:teuthology.orchestra.run.smithi057:> ') 2024-03-27T10:00:18.277 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-27T10:00:18.374 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-27T10:00:18.384 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T10:00:18.384 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-03-27T10:00:18.472 INFO:teuthology.orchestra.run.smithi057.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-27T10:00:18.472 INFO:teuthology.orchestra.run.smithi057.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-27T10:00:18.473 INFO:teuthology.orchestra.run.smithi057.stdout: inet 127.0.0.1/8 scope host lo 2024-03-27T10:00:18.473 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2024-03-27T10:00:18.473 INFO:teuthology.orchestra.run.smithi057.stdout: inet6 ::1/128 scope host 2024-03-27T10:00:18.473 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2024-03-27T10:00:18.473 INFO:teuthology.orchestra.run.smithi057.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-27T10:00:18.473 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether de:94:b7:72:ad:38 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-03-27T10:00:18.473 INFO:teuthology.orchestra.run.smithi057.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-03-27T10:00:18.473 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2024-03-27T10:00:18.473 INFO:teuthology.orchestra.run.smithi057.stdout: inet6 fe80::dc94:b7ff:fe72:ad38/64 scope link 2024-03-27T10:00:18.473 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2024-03-27T10:00:18.478 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T10:00:18.478 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-03-27T10:00:18.573 INFO:teuthology.orchestra.run.smithi057.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-27T10:00:18.573 INFO:teuthology.orchestra.run.smithi057.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-27T10:00:18.573 INFO:teuthology.orchestra.run.smithi057.stdout: inet 127.0.0.1/8 scope host lo 2024-03-27T10:00:18.573 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2024-03-27T10:00:18.573 INFO:teuthology.orchestra.run.smithi057.stdout: inet6 ::1/128 scope host 2024-03-27T10:00:18.573 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2024-03-27T10:00:18.573 INFO:teuthology.orchestra.run.smithi057.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-27T10:00:18.573 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether de:94:b7:72:ad:38 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-03-27T10:00:18.573 INFO:teuthology.orchestra.run.smithi057.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-03-27T10:00:18.574 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2024-03-27T10:00:18.574 INFO:teuthology.orchestra.run.smithi057.stdout: inet6 fe80::dc94:b7ff:fe72:ad38/64 scope link 2024-03-27T10:00:18.574 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2024-03-27T10:00:18.578 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-03-27T10:00:18.578 DEBUG:teuthology.orchestra.run.smithi057:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-27T10:00:18.578 DEBUG:teuthology.orchestra.run.smithi057:> set -e 2024-03-27T10:00:18.578 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-03-27T10:00:18.578 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-03-27T10:00:18.579 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-03-27T10:00:18.579 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-03-27T10:00:18.579 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-03-27T10:00:18.579 DEBUG:teuthology.orchestra.run.smithi057:> ') 2024-03-27T10:00:18.686 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-27T10:00:18.900 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-27T10:00:18.910 DEBUG:teuthology.orchestra.run.smithi057:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-27T10:00:18.910 DEBUG:teuthology.orchestra.run.smithi057:> set -e 2024-03-27T10:00:18.910 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip link set brx.1 up 2024-03-27T10:00:18.910 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip link set dev brx.1 master ceph-brx 2024-03-27T10:00:18.910 DEBUG:teuthology.orchestra.run.smithi057:> ') 2024-03-27T10:00:19.017 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-27T10:00:19.139 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-27T10:00:19.148 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2024-03-27T10:00:19.149 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-27T10:00:19.149 DEBUG:teuthology.orchestra.run.smithi057:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-03-27T10:00:19.200 INFO:teuthology.orchestra.run.smithi057.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-03-27T10:00:19.200 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-27T10:00:19.200 DEBUG:teuthology.orchestra.run.smithi057:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-03-27T10:00:19.257 DEBUG:teuthology.orchestra.run.smithi057:> sudo modprobe fuse 2024-03-27T10:00:19.360 DEBUG:teuthology.orchestra.run.smithi057:> cat /proc/self/mounts | awk '{print $2}' 2024-03-27T10:00:19.420 INFO:teuthology.orchestra.run.smithi057.stdout:/proc 2024-03-27T10:00:19.421 INFO:teuthology.orchestra.run.smithi057.stdout:/sys 2024-03-27T10:00:19.421 INFO:teuthology.orchestra.run.smithi057.stdout:/dev 2024-03-27T10:00:19.421 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/kernel/security 2024-03-27T10:00:19.421 INFO:teuthology.orchestra.run.smithi057.stdout:/dev/shm 2024-03-27T10:00:19.421 INFO:teuthology.orchestra.run.smithi057.stdout:/dev/pts 2024-03-27T10:00:19.421 INFO:teuthology.orchestra.run.smithi057.stdout:/run 2024-03-27T10:00:19.421 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/cgroup 2024-03-27T10:00:19.421 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/pstore 2024-03-27T10:00:19.421 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/bpf 2024-03-27T10:00:19.421 INFO:teuthology.orchestra.run.smithi057.stdout:/ 2024-03-27T10:00:19.421 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/selinux 2024-03-27T10:00:19.421 INFO:teuthology.orchestra.run.smithi057.stdout:/proc/sys/fs/binfmt_misc 2024-03-27T10:00:19.421 INFO:teuthology.orchestra.run.smithi057.stdout:/dev/hugepages 2024-03-27T10:00:19.422 INFO:teuthology.orchestra.run.smithi057.stdout:/dev/mqueue 2024-03-27T10:00:19.422 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/kernel/debug 2024-03-27T10:00:19.422 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/kernel/tracing 2024-03-27T10:00:19.422 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/fuse/connections 2024-03-27T10:00:19.422 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/kernel/config 2024-03-27T10:00:19.422 INFO:teuthology.orchestra.run.smithi057.stdout:/run/credentials/systemd-sysctl.service 2024-03-27T10:00:19.422 INFO:teuthology.orchestra.run.smithi057.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-27T10:00:19.422 INFO:teuthology.orchestra.run.smithi057.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-27T10:00:19.422 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/nfs/rpc_pipefs 2024-03-27T10:00:19.422 INFO:teuthology.orchestra.run.smithi057.stdout:/run/user/1000 2024-03-27T10:00:19.422 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/ceph 2024-03-27T10:00:19.422 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/ceph/osd/ceph-0 2024-03-27T10:00:19.422 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/ceph/osd/ceph-1 2024-03-27T10:00:19.422 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/ceph/osd/ceph-2 2024-03-27T10:00:19.423 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/ceph/osd/ceph-3 2024-03-27T10:00:19.423 INFO:teuthology.orchestra.run.smithi057.stdout:/run/netns 2024-03-27T10:00:19.423 INFO:teuthology.orchestra.run.smithi057.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-27T10:00:19.423 INFO:teuthology.orchestra.run.smithi057.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-27T10:00:19.423 INFO:teuthology.orchestra.run.smithi057.stdout:/home/ubuntu/cephtest/mnt.0 2024-03-27T10:00:19.423 INFO:teuthology.orchestra.run.smithi057.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-27T10:00:19.423 INFO:teuthology.orchestra.run.smithi057.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-27T10:00:19.424 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T10:00:19.424 DEBUG:teuthology.orchestra.run.smithi057:> ls /sys/fs/fuse/connections 2024-03-27T10:00:19.480 INFO:teuthology.orchestra.run.smithi057.stdout:42 2024-03-27T10:00:19.481 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [42] 2024-03-27T10:00:19.481 DEBUG:teuthology.orchestra.run.smithi057:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2024-03-27T10:00:19.487 DEBUG:teuthology.orchestra.run.smithi057:> sudo modprobe fuse 2024-03-27T10:00:19.566 DEBUG:teuthology.orchestra.run.smithi057:> cat /proc/self/mounts | awk '{print $2}' 2024-03-27T10:00:19.608 INFO:teuthology.orchestra.run.smithi057.stdout:/proc 2024-03-27T10:00:19.608 INFO:teuthology.orchestra.run.smithi057.stdout:/sys 2024-03-27T10:00:19.608 INFO:teuthology.orchestra.run.smithi057.stdout:/dev 2024-03-27T10:00:19.608 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/kernel/security 2024-03-27T10:00:19.608 INFO:teuthology.orchestra.run.smithi057.stdout:/dev/shm 2024-03-27T10:00:19.608 INFO:teuthology.orchestra.run.smithi057.stdout:/dev/pts 2024-03-27T10:00:19.608 INFO:teuthology.orchestra.run.smithi057.stdout:/run 2024-03-27T10:00:19.609 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/cgroup 2024-03-27T10:00:19.609 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/pstore 2024-03-27T10:00:19.609 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/bpf 2024-03-27T10:00:19.609 INFO:teuthology.orchestra.run.smithi057.stdout:/ 2024-03-27T10:00:19.609 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/selinux 2024-03-27T10:00:19.609 INFO:teuthology.orchestra.run.smithi057.stdout:/proc/sys/fs/binfmt_misc 2024-03-27T10:00:19.609 INFO:teuthology.orchestra.run.smithi057.stdout:/dev/hugepages 2024-03-27T10:00:19.609 INFO:teuthology.orchestra.run.smithi057.stdout:/dev/mqueue 2024-03-27T10:00:19.609 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/kernel/debug 2024-03-27T10:00:19.609 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/kernel/tracing 2024-03-27T10:00:19.609 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/fuse/connections 2024-03-27T10:00:19.609 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/kernel/config 2024-03-27T10:00:19.609 INFO:teuthology.orchestra.run.smithi057.stdout:/run/credentials/systemd-sysctl.service 2024-03-27T10:00:19.609 INFO:teuthology.orchestra.run.smithi057.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-27T10:00:19.609 INFO:teuthology.orchestra.run.smithi057.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-27T10:00:19.610 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/nfs/rpc_pipefs 2024-03-27T10:00:19.610 INFO:teuthology.orchestra.run.smithi057.stdout:/run/user/1000 2024-03-27T10:00:19.610 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/ceph 2024-03-27T10:00:19.610 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/ceph/osd/ceph-0 2024-03-27T10:00:19.610 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/ceph/osd/ceph-1 2024-03-27T10:00:19.610 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/ceph/osd/ceph-2 2024-03-27T10:00:19.610 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/ceph/osd/ceph-3 2024-03-27T10:00:19.610 INFO:teuthology.orchestra.run.smithi057.stdout:/run/netns 2024-03-27T10:00:19.610 INFO:teuthology.orchestra.run.smithi057.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-27T10:00:19.610 INFO:teuthology.orchestra.run.smithi057.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-27T10:00:19.610 INFO:teuthology.orchestra.run.smithi057.stdout:/home/ubuntu/cephtest/mnt.0 2024-03-27T10:00:19.610 INFO:teuthology.orchestra.run.smithi057.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-27T10:00:19.610 INFO:teuthology.orchestra.run.smithi057.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-27T10:00:19.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T10:00:19.611 DEBUG:teuthology.orchestra.run.smithi057:> ls /sys/fs/fuse/connections 2024-03-27T10:00:19.678 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi057.stderr:2024-03-27T10:00:19.688+0000 7fc36d641480 -1 init, newargv = 0x558361ef8330 newargc=15 2024-03-27T10:00:19.678 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi057.stderr:ceph-fuse[47954]: starting ceph client 2024-03-27T10:00:19.689 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi057.stderr:ceph-fuse[47954]: starting fuse 2024-03-27T10:00:19.698 INFO:teuthology.orchestra.run.smithi057.stdout:42 2024-03-27T10:00:19.698 INFO:teuthology.orchestra.run.smithi057.stdout:43 2024-03-27T10:00:19.699 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42, 43] 2024-03-27T10:00:19.699 DEBUG:teuthology.orchestra.run.smithi057:> sudo stdin-killer -- python3 -c ' 2024-03-27T10:00:19.699 DEBUG:teuthology.orchestra.run.smithi057:> import glob 2024-03-27T10:00:19.699 DEBUG:teuthology.orchestra.run.smithi057:> import re 2024-03-27T10:00:19.699 DEBUG:teuthology.orchestra.run.smithi057:> import os 2024-03-27T10:00:19.699 DEBUG:teuthology.orchestra.run.smithi057:> import subprocess 2024-03-27T10:00:19.699 DEBUG:teuthology.orchestra.run.smithi057:> 2024-03-27T10:00:19.699 DEBUG:teuthology.orchestra.run.smithi057:> def _find_admin_socket(client_name): 2024-03-27T10:00:19.699 DEBUG:teuthology.orchestra.run.smithi057:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2024-03-27T10:00:19.699 DEBUG:teuthology.orchestra.run.smithi057:> files = glob.glob(asok_path) 2024-03-27T10:00:19.699 DEBUG:teuthology.orchestra.run.smithi057:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2024-03-27T10:00:19.699 DEBUG:teuthology.orchestra.run.smithi057:> 2024-03-27T10:00:19.699 DEBUG:teuthology.orchestra.run.smithi057:> # Given a non-glob path, it better be there 2024-03-27T10:00:19.699 DEBUG:teuthology.orchestra.run.smithi057:> if "*" not in asok_path: 2024-03-27T10:00:19.700 DEBUG:teuthology.orchestra.run.smithi057:> assert(len(files) == 1) 2024-03-27T10:00:19.700 DEBUG:teuthology.orchestra.run.smithi057:> return files[0] 2024-03-27T10:00:19.700 DEBUG:teuthology.orchestra.run.smithi057:> 2024-03-27T10:00:19.700 DEBUG:teuthology.orchestra.run.smithi057:> for f in files: 2024-03-27T10:00:19.700 DEBUG:teuthology.orchestra.run.smithi057:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-03-27T10:00:19.700 DEBUG:teuthology.orchestra.run.smithi057:> if os.path.exists("/proc/{0}".format(pid)): 2024-03-27T10:00:19.700 DEBUG:teuthology.orchestra.run.smithi057:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-03-27T10:00:19.700 DEBUG:teuthology.orchestra.run.smithi057:> contents = proc_f.read() 2024-03-27T10:00:19.700 DEBUG:teuthology.orchestra.run.smithi057:> if mountpoint in contents: 2024-03-27T10:00:19.700 DEBUG:teuthology.orchestra.run.smithi057:> return f 2024-03-27T10:00:19.700 DEBUG:teuthology.orchestra.run.smithi057:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-03-27T10:00:19.700 DEBUG:teuthology.orchestra.run.smithi057:> 2024-03-27T10:00:19.700 DEBUG:teuthology.orchestra.run.smithi057:> print(_find_admin_socket("client.2")) 2024-03-27T10:00:19.700 DEBUG:teuthology.orchestra.run.smithi057:> ' 2024-03-27T10:00:19.915 INFO:teuthology.orchestra.run.smithi057.stdout:/var/run/ceph/ceph-client.2.47954.asok 2024-03-27T10:00:19.920 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-27T10:00:19.934 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.47954.asok 2024-03-27T10:00:19.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T10:00:19.935 DEBUG:teuthology.orchestra.run.smithi057:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.47954.asok status 2024-03-27T10:00:20.179 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-03-27T10:00:20.179 INFO:teuthology.orchestra.run.smithi057.stdout: "metadata": { 2024-03-27T10:00:20.179 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph_sha1": "155268c4e432a12433aa833f174f9fe3b1016ae0", 2024-03-27T10:00:20.179 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph_version": "ceph version 19.0.0-2478-g155268c4 (155268c4e432a12433aa833f174f9fe3b1016ae0) squid (dev)", 2024-03-27T10:00:20.179 INFO:teuthology.orchestra.run.smithi057.stdout: "entity_id": "2", 2024-03-27T10:00:20.179 INFO:teuthology.orchestra.run.smithi057.stdout: "hostname": "smithi057", 2024-03-27T10:00:20.179 INFO:teuthology.orchestra.run.smithi057.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2024-03-27T10:00:20.179 INFO:teuthology.orchestra.run.smithi057.stdout: "pid": "47954", 2024-03-27T10:00:20.179 INFO:teuthology.orchestra.run.smithi057.stdout: "root": "/" 2024-03-27T10:00:20.180 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-03-27T10:00:20.180 INFO:teuthology.orchestra.run.smithi057.stdout: "dentry_count": 0, 2024-03-27T10:00:20.180 INFO:teuthology.orchestra.run.smithi057.stdout: "dentry_pinned_count": 0, 2024-03-27T10:00:20.180 INFO:teuthology.orchestra.run.smithi057.stdout: "id": 4869, 2024-03-27T10:00:20.180 INFO:teuthology.orchestra.run.smithi057.stdout: "inst": { 2024-03-27T10:00:20.180 INFO:teuthology.orchestra.run.smithi057.stdout: "name": { 2024-03-27T10:00:20.180 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "client", 2024-03-27T10:00:20.180 INFO:teuthology.orchestra.run.smithi057.stdout: "num": 4869 2024-03-27T10:00:20.180 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-03-27T10:00:20.180 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": { 2024-03-27T10:00:20.180 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-03-27T10:00:20.180 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "192.168.0.2:0", 2024-03-27T10:00:20.180 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 358597233 2024-03-27T10:00:20.180 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-03-27T10:00:20.180 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-03-27T10:00:20.181 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": { 2024-03-27T10:00:20.181 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-03-27T10:00:20.181 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "192.168.0.2:0", 2024-03-27T10:00:20.181 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 358597233 2024-03-27T10:00:20.181 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-03-27T10:00:20.181 INFO:teuthology.orchestra.run.smithi057.stdout: "inst_str": "client.4869 192.168.0.2:0/358597233", 2024-03-27T10:00:20.181 INFO:teuthology.orchestra.run.smithi057.stdout: "addr_str": "192.168.0.2:0/358597233", 2024-03-27T10:00:20.181 INFO:teuthology.orchestra.run.smithi057.stdout: "inode_count": 1, 2024-03-27T10:00:20.181 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_epoch": 9, 2024-03-27T10:00:20.181 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_epoch": 28, 2024-03-27T10:00:20.181 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_epoch_barrier": 0, 2024-03-27T10:00:20.181 INFO:teuthology.orchestra.run.smithi057.stdout: "blocklisted": false, 2024-03-27T10:00:20.181 INFO:teuthology.orchestra.run.smithi057.stdout: "fs_name": "cephfs" 2024-03-27T10:00:20.181 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-03-27T10:00:20.194 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-27T10:00:20.417 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:20.427+0000 7fd54be00640 1 Processor -- start 2024-03-27T10:00:20.417 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:20.428+0000 7fd54be00640 1 -- start start 2024-03-27T10:00:20.419 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:20.429+0000 7fd54be00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd54c0d0690 0x7fd54c168cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:20.419 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:20.429+0000 7fd54be00640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd54c0adab0 con 0x7fd54c1615c0 2024-03-27T10:00:20.419 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:20.429+0000 7fd54be00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd54c0add90 con 0x7fd54c06db20 2024-03-27T10:00:20.420 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:20.429+0000 7fd54be00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fd54c0ae3e0 con 0x7fd54c0d0690 2024-03-27T10:00:20.420 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:20.430+0000 7fd54aa00640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fd54c1615c0 0x7fd54c0b4590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:60770/0 (socket says 172.21.15.57:60770) 2024-03-27T10:00:20.420 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:20.430+0000 7fd54aa00640 1 -- 172.21.15.57:0/2086666578 learned_addr learned my addr 172.21.15.57:0/2086666578 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T10:00:20.420 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:20.430+0000 7fd54b400640 1 --2- 172.21.15.57:0/2086666578 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd54c0d0690 0x7fd54c168cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:20.422 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:20.430+0000 7fd54a000640 1 -- 172.21.15.57:0/2086666578 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4265712703 0 0) 0x7fd54c0adab0 con 0x7fd54c1615c0 2024-03-27T10:00:20.422 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:20.430+0000 7fd54a000640 1 -- 172.21.15.57:0/2086666578 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd530003520 con 0x7fd54c1615c0 2024-03-27T10:00:20.422 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:20.431+0000 7fd54a000640 1 -- 172.21.15.57:0/2086666578 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2484730796 0 0) 0x7fd54c0add90 con 0x7fd54c06db20 2024-03-27T10:00:20.422 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:20.431+0000 7fd54a000640 1 -- 172.21.15.57:0/2086666578 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd54c0adab0 con 0x7fd54c06db20 2024-03-27T10:00:20.422 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:20.431+0000 7fd54a000640 1 -- 172.21.15.57:0/2086666578 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4036302285 0 0) 0x7fd530003520 con 0x7fd54c1615c0 2024-03-27T10:00:20.422 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:20.431+0000 7fd54a000640 1 -- 172.21.15.57:0/2086666578 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd54c0d0690 msgr2=0x7fd54c168cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:20.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:20.431+0000 7fd54a000640 1 --2- 172.21.15.57:0/2086666578 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd54c0d0690 0x7fd54c168cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:20.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:20.431+0000 7fd54a000640 1 -- 172.21.15.57:0/2086666578 >> v1:172.21.15.118:6789/0 conn(0x7fd54c06db20 legacy=0x7fd54c0cff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:20.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:20.431+0000 7fd54a000640 1 -- 172.21.15.57:0/2086666578 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd54c0ae070 con 0x7fd54c1615c0 2024-03-27T10:00:20.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:20.431+0000 7fd54a000640 1 -- 172.21.15.57:0/2086666578 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4227751516 0 0) 0x7fd53c001670 con 0x7fd54c1615c0 2024-03-27T10:00:20.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:20.431+0000 7fd54a000640 1 -- 172.21.15.57:0/2086666578 >> v1:172.21.15.57:6789/0 conn(0x7fd54c1615c0 legacy=0x7fd54c0b4590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:20.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:20.431+0000 7fd54a000640 1 --2- 172.21.15.57:0/2086666578 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd530003b70 0x7fd530003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:20.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:20.431+0000 7fd54a000640 1 --2- 172.21.15.57:0/2086666578 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd530004800 0x7fd530004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:20.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:20.431+0000 7fd54a000640 1 --2- 172.21.15.57:0/2086666578 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd54c0d0690 0x7fd5300051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:20.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:20.431+0000 7fd54a000640 1 -- 172.21.15.57:0/2086666578 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fd54c0ae3e0 con 0x7fd530004800 2024-03-27T10:00:20.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:20.431+0000 7fd54a000640 1 -- 172.21.15.57:0/2086666578 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fd53000baa0 con 0x7fd530003b70 2024-03-27T10:00:20.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:20.431+0000 7fd54a000640 1 -- 172.21.15.57:0/2086666578 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fd53000bca0 con 0x7fd54c0d0690 2024-03-27T10:00:20.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:20.431+0000 7fd542000640 1 --2- 172.21.15.57:0/2086666578 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd530004800 0x7fd530004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:20.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:20.432+0000 7fd54aa00640 1 --2- 172.21.15.57:0/2086666578 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd530003b70 0x7fd530003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:20.424 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:20.432+0000 7fd54b400640 1 --2- 172.21.15.57:0/2086666578 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd54c0d0690 0x7fd5300051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:20.424 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:20.432+0000 7fd542000640 1 -- 172.21.15.57:0/2086666578 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd54c0d0690 msgr2=0x7fd5300051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:20.424 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:20.432+0000 7fd542000640 1 --2- 172.21.15.57:0/2086666578 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd54c0d0690 0x7fd5300051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:20.424 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:20.432+0000 7fd542000640 1 -- 172.21.15.57:0/2086666578 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd530003b70 msgr2=0x7fd530003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:20.424 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:20.432+0000 7fd542000640 1 --2- 172.21.15.57:0/2086666578 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd530003b70 0x7fd530003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:20.424 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:20.432+0000 7fd542000640 1 -- 172.21.15.57:0/2086666578 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd530003520 con 0x7fd530004800 2024-03-27T10:00:20.425 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:20.433+0000 7fd542000640 1 --2- 172.21.15.57:0/2086666578 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd530004800 0x7fd530004c80 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fd5340018d0 tx=0x7fd530005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3b8a1714dfffe6 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:20.426 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:20.433+0000 7fd54a000640 1 -- 172.21.15.57:0/2086666578 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd534037070 con 0x7fd530004800 2024-03-27T10:00:20.426 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:20.433+0000 7fd54a000640 1 -- 172.21.15.57:0/2086666578 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5340052d0 con 0x7fd530004800 2024-03-27T10:00:20.426 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:20.433+0000 7fd54a000640 1 -- 172.21.15.57:0/2086666578 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5340014f0 con 0x7fd530004800 2024-03-27T10:00:20.426 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:20.434+0000 7fd54be00640 1 -- 172.21.15.57:0/2086666578 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd530004800 msgr2=0x7fd530004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:20.426 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:20.434+0000 7fd54be00640 1 --2- 172.21.15.57:0/2086666578 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd530004800 0x7fd530004c80 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fd5340018d0 tx=0x7fd530005830 comp rx=0 tx=0).stop 2024-03-27T10:00:20.426 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:20.434+0000 7fd54b400640 1 -- 172.21.15.57:0/2086666578 reap_dead start 2024-03-27T10:00:20.426 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:20.434+0000 7fd54be00640 1 -- 172.21.15.57:0/2086666578 shutdown_connections 2024-03-27T10:00:20.426 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:20.434+0000 7fd54be00640 1 -- 172.21.15.57:0/2086666578 >> 172.21.15.57:0/2086666578 conn(0x7fd54c06b990 msgr2=0x7fd54c06bda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:20.426 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:20.434+0000 7fd54be00640 1 -- 172.21.15.57:0/2086666578 shutdown_connections 2024-03-27T10:00:20.426 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:20.434+0000 7fd54be00640 1 -- 172.21.15.57:0/2086666578 wait complete. 2024-03-27T10:00:20.426 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:20.436+0000 7fd54be00640 1 Processor -- start 2024-03-27T10:00:20.426 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:20.436+0000 7fd54be00640 1 -- start start 2024-03-27T10:00:20.428 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:20.437+0000 7fd54be00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd530004800 0x7fd54c15e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:20.428 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:20.437+0000 7fd54be00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd54c158a90 0x7fd54c1572f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:20.428 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:20.437+0000 7fd54be00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd54c14b6b0 0x7fd54c159620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:20.429 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:20.437+0000 7fd54be00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fd54c0b3d80 con 0x7fd530004800 2024-03-27T10:00:20.429 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:20.437+0000 7fd54be00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fd54c0ae870 con 0x7fd54c158a90 2024-03-27T10:00:20.429 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:20.437+0000 7fd54be00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fd54c0b3f00 con 0x7fd54c14b6b0 2024-03-27T10:00:20.429 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:20.437+0000 7fd54aa00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd530004800 0x7fd54c15e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:20.429 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:20.437+0000 7fd54aa00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd530004800 0x7fd54c15e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38856/0 (socket says 172.21.15.57:38856) 2024-03-27T10:00:20.429 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:20.437+0000 7fd54aa00640 1 -- 172.21.15.57:0/1490482886 learned_addr learned my addr 172.21.15.57:0/1490482886 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:20.429 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:20.437+0000 7fd542000640 1 --2- 172.21.15.57:0/1490482886 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd54c158a90 0x7fd54c1572f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:20.429 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:20.437+0000 7fd54b400640 1 --2- 172.21.15.57:0/1490482886 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd54c14b6b0 0x7fd54c159620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:20.429 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:20.438+0000 7fd54aa00640 1 -- 172.21.15.57:0/1490482886 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd54c14b6b0 msgr2=0x7fd54c159620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:20.429 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:20.438+0000 7fd54aa00640 1 --2- 172.21.15.57:0/1490482886 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd54c14b6b0 0x7fd54c159620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:20.429 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:20.438+0000 7fd54aa00640 1 -- 172.21.15.57:0/1490482886 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd54c158a90 msgr2=0x7fd54c1572f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:20.429 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:20.438+0000 7fd54aa00640 1 --2- 172.21.15.57:0/1490482886 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd54c158a90 0x7fd54c1572f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:20.429 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:20.438+0000 7fd54aa00640 1 -- 172.21.15.57:0/1490482886 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd54c1579f0 con 0x7fd530004800 2024-03-27T10:00:20.429 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:20.438+0000 7fd54aa00640 1 --2- 172.21.15.57:0/1490482886 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd530004800 0x7fd54c15e3f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd53c00e780 tx=0x7fd53c00ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:20.429 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:20.438+0000 7fd543400640 1 -- 172.21.15.57:0/1490482886 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd53c00c660 con 0x7fd530004800 2024-03-27T10:00:20.429 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:20.438+0000 7fd543400640 1 -- 172.21.15.57:0/1490482886 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd53c018070 con 0x7fd530004800 2024-03-27T10:00:20.430 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:20.438+0000 7fd54be00640 1 -- 172.21.15.57:0/1490482886 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd54c157cd0 con 0x7fd530004800 2024-03-27T10:00:20.430 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:20.438+0000 7fd543400640 1 -- 172.21.15.57:0/1490482886 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd53c00ca00 con 0x7fd530004800 2024-03-27T10:00:20.430 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:20.438+0000 7fd54be00640 1 -- 172.21.15.57:0/1490482886 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd54c158290 con 0x7fd530004800 2024-03-27T10:00:20.430 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:20.440+0000 7fd54be00640 1 -- 172.21.15.57:0/1490482886 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd54c068540 con 0x7fd530004800 2024-03-27T10:00:20.430 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:20.441+0000 7fd543400640 1 -- 172.21.15.57:0/1490482886 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fd53c00cba0 con 0x7fd530004800 2024-03-27T10:00:20.431 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:20.441+0000 7fd543400640 1 --2- 172.21.15.57:0/1490482886 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fd52806c530 0x7fd52806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:20.431 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:20.441+0000 7fd543400640 1 -- 172.21.15.57:0/1490482886 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fd53c08b820 con 0x7fd530004800 2024-03-27T10:00:20.431 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:20.442+0000 7fd542000640 1 --2- 172.21.15.57:0/1490482886 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fd52806c530 0x7fd52806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:20.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:20.443+0000 7fd542000640 1 --2- 172.21.15.57:0/1490482886 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fd52806c530 0x7fd52806e9f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd534034000 tx=0x7fd534031000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:20.437 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:20.447+0000 7fd543400640 1 -- 172.21.15.57:0/1490482886 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7fd53c059ab0 con 0x7fd530004800 2024-03-27T10:00:20.686 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:20.697+0000 7fd54be00640 1 -- 172.21.15.57:0/1490482886 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fd54c06c290 con 0x7fd530004800 2024-03-27T10:00:20.687 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:20.697+0000 7fd543400640 1 -- 172.21.15.57:0/1490482886 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7fd53c0593b0 con 0x7fd530004800 2024-03-27T10:00:20.687 INFO:teuthology.orchestra.run.smithi057.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-03-27T10:00:20.690 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:20.700+0000 7fd54be00640 1 -- 172.21.15.57:0/1490482886 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fd52806c530 msgr2=0x7fd52806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:20.690 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:20.700+0000 7fd54be00640 1 --2- 172.21.15.57:0/1490482886 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fd52806c530 0x7fd52806e9f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd534034000 tx=0x7fd534031000 comp rx=0 tx=0).stop 2024-03-27T10:00:20.690 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:20.700+0000 7fd54be00640 1 -- 172.21.15.57:0/1490482886 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd530004800 msgr2=0x7fd54c15e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:20.690 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:20.700+0000 7fd54be00640 1 --2- 172.21.15.57:0/1490482886 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd530004800 0x7fd54c15e3f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd53c00e780 tx=0x7fd53c00ec40 comp rx=0 tx=0).stop 2024-03-27T10:00:20.690 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:20.700+0000 7fd54be00640 1 -- 172.21.15.57:0/1490482886 shutdown_connections 2024-03-27T10:00:20.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:20.700+0000 7fd54be00640 1 --2- 172.21.15.57:0/1490482886 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd54c14b6b0 0x7fd54c159620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:20.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:20.700+0000 7fd54be00640 1 --2- 172.21.15.57:0/1490482886 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fd52806c530 0x7fd52806e9f0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:20.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:20.700+0000 7fd54be00640 1 --2- 172.21.15.57:0/1490482886 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd54c158a90 0x7fd54c1572f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:20.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:20.700+0000 7fd54be00640 1 --2- 172.21.15.57:0/1490482886 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd530004800 0x7fd54c15e3f0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:20.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:20.700+0000 7fd54be00640 1 -- 172.21.15.57:0/1490482886 >> 172.21.15.57:0/1490482886 conn(0x7fd54c06b990 msgr2=0x7fd54c072980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:20.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:20.701+0000 7fd54be00640 1 -- 172.21.15.57:0/1490482886 shutdown_connections 2024-03-27T10:00:20.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:20.701+0000 7fd54be00640 1 -- 172.21.15.57:0/1490482886 wait complete. 2024-03-27T10:00:20.709 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-27T10:00:20.709 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-27T10:00:20.709 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi118.front.sepia.ceph.com 2024-03-27T10:00:20.709 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-03-27T10:00:20.709 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-03-27T10:00:20.709 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-27T10:00:20.709 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-27T10:00:20.709 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-27T10:00:20.709 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-03-27T10:00:20.710 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T10:00:20.710 DEBUG:teuthology.orchestra.run.smithi118:> ip addr 2024-03-27T10:00:20.763 INFO:teuthology.orchestra.run.smithi118.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-27T10:00:20.763 INFO:teuthology.orchestra.run.smithi118.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-27T10:00:20.764 INFO:teuthology.orchestra.run.smithi118.stdout: inet 127.0.0.1/8 scope host lo 2024-03-27T10:00:20.764 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-03-27T10:00:20.764 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 ::1/128 scope host 2024-03-27T10:00:20.764 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-03-27T10:00:20.764 INFO:teuthology.orchestra.run.smithi118.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-27T10:00:20.764 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:d8:a4:cc brd ff:ff:ff:ff:ff:ff 2024-03-27T10:00:20.764 INFO:teuthology.orchestra.run.smithi118.stdout: altname enp7s0f0 2024-03-27T10:00:20.764 INFO:teuthology.orchestra.run.smithi118.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-27T10:00:20.764 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:d8:a4:cd brd ff:ff:ff:ff:ff:ff 2024-03-27T10:00:20.764 INFO:teuthology.orchestra.run.smithi118.stdout: altname enp7s0f1 2024-03-27T10:00:20.764 INFO:teuthology.orchestra.run.smithi118.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-27T10:00:20.764 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:8f:d7:24 brd ff:ff:ff:ff:ff:ff 2024-03-27T10:00:20.764 INFO:teuthology.orchestra.run.smithi118.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-27T10:00:20.764 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:8f:d7:25 brd ff:ff:ff:ff:ff:ff 2024-03-27T10:00:20.764 INFO:teuthology.orchestra.run.smithi118.stdout: inet 172.21.15.118/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-03-27T10:00:20.765 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft 42485sec preferred_lft 42485sec 2024-03-27T10:00:20.765 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::ec4:7aff:fe8f:d725/64 scope link 2024-03-27T10:00:20.765 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-03-27T10:00:20.765 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-03-27T10:00:20.766 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-27T10:00:20.766 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2024-03-27T10:00:20.766 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link add name ceph-brx type bridge 2024-03-27T10:00:20.766 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip addr flush dev ceph-brx 2024-03-27T10:00:20.766 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link set ceph-brx up 2024-03-27T10:00:20.766 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-03-27T10:00:20.766 DEBUG:teuthology.orchestra.run.smithi118:> ') 2024-03-27T10:00:20.868 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T10:00:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-27T10:00:21.243 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T10:00:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-27T10:00:21.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T10:00:21.257 DEBUG:teuthology.orchestra.run.smithi118:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-27T10:00:21.328 INFO:teuthology.orchestra.run.smithi118.stdout:1 2024-03-27T10:00:21.331 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T10:00:21.331 DEBUG:teuthology.orchestra.run.smithi118:> route 2024-03-27T10:00:21.380 INFO:teuthology.orchestra.run.smithi118.stdout:Kernel IP routing table 2024-03-27T10:00:21.380 INFO:teuthology.orchestra.run.smithi118.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-27T10:00:21.380 INFO:teuthology.orchestra.run.smithi118.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-27T10:00:21.381 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-27T10:00:21.381 INFO:teuthology.orchestra.run.smithi118.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-27T10:00:21.382 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-27T10:00:21.382 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2024-03-27T10:00:21.382 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-27T10:00:21.382 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-27T10:00:21.382 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-27T10:00:21.382 DEBUG:teuthology.orchestra.run.smithi118:> ') 2024-03-27T10:00:21.467 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T10:00:21 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-27T10:00:22.154 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T10:00:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-27T10:00:22.164 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T10:00:22.164 DEBUG:teuthology.orchestra.run.smithi118:> ip netns list 2024-03-27T10:00:22.212 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T10:00:22.212 DEBUG:teuthology.orchestra.run.smithi118:> ip netns list-id 2024-03-27T10:00:22.306 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-27T10:00:22.306 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2024-03-27T10:00:22.306 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-27T10:00:22.306 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-03-27T10:00:22.307 DEBUG:teuthology.orchestra.run.smithi118:> ') 2024-03-27T10:00:22.399 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T10:00:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-27T10:00:22.488 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T10:00:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-27T10:00:22.502 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-03-27T10:00:22.502 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-27T10:00:22.502 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2024-03-27T10:00:22.502 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-03-27T10:00:22.502 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-03-27T10:00:22.502 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-03-27T10:00:22.502 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-03-27T10:00:22.502 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-03-27T10:00:22.502 DEBUG:teuthology.orchestra.run.smithi118:> ') 2024-03-27T10:00:22.600 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T10:00:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-27T10:00:22.838 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T10:00:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-27T10:00:22.847 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-27T10:00:22.847 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2024-03-27T10:00:22.847 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link set brx.0 up 2024-03-27T10:00:22.847 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link set dev brx.0 master ceph-brx 2024-03-27T10:00:22.847 DEBUG:teuthology.orchestra.run.smithi118:> ') 2024-03-27T10:00:22.937 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T10:00:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-27T10:00:23.053 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T10:00:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-27T10:00:23.067 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-03-27T10:00:23.067 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-27T10:00:23.067 DEBUG:teuthology.orchestra.run.smithi118:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-03-27T10:00:23.108 INFO:teuthology.orchestra.run.smithi118.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-03-27T10:00:23.109 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-27T10:00:23.109 DEBUG:teuthology.orchestra.run.smithi118:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-03-27T10:00:23.193 DEBUG:teuthology.orchestra.run.smithi118:> sudo modprobe fuse 2024-03-27T10:00:23.321 DEBUG:teuthology.orchestra.run.smithi118:> cat /proc/self/mounts | awk '{print $2}' 2024-03-27T10:00:23.361 INFO:teuthology.orchestra.run.smithi118.stdout:/proc 2024-03-27T10:00:23.361 INFO:teuthology.orchestra.run.smithi118.stdout:/sys 2024-03-27T10:00:23.361 INFO:teuthology.orchestra.run.smithi118.stdout:/dev 2024-03-27T10:00:23.361 INFO:teuthology.orchestra.run.smithi118.stdout:/sys/kernel/security 2024-03-27T10:00:23.361 INFO:teuthology.orchestra.run.smithi118.stdout:/dev/shm 2024-03-27T10:00:23.361 INFO:teuthology.orchestra.run.smithi118.stdout:/dev/pts 2024-03-27T10:00:23.361 INFO:teuthology.orchestra.run.smithi118.stdout:/run 2024-03-27T10:00:23.361 INFO:teuthology.orchestra.run.smithi118.stdout:/sys/fs/cgroup 2024-03-27T10:00:23.361 INFO:teuthology.orchestra.run.smithi118.stdout:/sys/fs/pstore 2024-03-27T10:00:23.361 INFO:teuthology.orchestra.run.smithi118.stdout:/sys/fs/bpf 2024-03-27T10:00:23.362 INFO:teuthology.orchestra.run.smithi118.stdout:/ 2024-03-27T10:00:23.362 INFO:teuthology.orchestra.run.smithi118.stdout:/sys/fs/selinux 2024-03-27T10:00:23.362 INFO:teuthology.orchestra.run.smithi118.stdout:/proc/sys/fs/binfmt_misc 2024-03-27T10:00:23.362 INFO:teuthology.orchestra.run.smithi118.stdout:/dev/mqueue 2024-03-27T10:00:23.362 INFO:teuthology.orchestra.run.smithi118.stdout:/dev/hugepages 2024-03-27T10:00:23.362 INFO:teuthology.orchestra.run.smithi118.stdout:/sys/kernel/debug 2024-03-27T10:00:23.362 INFO:teuthology.orchestra.run.smithi118.stdout:/sys/kernel/tracing 2024-03-27T10:00:23.362 INFO:teuthology.orchestra.run.smithi118.stdout:/sys/kernel/config 2024-03-27T10:00:23.362 INFO:teuthology.orchestra.run.smithi118.stdout:/sys/fs/fuse/connections 2024-03-27T10:00:23.362 INFO:teuthology.orchestra.run.smithi118.stdout:/run/credentials/systemd-sysctl.service 2024-03-27T10:00:23.362 INFO:teuthology.orchestra.run.smithi118.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-27T10:00:23.362 INFO:teuthology.orchestra.run.smithi118.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-27T10:00:23.362 INFO:teuthology.orchestra.run.smithi118.stdout:/var/lib/nfs/rpc_pipefs 2024-03-27T10:00:23.362 INFO:teuthology.orchestra.run.smithi118.stdout:/run/user/1000 2024-03-27T10:00:23.362 INFO:teuthology.orchestra.run.smithi118.stdout:/var/lib/ceph 2024-03-27T10:00:23.363 INFO:teuthology.orchestra.run.smithi118.stdout:/var/lib/ceph/osd/ceph-4 2024-03-27T10:00:23.363 INFO:teuthology.orchestra.run.smithi118.stdout:/var/lib/ceph/osd/ceph-5 2024-03-27T10:00:23.363 INFO:teuthology.orchestra.run.smithi118.stdout:/var/lib/ceph/osd/ceph-6 2024-03-27T10:00:23.363 INFO:teuthology.orchestra.run.smithi118.stdout:/var/lib/ceph/osd/ceph-7 2024-03-27T10:00:23.363 INFO:teuthology.orchestra.run.smithi118.stdout:/run/netns 2024-03-27T10:00:23.363 INFO:teuthology.orchestra.run.smithi118.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-27T10:00:23.363 INFO:teuthology.orchestra.run.smithi118.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-27T10:00:23.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T10:00:23.364 DEBUG:teuthology.orchestra.run.smithi118:> ls /sys/fs/fuse/connections 2024-03-27T10:00:23.455 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-03-27T10:00:23.455 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-03-27T10:00:23.460 DEBUG:teuthology.orchestra.run.smithi118:> sudo modprobe fuse 2024-03-27T10:00:23.536 DEBUG:teuthology.orchestra.run.smithi118:> cat /proc/self/mounts | awk '{print $2}' 2024-03-27T10:00:23.578 INFO:teuthology.orchestra.run.smithi118.stdout:/proc 2024-03-27T10:00:23.578 INFO:teuthology.orchestra.run.smithi118.stdout:/sys 2024-03-27T10:00:23.578 INFO:teuthology.orchestra.run.smithi118.stdout:/dev 2024-03-27T10:00:23.578 INFO:teuthology.orchestra.run.smithi118.stdout:/sys/kernel/security 2024-03-27T10:00:23.579 INFO:teuthology.orchestra.run.smithi118.stdout:/dev/shm 2024-03-27T10:00:23.579 INFO:teuthology.orchestra.run.smithi118.stdout:/dev/pts 2024-03-27T10:00:23.579 INFO:teuthology.orchestra.run.smithi118.stdout:/run 2024-03-27T10:00:23.579 INFO:teuthology.orchestra.run.smithi118.stdout:/sys/fs/cgroup 2024-03-27T10:00:23.579 INFO:teuthology.orchestra.run.smithi118.stdout:/sys/fs/pstore 2024-03-27T10:00:23.579 INFO:teuthology.orchestra.run.smithi118.stdout:/sys/fs/bpf 2024-03-27T10:00:23.579 INFO:teuthology.orchestra.run.smithi118.stdout:/ 2024-03-27T10:00:23.579 INFO:teuthology.orchestra.run.smithi118.stdout:/sys/fs/selinux 2024-03-27T10:00:23.579 INFO:teuthology.orchestra.run.smithi118.stdout:/proc/sys/fs/binfmt_misc 2024-03-27T10:00:23.579 INFO:teuthology.orchestra.run.smithi118.stdout:/dev/mqueue 2024-03-27T10:00:23.579 INFO:teuthology.orchestra.run.smithi118.stdout:/dev/hugepages 2024-03-27T10:00:23.579 INFO:teuthology.orchestra.run.smithi118.stdout:/sys/kernel/debug 2024-03-27T10:00:23.579 INFO:teuthology.orchestra.run.smithi118.stdout:/sys/kernel/tracing 2024-03-27T10:00:23.579 INFO:teuthology.orchestra.run.smithi118.stdout:/sys/kernel/config 2024-03-27T10:00:23.579 INFO:teuthology.orchestra.run.smithi118.stdout:/sys/fs/fuse/connections 2024-03-27T10:00:23.579 INFO:teuthology.orchestra.run.smithi118.stdout:/run/credentials/systemd-sysctl.service 2024-03-27T10:00:23.580 INFO:teuthology.orchestra.run.smithi118.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-27T10:00:23.580 INFO:teuthology.orchestra.run.smithi118.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-27T10:00:23.580 INFO:teuthology.orchestra.run.smithi118.stdout:/var/lib/nfs/rpc_pipefs 2024-03-27T10:00:23.580 INFO:teuthology.orchestra.run.smithi118.stdout:/run/user/1000 2024-03-27T10:00:23.580 INFO:teuthology.orchestra.run.smithi118.stdout:/var/lib/ceph 2024-03-27T10:00:23.580 INFO:teuthology.orchestra.run.smithi118.stdout:/var/lib/ceph/osd/ceph-4 2024-03-27T10:00:23.580 INFO:teuthology.orchestra.run.smithi118.stdout:/var/lib/ceph/osd/ceph-5 2024-03-27T10:00:23.580 INFO:teuthology.orchestra.run.smithi118.stdout:/var/lib/ceph/osd/ceph-6 2024-03-27T10:00:23.580 INFO:teuthology.orchestra.run.smithi118.stdout:/var/lib/ceph/osd/ceph-7 2024-03-27T10:00:23.580 INFO:teuthology.orchestra.run.smithi118.stdout:/run/netns 2024-03-27T10:00:23.580 INFO:teuthology.orchestra.run.smithi118.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-27T10:00:23.580 INFO:teuthology.orchestra.run.smithi118.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-27T10:00:23.581 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T10:00:23.581 DEBUG:teuthology.orchestra.run.smithi118:> ls /sys/fs/fuse/connections 2024-03-27T10:00:23.651 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi118.stderr:2024-03-27T10:00:23.662+0000 7fb303133480 -1 init, newargv = 0x556e84e10220 newargc=15 2024-03-27T10:00:23.652 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi118.stderr:ceph-fuse[41915]: starting ceph client 2024-03-27T10:00:23.663 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi118.stderr:ceph-fuse[41915]: starting fuse 2024-03-27T10:00:23.665 INFO:teuthology.orchestra.run.smithi118.stdout:41 2024-03-27T10:00:23.666 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-03-27T10:00:23.666 DEBUG:teuthology.orchestra.run.smithi118:> sudo stdin-killer -- python3 -c ' 2024-03-27T10:00:23.666 DEBUG:teuthology.orchestra.run.smithi118:> import glob 2024-03-27T10:00:23.666 DEBUG:teuthology.orchestra.run.smithi118:> import re 2024-03-27T10:00:23.666 DEBUG:teuthology.orchestra.run.smithi118:> import os 2024-03-27T10:00:23.666 DEBUG:teuthology.orchestra.run.smithi118:> import subprocess 2024-03-27T10:00:23.666 DEBUG:teuthology.orchestra.run.smithi118:> 2024-03-27T10:00:23.666 DEBUG:teuthology.orchestra.run.smithi118:> def _find_admin_socket(client_name): 2024-03-27T10:00:23.666 DEBUG:teuthology.orchestra.run.smithi118:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-03-27T10:00:23.667 DEBUG:teuthology.orchestra.run.smithi118:> files = glob.glob(asok_path) 2024-03-27T10:00:23.667 DEBUG:teuthology.orchestra.run.smithi118:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-03-27T10:00:23.667 DEBUG:teuthology.orchestra.run.smithi118:> 2024-03-27T10:00:23.667 DEBUG:teuthology.orchestra.run.smithi118:> # Given a non-glob path, it better be there 2024-03-27T10:00:23.667 DEBUG:teuthology.orchestra.run.smithi118:> if "*" not in asok_path: 2024-03-27T10:00:23.667 DEBUG:teuthology.orchestra.run.smithi118:> assert(len(files) == 1) 2024-03-27T10:00:23.667 DEBUG:teuthology.orchestra.run.smithi118:> return files[0] 2024-03-27T10:00:23.667 DEBUG:teuthology.orchestra.run.smithi118:> 2024-03-27T10:00:23.667 DEBUG:teuthology.orchestra.run.smithi118:> for f in files: 2024-03-27T10:00:23.667 DEBUG:teuthology.orchestra.run.smithi118:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-03-27T10:00:23.667 DEBUG:teuthology.orchestra.run.smithi118:> if os.path.exists("/proc/{0}".format(pid)): 2024-03-27T10:00:23.667 DEBUG:teuthology.orchestra.run.smithi118:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-03-27T10:00:23.667 DEBUG:teuthology.orchestra.run.smithi118:> contents = proc_f.read() 2024-03-27T10:00:23.667 DEBUG:teuthology.orchestra.run.smithi118:> if mountpoint in contents: 2024-03-27T10:00:23.668 DEBUG:teuthology.orchestra.run.smithi118:> return f 2024-03-27T10:00:23.668 DEBUG:teuthology.orchestra.run.smithi118:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-03-27T10:00:23.668 DEBUG:teuthology.orchestra.run.smithi118:> 2024-03-27T10:00:23.668 DEBUG:teuthology.orchestra.run.smithi118:> print(_find_admin_socket("client.1")) 2024-03-27T10:00:23.668 DEBUG:teuthology.orchestra.run.smithi118:> ' 2024-03-27T10:00:23.855 INFO:teuthology.orchestra.run.smithi118.stdout:/var/run/ceph/ceph-client.1.41915.asok 2024-03-27T10:00:23.891 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T10:00:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-27T10:00:23.891 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.41915.asok 2024-03-27T10:00:23.892 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T10:00:23.892 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.41915.asok status 2024-03-27T10:00:24.160 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-03-27T10:00:24.160 INFO:teuthology.orchestra.run.smithi118.stdout: "metadata": { 2024-03-27T10:00:24.160 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph_sha1": "155268c4e432a12433aa833f174f9fe3b1016ae0", 2024-03-27T10:00:24.160 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph_version": "ceph version 19.0.0-2478-g155268c4 (155268c4e432a12433aa833f174f9fe3b1016ae0) squid (dev)", 2024-03-27T10:00:24.160 INFO:teuthology.orchestra.run.smithi118.stdout: "entity_id": "1", 2024-03-27T10:00:24.160 INFO:teuthology.orchestra.run.smithi118.stdout: "hostname": "smithi118", 2024-03-27T10:00:24.161 INFO:teuthology.orchestra.run.smithi118.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-03-27T10:00:24.161 INFO:teuthology.orchestra.run.smithi118.stdout: "pid": "41915", 2024-03-27T10:00:24.161 INFO:teuthology.orchestra.run.smithi118.stdout: "root": "/" 2024-03-27T10:00:24.161 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-03-27T10:00:24.161 INFO:teuthology.orchestra.run.smithi118.stdout: "dentry_count": 0, 2024-03-27T10:00:24.161 INFO:teuthology.orchestra.run.smithi118.stdout: "dentry_pinned_count": 0, 2024-03-27T10:00:24.161 INFO:teuthology.orchestra.run.smithi118.stdout: "id": 4753, 2024-03-27T10:00:24.161 INFO:teuthology.orchestra.run.smithi118.stdout: "inst": { 2024-03-27T10:00:24.161 INFO:teuthology.orchestra.run.smithi118.stdout: "name": { 2024-03-27T10:00:24.161 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "client", 2024-03-27T10:00:24.161 INFO:teuthology.orchestra.run.smithi118.stdout: "num": 4753 2024-03-27T10:00:24.161 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-03-27T10:00:24.161 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": { 2024-03-27T10:00:24.161 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-03-27T10:00:24.161 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "192.168.0.1:0", 2024-03-27T10:00:24.162 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1627225892 2024-03-27T10:00:24.162 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-03-27T10:00:24.162 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-03-27T10:00:24.162 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": { 2024-03-27T10:00:24.162 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-03-27T10:00:24.162 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "192.168.0.1:0", 2024-03-27T10:00:24.162 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1627225892 2024-03-27T10:00:24.162 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-03-27T10:00:24.162 INFO:teuthology.orchestra.run.smithi118.stdout: "inst_str": "client.4753 192.168.0.1:0/1627225892", 2024-03-27T10:00:24.162 INFO:teuthology.orchestra.run.smithi118.stdout: "addr_str": "192.168.0.1:0/1627225892", 2024-03-27T10:00:24.162 INFO:teuthology.orchestra.run.smithi118.stdout: "inode_count": 1, 2024-03-27T10:00:24.162 INFO:teuthology.orchestra.run.smithi118.stdout: "mds_epoch": 9, 2024-03-27T10:00:24.162 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_epoch": 28, 2024-03-27T10:00:24.162 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_epoch_barrier": 0, 2024-03-27T10:00:24.163 INFO:teuthology.orchestra.run.smithi118.stdout: "blocklisted": false, 2024-03-27T10:00:24.163 INFO:teuthology.orchestra.run.smithi118.stdout: "fs_name": "cephfs" 2024-03-27T10:00:24.163 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-03-27T10:00:24.175 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-27T10:00:24.405 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:24.415+0000 7fd166a00640 1 Processor -- start 2024-03-27T10:00:24.405 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:24.415+0000 7fd166a00640 1 -- start start 2024-03-27T10:00:24.407 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:24.417+0000 7fd166a00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd1601456e0 0x7fd1600ce100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:24.407 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:24.417+0000 7fd166a00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fd1600d0690 0x7fd1600b2c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:24.407 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:24.417+0000 7fd166a00640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd160145ac0 con 0x7fd16006d810 2024-03-27T10:00:24.407 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:24.417+0000 7fd166a00640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7fd1600cf3f0 con 0x7fd1601456e0 2024-03-27T10:00:24.407 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:24.417+0000 7fd166a00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7fd1600ce7e0 con 0x7fd1600d0690 2024-03-27T10:00:24.407 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:24.417+0000 7fd165600640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd1601456e0 0x7fd1600ce100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:24.407 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:24.417+0000 7fd164c00640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fd16006d810 0x7fd1600cff80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:57018/0 (socket says 172.21.15.57:57018) 2024-03-27T10:00:24.408 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:24.417+0000 7fd164c00640 1 -- 172.21.15.57:0/3454315293 learned_addr learned my addr 172.21.15.57:0/3454315293 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T10:00:24.408 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:24.418+0000 7fd165600640 1 -- 172.21.15.57:0/3454315293 >> v2:172.21.15.118:3300/0 conn(0x7fd1600d0690 msgr2=0x7fd1600b2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:24.408 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:24.418+0000 7fd165600640 1 --2- 172.21.15.57:0/3454315293 >> v2:172.21.15.118:3300/0 conn(0x7fd1600d0690 0x7fd1600b2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:24.408 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:24.418+0000 7fd165600640 1 -- 172.21.15.57:0/3454315293 >> v1:172.21.15.57:6789/0 conn(0x7fd16006d810 legacy=0x7fd1600cff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:24.408 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:24.418+0000 7fd165600640 1 -- 172.21.15.57:0/3454315293 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1600ceac0 con 0x7fd1601456e0 2024-03-27T10:00:24.408 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:24.418+0000 7fd15fe00640 1 -- 172.21.15.57:0/3454315293 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 577321492 0 0) 0x7fd160145ac0 con 0x7fd16006d810 2024-03-27T10:00:24.409 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:24.419+0000 7fd165600640 1 --2- 172.21.15.57:0/3454315293 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd1601456e0 0x7fd1600ce100 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd16006e580 tx=0x7fd15402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e47fe0a77d0256e server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:24.409 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:24.420+0000 7fd15fe00640 1 -- 172.21.15.57:0/3454315293 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd154035020 con 0x7fd1601456e0 2024-03-27T10:00:24.409 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:24.420+0000 7fd15fe00640 1 -- 172.21.15.57:0/3454315293 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd154031830 con 0x7fd1601456e0 2024-03-27T10:00:24.409 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:24.420+0000 7fd15fe00640 1 -- 172.21.15.57:0/3454315293 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd154031c00 con 0x7fd1601456e0 2024-03-27T10:00:24.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:24.420+0000 7fd166a00640 1 -- 172.21.15.57:0/3454315293 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd1601456e0 msgr2=0x7fd1600ce100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:24.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:24.420+0000 7fd166a00640 1 --2- 172.21.15.57:0/3454315293 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd1601456e0 0x7fd1600ce100 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd16006e580 tx=0x7fd15402b8d0 comp rx=0 tx=0).stop 2024-03-27T10:00:24.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:24.420+0000 7fd166a00640 1 -- 172.21.15.57:0/3454315293 shutdown_connections 2024-03-27T10:00:24.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:24.420+0000 7fd166a00640 1 --2- 172.21.15.57:0/3454315293 >> v2:172.21.15.118:3300/0 conn(0x7fd1600d0690 0x7fd1600b2c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:24.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:24.420+0000 7fd166a00640 1 --2- 172.21.15.57:0/3454315293 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd1601456e0 0x7fd1600ce100 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:24.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:24.420+0000 7fd166a00640 1 -- 172.21.15.57:0/3454315293 >> 172.21.15.57:0/3454315293 conn(0x7fd16006b990 msgr2=0x7fd16006bda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:24.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:24.420+0000 7fd166a00640 1 -- 172.21.15.57:0/3454315293 shutdown_connections 2024-03-27T10:00:24.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:24.420+0000 7fd166a00640 1 -- 172.21.15.57:0/3454315293 wait complete. 2024-03-27T10:00:24.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:24.422+0000 7fd166a00640 1 Processor -- start 2024-03-27T10:00:24.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:24.422+0000 7fd166a00640 1 -- start start 2024-03-27T10:00:24.415 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:24.423+0000 7fd166a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd16006d810 0x7fd160151c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:24.415 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:24.423+0000 7fd166a00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd1600d0690 0x7fd1601f5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:24.415 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:24.423+0000 7fd166a00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd1601456e0 0x7fd160140140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:24.415 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:24.423+0000 7fd166a00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fd16006dcc0 con 0x7fd1600d0690 2024-03-27T10:00:24.415 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:24.423+0000 7fd166a00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fd1600cf080 con 0x7fd16006d810 2024-03-27T10:00:24.415 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:24.423+0000 7fd166a00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fd1600b3160 con 0x7fd1601456e0 2024-03-27T10:00:24.415 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:24.424+0000 7fd164c00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd1600d0690 0x7fd1601f5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:24.415 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:24.424+0000 7fd164c00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd1600d0690 0x7fd1601f5060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47284/0 (socket says 172.21.15.57:47284) 2024-03-27T10:00:24.415 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:24.424+0000 7fd164c00640 1 -- 172.21.15.57:0/3953110354 learned_addr learned my addr 172.21.15.57:0/3953110354 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:24.415 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:24.424+0000 7fd166000640 1 --2- 172.21.15.57:0/3953110354 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd1601456e0 0x7fd160140140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:24.415 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:24.424+0000 7fd165600640 1 --2- 172.21.15.57:0/3953110354 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd16006d810 0x7fd160151c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:24.415 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:24.424+0000 7fd164c00640 1 -- 172.21.15.57:0/3953110354 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd1601456e0 msgr2=0x7fd160140140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:24.415 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:24.424+0000 7fd164c00640 1 --2- 172.21.15.57:0/3953110354 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd1601456e0 0x7fd160140140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:24.415 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:24.424+0000 7fd164c00640 1 -- 172.21.15.57:0/3953110354 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd16006d810 msgr2=0x7fd160151c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:24.416 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:24.424+0000 7fd164c00640 1 --2- 172.21.15.57:0/3953110354 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd16006d810 0x7fd160151c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:24.416 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:24.424+0000 7fd164c00640 1 -- 172.21.15.57:0/3953110354 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1600ad1b0 con 0x7fd1600d0690 2024-03-27T10:00:24.416 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:24.425+0000 7fd164c00640 1 --2- 172.21.15.57:0/3953110354 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd1600d0690 0x7fd1601f5060 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd14c00c4d0 tx=0x7fd14c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:24.416 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:24.425+0000 7fd15d600640 1 -- 172.21.15.57:0/3953110354 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd14c018070 con 0x7fd1600d0690 2024-03-27T10:00:24.416 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:24.425+0000 7fd15d600640 1 -- 172.21.15.57:0/3953110354 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd14c007500 con 0x7fd1600d0690 2024-03-27T10:00:24.416 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:24.425+0000 7fd15d600640 1 -- 172.21.15.57:0/3953110354 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd14c004a20 con 0x7fd1600d0690 2024-03-27T10:00:24.416 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:24.425+0000 7fd166a00640 1 -- 172.21.15.57:0/3953110354 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1600ad490 con 0x7fd1600d0690 2024-03-27T10:00:24.416 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:24.425+0000 7fd166a00640 1 -- 172.21.15.57:0/3953110354 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1600ada50 con 0x7fd1600d0690 2024-03-27T10:00:24.417 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:24.426+0000 7fd166a00640 1 -- 172.21.15.57:0/3953110354 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd160068540 con 0x7fd1600d0690 2024-03-27T10:00:24.417 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:24.427+0000 7fd15d600640 1 -- 172.21.15.57:0/3953110354 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fd14c01b070 con 0x7fd1600d0690 2024-03-27T10:00:24.419 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:24.429+0000 7fd15d600640 1 --2- 172.21.15.57:0/3953110354 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fd14006c530 0x7fd14006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:24.419 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:24.429+0000 7fd15d600640 1 -- 172.21.15.57:0/3953110354 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fd14c08aee0 con 0x7fd1600d0690 2024-03-27T10:00:24.419 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:24.429+0000 7fd165600640 1 --2- 172.21.15.57:0/3953110354 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fd14006c530 0x7fd14006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:24.419 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:24.430+0000 7fd165600640 1 --2- 172.21.15.57:0/3953110354 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fd14006c530 0x7fd14006e9f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd154036000 tx=0x7fd15403c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:24.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:24.434+0000 7fd15d600640 1 -- 172.21.15.57:0/3953110354 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7fd14c059060 con 0x7fd1600d0690 2024-03-27T10:00:24.671 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:24.681+0000 7fd166a00640 1 -- 172.21.15.57:0/3953110354 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fd1600b4620 con 0x7fd1600d0690 2024-03-27T10:00:24.672 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:24.682+0000 7fd15d600640 1 -- 172.21.15.57:0/3953110354 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7fd14c058960 con 0x7fd1600d0690 2024-03-27T10:00:24.672 INFO:teuthology.orchestra.run.smithi057.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-03-27T10:00:24.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:24.685+0000 7fd166a00640 1 -- 172.21.15.57:0/3953110354 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fd14006c530 msgr2=0x7fd14006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:24.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:24.685+0000 7fd166a00640 1 --2- 172.21.15.57:0/3953110354 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fd14006c530 0x7fd14006e9f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd154036000 tx=0x7fd15403c040 comp rx=0 tx=0).stop 2024-03-27T10:00:24.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:24.685+0000 7fd166a00640 1 -- 172.21.15.57:0/3953110354 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd1600d0690 msgr2=0x7fd1601f5060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:24.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:24.685+0000 7fd166a00640 1 --2- 172.21.15.57:0/3953110354 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd1600d0690 0x7fd1601f5060 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd14c00c4d0 tx=0x7fd14c00c990 comp rx=0 tx=0).stop 2024-03-27T10:00:24.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:24.685+0000 7fd166a00640 1 -- 172.21.15.57:0/3953110354 shutdown_connections 2024-03-27T10:00:24.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:24.685+0000 7fd166a00640 1 --2- 172.21.15.57:0/3953110354 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd1601456e0 0x7fd160140140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:24.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:24.685+0000 7fd166a00640 1 --2- 172.21.15.57:0/3953110354 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd1600d0690 0x7fd1601f5060 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:24.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:24.685+0000 7fd166a00640 1 --2- 172.21.15.57:0/3953110354 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fd14006c530 0x7fd14006e9f0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:24.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:24.685+0000 7fd166a00640 1 --2- 172.21.15.57:0/3953110354 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd16006d810 0x7fd160151c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:24.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:24.685+0000 7fd166a00640 1 -- 172.21.15.57:0/3953110354 >> 172.21.15.57:0/3953110354 conn(0x7fd16006b990 msgr2=0x7fd1600b07e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:24.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:24.685+0000 7fd166a00640 1 -- 172.21.15.57:0/3953110354 shutdown_connections 2024-03-27T10:00:24.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:24.685+0000 7fd166a00640 1 -- 172.21.15.57:0/3953110354 wait complete. 2024-03-27T10:00:24.693 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-27T10:00:24.693 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-27T10:00:24.694 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi118.front.sepia.ceph.com 2024-03-27T10:00:24.694 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-03-27T10:00:24.694 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-03-27T10:00:24.694 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-27T10:00:24.694 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-27T10:00:24.694 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-27T10:00:24.694 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-03-27T10:00:24.694 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T10:00:24.694 DEBUG:teuthology.orchestra.run.smithi118:> ip addr 2024-03-27T10:00:24.751 INFO:teuthology.orchestra.run.smithi118.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-27T10:00:24.751 INFO:teuthology.orchestra.run.smithi118.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-27T10:00:24.751 INFO:teuthology.orchestra.run.smithi118.stdout: inet 127.0.0.1/8 scope host lo 2024-03-27T10:00:24.751 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-03-27T10:00:24.752 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 ::1/128 scope host 2024-03-27T10:00:24.752 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-03-27T10:00:24.752 INFO:teuthology.orchestra.run.smithi118.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-27T10:00:24.752 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:d8:a4:cc brd ff:ff:ff:ff:ff:ff 2024-03-27T10:00:24.752 INFO:teuthology.orchestra.run.smithi118.stdout: altname enp7s0f0 2024-03-27T10:00:24.752 INFO:teuthology.orchestra.run.smithi118.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-27T10:00:24.752 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:d8:a4:cd brd ff:ff:ff:ff:ff:ff 2024-03-27T10:00:24.752 INFO:teuthology.orchestra.run.smithi118.stdout: altname enp7s0f1 2024-03-27T10:00:24.752 INFO:teuthology.orchestra.run.smithi118.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-27T10:00:24.752 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:8f:d7:24 brd ff:ff:ff:ff:ff:ff 2024-03-27T10:00:24.752 INFO:teuthology.orchestra.run.smithi118.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-27T10:00:24.752 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 0c:c4:7a:8f:d7:25 brd ff:ff:ff:ff:ff:ff 2024-03-27T10:00:24.752 INFO:teuthology.orchestra.run.smithi118.stdout: inet 172.21.15.118/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-03-27T10:00:24.752 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft 42481sec preferred_lft 42481sec 2024-03-27T10:00:24.752 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::ec4:7aff:fe8f:d725/64 scope link 2024-03-27T10:00:24.752 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-03-27T10:00:24.753 INFO:teuthology.orchestra.run.smithi118.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-27T10:00:24.753 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether b2:6e:f8:d5:03:e1 brd ff:ff:ff:ff:ff:ff 2024-03-27T10:00:24.753 INFO:teuthology.orchestra.run.smithi118.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-03-27T10:00:24.753 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-03-27T10:00:24.753 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::9c0d:9cff:feeb:cca5/64 scope link 2024-03-27T10:00:24.753 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-03-27T10:00:24.753 INFO:teuthology.orchestra.run.smithi118.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-27T10:00:24.753 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether b2:6e:f8:d5:03:e1 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-27T10:00:24.753 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::b06e:f8ff:fed5:3e1/64 scope link 2024-03-27T10:00:24.753 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-03-27T10:00:24.754 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T10:00:24.754 DEBUG:teuthology.orchestra.run.smithi118:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-27T10:00:24.838 INFO:teuthology.orchestra.run.smithi118.stdout:1 2024-03-27T10:00:24.842 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T10:00:24.843 DEBUG:teuthology.orchestra.run.smithi118:> route 2024-03-27T10:00:24.890 INFO:teuthology.orchestra.run.smithi118.stdout:Kernel IP routing table 2024-03-27T10:00:24.890 INFO:teuthology.orchestra.run.smithi118.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-27T10:00:24.890 INFO:teuthology.orchestra.run.smithi118.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-27T10:00:24.890 INFO:teuthology.orchestra.run.smithi118.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-27T10:00:24.890 INFO:teuthology.orchestra.run.smithi118.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-27T10:00:24.890 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-27T10:00:24.891 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2024-03-27T10:00:24.891 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-27T10:00:24.891 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-27T10:00:24.891 DEBUG:teuthology.orchestra.run.smithi118:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-27T10:00:24.891 DEBUG:teuthology.orchestra.run.smithi118:> ') 2024-03-27T10:00:25.040 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T10:00:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-27T10:00:25.180 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T10:00:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-27T10:00:25.189 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T10:00:25.189 DEBUG:teuthology.orchestra.run.smithi118:> ip netns list 2024-03-27T10:00:25.237 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-03-27T10:00:25.238 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T10:00:25.238 DEBUG:teuthology.orchestra.run.smithi118:> ip netns list-id 2024-03-27T10:00:25.282 INFO:teuthology.orchestra.run.smithi118.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-03-27T10:00:25.282 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-27T10:00:25.282 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2024-03-27T10:00:25.282 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-03-27T10:00:25.282 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-03-27T10:00:25.283 DEBUG:teuthology.orchestra.run.smithi118:> ') 2024-03-27T10:00:25.423 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T10:00:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-27T10:00:25.514 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T10:00:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-27T10:00:25.523 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T10:00:25.523 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-03-27T10:00:25.604 INFO:teuthology.orchestra.run.smithi118.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-27T10:00:25.605 INFO:teuthology.orchestra.run.smithi118.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-27T10:00:25.605 INFO:teuthology.orchestra.run.smithi118.stdout: inet 127.0.0.1/8 scope host lo 2024-03-27T10:00:25.605 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-03-27T10:00:25.605 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 ::1/128 scope host 2024-03-27T10:00:25.605 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-03-27T10:00:25.605 INFO:teuthology.orchestra.run.smithi118.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-27T10:00:25.605 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 46:99:40:1d:f5:51 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-03-27T10:00:25.605 INFO:teuthology.orchestra.run.smithi118.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-03-27T10:00:25.605 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-03-27T10:00:25.605 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::4499:40ff:fe1d:f551/64 scope link 2024-03-27T10:00:25.605 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-03-27T10:00:25.608 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T10:00:25.608 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-03-27T10:00:25.688 INFO:teuthology.orchestra.run.smithi118.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-27T10:00:25.688 INFO:teuthology.orchestra.run.smithi118.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-27T10:00:25.688 INFO:teuthology.orchestra.run.smithi118.stdout: inet 127.0.0.1/8 scope host lo 2024-03-27T10:00:25.688 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-03-27T10:00:25.688 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 ::1/128 scope host 2024-03-27T10:00:25.688 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-03-27T10:00:25.688 INFO:teuthology.orchestra.run.smithi118.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-27T10:00:25.688 INFO:teuthology.orchestra.run.smithi118.stdout: link/ether 46:99:40:1d:f5:51 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-03-27T10:00:25.689 INFO:teuthology.orchestra.run.smithi118.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-03-27T10:00:25.689 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-03-27T10:00:25.689 INFO:teuthology.orchestra.run.smithi118.stdout: inet6 fe80::4499:40ff:fe1d:f551/64 scope link 2024-03-27T10:00:25.689 INFO:teuthology.orchestra.run.smithi118.stdout: valid_lft forever preferred_lft forever 2024-03-27T10:00:25.692 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-03-27T10:00:25.692 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-27T10:00:25.692 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2024-03-27T10:00:25.692 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-03-27T10:00:25.693 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-03-27T10:00:25.693 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-03-27T10:00:25.693 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-03-27T10:00:25.693 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-03-27T10:00:25.693 DEBUG:teuthology.orchestra.run.smithi118:> ') 2024-03-27T10:00:25.796 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T10:00:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-27T10:00:25.992 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T10:00:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-27T10:00:26.004 DEBUG:teuthology.orchestra.run.smithi118:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-27T10:00:26.005 DEBUG:teuthology.orchestra.run.smithi118:> set -e 2024-03-27T10:00:26.005 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link set brx.1 up 2024-03-27T10:00:26.005 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link set dev brx.1 master ceph-brx 2024-03-27T10:00:26.005 DEBUG:teuthology.orchestra.run.smithi118:> ') 2024-03-27T10:00:26.108 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T10:00:26 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-27T10:00:26.229 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T10:00:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-27T10:00:26.237 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2024-03-27T10:00:26.237 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-27T10:00:26.238 DEBUG:teuthology.orchestra.run.smithi118:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-03-27T10:00:26.283 INFO:teuthology.orchestra.run.smithi118.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-03-27T10:00:26.283 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-27T10:00:26.283 DEBUG:teuthology.orchestra.run.smithi118:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-03-27T10:00:26.374 DEBUG:teuthology.orchestra.run.smithi118:> sudo modprobe fuse 2024-03-27T10:00:26.456 DEBUG:teuthology.orchestra.run.smithi118:> cat /proc/self/mounts | awk '{print $2}' 2024-03-27T10:00:26.505 INFO:teuthology.orchestra.run.smithi118.stdout:/proc 2024-03-27T10:00:26.506 INFO:teuthology.orchestra.run.smithi118.stdout:/sys 2024-03-27T10:00:26.506 INFO:teuthology.orchestra.run.smithi118.stdout:/dev 2024-03-27T10:00:26.506 INFO:teuthology.orchestra.run.smithi118.stdout:/sys/kernel/security 2024-03-27T10:00:26.506 INFO:teuthology.orchestra.run.smithi118.stdout:/dev/shm 2024-03-27T10:00:26.506 INFO:teuthology.orchestra.run.smithi118.stdout:/dev/pts 2024-03-27T10:00:26.506 INFO:teuthology.orchestra.run.smithi118.stdout:/run 2024-03-27T10:00:26.506 INFO:teuthology.orchestra.run.smithi118.stdout:/sys/fs/cgroup 2024-03-27T10:00:26.506 INFO:teuthology.orchestra.run.smithi118.stdout:/sys/fs/pstore 2024-03-27T10:00:26.506 INFO:teuthology.orchestra.run.smithi118.stdout:/sys/fs/bpf 2024-03-27T10:00:26.506 INFO:teuthology.orchestra.run.smithi118.stdout:/ 2024-03-27T10:00:26.506 INFO:teuthology.orchestra.run.smithi118.stdout:/sys/fs/selinux 2024-03-27T10:00:26.506 INFO:teuthology.orchestra.run.smithi118.stdout:/proc/sys/fs/binfmt_misc 2024-03-27T10:00:26.506 INFO:teuthology.orchestra.run.smithi118.stdout:/dev/mqueue 2024-03-27T10:00:26.507 INFO:teuthology.orchestra.run.smithi118.stdout:/dev/hugepages 2024-03-27T10:00:26.507 INFO:teuthology.orchestra.run.smithi118.stdout:/sys/kernel/debug 2024-03-27T10:00:26.507 INFO:teuthology.orchestra.run.smithi118.stdout:/sys/kernel/tracing 2024-03-27T10:00:26.507 INFO:teuthology.orchestra.run.smithi118.stdout:/sys/kernel/config 2024-03-27T10:00:26.507 INFO:teuthology.orchestra.run.smithi118.stdout:/sys/fs/fuse/connections 2024-03-27T10:00:26.507 INFO:teuthology.orchestra.run.smithi118.stdout:/run/credentials/systemd-sysctl.service 2024-03-27T10:00:26.507 INFO:teuthology.orchestra.run.smithi118.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-27T10:00:26.507 INFO:teuthology.orchestra.run.smithi118.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-27T10:00:26.507 INFO:teuthology.orchestra.run.smithi118.stdout:/var/lib/nfs/rpc_pipefs 2024-03-27T10:00:26.507 INFO:teuthology.orchestra.run.smithi118.stdout:/run/user/1000 2024-03-27T10:00:26.507 INFO:teuthology.orchestra.run.smithi118.stdout:/var/lib/ceph 2024-03-27T10:00:26.507 INFO:teuthology.orchestra.run.smithi118.stdout:/var/lib/ceph/osd/ceph-4 2024-03-27T10:00:26.507 INFO:teuthology.orchestra.run.smithi118.stdout:/var/lib/ceph/osd/ceph-5 2024-03-27T10:00:26.507 INFO:teuthology.orchestra.run.smithi118.stdout:/var/lib/ceph/osd/ceph-6 2024-03-27T10:00:26.507 INFO:teuthology.orchestra.run.smithi118.stdout:/var/lib/ceph/osd/ceph-7 2024-03-27T10:00:26.508 INFO:teuthology.orchestra.run.smithi118.stdout:/run/netns 2024-03-27T10:00:26.508 INFO:teuthology.orchestra.run.smithi118.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-27T10:00:26.508 INFO:teuthology.orchestra.run.smithi118.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-27T10:00:26.508 INFO:teuthology.orchestra.run.smithi118.stdout:/home/ubuntu/cephtest/mnt.1 2024-03-27T10:00:26.508 INFO:teuthology.orchestra.run.smithi118.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-03-27T10:00:26.508 INFO:teuthology.orchestra.run.smithi118.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-03-27T10:00:26.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T10:00:26.509 DEBUG:teuthology.orchestra.run.smithi118:> ls /sys/fs/fuse/connections 2024-03-27T10:00:26.560 INFO:teuthology.orchestra.run.smithi118.stdout:41 2024-03-27T10:00:26.560 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [41] 2024-03-27T10:00:26.560 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2024-03-27T10:00:26.566 DEBUG:teuthology.orchestra.run.smithi118:> sudo modprobe fuse 2024-03-27T10:00:26.648 DEBUG:teuthology.orchestra.run.smithi118:> cat /proc/self/mounts | awk '{print $2}' 2024-03-27T10:00:26.688 INFO:teuthology.orchestra.run.smithi118.stdout:/proc 2024-03-27T10:00:26.688 INFO:teuthology.orchestra.run.smithi118.stdout:/sys 2024-03-27T10:00:26.689 INFO:teuthology.orchestra.run.smithi118.stdout:/dev 2024-03-27T10:00:26.689 INFO:teuthology.orchestra.run.smithi118.stdout:/sys/kernel/security 2024-03-27T10:00:26.689 INFO:teuthology.orchestra.run.smithi118.stdout:/dev/shm 2024-03-27T10:00:26.689 INFO:teuthology.orchestra.run.smithi118.stdout:/dev/pts 2024-03-27T10:00:26.689 INFO:teuthology.orchestra.run.smithi118.stdout:/run 2024-03-27T10:00:26.689 INFO:teuthology.orchestra.run.smithi118.stdout:/sys/fs/cgroup 2024-03-27T10:00:26.689 INFO:teuthology.orchestra.run.smithi118.stdout:/sys/fs/pstore 2024-03-27T10:00:26.689 INFO:teuthology.orchestra.run.smithi118.stdout:/sys/fs/bpf 2024-03-27T10:00:26.689 INFO:teuthology.orchestra.run.smithi118.stdout:/ 2024-03-27T10:00:26.689 INFO:teuthology.orchestra.run.smithi118.stdout:/sys/fs/selinux 2024-03-27T10:00:26.689 INFO:teuthology.orchestra.run.smithi118.stdout:/proc/sys/fs/binfmt_misc 2024-03-27T10:00:26.689 INFO:teuthology.orchestra.run.smithi118.stdout:/dev/mqueue 2024-03-27T10:00:26.689 INFO:teuthology.orchestra.run.smithi118.stdout:/dev/hugepages 2024-03-27T10:00:26.689 INFO:teuthology.orchestra.run.smithi118.stdout:/sys/kernel/debug 2024-03-27T10:00:26.690 INFO:teuthology.orchestra.run.smithi118.stdout:/sys/kernel/tracing 2024-03-27T10:00:26.690 INFO:teuthology.orchestra.run.smithi118.stdout:/sys/kernel/config 2024-03-27T10:00:26.690 INFO:teuthology.orchestra.run.smithi118.stdout:/sys/fs/fuse/connections 2024-03-27T10:00:26.690 INFO:teuthology.orchestra.run.smithi118.stdout:/run/credentials/systemd-sysctl.service 2024-03-27T10:00:26.690 INFO:teuthology.orchestra.run.smithi118.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-27T10:00:26.690 INFO:teuthology.orchestra.run.smithi118.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-27T10:00:26.690 INFO:teuthology.orchestra.run.smithi118.stdout:/var/lib/nfs/rpc_pipefs 2024-03-27T10:00:26.690 INFO:teuthology.orchestra.run.smithi118.stdout:/run/user/1000 2024-03-27T10:00:26.690 INFO:teuthology.orchestra.run.smithi118.stdout:/var/lib/ceph 2024-03-27T10:00:26.690 INFO:teuthology.orchestra.run.smithi118.stdout:/var/lib/ceph/osd/ceph-4 2024-03-27T10:00:26.690 INFO:teuthology.orchestra.run.smithi118.stdout:/var/lib/ceph/osd/ceph-5 2024-03-27T10:00:26.690 INFO:teuthology.orchestra.run.smithi118.stdout:/var/lib/ceph/osd/ceph-6 2024-03-27T10:00:26.690 INFO:teuthology.orchestra.run.smithi118.stdout:/var/lib/ceph/osd/ceph-7 2024-03-27T10:00:26.690 INFO:teuthology.orchestra.run.smithi118.stdout:/run/netns 2024-03-27T10:00:26.691 INFO:teuthology.orchestra.run.smithi118.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-27T10:00:26.691 INFO:teuthology.orchestra.run.smithi118.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-27T10:00:26.691 INFO:teuthology.orchestra.run.smithi118.stdout:/home/ubuntu/cephtest/mnt.1 2024-03-27T10:00:26.691 INFO:teuthology.orchestra.run.smithi118.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-03-27T10:00:26.691 INFO:teuthology.orchestra.run.smithi118.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-03-27T10:00:26.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T10:00:26.692 DEBUG:teuthology.orchestra.run.smithi118:> ls /sys/fs/fuse/connections 2024-03-27T10:00:26.756 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi118.stderr:2024-03-27T10:00:26.767+0000 7f6fdb00d480 -1 init, newargv = 0x55f41dbbb430 newargc=15 2024-03-27T10:00:26.757 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi118.stderr:ceph-fuse[42371]: starting ceph client 2024-03-27T10:00:26.767 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi118.stderr:ceph-fuse[42371]: starting fuse 2024-03-27T10:00:26.776 INFO:teuthology.orchestra.run.smithi118.stdout:41 2024-03-27T10:00:26.776 INFO:teuthology.orchestra.run.smithi118.stdout:43 2024-03-27T10:00:26.776 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41, 43] 2024-03-27T10:00:26.776 DEBUG:teuthology.orchestra.run.smithi118:> sudo stdin-killer -- python3 -c ' 2024-03-27T10:00:26.776 DEBUG:teuthology.orchestra.run.smithi118:> import glob 2024-03-27T10:00:26.776 DEBUG:teuthology.orchestra.run.smithi118:> import re 2024-03-27T10:00:26.776 DEBUG:teuthology.orchestra.run.smithi118:> import os 2024-03-27T10:00:26.776 DEBUG:teuthology.orchestra.run.smithi118:> import subprocess 2024-03-27T10:00:26.776 DEBUG:teuthology.orchestra.run.smithi118:> 2024-03-27T10:00:26.777 DEBUG:teuthology.orchestra.run.smithi118:> def _find_admin_socket(client_name): 2024-03-27T10:00:26.777 DEBUG:teuthology.orchestra.run.smithi118:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2024-03-27T10:00:26.777 DEBUG:teuthology.orchestra.run.smithi118:> files = glob.glob(asok_path) 2024-03-27T10:00:26.777 DEBUG:teuthology.orchestra.run.smithi118:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2024-03-27T10:00:26.777 DEBUG:teuthology.orchestra.run.smithi118:> 2024-03-27T10:00:26.777 DEBUG:teuthology.orchestra.run.smithi118:> # Given a non-glob path, it better be there 2024-03-27T10:00:26.777 DEBUG:teuthology.orchestra.run.smithi118:> if "*" not in asok_path: 2024-03-27T10:00:26.777 DEBUG:teuthology.orchestra.run.smithi118:> assert(len(files) == 1) 2024-03-27T10:00:26.777 DEBUG:teuthology.orchestra.run.smithi118:> return files[0] 2024-03-27T10:00:26.777 DEBUG:teuthology.orchestra.run.smithi118:> 2024-03-27T10:00:26.777 DEBUG:teuthology.orchestra.run.smithi118:> for f in files: 2024-03-27T10:00:26.777 DEBUG:teuthology.orchestra.run.smithi118:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-03-27T10:00:26.777 DEBUG:teuthology.orchestra.run.smithi118:> if os.path.exists("/proc/{0}".format(pid)): 2024-03-27T10:00:26.777 DEBUG:teuthology.orchestra.run.smithi118:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-03-27T10:00:26.777 DEBUG:teuthology.orchestra.run.smithi118:> contents = proc_f.read() 2024-03-27T10:00:26.777 DEBUG:teuthology.orchestra.run.smithi118:> if mountpoint in contents: 2024-03-27T10:00:26.777 DEBUG:teuthology.orchestra.run.smithi118:> return f 2024-03-27T10:00:26.778 DEBUG:teuthology.orchestra.run.smithi118:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-03-27T10:00:26.778 DEBUG:teuthology.orchestra.run.smithi118:> 2024-03-27T10:00:26.778 DEBUG:teuthology.orchestra.run.smithi118:> print(_find_admin_socket("client.3")) 2024-03-27T10:00:26.778 DEBUG:teuthology.orchestra.run.smithi118:> ' 2024-03-27T10:00:26.967 INFO:teuthology.orchestra.run.smithi118.stdout:/var/run/ceph/ceph-client.3.42371.asok 2024-03-27T10:00:26.971 INFO:teuthology.orchestra.run.smithi118.stderr:2024-03-27T10:00:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-27T10:00:26.983 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.42371.asok 2024-03-27T10:00:26.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T10:00:26.983 DEBUG:teuthology.orchestra.run.smithi118:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.42371.asok status 2024-03-27T10:00:27.222 INFO:teuthology.orchestra.run.smithi118.stdout:{ 2024-03-27T10:00:27.222 INFO:teuthology.orchestra.run.smithi118.stdout: "metadata": { 2024-03-27T10:00:27.222 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph_sha1": "155268c4e432a12433aa833f174f9fe3b1016ae0", 2024-03-27T10:00:27.222 INFO:teuthology.orchestra.run.smithi118.stdout: "ceph_version": "ceph version 19.0.0-2478-g155268c4 (155268c4e432a12433aa833f174f9fe3b1016ae0) squid (dev)", 2024-03-27T10:00:27.222 INFO:teuthology.orchestra.run.smithi118.stdout: "entity_id": "3", 2024-03-27T10:00:27.222 INFO:teuthology.orchestra.run.smithi118.stdout: "hostname": "smithi118", 2024-03-27T10:00:27.223 INFO:teuthology.orchestra.run.smithi118.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2024-03-27T10:00:27.223 INFO:teuthology.orchestra.run.smithi118.stdout: "pid": "42371", 2024-03-27T10:00:27.223 INFO:teuthology.orchestra.run.smithi118.stdout: "root": "/" 2024-03-27T10:00:27.223 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-03-27T10:00:27.223 INFO:teuthology.orchestra.run.smithi118.stdout: "dentry_count": 0, 2024-03-27T10:00:27.223 INFO:teuthology.orchestra.run.smithi118.stdout: "dentry_pinned_count": 0, 2024-03-27T10:00:27.223 INFO:teuthology.orchestra.run.smithi118.stdout: "id": 4598, 2024-03-27T10:00:27.223 INFO:teuthology.orchestra.run.smithi118.stdout: "inst": { 2024-03-27T10:00:27.223 INFO:teuthology.orchestra.run.smithi118.stdout: "name": { 2024-03-27T10:00:27.223 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "client", 2024-03-27T10:00:27.223 INFO:teuthology.orchestra.run.smithi118.stdout: "num": 4598 2024-03-27T10:00:27.223 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-03-27T10:00:27.223 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": { 2024-03-27T10:00:27.223 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-03-27T10:00:27.223 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "192.168.0.2:0", 2024-03-27T10:00:27.223 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1917723993 2024-03-27T10:00:27.224 INFO:teuthology.orchestra.run.smithi118.stdout: } 2024-03-27T10:00:27.224 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-03-27T10:00:27.224 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": { 2024-03-27T10:00:27.224 INFO:teuthology.orchestra.run.smithi118.stdout: "type": "v1", 2024-03-27T10:00:27.224 INFO:teuthology.orchestra.run.smithi118.stdout: "addr": "192.168.0.2:0", 2024-03-27T10:00:27.224 INFO:teuthology.orchestra.run.smithi118.stdout: "nonce": 1917723993 2024-03-27T10:00:27.224 INFO:teuthology.orchestra.run.smithi118.stdout: }, 2024-03-27T10:00:27.224 INFO:teuthology.orchestra.run.smithi118.stdout: "inst_str": "client.4598 192.168.0.2:0/1917723993", 2024-03-27T10:00:27.224 INFO:teuthology.orchestra.run.smithi118.stdout: "addr_str": "192.168.0.2:0/1917723993", 2024-03-27T10:00:27.224 INFO:teuthology.orchestra.run.smithi118.stdout: "inode_count": 1, 2024-03-27T10:00:27.224 INFO:teuthology.orchestra.run.smithi118.stdout: "mds_epoch": 9, 2024-03-27T10:00:27.224 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_epoch": 28, 2024-03-27T10:00:27.224 INFO:teuthology.orchestra.run.smithi118.stdout: "osd_epoch_barrier": 0, 2024-03-27T10:00:27.224 INFO:teuthology.orchestra.run.smithi118.stdout: "blocklisted": false, 2024-03-27T10:00:27.224 INFO:teuthology.orchestra.run.smithi118.stdout: "fs_name": "cephfs" 2024-03-27T10:00:27.224 INFO:teuthology.orchestra.run.smithi118.stdout:} 2024-03-27T10:00:27.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T10:00:27.236 DEBUG:teuthology.orchestra.run.smithi057:> stat --file-system '--printf=%T 2024-03-27T10:00:27.237 DEBUG:teuthology.orchestra.run.smithi057:> ' -- /home/ubuntu/cephtest/mnt.0 2024-03-27T10:00:27.298 INFO:teuthology.orchestra.run.smithi057.stdout:fuseblk 2024-03-27T10:00:27.298 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-03-27T10:00:27.299 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T10:00:27.299 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-03-27T10:00:27.408 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T10:00:27.408 DEBUG:teuthology.orchestra.run.smithi057:> stat --file-system '--printf=%T 2024-03-27T10:00:27.409 DEBUG:teuthology.orchestra.run.smithi057:> ' -- /home/ubuntu/cephtest/mnt.2 2024-03-27T10:00:27.465 INFO:teuthology.orchestra.run.smithi057.stdout:fuseblk 2024-03-27T10:00:27.465 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2024-03-27T10:00:27.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T10:00:27.466 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-03-27T10:00:27.570 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T10:00:27.570 DEBUG:teuthology.orchestra.run.smithi118:> stat --file-system '--printf=%T 2024-03-27T10:00:27.571 DEBUG:teuthology.orchestra.run.smithi118:> ' -- /home/ubuntu/cephtest/mnt.1 2024-03-27T10:00:27.626 INFO:teuthology.orchestra.run.smithi118.stdout:fuseblk 2024-03-27T10:00:27.626 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-03-27T10:00:27.627 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T10:00:27.627 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-03-27T10:00:27.712 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T10:00:27.712 DEBUG:teuthology.orchestra.run.smithi118:> stat --file-system '--printf=%T 2024-03-27T10:00:27.712 DEBUG:teuthology.orchestra.run.smithi118:> ' -- /home/ubuntu/cephtest/mnt.3 2024-03-27T10:00:27.763 INFO:teuthology.orchestra.run.smithi118.stdout:fuseblk 2024-03-27T10:00:27.764 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2024-03-27T10:00:27.764 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T10:00:27.764 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-03-27T10:00:27.848 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-03-27T10:00:27.865 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-27T10:00:28.097 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.108+0000 7f3349600640 1 Processor -- start 2024-03-27T10:00:28.098 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.108+0000 7f3349600640 1 -- start start 2024-03-27T10:00:28.100 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.110+0000 7f3349600640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f33440cecd0 0x7f334406dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:28.100 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.110+0000 7f3349600640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f334406e320 0x7f334415c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:28.100 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.110+0000 7f3349600640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33440cf570 con 0x7f33441455a0 2024-03-27T10:00:28.100 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.110+0000 7f3349600640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f334406f2d0 con 0x7f334406e320 2024-03-27T10:00:28.100 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.110+0000 7f3349600640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f33440cf290 con 0x7f33440cecd0 2024-03-27T10:00:28.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.111+0000 7f3348c00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f334406e320 0x7f334415c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:28.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.111+0000 7f3348c00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f334406e320 0x7f334415c3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47296/0 (socket says 172.21.15.57:47296) 2024-03-27T10:00:28.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.111+0000 7f3348c00640 1 -- 172.21.15.57:0/2757115599 learned_addr learned my addr 172.21.15.57:0/2757115599 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:28.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.111+0000 7f333be00640 1 --2- 172.21.15.57:0/2757115599 >> v2:172.21.15.118:3300/0 conn(0x7f33440cecd0 0x7f334406dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:28.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.111+0000 7f3348c00640 1 -- 172.21.15.57:0/2757115599 >> v2:172.21.15.118:3300/0 conn(0x7f33440cecd0 msgr2=0x7f334406dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:28.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.111+0000 7f3348c00640 1 --2- 172.21.15.57:0/2757115599 >> v2:172.21.15.118:3300/0 conn(0x7f33440cecd0 0x7f334406dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:28.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.111+0000 7f3348c00640 1 -- 172.21.15.57:0/2757115599 >> v1:172.21.15.118:6789/0 conn(0x7f33441455a0 legacy=0x7f3344071010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:28.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.111+0000 7f3348c00640 1 -- 172.21.15.57:0/2757115599 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f334406d300 con 0x7f334406e320 2024-03-27T10:00:28.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.112+0000 7f3348c00640 1 --2- 172.21.15.57:0/2757115599 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f334406e320 0x7f334415c3f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f3344072c40 tx=0x7f333c02bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c24cfaeb8ec5d2c server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:28.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.113+0000 7f3343400640 1 -- 172.21.15.57:0/2757115599 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f333c02cb10 con 0x7f334406e320 2024-03-27T10:00:28.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.113+0000 7f3343400640 1 -- 172.21.15.57:0/2757115599 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f333c02ccb0 con 0x7f334406e320 2024-03-27T10:00:28.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.113+0000 7f3343400640 1 -- 172.21.15.57:0/2757115599 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f333c02ce60 con 0x7f334406e320 2024-03-27T10:00:28.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.113+0000 7f3349600640 1 -- 172.21.15.57:0/2757115599 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f334406e320 msgr2=0x7f334415c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:28.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.113+0000 7f3349600640 1 --2- 172.21.15.57:0/2757115599 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f334406e320 0x7f334415c3f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f3344072c40 tx=0x7f333c02bf70 comp rx=0 tx=0).stop 2024-03-27T10:00:28.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.114+0000 7f3349600640 1 -- 172.21.15.57:0/2757115599 shutdown_connections 2024-03-27T10:00:28.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.114+0000 7f3349600640 1 --2- 172.21.15.57:0/2757115599 >> v2:172.21.15.118:3300/0 conn(0x7f33440cecd0 0x7f334406dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:28.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.114+0000 7f3349600640 1 --2- 172.21.15.57:0/2757115599 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f334406e320 0x7f334415c3f0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:28.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.114+0000 7f3349600640 1 -- 172.21.15.57:0/2757115599 >> 172.21.15.57:0/2757115599 conn(0x7f33440b1770 msgr2=0x7f33440b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:28.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.114+0000 7f3349600640 1 -- 172.21.15.57:0/2757115599 shutdown_connections 2024-03-27T10:00:28.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.114+0000 7f3349600640 1 -- 172.21.15.57:0/2757115599 wait complete. 2024-03-27T10:00:28.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.116+0000 7f3349600640 1 Processor -- start 2024-03-27T10:00:28.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.116+0000 7f3349600640 1 -- start start 2024-03-27T10:00:28.107 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.117+0000 7f3349600640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f334406e320 0x7f334413b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:28.107 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.117+0000 7f3349600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f33440cecd0 0x7f33440c49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:28.107 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.117+0000 7f3349600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f33441455a0 0x7f3344143d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:28.107 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.117+0000 7f3349600640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f3344145980 con 0x7f334406e320 2024-03-27T10:00:28.107 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.117+0000 7f3349600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f334406d8c0 con 0x7f33440cecd0 2024-03-27T10:00:28.108 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.117+0000 7f3349600640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f3344071720 con 0x7f33441455a0 2024-03-27T10:00:28.108 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.117+0000 7f3343e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f334406e320 0x7f334413b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:28.108 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.117+0000 7f3343e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f334406e320 0x7f334413b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47298/0 (socket says 172.21.15.57:47298) 2024-03-27T10:00:28.108 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.117+0000 7f3343e00640 1 -- 172.21.15.57:0/3101144988 learned_addr learned my addr 172.21.15.57:0/3101144988 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:28.108 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.117+0000 7f333be00640 1 --2- 172.21.15.57:0/3101144988 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f33440cecd0 0x7f33440c49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:28.108 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.117+0000 7f3348c00640 1 --2- 172.21.15.57:0/3101144988 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f33441455a0 0x7f3344143d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:28.108 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.118+0000 7f3343e00640 1 -- 172.21.15.57:0/3101144988 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f33441455a0 msgr2=0x7f3344143d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:28.108 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.118+0000 7f3343e00640 1 --2- 172.21.15.57:0/3101144988 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f33441455a0 0x7f3344143d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:28.108 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.118+0000 7f3343e00640 1 -- 172.21.15.57:0/3101144988 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f33440cecd0 msgr2=0x7f33440c49e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:28.109 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.118+0000 7f3343e00640 1 --2- 172.21.15.57:0/3101144988 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f33440cecd0 0x7f33440c49e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:28.109 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.118+0000 7f3343e00640 1 -- 172.21.15.57:0/3101144988 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33440c5430 con 0x7f334406e320 2024-03-27T10:00:28.109 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.118+0000 7f3348c00640 1 --2- 172.21.15.57:0/3101144988 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f33441455a0 0x7f3344143d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T10:00:28.109 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.118+0000 7f3343e00640 1 --2- 172.21.15.57:0/3101144988 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f334406e320 0x7f334413b3d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f333400c400 tx=0x7f333400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:28.110 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.118+0000 7f3340c00640 1 -- 172.21.15.57:0/3101144988 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33340052d0 con 0x7f334406e320 2024-03-27T10:00:28.110 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.118+0000 7f3340c00640 1 -- 172.21.15.57:0/3101144988 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3334005490 con 0x7f334406e320 2024-03-27T10:00:28.110 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.118+0000 7f3340c00640 1 -- 172.21.15.57:0/3101144988 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3334007260 con 0x7f334406e320 2024-03-27T10:00:28.110 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.118+0000 7f3349600640 1 -- 172.21.15.57:0/3101144988 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33440c5710 con 0x7f334406e320 2024-03-27T10:00:28.110 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.119+0000 7f3349600640 1 -- 172.21.15.57:0/3101144988 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33440c5cd0 con 0x7f334406e320 2024-03-27T10:00:28.110 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.120+0000 7f3349600640 1 -- 172.21.15.57:0/3101144988 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33440c5f10 con 0x7f334406e320 2024-03-27T10:00:28.110 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.121+0000 7f3340c00640 1 -- 172.21.15.57:0/3101144988 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f3334007400 con 0x7f334406e320 2024-03-27T10:00:28.111 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.121+0000 7f3340c00640 1 --2- 172.21.15.57:0/3101144988 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f332006c530 0x7f332006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:28.111 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.122+0000 7f3340c00640 1 -- 172.21.15.57:0/3101144988 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f333408b060 con 0x7f334406e320 2024-03-27T10:00:28.111 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.122+0000 7f333be00640 1 --2- 172.21.15.57:0/3101144988 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f332006c530 0x7f332006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:28.112 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.123+0000 7f333be00640 1 --2- 172.21.15.57:0/3101144988 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f332006c530 0x7f332006e9f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f33441412d0 tx=0x7f332c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:28.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.126+0000 7f3340c00640 1 -- 172.21.15.57:0/3101144988 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f3334059270 con 0x7f334406e320 2024-03-27T10:00:28.320 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.331+0000 7f3349600640 1 -- 172.21.15.57:0/3101144988 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f33440ccc80 con 0x7f334406e320 2024-03-27T10:00:28.323 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.334+0000 7f3340c00640 1 -- 172.21.15.57:0/3101144988 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) ==== 74+0+18888 (secure 0 0 0) 0x7f3334058b70 con 0x7f334406e320 2024-03-27T10:00:28.324 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:00:28.324 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":28,"fsid":"7ac43f86-2c16-4a97-98fb-715d3cebc75c","created":"2024-03-27T09:59:04.033417+0000","modified":"2024-03-27T10:00:10.462391+0000","last_up_change":"2024-03-27T09:59:16.969624+0000","last_in_change":"2024-03-27T09:59:07.421690+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-27T09:59:17.253008+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-27T09:59:26.690365+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-27T09:59:27.559059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-27T09:59:31.187596+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"47b44362-7302-4f2a-b735-582c6c3850cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6801","nonce":2020036298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6803","nonce":2020036298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6807","nonce":2020036298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6805","nonce":2020036298}]},"public_addr":"172.21.15.57:6801/2020036298","cluster_addr":"172.21.15.57:6803/2020036298","heartbeat_back_addr":"172.21.15.57:6807/2020036298","heartbeat_front_addr":"172.21.15.57:6805/2020036298","state":["exists","up"]},{"osd":1,"uuid":"feaf96f0-9431-4188-9a09-da505b40e934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6809","nonce":3190929242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6811","nonce":3190929242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6815","nonce":3190929242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6813","nonce":3190929242}]},"public_addr":"172.21.15.57:6809/3190929242","cluster_addr":"172.21.15.57:6811/3190929242","heartbeat_back_addr":"172.21.15.57:6815/3190929242","heartbeat_front_addr":"172.21.15.57:6813/3190929242","state":["exists","up"]},{"osd":2,"uuid":"21e406e6-cfbc-4fe7-a816-e2420487c95d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6817","nonce":4065849973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6819","nonce":4065849973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6823","nonce":4065849973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6821","nonce":4065849973}]},"public_addr":"172.21.15.57:6817/4065849973","cluster_addr":"172.21.15.57:6819/4065849973","heartbeat_back_addr":"172.21.15.57:6823/4065849973","heartbeat_front_addr":"172.21.15.57:6821/4065849973","state":["exists","up"]},{"osd":3,"uuid":"a389af1d-76c4-4dfc-b215-f983f4931257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6825","nonce":158084809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6827","nonce":158084809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6831","nonce":158084809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6829","nonce":158084809}]},"public_addr":"172.21.15.57:6825/158084809","cluster_addr":"172.21.15.57:6827/158084809","heartbeat_back_addr":"172.21.15.57:6831/158084809","heartbeat_front_addr":"172.21.15.57:6829/158084809","state":["exists","up"]},{"osd":4,"uuid":"e9b05dca-557a-43ee-b43f-9ce5b7d28304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6823","nonce":108719401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6827","nonce":108719401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6831","nonce":108719401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6829","nonce":108719401}]},"public_addr":"172.21.15.118:6823/108719401","cluster_addr":"172.21.15.118:6827/108719401","heartbeat_back_addr":"172.21.15.118:6831/108719401","heartbeat_front_addr":"172.21.15.118:6829/108719401","state":["exists","up"]},{"osd":5,"uuid":"d968177d-44ff-499a-b00a-b147ed879253","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6817","nonce":2704605866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6819","nonce":2704605866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6826","nonce":2704605866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6822","nonce":2704605866}]},"public_addr":"172.21.15.118:6817/2704605866","cluster_addr":"172.21.15.118:6819/2704605866","heartbeat_back_addr":"172.21.15.118:6826/2704605866","heartbeat_front_addr":"172.21.15.118:6822/2704605866","state":["exists","up"]},{"osd":6,"uuid":"e8f98052-e6ad-4cfe-a4a9-0b17a434d54e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6801","nonce":1963659095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6803","nonce":1963659095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6807","nonce":1963659095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6805","nonce":1963659095}]},"public_addr":"172.21.15.118:6801/1963659095","cluster_addr":"172.21.15.118:6803/1963659095","heartbeat_back_addr":"172.21.15.118:6807/1963659095","heartbeat_front_addr":"172.21.15.118:6805/1963659095","state":["exists","up"]},{"osd":7,"uuid":"eccff987-8e51-4a63-845a-cf0a3196d7fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6809","nonce":1955879596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6811","nonce":1955879596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6815","nonce":1955879596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6813","nonce":1955879596}]},"public_addr":"172.21.15.118:6809/1955879596","cluster_addr":"172.21.15.118:6811/1955879596","heartbeat_back_addr":"172.21.15.118:6815/1955879596","heartbeat_front_addr":"172.21.15.118:6813/1955879596","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.721258+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.696610+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.777895+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.806769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.743259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.845687+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:13.020165+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.722294+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.e","mappings":[{"from":7,"to":1}]},{"pgid":"3.15","mappings":[{"from":3,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-27T10:00:28.326 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.336+0000 7f3349600640 1 -- 172.21.15.57:0/3101144988 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f332006c530 msgr2=0x7f332006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:28.327 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.336+0000 7f3349600640 1 --2- 172.21.15.57:0/3101144988 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f332006c530 0x7f332006e9f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f33441412d0 tx=0x7f332c008040 comp rx=0 tx=0).stop 2024-03-27T10:00:28.327 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.336+0000 7f3349600640 1 -- 172.21.15.57:0/3101144988 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f334406e320 msgr2=0x7f334413b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:28.327 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.336+0000 7f3349600640 1 --2- 172.21.15.57:0/3101144988 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f334406e320 0x7f334413b3d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f333400c400 tx=0x7f333400c8c0 comp rx=0 tx=0).stop 2024-03-27T10:00:28.327 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.337+0000 7f3349600640 1 -- 172.21.15.57:0/3101144988 shutdown_connections 2024-03-27T10:00:28.327 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.337+0000 7f3349600640 1 --2- 172.21.15.57:0/3101144988 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f33441455a0 0x7f3344143d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:28.327 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.337+0000 7f3349600640 1 --2- 172.21.15.57:0/3101144988 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f332006c530 0x7f332006e9f0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:28.327 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.337+0000 7f3349600640 1 --2- 172.21.15.57:0/3101144988 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f33440cecd0 0x7f33440c49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:28.327 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.337+0000 7f3349600640 1 --2- 172.21.15.57:0/3101144988 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f334406e320 0x7f334413b3d0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:28.327 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.337+0000 7f3349600640 1 -- 172.21.15.57:0/3101144988 >> 172.21.15.57:0/3101144988 conn(0x7f33440b1770 msgr2=0x7f33440d03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:28.327 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.337+0000 7f3349600640 1 -- 172.21.15.57:0/3101144988 shutdown_connections 2024-03-27T10:00:28.327 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.337+0000 7f3349600640 1 -- 172.21.15.57:0/3101144988 wait complete. 2024-03-27T10:00:28.348 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-27T09:59:17.253008+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-27T09:59:26.690365+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-27T09:59:27.559059+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-27T09:59:31.187596+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-27T10:00:28.348 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-27T10:00:28.575 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.585+0000 7fb2b2200640 1 Processor -- start 2024-03-27T10:00:28.575 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.585+0000 7fb2b2200640 1 -- start start 2024-03-27T10:00:28.577 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.587+0000 7fb2b2200640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb2ac0d1650 0x7fb2ac0d0960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:28.577 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.587+0000 7fb2b2200640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fb2ac0d0ea0 0x7fb2ac0b7380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:28.577 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.587+0000 7fb2b2200640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2ac0d12b0 con 0x7fb2ac161800 2024-03-27T10:00:28.577 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.587+0000 7fb2b2200640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7fb2ac0b55b0 con 0x7fb2ac0d1650 2024-03-27T10:00:28.577 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.587+0000 7fb2b2200640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7fb2ac0cf6c0 con 0x7fb2ac0d0ea0 2024-03-27T10:00:28.577 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.587+0000 7fb2abe00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb2ac0d1650 0x7fb2ac0d0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:28.577 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.587+0000 7fb2b0e00640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fb2ac161800 0x7fb2ac0b4ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:57026/0 (socket says 172.21.15.57:57026) 2024-03-27T10:00:28.577 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.587+0000 7fb2b0e00640 1 -- 172.21.15.57:0/3494261603 learned_addr learned my addr 172.21.15.57:0/3494261603 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T10:00:28.578 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.588+0000 7fb2b1800640 1 --2- 172.21.15.57:0/3494261603 >> v2:172.21.15.118:3300/0 conn(0x7fb2ac0d0ea0 0x7fb2ac0b7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:28.578 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.588+0000 7fb2abe00640 1 -- 172.21.15.57:0/3494261603 >> v2:172.21.15.118:3300/0 conn(0x7fb2ac0d0ea0 msgr2=0x7fb2ac0b7380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:28.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.588+0000 7fb2ab400640 1 -- 172.21.15.57:0/3494261603 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4130437287 0 0) 0x7fb2a0001110 con 0x7fb2ac161800 2024-03-27T10:00:28.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.588+0000 7fb2abe00640 1 --2- 172.21.15.57:0/3494261603 >> v2:172.21.15.118:3300/0 conn(0x7fb2ac0d0ea0 0x7fb2ac0b7380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:28.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.588+0000 7fb2abe00640 1 -- 172.21.15.57:0/3494261603 >> v1:172.21.15.57:6789/0 conn(0x7fb2ac161800 legacy=0x7fb2ac0b4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:28.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.588+0000 7fb2abe00640 1 -- 172.21.15.57:0/3494261603 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2ac0cf9a0 con 0x7fb2ac0d1650 2024-03-27T10:00:28.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.588+0000 7fb2b1800640 1 --2- 172.21.15.57:0/3494261603 >> v2:172.21.15.118:3300/0 conn(0x7fb2ac0d0ea0 0x7fb2ac0b7380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T10:00:28.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.589+0000 7fb2abe00640 1 --2- 172.21.15.57:0/3494261603 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2ac0d1650 0x7fb2ac0d0960 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac08e490 tx=0x7fb29802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f46a600e95eafc89 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:28.580 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.589+0000 7fb2ab400640 1 -- 172.21.15.57:0/3494261603 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb298035020 con 0x7fb2ac0d1650 2024-03-27T10:00:28.580 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.589+0000 7fb2ab400640 1 -- 172.21.15.57:0/3494261603 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb298031830 con 0x7fb2ac0d1650 2024-03-27T10:00:28.580 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.589+0000 7fb2ab400640 1 -- 172.21.15.57:0/3494261603 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb298031c00 con 0x7fb2ac0d1650 2024-03-27T10:00:28.580 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.590+0000 7fb2b2200640 1 -- 172.21.15.57:0/3494261603 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2ac0d1650 msgr2=0x7fb2ac0d0960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:28.580 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.590+0000 7fb2b2200640 1 --2- 172.21.15.57:0/3494261603 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2ac0d1650 0x7fb2ac0d0960 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac08e490 tx=0x7fb29802b8d0 comp rx=0 tx=0).stop 2024-03-27T10:00:28.580 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.590+0000 7fb2b2200640 1 -- 172.21.15.57:0/3494261603 shutdown_connections 2024-03-27T10:00:28.581 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.590+0000 7fb2b2200640 1 --2- 172.21.15.57:0/3494261603 >> v2:172.21.15.118:3300/0 conn(0x7fb2ac0d0ea0 0x7fb2ac0b7380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:28.581 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.590+0000 7fb2b2200640 1 --2- 172.21.15.57:0/3494261603 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2ac0d1650 0x7fb2ac0d0960 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:28.581 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.590+0000 7fb2b2200640 1 -- 172.21.15.57:0/3494261603 >> 172.21.15.57:0/3494261603 conn(0x7fb2ac0d3f70 msgr2=0x7fb2ac0d4380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:28.581 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.590+0000 7fb2b2200640 1 -- 172.21.15.57:0/3494261603 shutdown_connections 2024-03-27T10:00:28.581 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.590+0000 7fb2b2200640 1 -- 172.21.15.57:0/3494261603 wait complete. 2024-03-27T10:00:28.581 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.592+0000 7fb2b2200640 1 Processor -- start 2024-03-27T10:00:28.582 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.592+0000 7fb2b2200640 1 -- start start 2024-03-27T10:00:28.584 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.593+0000 7fb2b2200640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2ac0d0ea0 0x7fb2ac0ccc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:28.584 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.593+0000 7fb2b2200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb2ac0d1650 0x7fb2ac1f3de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:28.584 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.593+0000 7fb2b2200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb2ac161800 0x7fb2ac0cb840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:28.584 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.593+0000 7fb2b2200640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fb2ac0b6e60 con 0x7fb2ac0d0ea0 2024-03-27T10:00:28.584 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.593+0000 7fb2b2200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fb2ac0cff60 con 0x7fb2ac0d1650 2024-03-27T10:00:28.584 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.593+0000 7fb2b2200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fb2ac161be0 con 0x7fb2ac161800 2024-03-27T10:00:28.584 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.594+0000 7fb2b0e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2ac0d0ea0 0x7fb2ac0ccc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:28.584 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.594+0000 7fb2b0e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2ac0d0ea0 0x7fb2ac0ccc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47308/0 (socket says 172.21.15.57:47308) 2024-03-27T10:00:28.584 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.594+0000 7fb2b0e00640 1 -- 172.21.15.57:0/598854017 learned_addr learned my addr 172.21.15.57:0/598854017 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:28.584 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.594+0000 7fb2abe00640 1 --2- 172.21.15.57:0/598854017 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb2ac0d1650 0x7fb2ac1f3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:28.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.594+0000 7fb2b0e00640 1 -- 172.21.15.57:0/598854017 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb2ac161800 msgr2=0x7fb2ac0cb840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:28.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.594+0000 7fb2b0e00640 1 --2- 172.21.15.57:0/598854017 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb2ac161800 0x7fb2ac0cb840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:28.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.594+0000 7fb2b0e00640 1 -- 172.21.15.57:0/598854017 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb2ac0d1650 msgr2=0x7fb2ac1f3de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:28.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.594+0000 7fb2b0e00640 1 --2- 172.21.15.57:0/598854017 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb2ac0d1650 0x7fb2ac1f3de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:28.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.594+0000 7fb2b0e00640 1 -- 172.21.15.57:0/598854017 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2ac1f4680 con 0x7fb2ac0d0ea0 2024-03-27T10:00:28.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.594+0000 7fb2b0e00640 1 --2- 172.21.15.57:0/598854017 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2ac0d0ea0 0x7fb2ac0ccc10 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb2a000c780 tx=0x7fb2a000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:28.586 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.595+0000 7fb2a8c00640 1 -- 172.21.15.57:0/598854017 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2a0018070 con 0x7fb2ac0d0ea0 2024-03-27T10:00:28.586 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.595+0000 7fb2a8c00640 1 -- 172.21.15.57:0/598854017 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2a00072d0 con 0x7fb2ac0d0ea0 2024-03-27T10:00:28.587 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.595+0000 7fb2a8c00640 1 -- 172.21.15.57:0/598854017 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2a00047e0 con 0x7fb2ac0d0ea0 2024-03-27T10:00:28.587 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.595+0000 7fb2b2200640 1 -- 172.21.15.57:0/598854017 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2ac1f4960 con 0x7fb2ac0d0ea0 2024-03-27T10:00:28.587 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.595+0000 7fb2b2200640 1 -- 172.21.15.57:0/598854017 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2ac0cb040 con 0x7fb2ac0d0ea0 2024-03-27T10:00:28.587 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.596+0000 7fb2b2200640 1 -- 172.21.15.57:0/598854017 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2ac0d0cc0 con 0x7fb2ac0d0ea0 2024-03-27T10:00:28.587 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.597+0000 7fb2a8c00640 1 -- 172.21.15.57:0/598854017 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fb2a001b070 con 0x7fb2ac0d0ea0 2024-03-27T10:00:28.587 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.598+0000 7fb2a8c00640 1 --2- 172.21.15.57:0/598854017 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fb28c06c530 0x7fb28c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:28.587 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.598+0000 7fb2a8c00640 1 -- 172.21.15.57:0/598854017 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fb2a008ae70 con 0x7fb2ac0d0ea0 2024-03-27T10:00:28.588 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.598+0000 7fb2abe00640 1 --2- 172.21.15.57:0/598854017 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fb28c06c530 0x7fb28c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:28.588 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.599+0000 7fb2abe00640 1 --2- 172.21.15.57:0/598854017 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fb28c06c530 0x7fb28c06e9f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb298036000 tx=0x7fb298008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:28.592 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.603+0000 7fb2a8c00640 1 -- 172.21.15.57:0/598854017 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7fb2ac0d0cc0 con 0x7fb2ac0d0ea0 2024-03-27T10:00:28.793 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.804+0000 7fb2b2200640 1 -- 172.21.15.57:0/598854017 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fb2ac068c50 con 0x7fb2ac0d0ea0 2024-03-27T10:00:28.794 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.804+0000 7fb2a8c00640 1 -- 172.21.15.57:0/598854017 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) ==== 93+0+10 (secure 0 0 0) 0x7fb2ac0d12b0 con 0x7fb2ac0d0ea0 2024-03-27T10:00:28.794 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2024-03-27T10:00:28.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.807+0000 7fb2b2200640 1 -- 172.21.15.57:0/598854017 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fb28c06c530 msgr2=0x7fb28c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:28.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.807+0000 7fb2b2200640 1 --2- 172.21.15.57:0/598854017 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fb28c06c530 0x7fb28c06e9f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb298036000 tx=0x7fb298008030 comp rx=0 tx=0).stop 2024-03-27T10:00:28.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.807+0000 7fb2b2200640 1 -- 172.21.15.57:0/598854017 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2ac0d0ea0 msgr2=0x7fb2ac0ccc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:28.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.807+0000 7fb2b2200640 1 --2- 172.21.15.57:0/598854017 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2ac0d0ea0 0x7fb2ac0ccc10 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb2a000c780 tx=0x7fb2a000cc40 comp rx=0 tx=0).stop 2024-03-27T10:00:28.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.807+0000 7fb2b2200640 1 -- 172.21.15.57:0/598854017 shutdown_connections 2024-03-27T10:00:28.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.807+0000 7fb2b2200640 1 --2- 172.21.15.57:0/598854017 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb2ac161800 0x7fb2ac0cb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:28.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.807+0000 7fb2b2200640 1 --2- 172.21.15.57:0/598854017 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fb28c06c530 0x7fb28c06e9f0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:28.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.807+0000 7fb2b2200640 1 --2- 172.21.15.57:0/598854017 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb2ac0d1650 0x7fb2ac1f3de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:28.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.807+0000 7fb2b2200640 1 --2- 172.21.15.57:0/598854017 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2ac0d0ea0 0x7fb2ac0ccc10 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:28.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.807+0000 7fb2b2200640 1 -- 172.21.15.57:0/598854017 >> 172.21.15.57:0/598854017 conn(0x7fb2ac0d3f70 msgr2=0x7fb2ac0b4d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:28.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.807+0000 7fb2b2200640 1 -- 172.21.15.57:0/598854017 shutdown_connections 2024-03-27T10:00:28.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:28.807+0000 7fb2b2200640 1 -- 172.21.15.57:0/598854017 wait complete. 2024-03-27T10:00:28.815 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-27T10:00:29.031 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.041+0000 7fb00b000640 1 Processor -- start 2024-03-27T10:00:29.031 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.041+0000 7fb00b000640 1 -- start start 2024-03-27T10:00:29.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.043+0000 7fb00b000640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb0041458e0 0x7fb00406d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:29.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.043+0000 7fb00b000640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb00415fa90 0x7fb00415fef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:29.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.043+0000 7fb00b000640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0040ca330 con 0x7fb0040cb0f0 2024-03-27T10:00:29.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.043+0000 7fb00b000640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7fb004160430 con 0x7fb00415fa90 2024-03-27T10:00:29.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.043+0000 7fb00b000640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fb0040ca610 con 0x7fb0041458e0 2024-03-27T10:00:29.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.043+0000 7fb009200640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb00415fa90 0x7fb00415fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:29.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.043+0000 7fb009200640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb00415fa90 0x7fb00415fef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47310/0 (socket says 172.21.15.57:47310) 2024-03-27T10:00:29.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.043+0000 7fb009200640 1 -- 172.21.15.57:0/1322766304 learned_addr learned my addr 172.21.15.57:0/1322766304 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:29.034 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.044+0000 7fb009c00640 1 --2- 172.21.15.57:0/1322766304 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb0041458e0 0x7fb00406d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:29.034 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.044+0000 7fb009200640 1 -- 172.21.15.57:0/1322766304 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb0041458e0 msgr2=0x7fb00406d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:29.034 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.044+0000 7fb009200640 1 --2- 172.21.15.57:0/1322766304 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb0041458e0 0x7fb00406d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:29.034 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.044+0000 7fb009200640 1 -- 172.21.15.57:0/1322766304 >> v1:172.21.15.118:6789/0 conn(0x7fb0040cb0f0 legacy=0x7fb0040cb540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:29.034 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.044+0000 7fb009200640 1 -- 172.21.15.57:0/1322766304 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0040ca8f0 con 0x7fb00415fa90 2024-03-27T10:00:29.034 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.044+0000 7fb009c00640 1 --2- 172.21.15.57:0/1322766304 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb0041458e0 0x7fb00406d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T10:00:29.036 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.047+0000 7fb009200640 1 --2- 172.21.15.57:0/1322766304 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb00415fa90 0x7fb00415fef0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7faff0009870 tx=0x7faff002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc2b12c5ef129408 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:29.037 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.047+0000 7fb003e00640 1 -- 172.21.15.57:0/1322766304 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faff0034070 con 0x7fb00415fa90 2024-03-27T10:00:29.037 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.047+0000 7fb003e00640 1 -- 172.21.15.57:0/1322766304 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faff0030840 con 0x7fb00415fa90 2024-03-27T10:00:29.037 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.047+0000 7fb003e00640 1 -- 172.21.15.57:0/1322766304 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faff0030c10 con 0x7fb00415fa90 2024-03-27T10:00:29.038 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.048+0000 7fb00b000640 1 -- 172.21.15.57:0/1322766304 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb00415fa90 msgr2=0x7fb00415fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:29.038 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.048+0000 7fb00b000640 1 --2- 172.21.15.57:0/1322766304 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb00415fa90 0x7fb00415fef0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7faff0009870 tx=0x7faff002b980 comp rx=0 tx=0).stop 2024-03-27T10:00:29.038 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.048+0000 7fb00b000640 1 -- 172.21.15.57:0/1322766304 shutdown_connections 2024-03-27T10:00:29.038 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.048+0000 7fb00b000640 1 --2- 172.21.15.57:0/1322766304 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb00415fa90 0x7fb00415fef0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:29.038 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.048+0000 7fb00b000640 1 --2- 172.21.15.57:0/1322766304 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb0041458e0 0x7fb00406d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:29.038 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.048+0000 7fb00b000640 1 -- 172.21.15.57:0/1322766304 >> 172.21.15.57:0/1322766304 conn(0x7fb0040cfb40 msgr2=0x7fb0040cff20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:29.038 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.048+0000 7fb00b000640 1 -- 172.21.15.57:0/1322766304 shutdown_connections 2024-03-27T10:00:29.038 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.048+0000 7fb00b000640 1 -- 172.21.15.57:0/1322766304 wait complete. 2024-03-27T10:00:29.039 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.050+0000 7fb00b000640 1 Processor -- start 2024-03-27T10:00:29.039 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.050+0000 7fb00b000640 1 -- start start 2024-03-27T10:00:29.041 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.051+0000 7fb00b000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb0040cb0f0 0x7fb0041f2a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:29.041 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.051+0000 7fb00b000640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb0041458e0 0x7fb00415e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:29.041 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.051+0000 7fb00b000640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb00415ea10 0x7fb004143720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:29.042 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.051+0000 7fb00b000640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fb0040ce720 con 0x7fb00415ea10 2024-03-27T10:00:29.042 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.051+0000 7fb00b000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fb0040cbc50 con 0x7fb0040cb0f0 2024-03-27T10:00:29.042 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.051+0000 7fb00b000640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fb0040ce8a0 con 0x7fb0041458e0 2024-03-27T10:00:29.042 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.051+0000 7fb00a600640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb00415ea10 0x7fb004143720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:29.042 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.051+0000 7fb00a600640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb00415ea10 0x7fb004143720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47320/0 (socket says 172.21.15.57:47320) 2024-03-27T10:00:29.042 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.052+0000 7fb00a600640 1 -- 172.21.15.57:0/119909703 learned_addr learned my addr 172.21.15.57:0/119909703 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:29.042 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.052+0000 7fb009c00640 1 --2- 172.21.15.57:0/119909703 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb0040cb0f0 0x7fb0041f2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:29.042 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.052+0000 7fb009200640 1 --2- 172.21.15.57:0/119909703 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb0041458e0 0x7fb00415e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:29.042 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.052+0000 7fb00a600640 1 -- 172.21.15.57:0/119909703 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb0041458e0 msgr2=0x7fb00415e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:29.042 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.052+0000 7fb00a600640 1 --2- 172.21.15.57:0/119909703 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb0041458e0 0x7fb00415e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:29.042 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.052+0000 7fb00a600640 1 -- 172.21.15.57:0/119909703 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb0040cb0f0 msgr2=0x7fb0041f2a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:29.042 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.052+0000 7fb00a600640 1 --2- 172.21.15.57:0/119909703 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb0040cb0f0 0x7fb0041f2a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:29.042 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.052+0000 7fb00a600640 1 -- 172.21.15.57:0/119909703 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb00415f040 con 0x7fb00415ea10 2024-03-27T10:00:29.043 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.052+0000 7fb009c00640 1 --2- 172.21.15.57:0/119909703 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb0040cb0f0 0x7fb0041f2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T10:00:29.043 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.052+0000 7fb00a600640 1 --2- 172.21.15.57:0/119909703 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb00415ea10 0x7fb004143720 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7faffc00c7d0 tx=0x7faffc00cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:29.043 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.053+0000 7fb001600640 1 -- 172.21.15.57:0/119909703 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faffc003b70 con 0x7fb00415ea10 2024-03-27T10:00:29.043 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.053+0000 7fb001600640 1 -- 172.21.15.57:0/119909703 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faffc003d30 con 0x7fb00415ea10 2024-03-27T10:00:29.044 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.053+0000 7fb001600640 1 -- 172.21.15.57:0/119909703 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faffc00aa90 con 0x7fb00415ea10 2024-03-27T10:00:29.044 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.053+0000 7fb00b000640 1 -- 172.21.15.57:0/119909703 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0041f5900 con 0x7fb00415ea10 2024-03-27T10:00:29.044 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.053+0000 7fb00b000640 1 -- 172.21.15.57:0/119909703 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0041f5ec0 con 0x7fb00415ea10 2024-03-27T10:00:29.044 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.054+0000 7fb00b000640 1 -- 172.21.15.57:0/119909703 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb004068540 con 0x7fb00415ea10 2024-03-27T10:00:29.045 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.055+0000 7fb001600640 1 -- 172.21.15.57:0/119909703 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7faffc00ac30 con 0x7fb00415ea10 2024-03-27T10:00:29.046 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.056+0000 7fb001600640 1 --2- 172.21.15.57:0/119909703 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fafe406c530 0x7fafe406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:29.046 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.056+0000 7fb001600640 1 -- 172.21.15.57:0/119909703 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7faffc08ba70 con 0x7fb00415ea10 2024-03-27T10:00:29.046 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.057+0000 7fb009c00640 1 --2- 172.21.15.57:0/119909703 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fafe406c530 0x7fafe406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:29.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.057+0000 7fb009c00640 1 --2- 172.21.15.57:0/119909703 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fafe406c530 0x7fafe406e9f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb0040cb720 tx=0x7faff8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:29.050 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.061+0000 7fb001600640 1 -- 172.21.15.57:0/119909703 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7faffc059c80 con 0x7fb00415ea10 2024-03-27T10:00:29.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.269+0000 7fb00b000640 1 -- 172.21.15.57:0/119909703 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fb004141b10 con 0x7fb00415ea10 2024-03-27T10:00:29.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.270+0000 7fb001600640 1 -- 172.21.15.57:0/119909703 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) ==== 104+0+11 (secure 0 0 0) 0x7faffc059580 con 0x7fb00415ea10 2024-03-27T10:00:29.260 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2024-03-27T10:00:29.263 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.273+0000 7fb00b000640 1 -- 172.21.15.57:0/119909703 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fafe406c530 msgr2=0x7fafe406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:29.263 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.273+0000 7fb00b000640 1 --2- 172.21.15.57:0/119909703 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fafe406c530 0x7fafe406e9f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb0040cb720 tx=0x7faff8008040 comp rx=0 tx=0).stop 2024-03-27T10:00:29.263 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.273+0000 7fb00b000640 1 -- 172.21.15.57:0/119909703 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb00415ea10 msgr2=0x7fb004143720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:29.263 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.273+0000 7fb00b000640 1 --2- 172.21.15.57:0/119909703 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb00415ea10 0x7fb004143720 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7faffc00c7d0 tx=0x7faffc00cc90 comp rx=0 tx=0).stop 2024-03-27T10:00:29.263 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.273+0000 7fb00b000640 1 -- 172.21.15.57:0/119909703 shutdown_connections 2024-03-27T10:00:29.263 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.273+0000 7fb00b000640 1 --2- 172.21.15.57:0/119909703 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb00415ea10 0x7fb004143720 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:29.263 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.273+0000 7fb00b000640 1 --2- 172.21.15.57:0/119909703 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb0041458e0 0x7fb00415e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:29.263 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.273+0000 7fb00b000640 1 --2- 172.21.15.57:0/119909703 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fafe406c530 0x7fafe406e9f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:29.263 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.273+0000 7fb00b000640 1 --2- 172.21.15.57:0/119909703 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb0040cb0f0 0x7fb0041f2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:29.263 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.273+0000 7fb00b000640 1 -- 172.21.15.57:0/119909703 >> 172.21.15.57:0/119909703 conn(0x7fb0040cfb40 msgr2=0x7fb004142ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:29.263 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.273+0000 7fb00b000640 1 -- 172.21.15.57:0/119909703 shutdown_connections 2024-03-27T10:00:29.263 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.273+0000 7fb00b000640 1 -- 172.21.15.57:0/119909703 wait complete. 2024-03-27T10:00:29.283 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-27T10:00:29.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.520+0000 7f261f200640 1 Processor -- start 2024-03-27T10:00:29.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.520+0000 7f261f200640 1 -- start start 2024-03-27T10:00:29.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.522+0000 7f261f200640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f26200cee30 0x7f262006d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:29.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.522+0000 7f261f200640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26200ca330 con 0x7f26201601a0 2024-03-27T10:00:29.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.522+0000 7f261f200640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26200ca610 con 0x7f26201458e0 2024-03-27T10:00:29.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.522+0000 7f261f200640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f26200ca8f0 con 0x7f26200cee30 2024-03-27T10:00:29.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.522+0000 7f2615400640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f26201601a0 0x7f26200ce720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:57042/0 (socket says 172.21.15.57:57042) 2024-03-27T10:00:29.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.522+0000 7f2615400640 1 -- 172.21.15.57:0/849110329 learned_addr learned my addr 172.21.15.57:0/849110329 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T10:00:29.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.522+0000 7f261e800640 1 --2- 172.21.15.57:0/849110329 >> v2:172.21.15.57:3300/0 conn(0x7f26200cee30 0x7f262006d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:29.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.523+0000 7f261d400640 1 -- 172.21.15.57:0/849110329 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4071539534 0 0) 0x7f26200ca330 con 0x7f26201601a0 2024-03-27T10:00:29.513 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.523+0000 7f261d400640 1 -- 172.21.15.57:0/849110329 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2604003520 con 0x7f26201601a0 2024-03-27T10:00:29.513 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.523+0000 7f261e800640 1 -- 172.21.15.57:0/849110329 >> v1:172.21.15.118:6789/0 conn(0x7f26201458e0 legacy=0x7f262015fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:29.513 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.523+0000 7f261e800640 1 -- 172.21.15.57:0/849110329 >> v1:172.21.15.57:6789/0 conn(0x7f26201601a0 legacy=0x7f26200ce720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:29.513 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.523+0000 7f261e800640 1 -- 172.21.15.57:0/849110329 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26200cabd0 con 0x7f26200cee30 2024-03-27T10:00:29.513 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.524+0000 7f261e800640 1 --2- 172.21.15.57:0/849110329 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26200cee30 0x7f262006d070 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f26180097a0 tx=0x7f261802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddcc5149aaabd164 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:29.514 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.524+0000 7f261d400640 1 -- 172.21.15.57:0/849110329 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2618034070 con 0x7f26200cee30 2024-03-27T10:00:29.514 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.524+0000 7f261d400640 1 -- 172.21.15.57:0/849110329 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2618030610 con 0x7f26200cee30 2024-03-27T10:00:29.514 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.524+0000 7f261d400640 1 -- 172.21.15.57:0/849110329 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26180309e0 con 0x7f26200cee30 2024-03-27T10:00:29.515 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.525+0000 7f261f200640 1 -- 172.21.15.57:0/849110329 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26200cee30 msgr2=0x7f262006d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:29.515 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.525+0000 7f261f200640 1 --2- 172.21.15.57:0/849110329 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26200cee30 0x7f262006d070 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f26180097a0 tx=0x7f261802b960 comp rx=0 tx=0).stop 2024-03-27T10:00:29.515 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.525+0000 7f261f200640 1 -- 172.21.15.57:0/849110329 shutdown_connections 2024-03-27T10:00:29.515 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.525+0000 7f261f200640 1 --2- 172.21.15.57:0/849110329 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26200cee30 0x7f262006d070 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:29.515 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.525+0000 7f261f200640 1 -- 172.21.15.57:0/849110329 >> 172.21.15.57:0/849110329 conn(0x7f26200cfb40 msgr2=0x7f26200cff20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:29.515 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.525+0000 7f261f200640 1 -- 172.21.15.57:0/849110329 shutdown_connections 2024-03-27T10:00:29.515 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.525+0000 7f261f200640 1 -- 172.21.15.57:0/849110329 wait complete. 2024-03-27T10:00:29.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.527+0000 7f261f200640 1 Processor -- start 2024-03-27T10:00:29.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.527+0000 7f261f200640 1 -- start start 2024-03-27T10:00:29.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.528+0000 7f261f200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f26200cee30 0x7f262015d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:29.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.528+0000 7f261f200640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26201458e0 0x7f26200c7620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:29.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.528+0000 7f261f200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f26201601a0 0x7f2620143c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:29.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.528+0000 7f261f200640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f26200cb4c0 con 0x7f26201458e0 2024-03-27T10:00:29.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.528+0000 7f261f200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f26200cb340 con 0x7f26200cee30 2024-03-27T10:00:29.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.528+0000 7f261f200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f26200cb640 con 0x7f26201601a0 2024-03-27T10:00:29.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.528+0000 7f2615400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26201458e0 0x7f26200c7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:29.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.528+0000 7f2615400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26201458e0 0x7f26200c7620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47332/0 (socket says 172.21.15.57:47332) 2024-03-27T10:00:29.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.528+0000 7f2615400640 1 -- 172.21.15.57:0/3524378020 learned_addr learned my addr 172.21.15.57:0/3524378020 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:29.519 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.529+0000 7f261de00640 1 --2- 172.21.15.57:0/3524378020 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f26200cee30 0x7f262015d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:29.520 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.529+0000 7f261e800640 1 --2- 172.21.15.57:0/3524378020 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f26201601a0 0x7f2620143c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:29.520 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.529+0000 7f2615400640 1 -- 172.21.15.57:0/3524378020 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f26201601a0 msgr2=0x7f2620143c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:29.520 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.529+0000 7f2615400640 1 --2- 172.21.15.57:0/3524378020 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f26201601a0 0x7f2620143c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:29.520 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.529+0000 7f2615400640 1 -- 172.21.15.57:0/3524378020 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f26200cee30 msgr2=0x7f262015d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:29.520 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.529+0000 7f2615400640 1 --2- 172.21.15.57:0/3524378020 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f26200cee30 0x7f262015d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:29.520 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.529+0000 7f2615400640 1 -- 172.21.15.57:0/3524378020 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26200c80e0 con 0x7f26201458e0 2024-03-27T10:00:29.520 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.529+0000 7f261e800640 1 --2- 172.21.15.57:0/3524378020 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f26201601a0 0x7f2620143c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T10:00:29.520 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.529+0000 7f2615400640 1 --2- 172.21.15.57:0/3524378020 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26201458e0 0x7f26200c7620 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f260800c440 tx=0x7f260800c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:29.520 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.529+0000 7f2616a00640 1 -- 172.21.15.57:0/3524378020 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2608017070 con 0x7f26201458e0 2024-03-27T10:00:29.520 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.529+0000 7f2616a00640 1 -- 172.21.15.57:0/3524378020 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2608005ce0 con 0x7f26201458e0 2024-03-27T10:00:29.520 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.529+0000 7f2616a00640 1 -- 172.21.15.57:0/3524378020 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26080072b0 con 0x7f26201458e0 2024-03-27T10:00:29.520 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.529+0000 7f261f200640 1 -- 172.21.15.57:0/3524378020 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2620142ed0 con 0x7f26201458e0 2024-03-27T10:00:29.520 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.530+0000 7f261f200640 1 -- 172.21.15.57:0/3524378020 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2620143490 con 0x7f26201458e0 2024-03-27T10:00:29.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.531+0000 7f261f200640 1 -- 172.21.15.57:0/3524378020 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2620068540 con 0x7f26201458e0 2024-03-27T10:00:29.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.532+0000 7f2616a00640 1 -- 172.21.15.57:0/3524378020 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f260801a070 con 0x7f26201458e0 2024-03-27T10:00:29.522 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.533+0000 7f2616a00640 1 --2- 172.21.15.57:0/3524378020 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f25fc06c530 0x7f25fc06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:29.522 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.533+0000 7f2616a00640 1 -- 172.21.15.57:0/3524378020 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f260808ae40 con 0x7f26201458e0 2024-03-27T10:00:29.522 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.533+0000 7f261de00640 1 --2- 172.21.15.57:0/3524378020 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f25fc06c530 0x7f25fc06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:29.523 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.534+0000 7f261de00640 1 --2- 172.21.15.57:0/3524378020 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f25fc06c530 0x7f25fc06e9f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f262015be20 tx=0x7f2610009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:29.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.537+0000 7f2616a00640 1 -- 172.21.15.57:0/3524378020 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f2608059120 con 0x7f26201458e0 2024-03-27T10:00:29.737 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.748+0000 7f261f200640 1 -- 172.21.15.57:0/3524378020 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f26200cf490 con 0x7f26201458e0 2024-03-27T10:00:29.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.749+0000 7f2616a00640 1 -- 172.21.15.57:0/3524378020 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) ==== 100+0+11 (secure 0 0 0) 0x7f2608058a20 con 0x7f26201458e0 2024-03-27T10:00:29.739 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2024-03-27T10:00:29.742 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.752+0000 7f261f200640 1 -- 172.21.15.57:0/3524378020 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f25fc06c530 msgr2=0x7f25fc06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:29.742 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.752+0000 7f261f200640 1 --2- 172.21.15.57:0/3524378020 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f25fc06c530 0x7f25fc06e9f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f262015be20 tx=0x7f2610009040 comp rx=0 tx=0).stop 2024-03-27T10:00:29.742 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.752+0000 7f261f200640 1 -- 172.21.15.57:0/3524378020 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26201458e0 msgr2=0x7f26200c7620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:29.742 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.752+0000 7f261f200640 1 --2- 172.21.15.57:0/3524378020 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26201458e0 0x7f26200c7620 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f260800c440 tx=0x7f260800c900 comp rx=0 tx=0).stop 2024-03-27T10:00:29.742 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.752+0000 7f261f200640 1 -- 172.21.15.57:0/3524378020 shutdown_connections 2024-03-27T10:00:29.742 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.752+0000 7f261f200640 1 --2- 172.21.15.57:0/3524378020 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f26201601a0 0x7f2620143c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:29.742 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.752+0000 7f261f200640 1 --2- 172.21.15.57:0/3524378020 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26201458e0 0x7f26200c7620 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:29.742 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.752+0000 7f261f200640 1 --2- 172.21.15.57:0/3524378020 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f25fc06c530 0x7f25fc06e9f0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:29.742 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.752+0000 7f261f200640 1 --2- 172.21.15.57:0/3524378020 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f26200cee30 0x7f262015d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:29.742 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.752+0000 7f261f200640 1 -- 172.21.15.57:0/3524378020 >> 172.21.15.57:0/3524378020 conn(0x7f26200cfb40 msgr2=0x7f26200ce680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:29.742 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.752+0000 7f261f200640 1 -- 172.21.15.57:0/3524378020 shutdown_connections 2024-03-27T10:00:29.743 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.752+0000 7f261f200640 1 -- 172.21.15.57:0/3524378020 wait complete. 2024-03-27T10:00:29.763 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-27T10:00:29.973 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.984+0000 7fdcdec00640 1 Processor -- start 2024-03-27T10:00:29.974 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.984+0000 7fdcdec00640 1 -- start start 2024-03-27T10:00:29.975 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.986+0000 7fdcdec00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fdcd815ae80 0x7fdcd80cbcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:29.975 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.986+0000 7fdcdec00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fdcd80cd920 0x7fdcd806ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:29.975 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.986+0000 7fdcdec00640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdcd815b260 con 0x7fdcd806ef50 2024-03-27T10:00:29.976 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.986+0000 7fdcdec00640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7fdcd806f3a0 con 0x7fdcd80cd920 2024-03-27T10:00:29.976 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.986+0000 7fdcdec00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7fdcd80ceaa0 con 0x7fdcd815ae80 2024-03-27T10:00:29.977 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.986+0000 7fdcdce00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fdcd80cd920 0x7fdcd806ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:29.977 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.986+0000 7fdcde200640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fdcd806ef50 0x7fdcd815e970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:57056/0 (socket says 172.21.15.57:57056) 2024-03-27T10:00:29.977 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.986+0000 7fdcde200640 1 -- 172.21.15.57:0/3610331086 learned_addr learned my addr 172.21.15.57:0/3610331086 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T10:00:29.977 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.987+0000 7fdcdd800640 1 --2- 172.21.15.57:0/3610331086 >> v2:172.21.15.118:3300/0 conn(0x7fdcd815ae80 0x7fdcd80cbcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:29.977 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.987+0000 7fdcd7e00640 1 -- 172.21.15.57:0/3610331086 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1536898793 0 0) 0x7fdcd815b260 con 0x7fdcd806ef50 2024-03-27T10:00:29.977 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.987+0000 7fdcdce00640 1 -- 172.21.15.57:0/3610331086 >> v2:172.21.15.118:3300/0 conn(0x7fdcd815ae80 msgr2=0x7fdcd80cbcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:29.977 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.987+0000 7fdcdce00640 1 --2- 172.21.15.57:0/3610331086 >> v2:172.21.15.118:3300/0 conn(0x7fdcd815ae80 0x7fdcd80cbcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:29.977 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.987+0000 7fdcdce00640 1 -- 172.21.15.57:0/3610331086 >> v1:172.21.15.57:6789/0 conn(0x7fdcd806ef50 legacy=0x7fdcd815e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:29.977 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.987+0000 7fdcdce00640 1 -- 172.21.15.57:0/3610331086 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcd80cde90 con 0x7fdcd80cd920 2024-03-27T10:00:29.978 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.988+0000 7fdcdce00640 1 --2- 172.21.15.57:0/3610331086 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdcd80cd920 0x7fdcd806ea10 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fdcc40097a0 tx=0x7fdcc402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc1e3d6c5a332f7 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:29.978 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.988+0000 7fdcd7e00640 1 -- 172.21.15.57:0/3610331086 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcc4035020 con 0x7fdcd80cd920 2024-03-27T10:00:29.978 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.988+0000 7fdcd7e00640 1 -- 172.21.15.57:0/3610331086 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcc4031830 con 0x7fdcd80cd920 2024-03-27T10:00:29.978 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.988+0000 7fdcd7e00640 1 -- 172.21.15.57:0/3610331086 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcc4031c00 con 0x7fdcd80cd920 2024-03-27T10:00:29.979 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.989+0000 7fdcdec00640 1 -- 172.21.15.57:0/3610331086 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdcd80cd920 msgr2=0x7fdcd806ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:29.979 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.989+0000 7fdcdec00640 1 --2- 172.21.15.57:0/3610331086 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdcd80cd920 0x7fdcd806ea10 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fdcc40097a0 tx=0x7fdcc402b8d0 comp rx=0 tx=0).stop 2024-03-27T10:00:29.979 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.989+0000 7fdcdec00640 1 -- 172.21.15.57:0/3610331086 shutdown_connections 2024-03-27T10:00:29.979 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.989+0000 7fdcdec00640 1 --2- 172.21.15.57:0/3610331086 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdcd80cd920 0x7fdcd806ea10 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:29.979 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.989+0000 7fdcdec00640 1 --2- 172.21.15.57:0/3610331086 >> v2:172.21.15.118:3300/0 conn(0x7fdcd815ae80 0x7fdcd80cbcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:29.979 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.989+0000 7fdcdec00640 1 -- 172.21.15.57:0/3610331086 >> 172.21.15.57:0/3610331086 conn(0x7fdcd80cfb40 msgr2=0x7fdcd80cff20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:29.979 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.989+0000 7fdcdec00640 1 -- 172.21.15.57:0/3610331086 shutdown_connections 2024-03-27T10:00:29.979 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.989+0000 7fdcdec00640 1 -- 172.21.15.57:0/3610331086 wait complete. 2024-03-27T10:00:29.980 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.991+0000 7fdcdec00640 1 Processor -- start 2024-03-27T10:00:29.980 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.991+0000 7fdcdec00640 1 -- start start 2024-03-27T10:00:29.981 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.992+0000 7fdcdec00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdcd806ef50 0x7fdcd80b50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:29.982 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.992+0000 7fdcdec00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdcd80cd920 0x7fdcd80b2820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:29.982 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.992+0000 7fdcdec00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdcd815ae80 0x7fdcd81f5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:29.982 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.992+0000 7fdcdec00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fdcd80ce450 con 0x7fdcd815ae80 2024-03-27T10:00:29.982 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.992+0000 7fdcdec00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fdcd80c59f0 con 0x7fdcd80cd920 2024-03-27T10:00:29.982 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.992+0000 7fdcdec00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fdcd80ce730 con 0x7fdcd806ef50 2024-03-27T10:00:29.982 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.992+0000 7fdcde200640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdcd815ae80 0x7fdcd81f5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:29.982 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.992+0000 7fdcde200640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdcd815ae80 0x7fdcd81f5cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47362/0 (socket says 172.21.15.57:47362) 2024-03-27T10:00:29.982 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.992+0000 7fdcde200640 1 -- 172.21.15.57:0/3103871780 learned_addr learned my addr 172.21.15.57:0/3103871780 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:29.983 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.993+0000 7fdcdd800640 1 --2- 172.21.15.57:0/3103871780 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdcd806ef50 0x7fdcd80b50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:29.984 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.993+0000 7fdcdce00640 1 --2- 172.21.15.57:0/3103871780 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdcd80cd920 0x7fdcd80b2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:29.984 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.993+0000 7fdcde200640 1 -- 172.21.15.57:0/3103871780 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdcd806ef50 msgr2=0x7fdcd80b50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:29.984 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.993+0000 7fdcde200640 1 --2- 172.21.15.57:0/3103871780 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdcd806ef50 0x7fdcd80b50d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:29.984 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.993+0000 7fdcde200640 1 -- 172.21.15.57:0/3103871780 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdcd80cd920 msgr2=0x7fdcd80b2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:29.984 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.993+0000 7fdcde200640 1 --2- 172.21.15.57:0/3103871780 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdcd80cd920 0x7fdcd80b2820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:29.984 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.993+0000 7fdcde200640 1 -- 172.21.15.57:0/3103871780 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcd80b3190 con 0x7fdcd815ae80 2024-03-27T10:00:29.984 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.993+0000 7fdcde200640 1 --2- 172.21.15.57:0/3103871780 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdcd815ae80 0x7fdcd81f5cb0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fdcd000c7b0 tx=0x7fdcd000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:29.984 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.993+0000 7fdcd5600640 1 -- 172.21.15.57:0/3103871780 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcd0018070 con 0x7fdcd815ae80 2024-03-27T10:00:29.984 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.993+0000 7fdcd5600640 1 -- 172.21.15.57:0/3103871780 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcd000a640 con 0x7fdcd815ae80 2024-03-27T10:00:29.984 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.993+0000 7fdcd5600640 1 -- 172.21.15.57:0/3103871780 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcd000aa30 con 0x7fdcd815ae80 2024-03-27T10:00:29.984 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.994+0000 7fdcdec00640 1 -- 172.21.15.57:0/3103871780 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcd80b3470 con 0x7fdcd815ae80 2024-03-27T10:00:29.984 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.994+0000 7fdcdec00640 1 -- 172.21.15.57:0/3103871780 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcd80b3a30 con 0x7fdcd815ae80 2024-03-27T10:00:29.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.995+0000 7fdcdec00640 1 -- 172.21.15.57:0/3103871780 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdcd8068540 con 0x7fdcd815ae80 2024-03-27T10:00:29.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.996+0000 7fdcd5600640 1 -- 172.21.15.57:0/3103871780 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fdcd000abd0 con 0x7fdcd815ae80 2024-03-27T10:00:29.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.997+0000 7fdcd5600640 1 --2- 172.21.15.57:0/3103871780 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fdcb806c560 0x7fdcb806ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:29.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.997+0000 7fdcd5600640 1 -- 172.21.15.57:0/3103871780 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fdcd008b0b0 con 0x7fdcd815ae80 2024-03-27T10:00:29.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.997+0000 7fdcdd800640 1 --2- 172.21.15.57:0/3103871780 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fdcb806c560 0x7fdcb806ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:29.987 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:29.998+0000 7fdcdd800640 1 --2- 172.21.15.57:0/3103871780 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fdcb806c560 0x7fdcb806ea20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fdccc006fd0 tx=0x7fdccc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:29.991 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.002+0000 7fdcd5600640 1 -- 172.21.15.57:0/3103871780 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7fdcd0059230 con 0x7fdcd815ae80 2024-03-27T10:00:30.194 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.205+0000 7fdcdec00640 1 -- 172.21.15.57:0/3103871780 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fdcd806d290 con 0x7fdcd815ae80 2024-03-27T10:00:30.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.206+0000 7fdcd5600640 1 -- 172.21.15.57:0/3103871780 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) ==== 103+0+11 (secure 0 0 0) 0x7fdcd0058b30 con 0x7fdcd815ae80 2024-03-27T10:00:30.195 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2024-03-27T10:00:30.199 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.208+0000 7fdcdec00640 1 -- 172.21.15.57:0/3103871780 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fdcb806c560 msgr2=0x7fdcb806ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:30.199 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.208+0000 7fdcdec00640 1 --2- 172.21.15.57:0/3103871780 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fdcb806c560 0x7fdcb806ea20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fdccc006fd0 tx=0x7fdccc008040 comp rx=0 tx=0).stop 2024-03-27T10:00:30.199 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.208+0000 7fdcdec00640 1 -- 172.21.15.57:0/3103871780 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdcd815ae80 msgr2=0x7fdcd81f5cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:30.199 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.208+0000 7fdcdec00640 1 --2- 172.21.15.57:0/3103871780 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdcd815ae80 0x7fdcd81f5cb0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fdcd000c7b0 tx=0x7fdcd000cc70 comp rx=0 tx=0).stop 2024-03-27T10:00:30.199 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.209+0000 7fdcdec00640 1 -- 172.21.15.57:0/3103871780 shutdown_connections 2024-03-27T10:00:30.199 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.209+0000 7fdcdec00640 1 --2- 172.21.15.57:0/3103871780 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdcd815ae80 0x7fdcd81f5cb0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:30.199 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.209+0000 7fdcdec00640 1 --2- 172.21.15.57:0/3103871780 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fdcb806c560 0x7fdcb806ea20 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:30.199 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.209+0000 7fdcdec00640 1 --2- 172.21.15.57:0/3103871780 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdcd80cd920 0x7fdcd80b2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:30.199 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.209+0000 7fdcdec00640 1 --2- 172.21.15.57:0/3103871780 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdcd806ef50 0x7fdcd80b50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:30.199 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.209+0000 7fdcdec00640 1 -- 172.21.15.57:0/3103871780 >> 172.21.15.57:0/3103871780 conn(0x7fdcd80cfb40 msgr2=0x7fdcd806e190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:30.199 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.209+0000 7fdcdec00640 1 -- 172.21.15.57:0/3103871780 shutdown_connections 2024-03-27T10:00:30.199 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.209+0000 7fdcdec00640 1 -- 172.21.15.57:0/3103871780 wait complete. 2024-03-27T10:00:30.218 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-27T10:00:30.440 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.450+0000 7fde91600640 1 Processor -- start 2024-03-27T10:00:30.440 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.451+0000 7fde91600640 1 -- start start 2024-03-27T10:00:30.442 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.452+0000 7fde91600640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fde8c15e2b0 0x7fde8c06ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:30.442 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.452+0000 7fde91600640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde8c162a30 con 0x7fde8c15ded0 2024-03-27T10:00:30.442 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.452+0000 7fde91600640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde8c0b3780 con 0x7fde8c06f120 2024-03-27T10:00:30.442 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.452+0000 7fde91600640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7fde8c162d10 con 0x7fde8c15e2b0 2024-03-27T10:00:30.442 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.453+0000 7fde8aa00640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fde8c15ded0 0x7fde8c0b4260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:57072/0 (socket says 172.21.15.57:57072) 2024-03-27T10:00:30.442 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.453+0000 7fde8aa00640 1 -- 172.21.15.57:0/1441360496 learned_addr learned my addr 172.21.15.57:0/1441360496 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T10:00:30.442 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.453+0000 7fde83e00640 1 --2- 172.21.15.57:0/1441360496 >> v2:172.21.15.57:3300/0 conn(0x7fde8c15e2b0 0x7fde8c06ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:30.443 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.453+0000 7fde83e00640 1 -- 172.21.15.57:0/1441360496 >> v1:172.21.15.118:6789/0 conn(0x7fde8c06f120 legacy=0x7fde8c161d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:30.443 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.453+0000 7fde83e00640 1 -- 172.21.15.57:0/1441360496 >> v1:172.21.15.57:6789/0 conn(0x7fde8c15ded0 legacy=0x7fde8c0b4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:30.443 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.453+0000 7fde8a000640 1 -- 172.21.15.57:0/1441360496 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 76299564 0 0) 0x7fde8c162a30 con 0x7fde8c15ded0 2024-03-27T10:00:30.443 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.453+0000 7fde83e00640 1 -- 172.21.15.57:0/1441360496 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde8c0b3a60 con 0x7fde8c15e2b0 2024-03-27T10:00:30.443 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.454+0000 7fde83e00640 1 --2- 172.21.15.57:0/1441360496 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde8c15e2b0 0x7fde8c06ebe0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fde740097a0 tx=0x7fde7402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c3a6ed20f9b258d server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:30.444 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.455+0000 7fde8a000640 1 -- 172.21.15.57:0/1441360496 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde74035020 con 0x7fde8c15e2b0 2024-03-27T10:00:30.444 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.455+0000 7fde8a000640 1 -- 172.21.15.57:0/1441360496 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde74031830 con 0x7fde8c15e2b0 2024-03-27T10:00:30.444 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.455+0000 7fde8a000640 1 -- 172.21.15.57:0/1441360496 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde74031c00 con 0x7fde8c15e2b0 2024-03-27T10:00:30.445 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.455+0000 7fde91600640 1 -- 172.21.15.57:0/1441360496 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde8c15e2b0 msgr2=0x7fde8c06ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:30.445 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.455+0000 7fde91600640 1 --2- 172.21.15.57:0/1441360496 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde8c15e2b0 0x7fde8c06ebe0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fde740097a0 tx=0x7fde7402b8d0 comp rx=0 tx=0).stop 2024-03-27T10:00:30.445 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.455+0000 7fde91600640 1 -- 172.21.15.57:0/1441360496 shutdown_connections 2024-03-27T10:00:30.445 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.455+0000 7fde91600640 1 --2- 172.21.15.57:0/1441360496 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde8c15e2b0 0x7fde8c06ebe0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:30.445 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.455+0000 7fde91600640 1 -- 172.21.15.57:0/1441360496 >> 172.21.15.57:0/1441360496 conn(0x7fde8c0b1c60 msgr2=0x7fde8c0b2070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:30.445 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.455+0000 7fde91600640 1 -- 172.21.15.57:0/1441360496 shutdown_connections 2024-03-27T10:00:30.445 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.455+0000 7fde91600640 1 -- 172.21.15.57:0/1441360496 wait complete. 2024-03-27T10:00:30.446 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.457+0000 7fde91600640 1 Processor -- start 2024-03-27T10:00:30.447 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.457+0000 7fde91600640 1 -- start start 2024-03-27T10:00:30.448 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.458+0000 7fde91600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fde8c06f120 0x7fde8c149230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:30.448 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.458+0000 7fde91600640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde8c15ded0 0x7fde8c1471f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:30.448 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.458+0000 7fde91600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fde8c15e2b0 0x7fde8c0ce740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:30.448 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.458+0000 7fde91600640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fde8c06f570 con 0x7fde8c15ded0 2024-03-27T10:00:30.448 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.458+0000 7fde91600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fde8c162710 con 0x7fde8c15e2b0 2024-03-27T10:00:30.448 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.458+0000 7fde91600640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fde8c0b3dd0 con 0x7fde8c06f120 2024-03-27T10:00:30.448 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.458+0000 7fde83e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde8c15ded0 0x7fde8c1471f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:30.448 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.458+0000 7fde83e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde8c15ded0 0x7fde8c1471f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47390/0 (socket says 172.21.15.57:47390) 2024-03-27T10:00:30.448 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.459+0000 7fde83e00640 1 -- 172.21.15.57:0/1005156056 learned_addr learned my addr 172.21.15.57:0/1005156056 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:30.450 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.459+0000 7fde8b400640 1 --2- 172.21.15.57:0/1005156056 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fde8c15e2b0 0x7fde8c0ce740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:30.450 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.459+0000 7fde8aa00640 1 --2- 172.21.15.57:0/1005156056 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fde8c06f120 0x7fde8c149230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:30.450 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.459+0000 7fde83e00640 1 -- 172.21.15.57:0/1005156056 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fde8c06f120 msgr2=0x7fde8c149230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:30.450 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.459+0000 7fde83e00640 1 --2- 172.21.15.57:0/1005156056 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fde8c06f120 0x7fde8c149230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:30.450 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.459+0000 7fde83e00640 1 -- 172.21.15.57:0/1005156056 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fde8c15e2b0 msgr2=0x7fde8c0ce740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:30.450 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.459+0000 7fde83e00640 1 --2- 172.21.15.57:0/1005156056 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fde8c15e2b0 0x7fde8c0ce740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:30.450 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.459+0000 7fde83e00640 1 -- 172.21.15.57:0/1005156056 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde8c15ae20 con 0x7fde8c15ded0 2024-03-27T10:00:30.450 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.459+0000 7fde8aa00640 1 --2- 172.21.15.57:0/1005156056 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fde8c06f120 0x7fde8c149230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T10:00:30.451 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.459+0000 7fde83e00640 1 --2- 172.21.15.57:0/1005156056 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde8c15ded0 0x7fde8c1471f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fde740098c0 tx=0x7fde740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:30.451 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.460+0000 7fde82a00640 1 -- 172.21.15.57:0/1005156056 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde7403ba80 con 0x7fde8c15ded0 2024-03-27T10:00:30.451 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.460+0000 7fde82a00640 1 -- 172.21.15.57:0/1005156056 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde7403bc40 con 0x7fde8c15ded0 2024-03-27T10:00:30.451 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.460+0000 7fde82a00640 1 -- 172.21.15.57:0/1005156056 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde740453f0 con 0x7fde8c15ded0 2024-03-27T10:00:30.451 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.460+0000 7fde91600640 1 -- 172.21.15.57:0/1005156056 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde8c15b100 con 0x7fde8c15ded0 2024-03-27T10:00:30.451 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.460+0000 7fde91600640 1 -- 172.21.15.57:0/1005156056 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde8c15b6c0 con 0x7fde8c15ded0 2024-03-27T10:00:30.451 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.461+0000 7fde91600640 1 -- 172.21.15.57:0/1005156056 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde8c068620 con 0x7fde8c15ded0 2024-03-27T10:00:30.451 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.462+0000 7fde82a00640 1 -- 172.21.15.57:0/1005156056 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fde7404c060 con 0x7fde8c15ded0 2024-03-27T10:00:30.453 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.463+0000 7fde82a00640 1 --2- 172.21.15.57:0/1005156056 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fde6806c530 0x7fde6806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:30.453 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.464+0000 7fde82a00640 1 -- 172.21.15.57:0/1005156056 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fde740ad8a0 con 0x7fde8c15ded0 2024-03-27T10:00:30.453 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.464+0000 7fde8aa00640 1 --2- 172.21.15.57:0/1005156056 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fde6806c530 0x7fde6806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:30.454 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.464+0000 7fde8aa00640 1 --2- 172.21.15.57:0/1005156056 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fde6806c530 0x7fde6806e9f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fde7c000f60 tx=0x7fde7c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:30.458 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.468+0000 7fde82a00640 1 -- 172.21.15.57:0/1005156056 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7fde74040070 con 0x7fde8c15ded0 2024-03-27T10:00:30.661 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.672+0000 7fde91600640 1 -- 172.21.15.57:0/1005156056 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fde8c0712a0 con 0x7fde8c15ded0 2024-03-27T10:00:30.664 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.674+0000 7fde82a00640 1 -- 172.21.15.57:0/1005156056 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) ==== 74+0+18888 (secure 0 0 0) 0x7fde7407ba20 con 0x7fde8c15ded0 2024-03-27T10:00:30.665 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:00:30.665 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":28,"fsid":"7ac43f86-2c16-4a97-98fb-715d3cebc75c","created":"2024-03-27T09:59:04.033417+0000","modified":"2024-03-27T10:00:10.462391+0000","last_up_change":"2024-03-27T09:59:16.969624+0000","last_in_change":"2024-03-27T09:59:07.421690+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-27T09:59:17.253008+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-27T09:59:26.690365+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-27T09:59:27.559059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-27T09:59:31.187596+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"47b44362-7302-4f2a-b735-582c6c3850cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6801","nonce":2020036298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6803","nonce":2020036298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6807","nonce":2020036298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6805","nonce":2020036298}]},"public_addr":"172.21.15.57:6801/2020036298","cluster_addr":"172.21.15.57:6803/2020036298","heartbeat_back_addr":"172.21.15.57:6807/2020036298","heartbeat_front_addr":"172.21.15.57:6805/2020036298","state":["exists","up"]},{"osd":1,"uuid":"feaf96f0-9431-4188-9a09-da505b40e934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6809","nonce":3190929242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6811","nonce":3190929242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6815","nonce":3190929242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6813","nonce":3190929242}]},"public_addr":"172.21.15.57:6809/3190929242","cluster_addr":"172.21.15.57:6811/3190929242","heartbeat_back_addr":"172.21.15.57:6815/3190929242","heartbeat_front_addr":"172.21.15.57:6813/3190929242","state":["exists","up"]},{"osd":2,"uuid":"21e406e6-cfbc-4fe7-a816-e2420487c95d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6817","nonce":4065849973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6819","nonce":4065849973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6823","nonce":4065849973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6821","nonce":4065849973}]},"public_addr":"172.21.15.57:6817/4065849973","cluster_addr":"172.21.15.57:6819/4065849973","heartbeat_back_addr":"172.21.15.57:6823/4065849973","heartbeat_front_addr":"172.21.15.57:6821/4065849973","state":["exists","up"]},{"osd":3,"uuid":"a389af1d-76c4-4dfc-b215-f983f4931257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6825","nonce":158084809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6827","nonce":158084809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6831","nonce":158084809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6829","nonce":158084809}]},"public_addr":"172.21.15.57:6825/158084809","cluster_addr":"172.21.15.57:6827/158084809","heartbeat_back_addr":"172.21.15.57:6831/158084809","heartbeat_front_addr":"172.21.15.57:6829/158084809","state":["exists","up"]},{"osd":4,"uuid":"e9b05dca-557a-43ee-b43f-9ce5b7d28304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6823","nonce":108719401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6827","nonce":108719401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6831","nonce":108719401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6829","nonce":108719401}]},"public_addr":"172.21.15.118:6823/108719401","cluster_addr":"172.21.15.118:6827/108719401","heartbeat_back_addr":"172.21.15.118:6831/108719401","heartbeat_front_addr":"172.21.15.118:6829/108719401","state":["exists","up"]},{"osd":5,"uuid":"d968177d-44ff-499a-b00a-b147ed879253","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6817","nonce":2704605866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6819","nonce":2704605866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6826","nonce":2704605866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6822","nonce":2704605866}]},"public_addr":"172.21.15.118:6817/2704605866","cluster_addr":"172.21.15.118:6819/2704605866","heartbeat_back_addr":"172.21.15.118:6826/2704605866","heartbeat_front_addr":"172.21.15.118:6822/2704605866","state":["exists","up"]},{"osd":6,"uuid":"e8f98052-e6ad-4cfe-a4a9-0b17a434d54e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6801","nonce":1963659095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6803","nonce":1963659095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6807","nonce":1963659095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6805","nonce":1963659095}]},"public_addr":"172.21.15.118:6801/1963659095","cluster_addr":"172.21.15.118:6803/1963659095","heartbeat_back_addr":"172.21.15.118:6807/1963659095","heartbeat_front_addr":"172.21.15.118:6805/1963659095","state":["exists","up"]},{"osd":7,"uuid":"eccff987-8e51-4a63-845a-cf0a3196d7fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6809","nonce":1955879596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6811","nonce":1955879596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6815","nonce":1955879596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6813","nonce":1955879596}]},"public_addr":"172.21.15.118:6809/1955879596","cluster_addr":"172.21.15.118:6811/1955879596","heartbeat_back_addr":"172.21.15.118:6815/1955879596","heartbeat_front_addr":"172.21.15.118:6813/1955879596","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.721258+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.696610+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.777895+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.806769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.743259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.845687+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:13.020165+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.722294+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.e","mappings":[{"from":7,"to":1}]},{"pgid":"3.15","mappings":[{"from":3,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-27T10:00:30.666 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.677+0000 7fde91600640 1 -- 172.21.15.57:0/1005156056 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fde6806c530 msgr2=0x7fde6806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:30.666 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.677+0000 7fde91600640 1 --2- 172.21.15.57:0/1005156056 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fde6806c530 0x7fde6806e9f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fde7c000f60 tx=0x7fde7c009040 comp rx=0 tx=0).stop 2024-03-27T10:00:30.667 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.677+0000 7fde91600640 1 -- 172.21.15.57:0/1005156056 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde8c15ded0 msgr2=0x7fde8c1471f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:30.667 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.677+0000 7fde91600640 1 --2- 172.21.15.57:0/1005156056 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde8c15ded0 0x7fde8c1471f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fde740098c0 tx=0x7fde740046c0 comp rx=0 tx=0).stop 2024-03-27T10:00:30.667 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.677+0000 7fde91600640 1 -- 172.21.15.57:0/1005156056 shutdown_connections 2024-03-27T10:00:30.667 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.677+0000 7fde91600640 1 --2- 172.21.15.57:0/1005156056 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fde6806c530 0x7fde6806e9f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:30.667 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.677+0000 7fde91600640 1 --2- 172.21.15.57:0/1005156056 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fde8c15e2b0 0x7fde8c0ce740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:30.667 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.677+0000 7fde91600640 1 --2- 172.21.15.57:0/1005156056 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde8c15ded0 0x7fde8c1471f0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:30.667 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.677+0000 7fde91600640 1 --2- 172.21.15.57:0/1005156056 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fde8c06f120 0x7fde8c149230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:30.667 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.677+0000 7fde91600640 1 -- 172.21.15.57:0/1005156056 >> 172.21.15.57:0/1005156056 conn(0x7fde8c0b1c60 msgr2=0x7fde8c071a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:30.667 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.677+0000 7fde91600640 1 -- 172.21.15.57:0/1005156056 shutdown_connections 2024-03-27T10:00:30.667 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.677+0000 7fde91600640 1 -- 172.21.15.57:0/1005156056 wait complete. 2024-03-27T10:00:30.688 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-27T09:59:17.253008+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-27T09:59:26.690365+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-27T09:59:27.559059+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-27T09:59:31.187596+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-27T10:00:30.688 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-27T10:00:30.910 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.920+0000 7f0242000640 1 Processor -- start 2024-03-27T10:00:30.910 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.920+0000 7f0242000640 1 -- start start 2024-03-27T10:00:30.912 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.922+0000 7f0242000640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f023c0b3d80 0x7f023c06d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:30.912 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.922+0000 7f0242000640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f023c0718c0 0x7f023c06dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:30.912 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.922+0000 7f0242000640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f023c0730a0 con 0x7f023c15e430 2024-03-27T10:00:30.912 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.922+0000 7f0242000640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f023c15e810 con 0x7f023c0718c0 2024-03-27T10:00:30.912 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.922+0000 7f0242000640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f023c0b2eb0 con 0x7f023c0b3d80 2024-03-27T10:00:30.912 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.922+0000 7f023be00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f023c0718c0 0x7f023c06dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:30.912 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.923+0000 7f023be00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f023c0718c0 0x7f023c06dd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47396/0 (socket says 172.21.15.57:47396) 2024-03-27T10:00:30.913 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.923+0000 7f023be00640 1 -- 172.21.15.57:0/347998554 learned_addr learned my addr 172.21.15.57:0/347998554 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:30.913 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.923+0000 7f0233e00640 1 --2- 172.21.15.57:0/347998554 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f023c0b3d80 0x7f023c06d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:30.913 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.923+0000 7f023be00640 1 -- 172.21.15.57:0/347998554 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f023c0b3d80 msgr2=0x7f023c06d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:30.913 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.923+0000 7f023be00640 1 --2- 172.21.15.57:0/347998554 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f023c0b3d80 0x7f023c06d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:30.913 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.923+0000 7f023be00640 1 -- 172.21.15.57:0/347998554 >> v1:172.21.15.118:6789/0 conn(0x7f023c15e430 legacy=0x7f023c0711b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:30.913 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.923+0000 7f023be00640 1 -- 172.21.15.57:0/347998554 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f023c073320 con 0x7f023c0718c0 2024-03-27T10:00:30.914 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.924+0000 7f023be00640 1 --2- 172.21.15.57:0/347998554 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f023c0718c0 0x7f023c06dd10 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f0234009e50 tx=0x7f023402be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c9d2695d02da104 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:30.914 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.925+0000 7f023aa00640 1 -- 172.21.15.57:0/347998554 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f023402c9e0 con 0x7f023c0718c0 2024-03-27T10:00:30.914 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.925+0000 7f023aa00640 1 -- 172.21.15.57:0/347998554 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f023402cb80 con 0x7f023c0718c0 2024-03-27T10:00:30.914 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.925+0000 7f023aa00640 1 -- 172.21.15.57:0/347998554 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02340343f0 con 0x7f023c0718c0 2024-03-27T10:00:30.915 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.925+0000 7f0242000640 1 -- 172.21.15.57:0/347998554 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f023c0718c0 msgr2=0x7f023c06dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:30.915 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.925+0000 7f0242000640 1 --2- 172.21.15.57:0/347998554 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f023c0718c0 0x7f023c06dd10 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f0234009e50 tx=0x7f023402be40 comp rx=0 tx=0).stop 2024-03-27T10:00:30.915 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.925+0000 7f0242000640 1 -- 172.21.15.57:0/347998554 shutdown_connections 2024-03-27T10:00:30.915 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.925+0000 7f0242000640 1 --2- 172.21.15.57:0/347998554 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f023c0b3d80 0x7f023c06d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:30.915 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.925+0000 7f0242000640 1 --2- 172.21.15.57:0/347998554 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f023c0718c0 0x7f023c06dd10 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:30.916 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.925+0000 7f0242000640 1 -- 172.21.15.57:0/347998554 >> 172.21.15.57:0/347998554 conn(0x7f023c0b18a0 msgr2=0x7f023c0b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:30.916 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.926+0000 7f0242000640 1 -- 172.21.15.57:0/347998554 shutdown_connections 2024-03-27T10:00:30.916 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.926+0000 7f0242000640 1 -- 172.21.15.57:0/347998554 wait complete. 2024-03-27T10:00:30.917 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.928+0000 7f0242000640 1 Processor -- start 2024-03-27T10:00:30.917 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.928+0000 7f0242000640 1 -- start start 2024-03-27T10:00:30.920 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.929+0000 7f0242000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f023c0718c0 0x7f023c157510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:30.920 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.929+0000 7f0242000640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f023c0b3d80 0x7f023c15ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:30.920 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.929+0000 7f0242000640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f023c15e430 0x7f023c15d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:30.920 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.929+0000 7f0242000640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f023c0b3100 con 0x7f023c0b3d80 2024-03-27T10:00:30.920 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.929+0000 7f0242000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f023c06d340 con 0x7f023c0718c0 2024-03-27T10:00:30.920 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.929+0000 7f0242000640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f023c06eeb0 con 0x7f023c15e430 2024-03-27T10:00:30.921 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.929+0000 7f0233e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f023c0b3d80 0x7f023c15ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:30.921 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.929+0000 7f0233e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f023c0b3d80 0x7f023c15ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47406/0 (socket says 172.21.15.57:47406) 2024-03-27T10:00:30.921 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.929+0000 7f0233e00640 1 -- 172.21.15.57:0/4166335519 learned_addr learned my addr 172.21.15.57:0/4166335519 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:30.921 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.930+0000 7f023be00640 1 --2- 172.21.15.57:0/4166335519 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f023c15e430 0x7f023c15d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:30.921 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.930+0000 7f023b400640 1 --2- 172.21.15.57:0/4166335519 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f023c0718c0 0x7f023c157510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:30.921 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.930+0000 7f0233e00640 1 -- 172.21.15.57:0/4166335519 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f023c15e430 msgr2=0x7f023c15d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:30.921 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.930+0000 7f0233e00640 1 --2- 172.21.15.57:0/4166335519 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f023c15e430 0x7f023c15d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:30.921 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.930+0000 7f0233e00640 1 -- 172.21.15.57:0/4166335519 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f023c0718c0 msgr2=0x7f023c157510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:30.921 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.930+0000 7f0233e00640 1 --2- 172.21.15.57:0/4166335519 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f023c0718c0 0x7f023c157510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:30.921 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.930+0000 7f0233e00640 1 -- 172.21.15.57:0/4166335519 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f023c14f0b0 con 0x7f023c0b3d80 2024-03-27T10:00:30.921 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.930+0000 7f0233e00640 1 --2- 172.21.15.57:0/4166335519 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f023c0b3d80 0x7f023c15ce40 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f022400d7d0 tx=0x7f022400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:30.921 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.931+0000 7f0233400640 1 -- 172.21.15.57:0/4166335519 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f022400b6c0 con 0x7f023c0b3d80 2024-03-27T10:00:30.921 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.931+0000 7f0233400640 1 -- 172.21.15.57:0/4166335519 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0224019070 con 0x7f023c0b3d80 2024-03-27T10:00:30.921 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.931+0000 7f0233400640 1 -- 172.21.15.57:0/4166335519 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f022400ba80 con 0x7f023c0b3d80 2024-03-27T10:00:30.921 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.931+0000 7f0242000640 1 -- 172.21.15.57:0/4166335519 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f023c155d40 con 0x7f023c0b3d80 2024-03-27T10:00:30.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.931+0000 7f0242000640 1 -- 172.21.15.57:0/4166335519 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f023c156300 con 0x7f023c0b3d80 2024-03-27T10:00:30.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.932+0000 7f0242000640 1 -- 172.21.15.57:0/4166335519 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f023c068540 con 0x7f023c0b3d80 2024-03-27T10:00:30.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.933+0000 7f0233400640 1 -- 172.21.15.57:0/4166335519 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f022400bc20 con 0x7f023c0b3d80 2024-03-27T10:00:30.924 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.935+0000 7f0233400640 1 --2- 172.21.15.57:0/4166335519 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f021806c530 0x7f021806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:30.924 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.935+0000 7f0233400640 1 -- 172.21.15.57:0/4166335519 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f022408bf80 con 0x7f023c0b3d80 2024-03-27T10:00:30.924 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.935+0000 7f023b400640 1 --2- 172.21.15.57:0/4166335519 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f021806c530 0x7f021806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:30.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.936+0000 7f023b400640 1 --2- 172.21.15.57:0/4166335519 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f021806c530 0x7f021806e9f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f022c006fd0 tx=0x7f022c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:30.929 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:30.940+0000 7f0233400640 1 -- 172.21.15.57:0/4166335519 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f022405a100 con 0x7f023c0b3d80 2024-03-27T10:00:31.131 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.142+0000 7f0242000640 1 -- 172.21.15.57:0/4166335519 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f023c071530 con 0x7f023c0b3d80 2024-03-27T10:00:31.132 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.143+0000 7f0233400640 1 -- 172.21.15.57:0/4166335519 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) ==== 93+0+10 (secure 0 0 0) 0x7f0224059a00 con 0x7f023c0b3d80 2024-03-27T10:00:31.133 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2024-03-27T10:00:31.136 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.146+0000 7f0242000640 1 -- 172.21.15.57:0/4166335519 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f021806c530 msgr2=0x7f021806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:31.136 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.146+0000 7f0242000640 1 --2- 172.21.15.57:0/4166335519 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f021806c530 0x7f021806e9f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f022c006fd0 tx=0x7f022c008040 comp rx=0 tx=0).stop 2024-03-27T10:00:31.136 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.146+0000 7f0242000640 1 -- 172.21.15.57:0/4166335519 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f023c0b3d80 msgr2=0x7f023c15ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:31.136 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.146+0000 7f0242000640 1 --2- 172.21.15.57:0/4166335519 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f023c0b3d80 0x7f023c15ce40 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f022400d7d0 tx=0x7f022400dc90 comp rx=0 tx=0).stop 2024-03-27T10:00:31.136 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.146+0000 7f0242000640 1 -- 172.21.15.57:0/4166335519 shutdown_connections 2024-03-27T10:00:31.136 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.146+0000 7f0242000640 1 --2- 172.21.15.57:0/4166335519 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f023c15e430 0x7f023c15d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:31.136 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.146+0000 7f0242000640 1 --2- 172.21.15.57:0/4166335519 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f023c0b3d80 0x7f023c15ce40 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:31.136 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.146+0000 7f0242000640 1 --2- 172.21.15.57:0/4166335519 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f021806c530 0x7f021806e9f0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:31.136 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.146+0000 7f0242000640 1 --2- 172.21.15.57:0/4166335519 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f023c0718c0 0x7f023c157510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:31.136 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.146+0000 7f0242000640 1 -- 172.21.15.57:0/4166335519 >> 172.21.15.57:0/4166335519 conn(0x7f023c0b18a0 msgr2=0x7f023c0af1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:31.136 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.146+0000 7f0242000640 1 -- 172.21.15.57:0/4166335519 shutdown_connections 2024-03-27T10:00:31.136 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.146+0000 7f0242000640 1 -- 172.21.15.57:0/4166335519 wait complete. 2024-03-27T10:00:31.156 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-27T10:00:31.382 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.393+0000 7fbd46000640 1 Processor -- start 2024-03-27T10:00:31.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.393+0000 7fbd46000640 1 -- start start 2024-03-27T10:00:31.384 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.395+0000 7fbd46000640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fbd400aea20 0x7fbd4015d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:31.384 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.395+0000 7fbd46000640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbd4006cf30 0x7fbd4006d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:31.384 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.395+0000 7fbd46000640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd400ad1d0 con 0x7fbd400acd60 2024-03-27T10:00:31.384 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.395+0000 7fbd46000640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7fbd4015c4c0 con 0x7fbd4006cf30 2024-03-27T10:00:31.385 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.395+0000 7fbd46000640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7fbd40072600 con 0x7fbd400aea20 2024-03-27T10:00:31.386 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.395+0000 7fbd3fe00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbd4006cf30 0x7fbd4006d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:31.386 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.395+0000 7fbd3fe00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbd4006cf30 0x7fbd4006d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47416/0 (socket says 172.21.15.57:47416) 2024-03-27T10:00:31.386 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.395+0000 7fbd3fe00640 1 -- 172.21.15.57:0/2513178212 learned_addr learned my addr 172.21.15.57:0/2513178212 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:31.386 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.395+0000 7fbd3f400640 1 --2- 172.21.15.57:0/2513178212 >> v2:172.21.15.118:3300/0 conn(0x7fbd400aea20 0x7fbd4015d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:31.386 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.396+0000 7fbd3fe00640 1 -- 172.21.15.57:0/2513178212 >> v2:172.21.15.118:3300/0 conn(0x7fbd400aea20 msgr2=0x7fbd4015d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:31.386 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.396+0000 7fbd3fe00640 1 --2- 172.21.15.57:0/2513178212 >> v2:172.21.15.118:3300/0 conn(0x7fbd400aea20 0x7fbd4015d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:31.386 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.396+0000 7fbd3fe00640 1 -- 172.21.15.57:0/2513178212 >> v1:172.21.15.57:6789/0 conn(0x7fbd400acd60 legacy=0x7fbd400aee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:31.386 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.396+0000 7fbd3fe00640 1 -- 172.21.15.57:0/2513178212 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd400728e0 con 0x7fbd4006cf30 2024-03-27T10:00:31.387 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.398+0000 7fbd3fe00640 1 --2- 172.21.15.57:0/2513178212 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbd4006cf30 0x7fbd4006d310 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fbd400753a0 tx=0x7fbd3802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd070502db9b5eaa server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:31.388 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.398+0000 7fbd3e000640 1 -- 172.21.15.57:0/2513178212 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd3802e070 con 0x7fbd4006cf30 2024-03-27T10:00:31.388 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.398+0000 7fbd3e000640 1 -- 172.21.15.57:0/2513178212 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd38037070 con 0x7fbd4006cf30 2024-03-27T10:00:31.388 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.398+0000 7fbd3e000640 1 -- 172.21.15.57:0/2513178212 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd38031a00 con 0x7fbd4006cf30 2024-03-27T10:00:31.389 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.399+0000 7fbd46000640 1 -- 172.21.15.57:0/2513178212 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbd4006cf30 msgr2=0x7fbd4006d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:31.389 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.399+0000 7fbd46000640 1 --2- 172.21.15.57:0/2513178212 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbd4006cf30 0x7fbd4006d310 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fbd400753a0 tx=0x7fbd3802b880 comp rx=0 tx=0).stop 2024-03-27T10:00:31.389 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.399+0000 7fbd46000640 1 -- 172.21.15.57:0/2513178212 shutdown_connections 2024-03-27T10:00:31.389 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.399+0000 7fbd46000640 1 --2- 172.21.15.57:0/2513178212 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbd4006cf30 0x7fbd4006d310 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:31.389 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.399+0000 7fbd46000640 1 --2- 172.21.15.57:0/2513178212 >> v2:172.21.15.118:3300/0 conn(0x7fbd400aea20 0x7fbd4015d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:31.389 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.399+0000 7fbd46000640 1 -- 172.21.15.57:0/2513178212 >> 172.21.15.57:0/2513178212 conn(0x7fbd400b18a0 msgr2=0x7fbd400b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:31.389 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.399+0000 7fbd46000640 1 -- 172.21.15.57:0/2513178212 shutdown_connections 2024-03-27T10:00:31.389 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.399+0000 7fbd46000640 1 -- 172.21.15.57:0/2513178212 wait complete. 2024-03-27T10:00:31.391 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.402+0000 7fbd46000640 1 Processor -- start 2024-03-27T10:00:31.391 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.402+0000 7fbd46000640 1 -- start start 2024-03-27T10:00:31.394 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.403+0000 7fbd46000640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbd4006cf30 0x7fbd4015f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:31.394 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.403+0000 7fbd46000640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbd400acd60 0x7fbd401f3e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:31.394 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.403+0000 7fbd46000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbd400aea20 0x7fbd401f4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:31.394 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.403+0000 7fbd46000640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fbd400733c0 con 0x7fbd4006cf30 2024-03-27T10:00:31.394 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.403+0000 7fbd46000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fbd40072ea0 con 0x7fbd400aea20 2024-03-27T10:00:31.394 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.403+0000 7fbd46000640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fbd4006d850 con 0x7fbd400acd60 2024-03-27T10:00:31.394 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.403+0000 7fbd3f400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbd4006cf30 0x7fbd4015f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:31.394 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.403+0000 7fbd3f400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbd4006cf30 0x7fbd4015f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:47426/0 (socket says 172.21.15.57:47426) 2024-03-27T10:00:31.394 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.403+0000 7fbd3f400640 1 -- 172.21.15.57:0/2840176559 learned_addr learned my addr 172.21.15.57:0/2840176559 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:31.394 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.404+0000 7fbd3ea00640 1 --2- 172.21.15.57:0/2840176559 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbd400acd60 0x7fbd401f3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:31.394 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.404+0000 7fbd3fe00640 1 --2- 172.21.15.57:0/2840176559 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbd400aea20 0x7fbd401f4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:31.395 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.404+0000 7fbd3f400640 1 -- 172.21.15.57:0/2840176559 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbd400acd60 msgr2=0x7fbd401f3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:31.395 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.404+0000 7fbd3f400640 1 --2- 172.21.15.57:0/2840176559 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbd400acd60 0x7fbd401f3e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:31.395 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.404+0000 7fbd3f400640 1 -- 172.21.15.57:0/2840176559 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbd400aea20 msgr2=0x7fbd401f4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:31.395 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.404+0000 7fbd3f400640 1 --2- 172.21.15.57:0/2840176559 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbd400aea20 0x7fbd401f4350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:31.395 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.404+0000 7fbd3f400640 1 -- 172.21.15.57:0/2840176559 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd400b2cc0 con 0x7fbd4006cf30 2024-03-27T10:00:31.395 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.404+0000 7fbd3f400640 1 --2- 172.21.15.57:0/2840176559 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbd4006cf30 0x7fbd4015f020 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fbd3000efc0 tx=0x7fbd3000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:31.396 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.405+0000 7fbd37400640 1 -- 172.21.15.57:0/2840176559 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd30018020 con 0x7fbd4006cf30 2024-03-27T10:00:31.396 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.405+0000 7fbd37400640 1 -- 172.21.15.57:0/2840176559 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd30014480 con 0x7fbd4006cf30 2024-03-27T10:00:31.396 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.405+0000 7fbd37400640 1 -- 172.21.15.57:0/2840176559 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd30014850 con 0x7fbd4006cf30 2024-03-27T10:00:31.396 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.405+0000 7fbd46000640 1 -- 172.21.15.57:0/2840176559 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd4009b800 con 0x7fbd4006cf30 2024-03-27T10:00:31.396 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.405+0000 7fbd46000640 1 -- 172.21.15.57:0/2840176559 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd4009bdc0 con 0x7fbd4006cf30 2024-03-27T10:00:31.396 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.406+0000 7fbd46000640 1 -- 172.21.15.57:0/2840176559 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd400757d0 con 0x7fbd4006cf30 2024-03-27T10:00:31.396 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.407+0000 7fbd37400640 1 -- 172.21.15.57:0/2840176559 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fbd30005d10 con 0x7fbd4006cf30 2024-03-27T10:00:31.398 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.408+0000 7fbd37400640 1 --2- 172.21.15.57:0/2840176559 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fbd2006c530 0x7fbd2006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:31.398 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.408+0000 7fbd37400640 1 -- 172.21.15.57:0/2840176559 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fbd3008c590 con 0x7fbd4006cf30 2024-03-27T10:00:31.398 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.408+0000 7fbd3ea00640 1 --2- 172.21.15.57:0/2840176559 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fbd2006c530 0x7fbd2006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:31.398 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.409+0000 7fbd3ea00640 1 --2- 172.21.15.57:0/2840176559 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fbd2006c530 0x7fbd2006e9f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fbd400b0de0 tx=0x7fbd2c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:31.403 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.413+0000 7fbd37400640 1 -- 172.21.15.57:0/2840176559 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7fbd30022070 con 0x7fbd4006cf30 2024-03-27T10:00:31.607 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.618+0000 7fbd46000640 1 -- 172.21.15.57:0/2840176559 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fbd40068540 con 0x7fbd4006cf30 2024-03-27T10:00:31.608 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.618+0000 7fbd37400640 1 -- 172.21.15.57:0/2840176559 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) ==== 104+0+11 (secure 0 0 0) 0x7fbd30010040 con 0x7fbd4006cf30 2024-03-27T10:00:31.608 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2024-03-27T10:00:31.611 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.621+0000 7fbd46000640 1 -- 172.21.15.57:0/2840176559 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fbd2006c530 msgr2=0x7fbd2006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:31.611 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.621+0000 7fbd46000640 1 --2- 172.21.15.57:0/2840176559 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fbd2006c530 0x7fbd2006e9f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fbd400b0de0 tx=0x7fbd2c009040 comp rx=0 tx=0).stop 2024-03-27T10:00:31.611 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.621+0000 7fbd46000640 1 -- 172.21.15.57:0/2840176559 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbd4006cf30 msgr2=0x7fbd4015f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:31.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.621+0000 7fbd46000640 1 --2- 172.21.15.57:0/2840176559 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbd4006cf30 0x7fbd4015f020 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fbd3000efc0 tx=0x7fbd3000c490 comp rx=0 tx=0).stop 2024-03-27T10:00:31.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.622+0000 7fbd46000640 1 -- 172.21.15.57:0/2840176559 shutdown_connections 2024-03-27T10:00:31.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.622+0000 7fbd46000640 1 --2- 172.21.15.57:0/2840176559 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fbd2006c530 0x7fbd2006e9f0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:31.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.622+0000 7fbd46000640 1 --2- 172.21.15.57:0/2840176559 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbd400aea20 0x7fbd401f4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:31.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.622+0000 7fbd46000640 1 --2- 172.21.15.57:0/2840176559 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbd400acd60 0x7fbd401f3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:31.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.622+0000 7fbd46000640 1 --2- 172.21.15.57:0/2840176559 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbd4006cf30 0x7fbd4015f020 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:31.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.622+0000 7fbd46000640 1 -- 172.21.15.57:0/2840176559 >> 172.21.15.57:0/2840176559 conn(0x7fbd400b18a0 msgr2=0x7fbd4006db50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:31.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.622+0000 7fbd46000640 1 -- 172.21.15.57:0/2840176559 shutdown_connections 2024-03-27T10:00:31.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.622+0000 7fbd46000640 1 -- 172.21.15.57:0/2840176559 wait complete. 2024-03-27T10:00:31.631 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-27T10:00:31.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.869+0000 7f44bf200640 1 Processor -- start 2024-03-27T10:00:31.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.869+0000 7f44bf200640 1 -- start start 2024-03-27T10:00:31.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.871+0000 7f44bf200640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f44c00ca6e0 0x7f44c00c4e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:31.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.871+0000 7f44bf200640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f44c00cbb50 0x7f44c00caac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:31.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.871+0000 7f44bf200640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44c00cb720 con 0x7f44c00cb000 2024-03-27T10:00:31.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.871+0000 7f44bf200640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f44c00c5570 con 0x7f44c00cbb50 2024-03-27T10:00:31.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.871+0000 7f44bf200640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f44c00c5850 con 0x7f44c00ca6e0 2024-03-27T10:00:31.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.871+0000 7f44bd400640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f44c00cbb50 0x7f44c00caac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:31.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.871+0000 7f44bd400640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f44c00cbb50 0x7f44c00caac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58702/0 (socket says 172.21.15.57:58702) 2024-03-27T10:00:31.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.871+0000 7f44bd400640 1 -- 172.21.15.57:0/114680454 learned_addr learned my addr 172.21.15.57:0/114680454 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:31.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.872+0000 7f44bde00640 1 --2- 172.21.15.57:0/114680454 >> v2:172.21.15.118:3300/0 conn(0x7f44c00ca6e0 0x7f44c00c4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:31.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.872+0000 7f44bd400640 1 -- 172.21.15.57:0/114680454 >> v2:172.21.15.118:3300/0 conn(0x7f44c00ca6e0 msgr2=0x7f44c00c4e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:31.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.872+0000 7f44bd400640 1 --2- 172.21.15.57:0/114680454 >> v2:172.21.15.118:3300/0 conn(0x7f44c00ca6e0 0x7f44c00c4e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:31.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.872+0000 7f44bd400640 1 -- 172.21.15.57:0/114680454 >> v1:172.21.15.118:6789/0 conn(0x7f44c00cb000 legacy=0x7f44c00ad8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:31.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.872+0000 7f44bd400640 1 -- 172.21.15.57:0/114680454 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44c00c5b30 con 0x7f44c00cbb50 2024-03-27T10:00:31.863 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.873+0000 7f44bd400640 1 --2- 172.21.15.57:0/114680454 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f44c00cbb50 0x7f44c00caac0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f44c00631f0 tx=0x7f44ac02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daa792907473c00b server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:31.863 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.873+0000 7f44bca00640 1 -- 172.21.15.57:0/114680454 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44ac02e070 con 0x7f44c00cbb50 2024-03-27T10:00:31.863 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.874+0000 7f44bca00640 1 -- 172.21.15.57:0/114680454 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44ac037070 con 0x7f44c00cbb50 2024-03-27T10:00:31.863 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.874+0000 7f44bca00640 1 -- 172.21.15.57:0/114680454 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44ac031a00 con 0x7f44c00cbb50 2024-03-27T10:00:31.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.874+0000 7f44bf200640 1 -- 172.21.15.57:0/114680454 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f44c00cbb50 msgr2=0x7f44c00caac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:31.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.874+0000 7f44bf200640 1 --2- 172.21.15.57:0/114680454 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f44c00cbb50 0x7f44c00caac0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f44c00631f0 tx=0x7f44ac02b880 comp rx=0 tx=0).stop 2024-03-27T10:00:31.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.874+0000 7f44bf200640 1 -- 172.21.15.57:0/114680454 shutdown_connections 2024-03-27T10:00:31.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.874+0000 7f44bf200640 1 --2- 172.21.15.57:0/114680454 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f44c00cbb50 0x7f44c00caac0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:31.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.874+0000 7f44bf200640 1 --2- 172.21.15.57:0/114680454 >> v2:172.21.15.118:3300/0 conn(0x7f44c00ca6e0 0x7f44c00c4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:31.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.874+0000 7f44bf200640 1 -- 172.21.15.57:0/114680454 >> 172.21.15.57:0/114680454 conn(0x7f44c00cfb40 msgr2=0x7f44c00cff20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:31.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.874+0000 7f44bf200640 1 -- 172.21.15.57:0/114680454 shutdown_connections 2024-03-27T10:00:31.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.874+0000 7f44bf200640 1 -- 172.21.15.57:0/114680454 wait complete. 2024-03-27T10:00:31.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.876+0000 7f44bf200640 1 Processor -- start 2024-03-27T10:00:31.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.876+0000 7f44bf200640 1 -- start start 2024-03-27T10:00:31.867 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.877+0000 7f44bf200640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f44c00ca6e0 0x7f44c01527b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:31.868 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.877+0000 7f44bf200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f44c00cb000 0x7f44c00aeb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:31.868 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.877+0000 7f44bf200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44c00cbb50 0x7f44c00af060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:31.868 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.877+0000 7f44bf200640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f44c00adfb0 con 0x7f44c00ca6e0 2024-03-27T10:00:31.868 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.877+0000 7f44bf200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f44c00c60f0 con 0x7f44c00cbb50 2024-03-27T10:00:31.868 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.877+0000 7f44bf200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f44c00ae130 con 0x7f44c00cb000 2024-03-27T10:00:31.868 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.877+0000 7f44bde00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f44c00ca6e0 0x7f44c01527b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:31.868 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.878+0000 7f44bde00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f44c00ca6e0 0x7f44c01527b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58716/0 (socket says 172.21.15.57:58716) 2024-03-27T10:00:31.868 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.878+0000 7f44bde00640 1 -- 172.21.15.57:0/3995416430 learned_addr learned my addr 172.21.15.57:0/3995416430 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:31.868 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.878+0000 7f44bd400640 1 --2- 172.21.15.57:0/3995416430 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f44c00cb000 0x7f44c00aeb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:31.868 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.878+0000 7f44be800640 1 --2- 172.21.15.57:0/3995416430 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44c00cbb50 0x7f44c00af060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:31.868 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.878+0000 7f44bde00640 1 -- 172.21.15.57:0/3995416430 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f44c00cb000 msgr2=0x7f44c00aeb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:31.868 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.878+0000 7f44bde00640 1 --2- 172.21.15.57:0/3995416430 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f44c00cb000 0x7f44c00aeb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:31.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.878+0000 7f44bde00640 1 -- 172.21.15.57:0/3995416430 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44c00cbb50 msgr2=0x7f44c00af060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:31.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.878+0000 7f44bde00640 1 --2- 172.21.15.57:0/3995416430 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44c00cbb50 0x7f44c00af060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:31.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.878+0000 7f44bde00640 1 -- 172.21.15.57:0/3995416430 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44c00afc80 con 0x7f44c00ca6e0 2024-03-27T10:00:31.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.878+0000 7f44bde00640 1 --2- 172.21.15.57:0/3995416430 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f44c00ca6e0 0x7f44c01527b0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f44b000d800 tx=0x7f44b000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:31.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.879+0000 7f44b6000640 1 -- 172.21.15.57:0/3995416430 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44b000b6c0 con 0x7f44c00ca6e0 2024-03-27T10:00:31.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.879+0000 7f44b6000640 1 -- 172.21.15.57:0/3995416430 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44b0019070 con 0x7f44c00ca6e0 2024-03-27T10:00:31.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.879+0000 7f44b6000640 1 -- 172.21.15.57:0/3995416430 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44b000ba80 con 0x7f44c00ca6e0 2024-03-27T10:00:31.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.879+0000 7f44bf200640 1 -- 172.21.15.57:0/3995416430 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44c00af6c0 con 0x7f44c00ca6e0 2024-03-27T10:00:31.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.879+0000 7f44bf200640 1 -- 172.21.15.57:0/3995416430 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44c00b3cc0 con 0x7f44c00ca6e0 2024-03-27T10:00:31.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.880+0000 7f44bf200640 1 -- 172.21.15.57:0/3995416430 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44c0068540 con 0x7f44c00ca6e0 2024-03-27T10:00:31.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.881+0000 7f44b6000640 1 -- 172.21.15.57:0/3995416430 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f44b000bc20 con 0x7f44c00ca6e0 2024-03-27T10:00:31.871 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.882+0000 7f44b6000640 1 --2- 172.21.15.57:0/3995416430 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f44a006c530 0x7f44a006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:31.871 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.882+0000 7f44b6000640 1 -- 172.21.15.57:0/3995416430 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f44b008bfb0 con 0x7f44c00ca6e0 2024-03-27T10:00:31.872 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.882+0000 7f44bd400640 1 --2- 172.21.15.57:0/3995416430 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f44a006c530 0x7f44a006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:31.872 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.883+0000 7f44bd400640 1 --2- 172.21.15.57:0/3995416430 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f44a006c530 0x7f44a006e9f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f44ac036000 tx=0x7f44ac03d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:31.876 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:31.886+0000 7f44b6000640 1 -- 172.21.15.57:0/3995416430 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f44b005a1c0 con 0x7f44c00ca6e0 2024-03-27T10:00:32.078 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.088+0000 7f44bf200640 1 -- 172.21.15.57:0/3995416430 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f44c0152e90 con 0x7f44c00ca6e0 2024-03-27T10:00:32.079 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.089+0000 7f44b6000640 1 -- 172.21.15.57:0/3995416430 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) ==== 100+0+11 (secure 0 0 0) 0x7f44b0059ac0 con 0x7f44c00ca6e0 2024-03-27T10:00:32.079 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2024-03-27T10:00:32.082 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.092+0000 7f44bf200640 1 -- 172.21.15.57:0/3995416430 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f44a006c530 msgr2=0x7f44a006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:32.082 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.092+0000 7f44bf200640 1 --2- 172.21.15.57:0/3995416430 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f44a006c530 0x7f44a006e9f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f44ac036000 tx=0x7f44ac03d040 comp rx=0 tx=0).stop 2024-03-27T10:00:32.082 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.092+0000 7f44bf200640 1 -- 172.21.15.57:0/3995416430 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f44c00ca6e0 msgr2=0x7f44c01527b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:32.082 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.092+0000 7f44bf200640 1 --2- 172.21.15.57:0/3995416430 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f44c00ca6e0 0x7f44c01527b0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f44b000d800 tx=0x7f44b000dcc0 comp rx=0 tx=0).stop 2024-03-27T10:00:32.082 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.092+0000 7f44bf200640 1 -- 172.21.15.57:0/3995416430 shutdown_connections 2024-03-27T10:00:32.082 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.092+0000 7f44bf200640 1 --2- 172.21.15.57:0/3995416430 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f44a006c530 0x7f44a006e9f0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:32.082 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.092+0000 7f44bf200640 1 --2- 172.21.15.57:0/3995416430 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f44c00cbb50 0x7f44c00af060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:32.082 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.092+0000 7f44bf200640 1 --2- 172.21.15.57:0/3995416430 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f44c00cb000 0x7f44c00aeb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:32.082 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.092+0000 7f44bf200640 1 --2- 172.21.15.57:0/3995416430 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f44c00ca6e0 0x7f44c01527b0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:32.082 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.092+0000 7f44bf200640 1 -- 172.21.15.57:0/3995416430 >> 172.21.15.57:0/3995416430 conn(0x7f44c00cfb40 msgr2=0x7f44c006e510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:32.082 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.092+0000 7f44bf200640 1 -- 172.21.15.57:0/3995416430 shutdown_connections 2024-03-27T10:00:32.082 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.092+0000 7f44bf200640 1 -- 172.21.15.57:0/3995416430 wait complete. 2024-03-27T10:00:32.100 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-27T10:00:32.326 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.336+0000 7fa602c00640 1 Processor -- start 2024-03-27T10:00:32.326 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.337+0000 7fa602c00640 1 -- start start 2024-03-27T10:00:32.328 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.338+0000 7fa602c00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa5fc161950 0x7fa5fc0ceb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:32.328 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.338+0000 7fa602c00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa5fc0cf040 0x7fa5fc0cf480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:32.328 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.338+0000 7fa602c00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5fc0cfe40 con 0x7fa5fc0d2760 2024-03-27T10:00:32.328 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.338+0000 7fa602c00640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7fa5fc0cf9c0 con 0x7fa5fc0cf040 2024-03-27T10:00:32.328 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.338+0000 7fa602c00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fa5fc161d30 con 0x7fa5fc161950 2024-03-27T10:00:32.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.339+0000 7fa600e00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa5fc0cf040 0x7fa5fc0cf480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:32.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.339+0000 7fa600e00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa5fc0cf040 0x7fa5fc0cf480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58722/0 (socket says 172.21.15.57:58722) 2024-03-27T10:00:32.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.339+0000 7fa600e00640 1 -- 172.21.15.57:0/1658619355 learned_addr learned my addr 172.21.15.57:0/1658619355 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:32.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.339+0000 7fa601800640 1 --2- 172.21.15.57:0/1658619355 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa5fc161950 0x7fa5fc0ceb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:32.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.339+0000 7fa600e00640 1 -- 172.21.15.57:0/1658619355 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa5fc161950 msgr2=0x7fa5fc0ceb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:32.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.339+0000 7fa600e00640 1 --2- 172.21.15.57:0/1658619355 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa5fc161950 0x7fa5fc0ceb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:32.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.339+0000 7fa600e00640 1 -- 172.21.15.57:0/1658619355 >> v1:172.21.15.118:6789/0 conn(0x7fa5fc0d2760 legacy=0x7fa5fc0d2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:32.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.339+0000 7fa600e00640 1 -- 172.21.15.57:0/1658619355 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5fc0d0f10 con 0x7fa5fc0cf040 2024-03-27T10:00:32.330 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.341+0000 7fa600e00640 1 --2- 172.21.15.57:0/1658619355 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5fc0cf040 0x7fa5fc0cf480 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fa5e8009870 tx=0x7fa5e802ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd8def30ac70aaea server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:32.330 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.341+0000 7fa5fbe00640 1 -- 172.21.15.57:0/1658619355 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5e802f830 con 0x7fa5fc0cf040 2024-03-27T10:00:32.330 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.341+0000 7fa5fbe00640 1 -- 172.21.15.57:0/1658619355 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5e802f9d0 con 0x7fa5fc0cf040 2024-03-27T10:00:32.330 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.341+0000 7fa5fbe00640 1 -- 172.21.15.57:0/1658619355 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5e802fda0 con 0x7fa5fc0cf040 2024-03-27T10:00:32.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.342+0000 7fa602c00640 1 -- 172.21.15.57:0/1658619355 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5fc0cf040 msgr2=0x7fa5fc0cf480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:32.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.342+0000 7fa602c00640 1 --2- 172.21.15.57:0/1658619355 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5fc0cf040 0x7fa5fc0cf480 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fa5e8009870 tx=0x7fa5e802ba10 comp rx=0 tx=0).stop 2024-03-27T10:00:32.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.342+0000 7fa602c00640 1 -- 172.21.15.57:0/1658619355 shutdown_connections 2024-03-27T10:00:32.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.342+0000 7fa602c00640 1 --2- 172.21.15.57:0/1658619355 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5fc0cf040 0x7fa5fc0cf480 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:32.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.342+0000 7fa602c00640 1 --2- 172.21.15.57:0/1658619355 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa5fc161950 0x7fa5fc0ceb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:32.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.342+0000 7fa602c00640 1 -- 172.21.15.57:0/1658619355 >> 172.21.15.57:0/1658619355 conn(0x7fa5fc0d3fc0 msgr2=0x7fa5fc0d43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:32.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.342+0000 7fa602c00640 1 -- 172.21.15.57:0/1658619355 shutdown_connections 2024-03-27T10:00:32.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.342+0000 7fa602c00640 1 -- 172.21.15.57:0/1658619355 wait complete. 2024-03-27T10:00:32.333 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.344+0000 7fa602c00640 1 Processor -- start 2024-03-27T10:00:32.333 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.344+0000 7fa602c00640 1 -- start start 2024-03-27T10:00:32.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.345+0000 7fa602c00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5fc0cf040 0x7fa5fc0cc0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:32.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.345+0000 7fa602c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5fc0d2760 0x7fa5fc1f7de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:32.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.345+0000 7fa602c00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa5fc161950 0x7fa5fc14cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:32.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.345+0000 7fa602c00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fa5fc0d1f60 con 0x7fa5fc0cf040 2024-03-27T10:00:32.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.345+0000 7fa602c00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fa5fc0d14d0 con 0x7fa5fc0d2760 2024-03-27T10:00:32.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.345+0000 7fa602c00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fa5fc0d2240 con 0x7fa5fc161950 2024-03-27T10:00:32.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.345+0000 7fa601800640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5fc0cf040 0x7fa5fc0cc0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:32.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.345+0000 7fa601800640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5fc0cf040 0x7fa5fc0cc0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58724/0 (socket says 172.21.15.57:58724) 2024-03-27T10:00:32.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.345+0000 7fa601800640 1 -- 172.21.15.57:0/3960938976 learned_addr learned my addr 172.21.15.57:0/3960938976 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:32.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.345+0000 7fa600e00640 1 --2- 172.21.15.57:0/3960938976 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5fc0d2760 0x7fa5fc1f7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:32.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.345+0000 7fa602200640 1 --2- 172.21.15.57:0/3960938976 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa5fc161950 0x7fa5fc14cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:32.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.346+0000 7fa601800640 1 -- 172.21.15.57:0/3960938976 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa5fc161950 msgr2=0x7fa5fc14cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:32.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.346+0000 7fa601800640 1 --2- 172.21.15.57:0/3960938976 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa5fc161950 0x7fa5fc14cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:32.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.346+0000 7fa601800640 1 -- 172.21.15.57:0/3960938976 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5fc0d2760 msgr2=0x7fa5fc1f7de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:32.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.346+0000 7fa601800640 1 --2- 172.21.15.57:0/3960938976 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5fc0d2760 0x7fa5fc1f7de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:32.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.346+0000 7fa601800640 1 -- 172.21.15.57:0/3960938976 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5fc14d040 con 0x7fa5fc0cf040 2024-03-27T10:00:32.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.346+0000 7fa602200640 1 --2- 172.21.15.57:0/3960938976 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa5fc161950 0x7fa5fc14cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T10:00:32.337 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.346+0000 7fa601800640 1 --2- 172.21.15.57:0/3960938976 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5fc0cf040 0x7fa5fc0cc0e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fa5f000d800 tx=0x7fa5f000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:32.337 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.346+0000 7fa5f9600640 1 -- 172.21.15.57:0/3960938976 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5f000b6c0 con 0x7fa5fc0cf040 2024-03-27T10:00:32.337 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.346+0000 7fa5f9600640 1 -- 172.21.15.57:0/3960938976 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5f0019070 con 0x7fa5fc0cf040 2024-03-27T10:00:32.337 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.346+0000 7fa5f9600640 1 -- 172.21.15.57:0/3960938976 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5f000ba80 con 0x7fa5fc0cf040 2024-03-27T10:00:32.337 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.347+0000 7fa602c00640 1 -- 172.21.15.57:0/3960938976 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5fc0cc770 con 0x7fa5fc0cf040 2024-03-27T10:00:32.337 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.347+0000 7fa602c00640 1 -- 172.21.15.57:0/3960938976 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5fc0ccd30 con 0x7fa5fc0cf040 2024-03-27T10:00:32.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.348+0000 7fa602c00640 1 -- 172.21.15.57:0/3960938976 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5fc068540 con 0x7fa5fc0cf040 2024-03-27T10:00:32.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.349+0000 7fa5f9600640 1 -- 172.21.15.57:0/3960938976 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fa5f000bc20 con 0x7fa5fc0cf040 2024-03-27T10:00:32.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.350+0000 7fa5f9600640 1 --2- 172.21.15.57:0/3960938976 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fa5dc06c530 0x7fa5dc06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:32.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.350+0000 7fa5f9600640 1 -- 172.21.15.57:0/3960938976 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fa5f008bf20 con 0x7fa5fc0cf040 2024-03-27T10:00:32.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.350+0000 7fa600e00640 1 --2- 172.21.15.57:0/3960938976 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fa5dc06c530 0x7fa5dc06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:32.340 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.351+0000 7fa600e00640 1 --2- 172.21.15.57:0/3960938976 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fa5dc06c530 0x7fa5dc06e9f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa5e8036000 tx=0x7fa5e8008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:32.344 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.355+0000 7fa5f9600640 1 -- 172.21.15.57:0/3960938976 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7fa5f005a130 con 0x7fa5fc0cf040 2024-03-27T10:00:32.546 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.557+0000 7fa602c00640 1 -- 172.21.15.57:0/3960938976 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fa5fc06cfc0 con 0x7fa5fc0cf040 2024-03-27T10:00:32.547 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.558+0000 7fa5f9600640 1 -- 172.21.15.57:0/3960938976 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) ==== 103+0+11 (secure 0 0 0) 0x7fa5f0059a30 con 0x7fa5fc0cf040 2024-03-27T10:00:32.548 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2024-03-27T10:00:32.550 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.560+0000 7fa602c00640 1 -- 172.21.15.57:0/3960938976 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fa5dc06c530 msgr2=0x7fa5dc06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:32.550 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.560+0000 7fa602c00640 1 --2- 172.21.15.57:0/3960938976 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fa5dc06c530 0x7fa5dc06e9f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa5e8036000 tx=0x7fa5e8008030 comp rx=0 tx=0).stop 2024-03-27T10:00:32.550 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.560+0000 7fa602c00640 1 -- 172.21.15.57:0/3960938976 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5fc0cf040 msgr2=0x7fa5fc0cc0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:32.550 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.560+0000 7fa602c00640 1 --2- 172.21.15.57:0/3960938976 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5fc0cf040 0x7fa5fc0cc0e0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fa5f000d800 tx=0x7fa5f000dcc0 comp rx=0 tx=0).stop 2024-03-27T10:00:32.551 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.561+0000 7fa602c00640 1 -- 172.21.15.57:0/3960938976 shutdown_connections 2024-03-27T10:00:32.551 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.561+0000 7fa602c00640 1 --2- 172.21.15.57:0/3960938976 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa5fc161950 0x7fa5fc14cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:32.551 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.561+0000 7fa602c00640 1 --2- 172.21.15.57:0/3960938976 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fa5dc06c530 0x7fa5dc06e9f0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:32.551 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.561+0000 7fa602c00640 1 --2- 172.21.15.57:0/3960938976 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5fc0d2760 0x7fa5fc1f7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:32.551 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.561+0000 7fa602c00640 1 --2- 172.21.15.57:0/3960938976 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5fc0cf040 0x7fa5fc0cc0e0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:32.551 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.561+0000 7fa602c00640 1 -- 172.21.15.57:0/3960938976 >> 172.21.15.57:0/3960938976 conn(0x7fa5fc0d3fc0 msgr2=0x7fa5fc15f370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:32.551 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.561+0000 7fa602c00640 1 -- 172.21.15.57:0/3960938976 shutdown_connections 2024-03-27T10:00:32.551 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.561+0000 7fa602c00640 1 -- 172.21.15.57:0/3960938976 wait complete. 2024-03-27T10:00:32.570 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-27T10:00:32.791 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.801+0000 7fbe0b200640 1 Processor -- start 2024-03-27T10:00:32.791 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.801+0000 7fbe0b200640 1 -- start start 2024-03-27T10:00:32.793 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.803+0000 7fbe0b200640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fbe0c143bb0 0x7fbe0c072b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:32.793 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.803+0000 7fbe0b200640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbe0c0d12b0 0x7fbe0c0ce110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:32.793 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.803+0000 7fbe0b200640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe0c06e980 con 0x7fbe0c0b5230 2024-03-27T10:00:32.793 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.803+0000 7fbe0b200640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7fbe0c0b4da0 con 0x7fbe0c0d12b0 2024-03-27T10:00:32.793 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.803+0000 7fbe0b200640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7fbe0c0b4750 con 0x7fbe0c143bb0 2024-03-27T10:00:32.793 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.803+0000 7fbe01400640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fbe0c0b5230 0x7fbe0c0d0ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:48202/0 (socket says 172.21.15.57:48202) 2024-03-27T10:00:32.794 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.803+0000 7fbe01400640 1 -- 172.21.15.57:0/4175233820 learned_addr learned my addr 172.21.15.57:0/4175233820 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T10:00:32.794 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.804+0000 7fbe0a800640 1 --2- 172.21.15.57:0/4175233820 >> v2:172.21.15.57:3300/0 conn(0x7fbe0c0d12b0 0x7fbe0c0ce110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:32.794 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.804+0000 7fbe09e00640 1 --2- 172.21.15.57:0/4175233820 >> v2:172.21.15.118:3300/0 conn(0x7fbe0c143bb0 0x7fbe0c072b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:32.794 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.804+0000 7fbe09400640 1 -- 172.21.15.57:0/4175233820 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 441412947 0 0) 0x7fbe0c06e980 con 0x7fbe0c0b5230 2024-03-27T10:00:32.795 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.804+0000 7fbe09400640 1 -- 172.21.15.57:0/4175233820 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbdf0003520 con 0x7fbe0c0b5230 2024-03-27T10:00:32.795 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.804+0000 7fbe0a800640 1 -- 172.21.15.57:0/4175233820 >> v2:172.21.15.118:3300/0 conn(0x7fbe0c143bb0 msgr2=0x7fbe0c072b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:32.795 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.804+0000 7fbe0a800640 1 --2- 172.21.15.57:0/4175233820 >> v2:172.21.15.118:3300/0 conn(0x7fbe0c143bb0 0x7fbe0c072b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:32.795 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.804+0000 7fbe0a800640 1 -- 172.21.15.57:0/4175233820 >> v1:172.21.15.57:6789/0 conn(0x7fbe0c0b5230 legacy=0x7fbe0c0d0ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:32.795 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.804+0000 7fbe0a800640 1 -- 172.21.15.57:0/4175233820 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe0c0b4a30 con 0x7fbe0c0d12b0 2024-03-27T10:00:32.796 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.806+0000 7fbe0a800640 1 --2- 172.21.15.57:0/4175233820 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe0c0d12b0 0x7fbe0c0ce110 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c0d1a60 tx=0x7fbe0402be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2635ccab134954ec server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:32.796 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.806+0000 7fbe09400640 1 -- 172.21.15.57:0/4175233820 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe04039070 con 0x7fbe0c0d12b0 2024-03-27T10:00:32.796 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.806+0000 7fbe09400640 1 -- 172.21.15.57:0/4175233820 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe0402cbf0 con 0x7fbe0c0d12b0 2024-03-27T10:00:32.796 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.806+0000 7fbe09400640 1 -- 172.21.15.57:0/4175233820 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe04034440 con 0x7fbe0c0d12b0 2024-03-27T10:00:32.796 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.807+0000 7fbe0b200640 1 -- 172.21.15.57:0/4175233820 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe0c0d12b0 msgr2=0x7fbe0c0ce110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:32.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.807+0000 7fbe0b200640 1 --2- 172.21.15.57:0/4175233820 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe0c0d12b0 0x7fbe0c0ce110 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c0d1a60 tx=0x7fbe0402be40 comp rx=0 tx=0).stop 2024-03-27T10:00:32.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.807+0000 7fbe0b200640 1 -- 172.21.15.57:0/4175233820 shutdown_connections 2024-03-27T10:00:32.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.807+0000 7fbe0b200640 1 --2- 172.21.15.57:0/4175233820 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe0c0d12b0 0x7fbe0c0ce110 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:32.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.807+0000 7fbe0b200640 1 --2- 172.21.15.57:0/4175233820 >> v2:172.21.15.118:3300/0 conn(0x7fbe0c143bb0 0x7fbe0c072b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:32.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.807+0000 7fbe0b200640 1 -- 172.21.15.57:0/4175233820 >> 172.21.15.57:0/4175233820 conn(0x7fbe0c06c650 msgr2=0x7fbe0c06ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:32.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.807+0000 7fbe0b200640 1 -- 172.21.15.57:0/4175233820 shutdown_connections 2024-03-27T10:00:32.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.807+0000 7fbe0b200640 1 -- 172.21.15.57:0/4175233820 wait complete. 2024-03-27T10:00:32.798 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.809+0000 7fbe0b200640 1 Processor -- start 2024-03-27T10:00:32.798 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.809+0000 7fbe0b200640 1 -- start start 2024-03-27T10:00:32.800 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.810+0000 7fbe0b200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbe0c0b5230 0x7fbe0c15e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:32.800 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.810+0000 7fbe0b200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbe0c0d12b0 0x7fbe0c0b2a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:32.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.810+0000 7fbe0b200640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe0c143bb0 0x7fbe0c0cf020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:32.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.810+0000 7fbe0b200640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fbe0c06e510 con 0x7fbe0c143bb0 2024-03-27T10:00:32.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.810+0000 7fbe0b200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fbe0c1449a0 con 0x7fbe0c0b5230 2024-03-27T10:00:32.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.810+0000 7fbe0b200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fbe0c06e690 con 0x7fbe0c0d12b0 2024-03-27T10:00:32.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.810+0000 7fbe0a800640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe0c143bb0 0x7fbe0c0cf020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:32.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.810+0000 7fbe0a800640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe0c143bb0 0x7fbe0c0cf020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58734/0 (socket says 172.21.15.57:58734) 2024-03-27T10:00:32.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.810+0000 7fbe0a800640 1 -- 172.21.15.57:0/1526891401 learned_addr learned my addr 172.21.15.57:0/1526891401 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:32.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.811+0000 7fbe01400640 1 --2- 172.21.15.57:0/1526891401 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbe0c0d12b0 0x7fbe0c0b2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:32.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.811+0000 7fbe0a800640 1 -- 172.21.15.57:0/1526891401 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbe0c0d12b0 msgr2=0x7fbe0c0b2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:32.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.811+0000 7fbe0a800640 1 --2- 172.21.15.57:0/1526891401 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbe0c0d12b0 0x7fbe0c0b2a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:32.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.811+0000 7fbe09e00640 1 --2- 172.21.15.57:0/1526891401 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbe0c0b5230 0x7fbe0c15e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:32.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.811+0000 7fbe0a800640 1 -- 172.21.15.57:0/1526891401 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbe0c0b5230 msgr2=0x7fbe0c15e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:32.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.811+0000 7fbe0a800640 1 --2- 172.21.15.57:0/1526891401 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbe0c0b5230 0x7fbe0c15e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:32.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.811+0000 7fbe0a800640 1 -- 172.21.15.57:0/1526891401 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe0c1f7500 con 0x7fbe0c143bb0 2024-03-27T10:00:32.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.811+0000 7fbe01400640 1 --2- 172.21.15.57:0/1526891401 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbe0c0d12b0 0x7fbe0c0b2a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T10:00:32.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.811+0000 7fbe0a800640 1 --2- 172.21.15.57:0/1526891401 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe0c143bb0 0x7fbe0c0cf020 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fbe04009e80 tx=0x7fbe04004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:32.802 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.811+0000 7fbe02a00640 1 -- 172.21.15.57:0/1526891401 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe04039050 con 0x7fbe0c143bb0 2024-03-27T10:00:32.802 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.811+0000 7fbe02a00640 1 -- 172.21.15.57:0/1526891401 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe04045070 con 0x7fbe0c143bb0 2024-03-27T10:00:32.803 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.811+0000 7fbe02a00640 1 -- 172.21.15.57:0/1526891401 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe04009450 con 0x7fbe0c143bb0 2024-03-27T10:00:32.803 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.812+0000 7fbe0b200640 1 -- 172.21.15.57:0/1526891401 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe0c1f77e0 con 0x7fbe0c143bb0 2024-03-27T10:00:32.803 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.812+0000 7fbe0b200640 1 -- 172.21.15.57:0/1526891401 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe0c1f7da0 con 0x7fbe0c143bb0 2024-03-27T10:00:32.803 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.813+0000 7fbe0b200640 1 -- 172.21.15.57:0/1526891401 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe0c1f8110 con 0x7fbe0c143bb0 2024-03-27T10:00:32.803 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.814+0000 7fbe02a00640 1 -- 172.21.15.57:0/1526891401 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fbe0403e850 con 0x7fbe0c143bb0 2024-03-27T10:00:32.804 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.815+0000 7fbe02a00640 1 --2- 172.21.15.57:0/1526891401 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fbde806c530 0x7fbde806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:32.805 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.815+0000 7fbe02a00640 1 -- 172.21.15.57:0/1526891401 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fbe040ae6b0 con 0x7fbe0c143bb0 2024-03-27T10:00:32.805 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.815+0000 7fbe09e00640 1 --2- 172.21.15.57:0/1526891401 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fbde806c530 0x7fbde806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:32.805 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.816+0000 7fbe09e00640 1 --2- 172.21.15.57:0/1526891401 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fbde806c530 0x7fbde806e9f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc009970 tx=0x7fbdfc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:32.809 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:32.820+0000 7fbe02a00640 1 -- 172.21.15.57:0/1526891401 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7fbe04032e20 con 0x7fbe0c143bb0 2024-03-27T10:00:33.015 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.025+0000 7fbe0b200640 1 -- 172.21.15.57:0/1526891401 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbe0c068540 con 0x7fbe0c143bb0 2024-03-27T10:00:33.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.028+0000 7fbe02a00640 1 -- 172.21.15.57:0/1526891401 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) ==== 74+0+18888 (secure 0 0 0) 0x7fbe0407c8c0 con 0x7fbe0c143bb0 2024-03-27T10:00:33.018 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:00:33.019 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":28,"fsid":"7ac43f86-2c16-4a97-98fb-715d3cebc75c","created":"2024-03-27T09:59:04.033417+0000","modified":"2024-03-27T10:00:10.462391+0000","last_up_change":"2024-03-27T09:59:16.969624+0000","last_in_change":"2024-03-27T09:59:07.421690+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-27T09:59:17.253008+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-27T09:59:26.690365+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-27T09:59:27.559059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-27T09:59:31.187596+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"47b44362-7302-4f2a-b735-582c6c3850cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6801","nonce":2020036298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6803","nonce":2020036298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6807","nonce":2020036298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6805","nonce":2020036298}]},"public_addr":"172.21.15.57:6801/2020036298","cluster_addr":"172.21.15.57:6803/2020036298","heartbeat_back_addr":"172.21.15.57:6807/2020036298","heartbeat_front_addr":"172.21.15.57:6805/2020036298","state":["exists","up"]},{"osd":1,"uuid":"feaf96f0-9431-4188-9a09-da505b40e934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6809","nonce":3190929242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6811","nonce":3190929242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6815","nonce":3190929242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6813","nonce":3190929242}]},"public_addr":"172.21.15.57:6809/3190929242","cluster_addr":"172.21.15.57:6811/3190929242","heartbeat_back_addr":"172.21.15.57:6815/3190929242","heartbeat_front_addr":"172.21.15.57:6813/3190929242","state":["exists","up"]},{"osd":2,"uuid":"21e406e6-cfbc-4fe7-a816-e2420487c95d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6817","nonce":4065849973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6819","nonce":4065849973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6823","nonce":4065849973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6821","nonce":4065849973}]},"public_addr":"172.21.15.57:6817/4065849973","cluster_addr":"172.21.15.57:6819/4065849973","heartbeat_back_addr":"172.21.15.57:6823/4065849973","heartbeat_front_addr":"172.21.15.57:6821/4065849973","state":["exists","up"]},{"osd":3,"uuid":"a389af1d-76c4-4dfc-b215-f983f4931257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6825","nonce":158084809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6827","nonce":158084809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6831","nonce":158084809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6829","nonce":158084809}]},"public_addr":"172.21.15.57:6825/158084809","cluster_addr":"172.21.15.57:6827/158084809","heartbeat_back_addr":"172.21.15.57:6831/158084809","heartbeat_front_addr":"172.21.15.57:6829/158084809","state":["exists","up"]},{"osd":4,"uuid":"e9b05dca-557a-43ee-b43f-9ce5b7d28304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6823","nonce":108719401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6827","nonce":108719401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6831","nonce":108719401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6829","nonce":108719401}]},"public_addr":"172.21.15.118:6823/108719401","cluster_addr":"172.21.15.118:6827/108719401","heartbeat_back_addr":"172.21.15.118:6831/108719401","heartbeat_front_addr":"172.21.15.118:6829/108719401","state":["exists","up"]},{"osd":5,"uuid":"d968177d-44ff-499a-b00a-b147ed879253","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6817","nonce":2704605866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6819","nonce":2704605866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6826","nonce":2704605866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6822","nonce":2704605866}]},"public_addr":"172.21.15.118:6817/2704605866","cluster_addr":"172.21.15.118:6819/2704605866","heartbeat_back_addr":"172.21.15.118:6826/2704605866","heartbeat_front_addr":"172.21.15.118:6822/2704605866","state":["exists","up"]},{"osd":6,"uuid":"e8f98052-e6ad-4cfe-a4a9-0b17a434d54e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6801","nonce":1963659095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6803","nonce":1963659095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6807","nonce":1963659095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6805","nonce":1963659095}]},"public_addr":"172.21.15.118:6801/1963659095","cluster_addr":"172.21.15.118:6803/1963659095","heartbeat_back_addr":"172.21.15.118:6807/1963659095","heartbeat_front_addr":"172.21.15.118:6805/1963659095","state":["exists","up"]},{"osd":7,"uuid":"eccff987-8e51-4a63-845a-cf0a3196d7fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6809","nonce":1955879596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6811","nonce":1955879596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6815","nonce":1955879596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6813","nonce":1955879596}]},"public_addr":"172.21.15.118:6809/1955879596","cluster_addr":"172.21.15.118:6811/1955879596","heartbeat_back_addr":"172.21.15.118:6815/1955879596","heartbeat_front_addr":"172.21.15.118:6813/1955879596","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.721258+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.696610+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.777895+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.806769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.743259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.845687+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:13.020165+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.722294+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.e","mappings":[{"from":7,"to":1}]},{"pgid":"3.15","mappings":[{"from":3,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-27T10:00:33.021 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.031+0000 7fbe0b200640 1 -- 172.21.15.57:0/1526891401 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fbde806c530 msgr2=0x7fbde806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:33.021 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.031+0000 7fbe0b200640 1 --2- 172.21.15.57:0/1526891401 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fbde806c530 0x7fbde806e9f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fbdfc009970 tx=0x7fbdfc008040 comp rx=0 tx=0).stop 2024-03-27T10:00:33.021 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.031+0000 7fbe0b200640 1 -- 172.21.15.57:0/1526891401 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe0c143bb0 msgr2=0x7fbe0c0cf020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:33.021 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.031+0000 7fbe0b200640 1 --2- 172.21.15.57:0/1526891401 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe0c143bb0 0x7fbe0c0cf020 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fbe04009e80 tx=0x7fbe04004a40 comp rx=0 tx=0).stop 2024-03-27T10:00:33.021 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.031+0000 7fbe0b200640 1 -- 172.21.15.57:0/1526891401 shutdown_connections 2024-03-27T10:00:33.021 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.031+0000 7fbe0b200640 1 --2- 172.21.15.57:0/1526891401 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbe0c143bb0 0x7fbe0c0cf020 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:33.021 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.031+0000 7fbe0b200640 1 --2- 172.21.15.57:0/1526891401 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbe0c0d12b0 0x7fbe0c0b2a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:33.022 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.031+0000 7fbe0b200640 1 --2- 172.21.15.57:0/1526891401 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fbde806c530 0x7fbde806e9f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:33.022 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.031+0000 7fbe0b200640 1 --2- 172.21.15.57:0/1526891401 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbe0c0b5230 0x7fbe0c15e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:33.022 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.031+0000 7fbe0b200640 1 -- 172.21.15.57:0/1526891401 >> 172.21.15.57:0/1526891401 conn(0x7fbe0c06c650 msgr2=0x7fbe0c140770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:33.022 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.032+0000 7fbe0b200640 1 -- 172.21.15.57:0/1526891401 shutdown_connections 2024-03-27T10:00:33.022 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.032+0000 7fbe0b200640 1 -- 172.21.15.57:0/1526891401 wait complete. 2024-03-27T10:00:33.041 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-27T09:59:17.253008+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-27T09:59:26.690365+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-27T09:59:27.559059+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-27T09:59:31.187596+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-27T10:00:33.042 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-27T10:00:33.264 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.275+0000 7ff347e00640 1 Processor -- start 2024-03-27T10:00:33.265 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.275+0000 7ff347e00640 1 -- start start 2024-03-27T10:00:33.266 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.277+0000 7ff347e00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ff3480cd920 0x7ff34806ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:33.266 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.277+0000 7ff347e00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff34806ef50 0x7ff3480c49e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:33.267 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.277+0000 7ff347e00640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff34815b260 con 0x7ff34815ae80 2024-03-27T10:00:33.267 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.277+0000 7ff347e00640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7ff34806f3a0 con 0x7ff34806ef50 2024-03-27T10:00:33.267 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.277+0000 7ff347e00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7ff3480ceaa0 con 0x7ff3480cd920 2024-03-27T10:00:33.267 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.277+0000 7ff346a00640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7ff34815ae80 0x7ff3480cbcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:48218/0 (socket says 172.21.15.57:48218) 2024-03-27T10:00:33.267 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.277+0000 7ff346a00640 1 -- 172.21.15.57:0/4149338600 learned_addr learned my addr 172.21.15.57:0/4149338600 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T10:00:33.267 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.277+0000 7ff347400640 1 --2- 172.21.15.57:0/4149338600 >> v2:172.21.15.57:3300/0 conn(0x7ff34806ef50 0x7ff3480c49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:33.268 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.277+0000 7ff346000640 1 --2- 172.21.15.57:0/4149338600 >> v2:172.21.15.118:3300/0 conn(0x7ff3480cd920 0x7ff34806ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:33.268 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.277+0000 7ff345600640 1 -- 172.21.15.57:0/4149338600 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2943797802 0 0) 0x7ff34815b260 con 0x7ff34815ae80 2024-03-27T10:00:33.268 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.278+0000 7ff345600640 1 -- 172.21.15.57:0/4149338600 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff32c003520 con 0x7ff34815ae80 2024-03-27T10:00:33.268 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.278+0000 7ff347400640 1 -- 172.21.15.57:0/4149338600 >> v2:172.21.15.118:3300/0 conn(0x7ff3480cd920 msgr2=0x7ff34806ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:33.268 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.278+0000 7ff347400640 1 --2- 172.21.15.57:0/4149338600 >> v2:172.21.15.118:3300/0 conn(0x7ff3480cd920 0x7ff34806ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:33.268 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.278+0000 7ff347400640 1 -- 172.21.15.57:0/4149338600 >> v1:172.21.15.57:6789/0 conn(0x7ff34815ae80 legacy=0x7ff3480cbcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:33.268 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.278+0000 7ff347400640 1 -- 172.21.15.57:0/4149338600 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3480cde90 con 0x7ff34806ef50 2024-03-27T10:00:33.269 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.279+0000 7ff347400640 1 --2- 172.21.15.57:0/4149338600 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff34806ef50 0x7ff3480c49e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7ff3400097a0 tx=0x7ff34002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d59aebbe059234a server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:33.270 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.279+0000 7ff345600640 1 -- 172.21.15.57:0/4149338600 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff340035020 con 0x7ff34806ef50 2024-03-27T10:00:33.270 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.279+0000 7ff345600640 1 -- 172.21.15.57:0/4149338600 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff340031830 con 0x7ff34806ef50 2024-03-27T10:00:33.270 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.279+0000 7ff345600640 1 -- 172.21.15.57:0/4149338600 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff340031be0 con 0x7ff34806ef50 2024-03-27T10:00:33.270 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.280+0000 7ff347e00640 1 -- 172.21.15.57:0/4149338600 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff34806ef50 msgr2=0x7ff3480c49e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:33.270 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.280+0000 7ff347e00640 1 --2- 172.21.15.57:0/4149338600 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff34806ef50 0x7ff3480c49e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7ff3400097a0 tx=0x7ff34002b8d0 comp rx=0 tx=0).stop 2024-03-27T10:00:33.270 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.280+0000 7ff347e00640 1 -- 172.21.15.57:0/4149338600 shutdown_connections 2024-03-27T10:00:33.270 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.280+0000 7ff347e00640 1 --2- 172.21.15.57:0/4149338600 >> v2:172.21.15.118:3300/0 conn(0x7ff3480cd920 0x7ff34806ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:33.270 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.280+0000 7ff347e00640 1 --2- 172.21.15.57:0/4149338600 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff34806ef50 0x7ff3480c49e0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:33.270 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.280+0000 7ff347e00640 1 -- 172.21.15.57:0/4149338600 >> 172.21.15.57:0/4149338600 conn(0x7ff3480cfb40 msgr2=0x7ff3480cff20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:33.270 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.280+0000 7ff347e00640 1 -- 172.21.15.57:0/4149338600 shutdown_connections 2024-03-27T10:00:33.270 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.280+0000 7ff347e00640 1 -- 172.21.15.57:0/4149338600 wait complete. 2024-03-27T10:00:33.271 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.282+0000 7ff347e00640 1 Processor -- start 2024-03-27T10:00:33.271 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.282+0000 7ff347e00640 1 -- start start 2024-03-27T10:00:33.273 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.283+0000 7ff347e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff34806ef50 0x7ff34814c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:33.273 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.283+0000 7ff347e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3480cd920 0x7ff3480ae870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:33.273 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.283+0000 7ff347e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff34815ae80 0x7ff3480b0160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:33.273 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.283+0000 7ff347e00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7ff3480ce730 con 0x7ff3480cd920 2024-03-27T10:00:33.273 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.283+0000 7ff347e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7ff3480ce450 con 0x7ff34815ae80 2024-03-27T10:00:33.274 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.283+0000 7ff347e00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7ff3480cef30 con 0x7ff34806ef50 2024-03-27T10:00:33.274 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.283+0000 7ff346000640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3480cd920 0x7ff3480ae870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:33.274 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.283+0000 7ff346000640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3480cd920 0x7ff3480ae870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58750/0 (socket says 172.21.15.57:58750) 2024-03-27T10:00:33.274 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.283+0000 7ff346000640 1 -- 172.21.15.57:0/3660268886 learned_addr learned my addr 172.21.15.57:0/3660268886 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:33.274 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.283+0000 7ff346a00640 1 --2- 172.21.15.57:0/3660268886 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff34806ef50 0x7ff34814c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:33.274 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.283+0000 7ff346000640 1 -- 172.21.15.57:0/3660268886 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff34806ef50 msgr2=0x7ff34814c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:33.274 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.284+0000 7ff347400640 1 --2- 172.21.15.57:0/3660268886 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff34815ae80 0x7ff3480b0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:33.274 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.284+0000 7ff346000640 1 --2- 172.21.15.57:0/3660268886 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff34806ef50 0x7ff34814c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:33.274 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.284+0000 7ff346000640 1 -- 172.21.15.57:0/3660268886 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff34815ae80 msgr2=0x7ff3480b0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:33.274 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.284+0000 7ff346000640 1 --2- 172.21.15.57:0/3660268886 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff34815ae80 0x7ff3480b0160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:33.274 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.284+0000 7ff346000640 1 -- 172.21.15.57:0/3660268886 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff34814ce90 con 0x7ff3480cd920 2024-03-27T10:00:33.274 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.284+0000 7ff346a00640 1 --2- 172.21.15.57:0/3660268886 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff34806ef50 0x7ff34814c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T10:00:33.274 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.284+0000 7ff347400640 1 --2- 172.21.15.57:0/3660268886 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff34815ae80 0x7ff3480b0160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T10:00:33.275 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.284+0000 7ff346000640 1 --2- 172.21.15.57:0/3660268886 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3480cd920 0x7ff3480ae870 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7ff338007ec0 tx=0x7ff33800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:33.276 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.284+0000 7ff33ea00640 1 -- 172.21.15.57:0/3660268886 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff338014620 con 0x7ff3480cd920 2024-03-27T10:00:33.276 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.284+0000 7ff33ea00640 1 -- 172.21.15.57:0/3660268886 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff338019070 con 0x7ff3480cd920 2024-03-27T10:00:33.276 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.284+0000 7ff347e00640 1 -- 172.21.15.57:0/3660268886 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3480c8cc0 con 0x7ff3480cd920 2024-03-27T10:00:33.276 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.284+0000 7ff33ea00640 1 -- 172.21.15.57:0/3660268886 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff338014a20 con 0x7ff3480cd920 2024-03-27T10:00:33.276 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.284+0000 7ff347e00640 1 -- 172.21.15.57:0/3660268886 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3480c9280 con 0x7ff3480cd920 2024-03-27T10:00:33.276 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.285+0000 7ff347e00640 1 -- 172.21.15.57:0/3660268886 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff348068540 con 0x7ff3480cd920 2024-03-27T10:00:33.276 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.286+0000 7ff33ea00640 1 -- 172.21.15.57:0/3660268886 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7ff338014bc0 con 0x7ff3480cd920 2024-03-27T10:00:33.277 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.287+0000 7ff33ea00640 1 --2- 172.21.15.57:0/3660268886 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7ff32406c560 0x7ff32406ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:33.277 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.288+0000 7ff33ea00640 1 -- 172.21.15.57:0/3660268886 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7ff33808c400 con 0x7ff3480cd920 2024-03-27T10:00:33.277 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.288+0000 7ff346a00640 1 --2- 172.21.15.57:0/3660268886 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7ff32406c560 0x7ff32406ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:33.278 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.288+0000 7ff346a00640 1 --2- 172.21.15.57:0/3660268886 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7ff32406c560 0x7ff32406ea20 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff330005880 tx=0x7ff330009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:33.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.292+0000 7ff33ea00640 1 -- 172.21.15.57:0/3660268886 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7ff33805a610 con 0x7ff3480cd920 2024-03-27T10:00:33.487 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.497+0000 7ff347e00640 1 -- 172.21.15.57:0/3660268886 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff34806d290 con 0x7ff3480cd920 2024-03-27T10:00:33.488 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.498+0000 7ff33ea00640 1 -- 172.21.15.57:0/3660268886 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) ==== 93+0+10 (secure 0 0 0) 0x7ff338059f10 con 0x7ff3480cd920 2024-03-27T10:00:33.488 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2024-03-27T10:00:33.491 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.501+0000 7ff347e00640 1 -- 172.21.15.57:0/3660268886 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7ff32406c560 msgr2=0x7ff32406ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:33.491 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.501+0000 7ff347e00640 1 --2- 172.21.15.57:0/3660268886 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7ff32406c560 0x7ff32406ea20 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff330005880 tx=0x7ff330009040 comp rx=0 tx=0).stop 2024-03-27T10:00:33.491 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.501+0000 7ff347e00640 1 -- 172.21.15.57:0/3660268886 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3480cd920 msgr2=0x7ff3480ae870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:33.491 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.501+0000 7ff347e00640 1 --2- 172.21.15.57:0/3660268886 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3480cd920 0x7ff3480ae870 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7ff338007ec0 tx=0x7ff33800e4b0 comp rx=0 tx=0).stop 2024-03-27T10:00:33.491 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.501+0000 7ff347e00640 1 -- 172.21.15.57:0/3660268886 shutdown_connections 2024-03-27T10:00:33.491 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.501+0000 7ff347e00640 1 --2- 172.21.15.57:0/3660268886 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7ff32406c560 0x7ff32406ea20 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:33.491 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.501+0000 7ff347e00640 1 --2- 172.21.15.57:0/3660268886 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff34815ae80 0x7ff3480b0160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:33.491 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.501+0000 7ff347e00640 1 --2- 172.21.15.57:0/3660268886 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3480cd920 0x7ff3480ae870 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:33.491 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.501+0000 7ff347e00640 1 --2- 172.21.15.57:0/3660268886 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff34806ef50 0x7ff34814c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:33.491 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.501+0000 7ff347e00640 1 -- 172.21.15.57:0/3660268886 >> 172.21.15.57:0/3660268886 conn(0x7ff3480cfb40 msgr2=0x7ff3480cb400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:33.491 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.501+0000 7ff347e00640 1 -- 172.21.15.57:0/3660268886 shutdown_connections 2024-03-27T10:00:33.491 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.501+0000 7ff347e00640 1 -- 172.21.15.57:0/3660268886 wait complete. 2024-03-27T10:00:33.511 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-27T10:00:33.743 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.754+0000 7f7985400640 1 Processor -- start 2024-03-27T10:00:33.743 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.754+0000 7f7985400640 1 -- start start 2024-03-27T10:00:33.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.756+0000 7f7985400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7980162bd0 0x7f79800cdc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:33.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.756+0000 7f7985400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f79800c4a70 0x7f79800c4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:33.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.756+0000 7f7985400640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79800ce290 con 0x7f79800ca190 2024-03-27T10:00:33.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.756+0000 7f7985400640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f79800ceea0 con 0x7f79800c4a70 2024-03-27T10:00:33.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.756+0000 7f7985400640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f79800ce570 con 0x7f7980162bd0 2024-03-27T10:00:33.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.756+0000 7f797fe00640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f79800ca190 0x7f79800ca570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:48232/0 (socket says 172.21.15.57:48232) 2024-03-27T10:00:33.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.756+0000 7f797fe00640 1 -- 172.21.15.57:0/30286230 learned_addr learned my addr 172.21.15.57:0/30286230 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T10:00:33.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.757+0000 7f797f400640 1 --2- 172.21.15.57:0/30286230 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7980162bd0 0x7f79800cdc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:33.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.757+0000 7f7984a00640 1 --2- 172.21.15.57:0/30286230 >> v2:172.21.15.118:3300/0 conn(0x7f79800c4a70 0x7f79800c4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:33.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.757+0000 7f797ea00640 1 -- 172.21.15.57:0/30286230 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2331344514 0 0) 0x7f79800ce290 con 0x7f79800ca190 2024-03-27T10:00:33.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.757+0000 7f797ea00640 1 -- 172.21.15.57:0/30286230 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7964003520 con 0x7f79800ca190 2024-03-27T10:00:33.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.757+0000 7f797ea00640 1 -- 172.21.15.57:0/30286230 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1260953591 0 0) 0x7f7964003520 con 0x7f79800ca190 2024-03-27T10:00:33.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.757+0000 7f797ea00640 1 -- 172.21.15.57:0/30286230 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7980162bd0 msgr2=0x7f79800cdc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:33.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.757+0000 7f797ea00640 1 --2- 172.21.15.57:0/30286230 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7980162bd0 0x7f79800cdc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:33.749 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.757+0000 7f797ea00640 1 -- 172.21.15.57:0/30286230 >> v2:172.21.15.118:3300/0 conn(0x7f79800c4a70 msgr2=0x7f79800c4ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:33.749 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.757+0000 7f797ea00640 1 --2- 172.21.15.57:0/30286230 >> v2:172.21.15.118:3300/0 conn(0x7f79800c4a70 0x7f79800c4ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:33.749 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.757+0000 7f797ea00640 1 -- 172.21.15.57:0/30286230 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79800ce850 con 0x7f79800ca190 2024-03-27T10:00:33.749 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.757+0000 7f797ea00640 1 -- 172.21.15.57:0/30286230 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4227751516 0 0) 0x7f7970001670 con 0x7f79800ca190 2024-03-27T10:00:33.749 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.757+0000 7f797ea00640 1 -- 172.21.15.57:0/30286230 >> v1:172.21.15.57:6789/0 conn(0x7f79800ca190 legacy=0x7f79800ca570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:33.749 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.758+0000 7f797ea00640 1 --2- 172.21.15.57:0/30286230 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f79640039b0 0x7f7964003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:33.749 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.758+0000 7f797ea00640 1 --2- 172.21.15.57:0/30286230 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7980162bd0 0x7f7964004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:33.749 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.758+0000 7f797ea00640 1 --2- 172.21.15.57:0/30286230 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7964004d40 0x7f79640051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:33.749 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.758+0000 7f797ea00640 1 -- 172.21.15.57:0/30286230 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f79800ceea0 con 0x7f7964004d40 2024-03-27T10:00:33.749 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.758+0000 7f797ea00640 1 -- 172.21.15.57:0/30286230 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f79800ce570 con 0x7f79640039b0 2024-03-27T10:00:33.749 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.758+0000 7f797ea00640 1 -- 172.21.15.57:0/30286230 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f796400b9c0 con 0x7f7980162bd0 2024-03-27T10:00:33.749 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.758+0000 7f7984a00640 1 --2- 172.21.15.57:0/30286230 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7964004d40 0x7f79640051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:33.749 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.758+0000 7f797fe00640 1 --2- 172.21.15.57:0/30286230 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f79640039b0 0x7f7964003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:33.749 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.758+0000 7f7984a00640 1 -- 172.21.15.57:0/30286230 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7980162bd0 msgr2=0x7f7964004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:33.749 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.758+0000 7f7984a00640 1 --2- 172.21.15.57:0/30286230 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7980162bd0 0x7f7964004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:33.750 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.758+0000 7f7984a00640 1 -- 172.21.15.57:0/30286230 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f79640039b0 msgr2=0x7f7964003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:33.750 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.758+0000 7f7984a00640 1 --2- 172.21.15.57:0/30286230 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f79640039b0 0x7f7964003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:33.750 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.758+0000 7f7984a00640 1 -- 172.21.15.57:0/30286230 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7964003520 con 0x7f7964004d40 2024-03-27T10:00:33.750 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.758+0000 7f797fe00640 1 --2- 172.21.15.57:0/30286230 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f79640039b0 0x7f7964003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T10:00:33.751 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.760+0000 7f7984a00640 1 --2- 172.21.15.57:0/30286230 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7964004d40 0x7f79640051c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f7978009fc0 tx=0x7f7964005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fa59915e335eb11 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:33.751 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.760+0000 7f797ea00640 1 -- 172.21.15.57:0/30286230 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7978039070 con 0x7f7964004d40 2024-03-27T10:00:33.751 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.760+0000 7f797ea00640 1 -- 172.21.15.57:0/30286230 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f797802cc60 con 0x7f7964004d40 2024-03-27T10:00:33.751 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.760+0000 7f797ea00640 1 -- 172.21.15.57:0/30286230 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7978009c10 con 0x7f7964004d40 2024-03-27T10:00:33.751 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.761+0000 7f7985400640 1 -- 172.21.15.57:0/30286230 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7964004d40 msgr2=0x7f79640051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:33.751 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.761+0000 7f7985400640 1 --2- 172.21.15.57:0/30286230 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7964004d40 0x7f79640051c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f7978009fc0 tx=0x7f7964005830 comp rx=0 tx=0).stop 2024-03-27T10:00:33.751 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.761+0000 7f7984a00640 1 -- 172.21.15.57:0/30286230 reap_dead start 2024-03-27T10:00:33.751 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.761+0000 7f7985400640 1 -- 172.21.15.57:0/30286230 shutdown_connections 2024-03-27T10:00:33.751 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.761+0000 7f7985400640 1 -- 172.21.15.57:0/30286230 >> 172.21.15.57:0/30286230 conn(0x7f79800cfb40 msgr2=0x7f79800cff20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:33.751 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.761+0000 7f7985400640 1 -- 172.21.15.57:0/30286230 shutdown_connections 2024-03-27T10:00:33.751 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.761+0000 7f7985400640 1 -- 172.21.15.57:0/30286230 wait complete. 2024-03-27T10:00:33.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.763+0000 7f7985400640 1 Processor -- start 2024-03-27T10:00:33.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.763+0000 7f7985400640 1 -- start start 2024-03-27T10:00:33.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.764+0000 7f7985400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7980161eb0 0x7f79800b4190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:33.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.764+0000 7f7985400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f79800b46d0 0x7f79800c90b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:33.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.764+0000 7f7985400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f79800c95f0 0x7f79801eda50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:33.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.764+0000 7f7985400640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f798014c160 con 0x7f79800c95f0 2024-03-27T10:00:33.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.764+0000 7f7985400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f79800cd940 con 0x7f79800b46d0 2024-03-27T10:00:33.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.764+0000 7f7985400640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f79800cdc20 con 0x7f7980161eb0 2024-03-27T10:00:33.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.764+0000 7f7984a00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f79800c95f0 0x7f79801eda50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:33.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.764+0000 7f7984a00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f79800c95f0 0x7f79801eda50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58760/0 (socket says 172.21.15.57:58760) 2024-03-27T10:00:33.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.764+0000 7f7984a00640 1 -- 172.21.15.57:0/1619962233 learned_addr learned my addr 172.21.15.57:0/1619962233 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:33.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.764+0000 7f797fe00640 1 --2- 172.21.15.57:0/1619962233 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7980161eb0 0x7f79800b4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:33.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.764+0000 7f7984a00640 1 -- 172.21.15.57:0/1619962233 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7980161eb0 msgr2=0x7f79800b4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:33.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.764+0000 7f7984a00640 1 --2- 172.21.15.57:0/1619962233 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7980161eb0 0x7f79800b4190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:33.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.764+0000 7f7984a00640 1 -- 172.21.15.57:0/1619962233 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f79800b46d0 msgr2=0x7f79800c90b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:33.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.764+0000 7f797f400640 1 --2- 172.21.15.57:0/1619962233 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f79800b46d0 0x7f79800c90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:33.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.764+0000 7f7984a00640 1 --2- 172.21.15.57:0/1619962233 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f79800b46d0 0x7f79800c90b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:33.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.764+0000 7f7984a00640 1 -- 172.21.15.57:0/1619962233 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79801ec360 con 0x7f79800c95f0 2024-03-27T10:00:33.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.764+0000 7f797fe00640 1 --2- 172.21.15.57:0/1619962233 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7980161eb0 0x7f79800b4190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T10:00:33.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.765+0000 7f7984a00640 1 --2- 172.21.15.57:0/1619962233 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f79800c95f0 0x7f79801eda50 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f797800e230 tx=0x7f7978009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:33.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.765+0000 7f7977e00640 1 -- 172.21.15.57:0/1619962233 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7978039030 con 0x7f79800c95f0 2024-03-27T10:00:33.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.765+0000 7f7977e00640 1 -- 172.21.15.57:0/1619962233 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f797803a040 con 0x7f79800c95f0 2024-03-27T10:00:33.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.765+0000 7f7977e00640 1 -- 172.21.15.57:0/1619962233 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7978009c10 con 0x7f79800c95f0 2024-03-27T10:00:33.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.765+0000 7f7985400640 1 -- 172.21.15.57:0/1619962233 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79801ec640 con 0x7f79800c95f0 2024-03-27T10:00:33.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.765+0000 7f7985400640 1 -- 172.21.15.57:0/1619962233 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79801ecc00 con 0x7f79800c95f0 2024-03-27T10:00:33.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.767+0000 7f7985400640 1 -- 172.21.15.57:0/1619962233 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7980068540 con 0x7f79800c95f0 2024-03-27T10:00:33.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.767+0000 7f7977e00640 1 -- 172.21.15.57:0/1619962233 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f7978045030 con 0x7f79800c95f0 2024-03-27T10:00:33.758 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.768+0000 7f7977e00640 1 --2- 172.21.15.57:0/1619962233 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f796006c560 0x7f796006ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:33.758 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.768+0000 7f7977e00640 1 -- 172.21.15.57:0/1619962233 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f79780ad620 con 0x7f79800c95f0 2024-03-27T10:00:33.758 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.769+0000 7f797fe00640 1 --2- 172.21.15.57:0/1619962233 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f796006c560 0x7f796006ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:33.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.769+0000 7f797fe00640 1 --2- 172.21.15.57:0/1619962233 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f796006c560 0x7f796006ea20 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f7970001820 tx=0x7f7970009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:33.762 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.773+0000 7f7977e00640 1 -- 172.21.15.57:0/1619962233 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f797804c060 con 0x7f79800c95f0 2024-03-27T10:00:33.966 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.976+0000 7f7985400640 1 -- 172.21.15.57:0/1619962233 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f79800c69a0 con 0x7f79800c95f0 2024-03-27T10:00:33.966 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.977+0000 7f7977e00640 1 -- 172.21.15.57:0/1619962233 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) ==== 104+0+11 (secure 0 0 0) 0x7f797807b8d0 con 0x7f79800c95f0 2024-03-27T10:00:33.967 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2024-03-27T10:00:33.969 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.979+0000 7f7985400640 1 -- 172.21.15.57:0/1619962233 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f796006c560 msgr2=0x7f796006ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:33.969 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.979+0000 7f7985400640 1 --2- 172.21.15.57:0/1619962233 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f796006c560 0x7f796006ea20 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f7970001820 tx=0x7f7970009040 comp rx=0 tx=0).stop 2024-03-27T10:00:33.969 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.979+0000 7f7985400640 1 -- 172.21.15.57:0/1619962233 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f79800c95f0 msgr2=0x7f79801eda50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:33.969 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.979+0000 7f7985400640 1 --2- 172.21.15.57:0/1619962233 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f79800c95f0 0x7f79801eda50 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f797800e230 tx=0x7f7978009750 comp rx=0 tx=0).stop 2024-03-27T10:00:33.969 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.979+0000 7f7985400640 1 -- 172.21.15.57:0/1619962233 shutdown_connections 2024-03-27T10:00:33.969 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.979+0000 7f7985400640 1 --2- 172.21.15.57:0/1619962233 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f79800c95f0 0x7f79801eda50 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:33.969 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.979+0000 7f7985400640 1 --2- 172.21.15.57:0/1619962233 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f796006c560 0x7f796006ea20 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:33.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.979+0000 7f7985400640 1 --2- 172.21.15.57:0/1619962233 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f79800b46d0 0x7f79800c90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:33.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.979+0000 7f7985400640 1 --2- 172.21.15.57:0/1619962233 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7980161eb0 0x7f79800b4190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:33.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.979+0000 7f7985400640 1 -- 172.21.15.57:0/1619962233 >> 172.21.15.57:0/1619962233 conn(0x7f79800cfb40 msgr2=0x7f7980072490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:33.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.980+0000 7f7985400640 1 -- 172.21.15.57:0/1619962233 shutdown_connections 2024-03-27T10:00:33.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:33.980+0000 7f7985400640 1 -- 172.21.15.57:0/1619962233 wait complete. 2024-03-27T10:00:33.990 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-27T10:00:34.219 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.229+0000 7fa4ef200640 1 Processor -- start 2024-03-27T10:00:34.219 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.229+0000 7fa4ef200640 1 -- start start 2024-03-27T10:00:34.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.231+0000 7fa4ef200640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa4f00cbb50 0x7fa4f00c4e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:34.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.231+0000 7fa4ef200640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4f00cb720 con 0x7fa4f00ca6e0 2024-03-27T10:00:34.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.231+0000 7fa4ef200640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4f00c5570 con 0x7fa4f00ae8b0 2024-03-27T10:00:34.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.231+0000 7fa4ef200640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7fa4f00c5850 con 0x7fa4f00cbb50 2024-03-27T10:00:34.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.231+0000 7fa4ede00640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fa4f00ca6e0 0x7fa4f00caac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:48242/0 (socket says 172.21.15.57:48242) 2024-03-27T10:00:34.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.231+0000 7fa4ee800640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa4f00cbb50 0x7fa4f00c4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:34.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.231+0000 7fa4ede00640 1 -- 172.21.15.57:0/1581394728 learned_addr learned my addr 172.21.15.57:0/1581394728 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T10:00:34.222 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.232+0000 7fa4ee800640 1 -- 172.21.15.57:0/1581394728 >> v1:172.21.15.118:6789/0 conn(0x7fa4f00ae8b0 legacy=0x7fa4f0165b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:34.222 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.232+0000 7fa4ee800640 1 -- 172.21.15.57:0/1581394728 >> v1:172.21.15.57:6789/0 conn(0x7fa4f00ca6e0 legacy=0x7fa4f00caac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:34.222 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.232+0000 7fa4ee800640 1 -- 172.21.15.57:0/1581394728 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4f00c5b30 con 0x7fa4f00cbb50 2024-03-27T10:00:34.222 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.233+0000 7fa4ee800640 1 --2- 172.21.15.57:0/1581394728 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4f00cbb50 0x7fa4f00c4e70 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fa4e8009d90 tx=0x7fa4e802bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80619c440f3046e3 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:34.223 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.233+0000 7fa4ed400640 1 -- 172.21.15.57:0/1581394728 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4e8039070 con 0x7fa4f00cbb50 2024-03-27T10:00:34.223 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.234+0000 7fa4ed400640 1 -- 172.21.15.57:0/1581394728 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4e802cc70 con 0x7fa4f00cbb50 2024-03-27T10:00:34.223 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.234+0000 7fa4ed400640 1 -- 172.21.15.57:0/1581394728 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4e8034660 con 0x7fa4f00cbb50 2024-03-27T10:00:34.224 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.234+0000 7fa4ef200640 1 -- 172.21.15.57:0/1581394728 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4f00cbb50 msgr2=0x7fa4f00c4e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:34.224 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.234+0000 7fa4ef200640 1 --2- 172.21.15.57:0/1581394728 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4f00cbb50 0x7fa4f00c4e70 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fa4e8009d90 tx=0x7fa4e802bec0 comp rx=0 tx=0).stop 2024-03-27T10:00:34.224 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.234+0000 7fa4ef200640 1 -- 172.21.15.57:0/1581394728 shutdown_connections 2024-03-27T10:00:34.224 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.234+0000 7fa4ef200640 1 --2- 172.21.15.57:0/1581394728 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4f00cbb50 0x7fa4f00c4e70 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:34.224 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.234+0000 7fa4ef200640 1 -- 172.21.15.57:0/1581394728 >> 172.21.15.57:0/1581394728 conn(0x7fa4f00cfb40 msgr2=0x7fa4f00cff20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:34.224 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.234+0000 7fa4ef200640 1 -- 172.21.15.57:0/1581394728 shutdown_connections 2024-03-27T10:00:34.224 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.234+0000 7fa4ef200640 1 -- 172.21.15.57:0/1581394728 wait complete. 2024-03-27T10:00:34.225 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.236+0000 7fa4ef200640 1 Processor -- start 2024-03-27T10:00:34.226 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.236+0000 7fa4ef200640 1 -- start start 2024-03-27T10:00:34.227 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.237+0000 7fa4ef200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa4f00ae8b0 0x7fa4f0154be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:34.227 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.237+0000 7fa4ef200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4f00ca6e0 0x7fa4f0156860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:34.228 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.237+0000 7fa4ef200640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4f00cbb50 0x7fa4f0156da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:34.228 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.237+0000 7fa4ef200640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fa4f00cb1d0 con 0x7fa4f00cbb50 2024-03-27T10:00:34.228 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.237+0000 7fa4ef200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fa4f00c60f0 con 0x7fa4f00ca6e0 2024-03-27T10:00:34.228 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.237+0000 7fa4ef200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fa4f01692b0 con 0x7fa4f00ae8b0 2024-03-27T10:00:34.228 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.238+0000 7fa4ee800640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4f00cbb50 0x7fa4f0156da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:34.228 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.238+0000 7fa4ee800640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4f00cbb50 0x7fa4f0156da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58772/0 (socket says 172.21.15.57:58772) 2024-03-27T10:00:34.228 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.238+0000 7fa4ee800640 1 -- 172.21.15.57:0/2459078683 learned_addr learned my addr 172.21.15.57:0/2459078683 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:34.228 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.238+0000 7fa4ede00640 1 --2- 172.21.15.57:0/2459078683 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa4f00ae8b0 0x7fa4f0154be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:34.228 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.238+0000 7fa4e5400640 1 --2- 172.21.15.57:0/2459078683 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4f00ca6e0 0x7fa4f0156860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:34.228 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.238+0000 7fa4ee800640 1 -- 172.21.15.57:0/2459078683 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa4f00ae8b0 msgr2=0x7fa4f0154be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:34.228 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.238+0000 7fa4ee800640 1 --2- 172.21.15.57:0/2459078683 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa4f00ae8b0 0x7fa4f0154be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:34.228 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.238+0000 7fa4ee800640 1 -- 172.21.15.57:0/2459078683 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4f00ca6e0 msgr2=0x7fa4f0156860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:34.228 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.238+0000 7fa4ee800640 1 --2- 172.21.15.57:0/2459078683 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4f00ca6e0 0x7fa4f0156860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:34.228 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.238+0000 7fa4ee800640 1 -- 172.21.15.57:0/2459078683 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4f015eb70 con 0x7fa4f00cbb50 2024-03-27T10:00:34.229 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.238+0000 7fa4e5400640 1 --2- 172.21.15.57:0/2459078683 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4f00ca6e0 0x7fa4f0156860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T10:00:34.229 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.239+0000 7fa4ee800640 1 --2- 172.21.15.57:0/2459078683 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4f00cbb50 0x7fa4f0156da0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fa4e8009d90 tx=0x7fa4e8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:34.230 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.239+0000 7fa4e6a00640 1 -- 172.21.15.57:0/2459078683 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4e8039050 con 0x7fa4f00cbb50 2024-03-27T10:00:34.230 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.239+0000 7fa4e6a00640 1 -- 172.21.15.57:0/2459078683 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4e8045070 con 0x7fa4f00cbb50 2024-03-27T10:00:34.230 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.239+0000 7fa4e6a00640 1 -- 172.21.15.57:0/2459078683 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4e803e830 con 0x7fa4f00cbb50 2024-03-27T10:00:34.230 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.239+0000 7fa4ef200640 1 -- 172.21.15.57:0/2459078683 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4f015a970 con 0x7fa4f00cbb50 2024-03-27T10:00:34.230 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.239+0000 7fa4ef200640 1 -- 172.21.15.57:0/2459078683 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4f015af30 con 0x7fa4f00cbb50 2024-03-27T10:00:34.230 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.240+0000 7fa4ef200640 1 -- 172.21.15.57:0/2459078683 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4f0068540 con 0x7fa4f00cbb50 2024-03-27T10:00:34.230 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.241+0000 7fa4e6a00640 1 -- 172.21.15.57:0/2459078683 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fa4e803e9d0 con 0x7fa4f00cbb50 2024-03-27T10:00:34.231 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.242+0000 7fa4e6a00640 1 --2- 172.21.15.57:0/2459078683 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fa4cc06c530 0x7fa4cc06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:34.232 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.242+0000 7fa4e6a00640 1 -- 172.21.15.57:0/2459078683 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fa4e80aea80 con 0x7fa4f00cbb50 2024-03-27T10:00:34.232 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.242+0000 7fa4ede00640 1 --2- 172.21.15.57:0/2459078683 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fa4cc06c530 0x7fa4cc06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:34.232 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.243+0000 7fa4ede00640 1 --2- 172.21.15.57:0/2459078683 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fa4cc06c530 0x7fa4cc06e9f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa4e0005880 tx=0x7fa4e0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:34.236 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.247+0000 7fa4e6a00640 1 -- 172.21.15.57:0/2459078683 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7fa4e80b0e20 con 0x7fa4f00cbb50 2024-03-27T10:00:34.436 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.447+0000 7fa4ef200640 1 -- 172.21.15.57:0/2459078683 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fa4f00b5b10 con 0x7fa4f00cbb50 2024-03-27T10:00:34.437 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.447+0000 7fa4e6a00640 1 -- 172.21.15.57:0/2459078683 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) ==== 100+0+11 (secure 0 0 0) 0x7fa4e802ce20 con 0x7fa4f00cbb50 2024-03-27T10:00:34.438 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2024-03-27T10:00:34.441 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.450+0000 7fa4ef200640 1 -- 172.21.15.57:0/2459078683 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fa4cc06c530 msgr2=0x7fa4cc06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:34.441 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.450+0000 7fa4ef200640 1 --2- 172.21.15.57:0/2459078683 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fa4cc06c530 0x7fa4cc06e9f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa4e0005880 tx=0x7fa4e0009040 comp rx=0 tx=0).stop 2024-03-27T10:00:34.441 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.450+0000 7fa4ef200640 1 -- 172.21.15.57:0/2459078683 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4f00cbb50 msgr2=0x7fa4f0156da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:34.441 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.450+0000 7fa4ef200640 1 --2- 172.21.15.57:0/2459078683 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4f00cbb50 0x7fa4f0156da0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fa4e8009d90 tx=0x7fa4e8004a40 comp rx=0 tx=0).stop 2024-03-27T10:00:34.441 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.450+0000 7fa4ef200640 1 -- 172.21.15.57:0/2459078683 shutdown_connections 2024-03-27T10:00:34.441 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.450+0000 7fa4ef200640 1 --2- 172.21.15.57:0/2459078683 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa4f00cbb50 0x7fa4f0156da0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:34.442 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.450+0000 7fa4ef200640 1 --2- 172.21.15.57:0/2459078683 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fa4cc06c530 0x7fa4cc06e9f0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:34.442 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.450+0000 7fa4ef200640 1 --2- 172.21.15.57:0/2459078683 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa4f00ca6e0 0x7fa4f0156860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:34.442 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.450+0000 7fa4ef200640 1 --2- 172.21.15.57:0/2459078683 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa4f00ae8b0 0x7fa4f0154be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:34.442 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.450+0000 7fa4ef200640 1 -- 172.21.15.57:0/2459078683 >> 172.21.15.57:0/2459078683 conn(0x7fa4f00cfb40 msgr2=0x7fa4f0160670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:34.442 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.450+0000 7fa4ef200640 1 -- 172.21.15.57:0/2459078683 shutdown_connections 2024-03-27T10:00:34.442 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.450+0000 7fa4ef200640 1 -- 172.21.15.57:0/2459078683 wait complete. 2024-03-27T10:00:34.457 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-27T10:00:34.667 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.678+0000 7f4caf200640 1 Processor -- start 2024-03-27T10:00:34.668 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.678+0000 7f4caf200640 1 -- start start 2024-03-27T10:00:34.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.680+0000 7f4caf200640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f4cb015e190 0x7f4cb00ad8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:34.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.680+0000 7f4caf200640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cb006d470 con 0x7f4cb00cbb90 2024-03-27T10:00:34.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.680+0000 7f4caf200640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cb00addf0 con 0x7f4cb00708e0 2024-03-27T10:00:34.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.680+0000 7f4caf200640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f4cb00b0070 con 0x7f4cb015e190 2024-03-27T10:00:34.672 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.680+0000 7f4cae800640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f4cb00cbb90 0x7f4cb00cfeb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:48250/0 (socket says 172.21.15.57:48250) 2024-03-27T10:00:34.672 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.680+0000 7f4cae800640 1 -- 172.21.15.57:0/1764648983 learned_addr learned my addr 172.21.15.57:0/1764648983 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T10:00:34.672 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.680+0000 7f4cade00640 1 --2- 172.21.15.57:0/1764648983 >> v2:172.21.15.118:3300/0 conn(0x7f4cb015e190 0x7f4cb00ad8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:34.672 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.681+0000 7f4caca00640 1 -- 172.21.15.57:0/1764648983 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 164706854 0 0) 0x7f4cb006d470 con 0x7f4cb00cbb90 2024-03-27T10:00:34.672 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.681+0000 7f4caca00640 1 -- 172.21.15.57:0/1764648983 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c94003520 con 0x7f4cb00cbb90 2024-03-27T10:00:34.672 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.681+0000 7f4caca00640 1 -- 172.21.15.57:0/1764648983 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2498360656 0 0) 0x7f4c94003520 con 0x7f4cb00cbb90 2024-03-27T10:00:34.672 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.681+0000 7f4caca00640 1 -- 172.21.15.57:0/1764648983 >> v2:172.21.15.118:3300/0 conn(0x7f4cb015e190 msgr2=0x7f4cb00ad8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:34.672 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.681+0000 7f4caca00640 1 --2- 172.21.15.57:0/1764648983 >> v2:172.21.15.118:3300/0 conn(0x7f4cb015e190 0x7f4cb00ad8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:34.672 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.681+0000 7f4caca00640 1 -- 172.21.15.57:0/1764648983 >> v1:172.21.15.118:6789/0 conn(0x7f4cb00708e0 legacy=0x7f4cb00cb480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:34.672 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.681+0000 7f4caca00640 1 -- 172.21.15.57:0/1764648983 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cb00cf6b0 con 0x7f4cb00cbb90 2024-03-27T10:00:34.672 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.681+0000 7f4caca00640 1 -- 172.21.15.57:0/1764648983 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4227751516 0 0) 0x7f4ca80019f0 con 0x7f4cb00cbb90 2024-03-27T10:00:34.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.681+0000 7f4caca00640 1 -- 172.21.15.57:0/1764648983 >> v1:172.21.15.57:6789/0 conn(0x7f4cb00cbb90 legacy=0x7f4cb00cfeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:34.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.681+0000 7f4caca00640 1 --2- 172.21.15.57:0/1764648983 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4c94003a00 0x7f4c94003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:34.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.681+0000 7f4caca00640 1 --2- 172.21.15.57:0/1764648983 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4c94004800 0x7f4c94004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:34.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.681+0000 7f4caca00640 1 --2- 172.21.15.57:0/1764648983 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4c940052e0 0x7f4c9400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:34.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.681+0000 7f4caca00640 1 -- 172.21.15.57:0/1764648983 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f4cb00b0070 con 0x7f4c94004800 2024-03-27T10:00:34.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.681+0000 7f4caca00640 1 -- 172.21.15.57:0/1764648983 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f4c9400c1e0 con 0x7f4c940052e0 2024-03-27T10:00:34.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.681+0000 7f4caca00640 1 -- 172.21.15.57:0/1764648983 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f4c9400c3e0 con 0x7f4c94003a00 2024-03-27T10:00:34.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.682+0000 7f4cad400640 1 --2- 172.21.15.57:0/1764648983 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4c94004800 0x7f4c94004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:34.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.682+0000 7f4cade00640 1 --2- 172.21.15.57:0/1764648983 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4c94003a00 0x7f4c94003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:34.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.682+0000 7f4cae800640 1 --2- 172.21.15.57:0/1764648983 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4c940052e0 0x7f4c9400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:34.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.682+0000 7f4cad400640 1 -- 172.21.15.57:0/1764648983 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4c94003a00 msgr2=0x7f4c94003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:34.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.682+0000 7f4cad400640 1 --2- 172.21.15.57:0/1764648983 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4c94003a00 0x7f4c94003e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:34.674 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.682+0000 7f4cad400640 1 -- 172.21.15.57:0/1764648983 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4c940052e0 msgr2=0x7f4c9400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:34.674 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.682+0000 7f4cad400640 1 --2- 172.21.15.57:0/1764648983 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4c940052e0 0x7f4c9400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:34.674 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.682+0000 7f4cad400640 1 -- 172.21.15.57:0/1764648983 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c94003520 con 0x7f4c94004800 2024-03-27T10:00:34.674 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.682+0000 7f4cae800640 1 --2- 172.21.15.57:0/1764648983 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4c940052e0 0x7f4c9400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T10:00:34.674 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.682+0000 7f4cae800640 1 -- 172.21.15.57:0/1764648983 reap_dead start 2024-03-27T10:00:34.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.683+0000 7f4cad400640 1 --2- 172.21.15.57:0/1764648983 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4c94004800 0x7f4c94004c80 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c001750 tx=0x7f4c94005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=768031495a489d8b server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:34.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.683+0000 7f4caca00640 1 -- 172.21.15.57:0/1764648983 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c9c001370 con 0x7f4c94004800 2024-03-27T10:00:34.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.683+0000 7f4caca00640 1 -- 172.21.15.57:0/1764648983 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c9c0052d0 con 0x7f4c94004800 2024-03-27T10:00:34.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.683+0000 7f4caca00640 1 -- 172.21.15.57:0/1764648983 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c9c003830 con 0x7f4c94004800 2024-03-27T10:00:34.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.684+0000 7f4caf200640 1 -- 172.21.15.57:0/1764648983 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4c94004800 msgr2=0x7f4c94004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:34.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.684+0000 7f4caf200640 1 --2- 172.21.15.57:0/1764648983 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4c94004800 0x7f4c94004c80 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c001750 tx=0x7f4c94005830 comp rx=0 tx=0).stop 2024-03-27T10:00:34.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.684+0000 7f4caf200640 1 -- 172.21.15.57:0/1764648983 shutdown_connections 2024-03-27T10:00:34.676 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.684+0000 7f4caf200640 1 --2- 172.21.15.57:0/1764648983 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4c94004800 0x7f4c94004c80 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:34.676 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.684+0000 7f4caf200640 1 -- 172.21.15.57:0/1764648983 >> 172.21.15.57:0/1764648983 conn(0x7f4cb00cd6a0 msgr2=0x7f4cb00cdab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:34.676 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.684+0000 7f4caf200640 1 -- 172.21.15.57:0/1764648983 shutdown_connections 2024-03-27T10:00:34.676 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.684+0000 7f4caf200640 1 -- 172.21.15.57:0/1764648983 wait complete. 2024-03-27T10:00:34.676 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.686+0000 7f4caf200640 1 Processor -- start 2024-03-27T10:00:34.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.686+0000 7f4caf200640 1 -- start start 2024-03-27T10:00:34.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.687+0000 7f4caf200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4c94004800 0x7f4cb0159d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:34.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.687+0000 7f4caf200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4cb00ae960 0x7f4cb00aede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:34.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.687+0000 7f4caf200640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4cb00c8df0 0x7f4cb00c9270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:34.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.687+0000 7f4caf200640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f4cb015e570 con 0x7f4cb00c8df0 2024-03-27T10:00:34.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.687+0000 7f4caf200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f4cb00af9f0 con 0x7f4c94004800 2024-03-27T10:00:34.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.687+0000 7f4caf200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f4cb015e6f0 con 0x7f4cb00ae960 2024-03-27T10:00:34.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.688+0000 7f4cae800640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4cb00c8df0 0x7f4cb00c9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:34.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.688+0000 7f4cae800640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4cb00c8df0 0x7f4cb00c9270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58792/0 (socket says 172.21.15.57:58792) 2024-03-27T10:00:34.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.688+0000 7f4cae800640 1 -- 172.21.15.57:0/3827628043 learned_addr learned my addr 172.21.15.57:0/3827628043 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:34.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.688+0000 7f4cade00640 1 --2- 172.21.15.57:0/3827628043 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4c94004800 0x7f4cb0159d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:34.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.688+0000 7f4cad400640 1 --2- 172.21.15.57:0/3827628043 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4cb00ae960 0x7f4cb00aede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:34.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.688+0000 7f4cae800640 1 -- 172.21.15.57:0/3827628043 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4cb00ae960 msgr2=0x7f4cb00aede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:34.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.688+0000 7f4cae800640 1 --2- 172.21.15.57:0/3827628043 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4cb00ae960 0x7f4cb00aede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:34.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.688+0000 7f4cae800640 1 -- 172.21.15.57:0/3827628043 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4c94004800 msgr2=0x7f4cb0159d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:34.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.688+0000 7f4cae800640 1 --2- 172.21.15.57:0/3827628043 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4c94004800 0x7f4cb0159d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:34.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.688+0000 7f4cae800640 1 -- 172.21.15.57:0/3827628043 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cb015a240 con 0x7f4cb00c8df0 2024-03-27T10:00:34.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.689+0000 7f4cae800640 1 --2- 172.21.15.57:0/3827628043 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4cb00c8df0 0x7f4cb00c9270 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f4cb00ce3c0 tx=0x7f4ca800df50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:34.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.689+0000 7f4ca6000640 1 -- 172.21.15.57:0/3827628043 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ca800b860 con 0x7f4cb00c8df0 2024-03-27T10:00:34.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.689+0000 7f4ca6000640 1 -- 172.21.15.57:0/3827628043 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ca800ba20 con 0x7f4cb00c8df0 2024-03-27T10:00:34.680 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.689+0000 7f4ca6000640 1 -- 172.21.15.57:0/3827628043 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ca800be10 con 0x7f4cb00c8df0 2024-03-27T10:00:34.680 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.689+0000 7f4caf200640 1 -- 172.21.15.57:0/3827628043 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cb00b38e0 con 0x7f4cb00c8df0 2024-03-27T10:00:34.680 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.689+0000 7f4caf200640 1 -- 172.21.15.57:0/3827628043 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cb00b3e80 con 0x7f4cb00c8df0 2024-03-27T10:00:34.680 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.691+0000 7f4caf200640 1 -- 172.21.15.57:0/3827628043 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cb0068c50 con 0x7f4cb00c8df0 2024-03-27T10:00:34.680 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.691+0000 7f4ca6000640 1 -- 172.21.15.57:0/3827628043 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f4ca801b020 con 0x7f4cb00c8df0 2024-03-27T10:00:34.681 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.692+0000 7f4ca6000640 1 --2- 172.21.15.57:0/3827628043 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f4c9006c560 0x7f4c9006ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:34.682 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.692+0000 7f4ca6000640 1 -- 172.21.15.57:0/3827628043 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f4ca808bae0 con 0x7f4cb00c8df0 2024-03-27T10:00:34.682 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.692+0000 7f4cade00640 1 --2- 172.21.15.57:0/3827628043 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f4c9006c560 0x7f4c9006ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:34.682 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.693+0000 7f4cade00640 1 --2- 172.21.15.57:0/3827628043 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f4c9006c560 0x7f4c9006ea20 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4ca0009a90 tx=0x7f4ca0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:34.686 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.697+0000 7f4ca6000640 1 -- 172.21.15.57:0/3827628043 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f4ca8059d00 con 0x7f4cb00c8df0 2024-03-27T10:00:34.898 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.909+0000 7f4caf200640 1 -- 172.21.15.57:0/3827628043 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f4cb00cdcd0 con 0x7f4cb00c8df0 2024-03-27T10:00:34.899 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.909+0000 7f4ca6000640 1 -- 172.21.15.57:0/3827628043 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) ==== 103+0+11 (secure 0 0 0) 0x7f4ca8059600 con 0x7f4cb00c8df0 2024-03-27T10:00:34.899 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2024-03-27T10:00:34.901 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.911+0000 7f4caf200640 1 -- 172.21.15.57:0/3827628043 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f4c9006c560 msgr2=0x7f4c9006ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:34.901 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.911+0000 7f4caf200640 1 --2- 172.21.15.57:0/3827628043 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f4c9006c560 0x7f4c9006ea20 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f4ca0009a90 tx=0x7f4ca0008040 comp rx=0 tx=0).stop 2024-03-27T10:00:34.901 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.911+0000 7f4caf200640 1 -- 172.21.15.57:0/3827628043 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4cb00c8df0 msgr2=0x7f4cb00c9270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:34.901 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.911+0000 7f4caf200640 1 --2- 172.21.15.57:0/3827628043 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4cb00c8df0 0x7f4cb00c9270 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f4cb00ce3c0 tx=0x7f4ca800df50 comp rx=0 tx=0).stop 2024-03-27T10:00:34.902 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.912+0000 7f4caf200640 1 -- 172.21.15.57:0/3827628043 shutdown_connections 2024-03-27T10:00:34.902 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.912+0000 7f4caf200640 1 --2- 172.21.15.57:0/3827628043 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4cb00c8df0 0x7f4cb00c9270 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:34.902 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.912+0000 7f4caf200640 1 --2- 172.21.15.57:0/3827628043 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4cb00ae960 0x7f4cb00aede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:34.902 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.912+0000 7f4caf200640 1 --2- 172.21.15.57:0/3827628043 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f4c9006c560 0x7f4c9006ea20 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:34.902 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.912+0000 7f4caf200640 1 --2- 172.21.15.57:0/3827628043 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4c94004800 0x7f4cb0159d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:34.902 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.912+0000 7f4caf200640 1 -- 172.21.15.57:0/3827628043 >> 172.21.15.57:0/3827628043 conn(0x7f4cb00cd6a0 msgr2=0x7f4cb00cfdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:34.902 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.912+0000 7f4caf200640 1 -- 172.21.15.57:0/3827628043 shutdown_connections 2024-03-27T10:00:34.902 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:34.912+0000 7f4caf200640 1 -- 172.21.15.57:0/3827628043 wait complete. 2024-03-27T10:00:34.920 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-27T10:00:35.109 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.119+0000 7f72e7200640 1 Processor -- start 2024-03-27T10:00:35.109 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.119+0000 7f72e7200640 1 -- start start 2024-03-27T10:00:35.111 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.121+0000 7f72e7200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f72e006b750 0x7f72e006bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:35.111 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.121+0000 7f72e7200640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f72e00ce740 0x7f72e00cebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:35.111 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.121+0000 7f72e7200640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72e015fc70 con 0x7f72e0145820 2024-03-27T10:00:35.111 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.121+0000 7f72e7200640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f72e0160b60 con 0x7f72e00ce740 2024-03-27T10:00:35.111 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.121+0000 7f72e7200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f72e006c0d0 con 0x7f72e006b750 2024-03-27T10:00:35.111 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.121+0000 7f72dfe00640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f72e0145820 0x7f72e00cc950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:48258/0 (socket says 172.21.15.57:48258) 2024-03-27T10:00:35.111 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.121+0000 7f72e5200640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f72e00ce740 0x7f72e00cebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:35.111 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.121+0000 7f72dfe00640 1 -- 172.21.15.57:0/1605081701 learned_addr learned my addr 172.21.15.57:0/1605081701 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T10:00:35.112 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.122+0000 7f72d7e00640 1 --2- 172.21.15.57:0/1605081701 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f72e006b750 0x7f72e006bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:35.112 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.122+0000 7f72e5200640 1 -- 172.21.15.57:0/1605081701 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f72e006b750 msgr2=0x7f72e006bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:35.112 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.122+0000 7f72e5200640 1 --2- 172.21.15.57:0/1605081701 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f72e006b750 0x7f72e006bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:35.112 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.122+0000 7f72e5200640 1 -- 172.21.15.57:0/1605081701 >> v1:172.21.15.57:6789/0 conn(0x7f72e0145820 legacy=0x7f72e00cc950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:35.112 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.122+0000 7f72e5200640 1 -- 172.21.15.57:0/1605081701 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72e015ff50 con 0x7f72e00ce740 2024-03-27T10:00:35.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.123+0000 7f72e5200640 1 --2- 172.21.15.57:0/1605081701 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f72e00ce740 0x7f72e00cebd0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f72d8009d90 tx=0x7f72d802bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7175035a2c8bc2a3 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:35.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.123+0000 7f72df400640 1 -- 172.21.15.57:0/1605081701 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72d8039070 con 0x7f72e00ce740 2024-03-27T10:00:35.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.124+0000 7f72df400640 1 -- 172.21.15.57:0/1605081701 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72d802cc50 con 0x7f72e00ce740 2024-03-27T10:00:35.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.124+0000 7f72df400640 1 -- 172.21.15.57:0/1605081701 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72d8034440 con 0x7f72e00ce740 2024-03-27T10:00:35.114 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.124+0000 7f72e7200640 1 -- 172.21.15.57:0/1605081701 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f72e00ce740 msgr2=0x7f72e00cebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:35.114 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.124+0000 7f72e7200640 1 --2- 172.21.15.57:0/1605081701 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f72e00ce740 0x7f72e00cebd0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f72d8009d90 tx=0x7f72d802bea0 comp rx=0 tx=0).stop 2024-03-27T10:00:35.114 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.124+0000 7f72e7200640 1 -- 172.21.15.57:0/1605081701 shutdown_connections 2024-03-27T10:00:35.114 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.124+0000 7f72e7200640 1 --2- 172.21.15.57:0/1605081701 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f72e006b750 0x7f72e006bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:35.114 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.124+0000 7f72e7200640 1 --2- 172.21.15.57:0/1605081701 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f72e00ce740 0x7f72e00cebd0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:35.114 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.124+0000 7f72e7200640 1 -- 172.21.15.57:0/1605081701 >> 172.21.15.57:0/1605081701 conn(0x7f72e00b1c60 msgr2=0x7f72e00b2070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:35.115 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.124+0000 7f72e7200640 1 -- 172.21.15.57:0/1605081701 shutdown_connections 2024-03-27T10:00:35.115 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.125+0000 7f72e7200640 1 -- 172.21.15.57:0/1605081701 wait complete. 2024-03-27T10:00:35.115 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.126+0000 7f72e7200640 1 Processor -- start 2024-03-27T10:00:35.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.126+0000 7f72e7200640 1 -- start start 2024-03-27T10:00:35.117 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.127+0000 7f72e7200640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f72e006b750 0x7f72e0155b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:35.117 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.127+0000 7f72e7200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f72e00ce740 0x7f72e01e5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:35.118 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.127+0000 7f72e7200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f72e0145820 0x7f72e01f7730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:35.118 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.127+0000 7f72e7200640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f72e01607f0 con 0x7f72e006b750 2024-03-27T10:00:35.118 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.127+0000 7f72e7200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f72e0160510 con 0x7f72e00ce740 2024-03-27T10:00:35.118 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.127+0000 7f72e7200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f72e0145c00 con 0x7f72e0145820 2024-03-27T10:00:35.118 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.128+0000 7f72dfe00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f72e006b750 0x7f72e0155b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:35.118 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.128+0000 7f72dfe00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f72e006b750 0x7f72e0155b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58804/0 (socket says 172.21.15.57:58804) 2024-03-27T10:00:35.118 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.128+0000 7f72dfe00640 1 -- 172.21.15.57:0/692018763 learned_addr learned my addr 172.21.15.57:0/692018763 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:35.118 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.128+0000 7f72d7e00640 1 --2- 172.21.15.57:0/692018763 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f72e00ce740 0x7f72e01e5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:35.118 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.128+0000 7f72e5200640 1 --2- 172.21.15.57:0/692018763 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f72e0145820 0x7f72e01f7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:35.118 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.128+0000 7f72dfe00640 1 -- 172.21.15.57:0/692018763 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f72e0145820 msgr2=0x7f72e01f7730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:35.118 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.128+0000 7f72dfe00640 1 --2- 172.21.15.57:0/692018763 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f72e0145820 0x7f72e01f7730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:35.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.128+0000 7f72dfe00640 1 -- 172.21.15.57:0/692018763 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f72e00ce740 msgr2=0x7f72e01e5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:35.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.128+0000 7f72dfe00640 1 --2- 172.21.15.57:0/692018763 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f72e00ce740 0x7f72e01e5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:35.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.128+0000 7f72dfe00640 1 -- 172.21.15.57:0/692018763 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72e01f7ea0 con 0x7f72e006b750 2024-03-27T10:00:35.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.128+0000 7f72dfe00640 1 --2- 172.21.15.57:0/692018763 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f72e006b750 0x7f72e0155b60 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f72d000c3f0 tx=0x7f72d000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:35.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.129+0000 7f72dcc00640 1 -- 172.21.15.57:0/692018763 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72d0017070 con 0x7f72e006b750 2024-03-27T10:00:35.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.129+0000 7f72dcc00640 1 -- 172.21.15.57:0/692018763 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72d0005ce0 con 0x7f72e006b750 2024-03-27T10:00:35.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.129+0000 7f72dcc00640 1 -- 172.21.15.57:0/692018763 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72d00072f0 con 0x7f72e006b750 2024-03-27T10:00:35.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.129+0000 7f72e7200640 1 -- 172.21.15.57:0/692018763 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72e01f8180 con 0x7f72e006b750 2024-03-27T10:00:35.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.129+0000 7f72e7200640 1 -- 172.21.15.57:0/692018763 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72e015edc0 con 0x7f72e006b750 2024-03-27T10:00:35.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.130+0000 7f72e7200640 1 -- 172.21.15.57:0/692018763 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72e0068620 con 0x7f72e006b750 2024-03-27T10:00:35.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.131+0000 7f72dcc00640 1 -- 172.21.15.57:0/692018763 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f72d001a070 con 0x7f72e006b750 2024-03-27T10:00:35.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.133+0000 7f72dcc00640 1 --2- 172.21.15.57:0/692018763 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f72bc06c530 0x7f72bc06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:35.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.133+0000 7f72dcc00640 1 -- 172.21.15.57:0/692018763 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f72d008aef0 con 0x7f72e006b750 2024-03-27T10:00:35.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.133+0000 7f72d7e00640 1 --2- 172.21.15.57:0/692018763 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f72bc06c530 0x7f72bc06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:35.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.133+0000 7f72d7e00640 1 --2- 172.21.15.57:0/692018763 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f72bc06c530 0x7f72bc06e9f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f72e01e6400 tx=0x7f72c8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:35.126 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.137+0000 7f72dcc00640 1 -- 172.21.15.57:0/692018763 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f72d0059070 con 0x7f72e006b750 2024-03-27T10:00:35.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.341+0000 7f72e7200640 1 -- 172.21.15.57:0/692018763 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f72e00717f0 con 0x7f72e006b750 2024-03-27T10:00:35.333 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.344+0000 7f72dcc00640 1 -- 172.21.15.57:0/692018763 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) ==== 74+0+18888 (secure 0 0 0) 0x7f72d0058970 con 0x7f72e006b750 2024-03-27T10:00:35.334 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:00:35.334 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":28,"fsid":"7ac43f86-2c16-4a97-98fb-715d3cebc75c","created":"2024-03-27T09:59:04.033417+0000","modified":"2024-03-27T10:00:10.462391+0000","last_up_change":"2024-03-27T09:59:16.969624+0000","last_in_change":"2024-03-27T09:59:07.421690+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-27T09:59:17.253008+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-27T09:59:26.690365+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-27T09:59:27.559059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-27T09:59:31.187596+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"47b44362-7302-4f2a-b735-582c6c3850cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6801","nonce":2020036298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6803","nonce":2020036298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6807","nonce":2020036298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6805","nonce":2020036298}]},"public_addr":"172.21.15.57:6801/2020036298","cluster_addr":"172.21.15.57:6803/2020036298","heartbeat_back_addr":"172.21.15.57:6807/2020036298","heartbeat_front_addr":"172.21.15.57:6805/2020036298","state":["exists","up"]},{"osd":1,"uuid":"feaf96f0-9431-4188-9a09-da505b40e934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6809","nonce":3190929242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6811","nonce":3190929242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6815","nonce":3190929242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6813","nonce":3190929242}]},"public_addr":"172.21.15.57:6809/3190929242","cluster_addr":"172.21.15.57:6811/3190929242","heartbeat_back_addr":"172.21.15.57:6815/3190929242","heartbeat_front_addr":"172.21.15.57:6813/3190929242","state":["exists","up"]},{"osd":2,"uuid":"21e406e6-cfbc-4fe7-a816-e2420487c95d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6817","nonce":4065849973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6819","nonce":4065849973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6823","nonce":4065849973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6821","nonce":4065849973}]},"public_addr":"172.21.15.57:6817/4065849973","cluster_addr":"172.21.15.57:6819/4065849973","heartbeat_back_addr":"172.21.15.57:6823/4065849973","heartbeat_front_addr":"172.21.15.57:6821/4065849973","state":["exists","up"]},{"osd":3,"uuid":"a389af1d-76c4-4dfc-b215-f983f4931257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6825","nonce":158084809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6827","nonce":158084809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6831","nonce":158084809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6829","nonce":158084809}]},"public_addr":"172.21.15.57:6825/158084809","cluster_addr":"172.21.15.57:6827/158084809","heartbeat_back_addr":"172.21.15.57:6831/158084809","heartbeat_front_addr":"172.21.15.57:6829/158084809","state":["exists","up"]},{"osd":4,"uuid":"e9b05dca-557a-43ee-b43f-9ce5b7d28304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6823","nonce":108719401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6827","nonce":108719401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6831","nonce":108719401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6829","nonce":108719401}]},"public_addr":"172.21.15.118:6823/108719401","cluster_addr":"172.21.15.118:6827/108719401","heartbeat_back_addr":"172.21.15.118:6831/108719401","heartbeat_front_addr":"172.21.15.118:6829/108719401","state":["exists","up"]},{"osd":5,"uuid":"d968177d-44ff-499a-b00a-b147ed879253","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6817","nonce":2704605866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6819","nonce":2704605866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6826","nonce":2704605866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6822","nonce":2704605866}]},"public_addr":"172.21.15.118:6817/2704605866","cluster_addr":"172.21.15.118:6819/2704605866","heartbeat_back_addr":"172.21.15.118:6826/2704605866","heartbeat_front_addr":"172.21.15.118:6822/2704605866","state":["exists","up"]},{"osd":6,"uuid":"e8f98052-e6ad-4cfe-a4a9-0b17a434d54e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6801","nonce":1963659095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6803","nonce":1963659095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6807","nonce":1963659095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6805","nonce":1963659095}]},"public_addr":"172.21.15.118:6801/1963659095","cluster_addr":"172.21.15.118:6803/1963659095","heartbeat_back_addr":"172.21.15.118:6807/1963659095","heartbeat_front_addr":"172.21.15.118:6805/1963659095","state":["exists","up"]},{"osd":7,"uuid":"eccff987-8e51-4a63-845a-cf0a3196d7fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6809","nonce":1955879596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6811","nonce":1955879596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6815","nonce":1955879596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6813","nonce":1955879596}]},"public_addr":"172.21.15.118:6809/1955879596","cluster_addr":"172.21.15.118:6811/1955879596","heartbeat_back_addr":"172.21.15.118:6815/1955879596","heartbeat_front_addr":"172.21.15.118:6813/1955879596","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.721258+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.696610+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.777895+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.806769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.743259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.845687+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:13.020165+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.722294+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.e","mappings":[{"from":7,"to":1}]},{"pgid":"3.15","mappings":[{"from":3,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-27T10:00:35.336 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.346+0000 7f72e7200640 1 -- 172.21.15.57:0/692018763 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f72bc06c530 msgr2=0x7f72bc06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:35.337 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.346+0000 7f72e7200640 1 --2- 172.21.15.57:0/692018763 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f72bc06c530 0x7f72bc06e9f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f72e01e6400 tx=0x7f72c8008040 comp rx=0 tx=0).stop 2024-03-27T10:00:35.337 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.346+0000 7f72e7200640 1 -- 172.21.15.57:0/692018763 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f72e006b750 msgr2=0x7f72e0155b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:35.337 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.346+0000 7f72e7200640 1 --2- 172.21.15.57:0/692018763 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f72e006b750 0x7f72e0155b60 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f72d000c3f0 tx=0x7f72d000c8b0 comp rx=0 tx=0).stop 2024-03-27T10:00:35.337 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.347+0000 7f72e7200640 1 -- 172.21.15.57:0/692018763 shutdown_connections 2024-03-27T10:00:35.337 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.347+0000 7f72e7200640 1 --2- 172.21.15.57:0/692018763 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f72e0145820 0x7f72e01f7730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:35.337 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.347+0000 7f72e7200640 1 --2- 172.21.15.57:0/692018763 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f72bc06c530 0x7f72bc06e9f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:35.337 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.347+0000 7f72e7200640 1 --2- 172.21.15.57:0/692018763 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f72e00ce740 0x7f72e01e5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:35.337 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.347+0000 7f72e7200640 1 --2- 172.21.15.57:0/692018763 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f72e006b750 0x7f72e0155b60 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:35.337 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.347+0000 7f72e7200640 1 -- 172.21.15.57:0/692018763 >> 172.21.15.57:0/692018763 conn(0x7f72e00b1c60 msgr2=0x7f72e00cbef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:35.337 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.347+0000 7f72e7200640 1 -- 172.21.15.57:0/692018763 shutdown_connections 2024-03-27T10:00:35.337 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.347+0000 7f72e7200640 1 -- 172.21.15.57:0/692018763 wait complete. 2024-03-27T10:00:35.354 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-27T09:59:17.253008+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-27T09:59:26.690365+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-27T09:59:27.559059+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-27T09:59:31.187596+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-27T10:00:35.355 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-27T10:00:35.555 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.565+0000 7f51da600640 1 Processor -- start 2024-03-27T10:00:35.555 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.566+0000 7f51da600640 1 -- start start 2024-03-27T10:00:35.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.567+0000 7f51da600640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f51d40cecf0 0x7f51d40b0a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:35.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.567+0000 7f51da600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f51d406c8d0 0x7f51d415da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:35.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.567+0000 7f51da600640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51d40afca0 con 0x7f51d40b0fa0 2024-03-27T10:00:35.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.567+0000 7f51da600640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f51d40afa50 con 0x7f51d40cecf0 2024-03-27T10:00:35.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.567+0000 7f51da600640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f51d40aff80 con 0x7f51d406c8d0 2024-03-27T10:00:35.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.567+0000 7f51d9200640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f51d40cecf0 0x7f51d40b0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:35.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.567+0000 7f51d9200640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f51d40cecf0 0x7f51d40b0a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58814/0 (socket says 172.21.15.57:58814) 2024-03-27T10:00:35.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.567+0000 7f51d9200640 1 -- 172.21.15.57:0/4131448867 learned_addr learned my addr 172.21.15.57:0/4131448867 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:35.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.568+0000 7f51d9c00640 1 --2- 172.21.15.57:0/4131448867 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f51d406c8d0 0x7f51d415da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:35.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.568+0000 7f51d9200640 1 -- 172.21.15.57:0/4131448867 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f51d406c8d0 msgr2=0x7f51d415da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:35.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.568+0000 7f51d9200640 1 --2- 172.21.15.57:0/4131448867 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f51d406c8d0 0x7f51d415da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:35.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.568+0000 7f51d9200640 1 -- 172.21.15.57:0/4131448867 >> v1:172.21.15.57:6789/0 conn(0x7f51d40b0fa0 legacy=0x7f51d40b1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:35.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.568+0000 7f51d9200640 1 -- 172.21.15.57:0/4131448867 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51d40b0260 con 0x7f51d40cecf0 2024-03-27T10:00:35.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.569+0000 7f51d9200640 1 --2- 172.21.15.57:0/4131448867 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f51d40cecf0 0x7f51d40b0a60 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f51c4009e50 tx=0x7f51c402be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=214fb61d6b3c20d9 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:35.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.569+0000 7f51d3400640 1 -- 172.21.15.57:0/4131448867 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51c402c9f0 con 0x7f51d40cecf0 2024-03-27T10:00:35.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.569+0000 7f51d3400640 1 -- 172.21.15.57:0/4131448867 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51c402cb90 con 0x7f51d40cecf0 2024-03-27T10:00:35.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.569+0000 7f51d3400640 1 -- 172.21.15.57:0/4131448867 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51c40343f0 con 0x7f51d40cecf0 2024-03-27T10:00:35.560 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.570+0000 7f51da600640 1 -- 172.21.15.57:0/4131448867 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f51d40cecf0 msgr2=0x7f51d40b0a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:35.560 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.570+0000 7f51da600640 1 --2- 172.21.15.57:0/4131448867 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f51d40cecf0 0x7f51d40b0a60 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f51c4009e50 tx=0x7f51c402be50 comp rx=0 tx=0).stop 2024-03-27T10:00:35.560 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.570+0000 7f51da600640 1 -- 172.21.15.57:0/4131448867 shutdown_connections 2024-03-27T10:00:35.560 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.570+0000 7f51da600640 1 --2- 172.21.15.57:0/4131448867 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f51d406c8d0 0x7f51d415da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:35.560 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.570+0000 7f51da600640 1 --2- 172.21.15.57:0/4131448867 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f51d40cecf0 0x7f51d40b0a60 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:35.560 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.570+0000 7f51da600640 1 -- 172.21.15.57:0/4131448867 >> 172.21.15.57:0/4131448867 conn(0x7f51d40d1d90 msgr2=0x7f51d40d21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:35.560 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.570+0000 7f51da600640 1 -- 172.21.15.57:0/4131448867 shutdown_connections 2024-03-27T10:00:35.560 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.570+0000 7f51da600640 1 -- 172.21.15.57:0/4131448867 wait complete. 2024-03-27T10:00:35.561 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.572+0000 7f51da600640 1 Processor -- start 2024-03-27T10:00:35.561 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.572+0000 7f51da600640 1 -- start start 2024-03-27T10:00:35.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.573+0000 7f51da600640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f51d406c8d0 0x7f51d415bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:35.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.573+0000 7f51da600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f51d40cecf0 0x7f51d41f4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:35.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.573+0000 7f51da600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f51d414f5b0 0x7f51d4070300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:35.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.573+0000 7f51da600640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f51d40b1b10 con 0x7f51d406c8d0 2024-03-27T10:00:35.564 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.573+0000 7f51da600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f51d40cf0d0 con 0x7f51d40cecf0 2024-03-27T10:00:35.564 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.573+0000 7f51da600640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f51d40b1c90 con 0x7f51d414f5b0 2024-03-27T10:00:35.564 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.573+0000 7f51d9200640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f51d406c8d0 0x7f51d415bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:35.564 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.573+0000 7f51d9200640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f51d406c8d0 0x7f51d415bb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58830/0 (socket says 172.21.15.57:58830) 2024-03-27T10:00:35.564 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.573+0000 7f51d9200640 1 -- 172.21.15.57:0/2131598132 learned_addr learned my addr 172.21.15.57:0/2131598132 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:35.564 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.574+0000 7f51d9200640 1 -- 172.21.15.57:0/2131598132 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f51d414f5b0 msgr2=0x7f51d4070300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:35.564 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.574+0000 7f51d9200640 1 --2- 172.21.15.57:0/2131598132 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f51d414f5b0 0x7f51d4070300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:35.564 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.574+0000 7f51d9200640 1 -- 172.21.15.57:0/2131598132 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f51d40cecf0 msgr2=0x7f51d41f4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:35.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.574+0000 7f51d9200640 1 --2- 172.21.15.57:0/2131598132 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f51d40cecf0 0x7f51d41f4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:35.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.574+0000 7f51d9200640 1 -- 172.21.15.57:0/2131598132 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51d41f4ab0 con 0x7f51d406c8d0 2024-03-27T10:00:35.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.574+0000 7f51d9200640 1 --2- 172.21.15.57:0/2131598132 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f51d406c8d0 0x7f51d415bb20 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f51c4000f80 tx=0x7f51c4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:35.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.574+0000 7f51d0c00640 1 -- 172.21.15.57:0/2131598132 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51c4044020 con 0x7f51d406c8d0 2024-03-27T10:00:35.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.574+0000 7f51d0c00640 1 -- 172.21.15.57:0/2131598132 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51c4040470 con 0x7f51d406c8d0 2024-03-27T10:00:35.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.574+0000 7f51da600640 1 -- 172.21.15.57:0/2131598132 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51d41f4d90 con 0x7f51d406c8d0 2024-03-27T10:00:35.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.574+0000 7f51d0c00640 1 -- 172.21.15.57:0/2131598132 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51c4009510 con 0x7f51d406c8d0 2024-03-27T10:00:35.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.575+0000 7f51da600640 1 -- 172.21.15.57:0/2131598132 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51d41f4740 con 0x7f51d406c8d0 2024-03-27T10:00:35.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.576+0000 7f51da600640 1 -- 172.21.15.57:0/2131598132 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51d4068c50 con 0x7f51d406c8d0 2024-03-27T10:00:35.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.577+0000 7f51d0c00640 1 -- 172.21.15.57:0/2131598132 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f51c4047020 con 0x7f51d406c8d0 2024-03-27T10:00:35.567 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.578+0000 7f51d0c00640 1 --2- 172.21.15.57:0/2131598132 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f51b006c560 0x7f51b006ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:35.568 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.578+0000 7f51d0c00640 1 -- 172.21.15.57:0/2131598132 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f51c40ae3e0 con 0x7f51d406c8d0 2024-03-27T10:00:35.568 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.578+0000 7f51d3e00640 1 --2- 172.21.15.57:0/2131598132 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f51b006c560 0x7f51b006ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:35.568 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.579+0000 7f51d3e00640 1 --2- 172.21.15.57:0/2131598132 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f51b006c560 0x7f51b006ea20 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f51d415b5f0 tx=0x7f51bc0079b0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:35.572 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.583+0000 7f51d0c00640 1 -- 172.21.15.57:0/2131598132 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f51c404e030 con 0x7f51d406c8d0 2024-03-27T10:00:35.776 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.787+0000 7f51da600640 1 -- 172.21.15.57:0/2131598132 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f51d40d0710 con 0x7f51d406c8d0 2024-03-27T10:00:35.777 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.787+0000 7f51d0c00640 1 -- 172.21.15.57:0/2131598132 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) ==== 93+0+10 (secure 0 0 0) 0x7f51c407c600 con 0x7f51d406c8d0 2024-03-27T10:00:35.777 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2024-03-27T10:00:35.780 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.790+0000 7f51da600640 1 -- 172.21.15.57:0/2131598132 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f51b006c560 msgr2=0x7f51b006ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:35.780 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.790+0000 7f51da600640 1 --2- 172.21.15.57:0/2131598132 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f51b006c560 0x7f51b006ea20 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f51d415b5f0 tx=0x7f51bc0079b0 comp rx=0 tx=0).stop 2024-03-27T10:00:35.780 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.790+0000 7f51da600640 1 -- 172.21.15.57:0/2131598132 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f51d406c8d0 msgr2=0x7f51d415bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:35.780 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.790+0000 7f51da600640 1 --2- 172.21.15.57:0/2131598132 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f51d406c8d0 0x7f51d415bb20 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f51c4000f80 tx=0x7f51c4004a40 comp rx=0 tx=0).stop 2024-03-27T10:00:35.780 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.790+0000 7f51da600640 1 -- 172.21.15.57:0/2131598132 shutdown_connections 2024-03-27T10:00:35.780 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.790+0000 7f51da600640 1 --2- 172.21.15.57:0/2131598132 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f51d414f5b0 0x7f51d4070300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:35.780 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.790+0000 7f51da600640 1 --2- 172.21.15.57:0/2131598132 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f51b006c560 0x7f51b006ea20 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:35.781 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.790+0000 7f51da600640 1 --2- 172.21.15.57:0/2131598132 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f51d40cecf0 0x7f51d41f4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:35.781 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.790+0000 7f51da600640 1 --2- 172.21.15.57:0/2131598132 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f51d406c8d0 0x7f51d415bb20 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:35.781 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.790+0000 7f51da600640 1 -- 172.21.15.57:0/2131598132 >> 172.21.15.57:0/2131598132 conn(0x7f51d40d1d90 msgr2=0x7f51d4074990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:35.781 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.791+0000 7f51da600640 1 -- 172.21.15.57:0/2131598132 shutdown_connections 2024-03-27T10:00:35.781 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:35.791+0000 7f51da600640 1 -- 172.21.15.57:0/2131598132 wait complete. 2024-03-27T10:00:35.798 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-27T10:00:36.007 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.018+0000 7f13faa00640 1 Processor -- start 2024-03-27T10:00:36.007 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.018+0000 7f13faa00640 1 -- start start 2024-03-27T10:00:36.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.019+0000 7f13faa00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f13f415e250 0x7f13f40cf9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:36.010 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.019+0000 7f13faa00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f13f40cfef0 0x7f13f40d0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:36.010 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.019+0000 7f13faa00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f13f415e630 0x7f13f40d0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:36.010 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.019+0000 7f13faa00640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f13f40d2d00 con 0x7f13f415e250 2024-03-27T10:00:36.010 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.019+0000 7f13faa00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f13f40d3190 con 0x7f13f415e630 2024-03-27T10:00:36.010 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.019+0000 7f13faa00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f13f40d20f0 con 0x7f13f40cfef0 2024-03-27T10:00:36.010 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.020+0000 7f13f3e00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f13f415e250 0x7f13f40cf9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:36.010 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.020+0000 7f13f3e00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f13f415e250 0x7f13f40cf9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58840/0 (socket says 172.21.15.57:58840) 2024-03-27T10:00:36.010 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.020+0000 7f13f3e00640 1 -- 172.21.15.57:0/2725601271 learned_addr learned my addr 172.21.15.57:0/2725601271 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:36.010 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.020+0000 7f13f8a00640 1 --2- 172.21.15.57:0/2725601271 >> v2:172.21.15.118:3300/0 conn(0x7f13f415e630 0x7f13f40d0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:36.010 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.020+0000 7f13f3400640 1 --2- 172.21.15.57:0/2725601271 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f13f40cfef0 0x7f13f40d0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:36.010 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.020+0000 7f13f3e00640 1 -- 172.21.15.57:0/2725601271 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f13f40cfef0 msgr2=0x7f13f40d0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:36.010 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.020+0000 7f13f3e00640 1 --2- 172.21.15.57:0/2725601271 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f13f40cfef0 0x7f13f40d0aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:36.010 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.020+0000 7f13f3e00640 1 -- 172.21.15.57:0/2725601271 >> v2:172.21.15.118:3300/0 conn(0x7f13f415e630 msgr2=0x7f13f40d0fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:36.011 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.020+0000 7f13f3e00640 1 --2- 172.21.15.57:0/2725601271 >> v2:172.21.15.118:3300/0 conn(0x7f13f415e630 0x7f13f40d0fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:36.011 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.020+0000 7f13f3e00640 1 -- 172.21.15.57:0/2725601271 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13f40d23d0 con 0x7f13f415e250 2024-03-27T10:00:36.011 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.021+0000 7f13f3e00640 1 --2- 172.21.15.57:0/2725601271 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13f415e250 0x7f13f40cf9b0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f13f409dbb0 tx=0x7f13e402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7cf6016201fc1ae server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:36.011 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.022+0000 7f13f2a00640 1 -- 172.21.15.57:0/2725601271 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13e402ca80 con 0x7f13f415e250 2024-03-27T10:00:36.011 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.022+0000 7f13f2a00640 1 -- 172.21.15.57:0/2725601271 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13e402cc20 con 0x7f13f415e250 2024-03-27T10:00:36.011 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.022+0000 7f13f2a00640 1 -- 172.21.15.57:0/2725601271 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13e40343f0 con 0x7f13f415e250 2024-03-27T10:00:36.012 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.022+0000 7f13faa00640 1 -- 172.21.15.57:0/2725601271 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13f415e250 msgr2=0x7f13f40cf9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:36.013 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.022+0000 7f13faa00640 1 --2- 172.21.15.57:0/2725601271 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13f415e250 0x7f13f40cf9b0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f13f409dbb0 tx=0x7f13e402bee0 comp rx=0 tx=0).stop 2024-03-27T10:00:36.013 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.023+0000 7f13faa00640 1 -- 172.21.15.57:0/2725601271 shutdown_connections 2024-03-27T10:00:36.013 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.023+0000 7f13faa00640 1 --2- 172.21.15.57:0/2725601271 >> v2:172.21.15.118:3300/0 conn(0x7f13f415e630 0x7f13f40d0fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:36.013 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.023+0000 7f13faa00640 1 --2- 172.21.15.57:0/2725601271 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f13f40cfef0 0x7f13f40d0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:36.013 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.023+0000 7f13faa00640 1 --2- 172.21.15.57:0/2725601271 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13f415e250 0x7f13f40cf9b0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:36.013 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.023+0000 7f13faa00640 1 -- 172.21.15.57:0/2725601271 >> 172.21.15.57:0/2725601271 conn(0x7f13f409d4a0 msgr2=0x7f13f40d4160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:36.013 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.023+0000 7f13faa00640 1 -- 172.21.15.57:0/2725601271 shutdown_connections 2024-03-27T10:00:36.013 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.023+0000 7f13faa00640 1 -- 172.21.15.57:0/2725601271 wait complete. 2024-03-27T10:00:36.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.025+0000 7f13faa00640 1 Processor -- start 2024-03-27T10:00:36.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.025+0000 7f13faa00640 1 -- start start 2024-03-27T10:00:36.017 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.026+0000 7f13faa00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f13f40cfef0 0x7f13f4154ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:36.017 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.026+0000 7f13faa00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13f415e250 0x7f13f415be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:36.017 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.027+0000 7f13faa00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f13f415e630 0x7f13f41533c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:36.017 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.027+0000 7f13faa00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f13f40d1d30 con 0x7f13f415e250 2024-03-27T10:00:36.017 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.027+0000 7f13faa00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f13f40d2990 con 0x7f13f40cfef0 2024-03-27T10:00:36.017 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.027+0000 7f13faa00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f13f40d1eb0 con 0x7f13f415e630 2024-03-27T10:00:36.017 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.027+0000 7f13f3400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13f415e250 0x7f13f415be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:36.017 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.027+0000 7f13f3400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13f415e250 0x7f13f415be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58842/0 (socket says 172.21.15.57:58842) 2024-03-27T10:00:36.017 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.027+0000 7f13f3400640 1 -- 172.21.15.57:0/2084503462 learned_addr learned my addr 172.21.15.57:0/2084503462 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:36.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.027+0000 7f13f3e00640 1 --2- 172.21.15.57:0/2084503462 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f13f40cfef0 0x7f13f4154ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:36.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.027+0000 7f13f8a00640 1 --2- 172.21.15.57:0/2084503462 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f13f415e630 0x7f13f41533c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:36.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.027+0000 7f13f3400640 1 -- 172.21.15.57:0/2084503462 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f13f415e630 msgr2=0x7f13f41533c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:36.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.027+0000 7f13f3400640 1 --2- 172.21.15.57:0/2084503462 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f13f415e630 0x7f13f41533c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:36.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.027+0000 7f13f3400640 1 -- 172.21.15.57:0/2084503462 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f13f40cfef0 msgr2=0x7f13f4154ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:36.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.027+0000 7f13f3400640 1 --2- 172.21.15.57:0/2084503462 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f13f40cfef0 0x7f13f4154ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:36.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.027+0000 7f13f3400640 1 -- 172.21.15.57:0/2084503462 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13f415c380 con 0x7f13f415e250 2024-03-27T10:00:36.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.027+0000 7f13f3e00640 1 --2- 172.21.15.57:0/2084503462 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f13f40cfef0 0x7f13f4154ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T10:00:36.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.028+0000 7f13f3400640 1 --2- 172.21.15.57:0/2084503462 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13f415e250 0x7f13f415be40 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f13dc00c570 tx=0x7f13dc00ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:36.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.028+0000 7f13ebe00640 1 -- 172.21.15.57:0/2084503462 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13dc015070 con 0x7f13f415e250 2024-03-27T10:00:36.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.028+0000 7f13ebe00640 1 -- 172.21.15.57:0/2084503462 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13dc011800 con 0x7f13f415e250 2024-03-27T10:00:36.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.028+0000 7f13ebe00640 1 -- 172.21.15.57:0/2084503462 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13dc011bb0 con 0x7f13f415e250 2024-03-27T10:00:36.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.028+0000 7f13faa00640 1 -- 172.21.15.57:0/2084503462 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13f41558f0 con 0x7f13f415e250 2024-03-27T10:00:36.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.028+0000 7f13faa00640 1 -- 172.21.15.57:0/2084503462 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13f4155610 con 0x7f13f415e250 2024-03-27T10:00:36.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.030+0000 7f13faa00640 1 -- 172.21.15.57:0/2084503462 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13f4068540 con 0x7f13f415e250 2024-03-27T10:00:36.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.030+0000 7f13ebe00640 1 -- 172.21.15.57:0/2084503462 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f13dc018070 con 0x7f13f415e250 2024-03-27T10:00:36.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.031+0000 7f13ebe00640 1 --2- 172.21.15.57:0/2084503462 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f13d006c530 0x7f13d006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:36.021 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.031+0000 7f13ebe00640 1 -- 172.21.15.57:0/2084503462 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f13dc08b950 con 0x7f13f415e250 2024-03-27T10:00:36.021 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.032+0000 7f13f3e00640 1 --2- 172.21.15.57:0/2084503462 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f13d006c530 0x7f13d006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:36.022 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.032+0000 7f13f3e00640 1 --2- 172.21.15.57:0/2084503462 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f13d006c530 0x7f13d006e9f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f13e4035000 tx=0x7f13e4030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:36.026 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.037+0000 7f13ebe00640 1 -- 172.21.15.57:0/2084503462 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f13dc059ad0 con 0x7f13f415e250 2024-03-27T10:00:36.234 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.245+0000 7f13faa00640 1 -- 172.21.15.57:0/2084503462 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f13f40d4870 con 0x7f13f415e250 2024-03-27T10:00:36.235 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.246+0000 7f13ebe00640 1 -- 172.21.15.57:0/2084503462 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) ==== 104+0+11 (secure 0 0 0) 0x7f13dc0593d0 con 0x7f13f415e250 2024-03-27T10:00:36.235 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2024-03-27T10:00:36.238 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.248+0000 7f13faa00640 1 -- 172.21.15.57:0/2084503462 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f13d006c530 msgr2=0x7f13d006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:36.238 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.248+0000 7f13faa00640 1 --2- 172.21.15.57:0/2084503462 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f13d006c530 0x7f13d006e9f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f13e4035000 tx=0x7f13e4030000 comp rx=0 tx=0).stop 2024-03-27T10:00:36.238 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.248+0000 7f13faa00640 1 -- 172.21.15.57:0/2084503462 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13f415e250 msgr2=0x7f13f415be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:36.238 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.248+0000 7f13faa00640 1 --2- 172.21.15.57:0/2084503462 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13f415e250 0x7f13f415be40 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f13dc00c570 tx=0x7f13dc00ca30 comp rx=0 tx=0).stop 2024-03-27T10:00:36.238 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.248+0000 7f13faa00640 1 -- 172.21.15.57:0/2084503462 shutdown_connections 2024-03-27T10:00:36.239 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.248+0000 7f13faa00640 1 --2- 172.21.15.57:0/2084503462 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f13f415e630 0x7f13f41533c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:36.239 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.248+0000 7f13faa00640 1 --2- 172.21.15.57:0/2084503462 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13f415e250 0x7f13f415be40 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:36.239 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.248+0000 7f13faa00640 1 --2- 172.21.15.57:0/2084503462 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f13d006c530 0x7f13d006e9f0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:36.239 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.248+0000 7f13faa00640 1 --2- 172.21.15.57:0/2084503462 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f13f40cfef0 0x7f13f4154ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:36.239 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.248+0000 7f13faa00640 1 -- 172.21.15.57:0/2084503462 >> 172.21.15.57:0/2084503462 conn(0x7f13f409d4a0 msgr2=0x7f13f40b5220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:36.239 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.248+0000 7f13faa00640 1 -- 172.21.15.57:0/2084503462 shutdown_connections 2024-03-27T10:00:36.239 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.248+0000 7f13faa00640 1 -- 172.21.15.57:0/2084503462 wait complete. 2024-03-27T10:00:36.258 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-27T10:00:36.479 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.489+0000 7ff22aa00640 1 Processor -- start 2024-03-27T10:00:36.479 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.489+0000 7ff22aa00640 1 -- start start 2024-03-27T10:00:36.481 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.491+0000 7ff22aa00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff22415d1a0 0x7ff2240acd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:36.481 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.491+0000 7ff22aa00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff22406cf30 0x7ff22406d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:36.481 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.491+0000 7ff22aa00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff22415d630 con 0x7ff2240aea20 2024-03-27T10:00:36.481 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.491+0000 7ff22aa00640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7ff22415c4c0 con 0x7ff22406cf30 2024-03-27T10:00:36.481 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.491+0000 7ff22aa00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7ff224072600 con 0x7ff22415d1a0 2024-03-27T10:00:36.481 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.492+0000 7ff228a00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff22406cf30 0x7ff22406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:36.481 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.492+0000 7ff228a00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff22406cf30 0x7ff22406d360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58854/0 (socket says 172.21.15.57:58854) 2024-03-27T10:00:36.481 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.492+0000 7ff228a00640 1 -- 172.21.15.57:0/492017271 learned_addr learned my addr 172.21.15.57:0/492017271 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:36.482 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.492+0000 7ff223400640 1 --2- 172.21.15.57:0/492017271 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff22415d1a0 0x7ff2240acd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:36.482 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.492+0000 7ff228a00640 1 -- 172.21.15.57:0/492017271 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff22415d1a0 msgr2=0x7ff2240acd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:36.482 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.492+0000 7ff228a00640 1 --2- 172.21.15.57:0/492017271 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff22415d1a0 0x7ff2240acd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:36.482 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.492+0000 7ff228a00640 1 -- 172.21.15.57:0/492017271 >> v1:172.21.15.118:6789/0 conn(0x7ff2240aea20 legacy=0x7ff2240aee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:36.483 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.492+0000 7ff228a00640 1 -- 172.21.15.57:0/492017271 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2240728e0 con 0x7ff22406cf30 2024-03-27T10:00:36.484 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.493+0000 7ff228a00640 1 --2- 172.21.15.57:0/492017271 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff22406cf30 0x7ff22406d360 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ff21c009870 tx=0x7ff21c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a501468759782e77 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:36.484 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.494+0000 7ff222a00640 1 -- 172.21.15.57:0/492017271 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff21c035020 con 0x7ff22406cf30 2024-03-27T10:00:36.484 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.494+0000 7ff222a00640 1 -- 172.21.15.57:0/492017271 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff21c031640 con 0x7ff22406cf30 2024-03-27T10:00:36.484 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.494+0000 7ff222a00640 1 -- 172.21.15.57:0/492017271 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff21c02d040 con 0x7ff22406cf30 2024-03-27T10:00:36.484 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.494+0000 7ff22aa00640 1 -- 172.21.15.57:0/492017271 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff22406cf30 msgr2=0x7ff22406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:36.484 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.494+0000 7ff22aa00640 1 --2- 172.21.15.57:0/492017271 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff22406cf30 0x7ff22406d360 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ff21c009870 tx=0x7ff21c02b8f0 comp rx=0 tx=0).stop 2024-03-27T10:00:36.484 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.494+0000 7ff22aa00640 1 -- 172.21.15.57:0/492017271 shutdown_connections 2024-03-27T10:00:36.484 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.494+0000 7ff22aa00640 1 --2- 172.21.15.57:0/492017271 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff22415d1a0 0x7ff2240acd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:36.484 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.494+0000 7ff22aa00640 1 --2- 172.21.15.57:0/492017271 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff22406cf30 0x7ff22406d360 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:36.484 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.494+0000 7ff22aa00640 1 -- 172.21.15.57:0/492017271 >> 172.21.15.57:0/492017271 conn(0x7ff2240b18a0 msgr2=0x7ff2240b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:36.484 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.494+0000 7ff22aa00640 1 -- 172.21.15.57:0/492017271 shutdown_connections 2024-03-27T10:00:36.484 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.494+0000 7ff22aa00640 1 -- 172.21.15.57:0/492017271 wait complete. 2024-03-27T10:00:36.485 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.496+0000 7ff22aa00640 1 Processor -- start 2024-03-27T10:00:36.485 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.496+0000 7ff22aa00640 1 -- start start 2024-03-27T10:00:36.488 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.497+0000 7ff22aa00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff22406cf30 0x7ff22409aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:36.488 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.497+0000 7ff22aa00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff2240aea20 0x7ff22414a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:36.488 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.497+0000 7ff22aa00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff22415d1a0 0x7ff2240c8f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:36.488 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.497+0000 7ff22aa00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7ff2240733c0 con 0x7ff22406cf30 2024-03-27T10:00:36.488 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.497+0000 7ff22aa00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7ff224072ea0 con 0x7ff22415d1a0 2024-03-27T10:00:36.488 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.497+0000 7ff22aa00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7ff22406d8a0 con 0x7ff2240aea20 2024-03-27T10:00:36.488 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.498+0000 7ff223e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff22406cf30 0x7ff22409aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:36.488 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.498+0000 7ff223e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff22406cf30 0x7ff22409aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58864/0 (socket says 172.21.15.57:58864) 2024-03-27T10:00:36.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.498+0000 7ff223e00640 1 -- 172.21.15.57:0/1769248768 learned_addr learned my addr 172.21.15.57:0/1769248768 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:36.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.498+0000 7ff228a00640 1 --2- 172.21.15.57:0/1769248768 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff22415d1a0 0x7ff2240c8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:36.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.498+0000 7ff223400640 1 --2- 172.21.15.57:0/1769248768 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff2240aea20 0x7ff22414a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:36.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.498+0000 7ff223e00640 1 -- 172.21.15.57:0/1769248768 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff2240aea20 msgr2=0x7ff22414a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:36.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.498+0000 7ff223e00640 1 --2- 172.21.15.57:0/1769248768 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff2240aea20 0x7ff22414a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:36.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.498+0000 7ff223e00640 1 -- 172.21.15.57:0/1769248768 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff22415d1a0 msgr2=0x7ff2240c8f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:36.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.498+0000 7ff223e00640 1 --2- 172.21.15.57:0/1769248768 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff22415d1a0 0x7ff2240c8f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:36.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.498+0000 7ff223e00640 1 -- 172.21.15.57:0/1769248768 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff224155c40 con 0x7ff22406cf30 2024-03-27T10:00:36.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.498+0000 7ff223e00640 1 --2- 172.21.15.57:0/1769248768 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff22406cf30 0x7ff22409aa30 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7ff21400c790 tx=0x7ff21400cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:36.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.499+0000 7ff21be00640 1 -- 172.21.15.57:0/1769248768 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff214016020 con 0x7ff22406cf30 2024-03-27T10:00:36.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.499+0000 7ff21be00640 1 -- 172.21.15.57:0/1769248768 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff214006d50 con 0x7ff22406cf30 2024-03-27T10:00:36.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.499+0000 7ff21be00640 1 -- 172.21.15.57:0/1769248768 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff214003bb0 con 0x7ff22406cf30 2024-03-27T10:00:36.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.499+0000 7ff22aa00640 1 -- 172.21.15.57:0/1769248768 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff224155f20 con 0x7ff22406cf30 2024-03-27T10:00:36.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.499+0000 7ff22aa00640 1 -- 172.21.15.57:0/1769248768 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2241564e0 con 0x7ff22406cf30 2024-03-27T10:00:36.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.500+0000 7ff22aa00640 1 -- 172.21.15.57:0/1769248768 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2240757d0 con 0x7ff22406cf30 2024-03-27T10:00:36.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.501+0000 7ff21be00640 1 -- 172.21.15.57:0/1769248768 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7ff21400a850 con 0x7ff22406cf30 2024-03-27T10:00:36.491 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.502+0000 7ff21be00640 1 --2- 172.21.15.57:0/1769248768 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7ff20006c530 0x7ff20006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:36.491 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.502+0000 7ff21be00640 1 -- 172.21.15.57:0/1769248768 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7ff21408b770 con 0x7ff22406cf30 2024-03-27T10:00:36.491 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.502+0000 7ff223400640 1 --2- 172.21.15.57:0/1769248768 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7ff20006c530 0x7ff20006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:36.492 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.503+0000 7ff223400640 1 --2- 172.21.15.57:0/1769248768 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7ff20006c530 0x7ff20006e9f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff20c006fd0 tx=0x7ff20c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:36.495 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.506+0000 7ff21be00640 1 -- 172.21.15.57:0/1769248768 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7ff214020020 con 0x7ff22406cf30 2024-03-27T10:00:36.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.699+0000 7ff22aa00640 1 -- 172.21.15.57:0/1769248768 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7ff224068540 con 0x7ff22406cf30 2024-03-27T10:00:36.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.700+0000 7ff21be00640 1 -- 172.21.15.57:0/1769248768 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) ==== 100+0+11 (secure 0 0 0) 0x7ff214019310 con 0x7ff22406cf30 2024-03-27T10:00:36.692 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2024-03-27T10:00:36.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.702+0000 7ff22aa00640 1 -- 172.21.15.57:0/1769248768 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7ff20006c530 msgr2=0x7ff20006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:36.693 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.702+0000 7ff22aa00640 1 --2- 172.21.15.57:0/1769248768 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7ff20006c530 0x7ff20006e9f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff20c006fd0 tx=0x7ff20c008040 comp rx=0 tx=0).stop 2024-03-27T10:00:36.693 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.702+0000 7ff22aa00640 1 -- 172.21.15.57:0/1769248768 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff22406cf30 msgr2=0x7ff22409aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:36.693 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.702+0000 7ff22aa00640 1 --2- 172.21.15.57:0/1769248768 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff22406cf30 0x7ff22409aa30 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7ff21400c790 tx=0x7ff21400cc50 comp rx=0 tx=0).stop 2024-03-27T10:00:36.693 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.702+0000 7ff22aa00640 1 -- 172.21.15.57:0/1769248768 shutdown_connections 2024-03-27T10:00:36.693 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.702+0000 7ff22aa00640 1 --2- 172.21.15.57:0/1769248768 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7ff20006c530 0x7ff20006e9f0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:36.693 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.702+0000 7ff22aa00640 1 --2- 172.21.15.57:0/1769248768 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff22415d1a0 0x7ff2240c8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:36.693 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.702+0000 7ff22aa00640 1 --2- 172.21.15.57:0/1769248768 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff2240aea20 0x7ff22414a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:36.693 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.702+0000 7ff22aa00640 1 --2- 172.21.15.57:0/1769248768 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff22406cf30 0x7ff22409aa30 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:36.693 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.702+0000 7ff22aa00640 1 -- 172.21.15.57:0/1769248768 >> 172.21.15.57:0/1769248768 conn(0x7ff2240b18a0 msgr2=0x7ff2240b08a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:36.693 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.703+0000 7ff22aa00640 1 -- 172.21.15.57:0/1769248768 shutdown_connections 2024-03-27T10:00:36.693 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.703+0000 7ff22aa00640 1 -- 172.21.15.57:0/1769248768 wait complete. 2024-03-27T10:00:36.711 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-27T10:00:36.936 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.946+0000 7f9f9a600640 1 Processor -- start 2024-03-27T10:00:36.936 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.947+0000 7f9f9a600640 1 -- start start 2024-03-27T10:00:36.938 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.948+0000 7f9f9a600640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9f940cd920 0x7f9f9406ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:36.938 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.948+0000 7f9f9a600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9f9406ef50 0x7f9f940c49e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:36.938 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.948+0000 7f9f9a600640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f9415b260 con 0x7f9f9415ae80 2024-03-27T10:00:36.938 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.948+0000 7f9f9a600640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f9f940ceaa0 con 0x7f9f940cd920 2024-03-27T10:00:36.938 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.948+0000 7f9f9a600640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f9f940cde90 con 0x7f9f9406ef50 2024-03-27T10:00:36.938 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.948+0000 7f9f93e00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9f940cd920 0x7f9f9406ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:36.938 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.948+0000 7f9f99200640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f9f9415ae80 0x7f9f940cbcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:48278/0 (socket says 172.21.15.57:48278) 2024-03-27T10:00:36.938 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.949+0000 7f9f99200640 1 -- 172.21.15.57:0/1971414961 learned_addr learned my addr 172.21.15.57:0/1971414961 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T10:00:36.938 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.949+0000 7f9f99c00640 1 --2- 172.21.15.57:0/1971414961 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9f9406ef50 0x7f9f940c49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:36.939 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.949+0000 7f9f93e00640 1 -- 172.21.15.57:0/1971414961 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9f9406ef50 msgr2=0x7f9f940c49e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:36.939 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.949+0000 7f9f93e00640 1 --2- 172.21.15.57:0/1971414961 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9f9406ef50 0x7f9f940c49e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:36.939 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.949+0000 7f9f93e00640 1 -- 172.21.15.57:0/1971414961 >> v1:172.21.15.57:6789/0 conn(0x7f9f9415ae80 legacy=0x7f9f940cbcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:36.939 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.949+0000 7f9f93e00640 1 -- 172.21.15.57:0/1971414961 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f940ce170 con 0x7f9f940cd920 2024-03-27T10:00:36.939 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.949+0000 7f9f93400640 1 -- 172.21.15.57:0/1971414961 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1409448209 0 0) 0x7f9f9415b260 con 0x7f9f9415ae80 2024-03-27T10:00:36.940 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.950+0000 7f9f93e00640 1 --2- 172.21.15.57:0/1971414961 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9f940cd920 0x7f9f9406ea10 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c0097d0 tx=0x7f9f7c02b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7456e41417d5e95c server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:36.940 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.950+0000 7f9f93400640 1 -- 172.21.15.57:0/1971414961 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f7c035020 con 0x7f9f940cd920 2024-03-27T10:00:36.940 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.950+0000 7f9f93400640 1 -- 172.21.15.57:0/1971414961 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f7c031800 con 0x7f9f940cd920 2024-03-27T10:00:36.940 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.951+0000 7f9f93400640 1 -- 172.21.15.57:0/1971414961 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f7c031bd0 con 0x7f9f940cd920 2024-03-27T10:00:36.941 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.951+0000 7f9f9a600640 1 -- 172.21.15.57:0/1971414961 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9f940cd920 msgr2=0x7f9f9406ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:36.941 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.951+0000 7f9f9a600640 1 --2- 172.21.15.57:0/1971414961 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9f940cd920 0x7f9f9406ea10 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c0097d0 tx=0x7f9f7c02b8a0 comp rx=0 tx=0).stop 2024-03-27T10:00:36.941 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.951+0000 7f9f9a600640 1 -- 172.21.15.57:0/1971414961 shutdown_connections 2024-03-27T10:00:36.941 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.951+0000 7f9f9a600640 1 --2- 172.21.15.57:0/1971414961 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9f9406ef50 0x7f9f940c49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:36.941 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.951+0000 7f9f9a600640 1 --2- 172.21.15.57:0/1971414961 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9f940cd920 0x7f9f9406ea10 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:36.941 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.951+0000 7f9f9a600640 1 -- 172.21.15.57:0/1971414961 >> 172.21.15.57:0/1971414961 conn(0x7f9f940cfb40 msgr2=0x7f9f940cff20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:36.941 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.951+0000 7f9f9a600640 1 -- 172.21.15.57:0/1971414961 shutdown_connections 2024-03-27T10:00:36.941 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.951+0000 7f9f9a600640 1 -- 172.21.15.57:0/1971414961 wait complete. 2024-03-27T10:00:36.942 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.953+0000 7f9f9a600640 1 Processor -- start 2024-03-27T10:00:36.942 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.953+0000 7f9f9a600640 1 -- start start 2024-03-27T10:00:36.946 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.954+0000 7f9f9a600640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9f9406ef50 0x7f9f94146740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:36.946 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.954+0000 7f9f9a600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9f940cd920 0x7f9f94147020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:36.946 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.954+0000 7f9f9a600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f9415ae80 0x7f9f940c8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:36.946 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.954+0000 7f9f9a600640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f9f940cef30 con 0x7f9f9406ef50 2024-03-27T10:00:36.946 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.954+0000 7f9f9a600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f9f940ce730 con 0x7f9f9415ae80 2024-03-27T10:00:36.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.954+0000 7f9f9a600640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f9f94157c00 con 0x7f9f940cd920 2024-03-27T10:00:36.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.954+0000 7f9f99200640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9f9406ef50 0x7f9f94146740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:36.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.954+0000 7f9f99200640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9f9406ef50 0x7f9f94146740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58882/0 (socket says 172.21.15.57:58882) 2024-03-27T10:00:36.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.954+0000 7f9f99200640 1 -- 172.21.15.57:0/1019744043 learned_addr learned my addr 172.21.15.57:0/1019744043 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:36.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.955+0000 7f9f99200640 1 -- 172.21.15.57:0/1019744043 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9f940cd920 msgr2=0x7f9f94147020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:36.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.955+0000 7f9f99200640 1 --2- 172.21.15.57:0/1019744043 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9f940cd920 0x7f9f94147020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:36.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.955+0000 7f9f99200640 1 -- 172.21.15.57:0/1019744043 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f9415ae80 msgr2=0x7f9f940c8c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:36.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.955+0000 7f9f99c00640 1 --2- 172.21.15.57:0/1019744043 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f9415ae80 0x7f9f940c8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:36.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.955+0000 7f9f99200640 1 --2- 172.21.15.57:0/1019744043 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f9415ae80 0x7f9f940c8c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:36.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.955+0000 7f9f99200640 1 -- 172.21.15.57:0/1019744043 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f94157ee0 con 0x7f9f9406ef50 2024-03-27T10:00:36.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.955+0000 7f9f99200640 1 --2- 172.21.15.57:0/1019744043 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9f9406ef50 0x7f9f94146740 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f9f8400c460 tx=0x7f9f8400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:36.949 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.955+0000 7f9f90c00640 1 -- 172.21.15.57:0/1019744043 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f84018070 con 0x7f9f9406ef50 2024-03-27T10:00:36.949 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.955+0000 7f9f90c00640 1 -- 172.21.15.57:0/1019744043 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f84007500 con 0x7f9f9406ef50 2024-03-27T10:00:36.949 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.955+0000 7f9f9a600640 1 -- 172.21.15.57:0/1019744043 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f940b4450 con 0x7f9f9406ef50 2024-03-27T10:00:36.949 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.955+0000 7f9f90c00640 1 -- 172.21.15.57:0/1019744043 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f84004a20 con 0x7f9f9406ef50 2024-03-27T10:00:36.949 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.956+0000 7f9f9a600640 1 -- 172.21.15.57:0/1019744043 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f940b4a10 con 0x7f9f9406ef50 2024-03-27T10:00:36.951 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.957+0000 7f9f9a600640 1 -- 172.21.15.57:0/1019744043 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f94068540 con 0x7f9f9406ef50 2024-03-27T10:00:36.951 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.958+0000 7f9f90c00640 1 -- 172.21.15.57:0/1019744043 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f9f8401b070 con 0x7f9f9406ef50 2024-03-27T10:00:36.952 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.958+0000 7f9f90c00640 1 --2- 172.21.15.57:0/1019744043 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f9f7006c530 0x7f9f7006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:36.952 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.959+0000 7f9f90c00640 1 -- 172.21.15.57:0/1019744043 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f9f8408ad00 con 0x7f9f9406ef50 2024-03-27T10:00:36.952 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.959+0000 7f9f93e00640 1 --2- 172.21.15.57:0/1019744043 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f9f7006c530 0x7f9f7006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:36.952 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.959+0000 7f9f93e00640 1 --2- 172.21.15.57:0/1019744043 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f9f7006c530 0x7f9f7006e9f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c036000 tx=0x7f9f7c030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:36.953 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:36.963+0000 7f9f90c00640 1 -- 172.21.15.57:0/1019744043 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f9f84058fb0 con 0x7f9f9406ef50 2024-03-27T10:00:37.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.166+0000 7f9f9a600640 1 -- 172.21.15.57:0/1019744043 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f9f940c5b20 con 0x7f9f9406ef50 2024-03-27T10:00:37.157 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.167+0000 7f9f90c00640 1 -- 172.21.15.57:0/1019744043 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) ==== 103+0+11 (secure 0 0 0) 0x7f9f840588b0 con 0x7f9f9406ef50 2024-03-27T10:00:37.157 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2024-03-27T10:00:37.160 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.170+0000 7f9f9a600640 1 -- 172.21.15.57:0/1019744043 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f9f7006c530 msgr2=0x7f9f7006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:37.160 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.170+0000 7f9f9a600640 1 --2- 172.21.15.57:0/1019744043 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f9f7006c530 0x7f9f7006e9f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c036000 tx=0x7f9f7c030000 comp rx=0 tx=0).stop 2024-03-27T10:00:37.160 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.170+0000 7f9f9a600640 1 -- 172.21.15.57:0/1019744043 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9f9406ef50 msgr2=0x7f9f94146740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:37.160 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.170+0000 7f9f9a600640 1 --2- 172.21.15.57:0/1019744043 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9f9406ef50 0x7f9f94146740 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f9f8400c460 tx=0x7f9f8400c920 comp rx=0 tx=0).stop 2024-03-27T10:00:37.160 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.170+0000 7f9f9a600640 1 -- 172.21.15.57:0/1019744043 shutdown_connections 2024-03-27T10:00:37.160 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.170+0000 7f9f9a600640 1 --2- 172.21.15.57:0/1019744043 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f9f7006c530 0x7f9f7006e9f0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:37.161 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.170+0000 7f9f9a600640 1 --2- 172.21.15.57:0/1019744043 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9f9415ae80 0x7f9f940c8c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:37.161 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.170+0000 7f9f9a600640 1 --2- 172.21.15.57:0/1019744043 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9f940cd920 0x7f9f94147020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:37.161 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.170+0000 7f9f9a600640 1 --2- 172.21.15.57:0/1019744043 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9f9406ef50 0x7f9f94146740 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:37.161 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.170+0000 7f9f9a600640 1 -- 172.21.15.57:0/1019744043 >> 172.21.15.57:0/1019744043 conn(0x7f9f940cfb40 msgr2=0x7f9f940cbe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:37.161 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.171+0000 7f9f9a600640 1 -- 172.21.15.57:0/1019744043 shutdown_connections 2024-03-27T10:00:37.161 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.171+0000 7f9f9a600640 1 -- 172.21.15.57:0/1019744043 wait complete. 2024-03-27T10:00:37.230 INFO:tasks.cephfs_test_runner:Starting test: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2024-03-27T10:00:37.230 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-27T10:00:37.456 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.466+0000 7fc72ae00640 1 Processor -- start 2024-03-27T10:00:37.456 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.467+0000 7fc72ae00640 1 -- start start 2024-03-27T10:00:37.459 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.469+0000 7fc72ae00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc72415ded0 0x7fc72415e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:37.459 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.469+0000 7fc72ae00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fc72406f2f0 0x7fc724161d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:37.459 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.469+0000 7fc72ae00640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc724162a30 con 0x7fc7240b4260 2024-03-27T10:00:37.459 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.469+0000 7fc72ae00640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7fc724162d10 con 0x7fc72415ded0 2024-03-27T10:00:37.459 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.469+0000 7fc72ae00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7fc7240b3dd0 con 0x7fc72406f2f0 2024-03-27T10:00:37.459 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.469+0000 7fc71be00640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fc7240b4260 0x7fc72406ebe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:48282/0 (socket says 172.21.15.57:48282) 2024-03-27T10:00:37.459 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.469+0000 7fc71be00640 1 -- 172.21.15.57:0/1499301242 learned_addr learned my addr 172.21.15.57:0/1499301242 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T10:00:37.459 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.469+0000 7fc723e00640 1 --2- 172.21.15.57:0/1499301242 >> v2:172.21.15.57:3300/0 conn(0x7fc72415ded0 0x7fc72415e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:37.459 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.470+0000 7fc728e00640 1 --2- 172.21.15.57:0/1499301242 >> v2:172.21.15.118:3300/0 conn(0x7fc72406f2f0 0x7fc724161d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:37.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.470+0000 7fc723e00640 1 -- 172.21.15.57:0/1499301242 >> v2:172.21.15.118:3300/0 conn(0x7fc72406f2f0 msgr2=0x7fc724161d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:37.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.470+0000 7fc723e00640 1 --2- 172.21.15.57:0/1499301242 >> v2:172.21.15.118:3300/0 conn(0x7fc72406f2f0 0x7fc724161d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:37.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.470+0000 7fc723e00640 1 -- 172.21.15.57:0/1499301242 >> v1:172.21.15.57:6789/0 conn(0x7fc7240b4260 legacy=0x7fc72406ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:37.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.470+0000 7fc723400640 1 -- 172.21.15.57:0/1499301242 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 843325807 0 0) 0x7fc724162a30 con 0x7fc7240b4260 2024-03-27T10:00:37.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.470+0000 7fc723e00640 1 -- 172.21.15.57:0/1499301242 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7240b3780 con 0x7fc72415ded0 2024-03-27T10:00:37.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.471+0000 7fc723e00640 1 --2- 172.21.15.57:0/1499301242 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc72415ded0 0x7fc72415e2b0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fc7240af750 tx=0x7fc71402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34a4fa6023d0390c server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:37.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.471+0000 7fc723400640 1 -- 172.21.15.57:0/1499301242 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc714035020 con 0x7fc72415ded0 2024-03-27T10:00:37.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.471+0000 7fc723400640 1 -- 172.21.15.57:0/1499301242 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc714031830 con 0x7fc72415ded0 2024-03-27T10:00:37.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.471+0000 7fc723400640 1 -- 172.21.15.57:0/1499301242 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc714031c00 con 0x7fc72415ded0 2024-03-27T10:00:37.462 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.472+0000 7fc72ae00640 1 -- 172.21.15.57:0/1499301242 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc72415ded0 msgr2=0x7fc72415e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:37.462 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.472+0000 7fc72ae00640 1 --2- 172.21.15.57:0/1499301242 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc72415ded0 0x7fc72415e2b0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fc7240af750 tx=0x7fc71402b8d0 comp rx=0 tx=0).stop 2024-03-27T10:00:37.462 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.472+0000 7fc72ae00640 1 -- 172.21.15.57:0/1499301242 shutdown_connections 2024-03-27T10:00:37.462 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.472+0000 7fc72ae00640 1 --2- 172.21.15.57:0/1499301242 >> v2:172.21.15.118:3300/0 conn(0x7fc72406f2f0 0x7fc724161d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:37.462 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.472+0000 7fc72ae00640 1 --2- 172.21.15.57:0/1499301242 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc72415ded0 0x7fc72415e2b0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:37.462 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.472+0000 7fc72ae00640 1 -- 172.21.15.57:0/1499301242 >> 172.21.15.57:0/1499301242 conn(0x7fc7240b1c60 msgr2=0x7fc7240b2070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:37.462 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.472+0000 7fc72ae00640 1 -- 172.21.15.57:0/1499301242 shutdown_connections 2024-03-27T10:00:37.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.472+0000 7fc72ae00640 1 -- 172.21.15.57:0/1499301242 wait complete. 2024-03-27T10:00:37.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.474+0000 7fc72ae00640 1 Processor -- start 2024-03-27T10:00:37.464 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.474+0000 7fc72ae00640 1 -- start start 2024-03-27T10:00:37.465 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.475+0000 7fc72ae00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc72406f2f0 0x7fc72414f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:37.466 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.475+0000 7fc72ae00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc7240b4260 0x7fc72414fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:37.466 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.475+0000 7fc72ae00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc72415ded0 0x7fc72415f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:37.466 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.475+0000 7fc72ae00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fc7241622b0 con 0x7fc72406f2f0 2024-03-27T10:00:37.466 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.475+0000 7fc72ae00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fc7240b46c0 con 0x7fc72415ded0 2024-03-27T10:00:37.466 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.475+0000 7fc72ae00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fc724162430 con 0x7fc7240b4260 2024-03-27T10:00:37.466 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.475+0000 7fc723e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc72406f2f0 0x7fc72414f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:37.466 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.475+0000 7fc723e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc72406f2f0 0x7fc72414f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58892/0 (socket says 172.21.15.57:58892) 2024-03-27T10:00:37.466 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.475+0000 7fc723e00640 1 -- 172.21.15.57:0/967117065 learned_addr learned my addr 172.21.15.57:0/967117065 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:37.466 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.476+0000 7fc723e00640 1 -- 172.21.15.57:0/967117065 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc7240b4260 msgr2=0x7fc72414fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:37.466 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.476+0000 7fc723e00640 1 --2- 172.21.15.57:0/967117065 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc7240b4260 0x7fc72414fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:37.467 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.476+0000 7fc723e00640 1 -- 172.21.15.57:0/967117065 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc72415ded0 msgr2=0x7fc72415f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:37.467 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.476+0000 7fc728e00640 1 --2- 172.21.15.57:0/967117065 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc72415ded0 0x7fc72415f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:37.467 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.476+0000 7fc723e00640 1 --2- 172.21.15.57:0/967117065 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc72415ded0 0x7fc72415f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:37.467 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.476+0000 7fc723e00640 1 -- 172.21.15.57:0/967117065 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc724160760 con 0x7fc72406f2f0 2024-03-27T10:00:37.467 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.476+0000 7fc723e00640 1 --2- 172.21.15.57:0/967117065 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc72406f2f0 0x7fc72414f4c0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fc714000c00 tx=0x7fc7140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:37.468 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.477+0000 7fc720c00640 1 -- 172.21.15.57:0/967117065 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc714040070 con 0x7fc72406f2f0 2024-03-27T10:00:37.468 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.477+0000 7fc720c00640 1 -- 172.21.15.57:0/967117065 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc714039a00 con 0x7fc72406f2f0 2024-03-27T10:00:37.468 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.477+0000 7fc720c00640 1 -- 172.21.15.57:0/967117065 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc714035040 con 0x7fc72406f2f0 2024-03-27T10:00:37.468 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.477+0000 7fc72ae00640 1 -- 172.21.15.57:0/967117065 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc724160a40 con 0x7fc72406f2f0 2024-03-27T10:00:37.468 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.477+0000 7fc72ae00640 1 -- 172.21.15.57:0/967117065 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7240ccd90 con 0x7fc72406f2f0 2024-03-27T10:00:37.468 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.478+0000 7fc72ae00640 1 -- 172.21.15.57:0/967117065 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc724068620 con 0x7fc72406f2f0 2024-03-27T10:00:37.468 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.479+0000 7fc720c00640 1 -- 172.21.15.57:0/967117065 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fc71404b060 con 0x7fc72406f2f0 2024-03-27T10:00:37.469 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.480+0000 7fc720c00640 1 --2- 172.21.15.57:0/967117065 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fc70006c530 0x7fc70006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:37.469 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.480+0000 7fc720c00640 1 -- 172.21.15.57:0/967117065 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fc7140ad4a0 con 0x7fc72406f2f0 2024-03-27T10:00:37.469 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.480+0000 7fc71be00640 1 --2- 172.21.15.57:0/967117065 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fc70006c530 0x7fc70006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:37.470 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.481+0000 7fc71be00640 1 --2- 172.21.15.57:0/967117065 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fc70006c530 0x7fc70006e9f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc70c007fd0 tx=0x7fc70c007920 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:37.474 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.485+0000 7fc720c00640 1 -- 172.21.15.57:0/967117065 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7fc71407b620 con 0x7fc72406f2f0 2024-03-27T10:00:37.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.688+0000 7fc72ae00640 1 -- 172.21.15.57:0/967117065 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc724158e60 con 0x7fc72406f2f0 2024-03-27T10:00:37.681 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.692+0000 7fc720c00640 1 -- 172.21.15.57:0/967117065 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) ==== 74+0+18888 (secure 0 0 0) 0x7fc71407af20 con 0x7fc72406f2f0 2024-03-27T10:00:37.682 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:00:37.682 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":28,"fsid":"7ac43f86-2c16-4a97-98fb-715d3cebc75c","created":"2024-03-27T09:59:04.033417+0000","modified":"2024-03-27T10:00:10.462391+0000","last_up_change":"2024-03-27T09:59:16.969624+0000","last_in_change":"2024-03-27T09:59:07.421690+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-27T09:59:17.253008+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-27T09:59:26.690365+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-27T09:59:27.559059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-27T09:59:31.187596+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"47b44362-7302-4f2a-b735-582c6c3850cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6801","nonce":2020036298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6803","nonce":2020036298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6807","nonce":2020036298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6805","nonce":2020036298}]},"public_addr":"172.21.15.57:6801/2020036298","cluster_addr":"172.21.15.57:6803/2020036298","heartbeat_back_addr":"172.21.15.57:6807/2020036298","heartbeat_front_addr":"172.21.15.57:6805/2020036298","state":["exists","up"]},{"osd":1,"uuid":"feaf96f0-9431-4188-9a09-da505b40e934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6809","nonce":3190929242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6811","nonce":3190929242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6815","nonce":3190929242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6813","nonce":3190929242}]},"public_addr":"172.21.15.57:6809/3190929242","cluster_addr":"172.21.15.57:6811/3190929242","heartbeat_back_addr":"172.21.15.57:6815/3190929242","heartbeat_front_addr":"172.21.15.57:6813/3190929242","state":["exists","up"]},{"osd":2,"uuid":"21e406e6-cfbc-4fe7-a816-e2420487c95d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6817","nonce":4065849973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6819","nonce":4065849973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6823","nonce":4065849973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6821","nonce":4065849973}]},"public_addr":"172.21.15.57:6817/4065849973","cluster_addr":"172.21.15.57:6819/4065849973","heartbeat_back_addr":"172.21.15.57:6823/4065849973","heartbeat_front_addr":"172.21.15.57:6821/4065849973","state":["exists","up"]},{"osd":3,"uuid":"a389af1d-76c4-4dfc-b215-f983f4931257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6825","nonce":158084809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6827","nonce":158084809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6831","nonce":158084809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6829","nonce":158084809}]},"public_addr":"172.21.15.57:6825/158084809","cluster_addr":"172.21.15.57:6827/158084809","heartbeat_back_addr":"172.21.15.57:6831/158084809","heartbeat_front_addr":"172.21.15.57:6829/158084809","state":["exists","up"]},{"osd":4,"uuid":"e9b05dca-557a-43ee-b43f-9ce5b7d28304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6823","nonce":108719401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6827","nonce":108719401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6831","nonce":108719401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6829","nonce":108719401}]},"public_addr":"172.21.15.118:6823/108719401","cluster_addr":"172.21.15.118:6827/108719401","heartbeat_back_addr":"172.21.15.118:6831/108719401","heartbeat_front_addr":"172.21.15.118:6829/108719401","state":["exists","up"]},{"osd":5,"uuid":"d968177d-44ff-499a-b00a-b147ed879253","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6817","nonce":2704605866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6819","nonce":2704605866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6826","nonce":2704605866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6822","nonce":2704605866}]},"public_addr":"172.21.15.118:6817/2704605866","cluster_addr":"172.21.15.118:6819/2704605866","heartbeat_back_addr":"172.21.15.118:6826/2704605866","heartbeat_front_addr":"172.21.15.118:6822/2704605866","state":["exists","up"]},{"osd":6,"uuid":"e8f98052-e6ad-4cfe-a4a9-0b17a434d54e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6801","nonce":1963659095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6803","nonce":1963659095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6807","nonce":1963659095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6805","nonce":1963659095}]},"public_addr":"172.21.15.118:6801/1963659095","cluster_addr":"172.21.15.118:6803/1963659095","heartbeat_back_addr":"172.21.15.118:6807/1963659095","heartbeat_front_addr":"172.21.15.118:6805/1963659095","state":["exists","up"]},{"osd":7,"uuid":"eccff987-8e51-4a63-845a-cf0a3196d7fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6809","nonce":1955879596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6811","nonce":1955879596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6815","nonce":1955879596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6813","nonce":1955879596}]},"public_addr":"172.21.15.118:6809/1955879596","cluster_addr":"172.21.15.118:6811/1955879596","heartbeat_back_addr":"172.21.15.118:6815/1955879596","heartbeat_front_addr":"172.21.15.118:6813/1955879596","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.721258+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.696610+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.777895+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.806769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.743259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.845687+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:13.020165+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.722294+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.e","mappings":[{"from":7,"to":1}]},{"pgid":"3.15","mappings":[{"from":3,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-27T10:00:37.684 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.694+0000 7fc72ae00640 1 -- 172.21.15.57:0/967117065 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fc70006c530 msgr2=0x7fc70006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:37.684 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.694+0000 7fc72ae00640 1 --2- 172.21.15.57:0/967117065 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fc70006c530 0x7fc70006e9f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc70c007fd0 tx=0x7fc70c007920 comp rx=0 tx=0).stop 2024-03-27T10:00:37.684 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.694+0000 7fc72ae00640 1 -- 172.21.15.57:0/967117065 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc72406f2f0 msgr2=0x7fc72414f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:37.684 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.694+0000 7fc72ae00640 1 --2- 172.21.15.57:0/967117065 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc72406f2f0 0x7fc72414f4c0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fc714000c00 tx=0x7fc7140046c0 comp rx=0 tx=0).stop 2024-03-27T10:00:37.684 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.694+0000 7fc72ae00640 1 -- 172.21.15.57:0/967117065 shutdown_connections 2024-03-27T10:00:37.684 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.694+0000 7fc72ae00640 1 --2- 172.21.15.57:0/967117065 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fc70006c530 0x7fc70006e9f0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:37.684 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.694+0000 7fc72ae00640 1 --2- 172.21.15.57:0/967117065 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc72415ded0 0x7fc72415f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:37.684 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.694+0000 7fc72ae00640 1 --2- 172.21.15.57:0/967117065 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc7240b4260 0x7fc72414fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:37.684 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.694+0000 7fc72ae00640 1 --2- 172.21.15.57:0/967117065 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc72406f2f0 0x7fc72414f4c0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:37.685 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.694+0000 7fc72ae00640 1 -- 172.21.15.57:0/967117065 >> 172.21.15.57:0/967117065 conn(0x7fc7240b1c60 msgr2=0x7fc7240af9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:37.685 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.695+0000 7fc72ae00640 1 -- 172.21.15.57:0/967117065 shutdown_connections 2024-03-27T10:00:37.685 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.695+0000 7fc72ae00640 1 -- 172.21.15.57:0/967117065 wait complete. 2024-03-27T10:00:37.706 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-27T09:59:17.253008+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-27T09:59:26.690365+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-27T09:59:27.559059+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-27T09:59:31.187596+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-27T10:00:37.709 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-27T10:00:37.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.935+0000 7fd531e00640 1 Processor -- start 2024-03-27T10:00:37.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.936+0000 7fd531e00640 1 -- start start 2024-03-27T10:00:37.926 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.937+0000 7fd531e00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fd52c161950 0x7fd52c0ceb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:37.926 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.937+0000 7fd531e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd52c0d3770 0x7fd52c06bf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:37.927 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.937+0000 7fd531e00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd52c0cfe40 con 0x7fd52c0cf040 2024-03-27T10:00:37.927 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.937+0000 7fd531e00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7fd52c161d30 con 0x7fd52c161950 2024-03-27T10:00:37.927 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.937+0000 7fd531e00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fd52c0d0f10 con 0x7fd52c0d3770 2024-03-27T10:00:37.927 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.938+0000 7fd530a00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fd52c161950 0x7fd52c0ceb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:37.927 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.938+0000 7fd530a00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fd52c161950 0x7fd52c0ceb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.57:35936/0 (socket says 172.21.15.57:35936) 2024-03-27T10:00:37.927 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.938+0000 7fd530a00640 1 -- 172.21.15.57:0/2134069617 learned_addr learned my addr 172.21.15.57:0/2134069617 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:37.928 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.938+0000 7fd531400640 1 --2- 172.21.15.57:0/2134069617 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd52c0d3770 0x7fd52c06bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:37.928 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.939+0000 7fd530a00640 1 -- 172.21.15.57:0/2134069617 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd52c0d3770 msgr2=0x7fd52c06bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:37.928 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.939+0000 7fd530a00640 1 --2- 172.21.15.57:0/2134069617 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd52c0d3770 0x7fd52c06bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:37.928 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.939+0000 7fd530a00640 1 -- 172.21.15.57:0/2134069617 >> v1:172.21.15.118:6789/0 conn(0x7fd52c0cf040 legacy=0x7fd52c0cf480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:37.928 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.939+0000 7fd530a00640 1 -- 172.21.15.57:0/2134069617 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd52c0d11f0 con 0x7fd52c161950 2024-03-27T10:00:37.929 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.940+0000 7fd530a00640 1 --2- 172.21.15.57:0/2134069617 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd52c161950 0x7fd52c0ceb00 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd51c009e50 tx=0x7fd51c02bff0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=117a030c7cd49ab1 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:37.930 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.940+0000 7fd52b400640 1 -- 172.21.15.57:0/2134069617 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd51c02cb90 con 0x7fd52c161950 2024-03-27T10:00:37.930 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.941+0000 7fd52b400640 1 -- 172.21.15.57:0/2134069617 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd51c02cd30 con 0x7fd52c161950 2024-03-27T10:00:37.930 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.941+0000 7fd52b400640 1 -- 172.21.15.57:0/2134069617 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd51c034610 con 0x7fd52c161950 2024-03-27T10:00:37.931 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.941+0000 7fd531e00640 1 -- 172.21.15.57:0/2134069617 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd52c161950 msgr2=0x7fd52c0ceb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:37.931 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.941+0000 7fd531e00640 1 --2- 172.21.15.57:0/2134069617 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd52c161950 0x7fd52c0ceb00 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd51c009e50 tx=0x7fd51c02bff0 comp rx=0 tx=0).stop 2024-03-27T10:00:37.931 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.941+0000 7fd531e00640 1 -- 172.21.15.57:0/2134069617 shutdown_connections 2024-03-27T10:00:37.931 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.941+0000 7fd531e00640 1 --2- 172.21.15.57:0/2134069617 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd52c0d3770 0x7fd52c06bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:37.931 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.941+0000 7fd531e00640 1 --2- 172.21.15.57:0/2134069617 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd52c161950 0x7fd52c0ceb00 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:37.931 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.941+0000 7fd531e00640 1 -- 172.21.15.57:0/2134069617 >> 172.21.15.57:0/2134069617 conn(0x7fd52c0d3fc0 msgr2=0x7fd52c0d43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:37.932 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.941+0000 7fd531e00640 1 -- 172.21.15.57:0/2134069617 shutdown_connections 2024-03-27T10:00:37.932 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.941+0000 7fd531e00640 1 -- 172.21.15.57:0/2134069617 wait complete. 2024-03-27T10:00:37.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.943+0000 7fd531e00640 1 Processor -- start 2024-03-27T10:00:37.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.943+0000 7fd531e00640 1 -- start start 2024-03-27T10:00:37.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.944+0000 7fd531e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd52c0cf040 0x7fd52c14baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:37.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.944+0000 7fd531e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd52c0d3770 0x7fd52c1f7650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:37.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.944+0000 7fd531e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd52c161950 0x7fd52c1f7b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:37.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.944+0000 7fd531e00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fd52c0d2240 con 0x7fd52c0d3770 2024-03-27T10:00:37.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.944+0000 7fd531e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fd52c0d1f60 con 0x7fd52c0cf040 2024-03-27T10:00:37.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.944+0000 7fd531e00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fd52c0d17b0 con 0x7fd52c161950 2024-03-27T10:00:37.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.945+0000 7fd52be00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd52c0d3770 0x7fd52c1f7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:37.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.945+0000 7fd52be00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd52c0d3770 0x7fd52c1f7650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58896/0 (socket says 172.21.15.57:58896) 2024-03-27T10:00:37.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.945+0000 7fd52be00640 1 -- 172.21.15.57:0/2075894425 learned_addr learned my addr 172.21.15.57:0/2075894425 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:37.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.945+0000 7fd531400640 1 --2- 172.21.15.57:0/2075894425 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd52c161950 0x7fd52c1f7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:37.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.945+0000 7fd530a00640 1 --2- 172.21.15.57:0/2075894425 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd52c0cf040 0x7fd52c14baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:37.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.945+0000 7fd52be00640 1 -- 172.21.15.57:0/2075894425 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd52c161950 msgr2=0x7fd52c1f7b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:37.936 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.945+0000 7fd52be00640 1 --2- 172.21.15.57:0/2075894425 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd52c161950 0x7fd52c1f7b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:37.936 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.945+0000 7fd52be00640 1 -- 172.21.15.57:0/2075894425 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd52c0cf040 msgr2=0x7fd52c14baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:37.936 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.945+0000 7fd52be00640 1 --2- 172.21.15.57:0/2075894425 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd52c0cf040 0x7fd52c14baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:37.936 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.945+0000 7fd52be00640 1 -- 172.21.15.57:0/2075894425 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd52c0b8b20 con 0x7fd52c0d3770 2024-03-27T10:00:37.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.946+0000 7fd52be00640 1 --2- 172.21.15.57:0/2075894425 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd52c0d3770 0x7fd52c1f7650 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fd51800c430 tx=0x7fd51800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:37.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.946+0000 7fd528c00640 1 -- 172.21.15.57:0/2075894425 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5180052d0 con 0x7fd52c0d3770 2024-03-27T10:00:37.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.946+0000 7fd528c00640 1 -- 172.21.15.57:0/2075894425 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd518005490 con 0x7fd52c0d3770 2024-03-27T10:00:37.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.946+0000 7fd531e00640 1 -- 172.21.15.57:0/2075894425 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd52c14d330 con 0x7fd52c0d3770 2024-03-27T10:00:37.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.946+0000 7fd528c00640 1 -- 172.21.15.57:0/2075894425 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd518007260 con 0x7fd52c0d3770 2024-03-27T10:00:37.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.946+0000 7fd531e00640 1 -- 172.21.15.57:0/2075894425 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd52c14d8f0 con 0x7fd52c0d3770 2024-03-27T10:00:37.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.947+0000 7fd531e00640 1 -- 172.21.15.57:0/2075894425 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd52c068540 con 0x7fd52c0d3770 2024-03-27T10:00:37.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.948+0000 7fd528c00640 1 -- 172.21.15.57:0/2075894425 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fd518007400 con 0x7fd52c0d3770 2024-03-27T10:00:37.938 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.949+0000 7fd528c00640 1 --2- 172.21.15.57:0/2075894425 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fd50c06c530 0x7fd50c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:37.938 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.949+0000 7fd528c00640 1 -- 172.21.15.57:0/2075894425 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fd51808b0b0 con 0x7fd52c0d3770 2024-03-27T10:00:37.939 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.949+0000 7fd530a00640 1 --2- 172.21.15.57:0/2075894425 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fd50c06c530 0x7fd50c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:37.940 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.950+0000 7fd530a00640 1 --2- 172.21.15.57:0/2075894425 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fd50c06c530 0x7fd50c06e9f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd51c035000 tx=0x7fd51c030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:37.943 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:37.954+0000 7fd528c00640 1 -- 172.21.15.57:0/2075894425 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7fd518059230 con 0x7fd52c0d3770 2024-03-27T10:00:38.146 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.157+0000 7fd531e00640 1 -- 172.21.15.57:0/2075894425 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fd52c14e060 con 0x7fd52c0d3770 2024-03-27T10:00:38.147 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.158+0000 7fd528c00640 1 -- 172.21.15.57:0/2075894425 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) ==== 93+0+10 (secure 0 0 0) 0x7fd518058b30 con 0x7fd52c0d3770 2024-03-27T10:00:38.147 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2024-03-27T10:00:38.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.160+0000 7fd531e00640 1 -- 172.21.15.57:0/2075894425 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fd50c06c530 msgr2=0x7fd50c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:38.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.160+0000 7fd531e00640 1 --2- 172.21.15.57:0/2075894425 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fd50c06c530 0x7fd50c06e9f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd51c035000 tx=0x7fd51c030000 comp rx=0 tx=0).stop 2024-03-27T10:00:38.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.160+0000 7fd531e00640 1 -- 172.21.15.57:0/2075894425 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd52c0d3770 msgr2=0x7fd52c1f7650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:38.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.160+0000 7fd531e00640 1 --2- 172.21.15.57:0/2075894425 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd52c0d3770 0x7fd52c1f7650 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fd51800c430 tx=0x7fd51800c8f0 comp rx=0 tx=0).stop 2024-03-27T10:00:38.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.160+0000 7fd531e00640 1 -- 172.21.15.57:0/2075894425 shutdown_connections 2024-03-27T10:00:38.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.160+0000 7fd531e00640 1 --2- 172.21.15.57:0/2075894425 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd52c161950 0x7fd52c1f7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:38.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.160+0000 7fd531e00640 1 --2- 172.21.15.57:0/2075894425 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd52c0d3770 0x7fd52c1f7650 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:38.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.160+0000 7fd531e00640 1 --2- 172.21.15.57:0/2075894425 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fd50c06c530 0x7fd50c06e9f0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:38.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.160+0000 7fd531e00640 1 --2- 172.21.15.57:0/2075894425 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd52c0cf040 0x7fd52c14baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:38.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.160+0000 7fd531e00640 1 -- 172.21.15.57:0/2075894425 >> 172.21.15.57:0/2075894425 conn(0x7fd52c0d3fc0 msgr2=0x7fd52c06cb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:38.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.161+0000 7fd531e00640 1 -- 172.21.15.57:0/2075894425 shutdown_connections 2024-03-27T10:00:38.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.161+0000 7fd531e00640 1 -- 172.21.15.57:0/2075894425 wait complete. 2024-03-27T10:00:38.169 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-27T10:00:38.398 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.408+0000 7f46f7200640 1 Processor -- start 2024-03-27T10:00:38.398 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.408+0000 7f46f7200640 1 -- start start 2024-03-27T10:00:38.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.410+0000 7f46f7200640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f46f81601a0 0x7f46f806d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:38.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.410+0000 7f46f7200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f46f80ce720 0x7f46f80ceb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:38.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.410+0000 7f46f7200640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46f80ca330 con 0x7f46f81458e0 2024-03-27T10:00:38.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.410+0000 7f46f7200640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f46f80cf0b0 con 0x7f46f81601a0 2024-03-27T10:00:38.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.410+0000 7f46f7200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f46f80ca610 con 0x7f46f80ce720 2024-03-27T10:00:38.401 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.411+0000 7f46f6800640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f46f80ce720 0x7f46f80ceb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:38.401 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.411+0000 7f46f5e00640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f46f81458e0 0x7f46f815fa90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.57:49766/0 (socket says 172.21.15.57:49766) 2024-03-27T10:00:38.401 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.411+0000 7f46f5e00640 1 -- 172.21.15.57:0/3517532147 learned_addr learned my addr 172.21.15.57:0/3517532147 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T10:00:38.401 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.411+0000 7f46ed400640 1 --2- 172.21.15.57:0/3517532147 >> v2:172.21.15.118:3300/0 conn(0x7f46f81601a0 0x7f46f806d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:38.401 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.411+0000 7f46f6800640 1 -- 172.21.15.57:0/3517532147 >> v2:172.21.15.118:3300/0 conn(0x7f46f81601a0 msgr2=0x7f46f806d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:38.401 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.411+0000 7f46f6800640 1 --2- 172.21.15.57:0/3517532147 >> v2:172.21.15.118:3300/0 conn(0x7f46f81601a0 0x7f46f806d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:38.401 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.411+0000 7f46f6800640 1 -- 172.21.15.57:0/3517532147 >> v1:172.21.15.118:6789/0 conn(0x7f46f81458e0 legacy=0x7f46f815fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:38.401 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.411+0000 7f46f6800640 1 -- 172.21.15.57:0/3517532147 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46f80ca8f0 con 0x7f46f80ce720 2024-03-27T10:00:38.402 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.413+0000 7f46f6800640 1 --2- 172.21.15.57:0/3517532147 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f46f80ce720 0x7f46f80ceb70 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f46f0009d90 tx=0x7f46f002bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=995f9f3bc4222436 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:38.403 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.413+0000 7f46f5400640 1 -- 172.21.15.57:0/3517532147 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46f0039070 con 0x7f46f80ce720 2024-03-27T10:00:38.403 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.413+0000 7f46f5400640 1 -- 172.21.15.57:0/3517532147 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46f002cc50 con 0x7f46f80ce720 2024-03-27T10:00:38.403 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.413+0000 7f46f5400640 1 -- 172.21.15.57:0/3517532147 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46f0034440 con 0x7f46f80ce720 2024-03-27T10:00:38.404 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.414+0000 7f46f7200640 1 -- 172.21.15.57:0/3517532147 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f46f80ce720 msgr2=0x7f46f80ceb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:38.404 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.414+0000 7f46f7200640 1 --2- 172.21.15.57:0/3517532147 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f46f80ce720 0x7f46f80ceb70 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f46f0009d90 tx=0x7f46f002bea0 comp rx=0 tx=0).stop 2024-03-27T10:00:38.404 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.414+0000 7f46f7200640 1 -- 172.21.15.57:0/3517532147 shutdown_connections 2024-03-27T10:00:38.404 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.414+0000 7f46f7200640 1 --2- 172.21.15.57:0/3517532147 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f46f80ce720 0x7f46f80ceb70 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:38.404 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.414+0000 7f46f7200640 1 --2- 172.21.15.57:0/3517532147 >> v2:172.21.15.118:3300/0 conn(0x7f46f81601a0 0x7f46f806d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:38.404 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.414+0000 7f46f7200640 1 -- 172.21.15.57:0/3517532147 >> 172.21.15.57:0/3517532147 conn(0x7f46f80cfb40 msgr2=0x7f46f80cff20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:38.404 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.414+0000 7f46f7200640 1 -- 172.21.15.57:0/3517532147 shutdown_connections 2024-03-27T10:00:38.404 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.414+0000 7f46f7200640 1 -- 172.21.15.57:0/3517532147 wait complete. 2024-03-27T10:00:38.405 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.416+0000 7f46f7200640 1 Processor -- start 2024-03-27T10:00:38.405 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.416+0000 7f46f7200640 1 -- start start 2024-03-27T10:00:38.407 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.417+0000 7f46f7200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f46f80ce720 0x7f46f81592b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:38.407 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.417+0000 7f46f7200640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46f81458e0 0x7f46f815b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:38.407 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.417+0000 7f46f7200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f46f81601a0 0x7f46f80b4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:38.407 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.417+0000 7f46f7200640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f46f80cb270 con 0x7f46f81458e0 2024-03-27T10:00:38.407 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.417+0000 7f46f7200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f46f80cb0f0 con 0x7f46f81601a0 2024-03-27T10:00:38.407 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.417+0000 7f46f7200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f46f80cb3f0 con 0x7f46f80ce720 2024-03-27T10:00:38.408 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.418+0000 7f46ed400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46f81458e0 0x7f46f815b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:38.408 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.418+0000 7f46ed400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46f81458e0 0x7f46f815b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58898/0 (socket says 172.21.15.57:58898) 2024-03-27T10:00:38.408 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.418+0000 7f46ed400640 1 -- 172.21.15.57:0/2669108917 learned_addr learned my addr 172.21.15.57:0/2669108917 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:38.408 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.418+0000 7f46f6800640 1 --2- 172.21.15.57:0/2669108917 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f46f81601a0 0x7f46f80b4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:38.408 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.418+0000 7f46f5e00640 1 --2- 172.21.15.57:0/2669108917 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f46f80ce720 0x7f46f81592b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:38.409 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.418+0000 7f46ed400640 1 -- 172.21.15.57:0/2669108917 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f46f80ce720 msgr2=0x7f46f81592b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:38.409 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.418+0000 7f46ed400640 1 --2- 172.21.15.57:0/2669108917 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f46f80ce720 0x7f46f81592b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:38.409 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.418+0000 7f46ed400640 1 -- 172.21.15.57:0/2669108917 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f46f81601a0 msgr2=0x7f46f80b4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:38.409 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.418+0000 7f46ed400640 1 --2- 172.21.15.57:0/2669108917 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f46f81601a0 0x7f46f80b4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:38.409 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.418+0000 7f46ed400640 1 -- 172.21.15.57:0/2669108917 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46f80c7760 con 0x7f46f81458e0 2024-03-27T10:00:38.409 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.419+0000 7f46ed400640 1 --2- 172.21.15.57:0/2669108917 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46f81458e0 0x7f46f815b110 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f46e000e870 tx=0x7f46e000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:38.409 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.419+0000 7f46eea00640 1 -- 172.21.15.57:0/2669108917 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46e0017070 con 0x7f46f81458e0 2024-03-27T10:00:38.409 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.419+0000 7f46eea00640 1 -- 172.21.15.57:0/2669108917 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46e000c940 con 0x7f46f81458e0 2024-03-27T10:00:38.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.419+0000 7f46eea00640 1 -- 172.21.15.57:0/2669108917 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46e000cd30 con 0x7f46f81458e0 2024-03-27T10:00:38.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.419+0000 7f46f7200640 1 -- 172.21.15.57:0/2669108917 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46f80c7a40 con 0x7f46f81458e0 2024-03-27T10:00:38.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.419+0000 7f46f7200640 1 -- 172.21.15.57:0/2669108917 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46f80c8000 con 0x7f46f81458e0 2024-03-27T10:00:38.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.420+0000 7f46f7200640 1 -- 172.21.15.57:0/2669108917 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46f8068540 con 0x7f46f81458e0 2024-03-27T10:00:38.410 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.421+0000 7f46eea00640 1 -- 172.21.15.57:0/2669108917 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f46e001a070 con 0x7f46f81458e0 2024-03-27T10:00:38.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.423+0000 7f46eea00640 1 --2- 172.21.15.57:0/2669108917 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f46d406c560 0x7f46d406ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:38.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.423+0000 7f46eea00640 1 -- 172.21.15.57:0/2669108917 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f46e008bce0 con 0x7f46f81458e0 2024-03-27T10:00:38.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.423+0000 7f46f5e00640 1 --2- 172.21.15.57:0/2669108917 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f46d406c560 0x7f46d406ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:38.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.424+0000 7f46f5e00640 1 --2- 172.21.15.57:0/2669108917 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f46d406c560 0x7f46d406ea20 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f46e8000f60 tx=0x7f46e8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:38.417 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.428+0000 7f46eea00640 1 -- 172.21.15.57:0/2669108917 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f46e0059810 con 0x7f46f81458e0 2024-03-27T10:00:38.620 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.630+0000 7f46f7200640 1 -- 172.21.15.57:0/2669108917 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f46f8145100 con 0x7f46f81458e0 2024-03-27T10:00:38.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.632+0000 7f46eea00640 1 -- 172.21.15.57:0/2669108917 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) ==== 104+0+11 (secure 0 0 0) 0x7f46e005db10 con 0x7f46f81458e0 2024-03-27T10:00:38.621 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2024-03-27T10:00:38.624 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.634+0000 7f46f7200640 1 -- 172.21.15.57:0/2669108917 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f46d406c560 msgr2=0x7f46d406ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:38.624 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.634+0000 7f46f7200640 1 --2- 172.21.15.57:0/2669108917 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f46d406c560 0x7f46d406ea20 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f46e8000f60 tx=0x7f46e8009040 comp rx=0 tx=0).stop 2024-03-27T10:00:38.624 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.634+0000 7f46f7200640 1 -- 172.21.15.57:0/2669108917 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46f81458e0 msgr2=0x7f46f815b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:38.624 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.634+0000 7f46f7200640 1 --2- 172.21.15.57:0/2669108917 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46f81458e0 0x7f46f815b110 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f46e000e870 tx=0x7f46e000ed30 comp rx=0 tx=0).stop 2024-03-27T10:00:38.624 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.634+0000 7f46f7200640 1 -- 172.21.15.57:0/2669108917 shutdown_connections 2024-03-27T10:00:38.624 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.634+0000 7f46f7200640 1 --2- 172.21.15.57:0/2669108917 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f46d406c560 0x7f46d406ea20 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:38.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.634+0000 7f46f7200640 1 --2- 172.21.15.57:0/2669108917 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f46f81601a0 0x7f46f80b4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:38.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.634+0000 7f46f7200640 1 --2- 172.21.15.57:0/2669108917 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f46f81458e0 0x7f46f815b110 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:38.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.634+0000 7f46f7200640 1 --2- 172.21.15.57:0/2669108917 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f46f80ce720 0x7f46f81592b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:38.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.635+0000 7f46f7200640 1 -- 172.21.15.57:0/2669108917 >> 172.21.15.57:0/2669108917 conn(0x7f46f80cfb40 msgr2=0x7f46f806d9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:38.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.635+0000 7f46f7200640 1 -- 172.21.15.57:0/2669108917 shutdown_connections 2024-03-27T10:00:38.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.635+0000 7f46f7200640 1 -- 172.21.15.57:0/2669108917 wait complete. 2024-03-27T10:00:38.642 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-27T10:00:38.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.873+0000 7f5c3e000640 1 Processor -- start 2024-03-27T10:00:38.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.873+0000 7f5c3e000640 1 -- start start 2024-03-27T10:00:38.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.874+0000 7f5c3e000640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5c3815e430 0x7f5c380711b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:38.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.874+0000 7f5c3e000640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5c380b3d80 0x7f5c380716f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:38.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.875+0000 7f5c3e000640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c380730a0 con 0x7f5c380b46f0 2024-03-27T10:00:38.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.875+0000 7f5c3e000640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f5c3815e810 con 0x7f5c380b3d80 2024-03-27T10:00:38.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.875+0000 7f5c3e000640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f5c380b2eb0 con 0x7f5c3815e430 2024-03-27T10:00:38.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.875+0000 7f5c36a00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5c380b3d80 0x7f5c380716f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:38.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.875+0000 7f5c36a00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5c380b3d80 0x7f5c380716f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58908/0 (socket says 172.21.15.57:58908) 2024-03-27T10:00:38.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.875+0000 7f5c37e00640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f5c380b46f0 0x7f5c38161eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:48286/0 (socket says 172.21.15.57:48286) 2024-03-27T10:00:38.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.875+0000 7f5c36a00640 1 -- 172.21.15.57:0/865809538 learned_addr learned my addr 172.21.15.57:0/865809538 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:38.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.875+0000 7f5c37400640 1 --2- 172.21.15.57:0/865809538 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5c3815e430 0x7f5c380711b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:38.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.875+0000 7f5c36a00640 1 -- 172.21.15.57:0/865809538 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5c3815e430 msgr2=0x7f5c380711b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:38.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.875+0000 7f5c36a00640 1 --2- 172.21.15.57:0/865809538 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5c3815e430 0x7f5c380711b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:38.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.875+0000 7f5c36a00640 1 -- 172.21.15.57:0/865809538 >> v1:172.21.15.57:6789/0 conn(0x7f5c380b46f0 legacy=0x7f5c38161eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:38.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.876+0000 7f5c36a00640 1 -- 172.21.15.57:0/865809538 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c38073320 con 0x7f5c380b3d80 2024-03-27T10:00:38.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.875+0000 7f5c36000640 1 -- 172.21.15.57:0/865809538 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2180535406 0 0) 0x7f5c30001490 con 0x7f5c380b46f0 2024-03-27T10:00:38.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.877+0000 7f5c36a00640 1 --2- 172.21.15.57:0/865809538 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5c380b3d80 0x7f5c380716f0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f5c24009870 tx=0x7f5c2402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d96b2937af1501b2 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:38.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.877+0000 7f5c36000640 1 -- 172.21.15.57:0/865809538 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c24035020 con 0x7f5c380b3d80 2024-03-27T10:00:38.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.877+0000 7f5c36000640 1 -- 172.21.15.57:0/865809538 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c24031640 con 0x7f5c380b3d80 2024-03-27T10:00:38.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.877+0000 7f5c36000640 1 -- 172.21.15.57:0/865809538 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c2402d040 con 0x7f5c380b3d80 2024-03-27T10:00:38.867 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.878+0000 7f5c3e000640 1 -- 172.21.15.57:0/865809538 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5c380b3d80 msgr2=0x7f5c380716f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:38.867 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.878+0000 7f5c3e000640 1 --2- 172.21.15.57:0/865809538 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5c380b3d80 0x7f5c380716f0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f5c24009870 tx=0x7f5c2402b8f0 comp rx=0 tx=0).stop 2024-03-27T10:00:38.867 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.878+0000 7f5c3e000640 1 -- 172.21.15.57:0/865809538 shutdown_connections 2024-03-27T10:00:38.868 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.878+0000 7f5c3e000640 1 --2- 172.21.15.57:0/865809538 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5c380b3d80 0x7f5c380716f0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:38.868 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.878+0000 7f5c3e000640 1 --2- 172.21.15.57:0/865809538 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5c3815e430 0x7f5c380711b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:38.868 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.878+0000 7f5c3e000640 1 -- 172.21.15.57:0/865809538 >> 172.21.15.57:0/865809538 conn(0x7f5c380b18a0 msgr2=0x7f5c380b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:38.868 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.878+0000 7f5c3e000640 1 -- 172.21.15.57:0/865809538 shutdown_connections 2024-03-27T10:00:38.868 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.878+0000 7f5c3e000640 1 -- 172.21.15.57:0/865809538 wait complete. 2024-03-27T10:00:38.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.880+0000 7f5c3e000640 1 Processor -- start 2024-03-27T10:00:38.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.881+0000 7f5c3e000640 1 -- start start 2024-03-27T10:00:38.872 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.882+0000 7f5c3e000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5c380b3d80 0x7f5c381467b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:38.872 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.882+0000 7f5c3e000640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5c380b46f0 0x7f5c381e9e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:38.872 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.882+0000 7f5c3e000640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5c3815e430 0x7f5c381ea390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:38.872 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.882+0000 7f5c3e000640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f5c380b3100 con 0x7f5c3815e430 2024-03-27T10:00:38.872 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.882+0000 7f5c3e000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f5c3806d340 con 0x7f5c380b3d80 2024-03-27T10:00:38.872 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.882+0000 7f5c3e000640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f5c3806eeb0 con 0x7f5c380b46f0 2024-03-27T10:00:38.872 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.882+0000 7f5c37e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5c3815e430 0x7f5c381ea390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:38.872 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.882+0000 7f5c37e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5c3815e430 0x7f5c381ea390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58924/0 (socket says 172.21.15.57:58924) 2024-03-27T10:00:38.872 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.882+0000 7f5c37e00640 1 -- 172.21.15.57:0/733469507 learned_addr learned my addr 172.21.15.57:0/733469507 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:38.873 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.883+0000 7f5c37400640 1 --2- 172.21.15.57:0/733469507 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5c380b3d80 0x7f5c381467b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:38.873 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.883+0000 7f5c36a00640 1 --2- 172.21.15.57:0/733469507 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5c380b46f0 0x7f5c381e9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:38.873 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.883+0000 7f5c37e00640 1 -- 172.21.15.57:0/733469507 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5c380b46f0 msgr2=0x7f5c381e9e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:38.873 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.883+0000 7f5c37e00640 1 --2- 172.21.15.57:0/733469507 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5c380b46f0 0x7f5c381e9e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:38.874 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.883+0000 7f5c37e00640 1 -- 172.21.15.57:0/733469507 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5c380b3d80 msgr2=0x7f5c381467b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:38.874 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.883+0000 7f5c37e00640 1 --2- 172.21.15.57:0/733469507 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5c380b3d80 0x7f5c381467b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:38.874 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.883+0000 7f5c37e00640 1 -- 172.21.15.57:0/733469507 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c3809ab10 con 0x7f5c3815e430 2024-03-27T10:00:38.874 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.883+0000 7f5c37e00640 1 --2- 172.21.15.57:0/733469507 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5c3815e430 0x7f5c381ea390 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f5c3000c7c0 tx=0x7f5c3000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:38.874 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.883+0000 7f5c2f400640 1 -- 172.21.15.57:0/733469507 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c30018070 con 0x7f5c3815e430 2024-03-27T10:00:38.874 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.884+0000 7f5c2f400640 1 -- 172.21.15.57:0/733469507 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c3000a5e0 con 0x7f5c3815e430 2024-03-27T10:00:38.874 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.884+0000 7f5c3e000640 1 -- 172.21.15.57:0/733469507 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c38155970 con 0x7f5c3815e430 2024-03-27T10:00:38.874 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.884+0000 7f5c2f400640 1 -- 172.21.15.57:0/733469507 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c3000a9d0 con 0x7f5c3815e430 2024-03-27T10:00:38.874 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.884+0000 7f5c3e000640 1 -- 172.21.15.57:0/733469507 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c38155f30 con 0x7f5c3815e430 2024-03-27T10:00:38.874 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.885+0000 7f5c3e000640 1 -- 172.21.15.57:0/733469507 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c380757d0 con 0x7f5c3815e430 2024-03-27T10:00:38.875 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.886+0000 7f5c2f400640 1 -- 172.21.15.57:0/733469507 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f5c3001b070 con 0x7f5c3815e430 2024-03-27T10:00:38.876 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.887+0000 7f5c2f400640 1 --2- 172.21.15.57:0/733469507 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f5c1806c530 0x7f5c1806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:38.876 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.887+0000 7f5c2f400640 1 -- 172.21.15.57:0/733469507 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f5c3008b100 con 0x7f5c3815e430 2024-03-27T10:00:38.876 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.887+0000 7f5c37400640 1 --2- 172.21.15.57:0/733469507 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f5c1806c530 0x7f5c1806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:38.877 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.888+0000 7f5c37400640 1 --2- 172.21.15.57:0/733469507 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f5c1806c530 0x7f5c1806e9f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5c28006fd0 tx=0x7f5c28008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:38.880 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:38.891+0000 7f5c2f400640 1 -- 172.21.15.57:0/733469507 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f5c380730a0 con 0x7f5c3815e430 2024-03-27T10:00:39.082 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.092+0000 7f5c3e000640 1 -- 172.21.15.57:0/733469507 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f5c38068540 con 0x7f5c3815e430 2024-03-27T10:00:39.083 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.093+0000 7f5c2f400640 1 -- 172.21.15.57:0/733469507 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) ==== 100+0+11 (secure 0 0 0) 0x7f5c30059310 con 0x7f5c3815e430 2024-03-27T10:00:39.083 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2024-03-27T10:00:39.085 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.096+0000 7f5c3e000640 1 -- 172.21.15.57:0/733469507 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f5c1806c530 msgr2=0x7f5c1806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:39.085 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.096+0000 7f5c3e000640 1 --2- 172.21.15.57:0/733469507 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f5c1806c530 0x7f5c1806e9f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5c28006fd0 tx=0x7f5c28008040 comp rx=0 tx=0).stop 2024-03-27T10:00:39.085 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.096+0000 7f5c3e000640 1 -- 172.21.15.57:0/733469507 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5c3815e430 msgr2=0x7f5c381ea390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:39.085 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.096+0000 7f5c3e000640 1 --2- 172.21.15.57:0/733469507 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5c3815e430 0x7f5c381ea390 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f5c3000c7c0 tx=0x7f5c3000cc80 comp rx=0 tx=0).stop 2024-03-27T10:00:39.086 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.096+0000 7f5c3e000640 1 -- 172.21.15.57:0/733469507 shutdown_connections 2024-03-27T10:00:39.086 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.096+0000 7f5c3e000640 1 --2- 172.21.15.57:0/733469507 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5c3815e430 0x7f5c381ea390 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:39.086 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.096+0000 7f5c3e000640 1 --2- 172.21.15.57:0/733469507 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5c380b46f0 0x7f5c381e9e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:39.086 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.096+0000 7f5c3e000640 1 --2- 172.21.15.57:0/733469507 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f5c1806c530 0x7f5c1806e9f0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:39.086 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.096+0000 7f5c3e000640 1 --2- 172.21.15.57:0/733469507 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5c380b3d80 0x7f5c381467b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:39.086 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.096+0000 7f5c3e000640 1 -- 172.21.15.57:0/733469507 >> 172.21.15.57:0/733469507 conn(0x7f5c380b18a0 msgr2=0x7f5c380b0d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:39.087 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.096+0000 7f5c3e000640 1 -- 172.21.15.57:0/733469507 shutdown_connections 2024-03-27T10:00:39.087 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.096+0000 7f5c3e000640 1 -- 172.21.15.57:0/733469507 wait complete. 2024-03-27T10:00:39.104 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-27T10:00:39.328 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.338+0000 7f1097200640 1 Processor -- start 2024-03-27T10:00:39.328 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.339+0000 7f1097200640 1 -- start start 2024-03-27T10:00:39.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.340+0000 7f1097200640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f10980d3770 0x7f10980cf210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:39.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.340+0000 7f1097200640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10980cfe40 con 0x7f1098161950 2024-03-27T10:00:39.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.340+0000 7f1097200640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1098161d30 con 0x7f10980cf750 2024-03-27T10:00:39.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.341+0000 7f1097200640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f10980d0f10 con 0x7f10980d3770 2024-03-27T10:00:39.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.341+0000 7f1095400640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f10980d3770 0x7f10980cf210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:39.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.341+0000 7f1095e00640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f1098161950 0x7f10980ceb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:48290/0 (socket says 172.21.15.57:48290) 2024-03-27T10:00:39.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.341+0000 7f1095e00640 1 -- 172.21.15.57:0/2338074801 learned_addr learned my addr 172.21.15.57:0/2338074801 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T10:00:39.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.341+0000 7f1095400640 1 -- 172.21.15.57:0/2338074801 >> v1:172.21.15.118:6789/0 conn(0x7f10980cf750 legacy=0x7f109806bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:39.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.341+0000 7f1095400640 1 -- 172.21.15.57:0/2338074801 >> v1:172.21.15.57:6789/0 conn(0x7f1098161950 legacy=0x7f10980ceb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:39.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.341+0000 7f1095400640 1 -- 172.21.15.57:0/2338074801 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10980d11f0 con 0x7f10980d3770 2024-03-27T10:00:39.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.341+0000 7f1094a00640 1 -- 172.21.15.57:0/2338074801 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3094509527 0 0) 0x7f10980cfe40 con 0x7f1098161950 2024-03-27T10:00:39.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.343+0000 7f1095400640 1 --2- 172.21.15.57:0/2338074801 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f10980d3770 0x7f10980cf210 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f10840097a0 tx=0x7f108402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e46676307439709 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:39.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.343+0000 7f1094a00640 1 -- 172.21.15.57:0/2338074801 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1084034070 con 0x7f10980d3770 2024-03-27T10:00:39.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.343+0000 7f1094a00640 1 -- 172.21.15.57:0/2338074801 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1084030610 con 0x7f10980d3770 2024-03-27T10:00:39.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.343+0000 7f1094a00640 1 -- 172.21.15.57:0/2338074801 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10840309e0 con 0x7f10980d3770 2024-03-27T10:00:39.333 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.344+0000 7f1097200640 1 -- 172.21.15.57:0/2338074801 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f10980d3770 msgr2=0x7f10980cf210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:39.333 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.344+0000 7f1097200640 1 --2- 172.21.15.57:0/2338074801 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f10980d3770 0x7f10980cf210 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f10840097a0 tx=0x7f108402b960 comp rx=0 tx=0).stop 2024-03-27T10:00:39.333 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.344+0000 7f1097200640 1 -- 172.21.15.57:0/2338074801 shutdown_connections 2024-03-27T10:00:39.333 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.344+0000 7f1097200640 1 --2- 172.21.15.57:0/2338074801 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f10980d3770 0x7f10980cf210 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:39.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.344+0000 7f1097200640 1 -- 172.21.15.57:0/2338074801 >> 172.21.15.57:0/2338074801 conn(0x7f10980d3fc0 msgr2=0x7f10980d43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:39.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.344+0000 7f1097200640 1 -- 172.21.15.57:0/2338074801 shutdown_connections 2024-03-27T10:00:39.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.344+0000 7f1097200640 1 -- 172.21.15.57:0/2338074801 wait complete. 2024-03-27T10:00:39.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.346+0000 7f1097200640 1 Processor -- start 2024-03-27T10:00:39.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.346+0000 7f1097200640 1 -- start start 2024-03-27T10:00:39.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.347+0000 7f1097200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f10980cf750 0x7f10980b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:39.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.347+0000 7f1097200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f10980d3770 0x7f10980b4490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:39.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.347+0000 7f1097200640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1098161950 0x7f10981f3af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:39.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.347+0000 7f1097200640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f10980d2240 con 0x7f1098161950 2024-03-27T10:00:39.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.347+0000 7f1097200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f10980d1f60 con 0x7f10980d3770 2024-03-27T10:00:39.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.347+0000 7f1097200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f10980d17b0 con 0x7f10980cf750 2024-03-27T10:00:39.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.348+0000 7f1096800640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1098161950 0x7f10981f3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:39.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.348+0000 7f1096800640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1098161950 0x7f10981f3af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58954/0 (socket says 172.21.15.57:58954) 2024-03-27T10:00:39.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.348+0000 7f1096800640 1 -- 172.21.15.57:0/2177622847 learned_addr learned my addr 172.21.15.57:0/2177622847 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:39.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.348+0000 7f1095e00640 1 --2- 172.21.15.57:0/2177622847 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f10980cf750 0x7f10980b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:39.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.348+0000 7f1095400640 1 --2- 172.21.15.57:0/2177622847 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f10980d3770 0x7f10980b4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:39.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.348+0000 7f1096800640 1 -- 172.21.15.57:0/2177622847 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f10980cf750 msgr2=0x7f10980b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:39.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.348+0000 7f1096800640 1 --2- 172.21.15.57:0/2177622847 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f10980cf750 0x7f10980b7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:39.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.348+0000 7f1096800640 1 -- 172.21.15.57:0/2177622847 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f10980d3770 msgr2=0x7f10980b4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:39.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.348+0000 7f1096800640 1 --2- 172.21.15.57:0/2177622847 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f10980d3770 0x7f10980b4490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:39.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.348+0000 7f1096800640 1 -- 172.21.15.57:0/2177622847 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10980b4c00 con 0x7f1098161950 2024-03-27T10:00:39.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.349+0000 7f1096800640 1 --2- 172.21.15.57:0/2177622847 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1098161950 0x7f10981f3af0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f109000c780 tx=0x7f109000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:39.340 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.349+0000 7f108e000640 1 -- 172.21.15.57:0/2177622847 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1090004b60 con 0x7f1098161950 2024-03-27T10:00:39.340 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.349+0000 7f108e000640 1 -- 172.21.15.57:0/2177622847 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1090004d00 con 0x7f1098161950 2024-03-27T10:00:39.340 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.349+0000 7f108e000640 1 -- 172.21.15.57:0/2177622847 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f109000aa90 con 0x7f1098161950 2024-03-27T10:00:39.340 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.349+0000 7f1097200640 1 -- 172.21.15.57:0/2177622847 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10980b4ee0 con 0x7f1098161950 2024-03-27T10:00:39.340 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.349+0000 7f1097200640 1 -- 172.21.15.57:0/2177622847 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10981f6830 con 0x7f1098161950 2024-03-27T10:00:39.340 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.350+0000 7f1097200640 1 -- 172.21.15.57:0/2177622847 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1098068540 con 0x7f1098161950 2024-03-27T10:00:39.340 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.351+0000 7f108e000640 1 -- 172.21.15.57:0/2177622847 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f109000ac30 con 0x7f1098161950 2024-03-27T10:00:39.342 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.353+0000 7f108e000640 1 --2- 172.21.15.57:0/2177622847 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f107806c530 0x7f107806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:39.342 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.353+0000 7f108e000640 1 -- 172.21.15.57:0/2177622847 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f109008be00 con 0x7f1098161950 2024-03-27T10:00:39.342 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.353+0000 7f1095e00640 1 --2- 172.21.15.57:0/2177622847 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f107806c530 0x7f107806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:39.343 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.354+0000 7f1095e00640 1 --2- 172.21.15.57:0/2177622847 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f107806c530 0x7f107806e9f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1088000f60 tx=0x7f1088007c00 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:39.347 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.358+0000 7f108e000640 1 -- 172.21.15.57:0/2177622847 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f1090020070 con 0x7f1098161950 2024-03-27T10:00:39.549 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.560+0000 7f1097200640 1 -- 172.21.15.57:0/2177622847 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f1098160b20 con 0x7f1098161950 2024-03-27T10:00:39.550 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.561+0000 7f108e000640 1 -- 172.21.15.57:0/2177622847 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) ==== 103+0+11 (secure 0 0 0) 0x7f109005a020 con 0x7f1098161950 2024-03-27T10:00:39.550 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2024-03-27T10:00:39.553 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.563+0000 7f1097200640 1 -- 172.21.15.57:0/2177622847 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f107806c530 msgr2=0x7f107806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:39.554 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.563+0000 7f1097200640 1 --2- 172.21.15.57:0/2177622847 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f107806c530 0x7f107806e9f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1088000f60 tx=0x7f1088007c00 comp rx=0 tx=0).stop 2024-03-27T10:00:39.554 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.563+0000 7f1097200640 1 -- 172.21.15.57:0/2177622847 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1098161950 msgr2=0x7f10981f3af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:39.554 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.563+0000 7f1097200640 1 --2- 172.21.15.57:0/2177622847 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1098161950 0x7f10981f3af0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f109000c780 tx=0x7f109000cc40 comp rx=0 tx=0).stop 2024-03-27T10:00:39.554 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.564+0000 7f1097200640 1 -- 172.21.15.57:0/2177622847 shutdown_connections 2024-03-27T10:00:39.554 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.564+0000 7f1097200640 1 --2- 172.21.15.57:0/2177622847 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1098161950 0x7f10981f3af0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:39.554 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.564+0000 7f1097200640 1 --2- 172.21.15.57:0/2177622847 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f107806c530 0x7f107806e9f0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:39.554 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.564+0000 7f1097200640 1 --2- 172.21.15.57:0/2177622847 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f10980d3770 0x7f10980b4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:39.554 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.564+0000 7f1097200640 1 --2- 172.21.15.57:0/2177622847 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f10980cf750 0x7f10980b7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:39.554 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.564+0000 7f1097200640 1 -- 172.21.15.57:0/2177622847 >> 172.21.15.57:0/2177622847 conn(0x7f10980d3fc0 msgr2=0x7f10980d0640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:39.554 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.564+0000 7f1097200640 1 -- 172.21.15.57:0/2177622847 shutdown_connections 2024-03-27T10:00:39.554 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.564+0000 7f1097200640 1 -- 172.21.15.57:0/2177622847 wait complete. 2024-03-27T10:00:39.573 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2024-03-27T10:00:39.800 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.810+0000 7f20d6c00640 1 Processor -- start 2024-03-27T10:00:39.800 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.810+0000 7f20d6c00640 1 -- start start 2024-03-27T10:00:39.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.812+0000 7f20d6c00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f20d014b410 0x7f20d0072940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:39.802 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.812+0000 7f20d6c00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f20d00d0690 0x7f20d006d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:39.802 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.812+0000 7f20d6c00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20d0071360 con 0x7f20d014bf50 2024-03-27T10:00:39.802 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.812+0000 7f20d6c00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f20d014b7f0 con 0x7f20d014b410 2024-03-27T10:00:39.802 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.812+0000 7f20d6c00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f20d0071f70 con 0x7f20d00d0690 2024-03-27T10:00:39.803 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.813+0000 7f20d6200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f20d00d0690 0x7f20d006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:39.803 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.813+0000 7f20d6200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f20d00d0690 0x7f20d006d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.57:35582/0 (socket says 172.21.15.57:35582) 2024-03-27T10:00:39.803 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.813+0000 7f20d6200640 1 -- 172.21.15.57:0/3655403006 learned_addr learned my addr 172.21.15.57:0/3655403006 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:39.803 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.813+0000 7f20d5800640 1 --2- 172.21.15.57:0/3655403006 >> v2:172.21.15.118:3300/0 conn(0x7f20d014b410 0x7f20d0072940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:39.803 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.813+0000 7f20d6200640 1 -- 172.21.15.57:0/3655403006 >> v2:172.21.15.118:3300/0 conn(0x7f20d014b410 msgr2=0x7f20d0072940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:39.803 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.813+0000 7f20d6200640 1 --2- 172.21.15.57:0/3655403006 >> v2:172.21.15.118:3300/0 conn(0x7f20d014b410 0x7f20d0072940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:39.803 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.814+0000 7f20d6200640 1 -- 172.21.15.57:0/3655403006 >> v1:172.21.15.118:6789/0 conn(0x7f20d014bf50 legacy=0x7f20d00cff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:39.803 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.814+0000 7f20d6200640 1 -- 172.21.15.57:0/3655403006 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20d0071640 con 0x7f20d00d0690 2024-03-27T10:00:39.803 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.814+0000 7f20d5800640 1 --2- 172.21.15.57:0/3655403006 >> v2:172.21.15.118:3300/0 conn(0x7f20d014b410 0x7f20d0072940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T10:00:39.804 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.815+0000 7f20d6200640 1 --2- 172.21.15.57:0/3655403006 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f20d00d0690 0x7f20d006d150 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f20c8009e50 tx=0x7f20c802bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1f3aabdc0d1aab6 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:39.805 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.815+0000 7f20cfe00640 1 -- 172.21.15.57:0/3655403006 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20c802cb00 con 0x7f20d00d0690 2024-03-27T10:00:39.805 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.816+0000 7f20cfe00640 1 -- 172.21.15.57:0/3655403006 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20c802cca0 con 0x7f20d00d0690 2024-03-27T10:00:39.805 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.816+0000 7f20cfe00640 1 -- 172.21.15.57:0/3655403006 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20c8034610 con 0x7f20d00d0690 2024-03-27T10:00:39.806 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.816+0000 7f20d6c00640 1 -- 172.21.15.57:0/3655403006 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f20d00d0690 msgr2=0x7f20d006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:39.806 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.816+0000 7f20d6c00640 1 --2- 172.21.15.57:0/3655403006 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f20d00d0690 0x7f20d006d150 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f20c8009e50 tx=0x7f20c802bf60 comp rx=0 tx=0).stop 2024-03-27T10:00:39.806 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.816+0000 7f20d6c00640 1 -- 172.21.15.57:0/3655403006 shutdown_connections 2024-03-27T10:00:39.806 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.816+0000 7f20d6c00640 1 --2- 172.21.15.57:0/3655403006 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f20d00d0690 0x7f20d006d150 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:39.806 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.816+0000 7f20d6c00640 1 --2- 172.21.15.57:0/3655403006 >> v2:172.21.15.118:3300/0 conn(0x7f20d014b410 0x7f20d0072940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:39.806 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.816+0000 7f20d6c00640 1 -- 172.21.15.57:0/3655403006 >> 172.21.15.57:0/3655403006 conn(0x7f20d006b990 msgr2=0x7f20d006bda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:39.806 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.816+0000 7f20d6c00640 1 -- 172.21.15.57:0/3655403006 shutdown_connections 2024-03-27T10:00:39.807 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.816+0000 7f20d6c00640 1 -- 172.21.15.57:0/3655403006 wait complete. 2024-03-27T10:00:39.808 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.818+0000 7f20d6c00640 1 Processor -- start 2024-03-27T10:00:39.808 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.818+0000 7f20d6c00640 1 -- start start 2024-03-27T10:00:39.810 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.819+0000 7f20d6c00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f20d00d0690 0x7f20d0146ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:39.810 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.819+0000 7f20d6c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f20d014b410 0x7f20d01e5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:39.810 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.819+0000 7f20d6c00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f20d014bf50 0x7f20d01f9550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:39.810 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.819+0000 7f20d6c00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f20d0071010 con 0x7f20d00d0690 2024-03-27T10:00:39.810 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.820+0000 7f20d6c00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f20d0071c00 con 0x7f20d014b410 2024-03-27T10:00:39.810 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.820+0000 7f20d6c00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f20d006d690 con 0x7f20d014bf50 2024-03-27T10:00:39.810 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.820+0000 7f20d5800640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f20d00d0690 0x7f20d0146ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:39.810 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.820+0000 7f20d5800640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f20d00d0690 0x7f20d0146ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58966/0 (socket says 172.21.15.57:58966) 2024-03-27T10:00:39.810 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.820+0000 7f20d5800640 1 -- 172.21.15.57:0/73141385 learned_addr learned my addr 172.21.15.57:0/73141385 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:39.810 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.820+0000 7f20d6200640 1 --2- 172.21.15.57:0/73141385 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f20d014bf50 0x7f20d01f9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:39.810 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.820+0000 7f20d4e00640 1 --2- 172.21.15.57:0/73141385 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f20d014b410 0x7f20d01e5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:39.811 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.820+0000 7f20d5800640 1 -- 172.21.15.57:0/73141385 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f20d014bf50 msgr2=0x7f20d01f9550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:39.811 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.820+0000 7f20d5800640 1 --2- 172.21.15.57:0/73141385 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f20d014bf50 0x7f20d01f9550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:39.811 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.820+0000 7f20d5800640 1 -- 172.21.15.57:0/73141385 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f20d014b410 msgr2=0x7f20d01e5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:39.811 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.820+0000 7f20d5800640 1 --2- 172.21.15.57:0/73141385 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f20d014b410 0x7f20d01e5380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:39.811 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.820+0000 7f20d5800640 1 -- 172.21.15.57:0/73141385 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20d00c5b40 con 0x7f20d00d0690 2024-03-27T10:00:39.812 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.821+0000 7f20d5800640 1 --2- 172.21.15.57:0/73141385 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f20d00d0690 0x7f20d0146ef0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f20c400e7e0 tx=0x7f20c400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:39.812 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.821+0000 7f20cd600640 1 -- 172.21.15.57:0/73141385 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20c400f040 con 0x7f20d00d0690 2024-03-27T10:00:39.812 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.821+0000 7f20cd600640 1 -- 172.21.15.57:0/73141385 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20c4004030 con 0x7f20d00d0690 2024-03-27T10:00:39.812 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.821+0000 7f20cd600640 1 -- 172.21.15.57:0/73141385 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20c4004400 con 0x7f20d00d0690 2024-03-27T10:00:39.812 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.821+0000 7f20d6c00640 1 -- 172.21.15.57:0/73141385 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20d01e2920 con 0x7f20d00d0690 2024-03-27T10:00:39.812 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.821+0000 7f20d6c00640 1 -- 172.21.15.57:0/73141385 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20d01e2ee0 con 0x7f20d00d0690 2024-03-27T10:00:39.812 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.822+0000 7f20d6c00640 1 -- 172.21.15.57:0/73141385 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20d01e2710 con 0x7f20d00d0690 2024-03-27T10:00:39.813 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.823+0000 7f20cd600640 1 -- 172.21.15.57:0/73141385 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f20c400c6d0 con 0x7f20d00d0690 2024-03-27T10:00:39.813 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.824+0000 7f20cd600640 1 --2- 172.21.15.57:0/73141385 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f20b006c530 0x7f20b006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:39.814 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.824+0000 7f20cd600640 1 -- 172.21.15.57:0/73141385 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f20c408b8a0 con 0x7f20d00d0690 2024-03-27T10:00:39.814 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.824+0000 7f20d4e00640 1 --2- 172.21.15.57:0/73141385 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f20b006c530 0x7f20b006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:39.814 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.825+0000 7f20d4e00640 1 --2- 172.21.15.57:0/73141385 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f20b006c530 0x7f20b006e9f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f20bc007fd0 tx=0x7f20bc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:39.818 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:39.829+0000 7f20cd600640 1 -- 172.21.15.57:0/73141385 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f20c4017020 con 0x7f20d00d0690 2024-03-27T10:00:40.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:40.106+0000 7f20d6c00640 1 -- 172.21.15.57:0/73141385 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) -- 0x7f20d0068540 con 0x7f20d00d0690 2024-03-27T10:00:40.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:40.680+0000 7f20cd600640 1 -- 172.21.15.57:0/73141385 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v87) ==== 147+0+0 (secure 0 0 0) 0x7f20c40593d0 con 0x7f20d00d0690 2024-03-27T10:00:40.674 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:40.685+0000 7f20d6c00640 1 -- 172.21.15.57:0/73141385 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f20b006c530 msgr2=0x7f20b006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:40.674 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:40.685+0000 7f20d6c00640 1 --2- 172.21.15.57:0/73141385 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f20b006c530 0x7f20b006e9f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f20bc007fd0 tx=0x7f20bc009040 comp rx=0 tx=0).stop 2024-03-27T10:00:40.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:40.685+0000 7f20d6c00640 1 -- 172.21.15.57:0/73141385 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f20d00d0690 msgr2=0x7f20d0146ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:40.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:40.685+0000 7f20d6c00640 1 --2- 172.21.15.57:0/73141385 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f20d00d0690 0x7f20d0146ef0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f20c400e7e0 tx=0x7f20c400eca0 comp rx=0 tx=0).stop 2024-03-27T10:00:40.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:40.685+0000 7f20d6c00640 1 -- 172.21.15.57:0/73141385 shutdown_connections 2024-03-27T10:00:40.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:40.685+0000 7f20d6c00640 1 --2- 172.21.15.57:0/73141385 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f20d014bf50 0x7f20d01f9550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:40.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:40.685+0000 7f20d6c00640 1 --2- 172.21.15.57:0/73141385 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f20b006c530 0x7f20b006e9f0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:40.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:40.685+0000 7f20d6c00640 1 --2- 172.21.15.57:0/73141385 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f20d014b410 0x7f20d01e5380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:40.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:40.685+0000 7f20d6c00640 1 --2- 172.21.15.57:0/73141385 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f20d00d0690 0x7f20d0146ef0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:40.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:40.685+0000 7f20d6c00640 1 -- 172.21.15.57:0/73141385 >> 172.21.15.57:0/73141385 conn(0x7f20d006b990 msgr2=0x7f20d01e9760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:40.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:40.685+0000 7f20d6c00640 1 -- 172.21.15.57:0/73141385 shutdown_connections 2024-03-27T10:00:40.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:40.685+0000 7f20d6c00640 1 -- 172.21.15.57:0/73141385 wait complete. 2024-03-27T10:00:40.694 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-03-27T10:00:40.918 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:40.928+0000 7f373fe00640 1 Processor -- start 2024-03-27T10:00:40.918 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:40.928+0000 7f373fe00640 1 -- start start 2024-03-27T10:00:40.919 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:40.929+0000 7f373fe00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f373815e250 0x7f37380cf9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:40.919 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:40.930+0000 7f373fe00640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37380d3190 con 0x7f37380cfef0 2024-03-27T10:00:40.919 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:40.930+0000 7f373fe00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37380d20f0 con 0x7f37380d11b0 2024-03-27T10:00:40.920 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:40.930+0000 7f373fe00640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f37380d2d00 con 0x7f373815e250 2024-03-27T10:00:40.920 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:40.930+0000 7f373ca00640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f37380cfef0 0x7f37380d0aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:48294/0 (socket says 172.21.15.57:48294) 2024-03-27T10:00:40.920 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:40.930+0000 7f373ca00640 1 -- 172.21.15.57:0/1531979414 learned_addr learned my addr 172.21.15.57:0/1531979414 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T10:00:40.920 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:40.930+0000 7f373d400640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f373815e250 0x7f37380cf9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:40.920 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:40.930+0000 7f373d400640 1 -- 172.21.15.57:0/1531979414 >> v1:172.21.15.118:6789/0 conn(0x7f37380d11b0 legacy=0x7f37380b92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:40.920 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:40.930+0000 7f3737e00640 1 -- 172.21.15.57:0/1531979414 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3869601770 0 0) 0x7f37380d3190 con 0x7f37380cfef0 2024-03-27T10:00:40.921 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:40.931+0000 7f373d400640 1 -- 172.21.15.57:0/1531979414 >> v1:172.21.15.57:6789/0 conn(0x7f37380cfef0 legacy=0x7f37380d0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:40.921 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:40.931+0000 7f373d400640 1 -- 172.21.15.57:0/1531979414 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37380d23d0 con 0x7f373815e250 2024-03-27T10:00:40.921 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:40.932+0000 7f373d400640 1 --2- 172.21.15.57:0/1531979414 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f373815e250 0x7f37380cf9b0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f372c0097a0 tx=0x7f372c02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5ab585011bc34d8 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:40.921 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:40.932+0000 7f3737e00640 1 -- 172.21.15.57:0/1531979414 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f372c034070 con 0x7f373815e250 2024-03-27T10:00:40.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:40.932+0000 7f3737e00640 1 -- 172.21.15.57:0/1531979414 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f372c030610 con 0x7f373815e250 2024-03-27T10:00:40.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:40.932+0000 7f3737e00640 1 -- 172.21.15.57:0/1531979414 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f372c0309e0 con 0x7f373815e250 2024-03-27T10:00:40.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:40.932+0000 7f373fe00640 1 -- 172.21.15.57:0/1531979414 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f373815e250 msgr2=0x7f37380cf9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:40.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:40.932+0000 7f373fe00640 1 --2- 172.21.15.57:0/1531979414 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f373815e250 0x7f37380cf9b0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f372c0097a0 tx=0x7f372c02b960 comp rx=0 tx=0).stop 2024-03-27T10:00:40.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:40.933+0000 7f373fe00640 1 -- 172.21.15.57:0/1531979414 shutdown_connections 2024-03-27T10:00:40.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:40.933+0000 7f373fe00640 1 --2- 172.21.15.57:0/1531979414 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f373815e250 0x7f37380cf9b0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:40.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:40.933+0000 7f373fe00640 1 -- 172.21.15.57:0/1531979414 >> 172.21.15.57:0/1531979414 conn(0x7f373809d4a0 msgr2=0x7f37380d4160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:40.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:40.933+0000 7f373fe00640 1 -- 172.21.15.57:0/1531979414 shutdown_connections 2024-03-27T10:00:40.923 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:40.933+0000 7f373fe00640 1 -- 172.21.15.57:0/1531979414 wait complete. 2024-03-27T10:00:40.924 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:40.934+0000 7f373fe00640 1 Processor -- start 2024-03-27T10:00:40.924 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:40.935+0000 7f373fe00640 1 -- start start 2024-03-27T10:00:40.926 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:40.935+0000 7f373fe00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f37380cfef0 0x7f373815b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:40.926 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:40.935+0000 7f373fe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f37380d11b0 0x7f37380cb230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:40.926 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:40.935+0000 7f373fe00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f373815e250 0x7f37380cb770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:40.926 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:40.935+0000 7f373fe00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f37380d1d30 con 0x7f37380cfef0 2024-03-27T10:00:40.927 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:40.935+0000 7f373fe00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f37380d2990 con 0x7f37380d11b0 2024-03-27T10:00:40.927 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:40.935+0000 7f373fe00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f37380d1eb0 con 0x7f373815e250 2024-03-27T10:00:40.927 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:40.936+0000 7f373d400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f37380cfef0 0x7f373815b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:40.927 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:40.936+0000 7f373d400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f37380cfef0 0x7f373815b670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58980/0 (socket says 172.21.15.57:58980) 2024-03-27T10:00:40.927 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:40.936+0000 7f373d400640 1 -- 172.21.15.57:0/4104228451 learned_addr learned my addr 172.21.15.57:0/4104228451 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:40.927 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:40.936+0000 7f373de00640 1 --2- 172.21.15.57:0/4104228451 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f373815e250 0x7f37380cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:40.927 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:40.936+0000 7f373d400640 1 -- 172.21.15.57:0/4104228451 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f373815e250 msgr2=0x7f37380cb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:40.927 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:40.936+0000 7f373d400640 1 --2- 172.21.15.57:0/4104228451 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f373815e250 0x7f37380cb770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:40.927 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:40.936+0000 7f373d400640 1 -- 172.21.15.57:0/4104228451 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f37380d11b0 msgr2=0x7f37380cb230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:40.927 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:40.936+0000 7f373d400640 1 --2- 172.21.15.57:0/4104228451 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f37380d11b0 0x7f37380cb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:40.927 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:40.936+0000 7f373d400640 1 -- 172.21.15.57:0/4104228451 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f373815f890 con 0x7f37380cfef0 2024-03-27T10:00:40.927 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:40.936+0000 7f373d400640 1 --2- 172.21.15.57:0/4104228451 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f37380cfef0 0x7f373815b670 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f372c0098c0 tx=0x7f372c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:40.928 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:40.937+0000 7f3735600640 1 -- 172.21.15.57:0/4104228451 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f372c034040 con 0x7f37380cfef0 2024-03-27T10:00:40.928 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:40.937+0000 7f3735600640 1 -- 172.21.15.57:0/4104228451 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f372c03acc0 con 0x7f37380cfef0 2024-03-27T10:00:40.928 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:40.937+0000 7f3735600640 1 -- 172.21.15.57:0/4104228451 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f372c044630 con 0x7f37380cfef0 2024-03-27T10:00:40.928 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:40.937+0000 7f373fe00640 1 -- 172.21.15.57:0/4104228451 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f373815fb70 con 0x7f37380cfef0 2024-03-27T10:00:40.928 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:40.937+0000 7f373fe00640 1 -- 172.21.15.57:0/4104228451 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3738160130 con 0x7f37380cfef0 2024-03-27T10:00:40.928 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:40.938+0000 7f373fe00640 1 -- 172.21.15.57:0/4104228451 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3738068540 con 0x7f37380cfef0 2024-03-27T10:00:40.929 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:40.939+0000 7f3735600640 1 -- 172.21.15.57:0/4104228451 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f372c04b060 con 0x7f37380cfef0 2024-03-27T10:00:40.930 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:40.940+0000 7f3735600640 1 --2- 172.21.15.57:0/4104228451 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f371c06c530 0x7f371c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:40.930 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:40.941+0000 7f3735600640 1 -- 172.21.15.57:0/4104228451 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f372c0adac0 con 0x7f37380cfef0 2024-03-27T10:00:40.930 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:40.941+0000 7f373ca00640 1 --2- 172.21.15.57:0/4104228451 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f371c06c530 0x7f371c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:40.930 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:40.941+0000 7f373ca00640 1 --2- 172.21.15.57:0/4104228451 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f371c06c530 0x7f371c06e9f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f3728000c00 tx=0x7f3728007900 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:40.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:40.944+0000 7f3735600640 1 -- 172.21.15.57:0/4104228451 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f372c03f070 con 0x7f37380cfef0 2024-03-27T10:00:41.140 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.150+0000 7f373fe00640 1 -- 172.21.15.57:0/4104228451 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f37380d4870 con 0x7f37380cfef0 2024-03-27T10:00:41.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.156+0000 7f3735600640 1 -- 172.21.15.57:0/4104228451 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7f372c07bce0 con 0x7f37380cfef0 2024-03-27T10:00:41.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.159+0000 7f373fe00640 1 -- 172.21.15.57:0/4104228451 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f371c06c530 msgr2=0x7f371c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:41.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.159+0000 7f373fe00640 1 --2- 172.21.15.57:0/4104228451 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f371c06c530 0x7f371c06e9f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f3728000c00 tx=0x7f3728007900 comp rx=0 tx=0).stop 2024-03-27T10:00:41.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.159+0000 7f373fe00640 1 -- 172.21.15.57:0/4104228451 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f37380cfef0 msgr2=0x7f373815b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:41.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.159+0000 7f373fe00640 1 --2- 172.21.15.57:0/4104228451 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f37380cfef0 0x7f373815b670 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f372c0098c0 tx=0x7f372c0046c0 comp rx=0 tx=0).stop 2024-03-27T10:00:41.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.159+0000 7f373fe00640 1 -- 172.21.15.57:0/4104228451 shutdown_connections 2024-03-27T10:00:41.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.159+0000 7f373fe00640 1 --2- 172.21.15.57:0/4104228451 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f373815e250 0x7f37380cb770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:41.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.159+0000 7f373fe00640 1 --2- 172.21.15.57:0/4104228451 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f371c06c530 0x7f371c06e9f0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:41.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.159+0000 7f373fe00640 1 --2- 172.21.15.57:0/4104228451 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f37380d11b0 0x7f37380cb230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:41.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.159+0000 7f373fe00640 1 --2- 172.21.15.57:0/4104228451 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f37380cfef0 0x7f373815b670 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:41.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.159+0000 7f373fe00640 1 -- 172.21.15.57:0/4104228451 >> 172.21.15.57:0/4104228451 conn(0x7f373809d4a0 msgr2=0x7f37380b80e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:41.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.160+0000 7f373fe00640 1 -- 172.21.15.57:0/4104228451 shutdown_connections 2024-03-27T10:00:41.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.160+0000 7f373fe00640 1 -- 172.21.15.57:0/4104228451 wait complete. 2024-03-27T10:00:41.169 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-03-27T10:00:41.169 DEBUG:teuthology.orchestra.run.smithi057:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-03-27T10:00:41.294 DEBUG:teuthology.orchestra.run.smithi118:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-03-27T10:00:41.422 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-03-27T10:00:41.423 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-03-27T10:00:41.423 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-27T10:00:41.484 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-03-27T10:00:41.484 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-27T10:00:41.541 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-27T10:00:41.761 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.772+0000 7fd702400640 1 Processor -- start 2024-03-27T10:00:41.761 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.772+0000 7fd702400640 1 -- start start 2024-03-27T10:00:41.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.773+0000 7fd702400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd6fc145820 0x7fd6fc0cc950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:41.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.773+0000 7fd702400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fd6fc0cf750 0x7fd6fc06bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:41.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.773+0000 7fd702400640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6fc0cce90 con 0x7fd6fc06b750 2024-03-27T10:00:41.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.773+0000 7fd702400640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7fd6fc160b60 con 0x7fd6fc0cf750 2024-03-27T10:00:41.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.773+0000 7fd702400640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fd6fc06c0d0 con 0x7fd6fc145820 2024-03-27T10:00:41.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.773+0000 7fd6faa00640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fd6fc06b750 0x7fd6fc0b2b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:48306/0 (socket says 172.21.15.57:48306) 2024-03-27T10:00:41.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.773+0000 7fd6faa00640 1 -- 172.21.15.57:0/3875392927 learned_addr learned my addr 172.21.15.57:0/3875392927 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T10:00:41.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.773+0000 7fd6fb400640 1 --2- 172.21.15.57:0/3875392927 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd6fc145820 0x7fd6fc0cc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:41.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.773+0000 7fd6fbe00640 1 --2- 172.21.15.57:0/3875392927 >> v2:172.21.15.118:3300/0 conn(0x7fd6fc0cf750 0x7fd6fc06bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:41.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.774+0000 7fd6fa000640 1 -- 172.21.15.57:0/3875392927 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2706311780 0 0) 0x7fd6fc0cce90 con 0x7fd6fc06b750 2024-03-27T10:00:41.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.774+0000 7fd6fa000640 1 -- 172.21.15.57:0/3875392927 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd6e0003520 con 0x7fd6fc06b750 2024-03-27T10:00:41.765 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.774+0000 7fd6fa000640 1 -- 172.21.15.57:0/3875392927 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 647898303 0 0) 0x7fd6e0003520 con 0x7fd6fc06b750 2024-03-27T10:00:41.765 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.774+0000 7fd6fa000640 1 -- 172.21.15.57:0/3875392927 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd6fc145820 msgr2=0x7fd6fc0cc950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:41.765 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.774+0000 7fd6fa000640 1 --2- 172.21.15.57:0/3875392927 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd6fc145820 0x7fd6fc0cc950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:41.765 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.774+0000 7fd6fa000640 1 -- 172.21.15.57:0/3875392927 >> v2:172.21.15.118:3300/0 conn(0x7fd6fc0cf750 msgr2=0x7fd6fc06bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:41.765 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.774+0000 7fd6fa000640 1 --2- 172.21.15.57:0/3875392927 >> v2:172.21.15.118:3300/0 conn(0x7fd6fc0cf750 0x7fd6fc06bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:41.765 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.774+0000 7fd6fa000640 1 -- 172.21.15.57:0/3875392927 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6fc15fc70 con 0x7fd6fc06b750 2024-03-27T10:00:41.765 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.774+0000 7fd6fa000640 1 -- 172.21.15.57:0/3875392927 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4227751516 0 0) 0x7fd6ec0019f0 con 0x7fd6fc06b750 2024-03-27T10:00:41.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.774+0000 7fd6fa000640 1 -- 172.21.15.57:0/3875392927 >> v1:172.21.15.57:6789/0 conn(0x7fd6fc06b750 legacy=0x7fd6fc0b2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:41.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.774+0000 7fd6fa000640 1 --2- 172.21.15.57:0/3875392927 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd6e00039b0 0x7fd6e0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:41.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.774+0000 7fd6fa000640 1 --2- 172.21.15.57:0/3875392927 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd6fc145820 0x7fd6e0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:41.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.774+0000 7fd6fa000640 1 --2- 172.21.15.57:0/3875392927 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd6e0004d40 0x7fd6e00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:41.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.774+0000 7fd6fa000640 1 -- 172.21.15.57:0/3875392927 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fd6fc160b60 con 0x7fd6e0004d40 2024-03-27T10:00:41.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.774+0000 7fd6fa000640 1 -- 172.21.15.57:0/3875392927 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fd6fc06c0d0 con 0x7fd6e00039b0 2024-03-27T10:00:41.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.774+0000 7fd6fa000640 1 -- 172.21.15.57:0/3875392927 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fd6e000b9c0 con 0x7fd6fc145820 2024-03-27T10:00:41.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.774+0000 7fd6fbe00640 1 --2- 172.21.15.57:0/3875392927 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd6e0004d40 0x7fd6e00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:41.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.775+0000 7fd6fb400640 1 --2- 172.21.15.57:0/3875392927 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd6e00039b0 0x7fd6e0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:41.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.775+0000 7fd6fbe00640 1 -- 172.21.15.57:0/3875392927 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd6fc145820 msgr2=0x7fd6e0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:41.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.775+0000 7fd6fbe00640 1 --2- 172.21.15.57:0/3875392927 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd6fc145820 0x7fd6e0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:41.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.775+0000 7fd6fbe00640 1 -- 172.21.15.57:0/3875392927 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd6e00039b0 msgr2=0x7fd6e0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:41.767 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.775+0000 7fd6fbe00640 1 --2- 172.21.15.57:0/3875392927 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd6e00039b0 0x7fd6e0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:41.767 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.775+0000 7fd6fbe00640 1 -- 172.21.15.57:0/3875392927 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6e0003520 con 0x7fd6e0004d40 2024-03-27T10:00:41.767 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.776+0000 7fd6fbe00640 1 --2- 172.21.15.57:0/3875392927 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd6e0004d40 0x7fd6e00051c0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fd6f4009ac0 tx=0x7fd6e0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22ca2fd7850205 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:41.768 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.776+0000 7fd6fa000640 1 -- 172.21.15.57:0/3875392927 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6f4039070 con 0x7fd6e0004d40 2024-03-27T10:00:41.768 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.776+0000 7fd6fa000640 1 -- 172.21.15.57:0/3875392927 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6f402c710 con 0x7fd6e0004d40 2024-03-27T10:00:41.768 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.776+0000 7fd6fa000640 1 -- 172.21.15.57:0/3875392927 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6f4009690 con 0x7fd6e0004d40 2024-03-27T10:00:41.768 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.777+0000 7fd702400640 1 -- 172.21.15.57:0/3875392927 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd6e0004d40 msgr2=0x7fd6e00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:41.768 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.777+0000 7fd702400640 1 --2- 172.21.15.57:0/3875392927 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd6e0004d40 0x7fd6e00051c0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fd6f4009ac0 tx=0x7fd6e0005830 comp rx=0 tx=0).stop 2024-03-27T10:00:41.768 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.777+0000 7fd6fbe00640 1 -- 172.21.15.57:0/3875392927 reap_dead start 2024-03-27T10:00:41.768 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.777+0000 7fd702400640 1 -- 172.21.15.57:0/3875392927 shutdown_connections 2024-03-27T10:00:41.768 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.777+0000 7fd702400640 1 -- 172.21.15.57:0/3875392927 >> 172.21.15.57:0/3875392927 conn(0x7fd6fc0b1c60 msgr2=0x7fd6fc0b2070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:41.769 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.777+0000 7fd702400640 1 -- 172.21.15.57:0/3875392927 shutdown_connections 2024-03-27T10:00:41.769 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.777+0000 7fd702400640 1 -- 172.21.15.57:0/3875392927 wait complete. 2024-03-27T10:00:41.769 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.779+0000 7fd702400640 1 Processor -- start 2024-03-27T10:00:41.770 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.779+0000 7fd702400640 1 -- start start 2024-03-27T10:00:41.770 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.780+0000 7fd702400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd6e0004d40 0x7fd6fc0aeab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:41.770 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.780+0000 7fd702400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd6fc15c510 0x7fd6fc15c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:41.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.780+0000 7fd702400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd6fc0b2960 0x7fd6fc0b2de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:41.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.780+0000 7fd702400640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fd6fc160510 con 0x7fd6fc0b2960 2024-03-27T10:00:41.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.780+0000 7fd702400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fd6fc160230 con 0x7fd6e0004d40 2024-03-27T10:00:41.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.780+0000 7fd702400640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fd6fc1607f0 con 0x7fd6fc15c510 2024-03-27T10:00:41.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.780+0000 7fd6fbe00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd6fc0b2960 0x7fd6fc0b2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:41.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.780+0000 7fd6fbe00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd6fc0b2960 0x7fd6fc0b2de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58992/0 (socket says 172.21.15.57:58992) 2024-03-27T10:00:41.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.780+0000 7fd6fbe00640 1 -- 172.21.15.57:0/2562689532 learned_addr learned my addr 172.21.15.57:0/2562689532 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:41.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.781+0000 7fd6fb400640 1 --2- 172.21.15.57:0/2562689532 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd6e0004d40 0x7fd6fc0aeab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:41.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.781+0000 7fd6faa00640 1 --2- 172.21.15.57:0/2562689532 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd6fc15c510 0x7fd6fc15c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:41.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.781+0000 7fd6fbe00640 1 -- 172.21.15.57:0/2562689532 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd6fc15c510 msgr2=0x7fd6fc15c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:41.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.781+0000 7fd6fbe00640 1 --2- 172.21.15.57:0/2562689532 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd6fc15c510 0x7fd6fc15c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:41.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.781+0000 7fd6fbe00640 1 -- 172.21.15.57:0/2562689532 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd6e0004d40 msgr2=0x7fd6fc0aeab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:41.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.781+0000 7fd6fbe00640 1 --2- 172.21.15.57:0/2562689532 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd6e0004d40 0x7fd6fc0aeab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:41.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.781+0000 7fd6fbe00640 1 -- 172.21.15.57:0/2562689532 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6fc15cff0 con 0x7fd6fc0b2960 2024-03-27T10:00:41.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.781+0000 7fd6fb400640 1 --2- 172.21.15.57:0/2562689532 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd6e0004d40 0x7fd6fc0aeab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T10:00:41.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.781+0000 7fd6fbe00640 1 --2- 172.21.15.57:0/2562689532 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd6fc0b2960 0x7fd6fc0b2de0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fd6f4009ac0 tx=0x7fd6f4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:41.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.782+0000 7fd6f3400640 1 -- 172.21.15.57:0/2562689532 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6f4039070 con 0x7fd6fc0b2960 2024-03-27T10:00:41.773 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.782+0000 7fd6f3400640 1 -- 172.21.15.57:0/2562689532 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6f4043070 con 0x7fd6fc0b2960 2024-03-27T10:00:41.773 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.782+0000 7fd6f3400640 1 -- 172.21.15.57:0/2562689532 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6f4009690 con 0x7fd6fc0b2960 2024-03-27T10:00:41.773 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.782+0000 7fd702400640 1 -- 172.21.15.57:0/2562689532 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6fc15d2d0 con 0x7fd6fc0b2960 2024-03-27T10:00:41.773 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.782+0000 7fd702400640 1 -- 172.21.15.57:0/2562689532 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6fc071680 con 0x7fd6fc0b2960 2024-03-27T10:00:41.773 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.783+0000 7fd702400640 1 -- 172.21.15.57:0/2562689532 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6fc068620 con 0x7fd6fc0b2960 2024-03-27T10:00:41.773 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.784+0000 7fd6f3400640 1 -- 172.21.15.57:0/2562689532 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fd6f4003850 con 0x7fd6fc0b2960 2024-03-27T10:00:41.774 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.785+0000 7fd6f3400640 1 --2- 172.21.15.57:0/2562689532 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fd6d806c530 0x7fd6d806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:41.774 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.785+0000 7fd6f3400640 1 -- 172.21.15.57:0/2562689532 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fd6f40acc90 con 0x7fd6fc0b2960 2024-03-27T10:00:41.774 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.785+0000 7fd6fb400640 1 --2- 172.21.15.57:0/2562689532 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fd6d806c530 0x7fd6d806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:41.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.786+0000 7fd6fb400640 1 --2- 172.21.15.57:0/2562689532 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fd6d806c530 0x7fd6d806e9f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd6e4009ad0 tx=0x7fd6e4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:41.778 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.789+0000 7fd6f3400640 1 -- 172.21.15.57:0/2562689532 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7fd6f404c020 con 0x7fd6fc0b2960 2024-03-27T10:00:41.981 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.991+0000 7fd702400640 1 -- 172.21.15.57:0/2562689532 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd6fc15e0e0 con 0x7fd6fc0b2960 2024-03-27T10:00:41.983 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.993+0000 7fd6f3400640 1 -- 172.21.15.57:0/2562689532 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) ==== 74+0+18888 (secure 0 0 0) 0x7fd6f407aea0 con 0x7fd6fc0b2960 2024-03-27T10:00:41.983 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:00:41.983 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":28,"fsid":"7ac43f86-2c16-4a97-98fb-715d3cebc75c","created":"2024-03-27T09:59:04.033417+0000","modified":"2024-03-27T10:00:10.462391+0000","last_up_change":"2024-03-27T09:59:16.969624+0000","last_in_change":"2024-03-27T09:59:07.421690+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-27T09:59:17.253008+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-27T09:59:26.690365+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-27T09:59:27.559059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-27T09:59:31.187596+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"47b44362-7302-4f2a-b735-582c6c3850cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6801","nonce":2020036298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6803","nonce":2020036298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6807","nonce":2020036298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6805","nonce":2020036298}]},"public_addr":"172.21.15.57:6801/2020036298","cluster_addr":"172.21.15.57:6803/2020036298","heartbeat_back_addr":"172.21.15.57:6807/2020036298","heartbeat_front_addr":"172.21.15.57:6805/2020036298","state":["exists","up"]},{"osd":1,"uuid":"feaf96f0-9431-4188-9a09-da505b40e934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6809","nonce":3190929242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6811","nonce":3190929242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6815","nonce":3190929242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6813","nonce":3190929242}]},"public_addr":"172.21.15.57:6809/3190929242","cluster_addr":"172.21.15.57:6811/3190929242","heartbeat_back_addr":"172.21.15.57:6815/3190929242","heartbeat_front_addr":"172.21.15.57:6813/3190929242","state":["exists","up"]},{"osd":2,"uuid":"21e406e6-cfbc-4fe7-a816-e2420487c95d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6817","nonce":4065849973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6819","nonce":4065849973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6823","nonce":4065849973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6821","nonce":4065849973}]},"public_addr":"172.21.15.57:6817/4065849973","cluster_addr":"172.21.15.57:6819/4065849973","heartbeat_back_addr":"172.21.15.57:6823/4065849973","heartbeat_front_addr":"172.21.15.57:6821/4065849973","state":["exists","up"]},{"osd":3,"uuid":"a389af1d-76c4-4dfc-b215-f983f4931257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6825","nonce":158084809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6827","nonce":158084809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6831","nonce":158084809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6829","nonce":158084809}]},"public_addr":"172.21.15.57:6825/158084809","cluster_addr":"172.21.15.57:6827/158084809","heartbeat_back_addr":"172.21.15.57:6831/158084809","heartbeat_front_addr":"172.21.15.57:6829/158084809","state":["exists","up"]},{"osd":4,"uuid":"e9b05dca-557a-43ee-b43f-9ce5b7d28304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6823","nonce":108719401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6827","nonce":108719401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6831","nonce":108719401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6829","nonce":108719401}]},"public_addr":"172.21.15.118:6823/108719401","cluster_addr":"172.21.15.118:6827/108719401","heartbeat_back_addr":"172.21.15.118:6831/108719401","heartbeat_front_addr":"172.21.15.118:6829/108719401","state":["exists","up"]},{"osd":5,"uuid":"d968177d-44ff-499a-b00a-b147ed879253","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6817","nonce":2704605866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6819","nonce":2704605866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6826","nonce":2704605866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6822","nonce":2704605866}]},"public_addr":"172.21.15.118:6817/2704605866","cluster_addr":"172.21.15.118:6819/2704605866","heartbeat_back_addr":"172.21.15.118:6826/2704605866","heartbeat_front_addr":"172.21.15.118:6822/2704605866","state":["exists","up"]},{"osd":6,"uuid":"e8f98052-e6ad-4cfe-a4a9-0b17a434d54e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6801","nonce":1963659095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6803","nonce":1963659095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6807","nonce":1963659095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6805","nonce":1963659095}]},"public_addr":"172.21.15.118:6801/1963659095","cluster_addr":"172.21.15.118:6803/1963659095","heartbeat_back_addr":"172.21.15.118:6807/1963659095","heartbeat_front_addr":"172.21.15.118:6805/1963659095","state":["exists","up"]},{"osd":7,"uuid":"eccff987-8e51-4a63-845a-cf0a3196d7fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6809","nonce":1955879596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6811","nonce":1955879596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6815","nonce":1955879596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6813","nonce":1955879596}]},"public_addr":"172.21.15.118:6809/1955879596","cluster_addr":"172.21.15.118:6811/1955879596","heartbeat_back_addr":"172.21.15.118:6815/1955879596","heartbeat_front_addr":"172.21.15.118:6813/1955879596","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.721258+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.696610+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.777895+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.806769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.743259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.845687+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:13.020165+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.722294+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.e","mappings":[{"from":7,"to":1}]},{"pgid":"3.15","mappings":[{"from":3,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-27T10:00:41.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.996+0000 7fd702400640 1 -- 172.21.15.57:0/2562689532 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fd6d806c530 msgr2=0x7fd6d806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:41.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.996+0000 7fd702400640 1 --2- 172.21.15.57:0/2562689532 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fd6d806c530 0x7fd6d806e9f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd6e4009ad0 tx=0x7fd6e4008040 comp rx=0 tx=0).stop 2024-03-27T10:00:41.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.996+0000 7fd702400640 1 -- 172.21.15.57:0/2562689532 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd6fc0b2960 msgr2=0x7fd6fc0b2de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:41.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.996+0000 7fd702400640 1 --2- 172.21.15.57:0/2562689532 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd6fc0b2960 0x7fd6fc0b2de0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fd6f4009ac0 tx=0x7fd6f4004730 comp rx=0 tx=0).stop 2024-03-27T10:00:41.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.996+0000 7fd702400640 1 -- 172.21.15.57:0/2562689532 shutdown_connections 2024-03-27T10:00:41.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.996+0000 7fd702400640 1 --2- 172.21.15.57:0/2562689532 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd6fc0b2960 0x7fd6fc0b2de0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:41.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.996+0000 7fd702400640 1 --2- 172.21.15.57:0/2562689532 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd6fc15c510 0x7fd6fc15c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:41.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.996+0000 7fd702400640 1 --2- 172.21.15.57:0/2562689532 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fd6d806c530 0x7fd6d806e9f0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:41.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.996+0000 7fd702400640 1 --2- 172.21.15.57:0/2562689532 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd6e0004d40 0x7fd6fc0aeab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:41.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.996+0000 7fd702400640 1 -- 172.21.15.57:0/2562689532 >> 172.21.15.57:0/2562689532 conn(0x7fd6fc0b1c60 msgr2=0x7fd6fc0b0200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:41.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.996+0000 7fd702400640 1 -- 172.21.15.57:0/2562689532 shutdown_connections 2024-03-27T10:00:41.987 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:41.996+0000 7fd702400640 1 -- 172.21.15.57:0/2562689532 wait complete. 2024-03-27T10:00:42.005 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-27T09:59:17.253008+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-27T09:59:26.690365+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-27T09:59:27.559059+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-27T09:59:31.187596+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-27T10:00:42.006 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-27T10:00:42.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.228+0000 7f1d42800640 1 Processor -- start 2024-03-27T10:00:42.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.228+0000 7f1d42800640 1 -- start start 2024-03-27T10:00:42.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.230+0000 7f1d42800640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1d3c0d3770 0x7f1d3c0cf210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:42.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.230+0000 7f1d42800640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f1d3c0cf750 0x7f1d3c06bf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:42.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.230+0000 7f1d42800640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d3c0cfe40 con 0x7f1d3c161950 2024-03-27T10:00:42.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.230+0000 7f1d42800640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f1d3c161d30 con 0x7f1d3c0d3770 2024-03-27T10:00:42.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.230+0000 7f1d42800640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f1d3c0d0f10 con 0x7f1d3c0cf750 2024-03-27T10:00:42.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.230+0000 7f1d40a00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1d3c0d3770 0x7f1d3c0cf210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:42.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.230+0000 7f1d40a00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1d3c0d3770 0x7f1d3c0cf210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44238/0 (socket says 172.21.15.57:44238) 2024-03-27T10:00:42.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.230+0000 7f1d40a00640 1 -- 172.21.15.57:0/1249404331 learned_addr learned my addr 172.21.15.57:0/1249404331 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:42.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.230+0000 7f1d41e00640 1 --2- 172.21.15.57:0/1249404331 >> v2:172.21.15.118:3300/0 conn(0x7f1d3c0cf750 0x7f1d3c06bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:42.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.230+0000 7f1d40a00640 1 -- 172.21.15.57:0/1249404331 >> v2:172.21.15.118:3300/0 conn(0x7f1d3c0cf750 msgr2=0x7f1d3c06bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:42.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.230+0000 7f1d40a00640 1 --2- 172.21.15.57:0/1249404331 >> v2:172.21.15.118:3300/0 conn(0x7f1d3c0cf750 0x7f1d3c06bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:42.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.230+0000 7f1d40a00640 1 -- 172.21.15.57:0/1249404331 >> v1:172.21.15.118:6789/0 conn(0x7f1d3c161950 legacy=0x7f1d3c0ceb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:42.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.230+0000 7f1d40a00640 1 -- 172.21.15.57:0/1249404331 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d3c0d11f0 con 0x7f1d3c0d3770 2024-03-27T10:00:42.221 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.230+0000 7f1d41e00640 1 --2- 172.21.15.57:0/1249404331 >> v2:172.21.15.118:3300/0 conn(0x7f1d3c0cf750 0x7f1d3c06bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T10:00:42.222 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.231+0000 7f1d40a00640 1 --2- 172.21.15.57:0/1249404331 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1d3c0d3770 0x7f1d3c0cf210 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c0c7aa0 tx=0x7f1d2802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3538048e0c86b4ef server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:42.222 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.233+0000 7f1d3be00640 1 -- 172.21.15.57:0/1249404331 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d28034070 con 0x7f1d3c0d3770 2024-03-27T10:00:42.222 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.233+0000 7f1d3be00640 1 -- 172.21.15.57:0/1249404331 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d28030860 con 0x7f1d3c0d3770 2024-03-27T10:00:42.222 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.233+0000 7f1d3be00640 1 -- 172.21.15.57:0/1249404331 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d28030c30 con 0x7f1d3c0d3770 2024-03-27T10:00:42.222 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.233+0000 7f1d42800640 1 -- 172.21.15.57:0/1249404331 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1d3c0d3770 msgr2=0x7f1d3c0cf210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:42.223 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.233+0000 7f1d42800640 1 --2- 172.21.15.57:0/1249404331 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1d3c0d3770 0x7f1d3c0cf210 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c0c7aa0 tx=0x7f1d2802b9a0 comp rx=0 tx=0).stop 2024-03-27T10:00:42.223 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.233+0000 7f1d42800640 1 -- 172.21.15.57:0/1249404331 shutdown_connections 2024-03-27T10:00:42.223 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.233+0000 7f1d42800640 1 --2- 172.21.15.57:0/1249404331 >> v2:172.21.15.118:3300/0 conn(0x7f1d3c0cf750 0x7f1d3c06bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:42.223 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.233+0000 7f1d42800640 1 --2- 172.21.15.57:0/1249404331 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1d3c0d3770 0x7f1d3c0cf210 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:42.223 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.233+0000 7f1d42800640 1 -- 172.21.15.57:0/1249404331 >> 172.21.15.57:0/1249404331 conn(0x7f1d3c0d3fc0 msgr2=0x7f1d3c0d43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:42.223 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.233+0000 7f1d42800640 1 -- 172.21.15.57:0/1249404331 shutdown_connections 2024-03-27T10:00:42.223 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.233+0000 7f1d42800640 1 -- 172.21.15.57:0/1249404331 wait complete. 2024-03-27T10:00:42.223 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.235+0000 7f1d42800640 1 Processor -- start 2024-03-27T10:00:42.224 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.235+0000 7f1d42800640 1 -- start start 2024-03-27T10:00:42.226 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.235+0000 7f1d42800640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1d3c0cf750 0x7f1d3c0b8010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:42.226 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.235+0000 7f1d42800640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1d3c0d3770 0x7f1d3c0b5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:42.226 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.236+0000 7f1d42800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d3c161950 0x7f1d3c0ca0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:42.226 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.236+0000 7f1d42800640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f1d3c0d2240 con 0x7f1d3c0cf750 2024-03-27T10:00:42.226 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.236+0000 7f1d42800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f1d3c0d1f60 con 0x7f1d3c161950 2024-03-27T10:00:42.226 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.236+0000 7f1d42800640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f1d3c0d17b0 con 0x7f1d3c0d3770 2024-03-27T10:00:42.226 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.236+0000 7f1d41400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1d3c0cf750 0x7f1d3c0b8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:42.226 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.236+0000 7f1d41400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1d3c0cf750 0x7f1d3c0b8010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44252/0 (socket says 172.21.15.57:44252) 2024-03-27T10:00:42.226 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.236+0000 7f1d41400640 1 -- 172.21.15.57:0/1740125277 learned_addr learned my addr 172.21.15.57:0/1740125277 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:42.226 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.236+0000 7f1d41400640 1 -- 172.21.15.57:0/1740125277 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1d3c0d3770 msgr2=0x7f1d3c0b5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:42.227 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.236+0000 7f1d41400640 1 --2- 172.21.15.57:0/1740125277 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1d3c0d3770 0x7f1d3c0b5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:42.227 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.236+0000 7f1d41400640 1 -- 172.21.15.57:0/1740125277 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d3c161950 msgr2=0x7f1d3c0ca0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:42.227 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.236+0000 7f1d41400640 1 --2- 172.21.15.57:0/1740125277 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d3c161950 0x7f1d3c0ca0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:42.227 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.236+0000 7f1d41400640 1 -- 172.21.15.57:0/1740125277 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d3c0b6f70 con 0x7f1d3c0cf750 2024-03-27T10:00:42.227 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.237+0000 7f1d41400640 1 --2- 172.21.15.57:0/1740125277 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1d3c0cf750 0x7f1d3c0b8010 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f1d3400ba80 tx=0x7f1d3400bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:42.228 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.237+0000 7f1d39600640 1 -- 172.21.15.57:0/1740125277 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d34019070 con 0x7f1d3c0cf750 2024-03-27T10:00:42.228 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.237+0000 7f1d39600640 1 -- 172.21.15.57:0/1740125277 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d3400cc90 con 0x7f1d3c0cf750 2024-03-27T10:00:42.228 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.237+0000 7f1d42800640 1 -- 172.21.15.57:0/1740125277 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d3c0b7250 con 0x7f1d3c0cf750 2024-03-27T10:00:42.228 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.237+0000 7f1d39600640 1 -- 172.21.15.57:0/1740125277 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d34014680 con 0x7f1d3c0cf750 2024-03-27T10:00:42.228 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.237+0000 7f1d42800640 1 -- 172.21.15.57:0/1740125277 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d3c0b7810 con 0x7f1d3c0cf750 2024-03-27T10:00:42.228 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.238+0000 7f1d42800640 1 -- 172.21.15.57:0/1740125277 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d3c068540 con 0x7f1d3c0cf750 2024-03-27T10:00:42.229 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.240+0000 7f1d39600640 1 -- 172.21.15.57:0/1740125277 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f1d3401c070 con 0x7f1d3c0cf750 2024-03-27T10:00:42.229 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.240+0000 7f1d39600640 1 --2- 172.21.15.57:0/1740125277 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f1d1c06c580 0x7f1d1c06ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:42.230 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.240+0000 7f1d39600640 1 -- 172.21.15.57:0/1740125277 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f1d3408b990 con 0x7f1d3c0cf750 2024-03-27T10:00:42.230 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.240+0000 7f1d40a00640 1 --2- 172.21.15.57:0/1740125277 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f1d1c06c580 0x7f1d1c06ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:42.230 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.241+0000 7f1d40a00640 1 --2- 172.21.15.57:0/1740125277 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f1d1c06c580 0x7f1d1c06ea40 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1d28036000 tx=0x7f1d2803b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:42.234 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.245+0000 7f1d39600640 1 -- 172.21.15.57:0/1740125277 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f1d34059b90 con 0x7f1d3c0cf750 2024-03-27T10:00:42.436 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.447+0000 7f1d42800640 1 -- 172.21.15.57:0/1740125277 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f1d3c0b1d40 con 0x7f1d3c0cf750 2024-03-27T10:00:42.437 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.448+0000 7f1d39600640 1 -- 172.21.15.57:0/1740125277 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) ==== 93+0+10 (secure 0 0 0) 0x7f1d34059490 con 0x7f1d3c0cf750 2024-03-27T10:00:42.438 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2024-03-27T10:00:42.441 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.451+0000 7f1d42800640 1 -- 172.21.15.57:0/1740125277 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f1d1c06c580 msgr2=0x7f1d1c06ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:42.441 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.451+0000 7f1d42800640 1 --2- 172.21.15.57:0/1740125277 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f1d1c06c580 0x7f1d1c06ea40 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1d28036000 tx=0x7f1d2803b040 comp rx=0 tx=0).stop 2024-03-27T10:00:42.441 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.451+0000 7f1d42800640 1 -- 172.21.15.57:0/1740125277 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1d3c0cf750 msgr2=0x7f1d3c0b8010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:42.441 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.451+0000 7f1d42800640 1 --2- 172.21.15.57:0/1740125277 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1d3c0cf750 0x7f1d3c0b8010 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f1d3400ba80 tx=0x7f1d3400bf40 comp rx=0 tx=0).stop 2024-03-27T10:00:42.441 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.451+0000 7f1d42800640 1 -- 172.21.15.57:0/1740125277 shutdown_connections 2024-03-27T10:00:42.441 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.451+0000 7f1d42800640 1 --2- 172.21.15.57:0/1740125277 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f1d1c06c580 0x7f1d1c06ea40 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:42.441 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.451+0000 7f1d42800640 1 --2- 172.21.15.57:0/1740125277 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1d3c161950 0x7f1d3c0ca0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:42.441 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.451+0000 7f1d42800640 1 --2- 172.21.15.57:0/1740125277 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1d3c0d3770 0x7f1d3c0b5a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:42.442 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.451+0000 7f1d42800640 1 --2- 172.21.15.57:0/1740125277 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1d3c0cf750 0x7f1d3c0b8010 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:42.442 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.451+0000 7f1d42800640 1 -- 172.21.15.57:0/1740125277 >> 172.21.15.57:0/1740125277 conn(0x7f1d3c0d3fc0 msgr2=0x7f1d3c06c890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:42.442 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.451+0000 7f1d42800640 1 -- 172.21.15.57:0/1740125277 shutdown_connections 2024-03-27T10:00:42.442 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.451+0000 7f1d42800640 1 -- 172.21.15.57:0/1740125277 wait complete. 2024-03-27T10:00:42.459 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-27T10:00:42.674 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.685+0000 7f45aa200640 1 Processor -- start 2024-03-27T10:00:42.674 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.685+0000 7f45aa200640 1 -- start start 2024-03-27T10:00:42.676 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.686+0000 7f45aa200640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f45a415ae80 0x7f45a40cbcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:42.676 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.686+0000 7f45aa200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f45a40cd920 0x7f45a406ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:42.676 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.686+0000 7f45aa200640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45a415b260 con 0x7f45a406ef50 2024-03-27T10:00:42.676 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.686+0000 7f45aa200640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f45a40ceaa0 con 0x7f45a415ae80 2024-03-27T10:00:42.676 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.686+0000 7f45aa200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f45a40c59f0 con 0x7f45a40cd920 2024-03-27T10:00:42.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.687+0000 7f45a9800640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f45a406ef50 0x7f45a415e970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:54358/0 (socket says 172.21.15.57:54358) 2024-03-27T10:00:42.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.687+0000 7f45a8e00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f45a415ae80 0x7f45a40cbcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:42.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.687+0000 7f45a9800640 1 -- 172.21.15.57:0/2352296815 learned_addr learned my addr 172.21.15.57:0/2352296815 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T10:00:42.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.687+0000 7f45a3e00640 1 --2- 172.21.15.57:0/2352296815 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f45a40cd920 0x7f45a406ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:42.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.687+0000 7f45a8e00640 1 -- 172.21.15.57:0/2352296815 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f45a40cd920 msgr2=0x7f45a406ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:42.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.687+0000 7f45a8e00640 1 --2- 172.21.15.57:0/2352296815 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f45a40cd920 0x7f45a406ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:42.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.687+0000 7f45a8e00640 1 -- 172.21.15.57:0/2352296815 >> v1:172.21.15.57:6789/0 conn(0x7f45a406ef50 legacy=0x7f45a415e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:42.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.687+0000 7f45a8e00640 1 -- 172.21.15.57:0/2352296815 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45a40cde90 con 0x7f45a415ae80 2024-03-27T10:00:42.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.688+0000 7f45a8e00640 1 --2- 172.21.15.57:0/2352296815 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f45a415ae80 0x7f45a40cbcc0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f45980097a0 tx=0x7f459802b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1584f22740588da5 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:42.680 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.690+0000 7f45a3400640 1 -- 172.21.15.57:0/2352296815 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4598035020 con 0x7f45a415ae80 2024-03-27T10:00:42.680 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.690+0000 7f45a3400640 1 -- 172.21.15.57:0/2352296815 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4598031810 con 0x7f45a415ae80 2024-03-27T10:00:42.680 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.690+0000 7f45a3400640 1 -- 172.21.15.57:0/2352296815 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4598031be0 con 0x7f45a415ae80 2024-03-27T10:00:42.680 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.691+0000 7f45aa200640 1 -- 172.21.15.57:0/2352296815 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f45a415ae80 msgr2=0x7f45a40cbcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:42.681 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.691+0000 7f45aa200640 1 --2- 172.21.15.57:0/2352296815 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f45a415ae80 0x7f45a40cbcc0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f45980097a0 tx=0x7f459802b8b0 comp rx=0 tx=0).stop 2024-03-27T10:00:42.681 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.691+0000 7f45aa200640 1 -- 172.21.15.57:0/2352296815 shutdown_connections 2024-03-27T10:00:42.681 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.691+0000 7f45aa200640 1 --2- 172.21.15.57:0/2352296815 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f45a40cd920 0x7f45a406ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:42.681 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.691+0000 7f45aa200640 1 --2- 172.21.15.57:0/2352296815 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f45a415ae80 0x7f45a40cbcc0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:42.681 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.691+0000 7f45aa200640 1 -- 172.21.15.57:0/2352296815 >> 172.21.15.57:0/2352296815 conn(0x7f45a40cfb40 msgr2=0x7f45a40cff20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:42.681 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.691+0000 7f45aa200640 1 -- 172.21.15.57:0/2352296815 shutdown_connections 2024-03-27T10:00:42.681 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.691+0000 7f45aa200640 1 -- 172.21.15.57:0/2352296815 wait complete. 2024-03-27T10:00:42.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.693+0000 7f45aa200640 1 Processor -- start 2024-03-27T10:00:42.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.694+0000 7f45aa200640 1 -- start start 2024-03-27T10:00:42.684 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.695+0000 7f45aa200640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f45a406ef50 0x7f45a40b4f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:42.685 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.695+0000 7f45aa200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f45a40cd920 0x7f45a414daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:42.685 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.695+0000 7f45aa200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f45a415ae80 0x7f45a40cc5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:42.685 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.695+0000 7f45aa200640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f45a40ce730 con 0x7f45a406ef50 2024-03-27T10:00:42.685 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.695+0000 7f45aa200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f45a40ce450 con 0x7f45a40cd920 2024-03-27T10:00:42.685 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.695+0000 7f45aa200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f45a40cc200 con 0x7f45a415ae80 2024-03-27T10:00:42.685 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.695+0000 7f45a8e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f45a406ef50 0x7f45a40b4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:42.685 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.695+0000 7f45a8e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f45a406ef50 0x7f45a40b4f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44268/0 (socket says 172.21.15.57:44268) 2024-03-27T10:00:42.685 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.695+0000 7f45a8e00640 1 -- 172.21.15.57:0/2711828479 learned_addr learned my addr 172.21.15.57:0/2711828479 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:42.686 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.696+0000 7f45a9800640 1 --2- 172.21.15.57:0/2711828479 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f45a415ae80 0x7f45a40cc5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:42.686 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.696+0000 7f45a3e00640 1 --2- 172.21.15.57:0/2711828479 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f45a40cd920 0x7f45a414daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:42.686 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.696+0000 7f45a8e00640 1 -- 172.21.15.57:0/2711828479 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f45a415ae80 msgr2=0x7f45a40cc5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:42.686 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.696+0000 7f45a8e00640 1 --2- 172.21.15.57:0/2711828479 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f45a415ae80 0x7f45a40cc5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:42.686 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.696+0000 7f45a8e00640 1 -- 172.21.15.57:0/2711828479 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f45a40cd920 msgr2=0x7f45a414daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:42.687 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.696+0000 7f45a8e00640 1 --2- 172.21.15.57:0/2711828479 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f45a40cd920 0x7f45a414daf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:42.687 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.696+0000 7f45a8e00640 1 -- 172.21.15.57:0/2711828479 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45a414aa70 con 0x7f45a406ef50 2024-03-27T10:00:42.687 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.696+0000 7f45a8e00640 1 --2- 172.21.15.57:0/2711828479 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f45a406ef50 0x7f45a40b4f50 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f45980097a0 tx=0x7f45980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:42.687 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.696+0000 7f45a0c00640 1 -- 172.21.15.57:0/2711828479 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f459803ad60 con 0x7f45a406ef50 2024-03-27T10:00:42.687 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.696+0000 7f45a0c00640 1 -- 172.21.15.57:0/2711828479 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45980443f0 con 0x7f45a406ef50 2024-03-27T10:00:42.687 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.696+0000 7f45a0c00640 1 -- 172.21.15.57:0/2711828479 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45980447e0 con 0x7f45a406ef50 2024-03-27T10:00:42.687 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.697+0000 7f45aa200640 1 -- 172.21.15.57:0/2711828479 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45a414ad50 con 0x7f45a406ef50 2024-03-27T10:00:42.687 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.697+0000 7f45aa200640 1 -- 172.21.15.57:0/2711828479 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45a414b310 con 0x7f45a406ef50 2024-03-27T10:00:42.687 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.698+0000 7f45aa200640 1 -- 172.21.15.57:0/2711828479 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45a4068540 con 0x7f45a406ef50 2024-03-27T10:00:42.689 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.699+0000 7f45a0c00640 1 -- 172.21.15.57:0/2711828479 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f459804b060 con 0x7f45a406ef50 2024-03-27T10:00:42.690 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.702+0000 7f45a0c00640 1 --2- 172.21.15.57:0/2711828479 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f458406c530 0x7f458406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:42.690 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.702+0000 7f45a0c00640 1 -- 172.21.15.57:0/2711828479 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f45980adca0 con 0x7f45a406ef50 2024-03-27T10:00:42.690 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.702+0000 7f45a3e00640 1 --2- 172.21.15.57:0/2711828479 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f458406c530 0x7f458406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:42.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.702+0000 7f45a3e00640 1 --2- 172.21.15.57:0/2711828479 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f458406c530 0x7f458406e9f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f45a413d070 tx=0x7f4590008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:42.694 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.704+0000 7f45a0c00640 1 -- 172.21.15.57:0/2711828479 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f459803f070 con 0x7f45a406ef50 2024-03-27T10:00:42.898 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.909+0000 7f45aa200640 1 -- 172.21.15.57:0/2711828479 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f45a406d290 con 0x7f45a406ef50 2024-03-27T10:00:42.899 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.911+0000 7f45a0c00640 1 -- 172.21.15.57:0/2711828479 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) ==== 104+0+11 (secure 0 0 0) 0x7f459804c3b0 con 0x7f45a406ef50 2024-03-27T10:00:42.899 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2024-03-27T10:00:42.902 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.912+0000 7f45aa200640 1 -- 172.21.15.57:0/2711828479 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f458406c530 msgr2=0x7f458406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:42.902 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.912+0000 7f45aa200640 1 --2- 172.21.15.57:0/2711828479 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f458406c530 0x7f458406e9f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f45a413d070 tx=0x7f4590008040 comp rx=0 tx=0).stop 2024-03-27T10:00:42.902 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.912+0000 7f45aa200640 1 -- 172.21.15.57:0/2711828479 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f45a406ef50 msgr2=0x7f45a40b4f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:42.902 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.912+0000 7f45aa200640 1 --2- 172.21.15.57:0/2711828479 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f45a406ef50 0x7f45a40b4f50 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f45980097a0 tx=0x7f45980046c0 comp rx=0 tx=0).stop 2024-03-27T10:00:42.902 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.913+0000 7f45aa200640 1 -- 172.21.15.57:0/2711828479 shutdown_connections 2024-03-27T10:00:42.902 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.913+0000 7f45aa200640 1 --2- 172.21.15.57:0/2711828479 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f45a415ae80 0x7f45a40cc5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:42.903 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.913+0000 7f45aa200640 1 --2- 172.21.15.57:0/2711828479 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f458406c530 0x7f458406e9f0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:42.903 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.913+0000 7f45aa200640 1 --2- 172.21.15.57:0/2711828479 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f45a40cd920 0x7f45a414daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:42.903 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.913+0000 7f45aa200640 1 --2- 172.21.15.57:0/2711828479 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f45a406ef50 0x7f45a40b4f50 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:42.903 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.913+0000 7f45aa200640 1 -- 172.21.15.57:0/2711828479 >> 172.21.15.57:0/2711828479 conn(0x7f45a40cfb40 msgr2=0x7f45a40ad8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:42.903 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.913+0000 7f45aa200640 1 -- 172.21.15.57:0/2711828479 shutdown_connections 2024-03-27T10:00:42.903 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:42.913+0000 7f45aa200640 1 -- 172.21.15.57:0/2711828479 wait complete. 2024-03-27T10:00:42.922 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-27T10:00:43.142 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.153+0000 7fa494800640 1 Processor -- start 2024-03-27T10:00:43.142 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.154+0000 7fa494800640 1 -- start start 2024-03-27T10:00:43.144 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.155+0000 7fa494800640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fa48c15e250 0x7fa48c0cf9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:43.144 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.155+0000 7fa494800640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa48c0d11b0 0x7fa48c0b92f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:43.144 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.155+0000 7fa494800640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa48c0d3190 con 0x7fa48c0cfef0 2024-03-27T10:00:43.144 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.155+0000 7fa494800640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7fa48c0d2d00 con 0x7fa48c15e250 2024-03-27T10:00:43.144 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.155+0000 7fa494800640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fa48c0d20f0 con 0x7fa48c0d11b0 2024-03-27T10:00:43.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.156+0000 7fa491e00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fa48c15e250 0x7fa48c0cf9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:43.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.156+0000 7fa492800640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa48c0d11b0 0x7fa48c0b92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:43.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.156+0000 7fa491e00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fa48c15e250 0x7fa48c0cf9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.57:57930/0 (socket says 172.21.15.57:57930) 2024-03-27T10:00:43.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.156+0000 7fa491e00640 1 -- 172.21.15.57:0/519368028 learned_addr learned my addr 172.21.15.57:0/519368028 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:43.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.156+0000 7fa491400640 1 --1- 172.21.15.57:0/519368028 >> v1:172.21.15.118:6789/0 conn(0x7fa48c0cfef0 0x7fa48c0d0aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.57:45590/0 (socket says 172.21.15.57:45590) 2024-03-27T10:00:43.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.157+0000 7fa491e00640 1 -- 172.21.15.57:0/519368028 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa48c0d11b0 msgr2=0x7fa48c0b92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:43.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.157+0000 7fa491e00640 1 --2- 172.21.15.57:0/519368028 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa48c0d11b0 0x7fa48c0b92f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:43.146 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.157+0000 7fa491e00640 1 -- 172.21.15.57:0/519368028 >> v1:172.21.15.118:6789/0 conn(0x7fa48c0cfef0 legacy=0x7fa48c0d0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:43.146 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.157+0000 7fa491e00640 1 -- 172.21.15.57:0/519368028 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa48c0d23d0 con 0x7fa48c15e250 2024-03-27T10:00:43.146 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.157+0000 7fa492800640 1 --2- 172.21.15.57:0/519368028 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa48c0d11b0 0x7fa48c0b92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T10:00:43.147 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.158+0000 7fa491e00640 1 --2- 172.21.15.57:0/519368028 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa48c15e250 0x7fa48c0cf9b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa48c0d2e80 tx=0x7fa48002b970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=827f906e7fca9cd8 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:43.147 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.159+0000 7fa490a00640 1 -- 172.21.15.57:0/519368028 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa480034070 con 0x7fa48c15e250 2024-03-27T10:00:43.147 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.159+0000 7fa490a00640 1 -- 172.21.15.57:0/519368028 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa480030830 con 0x7fa48c15e250 2024-03-27T10:00:43.147 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.159+0000 7fa490a00640 1 -- 172.21.15.57:0/519368028 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa480030c00 con 0x7fa48c15e250 2024-03-27T10:00:43.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.160+0000 7fa494800640 1 -- 172.21.15.57:0/519368028 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa48c15e250 msgr2=0x7fa48c0cf9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:43.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.160+0000 7fa494800640 1 --2- 172.21.15.57:0/519368028 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa48c15e250 0x7fa48c0cf9b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa48c0d2e80 tx=0x7fa48002b970 comp rx=0 tx=0).stop 2024-03-27T10:00:43.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.160+0000 7fa494800640 1 -- 172.21.15.57:0/519368028 shutdown_connections 2024-03-27T10:00:43.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.160+0000 7fa494800640 1 --2- 172.21.15.57:0/519368028 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa48c0d11b0 0x7fa48c0b92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:43.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.160+0000 7fa494800640 1 --2- 172.21.15.57:0/519368028 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa48c15e250 0x7fa48c0cf9b0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:43.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.160+0000 7fa494800640 1 -- 172.21.15.57:0/519368028 >> 172.21.15.57:0/519368028 conn(0x7fa48c09d4a0 msgr2=0x7fa48c0d4160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:43.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.160+0000 7fa494800640 1 -- 172.21.15.57:0/519368028 shutdown_connections 2024-03-27T10:00:43.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.160+0000 7fa494800640 1 -- 172.21.15.57:0/519368028 wait complete. 2024-03-27T10:00:43.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.162+0000 7fa494800640 1 Processor -- start 2024-03-27T10:00:43.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.162+0000 7fa494800640 1 -- start start 2024-03-27T10:00:43.152 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.164+0000 7fa494800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa48c0cfef0 0x7fa48c0b9340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:43.152 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.164+0000 7fa494800640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa48c0d11b0 0x7fa48c15c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:43.153 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.164+0000 7fa494800640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa48c15e250 0x7fa48c15c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:43.153 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.164+0000 7fa494800640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fa48c0d1d30 con 0x7fa48c15e250 2024-03-27T10:00:43.153 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.164+0000 7fa494800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fa48c0d2990 con 0x7fa48c0cfef0 2024-03-27T10:00:43.153 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.164+0000 7fa494800640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fa48c0d1eb0 con 0x7fa48c0d11b0 2024-03-27T10:00:43.153 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.164+0000 7fa492800640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa48c15e250 0x7fa48c15c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:43.153 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.164+0000 7fa492800640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa48c15e250 0x7fa48c15c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44270/0 (socket says 172.21.15.57:44270) 2024-03-27T10:00:43.153 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.164+0000 7fa492800640 1 -- 172.21.15.57:0/766034111 learned_addr learned my addr 172.21.15.57:0/766034111 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:43.153 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.164+0000 7fa491e00640 1 --2- 172.21.15.57:0/766034111 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa48c0cfef0 0x7fa48c0b9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:43.154 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.165+0000 7fa491400640 1 --2- 172.21.15.57:0/766034111 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa48c0d11b0 0x7fa48c15c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:43.154 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.165+0000 7fa492800640 1 -- 172.21.15.57:0/766034111 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa48c0d11b0 msgr2=0x7fa48c15c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:43.154 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.165+0000 7fa492800640 1 --2- 172.21.15.57:0/766034111 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa48c0d11b0 0x7fa48c15c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:43.154 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.165+0000 7fa492800640 1 -- 172.21.15.57:0/766034111 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa48c0cfef0 msgr2=0x7fa48c0b9340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:43.154 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.165+0000 7fa492800640 1 --2- 172.21.15.57:0/766034111 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa48c0cfef0 0x7fa48c0b9340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:43.154 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.165+0000 7fa492800640 1 -- 172.21.15.57:0/766034111 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa48c158880 con 0x7fa48c15e250 2024-03-27T10:00:43.155 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.165+0000 7fa492800640 1 --2- 172.21.15.57:0/766034111 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa48c15e250 0x7fa48c15c800 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fa48800efc0 tx=0x7fa48800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:43.155 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.166+0000 7fa486000640 1 -- 172.21.15.57:0/766034111 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa488018020 con 0x7fa48c15e250 2024-03-27T10:00:43.155 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.166+0000 7fa486000640 1 -- 172.21.15.57:0/766034111 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa488014480 con 0x7fa48c15e250 2024-03-27T10:00:43.155 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.166+0000 7fa486000640 1 -- 172.21.15.57:0/766034111 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa488014850 con 0x7fa48c15e250 2024-03-27T10:00:43.155 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.166+0000 7fa494800640 1 -- 172.21.15.57:0/766034111 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa48c1f7960 con 0x7fa48c15e250 2024-03-27T10:00:43.155 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.166+0000 7fa494800640 1 -- 172.21.15.57:0/766034111 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa48c1f7f20 con 0x7fa48c15e250 2024-03-27T10:00:43.155 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.167+0000 7fa494800640 1 -- 172.21.15.57:0/766034111 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa48c068540 con 0x7fa48c15e250 2024-03-27T10:00:43.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.168+0000 7fa486000640 1 -- 172.21.15.57:0/766034111 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fa488005d10 con 0x7fa48c15e250 2024-03-27T10:00:43.157 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.169+0000 7fa486000640 1 --2- 172.21.15.57:0/766034111 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fa47006c560 0x7fa47006ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:43.157 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.169+0000 7fa486000640 1 -- 172.21.15.57:0/766034111 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fa48808c910 con 0x7fa48c15e250 2024-03-27T10:00:43.157 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.169+0000 7fa491e00640 1 --2- 172.21.15.57:0/766034111 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fa47006c560 0x7fa47006ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:43.158 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.170+0000 7fa491e00640 1 --2- 172.21.15.57:0/766034111 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fa47006c560 0x7fa47006ea20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa480036000 tx=0x7fa48003b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:43.162 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.174+0000 7fa486000640 1 -- 172.21.15.57:0/766034111 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7fa488022030 con 0x7fa48c15e250 2024-03-27T10:00:43.366 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.378+0000 7fa494800640 1 -- 172.21.15.57:0/766034111 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fa48c0d4870 con 0x7fa48c15e250 2024-03-27T10:00:43.367 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.379+0000 7fa486000640 1 -- 172.21.15.57:0/766034111 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) ==== 100+0+11 (secure 0 0 0) 0x7fa488010040 con 0x7fa48c15e250 2024-03-27T10:00:43.368 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2024-03-27T10:00:43.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.382+0000 7fa494800640 1 -- 172.21.15.57:0/766034111 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fa47006c560 msgr2=0x7fa47006ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:43.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.382+0000 7fa494800640 1 --2- 172.21.15.57:0/766034111 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fa47006c560 0x7fa47006ea20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa480036000 tx=0x7fa48003b040 comp rx=0 tx=0).stop 2024-03-27T10:00:43.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.382+0000 7fa494800640 1 -- 172.21.15.57:0/766034111 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa48c15e250 msgr2=0x7fa48c15c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:43.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.382+0000 7fa494800640 1 --2- 172.21.15.57:0/766034111 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa48c15e250 0x7fa48c15c800 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fa48800efc0 tx=0x7fa48800c490 comp rx=0 tx=0).stop 2024-03-27T10:00:43.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.382+0000 7fa494800640 1 -- 172.21.15.57:0/766034111 shutdown_connections 2024-03-27T10:00:43.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.382+0000 7fa494800640 1 --2- 172.21.15.57:0/766034111 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa48c15e250 0x7fa48c15c800 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:43.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.382+0000 7fa494800640 1 --2- 172.21.15.57:0/766034111 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa48c0d11b0 0x7fa48c15c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:43.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.382+0000 7fa494800640 1 --2- 172.21.15.57:0/766034111 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fa47006c560 0x7fa47006ea20 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:43.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.382+0000 7fa494800640 1 --2- 172.21.15.57:0/766034111 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa48c0cfef0 0x7fa48c0b9340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:43.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.382+0000 7fa494800640 1 -- 172.21.15.57:0/766034111 >> 172.21.15.57:0/766034111 conn(0x7fa48c09d4a0 msgr2=0x7fa48c15f390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:43.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.382+0000 7fa494800640 1 -- 172.21.15.57:0/766034111 shutdown_connections 2024-03-27T10:00:43.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.382+0000 7fa494800640 1 -- 172.21.15.57:0/766034111 wait complete. 2024-03-27T10:00:43.390 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-27T10:00:43.608 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.619+0000 7f9562200640 1 Processor -- start 2024-03-27T10:00:43.608 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.620+0000 7f9562200640 1 -- start start 2024-03-27T10:00:43.609 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.621+0000 7f9562200640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f955c0cd920 0x7f955c06ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:43.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.621+0000 7f9562200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f955c06ef50 0x7f955c0c49e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:43.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.621+0000 7f9562200640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f955c15b260 con 0x7f955c15ae80 2024-03-27T10:00:43.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.621+0000 7f9562200640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f955c0ceaa0 con 0x7f955c0cd920 2024-03-27T10:00:43.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.621+0000 7f9562200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f955c0cde90 con 0x7f955c06ef50 2024-03-27T10:00:43.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.622+0000 7f9561800640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f955c06ef50 0x7f955c0c49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:43.611 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.622+0000 7f955be00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f955c0cd920 0x7f955c06ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:43.611 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.622+0000 7f9561800640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f955c06ef50 0x7f955c0c49e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.57:44452/0 (socket says 172.21.15.57:44452) 2024-03-27T10:00:43.611 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.622+0000 7f9561800640 1 -- 172.21.15.57:0/477724469 learned_addr learned my addr 172.21.15.57:0/477724469 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:43.611 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.623+0000 7f9561800640 1 -- 172.21.15.57:0/477724469 >> v2:172.21.15.118:3300/0 conn(0x7f955c0cd920 msgr2=0x7f955c06ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:43.611 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.623+0000 7f9561800640 1 --2- 172.21.15.57:0/477724469 >> v2:172.21.15.118:3300/0 conn(0x7f955c0cd920 0x7f955c06ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:43.611 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.623+0000 7f9561800640 1 -- 172.21.15.57:0/477724469 >> v1:172.21.15.118:6789/0 conn(0x7f955c15ae80 legacy=0x7f955c0cbcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:43.611 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.623+0000 7f9561800640 1 -- 172.21.15.57:0/477724469 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f955c0ce170 con 0x7f955c06ef50 2024-03-27T10:00:43.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.624+0000 7f9561800640 1 --2- 172.21.15.57:0/477724469 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f955c06ef50 0x7f955c0c49e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f955400d180 tx=0x7f955402e160 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6339e92e51119f52 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:43.613 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.625+0000 7f955b400640 1 -- 172.21.15.57:0/477724469 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f955400b0d0 con 0x7f955c06ef50 2024-03-27T10:00:43.613 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.625+0000 7f955b400640 1 -- 172.21.15.57:0/477724469 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f955400b270 con 0x7f955c06ef50 2024-03-27T10:00:43.613 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.625+0000 7f955b400640 1 -- 172.21.15.57:0/477724469 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9554009600 con 0x7f955c06ef50 2024-03-27T10:00:43.614 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.625+0000 7f9562200640 1 -- 172.21.15.57:0/477724469 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f955c06ef50 msgr2=0x7f955c0c49e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:43.614 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.625+0000 7f9562200640 1 --2- 172.21.15.57:0/477724469 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f955c06ef50 0x7f955c0c49e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f955400d180 tx=0x7f955402e160 comp rx=0 tx=0).stop 2024-03-27T10:00:43.614 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.625+0000 7f9562200640 1 -- 172.21.15.57:0/477724469 shutdown_connections 2024-03-27T10:00:43.614 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.625+0000 7f9562200640 1 --2- 172.21.15.57:0/477724469 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f955c06ef50 0x7f955c0c49e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:43.614 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.625+0000 7f9562200640 1 --2- 172.21.15.57:0/477724469 >> v2:172.21.15.118:3300/0 conn(0x7f955c0cd920 0x7f955c06ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:43.614 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.625+0000 7f9562200640 1 -- 172.21.15.57:0/477724469 >> 172.21.15.57:0/477724469 conn(0x7f955c0cfb40 msgr2=0x7f955c0cff20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:43.614 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.625+0000 7f9562200640 1 -- 172.21.15.57:0/477724469 shutdown_connections 2024-03-27T10:00:43.614 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.626+0000 7f9562200640 1 -- 172.21.15.57:0/477724469 wait complete. 2024-03-27T10:00:43.615 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.627+0000 7f9562200640 1 Processor -- start 2024-03-27T10:00:43.615 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.627+0000 7f9562200640 1 -- start start 2024-03-27T10:00:43.617 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.628+0000 7f9562200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f955c06ef50 0x7f955c15ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:43.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.628+0000 7f9562200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f955c0cd920 0x7f955c14b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:43.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.628+0000 7f9562200640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f955c15ae80 0x7f955c15bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:43.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.628+0000 7f9562200640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f955c0cef30 con 0x7f955c15ae80 2024-03-27T10:00:43.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.628+0000 7f9562200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f955c0ce730 con 0x7f955c0cd920 2024-03-27T10:00:43.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.628+0000 7f9562200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f955c15baa0 con 0x7f955c06ef50 2024-03-27T10:00:43.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.629+0000 7f9561800640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f955c15ae80 0x7f955c15bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:43.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.629+0000 7f9561800640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f955c15ae80 0x7f955c15bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44278/0 (socket says 172.21.15.57:44278) 2024-03-27T10:00:43.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.629+0000 7f9561800640 1 -- 172.21.15.57:0/1590687649 learned_addr learned my addr 172.21.15.57:0/1590687649 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:43.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.629+0000 7f955be00640 1 --2- 172.21.15.57:0/1590687649 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f955c0cd920 0x7f955c14b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:43.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.629+0000 7f9560e00640 1 --2- 172.21.15.57:0/1590687649 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f955c06ef50 0x7f955c15ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:43.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.629+0000 7f9561800640 1 -- 172.21.15.57:0/1590687649 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f955c06ef50 msgr2=0x7f955c15ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:43.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.629+0000 7f9561800640 1 --2- 172.21.15.57:0/1590687649 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f955c06ef50 0x7f955c15ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:43.619 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.629+0000 7f9561800640 1 -- 172.21.15.57:0/1590687649 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f955c0cd920 msgr2=0x7f955c14b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:43.619 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.629+0000 7f9561800640 1 --2- 172.21.15.57:0/1590687649 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f955c0cd920 0x7f955c14b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:43.619 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.629+0000 7f9561800640 1 -- 172.21.15.57:0/1590687649 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f955c14bc60 con 0x7f955c15ae80 2024-03-27T10:00:43.619 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.630+0000 7f9561800640 1 --2- 172.21.15.57:0/1590687649 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f955c15ae80 0x7f955c15bf30 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f955400d2a0 tx=0x7f9554004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:43.620 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.630+0000 7f9558c00640 1 -- 172.21.15.57:0/1590687649 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9554045020 con 0x7f955c15ae80 2024-03-27T10:00:43.620 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.630+0000 7f9558c00640 1 -- 172.21.15.57:0/1590687649 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9554009e50 con 0x7f955c15ae80 2024-03-27T10:00:43.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.630+0000 7f9562200640 1 -- 172.21.15.57:0/1590687649 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f955c15c470 con 0x7f955c15ae80 2024-03-27T10:00:43.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.630+0000 7f9558c00640 1 -- 172.21.15.57:0/1590687649 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f955400b0d0 con 0x7f955c15ae80 2024-03-27T10:00:43.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.630+0000 7f9562200640 1 -- 172.21.15.57:0/1590687649 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f955c15d4b0 con 0x7f955c15ae80 2024-03-27T10:00:43.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.631+0000 7f9562200640 1 -- 172.21.15.57:0/1590687649 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f955c068540 con 0x7f955c15ae80 2024-03-27T10:00:43.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.632+0000 7f9558c00640 1 -- 172.21.15.57:0/1590687649 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f9554048020 con 0x7f955c15ae80 2024-03-27T10:00:43.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.633+0000 7f9558c00640 1 --2- 172.21.15.57:0/1590687649 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f954006c530 0x7f954006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:43.622 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.633+0000 7f9558c00640 1 -- 172.21.15.57:0/1590687649 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f95540b0540 con 0x7f955c15ae80 2024-03-27T10:00:43.622 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.633+0000 7f9560e00640 1 --2- 172.21.15.57:0/1590687649 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f954006c530 0x7f954006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:43.622 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.634+0000 7f9560e00640 1 --2- 172.21.15.57:0/1590687649 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f954006c530 0x7f954006e9f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f9550001640 tx=0x7f9550009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:43.626 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.638+0000 7f9558c00640 1 -- 172.21.15.57:0/1590687649 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f955404f030 con 0x7f955c15ae80 2024-03-27T10:00:43.829 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.841+0000 7f9562200640 1 -- 172.21.15.57:0/1590687649 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f955c06d290 con 0x7f955c15ae80 2024-03-27T10:00:43.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.842+0000 7f9558c00640 1 -- 172.21.15.57:0/1590687649 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) ==== 103+0+11 (secure 0 0 0) 0x7f955c14bc60 con 0x7f955c15ae80 2024-03-27T10:00:43.831 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2024-03-27T10:00:43.833 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.844+0000 7f9562200640 1 -- 172.21.15.57:0/1590687649 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f954006c530 msgr2=0x7f954006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:43.833 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.844+0000 7f9562200640 1 --2- 172.21.15.57:0/1590687649 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f954006c530 0x7f954006e9f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f9550001640 tx=0x7f9550009040 comp rx=0 tx=0).stop 2024-03-27T10:00:43.833 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.844+0000 7f9562200640 1 -- 172.21.15.57:0/1590687649 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f955c15ae80 msgr2=0x7f955c15bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:43.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.844+0000 7f9562200640 1 --2- 172.21.15.57:0/1590687649 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f955c15ae80 0x7f955c15bf30 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f955400d2a0 tx=0x7f9554004a40 comp rx=0 tx=0).stop 2024-03-27T10:00:43.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.845+0000 7f9562200640 1 -- 172.21.15.57:0/1590687649 shutdown_connections 2024-03-27T10:00:43.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.845+0000 7f9562200640 1 --2- 172.21.15.57:0/1590687649 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f955c15ae80 0x7f955c15bf30 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:43.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.845+0000 7f9562200640 1 --2- 172.21.15.57:0/1590687649 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f954006c530 0x7f954006e9f0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:43.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.845+0000 7f9562200640 1 --2- 172.21.15.57:0/1590687649 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f955c0cd920 0x7f955c14b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:43.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.845+0000 7f9562200640 1 --2- 172.21.15.57:0/1590687649 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f955c06ef50 0x7f955c15ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:43.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.845+0000 7f9562200640 1 -- 172.21.15.57:0/1590687649 >> 172.21.15.57:0/1590687649 conn(0x7f955c0cfb40 msgr2=0x7f955c06dfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:43.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.845+0000 7f9562200640 1 -- 172.21.15.57:0/1590687649 shutdown_connections 2024-03-27T10:00:43.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:43.845+0000 7f9562200640 1 -- 172.21.15.57:0/1590687649 wait complete. 2024-03-27T10:00:43.853 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-27T10:00:44.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.087+0000 7f7673e00640 1 Processor -- start 2024-03-27T10:00:44.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.087+0000 7f7673e00640 1 -- start start 2024-03-27T10:00:44.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.089+0000 7f7673e00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f7674161830 0x7f76740cf970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:44.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.089+0000 7f7673e00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f76740cfeb0 0x7f76740d0780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:44.078 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.089+0000 7f7673e00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76740d2d90 con 0x7f76740d2820 2024-03-27T10:00:44.078 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.089+0000 7f7673e00640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f76740cf4e0 con 0x7f76740cfeb0 2024-03-27T10:00:44.078 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.089+0000 7f7673e00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f76740cee90 con 0x7f7674161830 2024-03-27T10:00:44.079 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.090+0000 7f7672000640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f76740cfeb0 0x7f76740d0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:44.079 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.090+0000 7f7672a00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f7674161830 0x7f76740cf970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:44.079 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.090+0000 7f7672000640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f76740cfeb0 0x7f76740d0780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44290/0 (socket says 172.21.15.57:44290) 2024-03-27T10:00:44.079 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.090+0000 7f7672000640 1 -- 172.21.15.57:0/2250671652 learned_addr learned my addr 172.21.15.57:0/2250671652 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:44.079 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.090+0000 7f7672000640 1 -- 172.21.15.57:0/2250671652 >> v2:172.21.15.118:3300/0 conn(0x7f7674161830 msgr2=0x7f76740cf970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:44.079 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.090+0000 7f7672000640 1 --2- 172.21.15.57:0/2250671652 >> v2:172.21.15.118:3300/0 conn(0x7f7674161830 0x7f76740cf970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:44.079 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.090+0000 7f7672000640 1 -- 172.21.15.57:0/2250671652 >> v1:172.21.15.118:6789/0 conn(0x7f76740d2820 legacy=0x7f76740c7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:44.079 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.090+0000 7f7672000640 1 -- 172.21.15.57:0/2250671652 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76740cf170 con 0x7f76740cfeb0 2024-03-27T10:00:44.080 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.091+0000 7f7672000640 1 --2- 172.21.15.57:0/2250671652 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f76740cfeb0 0x7f76740d0780 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f767408c2c0 tx=0x7f765c02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25367a8b227536a6 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:44.080 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.092+0000 7f7671600640 1 -- 172.21.15.57:0/2250671652 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f765c02ca80 con 0x7f76740cfeb0 2024-03-27T10:00:44.080 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.092+0000 7f7671600640 1 -- 172.21.15.57:0/2250671652 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f765c02cc20 con 0x7f76740cfeb0 2024-03-27T10:00:44.080 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.092+0000 7f7671600640 1 -- 172.21.15.57:0/2250671652 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f765c0343f0 con 0x7f76740cfeb0 2024-03-27T10:00:44.081 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.092+0000 7f7673e00640 1 -- 172.21.15.57:0/2250671652 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f76740cfeb0 msgr2=0x7f76740d0780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:44.081 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.092+0000 7f7673e00640 1 --2- 172.21.15.57:0/2250671652 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f76740cfeb0 0x7f76740d0780 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f767408c2c0 tx=0x7f765c02bee0 comp rx=0 tx=0).stop 2024-03-27T10:00:44.081 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.093+0000 7f7673e00640 1 -- 172.21.15.57:0/2250671652 shutdown_connections 2024-03-27T10:00:44.081 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.093+0000 7f7673e00640 1 --2- 172.21.15.57:0/2250671652 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f76740cfeb0 0x7f76740d0780 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:44.081 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.093+0000 7f7673e00640 1 --2- 172.21.15.57:0/2250671652 >> v2:172.21.15.118:3300/0 conn(0x7f7674161830 0x7f76740cf970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:44.081 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.093+0000 7f7673e00640 1 -- 172.21.15.57:0/2250671652 >> 172.21.15.57:0/2250671652 conn(0x7f76740d4030 msgr2=0x7f76740d4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:44.082 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.093+0000 7f7673e00640 1 -- 172.21.15.57:0/2250671652 shutdown_connections 2024-03-27T10:00:44.082 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.093+0000 7f7673e00640 1 -- 172.21.15.57:0/2250671652 wait complete. 2024-03-27T10:00:44.083 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.094+0000 7f7673e00640 1 Processor -- start 2024-03-27T10:00:44.083 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.095+0000 7f7673e00640 1 -- start start 2024-03-27T10:00:44.084 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.095+0000 7f7673e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f76740cfeb0 0x7f7674153070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:44.084 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.095+0000 7f7673e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f76740d2820 0x7f7674156170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:44.084 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.095+0000 7f7673e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7674161830 0x7f76741f7b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:44.084 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.095+0000 7f7673e00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f76740ce4b0 con 0x7f7674161830 2024-03-27T10:00:44.084 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.095+0000 7f7673e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f76740ce330 con 0x7f76740cfeb0 2024-03-27T10:00:44.084 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.095+0000 7f7673e00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f7674161c10 con 0x7f76740d2820 2024-03-27T10:00:44.084 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.096+0000 7f7673400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7674161830 0x7f76741f7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:44.085 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.096+0000 7f7673400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7674161830 0x7f76741f7b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44298/0 (socket says 172.21.15.57:44298) 2024-03-27T10:00:44.085 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.096+0000 7f7673400640 1 -- 172.21.15.57:0/972872718 learned_addr learned my addr 172.21.15.57:0/972872718 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:44.086 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.096+0000 7f7672a00640 1 --2- 172.21.15.57:0/972872718 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f76740cfeb0 0x7f7674153070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:44.086 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.096+0000 7f7673400640 1 -- 172.21.15.57:0/972872718 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f76740d2820 msgr2=0x7f7674156170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:44.086 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.096+0000 7f7673400640 1 --2- 172.21.15.57:0/972872718 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f76740d2820 0x7f7674156170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:44.086 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.096+0000 7f7673400640 1 -- 172.21.15.57:0/972872718 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f76740cfeb0 msgr2=0x7f7674153070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:44.086 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.096+0000 7f7673400640 1 --2- 172.21.15.57:0/972872718 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f76740cfeb0 0x7f7674153070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:44.086 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.096+0000 7f7673400640 1 -- 172.21.15.57:0/972872718 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7674156a10 con 0x7f7674161830 2024-03-27T10:00:44.086 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.097+0000 7f7673400640 1 --2- 172.21.15.57:0/972872718 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7674161830 0x7f76741f7b70 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f766c001eb0 tx=0x7f766c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:44.086 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.097+0000 7f766aa00640 1 -- 172.21.15.57:0/972872718 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f766c017070 con 0x7f7674161830 2024-03-27T10:00:44.087 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.097+0000 7f766aa00640 1 -- 172.21.15.57:0/972872718 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f766c0052d0 con 0x7f7674161830 2024-03-27T10:00:44.087 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.097+0000 7f766aa00640 1 -- 172.21.15.57:0/972872718 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f766c003830 con 0x7f7674161830 2024-03-27T10:00:44.087 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.097+0000 7f7673e00640 1 -- 172.21.15.57:0/972872718 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7674156cf0 con 0x7f7674161830 2024-03-27T10:00:44.087 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.097+0000 7f7673e00640 1 -- 172.21.15.57:0/972872718 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7674157c70 con 0x7f7674161830 2024-03-27T10:00:44.087 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.098+0000 7f7673e00640 1 -- 172.21.15.57:0/972872718 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7674068540 con 0x7f7674161830 2024-03-27T10:00:44.087 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.099+0000 7f766aa00640 1 -- 172.21.15.57:0/972872718 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f766c01a070 con 0x7f7674161830 2024-03-27T10:00:44.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.100+0000 7f766aa00640 1 --2- 172.21.15.57:0/972872718 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f765006c530 0x7f765006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:44.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.100+0000 7f766aa00640 1 -- 172.21.15.57:0/972872718 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f766c08ae90 con 0x7f7674161830 2024-03-27T10:00:44.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.100+0000 7f7672a00640 1 --2- 172.21.15.57:0/972872718 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f765006c530 0x7f765006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:44.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.101+0000 7f7672a00640 1 --2- 172.21.15.57:0/972872718 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f765006c530 0x7f765006e9f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7664009ad0 tx=0x7f7664008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:44.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.105+0000 7f766aa00640 1 -- 172.21.15.57:0/972872718 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f766c0590a0 con 0x7f7674161830 2024-03-27T10:00:44.311 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.323+0000 7f7673e00640 1 -- 172.21.15.57:0/972872718 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f767408d780 con 0x7f7674161830 2024-03-27T10:00:44.312 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.324+0000 7f766aa00640 1 -- 172.21.15.57:0/972872718 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) ==== 80+0+0 (secure 0 0 0) 0x7f766c0589a0 con 0x7f7674161830 2024-03-27T10:00:44.312 INFO:teuthology.orchestra.run.smithi057.stderr:listed 0 entries 2024-03-27T10:00:44.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.326+0000 7f7673e00640 1 -- 172.21.15.57:0/972872718 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f765006c530 msgr2=0x7f765006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:44.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.326+0000 7f7673e00640 1 --2- 172.21.15.57:0/972872718 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f765006c530 0x7f765006e9f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7664009ad0 tx=0x7f7664008040 comp rx=0 tx=0).stop 2024-03-27T10:00:44.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.326+0000 7f7673e00640 1 -- 172.21.15.57:0/972872718 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7674161830 msgr2=0x7f76741f7b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:44.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.326+0000 7f7673e00640 1 --2- 172.21.15.57:0/972872718 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7674161830 0x7f76741f7b70 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f766c001eb0 tx=0x7f766c00c890 comp rx=0 tx=0).stop 2024-03-27T10:00:44.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.327+0000 7f7673e00640 1 -- 172.21.15.57:0/972872718 shutdown_connections 2024-03-27T10:00:44.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.327+0000 7f7673e00640 1 --2- 172.21.15.57:0/972872718 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7674161830 0x7f76741f7b70 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:44.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.327+0000 7f7673e00640 1 --2- 172.21.15.57:0/972872718 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f76740d2820 0x7f7674156170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:44.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.327+0000 7f7673e00640 1 --2- 172.21.15.57:0/972872718 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f765006c530 0x7f765006e9f0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:44.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.327+0000 7f7673e00640 1 --2- 172.21.15.57:0/972872718 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f76740cfeb0 0x7f7674153070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:44.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.327+0000 7f7673e00640 1 -- 172.21.15.57:0/972872718 >> 172.21.15.57:0/972872718 conn(0x7f76740d4030 msgr2=0x7f76740cd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:44.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.327+0000 7f7673e00640 1 -- 172.21.15.57:0/972872718 shutdown_connections 2024-03-27T10:00:44.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.327+0000 7f7673e00640 1 -- 172.21.15.57:0/972872718 wait complete. 2024-03-27T10:00:44.336 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-03-27T10:00:44.336 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-27T10:00:44.390 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-27T10:00:44.615 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.626+0000 7fe99c600640 1 Processor -- start 2024-03-27T10:00:44.615 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.627+0000 7fe99c600640 1 -- start start 2024-03-27T10:00:44.617 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.628+0000 7fe99c600640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe99406b7a0 0x7fe99415f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:44.617 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.628+0000 7fe99c600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe9940cd330 0x7fe9940cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:44.617 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.628+0000 7fe99c600640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe99415eb00 con 0x7fe99406bb80 2024-03-27T10:00:44.617 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.628+0000 7fe99c600640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7fe99406dc70 con 0x7fe99406b7a0 2024-03-27T10:00:44.617 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.628+0000 7fe99c600640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fe99406df50 con 0x7fe9940cd330 2024-03-27T10:00:44.617 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.629+0000 7fe999c00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe99406b7a0 0x7fe99415f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:44.617 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.629+0000 7fe999c00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe99406b7a0 0x7fe99415f5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44308/0 (socket says 172.21.15.57:44308) 2024-03-27T10:00:44.617 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.629+0000 7fe999c00640 1 -- 172.21.15.57:0/546833157 learned_addr learned my addr 172.21.15.57:0/546833157 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:44.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.629+0000 7fe99a600640 1 --2- 172.21.15.57:0/546833157 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe9940cd330 0x7fe9940cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:44.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.629+0000 7fe999c00640 1 -- 172.21.15.57:0/546833157 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe9940cd330 msgr2=0x7fe9940cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:44.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.629+0000 7fe999c00640 1 --2- 172.21.15.57:0/546833157 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe9940cd330 0x7fe9940cd7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:44.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.629+0000 7fe999c00640 1 -- 172.21.15.57:0/546833157 >> v1:172.21.15.118:6789/0 conn(0x7fe99406bb80 legacy=0x7fe99406d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:44.619 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.629+0000 7fe999c00640 1 -- 172.21.15.57:0/546833157 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe99415edc0 con 0x7fe99406b7a0 2024-03-27T10:00:44.619 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.629+0000 7fe99a600640 1 --2- 172.21.15.57:0/546833157 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe9940cd330 0x7fe9940cd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T10:00:44.619 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.630+0000 7fe999c00640 1 --2- 172.21.15.57:0/546833157 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe99406b7a0 0x7fe99415f5c0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fe988009870 tx=0x7fe98802b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79a8d1630df3f4a7 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:44.619 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.631+0000 7fe993e00640 1 -- 172.21.15.57:0/546833157 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9880317c0 con 0x7fe99406b7a0 2024-03-27T10:00:44.620 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.631+0000 7fe993e00640 1 -- 172.21.15.57:0/546833157 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe988037070 con 0x7fe99406b7a0 2024-03-27T10:00:44.620 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.631+0000 7fe993e00640 1 -- 172.21.15.57:0/546833157 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe988031b80 con 0x7fe99406b7a0 2024-03-27T10:00:44.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.632+0000 7fe99c600640 1 -- 172.21.15.57:0/546833157 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe99406b7a0 msgr2=0x7fe99415f5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:44.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.632+0000 7fe99c600640 1 --2- 172.21.15.57:0/546833157 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe99406b7a0 0x7fe99415f5c0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fe988009870 tx=0x7fe98802b860 comp rx=0 tx=0).stop 2024-03-27T10:00:44.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.632+0000 7fe99c600640 1 -- 172.21.15.57:0/546833157 shutdown_connections 2024-03-27T10:00:44.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.632+0000 7fe99c600640 1 --2- 172.21.15.57:0/546833157 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe9940cd330 0x7fe9940cd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:44.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.632+0000 7fe99c600640 1 --2- 172.21.15.57:0/546833157 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe99406b7a0 0x7fe99415f5c0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:44.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.632+0000 7fe99c600640 1 -- 172.21.15.57:0/546833157 >> 172.21.15.57:0/546833157 conn(0x7fe9940b1c60 msgr2=0x7fe9940b2070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:44.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.632+0000 7fe99c600640 1 -- 172.21.15.57:0/546833157 shutdown_connections 2024-03-27T10:00:44.622 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.632+0000 7fe99c600640 1 -- 172.21.15.57:0/546833157 wait complete. 2024-03-27T10:00:44.622 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.634+0000 7fe99c600640 1 Processor -- start 2024-03-27T10:00:44.622 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.634+0000 7fe99c600640 1 -- start start 2024-03-27T10:00:44.624 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.635+0000 7fe99c600640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe99406b7a0 0x7fe99413d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:44.624 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.636+0000 7fe99c600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe99406bb80 0x7fe994140060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:44.624 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.636+0000 7fe99c600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe9940cd330 0x7fe99415be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:44.624 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.636+0000 7fe99c600640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fe99406bfd0 con 0x7fe99406b7a0 2024-03-27T10:00:44.624 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.636+0000 7fe99c600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fe9940726b0 con 0x7fe99406bb80 2024-03-27T10:00:44.624 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.636+0000 7fe99c600640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fe99406c150 con 0x7fe9940cd330 2024-03-27T10:00:44.626 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.636+0000 7fe999c00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe99406b7a0 0x7fe99413d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:44.626 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.636+0000 7fe999c00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe99406b7a0 0x7fe99413d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44314/0 (socket says 172.21.15.57:44314) 2024-03-27T10:00:44.626 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.636+0000 7fe999c00640 1 -- 172.21.15.57:0/485028449 learned_addr learned my addr 172.21.15.57:0/485028449 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:44.626 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.636+0000 7fe999200640 1 --2- 172.21.15.57:0/485028449 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe99406bb80 0x7fe994140060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:44.626 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.636+0000 7fe99a600640 1 --2- 172.21.15.57:0/485028449 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe9940cd330 0x7fe99415be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:44.626 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.637+0000 7fe999c00640 1 -- 172.21.15.57:0/485028449 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe9940cd330 msgr2=0x7fe99415be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:44.626 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.637+0000 7fe999c00640 1 --2- 172.21.15.57:0/485028449 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe9940cd330 0x7fe99415be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:44.626 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.637+0000 7fe999c00640 1 -- 172.21.15.57:0/485028449 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe99406bb80 msgr2=0x7fe994140060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:44.626 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.637+0000 7fe999c00640 1 --2- 172.21.15.57:0/485028449 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe99406bb80 0x7fe994140060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:44.626 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.637+0000 7fe999c00640 1 -- 172.21.15.57:0/485028449 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe99413c3c0 con 0x7fe99406b7a0 2024-03-27T10:00:44.627 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.637+0000 7fe99a600640 1 --2- 172.21.15.57:0/485028449 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe9940cd330 0x7fe99415be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T10:00:44.627 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.637+0000 7fe999c00640 1 --2- 172.21.15.57:0/485028449 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe99406b7a0 0x7fe99413d460 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fe988000c00 tx=0x7fe9880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:44.627 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.637+0000 7fe991600640 1 -- 172.21.15.57:0/485028449 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe988032860 con 0x7fe99406b7a0 2024-03-27T10:00:44.627 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.637+0000 7fe991600640 1 -- 172.21.15.57:0/485028449 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe988032a00 con 0x7fe99406b7a0 2024-03-27T10:00:44.627 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.637+0000 7fe991600640 1 -- 172.21.15.57:0/485028449 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe988032df0 con 0x7fe99406b7a0 2024-03-27T10:00:44.627 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.637+0000 7fe99c600640 1 -- 172.21.15.57:0/485028449 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe99413c6a0 con 0x7fe99406b7a0 2024-03-27T10:00:44.627 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.638+0000 7fe99c600640 1 -- 172.21.15.57:0/485028449 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe99413cc60 con 0x7fe99406b7a0 2024-03-27T10:00:44.627 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.639+0000 7fe99c600640 1 -- 172.21.15.57:0/485028449 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe994068620 con 0x7fe99406b7a0 2024-03-27T10:00:44.628 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.640+0000 7fe991600640 1 -- 172.21.15.57:0/485028449 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fe98804c060 con 0x7fe99406b7a0 2024-03-27T10:00:44.629 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.641+0000 7fe991600640 1 --2- 172.21.15.57:0/485028449 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fe97406c530 0x7fe97406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:44.629 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.641+0000 7fe991600640 1 -- 172.21.15.57:0/485028449 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fe9880ad670 con 0x7fe99406b7a0 2024-03-27T10:00:44.629 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.641+0000 7fe999200640 1 --2- 172.21.15.57:0/485028449 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fe97406c530 0x7fe97406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:44.630 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.642+0000 7fe999200640 1 --2- 172.21.15.57:0/485028449 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fe97406c530 0x7fe97406e9f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe99413ba70 tx=0x7fe980007e30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:44.633 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.645+0000 7fe991600640 1 -- 172.21.15.57:0/485028449 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7fe988040070 con 0x7fe99406b7a0 2024-03-27T10:00:44.839 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.850+0000 7fe99c600640 1 -- 172.21.15.57:0/485028449 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe994072030 con 0x7fe99406b7a0 2024-03-27T10:00:44.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.854+0000 7fe991600640 1 -- 172.21.15.57:0/485028449 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) ==== 74+0+18888 (secure 0 0 0) 0x7fe98807b7f0 con 0x7fe99406b7a0 2024-03-27T10:00:44.843 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:00:44.843 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":28,"fsid":"7ac43f86-2c16-4a97-98fb-715d3cebc75c","created":"2024-03-27T09:59:04.033417+0000","modified":"2024-03-27T10:00:10.462391+0000","last_up_change":"2024-03-27T09:59:16.969624+0000","last_in_change":"2024-03-27T09:59:07.421690+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-27T09:59:17.253008+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-27T09:59:26.690365+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-27T09:59:27.559059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-27T09:59:31.187596+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"47b44362-7302-4f2a-b735-582c6c3850cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6801","nonce":2020036298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6803","nonce":2020036298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6807","nonce":2020036298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6805","nonce":2020036298}]},"public_addr":"172.21.15.57:6801/2020036298","cluster_addr":"172.21.15.57:6803/2020036298","heartbeat_back_addr":"172.21.15.57:6807/2020036298","heartbeat_front_addr":"172.21.15.57:6805/2020036298","state":["exists","up"]},{"osd":1,"uuid":"feaf96f0-9431-4188-9a09-da505b40e934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6809","nonce":3190929242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6811","nonce":3190929242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6815","nonce":3190929242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6813","nonce":3190929242}]},"public_addr":"172.21.15.57:6809/3190929242","cluster_addr":"172.21.15.57:6811/3190929242","heartbeat_back_addr":"172.21.15.57:6815/3190929242","heartbeat_front_addr":"172.21.15.57:6813/3190929242","state":["exists","up"]},{"osd":2,"uuid":"21e406e6-cfbc-4fe7-a816-e2420487c95d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6817","nonce":4065849973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6819","nonce":4065849973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6823","nonce":4065849973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6821","nonce":4065849973}]},"public_addr":"172.21.15.57:6817/4065849973","cluster_addr":"172.21.15.57:6819/4065849973","heartbeat_back_addr":"172.21.15.57:6823/4065849973","heartbeat_front_addr":"172.21.15.57:6821/4065849973","state":["exists","up"]},{"osd":3,"uuid":"a389af1d-76c4-4dfc-b215-f983f4931257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6825","nonce":158084809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6827","nonce":158084809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6831","nonce":158084809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6829","nonce":158084809}]},"public_addr":"172.21.15.57:6825/158084809","cluster_addr":"172.21.15.57:6827/158084809","heartbeat_back_addr":"172.21.15.57:6831/158084809","heartbeat_front_addr":"172.21.15.57:6829/158084809","state":["exists","up"]},{"osd":4,"uuid":"e9b05dca-557a-43ee-b43f-9ce5b7d28304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6823","nonce":108719401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6827","nonce":108719401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6831","nonce":108719401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6829","nonce":108719401}]},"public_addr":"172.21.15.118:6823/108719401","cluster_addr":"172.21.15.118:6827/108719401","heartbeat_back_addr":"172.21.15.118:6831/108719401","heartbeat_front_addr":"172.21.15.118:6829/108719401","state":["exists","up"]},{"osd":5,"uuid":"d968177d-44ff-499a-b00a-b147ed879253","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6817","nonce":2704605866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6819","nonce":2704605866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6826","nonce":2704605866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6822","nonce":2704605866}]},"public_addr":"172.21.15.118:6817/2704605866","cluster_addr":"172.21.15.118:6819/2704605866","heartbeat_back_addr":"172.21.15.118:6826/2704605866","heartbeat_front_addr":"172.21.15.118:6822/2704605866","state":["exists","up"]},{"osd":6,"uuid":"e8f98052-e6ad-4cfe-a4a9-0b17a434d54e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6801","nonce":1963659095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6803","nonce":1963659095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6807","nonce":1963659095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6805","nonce":1963659095}]},"public_addr":"172.21.15.118:6801/1963659095","cluster_addr":"172.21.15.118:6803/1963659095","heartbeat_back_addr":"172.21.15.118:6807/1963659095","heartbeat_front_addr":"172.21.15.118:6805/1963659095","state":["exists","up"]},{"osd":7,"uuid":"eccff987-8e51-4a63-845a-cf0a3196d7fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6809","nonce":1955879596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6811","nonce":1955879596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6815","nonce":1955879596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6813","nonce":1955879596}]},"public_addr":"172.21.15.118:6809/1955879596","cluster_addr":"172.21.15.118:6811/1955879596","heartbeat_back_addr":"172.21.15.118:6815/1955879596","heartbeat_front_addr":"172.21.15.118:6813/1955879596","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.721258+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.696610+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.777895+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.806769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.743259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.845687+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:13.020165+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.722294+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.e","mappings":[{"from":7,"to":1}]},{"pgid":"3.15","mappings":[{"from":3,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-27T10:00:44.845 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.857+0000 7fe99c600640 1 -- 172.21.15.57:0/485028449 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fe97406c530 msgr2=0x7fe97406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:44.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.857+0000 7fe99c600640 1 --2- 172.21.15.57:0/485028449 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fe97406c530 0x7fe97406e9f0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe99413ba70 tx=0x7fe980007e30 comp rx=0 tx=0).stop 2024-03-27T10:00:44.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.857+0000 7fe99c600640 1 -- 172.21.15.57:0/485028449 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe99406b7a0 msgr2=0x7fe99413d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:44.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.857+0000 7fe99c600640 1 --2- 172.21.15.57:0/485028449 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe99406b7a0 0x7fe99413d460 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fe988000c00 tx=0x7fe9880046c0 comp rx=0 tx=0).stop 2024-03-27T10:00:44.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.857+0000 7fe99c600640 1 -- 172.21.15.57:0/485028449 shutdown_connections 2024-03-27T10:00:44.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.857+0000 7fe99c600640 1 --2- 172.21.15.57:0/485028449 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe9940cd330 0x7fe99415be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:44.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.857+0000 7fe99c600640 1 --2- 172.21.15.57:0/485028449 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fe97406c530 0x7fe97406e9f0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:44.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.857+0000 7fe99c600640 1 --2- 172.21.15.57:0/485028449 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe99406bb80 0x7fe994140060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:44.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.857+0000 7fe99c600640 1 --2- 172.21.15.57:0/485028449 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe99406b7a0 0x7fe99413d460 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:44.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.857+0000 7fe99c600640 1 -- 172.21.15.57:0/485028449 >> 172.21.15.57:0/485028449 conn(0x7fe9940b1c60 msgr2=0x7fe9940b0da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:44.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.857+0000 7fe99c600640 1 -- 172.21.15.57:0/485028449 shutdown_connections 2024-03-27T10:00:44.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:44.857+0000 7fe99c600640 1 -- 172.21.15.57:0/485028449 wait complete. 2024-03-27T10:00:44.865 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-27T09:59:17.253008+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-27T09:59:26.690365+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-27T09:59:27.559059+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-27T09:59:31.187596+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-27T10:00:44.866 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-27T10:00:45.097 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.109+0000 7f437e600640 1 Processor -- start 2024-03-27T10:00:45.098 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.109+0000 7f437e600640 1 -- start start 2024-03-27T10:00:45.099 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.111+0000 7f437e600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f437815afd0 0x7f4378071f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:45.099 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.111+0000 7f437e600640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f437815b3b0 0x7f43780724b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:45.099 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.111+0000 7f437e600640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43780ae520 con 0x7f43780711b0 2024-03-27T10:00:45.100 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.111+0000 7f437e600640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f43780ae800 con 0x7f437815b3b0 2024-03-27T10:00:45.100 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.111+0000 7f437e600640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f43780aeae0 con 0x7f437815afd0 2024-03-27T10:00:45.100 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.111+0000 7f4376a00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f437815b3b0 0x7f43780724b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:45.100 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.111+0000 7f4376a00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f437815b3b0 0x7f43780724b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44322/0 (socket says 172.21.15.57:44322) 2024-03-27T10:00:45.100 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.111+0000 7f4376a00640 1 -- 172.21.15.57:0/3381497928 learned_addr learned my addr 172.21.15.57:0/3381497928 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:45.100 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.112+0000 7f4376a00640 1 -- 172.21.15.57:0/3381497928 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f437815afd0 msgr2=0x7f4378071f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:45.100 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.112+0000 7f4376a00640 1 --2- 172.21.15.57:0/3381497928 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f437815afd0 0x7f4378071f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:45.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.112+0000 7f4376a00640 1 -- 172.21.15.57:0/3381497928 >> v1:172.21.15.118:6789/0 conn(0x7f43780711b0 legacy=0x7f43780715d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:45.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.112+0000 7f4376a00640 1 -- 172.21.15.57:0/3381497928 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43780aedc0 con 0x7f437815b3b0 2024-03-27T10:00:45.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.113+0000 7f4376a00640 1 --2- 172.21.15.57:0/3381497928 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f437815b3b0 0x7f43780724b0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f436400bb10 tx=0x7f436402e150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61d009233ad139b1 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:45.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.113+0000 7f4376000640 1 -- 172.21.15.57:0/3381497928 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f436403b070 con 0x7f437815b3b0 2024-03-27T10:00:45.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.113+0000 7f4376000640 1 -- 172.21.15.57:0/3381497928 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4364036440 con 0x7f437815b3b0 2024-03-27T10:00:45.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.113+0000 7f4376000640 1 -- 172.21.15.57:0/3381497928 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4364036810 con 0x7f437815b3b0 2024-03-27T10:00:45.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.114+0000 7f437e600640 1 -- 172.21.15.57:0/3381497928 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f437815b3b0 msgr2=0x7f43780724b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:45.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.114+0000 7f437e600640 1 --2- 172.21.15.57:0/3381497928 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f437815b3b0 0x7f43780724b0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f436400bb10 tx=0x7f436402e150 comp rx=0 tx=0).stop 2024-03-27T10:00:45.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.114+0000 7f437e600640 1 -- 172.21.15.57:0/3381497928 shutdown_connections 2024-03-27T10:00:45.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.114+0000 7f437e600640 1 --2- 172.21.15.57:0/3381497928 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f437815b3b0 0x7f43780724b0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:45.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.114+0000 7f437e600640 1 --2- 172.21.15.57:0/3381497928 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f437815afd0 0x7f4378071f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:45.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.114+0000 7f437e600640 1 -- 172.21.15.57:0/3381497928 >> 172.21.15.57:0/3381497928 conn(0x7f43780b18a0 msgr2=0x7f43780b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:45.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.114+0000 7f437e600640 1 -- 172.21.15.57:0/3381497928 shutdown_connections 2024-03-27T10:00:45.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.114+0000 7f437e600640 1 -- 172.21.15.57:0/3381497928 wait complete. 2024-03-27T10:00:45.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.116+0000 7f437e600640 1 Processor -- start 2024-03-27T10:00:45.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.116+0000 7f437e600640 1 -- start start 2024-03-27T10:00:45.106 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.117+0000 7f437e600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f43780711b0 0x7f4378149fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:45.106 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.117+0000 7f437e600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f437815afd0 0x7f4378146ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:45.106 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.117+0000 7f437e600640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f437815b3b0 0x7f4378147670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:45.106 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.117+0000 7f437e600640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f437806db90 con 0x7f437815b3b0 2024-03-27T10:00:45.106 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.117+0000 7f437e600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f437806da10 con 0x7f437815afd0 2024-03-27T10:00:45.106 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.117+0000 7f437e600640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f437806dd10 con 0x7f43780711b0 2024-03-27T10:00:45.106 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.117+0000 7f4377e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f437815b3b0 0x7f4378147670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:45.106 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.117+0000 7f4377e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f437815b3b0 0x7f4378147670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44328/0 (socket says 172.21.15.57:44328) 2024-03-27T10:00:45.106 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.117+0000 7f4377e00640 1 -- 172.21.15.57:0/3934671183 learned_addr learned my addr 172.21.15.57:0/3934671183 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:45.106 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.118+0000 7f4377400640 1 --2- 172.21.15.57:0/3934671183 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f43780711b0 0x7f4378149fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:45.108 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.118+0000 7f4376a00640 1 --2- 172.21.15.57:0/3934671183 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f437815afd0 0x7f4378146ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:45.108 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.118+0000 7f4377e00640 1 -- 172.21.15.57:0/3934671183 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f43780711b0 msgr2=0x7f4378149fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:45.108 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.118+0000 7f4377e00640 1 --2- 172.21.15.57:0/3934671183 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f43780711b0 0x7f4378149fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:45.108 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.118+0000 7f4377e00640 1 -- 172.21.15.57:0/3934671183 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f437815afd0 msgr2=0x7f4378146ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:45.108 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.118+0000 7f4377e00640 1 --2- 172.21.15.57:0/3934671183 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f437815afd0 0x7f4378146ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:45.108 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.118+0000 7f4377e00640 1 -- 172.21.15.57:0/3934671183 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4378158990 con 0x7f437815b3b0 2024-03-27T10:00:45.108 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.118+0000 7f4376a00640 1 --2- 172.21.15.57:0/3934671183 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f437815afd0 0x7f4378146ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T10:00:45.108 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.118+0000 7f4377e00640 1 --2- 172.21.15.57:0/3934671183 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f437815b3b0 0x7f4378147670 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f437000c780 tx=0x7f437000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:45.108 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.118+0000 7f436f400640 1 -- 172.21.15.57:0/3934671183 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4370004b60 con 0x7f437815b3b0 2024-03-27T10:00:45.108 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.119+0000 7f436f400640 1 -- 172.21.15.57:0/3934671183 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4370004d00 con 0x7f437815b3b0 2024-03-27T10:00:45.108 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.119+0000 7f436f400640 1 -- 172.21.15.57:0/3934671183 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f437000aa90 con 0x7f437815b3b0 2024-03-27T10:00:45.108 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.119+0000 7f437e600640 1 -- 172.21.15.57:0/3934671183 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4378158c70 con 0x7f437815b3b0 2024-03-27T10:00:45.108 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.119+0000 7f437e600640 1 -- 172.21.15.57:0/3934671183 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4378159230 con 0x7f437815b3b0 2024-03-27T10:00:45.109 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.120+0000 7f437e600640 1 -- 172.21.15.57:0/3934671183 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43780757d0 con 0x7f437815b3b0 2024-03-27T10:00:45.109 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.121+0000 7f436f400640 1 -- 172.21.15.57:0/3934671183 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f437000ac30 con 0x7f437815b3b0 2024-03-27T10:00:45.110 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.122+0000 7f436f400640 1 --2- 172.21.15.57:0/3934671183 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f435806c530 0x7f435806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:45.110 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.122+0000 7f436f400640 1 -- 172.21.15.57:0/3934671183 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f437008bdd0 con 0x7f437815b3b0 2024-03-27T10:00:45.110 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.122+0000 7f4377400640 1 --2- 172.21.15.57:0/3934671183 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f435806c530 0x7f435806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:45.111 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.123+0000 7f4377400640 1 --2- 172.21.15.57:0/3934671183 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f435806c530 0x7f435806e9f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4368009890 tx=0x7f4368008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:45.115 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.127+0000 7f436f400640 1 -- 172.21.15.57:0/3934671183 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f4370020070 con 0x7f437815b3b0 2024-03-27T10:00:45.325 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.336+0000 7f437e600640 1 -- 172.21.15.57:0/3934671183 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f4378068540 con 0x7f437815b3b0 2024-03-27T10:00:45.325 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.337+0000 7f436f400640 1 -- 172.21.15.57:0/3934671183 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) ==== 93+0+10 (secure 0 0 0) 0x7f437005ee20 con 0x7f437815b3b0 2024-03-27T10:00:45.326 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2024-03-27T10:00:45.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.340+0000 7f437e600640 1 -- 172.21.15.57:0/3934671183 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f435806c530 msgr2=0x7f435806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:45.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.340+0000 7f437e600640 1 --2- 172.21.15.57:0/3934671183 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f435806c530 0x7f435806e9f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4368009890 tx=0x7f4368008040 comp rx=0 tx=0).stop 2024-03-27T10:00:45.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.341+0000 7f437e600640 1 -- 172.21.15.57:0/3934671183 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f437815b3b0 msgr2=0x7f4378147670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:45.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.341+0000 7f437e600640 1 --2- 172.21.15.57:0/3934671183 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f437815b3b0 0x7f4378147670 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f437000c780 tx=0x7f437000cc40 comp rx=0 tx=0).stop 2024-03-27T10:00:45.330 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.341+0000 7f437e600640 1 -- 172.21.15.57:0/3934671183 shutdown_connections 2024-03-27T10:00:45.330 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.341+0000 7f437e600640 1 --2- 172.21.15.57:0/3934671183 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f437815b3b0 0x7f4378147670 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:45.330 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.341+0000 7f437e600640 1 --2- 172.21.15.57:0/3934671183 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f435806c530 0x7f435806e9f0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:45.330 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.341+0000 7f437e600640 1 --2- 172.21.15.57:0/3934671183 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f437815afd0 0x7f4378146ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:45.330 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.341+0000 7f437e600640 1 --2- 172.21.15.57:0/3934671183 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f43780711b0 0x7f4378149fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:45.330 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.341+0000 7f437e600640 1 -- 172.21.15.57:0/3934671183 >> 172.21.15.57:0/3934671183 conn(0x7f43780b18a0 msgr2=0x7f43780b1c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:45.330 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.341+0000 7f437e600640 1 -- 172.21.15.57:0/3934671183 shutdown_connections 2024-03-27T10:00:45.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.342+0000 7f437e600640 1 -- 172.21.15.57:0/3934671183 wait complete. 2024-03-27T10:00:45.349 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-27T10:00:45.572 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.583+0000 7f3155600640 1 Processor -- start 2024-03-27T10:00:45.573 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.584+0000 7f3155600640 1 -- start start 2024-03-27T10:00:45.573 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.585+0000 7f3155600640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f31501458e0 0x7f315006d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:45.574 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.585+0000 7f3155600640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f315015ff20 0x7f31500cb800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:45.574 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.585+0000 7f3155600640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31500cbd40 con 0x7f315015fa90 2024-03-27T10:00:45.574 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.585+0000 7f3155600640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f31500ca330 con 0x7f315015ff20 2024-03-27T10:00:45.574 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.585+0000 7f3155600640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f31500ca610 con 0x7f31501458e0 2024-03-27T10:00:45.575 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.586+0000 7f3154c00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f315015ff20 0x7f31500cb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:45.575 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.586+0000 7f3154c00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f315015ff20 0x7f31500cb800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44338/0 (socket says 172.21.15.57:44338) 2024-03-27T10:00:45.575 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.586+0000 7f3154c00640 1 -- 172.21.15.57:0/1649336079 learned_addr learned my addr 172.21.15.57:0/1649336079 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:45.575 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.586+0000 7f314fe00640 1 --2- 172.21.15.57:0/1649336079 >> v2:172.21.15.118:3300/0 conn(0x7f31501458e0 0x7f315006d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:45.575 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.586+0000 7f3154c00640 1 -- 172.21.15.57:0/1649336079 >> v2:172.21.15.118:3300/0 conn(0x7f31501458e0 msgr2=0x7f315006d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:45.575 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.586+0000 7f3154c00640 1 --2- 172.21.15.57:0/1649336079 >> v2:172.21.15.118:3300/0 conn(0x7f31501458e0 0x7f315006d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:45.575 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.586+0000 7f3154c00640 1 -- 172.21.15.57:0/1649336079 >> v1:172.21.15.118:6789/0 conn(0x7f315015fa90 legacy=0x7f31500cb0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:45.576 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.586+0000 7f3154c00640 1 -- 172.21.15.57:0/1649336079 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31500ca8f0 con 0x7f315015ff20 2024-03-27T10:00:45.576 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.587+0000 7f3154c00640 1 --2- 172.21.15.57:0/1649336079 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f315015ff20 0x7f31500cb800 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f31500508d0 tx=0x7f314802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f506b8bac47ce487 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:45.576 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.588+0000 7f314f400640 1 -- 172.21.15.57:0/1649336079 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f314802ca80 con 0x7f315015ff20 2024-03-27T10:00:45.576 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.588+0000 7f314f400640 1 -- 172.21.15.57:0/1649336079 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f314802cc20 con 0x7f315015ff20 2024-03-27T10:00:45.576 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.588+0000 7f314f400640 1 -- 172.21.15.57:0/1649336079 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31480343f0 con 0x7f315015ff20 2024-03-27T10:00:45.577 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.589+0000 7f3155600640 1 -- 172.21.15.57:0/1649336079 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f315015ff20 msgr2=0x7f31500cb800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:45.577 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.589+0000 7f3155600640 1 --2- 172.21.15.57:0/1649336079 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f315015ff20 0x7f31500cb800 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f31500508d0 tx=0x7f314802bee0 comp rx=0 tx=0).stop 2024-03-27T10:00:45.577 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.589+0000 7f3155600640 1 -- 172.21.15.57:0/1649336079 shutdown_connections 2024-03-27T10:00:45.578 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.589+0000 7f3155600640 1 --2- 172.21.15.57:0/1649336079 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f315015ff20 0x7f31500cb800 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:45.578 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.589+0000 7f3155600640 1 --2- 172.21.15.57:0/1649336079 >> v2:172.21.15.118:3300/0 conn(0x7f31501458e0 0x7f315006d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:45.578 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.589+0000 7f3155600640 1 -- 172.21.15.57:0/1649336079 >> 172.21.15.57:0/1649336079 conn(0x7f31500cfb40 msgr2=0x7f31500cff20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:45.578 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.589+0000 7f3155600640 1 -- 172.21.15.57:0/1649336079 shutdown_connections 2024-03-27T10:00:45.578 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.589+0000 7f3155600640 1 -- 172.21.15.57:0/1649336079 wait complete. 2024-03-27T10:00:45.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.591+0000 7f3155600640 1 Processor -- start 2024-03-27T10:00:45.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.591+0000 7f3155600640 1 -- start start 2024-03-27T10:00:45.581 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.592+0000 7f3155600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f31501458e0 0x7f3150156560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:45.581 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.592+0000 7f3155600640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f315015fa90 0x7f3150138450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:45.581 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.592+0000 7f3155600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f315015ff20 0x7f315015c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:45.581 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.592+0000 7f3155600640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f31500ce720 con 0x7f315015fa90 2024-03-27T10:00:45.581 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.592+0000 7f3155600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f3150160330 con 0x7f31501458e0 2024-03-27T10:00:45.581 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.592+0000 7f3155600640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f31500ce8a0 con 0x7f315015ff20 2024-03-27T10:00:45.581 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.592+0000 7f3147e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f315015fa90 0x7f3150138450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:45.581 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.592+0000 7f3147e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f315015fa90 0x7f3150138450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44352/0 (socket says 172.21.15.57:44352) 2024-03-27T10:00:45.582 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.592+0000 7f3147e00640 1 -- 172.21.15.57:0/1722739880 learned_addr learned my addr 172.21.15.57:0/1722739880 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:45.582 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.592+0000 7f314fe00640 1 --2- 172.21.15.57:0/1722739880 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f31501458e0 0x7f3150156560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:45.582 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.592+0000 7f3154c00640 1 --2- 172.21.15.57:0/1722739880 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f315015ff20 0x7f315015c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:45.582 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.592+0000 7f3147e00640 1 -- 172.21.15.57:0/1722739880 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f315015ff20 msgr2=0x7f315015c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:45.582 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.592+0000 7f3147e00640 1 --2- 172.21.15.57:0/1722739880 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f315015ff20 0x7f315015c3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:45.582 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.593+0000 7f3147e00640 1 -- 172.21.15.57:0/1722739880 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f31501458e0 msgr2=0x7f3150156560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:45.582 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.593+0000 7f3147e00640 1 --2- 172.21.15.57:0/1722739880 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f31501458e0 0x7f3150156560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:45.582 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.593+0000 7f3147e00640 1 -- 172.21.15.57:0/1722739880 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31500c6490 con 0x7f315015fa90 2024-03-27T10:00:45.583 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.593+0000 7f3147e00640 1 --2- 172.21.15.57:0/1722739880 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f315015fa90 0x7f3150138450 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f313800c430 tx=0x7f313800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:45.583 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.593+0000 7f314cc00640 1 -- 172.21.15.57:0/1722739880 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3138011790 con 0x7f315015fa90 2024-03-27T10:00:45.583 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.593+0000 7f314cc00640 1 -- 172.21.15.57:0/1722739880 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3138017070 con 0x7f315015fa90 2024-03-27T10:00:45.583 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.593+0000 7f3155600640 1 -- 172.21.15.57:0/1722739880 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31500c53f0 con 0x7f315015fa90 2024-03-27T10:00:45.583 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.593+0000 7f314cc00640 1 -- 172.21.15.57:0/1722739880 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3138011bb0 con 0x7f315015fa90 2024-03-27T10:00:45.584 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.593+0000 7f3155600640 1 -- 172.21.15.57:0/1722739880 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31500c59b0 con 0x7f315015fa90 2024-03-27T10:00:45.584 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.594+0000 7f3155600640 1 -- 172.21.15.57:0/1722739880 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3150068540 con 0x7f315015fa90 2024-03-27T10:00:45.584 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.595+0000 7f314cc00640 1 -- 172.21.15.57:0/1722739880 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f313801c460 con 0x7f315015fa90 2024-03-27T10:00:45.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.596+0000 7f314cc00640 1 --2- 172.21.15.57:0/1722739880 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f312c06c530 0x7f312c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:45.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.596+0000 7f314cc00640 1 -- 172.21.15.57:0/1722739880 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f313808ba90 con 0x7f315015fa90 2024-03-27T10:00:45.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.597+0000 7f314fe00640 1 --2- 172.21.15.57:0/1722739880 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f312c06c530 0x7f312c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:45.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.597+0000 7f314fe00640 1 --2- 172.21.15.57:0/1722739880 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f312c06c530 0x7f312c06e9f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f3140006fd0 tx=0x7f3140008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:45.589 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.601+0000 7f314cc00640 1 -- 172.21.15.57:0/1722739880 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f3138059c10 con 0x7f315015fa90 2024-03-27T10:00:45.796 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.808+0000 7f3155600640 1 -- 172.21.15.57:0/1722739880 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f31500cf490 con 0x7f315015fa90 2024-03-27T10:00:45.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.809+0000 7f314cc00640 1 -- 172.21.15.57:0/1722739880 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) ==== 104+0+11 (secure 0 0 0) 0x7f3138059510 con 0x7f315015fa90 2024-03-27T10:00:45.797 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2024-03-27T10:00:45.800 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.811+0000 7f3155600640 1 -- 172.21.15.57:0/1722739880 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f312c06c530 msgr2=0x7f312c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:45.800 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.811+0000 7f3155600640 1 --2- 172.21.15.57:0/1722739880 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f312c06c530 0x7f312c06e9f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f3140006fd0 tx=0x7f3140008040 comp rx=0 tx=0).stop 2024-03-27T10:00:45.800 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.811+0000 7f3155600640 1 -- 172.21.15.57:0/1722739880 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f315015fa90 msgr2=0x7f3150138450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:45.800 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.811+0000 7f3155600640 1 --2- 172.21.15.57:0/1722739880 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f315015fa90 0x7f3150138450 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f313800c430 tx=0x7f313800c8f0 comp rx=0 tx=0).stop 2024-03-27T10:00:45.800 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.811+0000 7f3155600640 1 -- 172.21.15.57:0/1722739880 shutdown_connections 2024-03-27T10:00:45.800 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.811+0000 7f3155600640 1 --2- 172.21.15.57:0/1722739880 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f315015ff20 0x7f315015c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:45.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.811+0000 7f3155600640 1 --2- 172.21.15.57:0/1722739880 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f315015fa90 0x7f3150138450 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:45.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.811+0000 7f3155600640 1 --2- 172.21.15.57:0/1722739880 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f312c06c530 0x7f312c06e9f0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:45.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.811+0000 7f3155600640 1 --2- 172.21.15.57:0/1722739880 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f31501458e0 0x7f3150156560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:45.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.811+0000 7f3155600640 1 -- 172.21.15.57:0/1722739880 >> 172.21.15.57:0/1722739880 conn(0x7f31500cfb40 msgr2=0x7f31500cff20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:45.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.812+0000 7f3155600640 1 -- 172.21.15.57:0/1722739880 shutdown_connections 2024-03-27T10:00:45.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:45.812+0000 7f3155600640 1 -- 172.21.15.57:0/1722739880 wait complete. 2024-03-27T10:00:45.820 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-27T10:00:46.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.060+0000 7f9ebee00640 1 Processor -- start 2024-03-27T10:00:46.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.061+0000 7f9ebee00640 1 -- start start 2024-03-27T10:00:46.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.062+0000 7f9ebee00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9eb8161950 0x7f9eb80ceb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:46.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.062+0000 7f9ebee00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f9eb80d3770 0x7f9eb806bf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:46.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.062+0000 7f9ebee00640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9eb80cfe40 con 0x7f9eb80cf040 2024-03-27T10:00:46.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.062+0000 7f9ebee00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f9eb8161d30 con 0x7f9eb80d3770 2024-03-27T10:00:46.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.062+0000 7f9ebee00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f9eb80d0f10 con 0x7f9eb8161950 2024-03-27T10:00:46.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.063+0000 7f9ebd000640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f9eb80cf040 0x7f9eb80cf480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:54372/0 (socket says 172.21.15.57:54372) 2024-03-27T10:00:46.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.063+0000 7f9ebd000640 1 -- 172.21.15.57:0/695707911 learned_addr learned my addr 172.21.15.57:0/695707911 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T10:00:46.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.063+0000 7f9ebe400640 1 --2- 172.21.15.57:0/695707911 >> v2:172.21.15.118:3300/0 conn(0x7f9eb80d3770 0x7f9eb806bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:46.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.063+0000 7f9ebda00640 1 --2- 172.21.15.57:0/695707911 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9eb8161950 0x7f9eb80ceb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:46.053 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.063+0000 7f9eb7e00640 1 -- 172.21.15.57:0/695707911 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3930959537 0 0) 0x7f9eb80cfe40 con 0x7f9eb80cf040 2024-03-27T10:00:46.053 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.063+0000 7f9eb7e00640 1 -- 172.21.15.57:0/695707911 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9ea0003520 con 0x7f9eb80cf040 2024-03-27T10:00:46.053 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.064+0000 7f9eb7e00640 1 -- 172.21.15.57:0/695707911 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2295070276 0 0) 0x7f9ea0003520 con 0x7f9eb80cf040 2024-03-27T10:00:46.053 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.064+0000 7f9eb7e00640 1 -- 172.21.15.57:0/695707911 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9eb8161950 msgr2=0x7f9eb80ceb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:46.053 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.064+0000 7f9eb7e00640 1 --2- 172.21.15.57:0/695707911 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9eb8161950 0x7f9eb80ceb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:46.053 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.064+0000 7f9eb7e00640 1 -- 172.21.15.57:0/695707911 >> v2:172.21.15.118:3300/0 conn(0x7f9eb80d3770 msgr2=0x7f9eb806bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:46.053 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.064+0000 7f9eb7e00640 1 --2- 172.21.15.57:0/695707911 >> v2:172.21.15.118:3300/0 conn(0x7f9eb80d3770 0x7f9eb806bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:46.053 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.064+0000 7f9eb7e00640 1 -- 172.21.15.57:0/695707911 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9eb80d11f0 con 0x7f9eb80cf040 2024-03-27T10:00:46.053 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.064+0000 7f9eb7e00640 1 -- 172.21.15.57:0/695707911 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4227751516 0 0) 0x7f9ea4001670 con 0x7f9eb80cf040 2024-03-27T10:00:46.053 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.064+0000 7f9eb7e00640 1 -- 172.21.15.57:0/695707911 >> v1:172.21.15.57:6789/0 conn(0x7f9eb80cf040 legacy=0x7f9eb80cf480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:46.053 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.064+0000 7f9eb7e00640 1 --2- 172.21.15.57:0/695707911 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9ea00039b0 0x7f9ea0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:46.053 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.064+0000 7f9eb7e00640 1 --2- 172.21.15.57:0/695707911 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ea0004800 0x7f9ea0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:46.054 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.064+0000 7f9eb7e00640 1 --2- 172.21.15.57:0/695707911 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9eb8161950 0x7f9ea00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:46.054 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.064+0000 7f9eb7e00640 1 -- 172.21.15.57:0/695707911 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f9eb8161d30 con 0x7f9ea0004800 2024-03-27T10:00:46.054 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.064+0000 7f9eb7e00640 1 -- 172.21.15.57:0/695707911 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f9eb80d0f10 con 0x7f9ea00039b0 2024-03-27T10:00:46.054 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.064+0000 7f9eb7e00640 1 -- 172.21.15.57:0/695707911 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f9ea000b9f0 con 0x7f9eb8161950 2024-03-27T10:00:46.054 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.064+0000 7f9ebd000640 1 --2- 172.21.15.57:0/695707911 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ea0004800 0x7f9ea0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:46.054 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.064+0000 7f9ebda00640 1 --2- 172.21.15.57:0/695707911 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9ea00039b0 0x7f9ea0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:46.056 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.065+0000 7f9ebe400640 1 --2- 172.21.15.57:0/695707911 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9eb8161950 0x7f9ea00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:46.056 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.065+0000 7f9ebd000640 1 -- 172.21.15.57:0/695707911 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9eb8161950 msgr2=0x7f9ea00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:46.056 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.065+0000 7f9ebd000640 1 --2- 172.21.15.57:0/695707911 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9eb8161950 0x7f9ea00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:46.056 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.065+0000 7f9ebd000640 1 -- 172.21.15.57:0/695707911 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9ea00039b0 msgr2=0x7f9ea0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:46.056 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.065+0000 7f9ebd000640 1 --2- 172.21.15.57:0/695707911 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9ea00039b0 0x7f9ea0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:46.056 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.065+0000 7f9ebd000640 1 -- 172.21.15.57:0/695707911 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ea0003520 con 0x7f9ea0004800 2024-03-27T10:00:46.056 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.066+0000 7f9ebd000640 1 --2- 172.21.15.57:0/695707911 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ea0004800 0x7f9ea0004c80 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f9ea400c190 tx=0x7f9ea0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d35ac90e8d481b7 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:46.056 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.066+0000 7f9eb7e00640 1 -- 172.21.15.57:0/695707911 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ea4007c80 con 0x7f9ea0004800 2024-03-27T10:00:46.056 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.066+0000 7f9eb7e00640 1 -- 172.21.15.57:0/695707911 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ea4030070 con 0x7f9ea0004800 2024-03-27T10:00:46.057 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.066+0000 7f9eb7e00640 1 -- 172.21.15.57:0/695707911 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ea4005d30 con 0x7f9ea0004800 2024-03-27T10:00:46.057 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.067+0000 7f9ebee00640 1 -- 172.21.15.57:0/695707911 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ea0004800 msgr2=0x7f9ea0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:46.057 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.067+0000 7f9ebee00640 1 --2- 172.21.15.57:0/695707911 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ea0004800 0x7f9ea0004c80 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f9ea400c190 tx=0x7f9ea0005830 comp rx=0 tx=0).stop 2024-03-27T10:00:46.057 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.067+0000 7f9ebe400640 1 -- 172.21.15.57:0/695707911 reap_dead start 2024-03-27T10:00:46.057 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.067+0000 7f9ebee00640 1 -- 172.21.15.57:0/695707911 shutdown_connections 2024-03-27T10:00:46.057 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.067+0000 7f9ebee00640 1 -- 172.21.15.57:0/695707911 >> 172.21.15.57:0/695707911 conn(0x7f9eb80d3fc0 msgr2=0x7f9eb80d43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:46.057 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.067+0000 7f9ebee00640 1 -- 172.21.15.57:0/695707911 shutdown_connections 2024-03-27T10:00:46.057 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.067+0000 7f9ebee00640 1 -- 172.21.15.57:0/695707911 wait complete. 2024-03-27T10:00:46.058 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.069+0000 7f9ebee00640 1 Processor -- start 2024-03-27T10:00:46.058 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.069+0000 7f9ebee00640 1 -- start start 2024-03-27T10:00:46.059 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.070+0000 7f9ebee00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ea0004800 0x7f9eb80cdf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:46.059 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.070+0000 7f9ebee00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9eb80c9610 0x7f9eb815fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:46.059 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.070+0000 7f9ebee00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9eb81f4270 0x7f9eb8150f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:46.059 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.070+0000 7f9ebee00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f9eb80d2240 con 0x7f9ea0004800 2024-03-27T10:00:46.059 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.070+0000 7f9ebee00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f9eb80d1f60 con 0x7f9eb80c9610 2024-03-27T10:00:46.059 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.070+0000 7f9ebee00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f9eb80d17b0 con 0x7f9eb81f4270 2024-03-27T10:00:46.059 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.070+0000 7f9ebda00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ea0004800 0x7f9eb80cdf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:46.060 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.070+0000 7f9ebda00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ea0004800 0x7f9eb80cdf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44366/0 (socket says 172.21.15.57:44366) 2024-03-27T10:00:46.060 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.070+0000 7f9ebda00640 1 -- 172.21.15.57:0/1527197102 learned_addr learned my addr 172.21.15.57:0/1527197102 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:46.060 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.071+0000 7f9ebd000640 1 --2- 172.21.15.57:0/1527197102 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9eb80c9610 0x7f9eb815fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:46.060 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.071+0000 7f9ebe400640 1 --2- 172.21.15.57:0/1527197102 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9eb81f4270 0x7f9eb8150f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:46.060 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.071+0000 7f9ebda00640 1 -- 172.21.15.57:0/1527197102 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9eb81f4270 msgr2=0x7f9eb8150f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:46.060 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.071+0000 7f9ebda00640 1 --2- 172.21.15.57:0/1527197102 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9eb81f4270 0x7f9eb8150f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:46.060 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.071+0000 7f9ebda00640 1 -- 172.21.15.57:0/1527197102 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9eb80c9610 msgr2=0x7f9eb815fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:46.060 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.071+0000 7f9ebda00640 1 --2- 172.21.15.57:0/1527197102 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9eb80c9610 0x7f9eb815fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:46.060 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.071+0000 7f9ebda00640 1 -- 172.21.15.57:0/1527197102 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9eb80c9e20 con 0x7f9ea0004800 2024-03-27T10:00:46.060 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.071+0000 7f9ebda00640 1 --2- 172.21.15.57:0/1527197102 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ea0004800 0x7f9eb80cdf80 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f9eac0118e0 tx=0x7f9eac011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:46.061 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.071+0000 7f9eb5600640 1 -- 172.21.15.57:0/1527197102 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eac00faf0 con 0x7f9ea0004800 2024-03-27T10:00:46.061 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.071+0000 7f9eb5600640 1 -- 172.21.15.57:0/1527197102 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9eac00fc90 con 0x7f9ea0004800 2024-03-27T10:00:46.061 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.071+0000 7f9ebee00640 1 -- 172.21.15.57:0/1527197102 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9eb80ca100 con 0x7f9ea0004800 2024-03-27T10:00:46.061 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.071+0000 7f9eb5600640 1 -- 172.21.15.57:0/1527197102 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eac014440 con 0x7f9ea0004800 2024-03-27T10:00:46.061 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.072+0000 7f9ebee00640 1 -- 172.21.15.57:0/1527197102 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9eb80cb6f0 con 0x7f9ea0004800 2024-03-27T10:00:46.061 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.073+0000 7f9ebee00640 1 -- 172.21.15.57:0/1527197102 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9eb8068540 con 0x7f9ea0004800 2024-03-27T10:00:46.062 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.074+0000 7f9eb5600640 1 -- 172.21.15.57:0/1527197102 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f9eac012040 con 0x7f9ea0004800 2024-03-27T10:00:46.063 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.075+0000 7f9eb5600640 1 --2- 172.21.15.57:0/1527197102 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f9e9806c560 0x7f9e9806ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:46.063 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.075+0000 7f9eb5600640 1 -- 172.21.15.57:0/1527197102 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f9eac08c1b0 con 0x7f9ea0004800 2024-03-27T10:00:46.063 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.075+0000 7f9ebd000640 1 --2- 172.21.15.57:0/1527197102 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f9e9806c560 0x7f9e9806ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:46.064 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.076+0000 7f9ebd000640 1 --2- 172.21.15.57:0/1527197102 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f9e9806c560 0x7f9e9806ea20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f9ea4034000 tx=0x7f9ea4007000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:46.068 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.079+0000 7f9eb5600640 1 -- 172.21.15.57:0/1527197102 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f9eac019030 con 0x7f9ea0004800 2024-03-27T10:00:46.273 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.285+0000 7f9ebee00640 1 -- 172.21.15.57:0/1527197102 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f9eb806cbc0 con 0x7f9ea0004800 2024-03-27T10:00:46.274 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.286+0000 7f9eb5600640 1 -- 172.21.15.57:0/1527197102 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) ==== 100+0+11 (secure 0 0 0) 0x7f9eac059ce0 con 0x7f9ea0004800 2024-03-27T10:00:46.274 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2024-03-27T10:00:46.277 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.289+0000 7f9ebee00640 1 -- 172.21.15.57:0/1527197102 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f9e9806c560 msgr2=0x7f9e9806ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:46.277 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.289+0000 7f9ebee00640 1 --2- 172.21.15.57:0/1527197102 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f9e9806c560 0x7f9e9806ea20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f9ea4034000 tx=0x7f9ea4007000 comp rx=0 tx=0).stop 2024-03-27T10:00:46.278 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.289+0000 7f9ebee00640 1 -- 172.21.15.57:0/1527197102 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ea0004800 msgr2=0x7f9eb80cdf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:46.278 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.289+0000 7f9ebee00640 1 --2- 172.21.15.57:0/1527197102 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ea0004800 0x7f9eb80cdf80 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f9eac0118e0 tx=0x7f9eac011da0 comp rx=0 tx=0).stop 2024-03-27T10:00:46.278 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.289+0000 7f9ebee00640 1 -- 172.21.15.57:0/1527197102 shutdown_connections 2024-03-27T10:00:46.278 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.289+0000 7f9ebee00640 1 --2- 172.21.15.57:0/1527197102 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9eb81f4270 0x7f9eb8150f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:46.278 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.289+0000 7f9ebee00640 1 --2- 172.21.15.57:0/1527197102 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f9e9806c560 0x7f9e9806ea20 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:46.278 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.289+0000 7f9ebee00640 1 --2- 172.21.15.57:0/1527197102 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9eb80c9610 0x7f9eb815fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:46.278 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.289+0000 7f9ebee00640 1 --2- 172.21.15.57:0/1527197102 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9ea0004800 0x7f9eb80cdf80 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:46.278 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.289+0000 7f9ebee00640 1 -- 172.21.15.57:0/1527197102 >> 172.21.15.57:0/1527197102 conn(0x7f9eb80d3fc0 msgr2=0x7f9eb8160910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:46.278 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.289+0000 7f9ebee00640 1 -- 172.21.15.57:0/1527197102 shutdown_connections 2024-03-27T10:00:46.278 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.289+0000 7f9ebee00640 1 -- 172.21.15.57:0/1527197102 wait complete. 2024-03-27T10:00:46.297 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-27T10:00:46.523 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.534+0000 7effe3e00640 1 Processor -- start 2024-03-27T10:00:46.523 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.535+0000 7effe3e00640 1 -- start start 2024-03-27T10:00:46.525 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.536+0000 7effe3e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7effdc15d1a0 0x7effdc0acd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:46.525 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.536+0000 7effe3e00640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effdc15d630 con 0x7effdc06cf30 2024-03-27T10:00:46.525 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.536+0000 7effe3e00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effdc15c4c0 con 0x7effdc0aea20 2024-03-27T10:00:46.525 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.536+0000 7effe3e00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7effdc072600 con 0x7effdc15d1a0 2024-03-27T10:00:46.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.537+0000 7effe1e00640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7effdc06cf30 0x7effdc06d360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:54388/0 (socket says 172.21.15.57:54388) 2024-03-27T10:00:46.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.537+0000 7effe1e00640 1 -- 172.21.15.57:0/1802633010 learned_addr learned my addr 172.21.15.57:0/1802633010 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T10:00:46.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.537+0000 7effe0a00640 1 --2- 172.21.15.57:0/1802633010 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7effdc15d1a0 0x7effdc0acd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:46.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.538+0000 7effdbe00640 1 -- 172.21.15.57:0/1802633010 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2904108304 0 0) 0x7effdc15d630 con 0x7effdc06cf30 2024-03-27T10:00:46.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.538+0000 7effdbe00640 1 -- 172.21.15.57:0/1802633010 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7effc4003520 con 0x7effdc06cf30 2024-03-27T10:00:46.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.538+0000 7effe0a00640 1 -- 172.21.15.57:0/1802633010 >> v1:172.21.15.118:6789/0 conn(0x7effdc0aea20 legacy=0x7effdc0aee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:46.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.538+0000 7effe0a00640 1 -- 172.21.15.57:0/1802633010 >> v1:172.21.15.57:6789/0 conn(0x7effdc06cf30 legacy=0x7effdc06d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:46.527 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.538+0000 7effdbe00640 1 -- 172.21.15.57:0/1802633010 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4182745573 0 0) 0x7effdc15c4c0 con 0x7effdc0aea20 2024-03-27T10:00:46.527 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.538+0000 7effe0a00640 1 -- 172.21.15.57:0/1802633010 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effdc0728e0 con 0x7effdc15d1a0 2024-03-27T10:00:46.527 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.539+0000 7effe0a00640 1 --2- 172.21.15.57:0/1802633010 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7effdc15d1a0 0x7effdc0acd60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7effc80097d0 tx=0x7effc802b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=18b360fa6e7a92e6 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:46.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.540+0000 7effdbe00640 1 -- 172.21.15.57:0/1802633010 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effc8035020 con 0x7effdc15d1a0 2024-03-27T10:00:46.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.540+0000 7effdbe00640 1 -- 172.21.15.57:0/1802633010 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effc8031800 con 0x7effdc15d1a0 2024-03-27T10:00:46.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.540+0000 7effdbe00640 1 -- 172.21.15.57:0/1802633010 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effc8031bd0 con 0x7effdc15d1a0 2024-03-27T10:00:46.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.540+0000 7effe3e00640 1 -- 172.21.15.57:0/1802633010 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7effdc15d1a0 msgr2=0x7effdc0acd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:46.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.540+0000 7effe3e00640 1 --2- 172.21.15.57:0/1802633010 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7effdc15d1a0 0x7effdc0acd60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7effc80097d0 tx=0x7effc802b8a0 comp rx=0 tx=0).stop 2024-03-27T10:00:46.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.541+0000 7effe3e00640 1 -- 172.21.15.57:0/1802633010 shutdown_connections 2024-03-27T10:00:46.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.541+0000 7effe3e00640 1 --2- 172.21.15.57:0/1802633010 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7effdc15d1a0 0x7effdc0acd60 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:46.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.541+0000 7effe3e00640 1 -- 172.21.15.57:0/1802633010 >> 172.21.15.57:0/1802633010 conn(0x7effdc0b18a0 msgr2=0x7effdc0b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:46.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.541+0000 7effe3e00640 1 -- 172.21.15.57:0/1802633010 shutdown_connections 2024-03-27T10:00:46.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.541+0000 7effe3e00640 1 -- 172.21.15.57:0/1802633010 wait complete. 2024-03-27T10:00:46.531 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.543+0000 7effe3e00640 1 Processor -- start 2024-03-27T10:00:46.531 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.543+0000 7effe3e00640 1 -- start start 2024-03-27T10:00:46.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.544+0000 7effe3e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7effdc06cf30 0x7effdc150be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:46.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.544+0000 7effe3e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7effdc0aea20 0x7effdc0caaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:46.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.544+0000 7effe3e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7effdc15d1a0 0x7effdc151700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:46.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.545+0000 7effe3e00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7effdc0733c0 con 0x7effdc06cf30 2024-03-27T10:00:46.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.545+0000 7effe3e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7effdc072ea0 con 0x7effdc0aea20 2024-03-27T10:00:46.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.545+0000 7effe3e00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7effdc06da70 con 0x7effdc15d1a0 2024-03-27T10:00:46.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.545+0000 7effe1400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7effdc06cf30 0x7effdc150be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:46.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.545+0000 7effe1400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7effdc06cf30 0x7effdc150be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44376/0 (socket says 172.21.15.57:44376) 2024-03-27T10:00:46.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.545+0000 7effe1400640 1 -- 172.21.15.57:0/3455472535 learned_addr learned my addr 172.21.15.57:0/3455472535 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:46.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.545+0000 7effe0a00640 1 --2- 172.21.15.57:0/3455472535 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7effdc0aea20 0x7effdc0caaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:46.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.545+0000 7effe1e00640 1 --2- 172.21.15.57:0/3455472535 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7effdc15d1a0 0x7effdc151700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:46.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.545+0000 7effe1400640 1 -- 172.21.15.57:0/3455472535 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7effdc15d1a0 msgr2=0x7effdc151700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:46.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.545+0000 7effe1400640 1 --2- 172.21.15.57:0/3455472535 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7effdc15d1a0 0x7effdc151700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:46.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.545+0000 7effe1400640 1 -- 172.21.15.57:0/3455472535 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7effdc0aea20 msgr2=0x7effdc0caaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:46.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.545+0000 7effe1400640 1 --2- 172.21.15.57:0/3455472535 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7effdc0aea20 0x7effdc0caaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:46.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.546+0000 7effe1400640 1 -- 172.21.15.57:0/3455472535 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effdc09ae10 con 0x7effdc06cf30 2024-03-27T10:00:46.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.546+0000 7effe0a00640 1 --2- 172.21.15.57:0/3455472535 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7effdc0aea20 0x7effdc0caaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T10:00:46.536 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.546+0000 7effe1400640 1 --2- 172.21.15.57:0/3455472535 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7effdc06cf30 0x7effdc150be0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7effd000c460 tx=0x7effd000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:46.536 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.546+0000 7effd9600640 1 -- 172.21.15.57:0/3455472535 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effd0017070 con 0x7effdc06cf30 2024-03-27T10:00:46.536 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.546+0000 7effd9600640 1 -- 172.21.15.57:0/3455472535 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effd00035f0 con 0x7effdc06cf30 2024-03-27T10:00:46.536 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.546+0000 7effd9600640 1 -- 172.21.15.57:0/3455472535 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effd00039e0 con 0x7effdc06cf30 2024-03-27T10:00:46.536 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.546+0000 7effe3e00640 1 -- 172.21.15.57:0/3455472535 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effdc09b0f0 con 0x7effdc06cf30 2024-03-27T10:00:46.536 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.547+0000 7effe3e00640 1 -- 172.21.15.57:0/3455472535 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effdc0ca2f0 con 0x7effdc06cf30 2024-03-27T10:00:46.536 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.548+0000 7effe3e00640 1 -- 172.21.15.57:0/3455472535 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effdc068540 con 0x7effdc06cf30 2024-03-27T10:00:46.537 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.549+0000 7effd9600640 1 -- 172.21.15.57:0/3455472535 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7effd001a070 con 0x7effdc06cf30 2024-03-27T10:00:46.538 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.550+0000 7effd9600640 1 --2- 172.21.15.57:0/3455472535 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7effbc06c530 0x7effbc06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:46.538 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.550+0000 7effd9600640 1 -- 172.21.15.57:0/3455472535 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7effd008afe0 con 0x7effdc06cf30 2024-03-27T10:00:46.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.551+0000 7effe0a00640 1 --2- 172.21.15.57:0/3455472535 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7effbc06c530 0x7effbc06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:46.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.551+0000 7effe0a00640 1 --2- 172.21.15.57:0/3455472535 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7effbc06c530 0x7effbc06e9f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7effc8036000 tx=0x7effc8008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:46.543 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.555+0000 7effd9600640 1 -- 172.21.15.57:0/3455472535 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7effd0059130 con 0x7effdc06cf30 2024-03-27T10:00:46.750 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.761+0000 7effe3e00640 1 -- 172.21.15.57:0/3455472535 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7effdc06e460 con 0x7effdc06cf30 2024-03-27T10:00:46.751 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.762+0000 7effd9600640 1 -- 172.21.15.57:0/3455472535 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) ==== 103+0+11 (secure 0 0 0) 0x7effd0058a30 con 0x7effdc06cf30 2024-03-27T10:00:46.751 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2024-03-27T10:00:46.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.765+0000 7effe3e00640 1 -- 172.21.15.57:0/3455472535 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7effbc06c530 msgr2=0x7effbc06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:46.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.765+0000 7effe3e00640 1 --2- 172.21.15.57:0/3455472535 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7effbc06c530 0x7effbc06e9f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7effc8036000 tx=0x7effc8008030 comp rx=0 tx=0).stop 2024-03-27T10:00:46.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.765+0000 7effe3e00640 1 -- 172.21.15.57:0/3455472535 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7effdc06cf30 msgr2=0x7effdc150be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:46.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.765+0000 7effe3e00640 1 --2- 172.21.15.57:0/3455472535 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7effdc06cf30 0x7effdc150be0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7effd000c460 tx=0x7effd000c920 comp rx=0 tx=0).stop 2024-03-27T10:00:46.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.765+0000 7effe3e00640 1 -- 172.21.15.57:0/3455472535 shutdown_connections 2024-03-27T10:00:46.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.765+0000 7effe3e00640 1 --2- 172.21.15.57:0/3455472535 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7effdc15d1a0 0x7effdc151700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:46.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.765+0000 7effe3e00640 1 --2- 172.21.15.57:0/3455472535 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7effbc06c530 0x7effbc06e9f0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:46.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.765+0000 7effe3e00640 1 --2- 172.21.15.57:0/3455472535 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7effdc0aea20 0x7effdc0caaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:46.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.765+0000 7effe3e00640 1 --2- 172.21.15.57:0/3455472535 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7effdc06cf30 0x7effdc150be0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:46.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.765+0000 7effe3e00640 1 -- 172.21.15.57:0/3455472535 >> 172.21.15.57:0/3455472535 conn(0x7effdc0b18a0 msgr2=0x7effdc0711b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:46.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.766+0000 7effe3e00640 1 -- 172.21.15.57:0/3455472535 shutdown_connections 2024-03-27T10:00:46.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:46.766+0000 7effe3e00640 1 -- 172.21.15.57:0/3455472535 wait complete. 2024-03-27T10:00:46.776 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-27T10:00:46.997 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.008+0000 7fdf4fe00640 1 Processor -- start 2024-03-27T10:00:46.997 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.008+0000 7fdf4fe00640 1 -- start start 2024-03-27T10:00:46.998 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.010+0000 7fdf4fe00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fdf50071b90 0x7fdf50072020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:46.998 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.010+0000 7fdf4fe00640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf5006e210 con 0x7fdf50158530 2024-03-27T10:00:46.998 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.010+0000 7fdf4fe00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf5006e4f0 con 0x7fdf5006e970 2024-03-27T10:00:46.998 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.010+0000 7fdf4fe00640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7fdf500710b0 con 0x7fdf50071b90 2024-03-27T10:00:46.999 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.010+0000 7fdf46000640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fdf50071b90 0x7fdf50072020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:46.999 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.010+0000 7fdf4ea00640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fdf50158530 0x7fdf500ad8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:54392/0 (socket says 172.21.15.57:54392) 2024-03-27T10:00:46.999 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.010+0000 7fdf4ea00640 1 -- 172.21.15.57:0/2930737764 learned_addr learned my addr 172.21.15.57:0/2930737764 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T10:00:46.999 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.011+0000 7fdf46000640 1 -- 172.21.15.57:0/2930737764 >> v1:172.21.15.118:6789/0 conn(0x7fdf5006e970 legacy=0x7fdf5006d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:46.999 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.011+0000 7fdf46000640 1 -- 172.21.15.57:0/2930737764 >> v1:172.21.15.57:6789/0 conn(0x7fdf50158530 legacy=0x7fdf500ad8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:46.999 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.011+0000 7fdf46000640 1 -- 172.21.15.57:0/2930737764 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf50071390 con 0x7fdf50071b90 2024-03-27T10:00:47.000 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.012+0000 7fdf46000640 1 --2- 172.21.15.57:0/2930737764 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdf50071b90 0x7fdf50072020 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fdf380097a0 tx=0x7fdf3802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e7f103676084cd7 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:47.001 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.012+0000 7fdf4e000640 1 -- 172.21.15.57:0/2930737764 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf38035020 con 0x7fdf50071b90 2024-03-27T10:00:47.001 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.012+0000 7fdf4e000640 1 -- 172.21.15.57:0/2930737764 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf38031830 con 0x7fdf50071b90 2024-03-27T10:00:47.002 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.012+0000 7fdf4e000640 1 -- 172.21.15.57:0/2930737764 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf38031c00 con 0x7fdf50071b90 2024-03-27T10:00:47.002 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.013+0000 7fdf4fe00640 1 -- 172.21.15.57:0/2930737764 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdf50071b90 msgr2=0x7fdf50072020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:47.002 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.013+0000 7fdf4fe00640 1 --2- 172.21.15.57:0/2930737764 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdf50071b90 0x7fdf50072020 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fdf380097a0 tx=0x7fdf3802b8d0 comp rx=0 tx=0).stop 2024-03-27T10:00:47.002 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.013+0000 7fdf4fe00640 1 -- 172.21.15.57:0/2930737764 shutdown_connections 2024-03-27T10:00:47.002 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.013+0000 7fdf4fe00640 1 --2- 172.21.15.57:0/2930737764 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdf50071b90 0x7fdf50072020 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:47.002 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.013+0000 7fdf4fe00640 1 -- 172.21.15.57:0/2930737764 >> 172.21.15.57:0/2930737764 conn(0x7fdf500b1770 msgr2=0x7fdf500b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:47.002 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.013+0000 7fdf4fe00640 1 -- 172.21.15.57:0/2930737764 shutdown_connections 2024-03-27T10:00:47.002 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.013+0000 7fdf4fe00640 1 -- 172.21.15.57:0/2930737764 wait complete. 2024-03-27T10:00:47.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.015+0000 7fdf4fe00640 1 Processor -- start 2024-03-27T10:00:47.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.015+0000 7fdf4fe00640 1 -- start start 2024-03-27T10:00:47.004 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.016+0000 7fdf4fe00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdf5006e970 0x7fdf501f4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:47.004 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.016+0000 7fdf4fe00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdf50071b90 0x7fdf50148f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:47.004 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.016+0000 7fdf4fe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf50158530 0x7fdf501511d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:47.004 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.016+0000 7fdf4fe00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fdf50158a90 con 0x7fdf5006e970 2024-03-27T10:00:47.004 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.016+0000 7fdf4fe00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fdf50158910 con 0x7fdf50158530 2024-03-27T10:00:47.005 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.016+0000 7fdf4fe00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fdf500adfb0 con 0x7fdf50071b90 2024-03-27T10:00:47.005 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.016+0000 7fdf4ea00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdf5006e970 0x7fdf501f4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:47.005 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.016+0000 7fdf4ea00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdf5006e970 0x7fdf501f4e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44390/0 (socket says 172.21.15.57:44390) 2024-03-27T10:00:47.005 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.016+0000 7fdf4ea00640 1 -- 172.21.15.57:0/4086101583 learned_addr learned my addr 172.21.15.57:0/4086101583 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:47.006 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.016+0000 7fdf4ea00640 1 -- 172.21.15.57:0/4086101583 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdf50071b90 msgr2=0x7fdf50148f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:47.006 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.016+0000 7fdf4ea00640 1 --2- 172.21.15.57:0/4086101583 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdf50071b90 0x7fdf50148f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:47.006 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.016+0000 7fdf4ea00640 1 -- 172.21.15.57:0/4086101583 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf50158530 msgr2=0x7fdf501511d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:47.006 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.016+0000 7fdf4ea00640 1 --2- 172.21.15.57:0/4086101583 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf50158530 0x7fdf501511d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:47.006 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.016+0000 7fdf4ea00640 1 -- 172.21.15.57:0/4086101583 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf501494c0 con 0x7fdf5006e970 2024-03-27T10:00:47.006 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.017+0000 7fdf4ea00640 1 --2- 172.21.15.57:0/4086101583 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdf5006e970 0x7fdf501f4e50 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fdf4000c3f0 tx=0x7fdf4000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:47.006 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.017+0000 7fdf47e00640 1 -- 172.21.15.57:0/4086101583 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf40017070 con 0x7fdf5006e970 2024-03-27T10:00:47.008 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.017+0000 7fdf47e00640 1 -- 172.21.15.57:0/4086101583 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf40005ce0 con 0x7fdf5006e970 2024-03-27T10:00:47.008 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.017+0000 7fdf47e00640 1 -- 172.21.15.57:0/4086101583 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf400072f0 con 0x7fdf5006e970 2024-03-27T10:00:47.008 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.017+0000 7fdf4fe00640 1 -- 172.21.15.57:0/4086101583 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf50151bd0 con 0x7fdf5006e970 2024-03-27T10:00:47.008 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.017+0000 7fdf4fe00640 1 -- 172.21.15.57:0/4086101583 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf501f4650 con 0x7fdf5006e970 2024-03-27T10:00:47.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.018+0000 7fdf4fe00640 1 -- 172.21.15.57:0/4086101583 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf50068540 con 0x7fdf5006e970 2024-03-27T10:00:47.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.019+0000 7fdf47e00640 1 -- 172.21.15.57:0/4086101583 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fdf4001a070 con 0x7fdf5006e970 2024-03-27T10:00:47.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.021+0000 7fdf47e00640 1 --2- 172.21.15.57:0/4086101583 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fdf2c06c530 0x7fdf2c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:47.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.021+0000 7fdf47e00640 1 -- 172.21.15.57:0/4086101583 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fdf4008aee0 con 0x7fdf5006e970 2024-03-27T10:00:47.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.021+0000 7fdf46000640 1 --2- 172.21.15.57:0/4086101583 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fdf2c06c530 0x7fdf2c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:47.010 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.022+0000 7fdf46000640 1 --2- 172.21.15.57:0/4086101583 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fdf2c06c530 0x7fdf2c06e9f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fdf38036000 tx=0x7fdf38030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:47.013 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.025+0000 7fdf47e00640 1 -- 172.21.15.57:0/4086101583 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7fdf40059060 con 0x7fdf5006e970 2024-03-27T10:00:47.233 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.244+0000 7fdf4fe00640 1 -- 172.21.15.57:0/4086101583 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fdf500aef10 con 0x7fdf5006e970 2024-03-27T10:00:47.233 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.245+0000 7fdf47e00640 1 -- 172.21.15.57:0/4086101583 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) ==== 80+0+0 (secure 0 0 0) 0x7fdf40058960 con 0x7fdf5006e970 2024-03-27T10:00:47.234 INFO:teuthology.orchestra.run.smithi057.stderr:listed 0 entries 2024-03-27T10:00:47.236 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.248+0000 7fdf4fe00640 1 -- 172.21.15.57:0/4086101583 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fdf2c06c530 msgr2=0x7fdf2c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:47.236 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.248+0000 7fdf4fe00640 1 --2- 172.21.15.57:0/4086101583 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fdf2c06c530 0x7fdf2c06e9f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fdf38036000 tx=0x7fdf38030000 comp rx=0 tx=0).stop 2024-03-27T10:00:47.236 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.248+0000 7fdf4fe00640 1 -- 172.21.15.57:0/4086101583 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdf5006e970 msgr2=0x7fdf501f4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:47.237 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.248+0000 7fdf4fe00640 1 --2- 172.21.15.57:0/4086101583 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdf5006e970 0x7fdf501f4e50 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fdf4000c3f0 tx=0x7fdf4000c8b0 comp rx=0 tx=0).stop 2024-03-27T10:00:47.237 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.248+0000 7fdf4fe00640 1 -- 172.21.15.57:0/4086101583 shutdown_connections 2024-03-27T10:00:47.237 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.248+0000 7fdf4fe00640 1 --2- 172.21.15.57:0/4086101583 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fdf2c06c530 0x7fdf2c06e9f0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:47.237 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.248+0000 7fdf4fe00640 1 --2- 172.21.15.57:0/4086101583 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf50158530 0x7fdf501511d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:47.237 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.248+0000 7fdf4fe00640 1 --2- 172.21.15.57:0/4086101583 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdf50071b90 0x7fdf50148f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:47.237 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.248+0000 7fdf4fe00640 1 --2- 172.21.15.57:0/4086101583 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdf5006e970 0x7fdf501f4e50 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:47.238 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.248+0000 7fdf4fe00640 1 -- 172.21.15.57:0/4086101583 >> 172.21.15.57:0/4086101583 conn(0x7fdf500b1770 msgr2=0x7fdf500b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:47.238 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.249+0000 7fdf4fe00640 1 -- 172.21.15.57:0/4086101583 shutdown_connections 2024-03-27T10:00:47.238 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.249+0000 7fdf4fe00640 1 -- 172.21.15.57:0/4086101583 wait complete. 2024-03-27T10:00:47.257 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi057.front.sepia.ceph.com... 2024-03-27T10:00:47.258 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T10:00:47.258 DEBUG:teuthology.orchestra.run.smithi057:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-03-27T10:00:47.359 INFO:teuthology.orchestra.run:waiting for 300 2024-03-27T10:00:47.359 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi057.front.sepia.ceph.com 2024-03-27T10:00:47.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T10:00:47.359 DEBUG:teuthology.orchestra.run.smithi057:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-03-27T10:00:47.413 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-03-27T10:00:47.413 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-27T10:00:47.471 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-03-27T10:00:47.471 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-27T10:00:47.521 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-27T10:00:47.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.765+0000 7f4e1dc00640 1 Processor -- start 2024-03-27T10:00:47.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.765+0000 7f4e1dc00640 1 -- start start 2024-03-27T10:00:47.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.766+0000 7f4e1dc00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4e18145820 0x7f4e180cc950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:47.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.766+0000 7f4e1dc00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4e1806b750 0x7f4e1806bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:47.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.766+0000 7f4e1dc00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e180cce90 con 0x7f4e180b2b70 2024-03-27T10:00:47.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.767+0000 7f4e1dc00640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f4e18160b60 con 0x7f4e18145820 2024-03-27T10:00:47.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.767+0000 7f4e1dc00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f4e1806c0d0 con 0x7f4e1806b750 2024-03-27T10:00:47.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.767+0000 7f4e16a00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4e18145820 0x7f4e180cc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:47.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.767+0000 7f4e16a00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4e18145820 0x7f4e180cc950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44398/0 (socket says 172.21.15.57:44398) 2024-03-27T10:00:47.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.767+0000 7f4e16a00640 1 -- 172.21.15.57:0/1978770135 learned_addr learned my addr 172.21.15.57:0/1978770135 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:47.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.767+0000 7f4e0fe00640 1 --2- 172.21.15.57:0/1978770135 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4e1806b750 0x7f4e1806bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:47.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.767+0000 7f4e16a00640 1 -- 172.21.15.57:0/1978770135 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4e1806b750 msgr2=0x7f4e1806bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:47.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.767+0000 7f4e16a00640 1 --2- 172.21.15.57:0/1978770135 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4e1806b750 0x7f4e1806bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:47.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.767+0000 7f4e16a00640 1 -- 172.21.15.57:0/1978770135 >> v1:172.21.15.118:6789/0 conn(0x7f4e180b2b70 legacy=0x7f4e180b2fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:47.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.767+0000 7f4e16a00640 1 -- 172.21.15.57:0/1978770135 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e1815fc70 con 0x7f4e18145820 2024-03-27T10:00:47.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.768+0000 7f4e16a00640 1 --2- 172.21.15.57:0/1978770135 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e18145820 0x7f4e180cc950 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f4e18160ce0 tx=0x7f4e0802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa639be1d993884d server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:47.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.769+0000 7f4e16000640 1 -- 172.21.15.57:0/1978770135 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e08035020 con 0x7f4e18145820 2024-03-27T10:00:47.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.769+0000 7f4e16000640 1 -- 172.21.15.57:0/1978770135 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e08031640 con 0x7f4e18145820 2024-03-27T10:00:47.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.769+0000 7f4e16000640 1 -- 172.21.15.57:0/1978770135 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e0802d040 con 0x7f4e18145820 2024-03-27T10:00:47.758 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.769+0000 7f4e1dc00640 1 -- 172.21.15.57:0/1978770135 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e18145820 msgr2=0x7f4e180cc950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:47.758 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.769+0000 7f4e1dc00640 1 --2- 172.21.15.57:0/1978770135 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e18145820 0x7f4e180cc950 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f4e18160ce0 tx=0x7f4e0802b8f0 comp rx=0 tx=0).stop 2024-03-27T10:00:47.758 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.770+0000 7f4e1dc00640 1 -- 172.21.15.57:0/1978770135 shutdown_connections 2024-03-27T10:00:47.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.770+0000 7f4e1dc00640 1 --2- 172.21.15.57:0/1978770135 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4e1806b750 0x7f4e1806bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:47.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.770+0000 7f4e1dc00640 1 --2- 172.21.15.57:0/1978770135 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e18145820 0x7f4e180cc950 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:47.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.770+0000 7f4e1dc00640 1 -- 172.21.15.57:0/1978770135 >> 172.21.15.57:0/1978770135 conn(0x7f4e180b1c60 msgr2=0x7f4e180b2070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:47.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.770+0000 7f4e1dc00640 1 -- 172.21.15.57:0/1978770135 shutdown_connections 2024-03-27T10:00:47.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.770+0000 7f4e1dc00640 1 -- 172.21.15.57:0/1978770135 wait complete. 2024-03-27T10:00:47.760 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.771+0000 7f4e1dc00640 1 Processor -- start 2024-03-27T10:00:47.760 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.772+0000 7f4e1dc00640 1 -- start start 2024-03-27T10:00:47.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.772+0000 7f4e1dc00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e1806b750 0x7f4e181f3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:47.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.772+0000 7f4e1dc00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e180b2b70 0x7f4e180cf150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:47.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.772+0000 7f4e1dc00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4e18145820 0x7f4e1813f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:47.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.773+0000 7f4e1dc00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f4e18160510 con 0x7f4e1806b750 2024-03-27T10:00:47.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.773+0000 7f4e1dc00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f4e18160230 con 0x7f4e180b2b70 2024-03-27T10:00:47.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.773+0000 7f4e1dc00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f4e181607f0 con 0x7f4e18145820 2024-03-27T10:00:47.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.773+0000 7f4e16a00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e1806b750 0x7f4e181f3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:47.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.773+0000 7f4e16a00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e1806b750 0x7f4e181f3f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44412/0 (socket says 172.21.15.57:44412) 2024-03-27T10:00:47.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.773+0000 7f4e16a00640 1 -- 172.21.15.57:0/1826501801 learned_addr learned my addr 172.21.15.57:0/1826501801 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:47.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.773+0000 7f4e0fe00640 1 --2- 172.21.15.57:0/1826501801 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e180b2b70 0x7f4e180cf150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:47.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.773+0000 7f4e17400640 1 --2- 172.21.15.57:0/1826501801 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4e18145820 0x7f4e1813f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:47.764 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.773+0000 7f4e16a00640 1 -- 172.21.15.57:0/1826501801 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4e18145820 msgr2=0x7f4e1813f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:47.764 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.773+0000 7f4e16a00640 1 --2- 172.21.15.57:0/1826501801 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4e18145820 0x7f4e1813f820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:47.764 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.773+0000 7f4e16a00640 1 -- 172.21.15.57:0/1826501801 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e180b2b70 msgr2=0x7f4e180cf150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:47.764 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.773+0000 7f4e16a00640 1 --2- 172.21.15.57:0/1826501801 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e180b2b70 0x7f4e180cf150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:47.764 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.773+0000 7f4e16a00640 1 -- 172.21.15.57:0/1826501801 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e18155f20 con 0x7f4e1806b750 2024-03-27T10:00:47.764 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.773+0000 7f4e0fe00640 1 --2- 172.21.15.57:0/1826501801 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e180b2b70 0x7f4e180cf150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T10:00:47.764 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.774+0000 7f4e16a00640 1 --2- 172.21.15.57:0/1826501801 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e1806b750 0x7f4e181f3f60 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f4e08000c00 tx=0x7f4e080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:47.764 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.774+0000 7f4e0ea00640 1 -- 172.21.15.57:0/1826501801 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e08040070 con 0x7f4e1806b750 2024-03-27T10:00:47.764 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.774+0000 7f4e0ea00640 1 -- 172.21.15.57:0/1826501801 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e080399f0 con 0x7f4e1806b750 2024-03-27T10:00:47.764 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.774+0000 7f4e0ea00640 1 -- 172.21.15.57:0/1826501801 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e08035040 con 0x7f4e1806b750 2024-03-27T10:00:47.764 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.774+0000 7f4e1dc00640 1 -- 172.21.15.57:0/1826501801 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e180cff60 con 0x7f4e1806b750 2024-03-27T10:00:47.764 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.774+0000 7f4e1dc00640 1 -- 172.21.15.57:0/1826501801 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e181f4820 con 0x7f4e1806b750 2024-03-27T10:00:47.765 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.775+0000 7f4e1dc00640 1 -- 172.21.15.57:0/1826501801 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e18068620 con 0x7f4e1806b750 2024-03-27T10:00:47.765 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.777+0000 7f4e0ea00640 1 -- 172.21.15.57:0/1826501801 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f4e0804b060 con 0x7f4e1806b750 2024-03-27T10:00:47.765 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.777+0000 7f4e0ea00640 1 --2- 172.21.15.57:0/1826501801 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f4df406c530 0x7f4df406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:47.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.777+0000 7f4e0ea00640 1 -- 172.21.15.57:0/1826501801 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f4e080ad4a0 con 0x7f4e1806b750 2024-03-27T10:00:47.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.778+0000 7f4e0fe00640 1 --2- 172.21.15.57:0/1826501801 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f4df406c530 0x7f4df406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:47.767 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.779+0000 7f4e0fe00640 1 --2- 172.21.15.57:0/1826501801 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f4df406c530 0x7f4df406e9f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4e180b3fb0 tx=0x7f4e00008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:47.770 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.782+0000 7f4e0ea00640 1 -- 172.21.15.57:0/1826501801 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f4e18155f20 con 0x7f4e1806b750 2024-03-27T10:00:47.978 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.990+0000 7f4e1dc00640 1 -- 172.21.15.57:0/1826501801 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4e180b4a70 con 0x7f4e1806b750 2024-03-27T10:00:47.981 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.993+0000 7f4e0ea00640 1 -- 172.21.15.57:0/1826501801 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) ==== 74+0+18888 (secure 0 0 0) 0x7f4e0802f300 con 0x7f4e1806b750 2024-03-27T10:00:47.982 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:00:47.983 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":28,"fsid":"7ac43f86-2c16-4a97-98fb-715d3cebc75c","created":"2024-03-27T09:59:04.033417+0000","modified":"2024-03-27T10:00:10.462391+0000","last_up_change":"2024-03-27T09:59:16.969624+0000","last_in_change":"2024-03-27T09:59:07.421690+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-27T09:59:17.253008+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-27T09:59:26.690365+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-27T09:59:27.559059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-27T09:59:31.187596+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"47b44362-7302-4f2a-b735-582c6c3850cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6801","nonce":2020036298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6803","nonce":2020036298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6807","nonce":2020036298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6805","nonce":2020036298}]},"public_addr":"172.21.15.57:6801/2020036298","cluster_addr":"172.21.15.57:6803/2020036298","heartbeat_back_addr":"172.21.15.57:6807/2020036298","heartbeat_front_addr":"172.21.15.57:6805/2020036298","state":["exists","up"]},{"osd":1,"uuid":"feaf96f0-9431-4188-9a09-da505b40e934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6809","nonce":3190929242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6811","nonce":3190929242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6815","nonce":3190929242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6813","nonce":3190929242}]},"public_addr":"172.21.15.57:6809/3190929242","cluster_addr":"172.21.15.57:6811/3190929242","heartbeat_back_addr":"172.21.15.57:6815/3190929242","heartbeat_front_addr":"172.21.15.57:6813/3190929242","state":["exists","up"]},{"osd":2,"uuid":"21e406e6-cfbc-4fe7-a816-e2420487c95d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6817","nonce":4065849973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6819","nonce":4065849973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6823","nonce":4065849973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6821","nonce":4065849973}]},"public_addr":"172.21.15.57:6817/4065849973","cluster_addr":"172.21.15.57:6819/4065849973","heartbeat_back_addr":"172.21.15.57:6823/4065849973","heartbeat_front_addr":"172.21.15.57:6821/4065849973","state":["exists","up"]},{"osd":3,"uuid":"a389af1d-76c4-4dfc-b215-f983f4931257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6825","nonce":158084809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6827","nonce":158084809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6831","nonce":158084809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6829","nonce":158084809}]},"public_addr":"172.21.15.57:6825/158084809","cluster_addr":"172.21.15.57:6827/158084809","heartbeat_back_addr":"172.21.15.57:6831/158084809","heartbeat_front_addr":"172.21.15.57:6829/158084809","state":["exists","up"]},{"osd":4,"uuid":"e9b05dca-557a-43ee-b43f-9ce5b7d28304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6823","nonce":108719401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6827","nonce":108719401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6831","nonce":108719401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6829","nonce":108719401}]},"public_addr":"172.21.15.118:6823/108719401","cluster_addr":"172.21.15.118:6827/108719401","heartbeat_back_addr":"172.21.15.118:6831/108719401","heartbeat_front_addr":"172.21.15.118:6829/108719401","state":["exists","up"]},{"osd":5,"uuid":"d968177d-44ff-499a-b00a-b147ed879253","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6817","nonce":2704605866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6819","nonce":2704605866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6826","nonce":2704605866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6822","nonce":2704605866}]},"public_addr":"172.21.15.118:6817/2704605866","cluster_addr":"172.21.15.118:6819/2704605866","heartbeat_back_addr":"172.21.15.118:6826/2704605866","heartbeat_front_addr":"172.21.15.118:6822/2704605866","state":["exists","up"]},{"osd":6,"uuid":"e8f98052-e6ad-4cfe-a4a9-0b17a434d54e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6801","nonce":1963659095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6803","nonce":1963659095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6807","nonce":1963659095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6805","nonce":1963659095}]},"public_addr":"172.21.15.118:6801/1963659095","cluster_addr":"172.21.15.118:6803/1963659095","heartbeat_back_addr":"172.21.15.118:6807/1963659095","heartbeat_front_addr":"172.21.15.118:6805/1963659095","state":["exists","up"]},{"osd":7,"uuid":"eccff987-8e51-4a63-845a-cf0a3196d7fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6809","nonce":1955879596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6811","nonce":1955879596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6815","nonce":1955879596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6813","nonce":1955879596}]},"public_addr":"172.21.15.118:6809/1955879596","cluster_addr":"172.21.15.118:6811/1955879596","heartbeat_back_addr":"172.21.15.118:6815/1955879596","heartbeat_front_addr":"172.21.15.118:6813/1955879596","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.721258+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.696610+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.777895+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.806769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.743259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.845687+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:13.020165+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.722294+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.e","mappings":[{"from":7,"to":1}]},{"pgid":"3.15","mappings":[{"from":3,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-27T10:00:47.984 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:00:47.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.996+0000 7f4e1dc00640 1 -- 172.21.15.57:0/1826501801 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f4df406c530 msgr2=0x7f4df406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:47.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.996+0000 7f4e1dc00640 1 --2- 172.21.15.57:0/1826501801 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f4df406c530 0x7f4df406e9f0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4e180b3fb0 tx=0x7f4e00008040 comp rx=0 tx=0).stop 2024-03-27T10:00:47.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.996+0000 7f4e1dc00640 1 -- 172.21.15.57:0/1826501801 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e1806b750 msgr2=0x7f4e181f3f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:47.985 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.996+0000 7f4e1dc00640 1 --2- 172.21.15.57:0/1826501801 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e1806b750 0x7f4e181f3f60 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f4e08000c00 tx=0x7f4e080046c0 comp rx=0 tx=0).stop 2024-03-27T10:00:47.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.996+0000 7f4e1dc00640 1 -- 172.21.15.57:0/1826501801 shutdown_connections 2024-03-27T10:00:47.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.996+0000 7f4e1dc00640 1 --2- 172.21.15.57:0/1826501801 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4e18145820 0x7f4e1813f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:47.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.996+0000 7f4e1dc00640 1 --2- 172.21.15.57:0/1826501801 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f4df406c530 0x7f4df406e9f0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:47.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.996+0000 7f4e1dc00640 1 --2- 172.21.15.57:0/1826501801 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4e180b2b70 0x7f4e180cf150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:47.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.996+0000 7f4e1dc00640 1 --2- 172.21.15.57:0/1826501801 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4e1806b750 0x7f4e181f3f60 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:47.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.996+0000 7f4e1dc00640 1 -- 172.21.15.57:0/1826501801 >> 172.21.15.57:0/1826501801 conn(0x7f4e180b1c60 msgr2=0x7f4e1815f2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:47.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.996+0000 7f4e1dc00640 1 -- 172.21.15.57:0/1826501801 shutdown_connections 2024-03-27T10:00:47.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:47.996+0000 7f4e1dc00640 1 -- 172.21.15.57:0/1826501801 wait complete. 2024-03-27T10:00:47.993 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:00:48.004 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-27T09:59:17.253008+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-27T09:59:26.690365+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-27T09:59:27.559059+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-27T09:59:31.187596+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-27T10:00:48.004 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-27T10:00:48.275 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.287+0000 7fcc2f200640 1 Processor -- start 2024-03-27T10:00:48.275 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.287+0000 7fcc2f200640 1 -- start start 2024-03-27T10:00:48.277 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.289+0000 7fcc2f200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcc300cee30 0x7fcc3006d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:48.277 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.289+0000 7fcc2f200640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc300ca330 con 0x7fcc301601a0 2024-03-27T10:00:48.277 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.289+0000 7fcc2f200640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc300ca610 con 0x7fcc301458e0 2024-03-27T10:00:48.277 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.289+0000 7fcc2f200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fcc300ca8f0 con 0x7fcc300cee30 2024-03-27T10:00:48.277 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.289+0000 7fcc25400640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fcc301601a0 0x7fcc300ce720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:54394/0 (socket says 172.21.15.57:54394) 2024-03-27T10:00:48.278 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.289+0000 7fcc25400640 1 -- 172.21.15.57:0/3477248610 learned_addr learned my addr 172.21.15.57:0/3477248610 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T10:00:48.279 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.289+0000 7fcc2d400640 1 -- 172.21.15.57:0/3477248610 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1000936748 0 0) 0x7fcc300ca330 con 0x7fcc301601a0 2024-03-27T10:00:48.279 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.289+0000 7fcc2e800640 1 --2- 172.21.15.57:0/3477248610 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcc300cee30 0x7fcc3006d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:48.279 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.289+0000 7fcc2d400640 1 -- 172.21.15.57:0/3477248610 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcc14003520 con 0x7fcc301601a0 2024-03-27T10:00:48.279 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.290+0000 7fcc2d400640 1 -- 172.21.15.57:0/3477248610 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3302111924 0 0) 0x7fcc14003520 con 0x7fcc301601a0 2024-03-27T10:00:48.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.290+0000 7fcc2d400640 1 -- 172.21.15.57:0/3477248610 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcc300cee30 msgr2=0x7fcc3006d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:48.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.290+0000 7fcc2d400640 1 --2- 172.21.15.57:0/3477248610 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcc300cee30 0x7fcc3006d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:48.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.290+0000 7fcc2d400640 1 -- 172.21.15.57:0/3477248610 >> v1:172.21.15.118:6789/0 conn(0x7fcc301458e0 legacy=0x7fcc3015fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:48.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.290+0000 7fcc2d400640 1 -- 172.21.15.57:0/3477248610 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc300cabd0 con 0x7fcc301601a0 2024-03-27T10:00:48.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.290+0000 7fcc2d400640 1 -- 172.21.15.57:0/3477248610 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4227751516 0 0) 0x7fcc18001670 con 0x7fcc301601a0 2024-03-27T10:00:48.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.290+0000 7fcc2d400640 1 -- 172.21.15.57:0/3477248610 >> v1:172.21.15.57:6789/0 conn(0x7fcc301601a0 legacy=0x7fcc300ce720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:48.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.290+0000 7fcc2d400640 1 --2- 172.21.15.57:0/3477248610 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcc300cee30 0x7fcc140039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:48.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.290+0000 7fcc2d400640 1 --2- 172.21.15.57:0/3477248610 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcc14003f60 0x7fcc14004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:48.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.290+0000 7fcc2d400640 1 --2- 172.21.15.57:0/3477248610 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcc14004d40 0x7fcc140051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:48.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.290+0000 7fcc2d400640 1 -- 172.21.15.57:0/3477248610 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fcc300ca8f0 con 0x7fcc14004d40 2024-03-27T10:00:48.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.290+0000 7fcc2d400640 1 -- 172.21.15.57:0/3477248610 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fcc1400baa0 con 0x7fcc14003f60 2024-03-27T10:00:48.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.290+0000 7fcc2d400640 1 -- 172.21.15.57:0/3477248610 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fcc1400bca0 con 0x7fcc300cee30 2024-03-27T10:00:48.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.290+0000 7fcc2e800640 1 --2- 172.21.15.57:0/3477248610 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcc14004d40 0x7fcc140051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:48.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.291+0000 7fcc25400640 1 --2- 172.21.15.57:0/3477248610 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcc14003f60 0x7fcc14004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:48.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.291+0000 7fcc2e800640 1 -- 172.21.15.57:0/3477248610 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcc300cee30 msgr2=0x7fcc140039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:48.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.291+0000 7fcc2e800640 1 --2- 172.21.15.57:0/3477248610 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcc300cee30 0x7fcc140039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:48.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.291+0000 7fcc2e800640 1 -- 172.21.15.57:0/3477248610 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcc14003f60 msgr2=0x7fcc14004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:48.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.291+0000 7fcc2e800640 1 --2- 172.21.15.57:0/3477248610 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcc14003f60 0x7fcc14004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:48.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.291+0000 7fcc2e800640 1 -- 172.21.15.57:0/3477248610 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc14003520 con 0x7fcc14004d40 2024-03-27T10:00:48.282 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.292+0000 7fcc2e800640 1 --2- 172.21.15.57:0/3477248610 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcc14004d40 0x7fcc140051c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fcc28009f90 tx=0x7fcc14005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37896ee0e177ec4e server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:48.282 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.292+0000 7fcc2d400640 1 -- 172.21.15.57:0/3477248610 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc28039070 con 0x7fcc14004d40 2024-03-27T10:00:48.282 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.292+0000 7fcc2d400640 1 -- 172.21.15.57:0/3477248610 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc2802cc20 con 0x7fcc14004d40 2024-03-27T10:00:48.282 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.292+0000 7fcc2d400640 1 -- 172.21.15.57:0/3477248610 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc28009c10 con 0x7fcc14004d40 2024-03-27T10:00:48.282 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.293+0000 7fcc2f200640 1 -- 172.21.15.57:0/3477248610 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcc14004d40 msgr2=0x7fcc140051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:48.282 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.293+0000 7fcc2f200640 1 --2- 172.21.15.57:0/3477248610 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcc14004d40 0x7fcc140051c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fcc28009f90 tx=0x7fcc14005830 comp rx=0 tx=0).stop 2024-03-27T10:00:48.282 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.293+0000 7fcc2e800640 1 -- 172.21.15.57:0/3477248610 reap_dead start 2024-03-27T10:00:48.282 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.293+0000 7fcc2f200640 1 -- 172.21.15.57:0/3477248610 shutdown_connections 2024-03-27T10:00:48.283 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.293+0000 7fcc2f200640 1 -- 172.21.15.57:0/3477248610 >> 172.21.15.57:0/3477248610 conn(0x7fcc300cfb40 msgr2=0x7fcc300cff20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:48.283 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.293+0000 7fcc2f200640 1 -- 172.21.15.57:0/3477248610 shutdown_connections 2024-03-27T10:00:48.283 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.293+0000 7fcc2f200640 1 -- 172.21.15.57:0/3477248610 wait complete. 2024-03-27T10:00:48.283 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.295+0000 7fcc2f200640 1 Processor -- start 2024-03-27T10:00:48.283 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.295+0000 7fcc2f200640 1 -- start start 2024-03-27T10:00:48.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.296+0000 7fcc2f200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcc14004d40 0x7fcc300c7c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:48.286 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.296+0000 7fcc2f200640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcc3013f860 0x7fcc30144e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:48.286 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.296+0000 7fcc2f200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcc300c5a30 0x7fcc300c5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:48.286 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.296+0000 7fcc2f200640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fcc3006d400 con 0x7fcc3013f860 2024-03-27T10:00:48.286 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.296+0000 7fcc2f200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fcc3006d280 con 0x7fcc300c5a30 2024-03-27T10:00:48.286 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.296+0000 7fcc2f200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fcc300cb0f0 con 0x7fcc14004d40 2024-03-27T10:00:48.286 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.297+0000 7fcc25400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcc3013f860 0x7fcc30144e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:48.286 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.297+0000 7fcc25400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcc3013f860 0x7fcc30144e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44442/0 (socket says 172.21.15.57:44442) 2024-03-27T10:00:48.286 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.297+0000 7fcc25400640 1 -- 172.21.15.57:0/2194823176 learned_addr learned my addr 172.21.15.57:0/2194823176 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:48.286 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.297+0000 7fcc2de00640 1 --2- 172.21.15.57:0/2194823176 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcc14004d40 0x7fcc300c7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:48.286 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.297+0000 7fcc2e800640 1 --2- 172.21.15.57:0/2194823176 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcc300c5a30 0x7fcc300c5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:48.286 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.297+0000 7fcc25400640 1 -- 172.21.15.57:0/2194823176 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcc14004d40 msgr2=0x7fcc300c7c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:48.286 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.297+0000 7fcc25400640 1 --2- 172.21.15.57:0/2194823176 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcc14004d40 0x7fcc300c7c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:48.286 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.297+0000 7fcc25400640 1 -- 172.21.15.57:0/2194823176 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcc300c5a30 msgr2=0x7fcc300c5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:48.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.297+0000 7fcc25400640 1 --2- 172.21.15.57:0/2194823176 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcc300c5a30 0x7fcc300c5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:48.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.297+0000 7fcc25400640 1 -- 172.21.15.57:0/2194823176 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc3013fce0 con 0x7fcc3013f860 2024-03-27T10:00:48.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.297+0000 7fcc25400640 1 --2- 172.21.15.57:0/2194823176 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcc3013f860 0x7fcc30144e20 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fcc1800e8c0 tx=0x7fcc1800ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:48.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.298+0000 7fcc26a00640 1 -- 172.21.15.57:0/2194823176 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc1800c8d0 con 0x7fcc3013f860 2024-03-27T10:00:48.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.298+0000 7fcc26a00640 1 -- 172.21.15.57:0/2194823176 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc18018070 con 0x7fcc3013f860 2024-03-27T10:00:48.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.298+0000 7fcc26a00640 1 -- 172.21.15.57:0/2194823176 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc1800ccd0 con 0x7fcc3013f860 2024-03-27T10:00:48.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.298+0000 7fcc2f200640 1 -- 172.21.15.57:0/2194823176 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc300c8350 con 0x7fcc3013f860 2024-03-27T10:00:48.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.298+0000 7fcc2f200640 1 -- 172.21.15.57:0/2194823176 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc3015ec70 con 0x7fcc3013f860 2024-03-27T10:00:48.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.299+0000 7fcc2f200640 1 -- 172.21.15.57:0/2194823176 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc30068540 con 0x7fcc3013f860 2024-03-27T10:00:48.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.300+0000 7fcc26a00640 1 -- 172.21.15.57:0/2194823176 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fcc1801d460 con 0x7fcc3013f860 2024-03-27T10:00:48.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.301+0000 7fcc26a00640 1 --2- 172.21.15.57:0/2194823176 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fcc0c06c560 0x7fcc0c06ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:48.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.301+0000 7fcc26a00640 1 -- 172.21.15.57:0/2194823176 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fcc1808bb90 con 0x7fcc3013f860 2024-03-27T10:00:48.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.301+0000 7fcc2de00640 1 --2- 172.21.15.57:0/2194823176 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fcc0c06c560 0x7fcc0c06ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:48.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.302+0000 7fcc2de00640 1 --2- 172.21.15.57:0/2194823176 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fcc0c06c560 0x7fcc0c06ea20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fcc20001680 tx=0x7fcc20009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:48.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.306+0000 7fcc26a00640 1 -- 172.21.15.57:0/2194823176 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7fcc18059d10 con 0x7fcc3013f860 2024-03-27T10:00:48.498 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.509+0000 7fcc2f200640 1 -- 172.21.15.57:0/2194823176 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fcc30145360 con 0x7fcc3013f860 2024-03-27T10:00:48.498 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.510+0000 7fcc26a00640 1 -- 172.21.15.57:0/2194823176 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) ==== 93+0+10 (secure 0 0 0) 0x7fcc18059610 con 0x7fcc3013f860 2024-03-27T10:00:48.499 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2024-03-27T10:00:48.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.513+0000 7fcc2f200640 1 -- 172.21.15.57:0/2194823176 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fcc0c06c560 msgr2=0x7fcc0c06ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:48.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.513+0000 7fcc2f200640 1 --2- 172.21.15.57:0/2194823176 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fcc0c06c560 0x7fcc0c06ea20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fcc20001680 tx=0x7fcc20009040 comp rx=0 tx=0).stop 2024-03-27T10:00:48.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.513+0000 7fcc2f200640 1 -- 172.21.15.57:0/2194823176 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcc3013f860 msgr2=0x7fcc30144e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:48.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.513+0000 7fcc2f200640 1 --2- 172.21.15.57:0/2194823176 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcc3013f860 0x7fcc30144e20 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fcc1800e8c0 tx=0x7fcc1800ed80 comp rx=0 tx=0).stop 2024-03-27T10:00:48.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.513+0000 7fcc2f200640 1 -- 172.21.15.57:0/2194823176 shutdown_connections 2024-03-27T10:00:48.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.513+0000 7fcc2f200640 1 --2- 172.21.15.57:0/2194823176 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fcc0c06c560 0x7fcc0c06ea20 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:48.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.513+0000 7fcc2f200640 1 --2- 172.21.15.57:0/2194823176 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcc300c5a30 0x7fcc300c5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:48.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.513+0000 7fcc2f200640 1 --2- 172.21.15.57:0/2194823176 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcc3013f860 0x7fcc30144e20 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:48.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.513+0000 7fcc2f200640 1 --2- 172.21.15.57:0/2194823176 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcc14004d40 0x7fcc300c7c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:48.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.513+0000 7fcc2f200640 1 -- 172.21.15.57:0/2194823176 >> 172.21.15.57:0/2194823176 conn(0x7fcc300cfb40 msgr2=0x7fcc30140ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:48.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.514+0000 7fcc2f200640 1 -- 172.21.15.57:0/2194823176 shutdown_connections 2024-03-27T10:00:48.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.514+0000 7fcc2f200640 1 -- 172.21.15.57:0/2194823176 wait complete. 2024-03-27T10:00:48.521 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-27T10:00:48.744 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.756+0000 7f7037200640 1 Processor -- start 2024-03-27T10:00:48.744 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.756+0000 7f7037200640 1 -- start start 2024-03-27T10:00:48.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.757+0000 7f7037200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f70380ca190 0x7f7038162bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:48.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.757+0000 7f7037200640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f70380cdc20 0x7f70380ca570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:48.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.757+0000 7f7037200640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70380caab0 con 0x7f70381661a0 2024-03-27T10:00:48.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.757+0000 7f7037200640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f70380ce060 con 0x7f70380cdc20 2024-03-27T10:00:48.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.757+0000 7f7037200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f70380ceea0 con 0x7f70380ca190 2024-03-27T10:00:48.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.758+0000 7f702fe00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f70380cdc20 0x7f70380ca570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:48.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.758+0000 7f702fe00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f70380cdc20 0x7f70380ca570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.57:58096/0 (socket says 172.21.15.57:58096) 2024-03-27T10:00:48.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.758+0000 7f702fe00640 1 -- 172.21.15.57:0/2131210641 learned_addr learned my addr 172.21.15.57:0/2131210641 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:48.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.758+0000 7f7035e00640 1 --2- 172.21.15.57:0/2131210641 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f70380ca190 0x7f7038162bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:48.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.759+0000 7f702fe00640 1 -- 172.21.15.57:0/2131210641 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f70380ca190 msgr2=0x7f7038162bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:48.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.759+0000 7f702fe00640 1 --2- 172.21.15.57:0/2131210641 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f70380ca190 0x7f7038162bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:48.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.759+0000 7f702fe00640 1 -- 172.21.15.57:0/2131210641 >> v1:172.21.15.118:6789/0 conn(0x7f70381661a0 legacy=0x7f7038166600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:48.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.759+0000 7f702fe00640 1 -- 172.21.15.57:0/2131210641 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70380ce290 con 0x7f70380cdc20 2024-03-27T10:00:48.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.760+0000 7f702fe00640 1 --2- 172.21.15.57:0/2131210641 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f70380cdc20 0x7f70380ca570 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7020009870 tx=0x7f702002ba20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=28d7a8232961304f server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:48.749 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.761+0000 7f7035400640 1 -- 172.21.15.57:0/2131210641 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f702002f840 con 0x7f70380cdc20 2024-03-27T10:00:48.749 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.761+0000 7f7035400640 1 -- 172.21.15.57:0/2131210641 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f702002f9e0 con 0x7f70380cdc20 2024-03-27T10:00:48.749 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.761+0000 7f7035400640 1 -- 172.21.15.57:0/2131210641 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f702002fdb0 con 0x7f70380cdc20 2024-03-27T10:00:48.750 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.761+0000 7f7037200640 1 -- 172.21.15.57:0/2131210641 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f70380cdc20 msgr2=0x7f70380ca570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:48.750 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.761+0000 7f7037200640 1 --2- 172.21.15.57:0/2131210641 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f70380cdc20 0x7f70380ca570 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7020009870 tx=0x7f702002ba20 comp rx=0 tx=0).stop 2024-03-27T10:00:48.750 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.761+0000 7f7037200640 1 -- 172.21.15.57:0/2131210641 shutdown_connections 2024-03-27T10:00:48.750 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.761+0000 7f7037200640 1 --2- 172.21.15.57:0/2131210641 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f70380cdc20 0x7f70380ca570 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:48.750 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.761+0000 7f7037200640 1 --2- 172.21.15.57:0/2131210641 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f70380ca190 0x7f7038162bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:48.750 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.761+0000 7f7037200640 1 -- 172.21.15.57:0/2131210641 >> 172.21.15.57:0/2131210641 conn(0x7f70380cfb40 msgr2=0x7f70380cff20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:48.750 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.761+0000 7f7037200640 1 -- 172.21.15.57:0/2131210641 shutdown_connections 2024-03-27T10:00:48.750 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.761+0000 7f7037200640 1 -- 172.21.15.57:0/2131210641 wait complete. 2024-03-27T10:00:48.751 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.763+0000 7f7037200640 1 Processor -- start 2024-03-27T10:00:48.751 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.763+0000 7f7037200640 1 -- start start 2024-03-27T10:00:48.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.764+0000 7f7037200640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f70380ca190 0x7f7038161de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:48.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.764+0000 7f7037200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f70380cdc20 0x7f70380c6e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:48.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.764+0000 7f7037200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f70381661a0 0x7f7038160d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:48.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.764+0000 7f7037200640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f70380ceb30 con 0x7f70380ca190 2024-03-27T10:00:48.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.764+0000 7f7037200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f70380ce850 con 0x7f70381661a0 2024-03-27T10:00:48.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.764+0000 7f7037200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f70380cd940 con 0x7f70380cdc20 2024-03-27T10:00:48.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.764+0000 7f7035e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f70380ca190 0x7f7038161de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:48.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.764+0000 7f7035e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f70380ca190 0x7f7038161de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44448/0 (socket says 172.21.15.57:44448) 2024-03-27T10:00:48.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.765+0000 7f7035e00640 1 -- 172.21.15.57:0/3165719814 learned_addr learned my addr 172.21.15.57:0/3165719814 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:48.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.765+0000 7f7036800640 1 --2- 172.21.15.57:0/3165719814 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f70381661a0 0x7f7038160d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:48.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.765+0000 7f702fe00640 1 --2- 172.21.15.57:0/3165719814 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f70380cdc20 0x7f70380c6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:48.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.765+0000 7f7035e00640 1 -- 172.21.15.57:0/3165719814 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f70380cdc20 msgr2=0x7f70380c6e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:48.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.765+0000 7f7035e00640 1 --2- 172.21.15.57:0/3165719814 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f70380cdc20 0x7f70380c6e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:48.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.765+0000 7f7035e00640 1 -- 172.21.15.57:0/3165719814 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f70381661a0 msgr2=0x7f7038160d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:48.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.765+0000 7f7035e00640 1 --2- 172.21.15.57:0/3165719814 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f70381661a0 0x7f7038160d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:48.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.765+0000 7f7035e00640 1 -- 172.21.15.57:0/3165719814 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7038148600 con 0x7f70380ca190 2024-03-27T10:00:48.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.765+0000 7f702fe00640 1 --2- 172.21.15.57:0/3165719814 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f70380cdc20 0x7f70380c6e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T10:00:48.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.765+0000 7f7035e00640 1 --2- 172.21.15.57:0/3165719814 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f70380ca190 0x7f7038161de0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f702800e9e0 tx=0x7f702800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:48.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.766+0000 7f702e000640 1 -- 172.21.15.57:0/3165719814 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7028017070 con 0x7f70380ca190 2024-03-27T10:00:48.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.766+0000 7f702e000640 1 -- 172.21.15.57:0/3165719814 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f702800c9d0 con 0x7f70380ca190 2024-03-27T10:00:48.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.766+0000 7f702e000640 1 -- 172.21.15.57:0/3165719814 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f702800cdc0 con 0x7f70380ca190 2024-03-27T10:00:48.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.766+0000 7f7037200640 1 -- 172.21.15.57:0/3165719814 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70381488e0 con 0x7f70380ca190 2024-03-27T10:00:48.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.766+0000 7f7037200640 1 -- 172.21.15.57:0/3165719814 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7038148ea0 con 0x7f70380ca190 2024-03-27T10:00:48.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.767+0000 7f7037200640 1 -- 172.21.15.57:0/3165719814 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7038068540 con 0x7f70380ca190 2024-03-27T10:00:48.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.768+0000 7f702e000640 1 -- 172.21.15.57:0/3165719814 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f702801a070 con 0x7f70380ca190 2024-03-27T10:00:48.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.769+0000 7f702e000640 1 --2- 172.21.15.57:0/3165719814 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f701406c530 0x7f701406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:48.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.769+0000 7f702e000640 1 -- 172.21.15.57:0/3165719814 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f702808bf50 con 0x7f70380ca190 2024-03-27T10:00:48.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.769+0000 7f702fe00640 1 --2- 172.21.15.57:0/3165719814 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f701406c530 0x7f701406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:48.758 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.770+0000 7f702fe00640 1 --2- 172.21.15.57:0/3165719814 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f701406c530 0x7f701406e9f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7020036000 tx=0x7f7020039040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:48.761 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.773+0000 7f702e000640 1 -- 172.21.15.57:0/3165719814 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f702805a0d0 con 0x7f70380ca190 2024-03-27T10:00:48.964 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.976+0000 7f7037200640 1 -- 172.21.15.57:0/3165719814 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f70380c69a0 con 0x7f70380ca190 2024-03-27T10:00:48.965 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.977+0000 7f702e000640 1 -- 172.21.15.57:0/3165719814 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) ==== 104+0+11 (secure 0 0 0) 0x7f70280599d0 con 0x7f70380ca190 2024-03-27T10:00:48.966 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2024-03-27T10:00:48.969 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.980+0000 7f7037200640 1 -- 172.21.15.57:0/3165719814 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f701406c530 msgr2=0x7f701406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:48.969 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.980+0000 7f7037200640 1 --2- 172.21.15.57:0/3165719814 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f701406c530 0x7f701406e9f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7020036000 tx=0x7f7020039040 comp rx=0 tx=0).stop 2024-03-27T10:00:48.969 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.980+0000 7f7037200640 1 -- 172.21.15.57:0/3165719814 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f70380ca190 msgr2=0x7f7038161de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:48.969 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.980+0000 7f7037200640 1 --2- 172.21.15.57:0/3165719814 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f70380ca190 0x7f7038161de0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f702800e9e0 tx=0x7f702800eea0 comp rx=0 tx=0).stop 2024-03-27T10:00:48.969 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.980+0000 7f7037200640 1 -- 172.21.15.57:0/3165719814 shutdown_connections 2024-03-27T10:00:48.969 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.980+0000 7f7037200640 1 --2- 172.21.15.57:0/3165719814 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f701406c530 0x7f701406e9f0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:48.969 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.980+0000 7f7037200640 1 --2- 172.21.15.57:0/3165719814 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f70381661a0 0x7f7038160d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:48.969 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.980+0000 7f7037200640 1 --2- 172.21.15.57:0/3165719814 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f70380cdc20 0x7f70380c6e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:48.969 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.980+0000 7f7037200640 1 --2- 172.21.15.57:0/3165719814 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f70380ca190 0x7f7038161de0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:48.969 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.980+0000 7f7037200640 1 -- 172.21.15.57:0/3165719814 >> 172.21.15.57:0/3165719814 conn(0x7f70380cfb40 msgr2=0x7f7038146ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:48.969 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.980+0000 7f7037200640 1 -- 172.21.15.57:0/3165719814 shutdown_connections 2024-03-27T10:00:48.969 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:48.980+0000 7f7037200640 1 -- 172.21.15.57:0/3165719814 wait complete. 2024-03-27T10:00:48.989 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-27T10:00:49.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.221+0000 7fc45fe00640 1 Processor -- start 2024-03-27T10:00:49.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.221+0000 7fc45fe00640 1 -- start start 2024-03-27T10:00:49.211 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.222+0000 7fc45fe00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fc4601458e0 0x7fc46006d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:49.211 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.222+0000 7fc45fe00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc46015fa90 0x7fc46015fef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:49.211 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.222+0000 7fc45fe00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc4600cb0f0 0x7fc4600cb540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:49.211 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.222+0000 7fc45fe00640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7fc460160430 con 0x7fc4600cb0f0 2024-03-27T10:00:49.211 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.222+0000 7fc45fe00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7fc4600ca330 con 0x7fc4601458e0 2024-03-27T10:00:49.211 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.222+0000 7fc45fe00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fc4600ca610 con 0x7fc46015fa90 2024-03-27T10:00:49.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.223+0000 7fc45f400640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc4600cb0f0 0x7fc4600cb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:49.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.223+0000 7fc45f400640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc4600cb0f0 0x7fc4600cb540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44464/0 (socket says 172.21.15.57:44464) 2024-03-27T10:00:49.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.223+0000 7fc45f400640 1 -- 172.21.15.57:0/1689326270 learned_addr learned my addr 172.21.15.57:0/1689326270 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:49.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.223+0000 7fc45ea00640 1 --2- 172.21.15.57:0/1689326270 >> v2:172.21.15.118:3300/0 conn(0x7fc4601458e0 0x7fc46006d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:49.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.223+0000 7fc457e00640 1 --2- 172.21.15.57:0/1689326270 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc46015fa90 0x7fc46015fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:49.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.223+0000 7fc45f400640 1 -- 172.21.15.57:0/1689326270 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc46015fa90 msgr2=0x7fc46015fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:49.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.223+0000 7fc45f400640 1 --2- 172.21.15.57:0/1689326270 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc46015fa90 0x7fc46015fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:49.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.223+0000 7fc45f400640 1 -- 172.21.15.57:0/1689326270 >> v2:172.21.15.118:3300/0 conn(0x7fc4601458e0 msgr2=0x7fc46006d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:49.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.223+0000 7fc45f400640 1 --2- 172.21.15.57:0/1689326270 >> v2:172.21.15.118:3300/0 conn(0x7fc4601458e0 0x7fc46006d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:49.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.223+0000 7fc45f400640 1 -- 172.21.15.57:0/1689326270 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4600ca8f0 con 0x7fc4600cb0f0 2024-03-27T10:00:49.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.223+0000 7fc457e00640 1 --2- 172.21.15.57:0/1689326270 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc46015fa90 0x7fc46015fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T10:00:49.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.225+0000 7fc45f400640 1 --2- 172.21.15.57:0/1689326270 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc4600cb0f0 0x7fc4600cb540 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fc4600508d0 tx=0x7fc45802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ae0425686c7dae9 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:49.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.225+0000 7fc45e000640 1 -- 172.21.15.57:0/1689326270 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc45802ca70 con 0x7fc4600cb0f0 2024-03-27T10:00:49.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.225+0000 7fc45e000640 1 -- 172.21.15.57:0/1689326270 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc45802cc10 con 0x7fc4600cb0f0 2024-03-27T10:00:49.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.225+0000 7fc45e000640 1 -- 172.21.15.57:0/1689326270 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4580343f0 con 0x7fc4600cb0f0 2024-03-27T10:00:49.215 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.226+0000 7fc45fe00640 1 -- 172.21.15.57:0/1689326270 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc4600cb0f0 msgr2=0x7fc4600cb540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:49.215 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.226+0000 7fc45fe00640 1 --2- 172.21.15.57:0/1689326270 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc4600cb0f0 0x7fc4600cb540 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fc4600508d0 tx=0x7fc45802bed0 comp rx=0 tx=0).stop 2024-03-27T10:00:49.215 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.226+0000 7fc45fe00640 1 -- 172.21.15.57:0/1689326270 shutdown_connections 2024-03-27T10:00:49.215 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.226+0000 7fc45fe00640 1 --2- 172.21.15.57:0/1689326270 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc4600cb0f0 0x7fc4600cb540 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:49.215 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.226+0000 7fc45fe00640 1 --2- 172.21.15.57:0/1689326270 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc46015fa90 0x7fc46015fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:49.215 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.226+0000 7fc45fe00640 1 --2- 172.21.15.57:0/1689326270 >> v2:172.21.15.118:3300/0 conn(0x7fc4601458e0 0x7fc46006d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:49.215 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.226+0000 7fc45fe00640 1 -- 172.21.15.57:0/1689326270 >> 172.21.15.57:0/1689326270 conn(0x7fc4600cfb40 msgr2=0x7fc4600cff20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:49.215 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.226+0000 7fc45fe00640 1 -- 172.21.15.57:0/1689326270 shutdown_connections 2024-03-27T10:00:49.215 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.226+0000 7fc45fe00640 1 -- 172.21.15.57:0/1689326270 wait complete. 2024-03-27T10:00:49.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.228+0000 7fc45fe00640 1 Processor -- start 2024-03-27T10:00:49.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.228+0000 7fc45fe00640 1 -- start start 2024-03-27T10:00:49.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.229+0000 7fc45fe00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc4600cb0f0 0x7fc4601f0f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:49.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.229+0000 7fc45fe00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc4601458e0 0x7fc4600b2890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:49.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.229+0000 7fc45fe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc46015fa90 0x7fc4601f4b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:49.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.229+0000 7fc45fe00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fc4600cbc00 con 0x7fc4601458e0 2024-03-27T10:00:49.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.229+0000 7fc45fe00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fc4600cba80 con 0x7fc46015fa90 2024-03-27T10:00:49.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.229+0000 7fc45fe00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fc4600cbd80 con 0x7fc4600cb0f0 2024-03-27T10:00:49.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.229+0000 7fc457e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc4601458e0 0x7fc4600b2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:49.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.229+0000 7fc457e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc4601458e0 0x7fc4600b2890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44480/0 (socket says 172.21.15.57:44480) 2024-03-27T10:00:49.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.229+0000 7fc457e00640 1 -- 172.21.15.57:0/52984976 learned_addr learned my addr 172.21.15.57:0/52984976 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:49.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.229+0000 7fc457e00640 1 -- 172.21.15.57:0/52984976 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc4600cb0f0 msgr2=0x7fc4601f0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:49.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.229+0000 7fc457e00640 1 --2- 172.21.15.57:0/52984976 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc4600cb0f0 0x7fc4601f0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:49.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.229+0000 7fc45f400640 1 --2- 172.21.15.57:0/52984976 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc46015fa90 0x7fc4601f4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:49.219 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.229+0000 7fc457e00640 1 -- 172.21.15.57:0/52984976 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc46015fa90 msgr2=0x7fc4601f4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:49.219 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.229+0000 7fc457e00640 1 --2- 172.21.15.57:0/52984976 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc46015fa90 0x7fc4601f4b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:49.219 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.229+0000 7fc457e00640 1 -- 172.21.15.57:0/52984976 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4600c8b00 con 0x7fc4601458e0 2024-03-27T10:00:49.219 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.230+0000 7fc457e00640 1 --2- 172.21.15.57:0/52984976 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc4601458e0 0x7fc4600b2890 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fc44800c7f0 tx=0x7fc44800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:49.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.230+0000 7fc456a00640 1 -- 172.21.15.57:0/52984976 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc448015070 con 0x7fc4601458e0 2024-03-27T10:00:49.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.230+0000 7fc456a00640 1 -- 172.21.15.57:0/52984976 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc448007a30 con 0x7fc4601458e0 2024-03-27T10:00:49.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.230+0000 7fc456a00640 1 -- 172.21.15.57:0/52984976 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc448007e00 con 0x7fc4601458e0 2024-03-27T10:00:49.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.230+0000 7fc45fe00640 1 -- 172.21.15.57:0/52984976 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4600c8de0 con 0x7fc4601458e0 2024-03-27T10:00:49.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.230+0000 7fc45fe00640 1 -- 172.21.15.57:0/52984976 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4600c93a0 con 0x7fc4601458e0 2024-03-27T10:00:49.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.231+0000 7fc45fe00640 1 -- 172.21.15.57:0/52984976 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc460068540 con 0x7fc4601458e0 2024-03-27T10:00:49.220 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.232+0000 7fc456a00640 1 -- 172.21.15.57:0/52984976 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fc448018070 con 0x7fc4601458e0 2024-03-27T10:00:49.222 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.234+0000 7fc456a00640 1 --2- 172.21.15.57:0/52984976 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fc43c06c580 0x7fc43c06ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:49.222 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.234+0000 7fc456a00640 1 -- 172.21.15.57:0/52984976 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fc44808ba40 con 0x7fc4601458e0 2024-03-27T10:00:49.222 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.234+0000 7fc45ea00640 1 --2- 172.21.15.57:0/52984976 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fc43c06c580 0x7fc43c06ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:49.223 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.234+0000 7fc45ea00640 1 --2- 172.21.15.57:0/52984976 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fc43c06c580 0x7fc43c06ea40 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc450009870 tx=0x7fc450008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:49.226 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.238+0000 7fc456a00640 1 -- 172.21.15.57:0/52984976 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7fc448059cd0 con 0x7fc4601458e0 2024-03-27T10:00:49.427 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.439+0000 7fc45fe00640 1 -- 172.21.15.57:0/52984976 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fc4600cf490 con 0x7fc4601458e0 2024-03-27T10:00:49.428 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.440+0000 7fc456a00640 1 -- 172.21.15.57:0/52984976 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) ==== 100+0+11 (secure 0 0 0) 0x7fc4480595d0 con 0x7fc4601458e0 2024-03-27T10:00:49.428 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2024-03-27T10:00:49.431 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.442+0000 7fc45fe00640 1 -- 172.21.15.57:0/52984976 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fc43c06c580 msgr2=0x7fc43c06ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:49.431 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.442+0000 7fc45fe00640 1 --2- 172.21.15.57:0/52984976 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fc43c06c580 0x7fc43c06ea40 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc450009870 tx=0x7fc450008040 comp rx=0 tx=0).stop 2024-03-27T10:00:49.431 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.442+0000 7fc45fe00640 1 -- 172.21.15.57:0/52984976 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc4601458e0 msgr2=0x7fc4600b2890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:49.431 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.442+0000 7fc45fe00640 1 --2- 172.21.15.57:0/52984976 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc4601458e0 0x7fc4600b2890 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fc44800c7f0 tx=0x7fc44800cbf0 comp rx=0 tx=0).stop 2024-03-27T10:00:49.431 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.442+0000 7fc45fe00640 1 -- 172.21.15.57:0/52984976 shutdown_connections 2024-03-27T10:00:49.431 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.442+0000 7fc45fe00640 1 --2- 172.21.15.57:0/52984976 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fc43c06c580 0x7fc43c06ea40 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:49.431 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.442+0000 7fc45fe00640 1 --2- 172.21.15.57:0/52984976 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc46015fa90 0x7fc4601f4b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:49.431 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.442+0000 7fc45fe00640 1 --2- 172.21.15.57:0/52984976 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc4601458e0 0x7fc4600b2890 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:49.431 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.442+0000 7fc45fe00640 1 --2- 172.21.15.57:0/52984976 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc4600cb0f0 0x7fc4601f0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:49.431 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.442+0000 7fc45fe00640 1 -- 172.21.15.57:0/52984976 >> 172.21.15.57:0/52984976 conn(0x7fc4600cfb40 msgr2=0x7fc4600cd6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:49.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.443+0000 7fc45fe00640 1 -- 172.21.15.57:0/52984976 shutdown_connections 2024-03-27T10:00:49.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.443+0000 7fc45fe00640 1 -- 172.21.15.57:0/52984976 wait complete. 2024-03-27T10:00:49.451 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-27T10:00:49.717 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.728+0000 7f13b6800640 1 Processor -- start 2024-03-27T10:00:49.718 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.729+0000 7f13b6800640 1 -- start start 2024-03-27T10:00:49.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.730+0000 7f13b6800640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f13b00aea20 0x7f13b015d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:49.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.730+0000 7f13b6800640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f13b00acd60 0x7f13b00aee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:49.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.730+0000 7f13b6800640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13b00ad1f0 con 0x7f13b00711b0 2024-03-27T10:00:49.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.731+0000 7f13b6800640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f13b00af340 con 0x7f13b00aea20 2024-03-27T10:00:49.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.731+0000 7f13b6800640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f13b006df40 con 0x7f13b00acd60 2024-03-27T10:00:49.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.731+0000 7f13af400640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f13b00aea20 0x7f13b015d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:49.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.731+0000 7f13af400640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f13b00aea20 0x7f13b015d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44482/0 (socket says 172.21.15.57:44482) 2024-03-27T10:00:49.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.731+0000 7f13af400640 1 -- 172.21.15.57:0/2758462334 learned_addr learned my addr 172.21.15.57:0/2758462334 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:49.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.731+0000 7f13a7e00640 1 --2- 172.21.15.57:0/2758462334 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f13b00acd60 0x7f13b00aee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:49.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.731+0000 7f13af400640 1 -- 172.21.15.57:0/2758462334 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f13b00acd60 msgr2=0x7f13b00aee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:49.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.731+0000 7f13af400640 1 --2- 172.21.15.57:0/2758462334 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f13b00acd60 0x7f13b00aee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:49.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.731+0000 7f13af400640 1 -- 172.21.15.57:0/2758462334 >> v1:172.21.15.118:6789/0 conn(0x7f13b00711b0 legacy=0x7f13b00715c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:49.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.731+0000 7f13af400640 1 -- 172.21.15.57:0/2758462334 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13b015c4c0 con 0x7f13b00aea20 2024-03-27T10:00:49.721 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.731+0000 7f13a7e00640 1 --2- 172.21.15.57:0/2758462334 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f13b00acd60 0x7f13b00aee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T10:00:49.721 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.733+0000 7f13af400640 1 --2- 172.21.15.57:0/2758462334 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13b00aea20 0x7f13b015d1a0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f13b00ad3c0 tx=0x7f13a002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a060c9a7e3406b0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:49.721 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.733+0000 7f13aea00640 1 -- 172.21.15.57:0/2758462334 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13a00317c0 con 0x7f13b00aea20 2024-03-27T10:00:49.721 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.733+0000 7f13aea00640 1 -- 172.21.15.57:0/2758462334 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13a0037070 con 0x7f13b00aea20 2024-03-27T10:00:49.722 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.733+0000 7f13aea00640 1 -- 172.21.15.57:0/2758462334 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13a0031b80 con 0x7f13b00aea20 2024-03-27T10:00:49.722 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.734+0000 7f13b6800640 1 -- 172.21.15.57:0/2758462334 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13b00aea20 msgr2=0x7f13b015d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:49.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.734+0000 7f13b6800640 1 --2- 172.21.15.57:0/2758462334 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13b00aea20 0x7f13b015d1a0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f13b00ad3c0 tx=0x7f13a002b860 comp rx=0 tx=0).stop 2024-03-27T10:00:49.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.734+0000 7f13b6800640 1 -- 172.21.15.57:0/2758462334 shutdown_connections 2024-03-27T10:00:49.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.734+0000 7f13b6800640 1 --2- 172.21.15.57:0/2758462334 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f13b00acd60 0x7f13b00aee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:49.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.734+0000 7f13b6800640 1 --2- 172.21.15.57:0/2758462334 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13b00aea20 0x7f13b015d1a0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:49.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.734+0000 7f13b6800640 1 -- 172.21.15.57:0/2758462334 >> 172.21.15.57:0/2758462334 conn(0x7f13b00b18a0 msgr2=0x7f13b00b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:49.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.734+0000 7f13b6800640 1 -- 172.21.15.57:0/2758462334 shutdown_connections 2024-03-27T10:00:49.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.734+0000 7f13b6800640 1 -- 172.21.15.57:0/2758462334 wait complete. 2024-03-27T10:00:49.724 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.736+0000 7f13b6800640 1 Processor -- start 2024-03-27T10:00:49.724 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.736+0000 7f13b6800640 1 -- start start 2024-03-27T10:00:49.726 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.737+0000 7f13b6800640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13b00711b0 0x7f13b00cb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:49.726 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.737+0000 7f13b6800640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f13b00acd60 0x7f13b01f3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:49.726 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.737+0000 7f13b6800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f13b00aea20 0x7f13b014d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:49.726 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.737+0000 7f13b6800640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f13b0072bc0 con 0x7f13b00711b0 2024-03-27T10:00:49.726 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.737+0000 7f13b6800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f13b00728e0 con 0x7f13b00aea20 2024-03-27T10:00:49.726 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.737+0000 7f13b6800640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f13b0072ea0 con 0x7f13b00acd60 2024-03-27T10:00:49.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.737+0000 7f13af400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13b00711b0 0x7f13b00cb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:49.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.737+0000 7f13af400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13b00711b0 0x7f13b00cb8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44484/0 (socket says 172.21.15.57:44484) 2024-03-27T10:00:49.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.737+0000 7f13af400640 1 -- 172.21.15.57:0/2911335221 learned_addr learned my addr 172.21.15.57:0/2911335221 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:49.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.737+0000 7f13afe00640 1 --2- 172.21.15.57:0/2911335221 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f13b00aea20 0x7f13b014d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:49.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.738+0000 7f13af400640 1 -- 172.21.15.57:0/2911335221 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f13b00acd60 msgr2=0x7f13b01f3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:49.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.738+0000 7f13a7e00640 1 --2- 172.21.15.57:0/2911335221 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f13b00acd60 0x7f13b01f3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:49.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.738+0000 7f13af400640 1 --2- 172.21.15.57:0/2911335221 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f13b00acd60 0x7f13b01f3b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:49.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.738+0000 7f13af400640 1 -- 172.21.15.57:0/2911335221 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f13b00aea20 msgr2=0x7f13b014d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:49.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.738+0000 7f13af400640 1 --2- 172.21.15.57:0/2911335221 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f13b00aea20 0x7f13b014d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:49.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.738+0000 7f13af400640 1 -- 172.21.15.57:0/2911335221 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13b01f4060 con 0x7f13b00711b0 2024-03-27T10:00:49.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.738+0000 7f13afe00640 1 --2- 172.21.15.57:0/2911335221 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f13b00aea20 0x7f13b014d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T10:00:49.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.738+0000 7f13af400640 1 --2- 172.21.15.57:0/2911335221 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13b00711b0 0x7f13b00cb8d0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f13a002b8a0 tx=0x7f13a00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:49.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.739+0000 7f13a7400640 1 -- 172.21.15.57:0/2911335221 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13a0032860 con 0x7f13b00711b0 2024-03-27T10:00:49.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.739+0000 7f13a7400640 1 -- 172.21.15.57:0/2911335221 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13a0032a00 con 0x7f13b00711b0 2024-03-27T10:00:49.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.740+0000 7f13b6800640 1 -- 172.21.15.57:0/2911335221 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13b01f42e0 con 0x7f13b00711b0 2024-03-27T10:00:49.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.740+0000 7f13a7400640 1 -- 172.21.15.57:0/2911335221 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13a0032df0 con 0x7f13b00711b0 2024-03-27T10:00:49.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.740+0000 7f13b6800640 1 -- 172.21.15.57:0/2911335221 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13b01f48a0 con 0x7f13b00711b0 2024-03-27T10:00:49.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.741+0000 7f13b6800640 1 -- 172.21.15.57:0/2911335221 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13b00757d0 con 0x7f13b00711b0 2024-03-27T10:00:49.731 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.743+0000 7f13a7400640 1 -- 172.21.15.57:0/2911335221 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f13a004c060 con 0x7f13b00711b0 2024-03-27T10:00:49.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.744+0000 7f13a7400640 1 --2- 172.21.15.57:0/2911335221 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f138c06c530 0x7f138c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:49.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.744+0000 7f13a7400640 1 -- 172.21.15.57:0/2911335221 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f13a00ad530 con 0x7f13b00711b0 2024-03-27T10:00:49.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.744+0000 7f13a7e00640 1 --2- 172.21.15.57:0/2911335221 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f138c06c530 0x7f138c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:49.734 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.746+0000 7f13a7e00640 1 --2- 172.21.15.57:0/2911335221 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f138c06c530 0x7f138c06e9f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f13b015f930 tx=0x7f1398008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:49.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.750+0000 7f13a7400640 1 -- 172.21.15.57:0/2911335221 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f13b01f4060 con 0x7f13b00711b0 2024-03-27T10:00:49.942 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.953+0000 7f13b6800640 1 -- 172.21.15.57:0/2911335221 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f13b01f4ae0 con 0x7f13b00711b0 2024-03-27T10:00:49.942 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.954+0000 7f13a7400640 1 -- 172.21.15.57:0/2911335221 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) ==== 103+0+11 (secure 0 0 0) 0x7f13b01f4ae0 con 0x7f13b00711b0 2024-03-27T10:00:49.942 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2024-03-27T10:00:49.946 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.956+0000 7f13b6800640 1 -- 172.21.15.57:0/2911335221 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f138c06c530 msgr2=0x7f138c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:49.946 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.956+0000 7f13b6800640 1 --2- 172.21.15.57:0/2911335221 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f138c06c530 0x7f138c06e9f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f13b015f930 tx=0x7f1398008040 comp rx=0 tx=0).stop 2024-03-27T10:00:49.946 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.957+0000 7f13b6800640 1 -- 172.21.15.57:0/2911335221 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13b00711b0 msgr2=0x7f13b00cb8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:49.946 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.957+0000 7f13b6800640 1 --2- 172.21.15.57:0/2911335221 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13b00711b0 0x7f13b00cb8d0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f13a002b8a0 tx=0x7f13a00046c0 comp rx=0 tx=0).stop 2024-03-27T10:00:49.946 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.957+0000 7f13b6800640 1 -- 172.21.15.57:0/2911335221 shutdown_connections 2024-03-27T10:00:49.946 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.957+0000 7f13b6800640 1 --2- 172.21.15.57:0/2911335221 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f138c06c530 0x7f138c06e9f0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:49.946 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.957+0000 7f13b6800640 1 --2- 172.21.15.57:0/2911335221 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f13b00aea20 0x7f13b014d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:49.946 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.957+0000 7f13b6800640 1 --2- 172.21.15.57:0/2911335221 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f13b00acd60 0x7f13b01f3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:49.946 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.957+0000 7f13b6800640 1 --2- 172.21.15.57:0/2911335221 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13b00711b0 0x7f13b00cb8d0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:49.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.957+0000 7f13b6800640 1 -- 172.21.15.57:0/2911335221 >> 172.21.15.57:0/2911335221 conn(0x7f13b00b18a0 msgr2=0x7f13b006cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:49.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.957+0000 7f13b6800640 1 -- 172.21.15.57:0/2911335221 shutdown_connections 2024-03-27T10:00:49.947 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:49.957+0000 7f13b6800640 1 -- 172.21.15.57:0/2911335221 wait complete. 2024-03-27T10:00:49.965 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-27T10:00:50.191 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.202+0000 7f8657e00640 1 Processor -- start 2024-03-27T10:00:50.191 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.203+0000 7f8657e00640 1 -- start start 2024-03-27T10:00:50.193 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.204+0000 7f8657e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f865806f080 0x7f8658072020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:50.193 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.204+0000 7f8657e00640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f865806e210 con 0x7f8658071b90 2024-03-27T10:00:50.193 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.204+0000 7f8657e00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f865806e4f0 con 0x7f8658158530 2024-03-27T10:00:50.193 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.204+0000 7f8657e00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f86580710b0 con 0x7f865806f080 2024-03-27T10:00:50.193 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.205+0000 7f864e000640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f8658071b90 0x7f865806e970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:54402/0 (socket says 172.21.15.57:54402) 2024-03-27T10:00:50.193 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.205+0000 7f864e000640 1 -- 172.21.15.57:0/3336083434 learned_addr learned my addr 172.21.15.57:0/3336083434 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T10:00:50.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.205+0000 7f8656000640 1 -- 172.21.15.57:0/3336083434 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3337769978 0 0) 0x7f865806e210 con 0x7f8658071b90 2024-03-27T10:00:50.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.205+0000 7f8657400640 1 --2- 172.21.15.57:0/3336083434 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f865806f080 0x7f8658072020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:50.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.205+0000 7f8656000640 1 -- 172.21.15.57:0/3336083434 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f863c003520 con 0x7f8658071b90 2024-03-27T10:00:50.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.205+0000 7f8656000640 1 -- 172.21.15.57:0/3336083434 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3753458931 0 0) 0x7f863c003520 con 0x7f8658071b90 2024-03-27T10:00:50.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.205+0000 7f8656000640 1 -- 172.21.15.57:0/3336083434 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f865806f080 msgr2=0x7f8658072020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:50.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.205+0000 7f8656000640 1 --2- 172.21.15.57:0/3336083434 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f865806f080 0x7f8658072020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:50.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.205+0000 7f8656000640 1 -- 172.21.15.57:0/3336083434 >> v1:172.21.15.118:6789/0 conn(0x7f8658158530 legacy=0x7f86580ad8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:50.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.205+0000 7f8656000640 1 -- 172.21.15.57:0/3336083434 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8658071390 con 0x7f8658071b90 2024-03-27T10:00:50.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.206+0000 7f8656000640 1 -- 172.21.15.57:0/3336083434 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4227751516 0 0) 0x7f8640001670 con 0x7f8658071b90 2024-03-27T10:00:50.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.206+0000 7f8656000640 1 -- 172.21.15.57:0/3336083434 >> v1:172.21.15.57:6789/0 conn(0x7f8658071b90 legacy=0x7f865806e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:50.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.206+0000 7f8656000640 1 --2- 172.21.15.57:0/3336083434 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f863c0039e0 0x7f863c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:50.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.206+0000 7f8656000640 1 --2- 172.21.15.57:0/3336083434 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f863c004800 0x7f863c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:50.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.206+0000 7f8656000640 1 --2- 172.21.15.57:0/3336083434 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f863c0051c0 0x7f863c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:50.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.206+0000 7f8656000640 1 -- 172.21.15.57:0/3336083434 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f86580710b0 con 0x7f863c0039e0 2024-03-27T10:00:50.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.206+0000 7f8656000640 1 -- 172.21.15.57:0/3336083434 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f863c00c060 con 0x7f863c004800 2024-03-27T10:00:50.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.206+0000 7f8656000640 1 -- 172.21.15.57:0/3336083434 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f863c00c260 con 0x7f863c0051c0 2024-03-27T10:00:50.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.206+0000 7f8657400640 1 --2- 172.21.15.57:0/3336083434 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f865806f080 0x7f8658072020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T10:00:50.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.206+0000 7f8656a00640 1 --2- 172.21.15.57:0/3336083434 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f863c0039e0 0x7f863c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:50.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.206+0000 7f8656a00640 1 -- 172.21.15.57:0/3336083434 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f863c0051c0 msgr2=0x7f863c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:50.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.206+0000 7f8656a00640 1 --2- 172.21.15.57:0/3336083434 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f863c0051c0 0x7f863c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:50.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.206+0000 7f864e000640 1 --2- 172.21.15.57:0/3336083434 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f863c004800 0x7f863c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:50.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.206+0000 7f8656a00640 1 -- 172.21.15.57:0/3336083434 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f863c004800 msgr2=0x7f863c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:50.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.206+0000 7f8656a00640 1 --2- 172.21.15.57:0/3336083434 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f863c004800 0x7f863c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:50.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.206+0000 7f8656a00640 1 -- 172.21.15.57:0/3336083434 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f863c003520 con 0x7f863c0039e0 2024-03-27T10:00:50.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.206+0000 7f864e000640 1 --2- 172.21.15.57:0/3336083434 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f863c004800 0x7f863c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T10:00:50.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.208+0000 7f8656a00640 1 --2- 172.21.15.57:0/3336083434 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f863c0039e0 0x7f863c003e00 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f8648001e50 tx=0x7f863c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3aa415e8eb01a2 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:50.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.208+0000 7f8656000640 1 -- 172.21.15.57:0/3336083434 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8648001a70 con 0x7f863c0039e0 2024-03-27T10:00:50.199 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.208+0000 7f8656000640 1 -- 172.21.15.57:0/3336083434 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8648003b70 con 0x7f863c0039e0 2024-03-27T10:00:50.199 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.208+0000 7f8656000640 1 -- 172.21.15.57:0/3336083434 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86480050d0 con 0x7f863c0039e0 2024-03-27T10:00:50.199 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.209+0000 7f8657e00640 1 -- 172.21.15.57:0/3336083434 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f863c0039e0 msgr2=0x7f863c003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:50.199 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.209+0000 7f8657e00640 1 --2- 172.21.15.57:0/3336083434 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f863c0039e0 0x7f863c003e00 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f8648001e50 tx=0x7f863c005830 comp rx=0 tx=0).stop 2024-03-27T10:00:50.199 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.209+0000 7f8657400640 1 -- 172.21.15.57:0/3336083434 reap_dead start 2024-03-27T10:00:50.199 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.209+0000 7f8657e00640 1 -- 172.21.15.57:0/3336083434 shutdown_connections 2024-03-27T10:00:50.199 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.209+0000 7f8657e00640 1 -- 172.21.15.57:0/3336083434 >> 172.21.15.57:0/3336083434 conn(0x7f86580b1770 msgr2=0x7f86580b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:50.199 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.209+0000 7f8657e00640 1 -- 172.21.15.57:0/3336083434 shutdown_connections 2024-03-27T10:00:50.199 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.209+0000 7f8657e00640 1 -- 172.21.15.57:0/3336083434 wait complete. 2024-03-27T10:00:50.200 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.211+0000 7f8657e00640 1 Processor -- start 2024-03-27T10:00:50.200 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.211+0000 7f8657e00640 1 -- start start 2024-03-27T10:00:50.202 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.212+0000 7f8657e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f863c0039e0 0x7f86581f3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:50.202 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.212+0000 7f8657e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f865815acb0 0x7f86581ed9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:50.202 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.212+0000 7f8657e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f86581f4d40 0x7f86580b0960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:50.202 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.212+0000 7f8657e00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f8658158a90 con 0x7f865815acb0 2024-03-27T10:00:50.202 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.212+0000 7f8657e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f8658158910 con 0x7f86581f4d40 2024-03-27T10:00:50.202 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.212+0000 7f8657e00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f86580adfb0 con 0x7f863c0039e0 2024-03-27T10:00:50.202 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.212+0000 7f864e000640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f865815acb0 0x7f86581ed9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:50.202 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.212+0000 7f864e000640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f865815acb0 0x7f86581ed9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44510/0 (socket says 172.21.15.57:44510) 2024-03-27T10:00:50.203 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.212+0000 7f864e000640 1 -- 172.21.15.57:0/2532553462 learned_addr learned my addr 172.21.15.57:0/2532553462 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:50.203 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.213+0000 7f8657400640 1 --2- 172.21.15.57:0/2532553462 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f86581f4d40 0x7f86580b0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:50.203 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.213+0000 7f8656a00640 1 --2- 172.21.15.57:0/2532553462 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f863c0039e0 0x7f86581f3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:50.203 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.213+0000 7f864e000640 1 -- 172.21.15.57:0/2532553462 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f863c0039e0 msgr2=0x7f86581f3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:50.203 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.213+0000 7f864e000640 1 --2- 172.21.15.57:0/2532553462 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f863c0039e0 0x7f86581f3b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:50.203 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.213+0000 7f864e000640 1 -- 172.21.15.57:0/2532553462 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f86581f4d40 msgr2=0x7f86580b0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:50.203 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.213+0000 7f864e000640 1 --2- 172.21.15.57:0/2532553462 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f86581f4d40 0x7f86580b0960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:50.203 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.213+0000 7f864e000640 1 -- 172.21.15.57:0/2532553462 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86581f43d0 con 0x7f865815acb0 2024-03-27T10:00:50.203 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.213+0000 7f8656a00640 1 --2- 172.21.15.57:0/2532553462 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f863c0039e0 0x7f86581f3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T10:00:50.203 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.213+0000 7f8657400640 1 --2- 172.21.15.57:0/2532553462 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f86581f4d40 0x7f86580b0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T10:00:50.203 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.213+0000 7f864e000640 1 --2- 172.21.15.57:0/2532553462 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f865815acb0 0x7f86581ed9d0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f864000d8e0 tx=0x7f864000dda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:50.203 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.214+0000 7f864f400640 1 -- 172.21.15.57:0/2532553462 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8640019070 con 0x7f865815acb0 2024-03-27T10:00:50.204 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.214+0000 7f864f400640 1 -- 172.21.15.57:0/2532553462 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86400074e0 con 0x7f865815acb0 2024-03-27T10:00:50.204 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.214+0000 7f864f400640 1 -- 172.21.15.57:0/2532553462 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86400049e0 con 0x7f865815acb0 2024-03-27T10:00:50.204 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.214+0000 7f8657e00640 1 -- 172.21.15.57:0/2532553462 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86581f46b0 con 0x7f865815acb0 2024-03-27T10:00:50.204 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.214+0000 7f8657e00640 1 -- 172.21.15.57:0/2532553462 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86581f40c0 con 0x7f865815acb0 2024-03-27T10:00:50.204 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.215+0000 7f8657e00640 1 -- 172.21.15.57:0/2532553462 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8658068540 con 0x7f865815acb0 2024-03-27T10:00:50.204 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.216+0000 7f864f400640 1 -- 172.21.15.57:0/2532553462 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f8640004b80 con 0x7f865815acb0 2024-03-27T10:00:50.205 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.217+0000 7f864f400640 1 --2- 172.21.15.57:0/2532553462 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f863406c530 0x7f863406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:50.205 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.217+0000 7f864f400640 1 -- 172.21.15.57:0/2532553462 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f864008b610 con 0x7f865815acb0 2024-03-27T10:00:50.205 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.217+0000 7f8656a00640 1 --2- 172.21.15.57:0/2532553462 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f863406c530 0x7f863406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:50.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.218+0000 7f8656a00640 1 --2- 172.21.15.57:0/2532553462 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f863406c530 0x7f863406e9f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f8648034000 tx=0x7f8648009030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:50.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.222+0000 7f864f400640 1 -- 172.21.15.57:0/2532553462 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f8640059820 con 0x7f865815acb0 2024-03-27T10:00:50.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.434+0000 7f8657e00640 1 -- 172.21.15.57:0/2532553462 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f86580cc4d0 con 0x7f865815acb0 2024-03-27T10:00:50.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.435+0000 7f864f400640 1 -- 172.21.15.57:0/2532553462 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) ==== 80+0+0 (secure 0 0 0) 0x7f8640059120 con 0x7f865815acb0 2024-03-27T10:00:50.423 INFO:teuthology.orchestra.run.smithi057.stderr:listed 0 entries 2024-03-27T10:00:50.426 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.438+0000 7f8657e00640 1 -- 172.21.15.57:0/2532553462 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f863406c530 msgr2=0x7f863406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:50.427 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.438+0000 7f8657e00640 1 --2- 172.21.15.57:0/2532553462 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f863406c530 0x7f863406e9f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f8648034000 tx=0x7f8648009030 comp rx=0 tx=0).stop 2024-03-27T10:00:50.427 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.438+0000 7f8657e00640 1 -- 172.21.15.57:0/2532553462 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f865815acb0 msgr2=0x7f86581ed9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:50.427 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.438+0000 7f8657e00640 1 --2- 172.21.15.57:0/2532553462 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f865815acb0 0x7f86581ed9d0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f864000d8e0 tx=0x7f864000dda0 comp rx=0 tx=0).stop 2024-03-27T10:00:50.427 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.438+0000 7f8657e00640 1 -- 172.21.15.57:0/2532553462 shutdown_connections 2024-03-27T10:00:50.427 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.438+0000 7f8657e00640 1 --2- 172.21.15.57:0/2532553462 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f863406c530 0x7f863406e9f0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:50.427 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.438+0000 7f8657e00640 1 --2- 172.21.15.57:0/2532553462 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f86581f4d40 0x7f86580b0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:50.427 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.438+0000 7f8657e00640 1 --2- 172.21.15.57:0/2532553462 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f865815acb0 0x7f86581ed9d0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:50.427 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.438+0000 7f8657e00640 1 --2- 172.21.15.57:0/2532553462 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f863c0039e0 0x7f86581f3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:50.427 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.438+0000 7f8657e00640 1 -- 172.21.15.57:0/2532553462 >> 172.21.15.57:0/2532553462 conn(0x7f86580b1770 msgr2=0x7f86580b46f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:50.427 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.438+0000 7f8657e00640 1 -- 172.21.15.57:0/2532553462 shutdown_connections 2024-03-27T10:00:50.427 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.438+0000 7f8657e00640 1 -- 172.21.15.57:0/2532553462 wait complete. 2024-03-27T10:00:50.445 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-03-27T10:00:50.445 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-27T10:00:50.500 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-27T10:00:50.724 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.735+0000 7fd187600640 1 Processor -- start 2024-03-27T10:00:50.724 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.736+0000 7fd187600640 1 -- start start 2024-03-27T10:00:50.726 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.737+0000 7fd187600640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fd18006c940 0x7fd180161f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:50.726 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.737+0000 7fd187600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd18015e590 0x7fd1800d1e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:50.726 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.737+0000 7fd187600640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1801628d0 con 0x7fd18015e1b0 2024-03-27T10:00:50.726 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.737+0000 7fd187600640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7fd180162bb0 con 0x7fd18006c940 2024-03-27T10:00:50.726 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.737+0000 7fd187600640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fd1800b2150 con 0x7fd18015e590 2024-03-27T10:00:50.726 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.737+0000 7fd184c00640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fd18015e1b0 0x7fd1800b2950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:54412/0 (socket says 172.21.15.57:54412) 2024-03-27T10:00:50.726 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.737+0000 7fd184c00640 1 -- 172.21.15.57:0/4241525396 learned_addr learned my addr 172.21.15.57:0/4241525396 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T10:00:50.726 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.738+0000 7fd17fe00640 1 --2- 172.21.15.57:0/4241525396 >> v2:172.21.15.57:3300/0 conn(0x7fd18006c940 0x7fd180161f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:50.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.738+0000 7fd185600640 1 --2- 172.21.15.57:0/4241525396 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd18015e590 0x7fd1800d1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:50.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.738+0000 7fd17f400640 1 -- 172.21.15.57:0/4241525396 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3873519614 0 0) 0x7fd1801628d0 con 0x7fd18015e1b0 2024-03-27T10:00:50.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.738+0000 7fd17f400640 1 -- 172.21.15.57:0/4241525396 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd164003520 con 0x7fd18015e1b0 2024-03-27T10:00:50.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.738+0000 7fd17fe00640 1 -- 172.21.15.57:0/4241525396 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd18015e590 msgr2=0x7fd1800d1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:50.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.738+0000 7fd17fe00640 1 --2- 172.21.15.57:0/4241525396 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd18015e590 0x7fd1800d1e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:50.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.738+0000 7fd17fe00640 1 -- 172.21.15.57:0/4241525396 >> v1:172.21.15.57:6789/0 conn(0x7fd18015e1b0 legacy=0x7fd1800b2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:50.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.738+0000 7fd17fe00640 1 -- 172.21.15.57:0/4241525396 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1800b2430 con 0x7fd18006c940 2024-03-27T10:00:50.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.739+0000 7fd17fe00640 1 --2- 172.21.15.57:0/4241525396 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd18006c940 0x7fd180161f60 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fd1680097a0 tx=0x7fd16802b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f311b950551134 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:50.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.740+0000 7fd17f400640 1 -- 172.21.15.57:0/4241525396 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd168031780 con 0x7fd18006c940 2024-03-27T10:00:50.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.740+0000 7fd17f400640 1 -- 172.21.15.57:0/4241525396 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd168037070 con 0x7fd18006c940 2024-03-27T10:00:50.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.740+0000 7fd17f400640 1 -- 172.21.15.57:0/4241525396 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd168031b40 con 0x7fd18006c940 2024-03-27T10:00:50.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.740+0000 7fd187600640 1 -- 172.21.15.57:0/4241525396 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd18006c940 msgr2=0x7fd180161f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:50.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.740+0000 7fd187600640 1 --2- 172.21.15.57:0/4241525396 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd18006c940 0x7fd180161f60 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fd1680097a0 tx=0x7fd16802b820 comp rx=0 tx=0).stop 2024-03-27T10:00:50.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.740+0000 7fd187600640 1 -- 172.21.15.57:0/4241525396 shutdown_connections 2024-03-27T10:00:50.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.740+0000 7fd187600640 1 --2- 172.21.15.57:0/4241525396 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd18015e590 0x7fd1800d1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:50.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.740+0000 7fd187600640 1 --2- 172.21.15.57:0/4241525396 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd18006c940 0x7fd180161f60 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:50.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.740+0000 7fd187600640 1 -- 172.21.15.57:0/4241525396 >> 172.21.15.57:0/4241525396 conn(0x7fd18009aa30 msgr2=0x7fd18009ae40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:50.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.740+0000 7fd187600640 1 -- 172.21.15.57:0/4241525396 shutdown_connections 2024-03-27T10:00:50.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.740+0000 7fd187600640 1 -- 172.21.15.57:0/4241525396 wait complete. 2024-03-27T10:00:50.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.742+0000 7fd187600640 1 Processor -- start 2024-03-27T10:00:50.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.742+0000 7fd187600640 1 -- start start 2024-03-27T10:00:50.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.743+0000 7fd187600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd18006c940 0x7fd18015ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:50.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.743+0000 7fd187600640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd18015e1b0 0x7fd1801612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:50.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.743+0000 7fd187600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd18015e590 0x7fd18014c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:50.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.743+0000 7fd187600640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fd1800d2500 con 0x7fd18015e1b0 2024-03-27T10:00:50.733 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.743+0000 7fd187600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fd1800d2380 con 0x7fd18015e590 2024-03-27T10:00:50.733 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.743+0000 7fd187600640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fd1800d2680 con 0x7fd18006c940 2024-03-27T10:00:50.733 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.743+0000 7fd17fe00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd18015e1b0 0x7fd1801612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:50.733 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.743+0000 7fd17fe00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd18015e1b0 0x7fd1801612e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44528/0 (socket says 172.21.15.57:44528) 2024-03-27T10:00:50.733 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.743+0000 7fd17fe00640 1 -- 172.21.15.57:0/2429528481 learned_addr learned my addr 172.21.15.57:0/2429528481 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:50.733 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.744+0000 7fd184c00640 1 --2- 172.21.15.57:0/2429528481 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd18006c940 0x7fd18015ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:50.733 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.744+0000 7fd185600640 1 --2- 172.21.15.57:0/2429528481 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd18015e590 0x7fd18014c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:50.733 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.744+0000 7fd17fe00640 1 -- 172.21.15.57:0/2429528481 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd18006c940 msgr2=0x7fd18015ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:50.733 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.744+0000 7fd17fe00640 1 --2- 172.21.15.57:0/2429528481 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd18006c940 0x7fd18015ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:50.733 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.744+0000 7fd17fe00640 1 -- 172.21.15.57:0/2429528481 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd18015e590 msgr2=0x7fd18014c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:50.733 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.744+0000 7fd17fe00640 1 --2- 172.21.15.57:0/2429528481 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd18015e590 0x7fd18014c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:50.733 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.744+0000 7fd17fe00640 1 -- 172.21.15.57:0/2429528481 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd18014cd80 con 0x7fd18015e1b0 2024-03-27T10:00:50.733 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.744+0000 7fd185600640 1 --2- 172.21.15.57:0/2429528481 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd18015e590 0x7fd18014c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T10:00:50.734 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.744+0000 7fd17fe00640 1 --2- 172.21.15.57:0/2429528481 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd18015e1b0 0x7fd1801612e0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fd168034040 tx=0x7fd1680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:50.735 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.746+0000 7fd17cc00640 1 -- 172.21.15.57:0/2429528481 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd168032610 con 0x7fd18015e1b0 2024-03-27T10:00:50.735 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.746+0000 7fd17cc00640 1 -- 172.21.15.57:0/2429528481 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1680327b0 con 0x7fd18015e1b0 2024-03-27T10:00:50.735 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.746+0000 7fd17cc00640 1 -- 172.21.15.57:0/2429528481 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd168032ba0 con 0x7fd18015e1b0 2024-03-27T10:00:50.735 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.746+0000 7fd187600640 1 -- 172.21.15.57:0/2429528481 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd18014d060 con 0x7fd18015e1b0 2024-03-27T10:00:50.735 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.747+0000 7fd187600640 1 -- 172.21.15.57:0/2429528481 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd18014d620 con 0x7fd18015e1b0 2024-03-27T10:00:50.736 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.748+0000 7fd187600640 1 -- 172.21.15.57:0/2429528481 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd180068620 con 0x7fd18015e1b0 2024-03-27T10:00:50.737 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.749+0000 7fd17cc00640 1 -- 172.21.15.57:0/2429528481 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fd16804e440 con 0x7fd18015e1b0 2024-03-27T10:00:50.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.749+0000 7fd17cc00640 1 --2- 172.21.15.57:0/2429528481 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fd15c06c530 0x7fd15c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:50.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.750+0000 7fd17cc00640 1 -- 172.21.15.57:0/2429528481 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fd1680ad920 con 0x7fd18015e1b0 2024-03-27T10:00:50.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.750+0000 7fd184c00640 1 --2- 172.21.15.57:0/2429528481 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fd15c06c530 0x7fd15c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:50.739 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.751+0000 7fd184c00640 1 --2- 172.21.15.57:0/2429528481 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fd15c06c530 0x7fd15c06e9f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd170005c00 tx=0x7fd170009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:50.742 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.754+0000 7fd17cc00640 1 -- 172.21.15.57:0/2429528481 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7fd168040070 con 0x7fd18015e1b0 2024-03-27T10:00:50.946 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.958+0000 7fd187600640 1 -- 172.21.15.57:0/2429528481 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd180069010 con 0x7fd18015e1b0 2024-03-27T10:00:50.948 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.960+0000 7fd17cc00640 1 -- 172.21.15.57:0/2429528481 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) ==== 74+0+18888 (secure 0 0 0) 0x7fd16802f050 con 0x7fd18015e1b0 2024-03-27T10:00:50.948 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:00:50.949 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":28,"fsid":"7ac43f86-2c16-4a97-98fb-715d3cebc75c","created":"2024-03-27T09:59:04.033417+0000","modified":"2024-03-27T10:00:10.462391+0000","last_up_change":"2024-03-27T09:59:16.969624+0000","last_in_change":"2024-03-27T09:59:07.421690+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-27T09:59:17.253008+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-27T09:59:26.690365+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-27T09:59:27.559059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-27T09:59:31.187596+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"47b44362-7302-4f2a-b735-582c6c3850cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6801","nonce":2020036298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6803","nonce":2020036298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6807","nonce":2020036298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6805","nonce":2020036298}]},"public_addr":"172.21.15.57:6801/2020036298","cluster_addr":"172.21.15.57:6803/2020036298","heartbeat_back_addr":"172.21.15.57:6807/2020036298","heartbeat_front_addr":"172.21.15.57:6805/2020036298","state":["exists","up"]},{"osd":1,"uuid":"feaf96f0-9431-4188-9a09-da505b40e934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6809","nonce":3190929242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6811","nonce":3190929242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6815","nonce":3190929242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6813","nonce":3190929242}]},"public_addr":"172.21.15.57:6809/3190929242","cluster_addr":"172.21.15.57:6811/3190929242","heartbeat_back_addr":"172.21.15.57:6815/3190929242","heartbeat_front_addr":"172.21.15.57:6813/3190929242","state":["exists","up"]},{"osd":2,"uuid":"21e406e6-cfbc-4fe7-a816-e2420487c95d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6817","nonce":4065849973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6819","nonce":4065849973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6823","nonce":4065849973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6821","nonce":4065849973}]},"public_addr":"172.21.15.57:6817/4065849973","cluster_addr":"172.21.15.57:6819/4065849973","heartbeat_back_addr":"172.21.15.57:6823/4065849973","heartbeat_front_addr":"172.21.15.57:6821/4065849973","state":["exists","up"]},{"osd":3,"uuid":"a389af1d-76c4-4dfc-b215-f983f4931257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6825","nonce":158084809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6827","nonce":158084809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6831","nonce":158084809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6829","nonce":158084809}]},"public_addr":"172.21.15.57:6825/158084809","cluster_addr":"172.21.15.57:6827/158084809","heartbeat_back_addr":"172.21.15.57:6831/158084809","heartbeat_front_addr":"172.21.15.57:6829/158084809","state":["exists","up"]},{"osd":4,"uuid":"e9b05dca-557a-43ee-b43f-9ce5b7d28304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6823","nonce":108719401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6827","nonce":108719401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6831","nonce":108719401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6829","nonce":108719401}]},"public_addr":"172.21.15.118:6823/108719401","cluster_addr":"172.21.15.118:6827/108719401","heartbeat_back_addr":"172.21.15.118:6831/108719401","heartbeat_front_addr":"172.21.15.118:6829/108719401","state":["exists","up"]},{"osd":5,"uuid":"d968177d-44ff-499a-b00a-b147ed879253","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6817","nonce":2704605866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6819","nonce":2704605866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6826","nonce":2704605866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6822","nonce":2704605866}]},"public_addr":"172.21.15.118:6817/2704605866","cluster_addr":"172.21.15.118:6819/2704605866","heartbeat_back_addr":"172.21.15.118:6826/2704605866","heartbeat_front_addr":"172.21.15.118:6822/2704605866","state":["exists","up"]},{"osd":6,"uuid":"e8f98052-e6ad-4cfe-a4a9-0b17a434d54e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6801","nonce":1963659095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6803","nonce":1963659095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6807","nonce":1963659095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6805","nonce":1963659095}]},"public_addr":"172.21.15.118:6801/1963659095","cluster_addr":"172.21.15.118:6803/1963659095","heartbeat_back_addr":"172.21.15.118:6807/1963659095","heartbeat_front_addr":"172.21.15.118:6805/1963659095","state":["exists","up"]},{"osd":7,"uuid":"eccff987-8e51-4a63-845a-cf0a3196d7fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6809","nonce":1955879596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6811","nonce":1955879596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6815","nonce":1955879596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6813","nonce":1955879596}]},"public_addr":"172.21.15.118:6809/1955879596","cluster_addr":"172.21.15.118:6811/1955879596","heartbeat_back_addr":"172.21.15.118:6815/1955879596","heartbeat_front_addr":"172.21.15.118:6813/1955879596","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.721258+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.696610+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.777895+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.806769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.743259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.845687+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:13.020165+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.722294+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.e","mappings":[{"from":7,"to":1}]},{"pgid":"3.15","mappings":[{"from":3,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-27T10:00:50.952 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.963+0000 7fd187600640 1 -- 172.21.15.57:0/2429528481 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fd15c06c530 msgr2=0x7fd15c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:50.952 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.963+0000 7fd187600640 1 --2- 172.21.15.57:0/2429528481 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fd15c06c530 0x7fd15c06e9f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd170005c00 tx=0x7fd170009040 comp rx=0 tx=0).stop 2024-03-27T10:00:50.952 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.963+0000 7fd187600640 1 -- 172.21.15.57:0/2429528481 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd18015e1b0 msgr2=0x7fd1801612e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:50.952 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.963+0000 7fd187600640 1 --2- 172.21.15.57:0/2429528481 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd18015e1b0 0x7fd1801612e0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fd168034040 tx=0x7fd1680046c0 comp rx=0 tx=0).stop 2024-03-27T10:00:50.952 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.963+0000 7fd187600640 1 -- 172.21.15.57:0/2429528481 shutdown_connections 2024-03-27T10:00:50.952 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.963+0000 7fd187600640 1 --2- 172.21.15.57:0/2429528481 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fd15c06c530 0x7fd15c06e9f0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:50.952 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.963+0000 7fd187600640 1 --2- 172.21.15.57:0/2429528481 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd18015e590 0x7fd18014c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:50.952 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.963+0000 7fd187600640 1 --2- 172.21.15.57:0/2429528481 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd18015e1b0 0x7fd1801612e0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:50.952 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.963+0000 7fd187600640 1 --2- 172.21.15.57:0/2429528481 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd18006c940 0x7fd18015ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:50.952 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.963+0000 7fd187600640 1 -- 172.21.15.57:0/2429528481 >> 172.21.15.57:0/2429528481 conn(0x7fd18009aa30 msgr2=0x7fd1800b1390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:50.953 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.963+0000 7fd187600640 1 -- 172.21.15.57:0/2429528481 shutdown_connections 2024-03-27T10:00:50.953 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:50.963+0000 7fd187600640 1 -- 172.21.15.57:0/2429528481 wait complete. 2024-03-27T10:00:50.972 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-27T09:59:17.253008+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-27T09:59:26.690365+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-27T09:59:27.559059+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-27T09:59:31.187596+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-27T10:00:50.973 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-27T10:00:51.194 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.205+0000 7ff333e00640 1 Processor -- start 2024-03-27T10:00:51.194 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.206+0000 7ff333e00640 1 -- start start 2024-03-27T10:00:51.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.207+0000 7ff333e00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7ff3340d3770 0x7ff3340cf210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:51.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.207+0000 7ff333e00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7ff3340cf750 0x7ff33406bf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:51.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.207+0000 7ff333e00640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3340cfe40 con 0x7ff334161950 2024-03-27T10:00:51.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.207+0000 7ff333e00640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7ff334161d30 con 0x7ff3340d3770 2024-03-27T10:00:51.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.207+0000 7ff333e00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7ff3340d0f10 con 0x7ff3340cf750 2024-03-27T10:00:51.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.208+0000 7ff332a00640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7ff334161950 0x7ff3340ceb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:54424/0 (socket says 172.21.15.57:54424) 2024-03-27T10:00:51.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.208+0000 7ff332a00640 1 -- 172.21.15.57:0/3443982308 learned_addr learned my addr 172.21.15.57:0/3443982308 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T10:00:51.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.208+0000 7ff332000640 1 --2- 172.21.15.57:0/3443982308 >> v2:172.21.15.57:3300/0 conn(0x7ff3340d3770 0x7ff3340cf210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:51.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.208+0000 7ff333400640 1 --2- 172.21.15.57:0/3443982308 >> v2:172.21.15.118:3300/0 conn(0x7ff3340cf750 0x7ff33406bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:51.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.208+0000 7ff332000640 1 -- 172.21.15.57:0/3443982308 >> v2:172.21.15.118:3300/0 conn(0x7ff3340cf750 msgr2=0x7ff33406bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:51.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.208+0000 7ff332000640 1 --2- 172.21.15.57:0/3443982308 >> v2:172.21.15.118:3300/0 conn(0x7ff3340cf750 0x7ff33406bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:51.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.208+0000 7ff332000640 1 -- 172.21.15.57:0/3443982308 >> v1:172.21.15.57:6789/0 conn(0x7ff334161950 legacy=0x7ff3340ceb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:51.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.208+0000 7ff332000640 1 -- 172.21.15.57:0/3443982308 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3340d11f0 con 0x7ff3340d3770 2024-03-27T10:00:51.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.208+0000 7ff331600640 1 -- 172.21.15.57:0/3443982308 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3957469082 0 0) 0x7ff3340cfe40 con 0x7ff334161950 2024-03-27T10:00:51.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.209+0000 7ff332000640 1 --2- 172.21.15.57:0/3443982308 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3340d3770 0x7ff3340cf210 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ff3340c7aa0 tx=0x7ff31c02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a84cb954690689c0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:51.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.210+0000 7ff331600640 1 -- 172.21.15.57:0/3443982308 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff31c034070 con 0x7ff3340d3770 2024-03-27T10:00:51.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.210+0000 7ff331600640 1 -- 172.21.15.57:0/3443982308 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff31c030610 con 0x7ff3340d3770 2024-03-27T10:00:51.199 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.210+0000 7ff331600640 1 -- 172.21.15.57:0/3443982308 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff31c0309e0 con 0x7ff3340d3770 2024-03-27T10:00:51.200 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.210+0000 7ff333e00640 1 -- 172.21.15.57:0/3443982308 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3340d3770 msgr2=0x7ff3340cf210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:51.200 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.210+0000 7ff333e00640 1 --2- 172.21.15.57:0/3443982308 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3340d3770 0x7ff3340cf210 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ff3340c7aa0 tx=0x7ff31c02b960 comp rx=0 tx=0).stop 2024-03-27T10:00:51.200 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.210+0000 7ff333e00640 1 -- 172.21.15.57:0/3443982308 shutdown_connections 2024-03-27T10:00:51.200 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.210+0000 7ff333e00640 1 --2- 172.21.15.57:0/3443982308 >> v2:172.21.15.118:3300/0 conn(0x7ff3340cf750 0x7ff33406bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:51.200 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.210+0000 7ff333e00640 1 --2- 172.21.15.57:0/3443982308 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3340d3770 0x7ff3340cf210 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:51.200 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.210+0000 7ff333e00640 1 -- 172.21.15.57:0/3443982308 >> 172.21.15.57:0/3443982308 conn(0x7ff3340d3fc0 msgr2=0x7ff3340d43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:51.200 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.211+0000 7ff333e00640 1 -- 172.21.15.57:0/3443982308 shutdown_connections 2024-03-27T10:00:51.200 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.211+0000 7ff333e00640 1 -- 172.21.15.57:0/3443982308 wait complete. 2024-03-27T10:00:51.201 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.213+0000 7ff333e00640 1 Processor -- start 2024-03-27T10:00:51.201 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.213+0000 7ff333e00640 1 -- start start 2024-03-27T10:00:51.203 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.214+0000 7ff333e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3340cf750 0x7ff33415ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:51.203 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.214+0000 7ff333e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff3340d3770 0x7ff334160490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:51.203 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.214+0000 7ff333e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff334161950 0x7ff33415df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:51.204 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.214+0000 7ff333e00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7ff3340d2240 con 0x7ff3340cf750 2024-03-27T10:00:51.204 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.214+0000 7ff333e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7ff3340d1f60 con 0x7ff334161950 2024-03-27T10:00:51.204 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.214+0000 7ff333e00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7ff3340d17b0 con 0x7ff3340d3770 2024-03-27T10:00:51.204 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.214+0000 7ff332a00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3340cf750 0x7ff33415ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:51.204 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.214+0000 7ff332a00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3340cf750 0x7ff33415ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44532/0 (socket says 172.21.15.57:44532) 2024-03-27T10:00:51.204 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.214+0000 7ff332a00640 1 -- 172.21.15.57:0/913736224 learned_addr learned my addr 172.21.15.57:0/913736224 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:51.204 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.215+0000 7ff333400640 1 --2- 172.21.15.57:0/913736224 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff334161950 0x7ff33415df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:51.204 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.215+0000 7ff332000640 1 --2- 172.21.15.57:0/913736224 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff3340d3770 0x7ff334160490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:51.204 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.215+0000 7ff332a00640 1 -- 172.21.15.57:0/913736224 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff3340d3770 msgr2=0x7ff334160490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:51.204 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.215+0000 7ff332a00640 1 --2- 172.21.15.57:0/913736224 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff3340d3770 0x7ff334160490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:51.204 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.215+0000 7ff332a00640 1 -- 172.21.15.57:0/913736224 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff334161950 msgr2=0x7ff33415df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:51.204 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.215+0000 7ff332a00640 1 --2- 172.21.15.57:0/913736224 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff334161950 0x7ff33415df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:51.205 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.215+0000 7ff332a00640 1 -- 172.21.15.57:0/913736224 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3340c9fd0 con 0x7ff3340cf750 2024-03-27T10:00:51.205 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.215+0000 7ff332a00640 1 --2- 172.21.15.57:0/913736224 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3340cf750 0x7ff33415ff50 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7ff32400c7c0 tx=0x7ff32400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:51.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.216+0000 7ff32aa00640 1 -- 172.21.15.57:0/913736224 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff324018070 con 0x7ff3340cf750 2024-03-27T10:00:51.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.216+0000 7ff32aa00640 1 -- 172.21.15.57:0/913736224 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff32400a640 con 0x7ff3340cf750 2024-03-27T10:00:51.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.216+0000 7ff32aa00640 1 -- 172.21.15.57:0/913736224 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff32400aa30 con 0x7ff3340cf750 2024-03-27T10:00:51.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.216+0000 7ff333e00640 1 -- 172.21.15.57:0/913736224 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3340c9210 con 0x7ff3340cf750 2024-03-27T10:00:51.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.216+0000 7ff333e00640 1 -- 172.21.15.57:0/913736224 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3340c97d0 con 0x7ff3340cf750 2024-03-27T10:00:51.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.217+0000 7ff333e00640 1 -- 172.21.15.57:0/913736224 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff334068540 con 0x7ff3340cf750 2024-03-27T10:00:51.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.218+0000 7ff32aa00640 1 -- 172.21.15.57:0/913736224 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7ff32400abd0 con 0x7ff3340cf750 2024-03-27T10:00:51.207 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.219+0000 7ff32aa00640 1 --2- 172.21.15.57:0/913736224 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7ff31006c530 0x7ff31006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:51.207 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.219+0000 7ff32aa00640 1 -- 172.21.15.57:0/913736224 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7ff32408b010 con 0x7ff3340cf750 2024-03-27T10:00:51.207 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.219+0000 7ff332000640 1 --2- 172.21.15.57:0/913736224 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7ff31006c530 0x7ff31006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:51.208 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.220+0000 7ff332000640 1 --2- 172.21.15.57:0/913736224 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7ff31006c530 0x7ff31006e9f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff31c036000 tx=0x7ff31c03b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:51.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.223+0000 7ff32aa00640 1 -- 172.21.15.57:0/913736224 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7ff3240592c0 con 0x7ff3340cf750 2024-03-27T10:00:51.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.425+0000 7ff333e00640 1 -- 172.21.15.57:0/913736224 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff33406c810 con 0x7ff3340cf750 2024-03-27T10:00:51.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.426+0000 7ff32aa00640 1 -- 172.21.15.57:0/913736224 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) ==== 93+0+10 (secure 0 0 0) 0x7ff324058bc0 con 0x7ff3340cf750 2024-03-27T10:00:51.414 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2024-03-27T10:00:51.417 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.428+0000 7ff333e00640 1 -- 172.21.15.57:0/913736224 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7ff31006c530 msgr2=0x7ff31006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:51.417 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.428+0000 7ff333e00640 1 --2- 172.21.15.57:0/913736224 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7ff31006c530 0x7ff31006e9f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff31c036000 tx=0x7ff31c03b040 comp rx=0 tx=0).stop 2024-03-27T10:00:51.417 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.428+0000 7ff333e00640 1 -- 172.21.15.57:0/913736224 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3340cf750 msgr2=0x7ff33415ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:51.417 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.428+0000 7ff333e00640 1 --2- 172.21.15.57:0/913736224 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3340cf750 0x7ff33415ff50 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7ff32400c7c0 tx=0x7ff32400cc80 comp rx=0 tx=0).stop 2024-03-27T10:00:51.417 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.428+0000 7ff333e00640 1 -- 172.21.15.57:0/913736224 shutdown_connections 2024-03-27T10:00:51.417 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.428+0000 7ff333e00640 1 --2- 172.21.15.57:0/913736224 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7ff31006c530 0x7ff31006e9f0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:51.417 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.428+0000 7ff333e00640 1 --2- 172.21.15.57:0/913736224 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7ff334161950 0x7ff33415df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:51.417 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.428+0000 7ff333e00640 1 --2- 172.21.15.57:0/913736224 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7ff3340d3770 0x7ff334160490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:51.417 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.428+0000 7ff333e00640 1 --2- 172.21.15.57:0/913736224 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7ff3340cf750 0x7ff33415ff50 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:51.417 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.428+0000 7ff333e00640 1 -- 172.21.15.57:0/913736224 >> 172.21.15.57:0/913736224 conn(0x7ff3340d3fc0 msgr2=0x7ff33415d470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:51.417 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.429+0000 7ff333e00640 1 -- 172.21.15.57:0/913736224 shutdown_connections 2024-03-27T10:00:51.417 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.429+0000 7ff333e00640 1 -- 172.21.15.57:0/913736224 wait complete. 2024-03-27T10:00:51.436 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-27T10:00:51.660 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.672+0000 7fdbef200640 1 Processor -- start 2024-03-27T10:00:51.660 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.672+0000 7fdbef200640 1 -- start start 2024-03-27T10:00:51.662 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.673+0000 7fdbef200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdbe8072680 0x7fdbe80711b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:51.662 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.673+0000 7fdbef200640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fdbe815b3b0 0x7fdbe80716f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:51.662 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.673+0000 7fdbef200640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbe80ae520 con 0x7fdbe815afd0 2024-03-27T10:00:51.662 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.673+0000 7fdbef200640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7fdbe8071c30 con 0x7fdbe815b3b0 2024-03-27T10:00:51.662 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.673+0000 7fdbef200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fdbe80ae800 con 0x7fdbe8072680 2024-03-27T10:00:51.662 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.673+0000 7fdbe7e00640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fdbe815afd0 0x7fdbe8071f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:54430/0 (socket says 172.21.15.57:54430) 2024-03-27T10:00:51.662 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.673+0000 7fdbe7e00640 1 -- 172.21.15.57:0/516947720 learned_addr learned my addr 172.21.15.57:0/516947720 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T10:00:51.662 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.674+0000 7fdbed200640 1 --2- 172.21.15.57:0/516947720 >> v2:172.21.15.57:3300/0 conn(0x7fdbe815b3b0 0x7fdbe80716f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:51.663 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.674+0000 7fdbe6a00640 1 -- 172.21.15.57:0/516947720 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1010464643 0 0) 0x7fdbe80ae520 con 0x7fdbe815afd0 2024-03-27T10:00:51.663 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.674+0000 7fdbe6a00640 1 -- 172.21.15.57:0/516947720 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdbcc003520 con 0x7fdbe815afd0 2024-03-27T10:00:51.663 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.674+0000 7fdbe7400640 1 --2- 172.21.15.57:0/516947720 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdbe8072680 0x7fdbe80711b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:51.663 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.674+0000 7fdbed200640 1 -- 172.21.15.57:0/516947720 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdbe8072680 msgr2=0x7fdbe80711b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:51.663 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.674+0000 7fdbed200640 1 --2- 172.21.15.57:0/516947720 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdbe8072680 0x7fdbe80711b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:51.663 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.674+0000 7fdbed200640 1 -- 172.21.15.57:0/516947720 >> v1:172.21.15.57:6789/0 conn(0x7fdbe815afd0 legacy=0x7fdbe8071f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:51.663 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.674+0000 7fdbed200640 1 -- 172.21.15.57:0/516947720 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbe80aeae0 con 0x7fdbe815b3b0 2024-03-27T10:00:51.664 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.675+0000 7fdbed200640 1 --2- 172.21.15.57:0/516947720 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdbe815b3b0 0x7fdbe80716f0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fdbd80097a0 tx=0x7fdbd802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74b1342f68ef242c server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:51.664 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.676+0000 7fdbe6a00640 1 -- 172.21.15.57:0/516947720 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbd8034070 con 0x7fdbe815b3b0 2024-03-27T10:00:51.664 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.676+0000 7fdbe6a00640 1 -- 172.21.15.57:0/516947720 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbd8030610 con 0x7fdbe815b3b0 2024-03-27T10:00:51.664 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.676+0000 7fdbe6a00640 1 -- 172.21.15.57:0/516947720 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbd80309c0 con 0x7fdbe815b3b0 2024-03-27T10:00:51.665 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.676+0000 7fdbef200640 1 -- 172.21.15.57:0/516947720 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdbe815b3b0 msgr2=0x7fdbe80716f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:51.665 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.676+0000 7fdbef200640 1 --2- 172.21.15.57:0/516947720 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdbe815b3b0 0x7fdbe80716f0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fdbd80097a0 tx=0x7fdbd802b960 comp rx=0 tx=0).stop 2024-03-27T10:00:51.665 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.676+0000 7fdbef200640 1 -- 172.21.15.57:0/516947720 shutdown_connections 2024-03-27T10:00:51.665 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.676+0000 7fdbef200640 1 --2- 172.21.15.57:0/516947720 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdbe8072680 0x7fdbe80711b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:51.665 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.676+0000 7fdbef200640 1 --2- 172.21.15.57:0/516947720 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdbe815b3b0 0x7fdbe80716f0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:51.665 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.676+0000 7fdbef200640 1 -- 172.21.15.57:0/516947720 >> 172.21.15.57:0/516947720 conn(0x7fdbe80b18a0 msgr2=0x7fdbe80b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:51.665 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.677+0000 7fdbef200640 1 -- 172.21.15.57:0/516947720 shutdown_connections 2024-03-27T10:00:51.665 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.677+0000 7fdbef200640 1 -- 172.21.15.57:0/516947720 wait complete. 2024-03-27T10:00:51.666 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.678+0000 7fdbef200640 1 Processor -- start 2024-03-27T10:00:51.667 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.678+0000 7fdbef200640 1 -- start start 2024-03-27T10:00:51.668 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.679+0000 7fdbef200640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdbe8072680 0x7fdbe814ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:51.668 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.679+0000 7fdbef200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdbe815afd0 0x7fdbe809ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:51.668 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.679+0000 7fdbef200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdbe815b3b0 0x7fdbe809cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:51.668 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.680+0000 7fdbef200640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fdbe80b2db0 con 0x7fdbe8072680 2024-03-27T10:00:51.668 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.680+0000 7fdbef200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fdbe80b2c30 con 0x7fdbe815b3b0 2024-03-27T10:00:51.668 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.680+0000 7fdbef200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fdbe80b2f30 con 0x7fdbe815afd0 2024-03-27T10:00:51.668 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.680+0000 7fdbe7e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdbe8072680 0x7fdbe814ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:51.668 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.680+0000 7fdbe7e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdbe8072680 0x7fdbe814ca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:44548/0 (socket says 172.21.15.57:44548) 2024-03-27T10:00:51.668 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.680+0000 7fdbe7e00640 1 -- 172.21.15.57:0/1881226691 learned_addr learned my addr 172.21.15.57:0/1881226691 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:51.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.680+0000 7fdbe7400640 1 --2- 172.21.15.57:0/1881226691 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdbe815afd0 0x7fdbe809ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:51.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.680+0000 7fdbed200640 1 --2- 172.21.15.57:0/1881226691 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdbe815b3b0 0x7fdbe809cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:51.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.680+0000 7fdbe7e00640 1 -- 172.21.15.57:0/1881226691 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdbe815afd0 msgr2=0x7fdbe809ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:51.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.680+0000 7fdbe7e00640 1 --2- 172.21.15.57:0/1881226691 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdbe815afd0 0x7fdbe809ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:51.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.680+0000 7fdbe7e00640 1 -- 172.21.15.57:0/1881226691 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdbe815b3b0 msgr2=0x7fdbe809cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:51.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.680+0000 7fdbe7e00640 1 --2- 172.21.15.57:0/1881226691 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdbe815b3b0 0x7fdbe809cf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:51.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.680+0000 7fdbe7e00640 1 -- 172.21.15.57:0/1881226691 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbe8150120 con 0x7fdbe8072680 2024-03-27T10:00:51.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.681+0000 7fdbe7e00640 1 --2- 172.21.15.57:0/1881226691 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdbe8072680 0x7fdbe814ca30 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fdbe000cb40 tx=0x7fdbe000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:51.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.681+0000 7fdbdfe00640 1 -- 172.21.15.57:0/1881226691 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbe0017070 con 0x7fdbe8072680 2024-03-27T10:00:51.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.681+0000 7fdbdfe00640 1 -- 172.21.15.57:0/1881226691 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbe000aca0 con 0x7fdbe8072680 2024-03-27T10:00:51.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.681+0000 7fdbdfe00640 1 -- 172.21.15.57:0/1881226691 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbe0012620 con 0x7fdbe8072680 2024-03-27T10:00:51.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.681+0000 7fdbef200640 1 -- 172.21.15.57:0/1881226691 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbe81fbc60 con 0x7fdbe8072680 2024-03-27T10:00:51.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.681+0000 7fdbef200640 1 -- 172.21.15.57:0/1881226691 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbe81fc220 con 0x7fdbe8072680 2024-03-27T10:00:51.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.682+0000 7fdbef200640 1 -- 172.21.15.57:0/1881226691 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbe80757d0 con 0x7fdbe8072680 2024-03-27T10:00:51.671 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.683+0000 7fdbdfe00640 1 -- 172.21.15.57:0/1881226691 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fdbe001a070 con 0x7fdbe8072680 2024-03-27T10:00:51.672 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.684+0000 7fdbdfe00640 1 --2- 172.21.15.57:0/1881226691 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fdbc406c530 0x7fdbc406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:51.672 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.684+0000 7fdbdfe00640 1 -- 172.21.15.57:0/1881226691 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fdbe008ba30 con 0x7fdbe8072680 2024-03-27T10:00:51.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.685+0000 7fdbe7400640 1 --2- 172.21.15.57:0/1881226691 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fdbc406c530 0x7fdbc406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:51.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.685+0000 7fdbe7400640 1 --2- 172.21.15.57:0/1881226691 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fdbc406c530 0x7fdbc406e9f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fdbe80d0610 tx=0x7fdbd0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:51.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.689+0000 7fdbdfe00640 1 -- 172.21.15.57:0/1881226691 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7fdbe0059bb0 con 0x7fdbe8072680 2024-03-27T10:00:51.879 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.891+0000 7fdbef200640 1 -- 172.21.15.57:0/1881226691 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fdbe806d0e0 con 0x7fdbe8072680 2024-03-27T10:00:51.880 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.892+0000 7fdbdfe00640 1 -- 172.21.15.57:0/1881226691 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) ==== 104+0+11 (secure 0 0 0) 0x7fdbe00594b0 con 0x7fdbe8072680 2024-03-27T10:00:51.880 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2024-03-27T10:00:51.883 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.894+0000 7fdbef200640 1 -- 172.21.15.57:0/1881226691 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fdbc406c530 msgr2=0x7fdbc406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:51.883 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.894+0000 7fdbef200640 1 --2- 172.21.15.57:0/1881226691 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fdbc406c530 0x7fdbc406e9f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fdbe80d0610 tx=0x7fdbd0008040 comp rx=0 tx=0).stop 2024-03-27T10:00:51.883 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.894+0000 7fdbef200640 1 -- 172.21.15.57:0/1881226691 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdbe8072680 msgr2=0x7fdbe814ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:51.883 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.894+0000 7fdbef200640 1 --2- 172.21.15.57:0/1881226691 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdbe8072680 0x7fdbe814ca30 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fdbe000cb40 tx=0x7fdbe000a060 comp rx=0 tx=0).stop 2024-03-27T10:00:51.883 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.894+0000 7fdbef200640 1 -- 172.21.15.57:0/1881226691 shutdown_connections 2024-03-27T10:00:51.883 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.894+0000 7fdbef200640 1 --2- 172.21.15.57:0/1881226691 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fdbc406c530 0x7fdbc406e9f0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:51.883 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.894+0000 7fdbef200640 1 --2- 172.21.15.57:0/1881226691 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdbe815b3b0 0x7fdbe809cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:51.883 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.894+0000 7fdbef200640 1 --2- 172.21.15.57:0/1881226691 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdbe815afd0 0x7fdbe809ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:51.883 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.894+0000 7fdbef200640 1 --2- 172.21.15.57:0/1881226691 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdbe8072680 0x7fdbe814ca30 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:51.884 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.894+0000 7fdbef200640 1 -- 172.21.15.57:0/1881226691 >> 172.21.15.57:0/1881226691 conn(0x7fdbe80b18a0 msgr2=0x7fdbe8071f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:51.884 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.895+0000 7fdbef200640 1 -- 172.21.15.57:0/1881226691 shutdown_connections 2024-03-27T10:00:51.884 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:51.895+0000 7fdbef200640 1 -- 172.21.15.57:0/1881226691 wait complete. 2024-03-27T10:00:51.903 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-27T10:00:52.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.131+0000 7fbaa8c00640 1 Processor -- start 2024-03-27T10:00:52.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.132+0000 7fbaa8c00640 1 -- start start 2024-03-27T10:00:52.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.133+0000 7fbaa8c00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbaa40aea20 0x7fbaa415d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:52.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.133+0000 7fbaa8c00640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbaa40ad1d0 con 0x7fbaa40acd60 2024-03-27T10:00:52.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.133+0000 7fbaa8c00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbaa415c4c0 con 0x7fbaa406cf30 2024-03-27T10:00:52.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.133+0000 7fbaa8c00640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7fbaa4072600 con 0x7fbaa40aea20 2024-03-27T10:00:52.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.134+0000 7fbaa1400640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fbaa40acd60 0x7fbaa40aee00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:49774/0 (socket says 172.21.15.57:49774) 2024-03-27T10:00:52.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.134+0000 7fbaa1e00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbaa40aea20 0x7fbaa415d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:52.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.134+0000 7fbaa1400640 1 -- 172.21.15.57:0/4197536146 learned_addr learned my addr 172.21.15.57:0/4197536146 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T10:00:52.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.134+0000 7fbaa0a00640 1 -- 172.21.15.57:0/4197536146 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1553172432 0 0) 0x7fbaa40ad1d0 con 0x7fbaa40acd60 2024-03-27T10:00:52.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.134+0000 7fbaa1e00640 1 -- 172.21.15.57:0/4197536146 >> v1:172.21.15.118:6789/0 conn(0x7fbaa406cf30 legacy=0x7fbaa406d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:52.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.134+0000 7fbaa1e00640 1 -- 172.21.15.57:0/4197536146 >> v1:172.21.15.57:6789/0 conn(0x7fbaa40acd60 legacy=0x7fbaa40aee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:52.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.134+0000 7fbaa1e00640 1 -- 172.21.15.57:0/4197536146 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaa40728e0 con 0x7fbaa40aea20 2024-03-27T10:00:52.124 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.135+0000 7fbaa1e00640 1 --2- 172.21.15.57:0/4197536146 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbaa40aea20 0x7fbaa415d1a0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fba8c0097a0 tx=0x7fba8c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1245e7cf0dd4433b server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:52.124 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.136+0000 7fbaa0a00640 1 -- 172.21.15.57:0/4197536146 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba8c0315a0 con 0x7fbaa40aea20 2024-03-27T10:00:52.124 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.136+0000 7fbaa0a00640 1 -- 172.21.15.57:0/4197536146 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba8c037070 con 0x7fbaa40aea20 2024-03-27T10:00:52.124 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.136+0000 7fbaa0a00640 1 -- 172.21.15.57:0/4197536146 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba8c031960 con 0x7fbaa40aea20 2024-03-27T10:00:52.125 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.136+0000 7fbaa8c00640 1 -- 172.21.15.57:0/4197536146 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbaa40aea20 msgr2=0x7fbaa415d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:52.125 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.136+0000 7fbaa8c00640 1 --2- 172.21.15.57:0/4197536146 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbaa40aea20 0x7fbaa415d1a0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fba8c0097a0 tx=0x7fba8c02b840 comp rx=0 tx=0).stop 2024-03-27T10:00:52.125 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.136+0000 7fbaa8c00640 1 -- 172.21.15.57:0/4197536146 shutdown_connections 2024-03-27T10:00:52.125 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.136+0000 7fbaa8c00640 1 --2- 172.21.15.57:0/4197536146 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbaa40aea20 0x7fbaa415d1a0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:52.125 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.137+0000 7fbaa8c00640 1 -- 172.21.15.57:0/4197536146 >> 172.21.15.57:0/4197536146 conn(0x7fbaa40b18a0 msgr2=0x7fbaa40b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:52.125 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.137+0000 7fbaa8c00640 1 -- 172.21.15.57:0/4197536146 shutdown_connections 2024-03-27T10:00:52.125 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.137+0000 7fbaa8c00640 1 -- 172.21.15.57:0/4197536146 wait complete. 2024-03-27T10:00:52.126 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.138+0000 7fbaa8c00640 1 Processor -- start 2024-03-27T10:00:52.126 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.138+0000 7fbaa8c00640 1 -- start start 2024-03-27T10:00:52.128 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.139+0000 7fbaa8c00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbaa406cf30 0x7fbaa414fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:52.128 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.139+0000 7fbaa8c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbaa40acd60 0x7fbaa414c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:52.128 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.139+0000 7fbaa8c00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbaa40aea20 0x7fbaa40ca850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:52.128 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.139+0000 7fbaa8c00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fbaa40733c0 con 0x7fbaa406cf30 2024-03-27T10:00:52.128 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.139+0000 7fbaa8c00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fbaa4072ea0 con 0x7fbaa40acd60 2024-03-27T10:00:52.128 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.139+0000 7fbaa8c00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fbaa406da20 con 0x7fbaa40aea20 2024-03-27T10:00:52.128 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.140+0000 7fbaa1e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbaa406cf30 0x7fbaa414fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:52.128 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.140+0000 7fbaa1e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbaa406cf30 0x7fbaa414fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56080/0 (socket says 172.21.15.57:56080) 2024-03-27T10:00:52.128 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.140+0000 7fbaa1e00640 1 -- 172.21.15.57:0/1010321926 learned_addr learned my addr 172.21.15.57:0/1010321926 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:52.129 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.140+0000 7fbaa1400640 1 --2- 172.21.15.57:0/1010321926 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbaa40acd60 0x7fbaa414c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:52.130 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.140+0000 7fbaa2800640 1 --2- 172.21.15.57:0/1010321926 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbaa40aea20 0x7fbaa40ca850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:52.130 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.140+0000 7fbaa1e00640 1 -- 172.21.15.57:0/1010321926 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbaa40aea20 msgr2=0x7fbaa40ca850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:52.130 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.140+0000 7fbaa1e00640 1 --2- 172.21.15.57:0/1010321926 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbaa40aea20 0x7fbaa40ca850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:52.130 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.140+0000 7fbaa1e00640 1 -- 172.21.15.57:0/1010321926 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbaa40acd60 msgr2=0x7fbaa414c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:52.130 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.140+0000 7fbaa1e00640 1 --2- 172.21.15.57:0/1010321926 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbaa40acd60 0x7fbaa414c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:52.130 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.140+0000 7fbaa1e00640 1 -- 172.21.15.57:0/1010321926 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaa40cb130 con 0x7fbaa406cf30 2024-03-27T10:00:52.130 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.141+0000 7fbaa1e00640 1 --2- 172.21.15.57:0/1010321926 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbaa406cf30 0x7fbaa414fc10 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fba8c0097a0 tx=0x7fba8c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:52.130 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.141+0000 7fba9a000640 1 -- 172.21.15.57:0/1010321926 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba8c032840 con 0x7fbaa406cf30 2024-03-27T10:00:52.130 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.141+0000 7fba9a000640 1 -- 172.21.15.57:0/1010321926 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba8c0329e0 con 0x7fbaa406cf30 2024-03-27T10:00:52.130 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.141+0000 7fba9a000640 1 -- 172.21.15.57:0/1010321926 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba8c032dd0 con 0x7fbaa406cf30 2024-03-27T10:00:52.130 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.141+0000 7fbaa8c00640 1 -- 172.21.15.57:0/1010321926 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbaa40cb410 con 0x7fbaa406cf30 2024-03-27T10:00:52.130 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.141+0000 7fbaa8c00640 1 -- 172.21.15.57:0/1010321926 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbaa40cb9d0 con 0x7fbaa406cf30 2024-03-27T10:00:52.131 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.142+0000 7fbaa8c00640 1 -- 172.21.15.57:0/1010321926 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbaa4068540 con 0x7fbaa406cf30 2024-03-27T10:00:52.131 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.143+0000 7fba9a000640 1 -- 172.21.15.57:0/1010321926 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fba8c03b3f0 con 0x7fbaa406cf30 2024-03-27T10:00:52.132 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.144+0000 7fba9a000640 1 --2- 172.21.15.57:0/1010321926 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fba8006c530 0x7fba8006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:52.132 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.144+0000 7fba9a000640 1 -- 172.21.15.57:0/1010321926 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fba8c02f030 con 0x7fbaa406cf30 2024-03-27T10:00:52.132 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.144+0000 7fbaa1400640 1 --2- 172.21.15.57:0/1010321926 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fba8006c530 0x7fba8006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:52.133 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.145+0000 7fbaa1400640 1 --2- 172.21.15.57:0/1010321926 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fba8006c530 0x7fba8006e9f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fbaa406d480 tx=0x7fba94007ed0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:52.137 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.149+0000 7fba9a000640 1 -- 172.21.15.57:0/1010321926 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7fba8c040070 con 0x7fbaa406cf30 2024-03-27T10:00:52.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.350+0000 7fbaa8c00640 1 -- 172.21.15.57:0/1010321926 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fbaa40cbd70 con 0x7fbaa406cf30 2024-03-27T10:00:52.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.351+0000 7fba9a000640 1 -- 172.21.15.57:0/1010321926 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) ==== 100+0+11 (secure 0 0 0) 0x7fba8c07bd20 con 0x7fbaa406cf30 2024-03-27T10:00:52.339 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2024-03-27T10:00:52.342 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.353+0000 7fbaa8c00640 1 -- 172.21.15.57:0/1010321926 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fba8006c530 msgr2=0x7fba8006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:52.342 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.353+0000 7fbaa8c00640 1 --2- 172.21.15.57:0/1010321926 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fba8006c530 0x7fba8006e9f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fbaa406d480 tx=0x7fba94007ed0 comp rx=0 tx=0).stop 2024-03-27T10:00:52.342 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.353+0000 7fbaa8c00640 1 -- 172.21.15.57:0/1010321926 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbaa406cf30 msgr2=0x7fbaa414fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:52.342 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.353+0000 7fbaa8c00640 1 --2- 172.21.15.57:0/1010321926 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbaa406cf30 0x7fbaa414fc10 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fba8c0097a0 tx=0x7fba8c0046c0 comp rx=0 tx=0).stop 2024-03-27T10:00:52.342 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.353+0000 7fbaa8c00640 1 -- 172.21.15.57:0/1010321926 shutdown_connections 2024-03-27T10:00:52.342 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.353+0000 7fbaa8c00640 1 --2- 172.21.15.57:0/1010321926 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbaa40aea20 0x7fbaa40ca850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:52.342 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.353+0000 7fbaa8c00640 1 --2- 172.21.15.57:0/1010321926 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fba8006c530 0x7fba8006e9f0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:52.342 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.353+0000 7fbaa8c00640 1 --2- 172.21.15.57:0/1010321926 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbaa40acd60 0x7fbaa414c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:52.342 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.353+0000 7fbaa8c00640 1 --2- 172.21.15.57:0/1010321926 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbaa406cf30 0x7fbaa414fc10 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:52.343 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.353+0000 7fbaa8c00640 1 -- 172.21.15.57:0/1010321926 >> 172.21.15.57:0/1010321926 conn(0x7fbaa40b18a0 msgr2=0x7fbaa40adaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:52.343 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.354+0000 7fbaa8c00640 1 -- 172.21.15.57:0/1010321926 shutdown_connections 2024-03-27T10:00:52.343 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.354+0000 7fbaa8c00640 1 -- 172.21.15.57:0/1010321926 wait complete. 2024-03-27T10:00:52.359 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-27T10:00:52.583 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.595+0000 7fa5d2600640 1 Processor -- start 2024-03-27T10:00:52.583 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.595+0000 7fa5d2600640 1 -- start start 2024-03-27T10:00:52.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.597+0000 7fa5d2600640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fa5cc0d3770 0x7fa5cc0cf210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:52.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.597+0000 7fa5d2600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa5cc0cf750 0x7fa5cc06bf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:52.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.597+0000 7fa5d2600640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5cc0cfe40 con 0x7fa5cc161950 2024-03-27T10:00:52.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.597+0000 7fa5d2600640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7fa5cc161d30 con 0x7fa5cc0d3770 2024-03-27T10:00:52.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.597+0000 7fa5d2600640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fa5cc0d0f10 con 0x7fa5cc0cf750 2024-03-27T10:00:52.586 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.597+0000 7fa5cbe00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fa5cc0d3770 0x7fa5cc0cf210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:52.586 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.597+0000 7fa5d1c00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa5cc0cf750 0x7fa5cc06bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:52.586 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.597+0000 7fa5cbe00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fa5cc0d3770 0x7fa5cc0cf210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.57:50514/0 (socket says 172.21.15.57:50514) 2024-03-27T10:00:52.586 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.597+0000 7fa5cbe00640 1 -- 172.21.15.57:0/2671167207 learned_addr learned my addr 172.21.15.57:0/2671167207 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:52.586 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.597+0000 7fa5d1c00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa5cc0cf750 0x7fa5cc06bf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.57:38776/0 (socket says 172.21.15.57:38776) 2024-03-27T10:00:52.586 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.598+0000 7fa5cbe00640 1 -- 172.21.15.57:0/2671167207 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa5cc0cf750 msgr2=0x7fa5cc06bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:52.586 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.598+0000 7fa5cbe00640 1 --2- 172.21.15.57:0/2671167207 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa5cc0cf750 0x7fa5cc06bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:52.586 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.598+0000 7fa5cbe00640 1 -- 172.21.15.57:0/2671167207 >> v1:172.21.15.118:6789/0 conn(0x7fa5cc161950 legacy=0x7fa5cc0ceb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:52.587 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.598+0000 7fa5cbe00640 1 -- 172.21.15.57:0/2671167207 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5cc0d11f0 con 0x7fa5cc0d3770 2024-03-27T10:00:52.588 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.599+0000 7fa5cbe00640 1 --2- 172.21.15.57:0/2671167207 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5cc0d3770 0x7fa5cc0cf210 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa5b8009870 tx=0x7fa5b802ba10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9fbd908c2dc61d83 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:52.588 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.600+0000 7fa5cb400640 1 -- 172.21.15.57:0/2671167207 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5b802f830 con 0x7fa5cc0d3770 2024-03-27T10:00:52.588 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.600+0000 7fa5cb400640 1 -- 172.21.15.57:0/2671167207 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5b802f9d0 con 0x7fa5cc0d3770 2024-03-27T10:00:52.588 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.600+0000 7fa5cb400640 1 -- 172.21.15.57:0/2671167207 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5b802fda0 con 0x7fa5cc0d3770 2024-03-27T10:00:52.589 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.601+0000 7fa5d2600640 1 -- 172.21.15.57:0/2671167207 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5cc0d3770 msgr2=0x7fa5cc0cf210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:52.590 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.601+0000 7fa5d2600640 1 --2- 172.21.15.57:0/2671167207 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5cc0d3770 0x7fa5cc0cf210 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa5b8009870 tx=0x7fa5b802ba10 comp rx=0 tx=0).stop 2024-03-27T10:00:52.590 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.601+0000 7fa5d2600640 1 -- 172.21.15.57:0/2671167207 shutdown_connections 2024-03-27T10:00:52.590 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.601+0000 7fa5d2600640 1 --2- 172.21.15.57:0/2671167207 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa5cc0cf750 0x7fa5cc06bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:52.590 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.601+0000 7fa5d2600640 1 --2- 172.21.15.57:0/2671167207 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5cc0d3770 0x7fa5cc0cf210 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:52.590 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.601+0000 7fa5d2600640 1 -- 172.21.15.57:0/2671167207 >> 172.21.15.57:0/2671167207 conn(0x7fa5cc0d3fc0 msgr2=0x7fa5cc0d43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:52.590 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.601+0000 7fa5d2600640 1 -- 172.21.15.57:0/2671167207 shutdown_connections 2024-03-27T10:00:52.590 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.601+0000 7fa5d2600640 1 -- 172.21.15.57:0/2671167207 wait complete. 2024-03-27T10:00:52.590 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.602+0000 7fa5d2600640 1 Processor -- start 2024-03-27T10:00:52.591 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.603+0000 7fa5d2600640 1 -- start start 2024-03-27T10:00:52.592 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.603+0000 7fa5d2600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa5cc0cf750 0x7fa5cc1514a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:52.592 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.604+0000 7fa5d2600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5cc0d3770 0x7fa5cc0b8a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:52.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.604+0000 7fa5d2600640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5cc161950 0x7fa5cc0b6d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:52.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.604+0000 7fa5d2600640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fa5cc0d2240 con 0x7fa5cc161950 2024-03-27T10:00:52.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.604+0000 7fa5d2600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fa5cc0d1f60 con 0x7fa5cc0d3770 2024-03-27T10:00:52.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.604+0000 7fa5d2600640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fa5cc0d17b0 con 0x7fa5cc0cf750 2024-03-27T10:00:52.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.604+0000 7fa5d1c00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5cc161950 0x7fa5cc0b6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:52.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.604+0000 7fa5d1c00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5cc161950 0x7fa5cc0b6d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56084/0 (socket says 172.21.15.57:56084) 2024-03-27T10:00:52.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.604+0000 7fa5d1c00640 1 -- 172.21.15.57:0/3801869556 learned_addr learned my addr 172.21.15.57:0/3801869556 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:52.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.604+0000 7fa5cbe00640 1 --2- 172.21.15.57:0/3801869556 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5cc0d3770 0x7fa5cc0b8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:52.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.604+0000 7fa5d1c00640 1 -- 172.21.15.57:0/3801869556 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa5cc0cf750 msgr2=0x7fa5cc1514a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:52.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.604+0000 7fa5d1c00640 1 --2- 172.21.15.57:0/3801869556 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa5cc0cf750 0x7fa5cc1514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:52.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.604+0000 7fa5d1c00640 1 -- 172.21.15.57:0/3801869556 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5cc0d3770 msgr2=0x7fa5cc0b8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:52.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.604+0000 7fa5d1c00640 1 --2- 172.21.15.57:0/3801869556 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5cc0d3770 0x7fa5cc0b8a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:52.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.604+0000 7fa5d1c00640 1 -- 172.21.15.57:0/3801869556 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5cc0b79e0 con 0x7fa5cc161950 2024-03-27T10:00:52.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.604+0000 7fa5cbe00640 1 --2- 172.21.15.57:0/3801869556 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5cc0d3770 0x7fa5cc0b8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T10:00:52.594 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.605+0000 7fa5d1c00640 1 --2- 172.21.15.57:0/3801869556 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5cc161950 0x7fa5cc0b6d40 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fa5c4009e30 tx=0x7fa5c400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:52.594 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.605+0000 7fa5c8c00640 1 -- 172.21.15.57:0/3801869556 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5c4018020 con 0x7fa5cc161950 2024-03-27T10:00:52.594 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.605+0000 7fa5c8c00640 1 -- 172.21.15.57:0/3801869556 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5c4014480 con 0x7fa5cc161950 2024-03-27T10:00:52.595 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.605+0000 7fa5d2600640 1 -- 172.21.15.57:0/3801869556 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5cc0b7cc0 con 0x7fa5cc161950 2024-03-27T10:00:52.595 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.605+0000 7fa5c8c00640 1 -- 172.21.15.57:0/3801869556 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5c4014870 con 0x7fa5cc161950 2024-03-27T10:00:52.595 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.605+0000 7fa5d2600640 1 -- 172.21.15.57:0/3801869556 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5cc0b8280 con 0x7fa5cc161950 2024-03-27T10:00:52.595 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.606+0000 7fa5d2600640 1 -- 172.21.15.57:0/3801869556 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5cc068540 con 0x7fa5cc161950 2024-03-27T10:00:52.595 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.607+0000 7fa5c8c00640 1 -- 172.21.15.57:0/3801869556 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fa5c4005d10 con 0x7fa5cc161950 2024-03-27T10:00:52.596 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.608+0000 7fa5c8c00640 1 --2- 172.21.15.57:0/3801869556 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fa5ac06c530 0x7fa5ac06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:52.596 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.608+0000 7fa5c8c00640 1 -- 172.21.15.57:0/3801869556 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fa5c408c960 con 0x7fa5cc161950 2024-03-27T10:00:52.596 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.608+0000 7fa5d1200640 1 --2- 172.21.15.57:0/3801869556 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fa5ac06c530 0x7fa5ac06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:52.597 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.609+0000 7fa5d1200640 1 --2- 172.21.15.57:0/3801869556 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fa5ac06c530 0x7fa5ac06e9f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa5c0000f60 tx=0x7fa5c00079d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:52.600 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.613+0000 7fa5c8c00640 1 -- 172.21.15.57:0/3801869556 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7fa5c4022030 con 0x7fa5cc161950 2024-03-27T10:00:52.802 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.814+0000 7fa5d2600640 1 -- 172.21.15.57:0/3801869556 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fa5cc06c0b0 con 0x7fa5cc161950 2024-03-27T10:00:52.803 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.815+0000 7fa5c8c00640 1 -- 172.21.15.57:0/3801869556 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) ==== 103+0+11 (secure 0 0 0) 0x7fa5c4010040 con 0x7fa5cc161950 2024-03-27T10:00:52.803 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2024-03-27T10:00:52.806 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.817+0000 7fa5d2600640 1 -- 172.21.15.57:0/3801869556 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fa5ac06c530 msgr2=0x7fa5ac06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:52.806 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.817+0000 7fa5d2600640 1 --2- 172.21.15.57:0/3801869556 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fa5ac06c530 0x7fa5ac06e9f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa5c0000f60 tx=0x7fa5c00079d0 comp rx=0 tx=0).stop 2024-03-27T10:00:52.806 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.817+0000 7fa5d2600640 1 -- 172.21.15.57:0/3801869556 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5cc161950 msgr2=0x7fa5cc0b6d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:52.806 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.817+0000 7fa5d2600640 1 --2- 172.21.15.57:0/3801869556 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5cc161950 0x7fa5cc0b6d40 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fa5c4009e30 tx=0x7fa5c400c490 comp rx=0 tx=0).stop 2024-03-27T10:00:52.806 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.817+0000 7fa5d2600640 1 -- 172.21.15.57:0/3801869556 shutdown_connections 2024-03-27T10:00:52.806 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.817+0000 7fa5d2600640 1 --2- 172.21.15.57:0/3801869556 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5cc161950 0x7fa5cc0b6d40 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:52.806 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.817+0000 7fa5d2600640 1 --2- 172.21.15.57:0/3801869556 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fa5ac06c530 0x7fa5ac06e9f0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:52.806 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.817+0000 7fa5d2600640 1 --2- 172.21.15.57:0/3801869556 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5cc0d3770 0x7fa5cc0b8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:52.806 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.817+0000 7fa5d2600640 1 --2- 172.21.15.57:0/3801869556 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa5cc0cf750 0x7fa5cc1514a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:52.806 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.817+0000 7fa5d2600640 1 -- 172.21.15.57:0/3801869556 >> 172.21.15.57:0/3801869556 conn(0x7fa5cc0d3fc0 msgr2=0x7fa5cc0d25b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:52.806 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.817+0000 7fa5d2600640 1 -- 172.21.15.57:0/3801869556 shutdown_connections 2024-03-27T10:00:52.806 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:52.817+0000 7fa5d2600640 1 -- 172.21.15.57:0/3801869556 wait complete. 2024-03-27T10:00:52.822 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-27T10:00:53.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.032+0000 7f2608a00640 1 Processor -- start 2024-03-27T10:00:53.021 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.032+0000 7f2608a00640 1 -- start start 2024-03-27T10:00:53.023 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.034+0000 7f2608a00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f260415e2b0 0x7f260406ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:53.023 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.034+0000 7f2608a00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f260406f120 0x7f2604161d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:53.023 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.034+0000 7f2608a00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2604162a30 con 0x7f260415ded0 2024-03-27T10:00:53.023 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.034+0000 7f2608a00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f2604162d10 con 0x7f260406f120 2024-03-27T10:00:53.023 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.034+0000 7f2608a00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f26040b3dd0 con 0x7f260415e2b0 2024-03-27T10:00:53.024 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.035+0000 7f2602800640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f260406f120 0x7f2604161d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:53.024 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.035+0000 7f25f9400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f260415e2b0 0x7f260406ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:53.024 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.035+0000 7f25f9400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f260415e2b0 0x7f260406ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.57:38804/0 (socket says 172.21.15.57:38804) 2024-03-27T10:00:53.024 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.035+0000 7f25f9400640 1 -- 172.21.15.57:0/2715251637 learned_addr learned my addr 172.21.15.57:0/2715251637 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:53.024 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.036+0000 7f2601400640 1 -- 172.21.15.57:0/2715251637 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1469542677 0 0) 0x7f2604162a30 con 0x7f260415ded0 2024-03-27T10:00:53.024 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.036+0000 7f2601400640 1 -- 172.21.15.57:0/2715251637 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f25e8003520 con 0x7f260415ded0 2024-03-27T10:00:53.025 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.036+0000 7f2602800640 1 -- 172.21.15.57:0/2715251637 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f260415e2b0 msgr2=0x7f260406ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:53.025 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.036+0000 7f2602800640 1 --2- 172.21.15.57:0/2715251637 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f260415e2b0 0x7f260406ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:53.025 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.036+0000 7f2602800640 1 -- 172.21.15.57:0/2715251637 >> v1:172.21.15.118:6789/0 conn(0x7f260415ded0 legacy=0x7f26040b4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:53.025 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.036+0000 7f2602800640 1 -- 172.21.15.57:0/2715251637 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26040b3780 con 0x7f260406f120 2024-03-27T10:00:53.025 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.036+0000 7f25f9400640 1 --2- 172.21.15.57:0/2715251637 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f260415e2b0 0x7f260406ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T10:00:53.025 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.037+0000 7f2602800640 1 --2- 172.21.15.57:0/2715251637 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f260406f120 0x7f2604161d70 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f25fc009d90 tx=0x7f25fc02bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=412e1878edda05c9 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:53.026 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.038+0000 7f2601400640 1 -- 172.21.15.57:0/2715251637 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25fc039070 con 0x7f260406f120 2024-03-27T10:00:53.026 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.038+0000 7f2601400640 1 -- 172.21.15.57:0/2715251637 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25fc02cc50 con 0x7f260406f120 2024-03-27T10:00:53.026 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.038+0000 7f2601400640 1 -- 172.21.15.57:0/2715251637 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25fc034440 con 0x7f260406f120 2024-03-27T10:00:53.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.038+0000 7f2608a00640 1 -- 172.21.15.57:0/2715251637 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f260406f120 msgr2=0x7f2604161d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:53.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.038+0000 7f2608a00640 1 --2- 172.21.15.57:0/2715251637 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f260406f120 0x7f2604161d70 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f25fc009d90 tx=0x7f25fc02bea0 comp rx=0 tx=0).stop 2024-03-27T10:00:53.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.039+0000 7f2608a00640 1 -- 172.21.15.57:0/2715251637 shutdown_connections 2024-03-27T10:00:53.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.039+0000 7f2608a00640 1 --2- 172.21.15.57:0/2715251637 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f260406f120 0x7f2604161d70 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:53.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.039+0000 7f2608a00640 1 --2- 172.21.15.57:0/2715251637 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f260415e2b0 0x7f260406ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:53.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.039+0000 7f2608a00640 1 -- 172.21.15.57:0/2715251637 >> 172.21.15.57:0/2715251637 conn(0x7f26040b1c60 msgr2=0x7f26040b2070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:53.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.039+0000 7f2608a00640 1 -- 172.21.15.57:0/2715251637 shutdown_connections 2024-03-27T10:00:53.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.039+0000 7f2608a00640 1 -- 172.21.15.57:0/2715251637 wait complete. 2024-03-27T10:00:53.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.041+0000 7f2608a00640 1 Processor -- start 2024-03-27T10:00:53.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.041+0000 7f2608a00640 1 -- start start 2024-03-27T10:00:53.031 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.043+0000 7f2608a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f260406f120 0x7f26041410b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:53.031 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.043+0000 7f2608a00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f260415ded0 0x7f26041f3240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:53.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.043+0000 7f2608a00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f260415e2b0 0x7f2604160150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:53.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.043+0000 7f2608a00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f2604162430 con 0x7f260415ded0 2024-03-27T10:00:53.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.043+0000 7f2608a00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f26041622b0 con 0x7f260406f120 2024-03-27T10:00:53.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.043+0000 7f2608a00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f26041625b0 con 0x7f260415e2b0 2024-03-27T10:00:53.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.043+0000 7f25f9400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f260415ded0 0x7f26041f3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:53.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.043+0000 7f25f9400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f260415ded0 0x7f26041f3240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56094/0 (socket says 172.21.15.57:56094) 2024-03-27T10:00:53.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.043+0000 7f25f9400640 1 -- 172.21.15.57:0/3611845395 learned_addr learned my addr 172.21.15.57:0/3611845395 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:53.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.043+0000 7f2601e00640 1 --2- 172.21.15.57:0/3611845395 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f260406f120 0x7f26041410b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:53.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.044+0000 7f2602800640 1 --2- 172.21.15.57:0/3611845395 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f260415e2b0 0x7f2604160150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:53.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.044+0000 7f25f9400640 1 -- 172.21.15.57:0/3611845395 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f260415e2b0 msgr2=0x7f2604160150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:53.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.044+0000 7f25f9400640 1 --2- 172.21.15.57:0/3611845395 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f260415e2b0 0x7f2604160150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:53.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.044+0000 7f25f9400640 1 -- 172.21.15.57:0/3611845395 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f260406f120 msgr2=0x7f26041410b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:53.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.044+0000 7f25f9400640 1 --2- 172.21.15.57:0/3611845395 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f260406f120 0x7f26041410b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:53.034 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.044+0000 7f25f9400640 1 -- 172.21.15.57:0/3611845395 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2604160690 con 0x7f260415ded0 2024-03-27T10:00:53.034 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.044+0000 7f2602800640 1 --2- 172.21.15.57:0/3611845395 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f260415e2b0 0x7f2604160150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T10:00:53.034 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.044+0000 7f25f9400640 1 --2- 172.21.15.57:0/3611845395 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f260415ded0 0x7f26041f3240 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f25ec00e9d0 tx=0x7f25ec00ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:53.034 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.044+0000 7f25faa00640 1 -- 172.21.15.57:0/3611845395 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25ec017070 con 0x7f260415ded0 2024-03-27T10:00:53.034 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.044+0000 7f25faa00640 1 -- 172.21.15.57:0/3611845395 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25ec00ca60 con 0x7f260415ded0 2024-03-27T10:00:53.034 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.044+0000 7f25faa00640 1 -- 172.21.15.57:0/3611845395 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25ec00ce10 con 0x7f260415ded0 2024-03-27T10:00:53.034 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.044+0000 7f2608a00640 1 -- 172.21.15.57:0/3611845395 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2604160910 con 0x7f260415ded0 2024-03-27T10:00:53.034 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.045+0000 7f2608a00640 1 -- 172.21.15.57:0/3611845395 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2604160ed0 con 0x7f260415ded0 2024-03-27T10:00:53.034 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.046+0000 7f2608a00640 1 -- 172.21.15.57:0/3611845395 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2604068620 con 0x7f260415ded0 2024-03-27T10:00:53.035 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.047+0000 7f25faa00640 1 -- 172.21.15.57:0/3611845395 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f25ec01a070 con 0x7f260415ded0 2024-03-27T10:00:53.036 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.048+0000 7f25faa00640 1 --2- 172.21.15.57:0/3611845395 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f25e006c560 0x7f25e006ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:53.036 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.048+0000 7f25faa00640 1 -- 172.21.15.57:0/3611845395 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f25ec08ba40 con 0x7f260415ded0 2024-03-27T10:00:53.036 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.048+0000 7f2601e00640 1 --2- 172.21.15.57:0/3611845395 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f25e006c560 0x7f25e006ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:53.037 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.049+0000 7f2601e00640 1 --2- 172.21.15.57:0/3611845395 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f25e006c560 0x7f25e006ea20 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f25f4001650 tx=0x7f25f4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:53.040 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.052+0000 7f25faa00640 1 -- 172.21.15.57:0/3611845395 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f2604160690 con 0x7f260415ded0 2024-03-27T10:00:53.264 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.276+0000 7f2608a00640 1 -- 172.21.15.57:0/3611845395 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f26041610a0 con 0x7f260415ded0 2024-03-27T10:00:53.265 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.276+0000 7f25faa00640 1 -- 172.21.15.57:0/3611845395 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) ==== 80+0+0 (secure 0 0 0) 0x7f26041610a0 con 0x7f260415ded0 2024-03-27T10:00:53.265 INFO:teuthology.orchestra.run.smithi057.stderr:listed 0 entries 2024-03-27T10:00:53.268 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.279+0000 7f2608a00640 1 -- 172.21.15.57:0/3611845395 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f25e006c560 msgr2=0x7f25e006ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:53.268 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.279+0000 7f2608a00640 1 --2- 172.21.15.57:0/3611845395 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f25e006c560 0x7f25e006ea20 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f25f4001650 tx=0x7f25f4009040 comp rx=0 tx=0).stop 2024-03-27T10:00:53.268 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.279+0000 7f2608a00640 1 -- 172.21.15.57:0/3611845395 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f260415ded0 msgr2=0x7f26041f3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:53.268 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.279+0000 7f2608a00640 1 --2- 172.21.15.57:0/3611845395 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f260415ded0 0x7f26041f3240 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f25ec00e9d0 tx=0x7f25ec00ee90 comp rx=0 tx=0).stop 2024-03-27T10:00:53.268 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.279+0000 7f2608a00640 1 -- 172.21.15.57:0/3611845395 shutdown_connections 2024-03-27T10:00:53.268 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.279+0000 7f2608a00640 1 --2- 172.21.15.57:0/3611845395 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f260415e2b0 0x7f2604160150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:53.268 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.279+0000 7f2608a00640 1 --2- 172.21.15.57:0/3611845395 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f260415ded0 0x7f26041f3240 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:53.268 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.279+0000 7f2608a00640 1 --2- 172.21.15.57:0/3611845395 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f25e006c560 0x7f25e006ea20 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:53.268 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.279+0000 7f2608a00640 1 --2- 172.21.15.57:0/3611845395 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f260406f120 0x7f26041410b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:53.268 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.279+0000 7f2608a00640 1 -- 172.21.15.57:0/3611845395 >> 172.21.15.57:0/3611845395 conn(0x7f26040b1c60 msgr2=0x7f2604071a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:53.269 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.280+0000 7f2608a00640 1 -- 172.21.15.57:0/3611845395 shutdown_connections 2024-03-27T10:00:53.269 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.280+0000 7f2608a00640 1 -- 172.21.15.57:0/3611845395 wait complete. 2024-03-27T10:00:53.287 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi118.front.sepia.ceph.com... 2024-03-27T10:00:53.288 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T10:00:53.288 DEBUG:teuthology.orchestra.run.smithi118:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-03-27T10:00:53.383 INFO:teuthology.orchestra.run:waiting for 300 2024-03-27T10:00:53.383 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi118.front.sepia.ceph.com 2024-03-27T10:00:53.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T10:00:53.384 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-03-27T10:00:53.443 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-03-27T10:00:53.443 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-27T10:00:53.503 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-03-27T10:00:53.503 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-27T10:00:53.558 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-27T10:00:53.782 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.793+0000 7eff46800640 1 Processor -- start 2024-03-27T10:00:53.782 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.794+0000 7eff46800640 1 -- start start 2024-03-27T10:00:53.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.795+0000 7eff46800640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7eff40145820 0x7eff400cc950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:53.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.795+0000 7eff46800640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7eff400cf750 0x7eff4006bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:53.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.795+0000 7eff46800640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff400cce90 con 0x7eff4006b750 2024-03-27T10:00:53.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.795+0000 7eff46800640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7eff4006c100 con 0x7eff400cf750 2024-03-27T10:00:53.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.795+0000 7eff46800640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7eff40160b60 con 0x7eff40145820 2024-03-27T10:00:53.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.796+0000 7eff3fe00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7eff400cf750 0x7eff4006bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:53.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.796+0000 7eff3fe00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7eff400cf750 0x7eff4006bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56106/0 (socket says 172.21.15.57:56106) 2024-03-27T10:00:53.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.796+0000 7eff3fe00640 1 -- 172.21.15.57:0/1828400257 learned_addr learned my addr 172.21.15.57:0/1828400257 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:53.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.796+0000 7eff3f400640 1 --2- 172.21.15.57:0/1828400257 >> v2:172.21.15.118:3300/0 conn(0x7eff40145820 0x7eff400cc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:53.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.796+0000 7eff3fe00640 1 -- 172.21.15.57:0/1828400257 >> v2:172.21.15.118:3300/0 conn(0x7eff40145820 msgr2=0x7eff400cc950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:53.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.796+0000 7eff3fe00640 1 --2- 172.21.15.57:0/1828400257 >> v2:172.21.15.118:3300/0 conn(0x7eff40145820 0x7eff400cc950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:53.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.796+0000 7eff3fe00640 1 -- 172.21.15.57:0/1828400257 >> v1:172.21.15.118:6789/0 conn(0x7eff4006b750 legacy=0x7eff400b2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:53.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.796+0000 7eff3fe00640 1 -- 172.21.15.57:0/1828400257 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff4015fc70 con 0x7eff400cf750 2024-03-27T10:00:53.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.798+0000 7eff3fe00640 1 --2- 172.21.15.57:0/1828400257 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7eff400cf750 0x7eff4006bbc0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7eff400af610 tx=0x7eff3802b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f189ddf35e879a9 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:53.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.798+0000 7eff3e000640 1 -- 172.21.15.57:0/1828400257 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff380317c0 con 0x7eff400cf750 2024-03-27T10:00:53.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.798+0000 7eff3e000640 1 -- 172.21.15.57:0/1828400257 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff38037070 con 0x7eff400cf750 2024-03-27T10:00:53.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.798+0000 7eff3e000640 1 -- 172.21.15.57:0/1828400257 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff38031b80 con 0x7eff400cf750 2024-03-27T10:00:53.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.798+0000 7eff46800640 1 -- 172.21.15.57:0/1828400257 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7eff400cf750 msgr2=0x7eff4006bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:53.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.798+0000 7eff46800640 1 --2- 172.21.15.57:0/1828400257 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7eff400cf750 0x7eff4006bbc0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7eff400af610 tx=0x7eff3802b860 comp rx=0 tx=0).stop 2024-03-27T10:00:53.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.799+0000 7eff46800640 1 -- 172.21.15.57:0/1828400257 shutdown_connections 2024-03-27T10:00:53.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.799+0000 7eff46800640 1 --2- 172.21.15.57:0/1828400257 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7eff400cf750 0x7eff4006bbc0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:53.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.799+0000 7eff46800640 1 --2- 172.21.15.57:0/1828400257 >> v2:172.21.15.118:3300/0 conn(0x7eff40145820 0x7eff400cc950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:53.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.799+0000 7eff46800640 1 -- 172.21.15.57:0/1828400257 >> 172.21.15.57:0/1828400257 conn(0x7eff400b1c60 msgr2=0x7eff400b2070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:53.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.799+0000 7eff46800640 1 -- 172.21.15.57:0/1828400257 shutdown_connections 2024-03-27T10:00:53.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.799+0000 7eff46800640 1 -- 172.21.15.57:0/1828400257 wait complete. 2024-03-27T10:00:53.788 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.800+0000 7eff46800640 1 Processor -- start 2024-03-27T10:00:53.788 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.800+0000 7eff46800640 1 -- start start 2024-03-27T10:00:53.790 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.801+0000 7eff46800640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7eff4006b750 0x7eff4013c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:53.791 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.801+0000 7eff46800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7eff400cf750 0x7eff40071b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:53.791 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.801+0000 7eff46800640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7eff40145820 0x7eff40072080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:53.791 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.801+0000 7eff46800640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7eff40160510 con 0x7eff40145820 2024-03-27T10:00:53.791 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.801+0000 7eff46800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7eff40160230 con 0x7eff400cf750 2024-03-27T10:00:53.791 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.801+0000 7eff46800640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7eff401607f0 con 0x7eff4006b750 2024-03-27T10:00:53.791 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.802+0000 7eff3fe00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7eff40145820 0x7eff40072080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:53.791 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.802+0000 7eff3fe00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7eff40145820 0x7eff40072080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56120/0 (socket says 172.21.15.57:56120) 2024-03-27T10:00:53.791 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.802+0000 7eff3fe00640 1 -- 172.21.15.57:0/1628511209 learned_addr learned my addr 172.21.15.57:0/1628511209 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:53.791 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.802+0000 7eff3f400640 1 --2- 172.21.15.57:0/1628511209 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7eff4006b750 0x7eff4013c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:53.791 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.802+0000 7eff3ea00640 1 --2- 172.21.15.57:0/1628511209 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7eff400cf750 0x7eff40071b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:53.791 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.802+0000 7eff3fe00640 1 -- 172.21.15.57:0/1628511209 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7eff4006b750 msgr2=0x7eff4013c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:53.791 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.802+0000 7eff3fe00640 1 --2- 172.21.15.57:0/1628511209 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7eff4006b750 0x7eff4013c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:53.791 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.802+0000 7eff3fe00640 1 -- 172.21.15.57:0/1628511209 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7eff400cf750 msgr2=0x7eff40071b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:53.792 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.802+0000 7eff3fe00640 1 --2- 172.21.15.57:0/1628511209 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7eff400cf750 0x7eff40071b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:53.792 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.802+0000 7eff3fe00640 1 -- 172.21.15.57:0/1628511209 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff4013cb40 con 0x7eff40145820 2024-03-27T10:00:53.792 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.803+0000 7eff3fe00640 1 --2- 172.21.15.57:0/1628511209 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7eff40145820 0x7eff40072080 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7eff380090b0 tx=0x7eff380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:53.792 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.803+0000 7eff37400640 1 -- 172.21.15.57:0/1628511209 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff38032650 con 0x7eff40145820 2024-03-27T10:00:53.793 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.803+0000 7eff37400640 1 -- 172.21.15.57:0/1628511209 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff380327f0 con 0x7eff40145820 2024-03-27T10:00:53.793 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.803+0000 7eff37400640 1 -- 172.21.15.57:0/1628511209 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff38032be0 con 0x7eff40145820 2024-03-27T10:00:53.793 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.803+0000 7eff46800640 1 -- 172.21.15.57:0/1628511209 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff400ae790 con 0x7eff40145820 2024-03-27T10:00:53.793 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.803+0000 7eff46800640 1 -- 172.21.15.57:0/1628511209 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff400aed50 con 0x7eff40145820 2024-03-27T10:00:53.793 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.804+0000 7eff46800640 1 -- 172.21.15.57:0/1628511209 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff40068620 con 0x7eff40145820 2024-03-27T10:00:53.793 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.805+0000 7eff37400640 1 -- 172.21.15.57:0/1628511209 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7eff3804c060 con 0x7eff40145820 2024-03-27T10:00:53.795 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.807+0000 7eff37400640 1 --2- 172.21.15.57:0/1628511209 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7eff2006c530 0x7eff2006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:53.796 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.807+0000 7eff37400640 1 -- 172.21.15.57:0/1628511209 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7eff380ad690 con 0x7eff40145820 2024-03-27T10:00:53.796 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.807+0000 7eff3f400640 1 --2- 172.21.15.57:0/1628511209 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7eff2006c530 0x7eff2006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:53.796 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.808+0000 7eff3f400640 1 --2- 172.21.15.57:0/1628511209 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7eff2006c530 0x7eff2006e9f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7eff400b1330 tx=0x7eff300039b0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:53.799 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:53.811+0000 7eff37400640 1 -- 172.21.15.57:0/1628511209 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7eff38040070 con 0x7eff40145820 2024-03-27T10:00:54.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.014+0000 7eff46800640 1 -- 172.21.15.57:0/1628511209 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7eff400b4a70 con 0x7eff40145820 2024-03-27T10:00:54.004 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.016+0000 7eff37400640 1 -- 172.21.15.57:0/1628511209 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) ==== 74+0+18888 (secure 0 0 0) 0x7eff3807b8a0 con 0x7eff40145820 2024-03-27T10:00:54.005 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:00:54.005 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":28,"fsid":"7ac43f86-2c16-4a97-98fb-715d3cebc75c","created":"2024-03-27T09:59:04.033417+0000","modified":"2024-03-27T10:00:10.462391+0000","last_up_change":"2024-03-27T09:59:16.969624+0000","last_in_change":"2024-03-27T09:59:07.421690+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-27T09:59:17.253008+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-27T09:59:26.690365+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-27T09:59:27.559059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-27T09:59:31.187596+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"47b44362-7302-4f2a-b735-582c6c3850cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6801","nonce":2020036298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6803","nonce":2020036298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6807","nonce":2020036298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6805","nonce":2020036298}]},"public_addr":"172.21.15.57:6801/2020036298","cluster_addr":"172.21.15.57:6803/2020036298","heartbeat_back_addr":"172.21.15.57:6807/2020036298","heartbeat_front_addr":"172.21.15.57:6805/2020036298","state":["exists","up"]},{"osd":1,"uuid":"feaf96f0-9431-4188-9a09-da505b40e934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6809","nonce":3190929242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6811","nonce":3190929242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6815","nonce":3190929242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6813","nonce":3190929242}]},"public_addr":"172.21.15.57:6809/3190929242","cluster_addr":"172.21.15.57:6811/3190929242","heartbeat_back_addr":"172.21.15.57:6815/3190929242","heartbeat_front_addr":"172.21.15.57:6813/3190929242","state":["exists","up"]},{"osd":2,"uuid":"21e406e6-cfbc-4fe7-a816-e2420487c95d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6817","nonce":4065849973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6819","nonce":4065849973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6823","nonce":4065849973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6821","nonce":4065849973}]},"public_addr":"172.21.15.57:6817/4065849973","cluster_addr":"172.21.15.57:6819/4065849973","heartbeat_back_addr":"172.21.15.57:6823/4065849973","heartbeat_front_addr":"172.21.15.57:6821/4065849973","state":["exists","up"]},{"osd":3,"uuid":"a389af1d-76c4-4dfc-b215-f983f4931257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6825","nonce":158084809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6827","nonce":158084809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6831","nonce":158084809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6829","nonce":158084809}]},"public_addr":"172.21.15.57:6825/158084809","cluster_addr":"172.21.15.57:6827/158084809","heartbeat_back_addr":"172.21.15.57:6831/158084809","heartbeat_front_addr":"172.21.15.57:6829/158084809","state":["exists","up"]},{"osd":4,"uuid":"e9b05dca-557a-43ee-b43f-9ce5b7d28304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6823","nonce":108719401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6827","nonce":108719401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6831","nonce":108719401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6829","nonce":108719401}]},"public_addr":"172.21.15.118:6823/108719401","cluster_addr":"172.21.15.118:6827/108719401","heartbeat_back_addr":"172.21.15.118:6831/108719401","heartbeat_front_addr":"172.21.15.118:6829/108719401","state":["exists","up"]},{"osd":5,"uuid":"d968177d-44ff-499a-b00a-b147ed879253","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6817","nonce":2704605866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6819","nonce":2704605866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6826","nonce":2704605866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6822","nonce":2704605866}]},"public_addr":"172.21.15.118:6817/2704605866","cluster_addr":"172.21.15.118:6819/2704605866","heartbeat_back_addr":"172.21.15.118:6826/2704605866","heartbeat_front_addr":"172.21.15.118:6822/2704605866","state":["exists","up"]},{"osd":6,"uuid":"e8f98052-e6ad-4cfe-a4a9-0b17a434d54e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6801","nonce":1963659095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6803","nonce":1963659095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6807","nonce":1963659095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6805","nonce":1963659095}]},"public_addr":"172.21.15.118:6801/1963659095","cluster_addr":"172.21.15.118:6803/1963659095","heartbeat_back_addr":"172.21.15.118:6807/1963659095","heartbeat_front_addr":"172.21.15.118:6805/1963659095","state":["exists","up"]},{"osd":7,"uuid":"eccff987-8e51-4a63-845a-cf0a3196d7fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6809","nonce":1955879596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6811","nonce":1955879596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6815","nonce":1955879596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6813","nonce":1955879596}]},"public_addr":"172.21.15.118:6809/1955879596","cluster_addr":"172.21.15.118:6811/1955879596","heartbeat_back_addr":"172.21.15.118:6815/1955879596","heartbeat_front_addr":"172.21.15.118:6813/1955879596","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.721258+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.696610+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.777895+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.806769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.743259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.845687+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:13.020165+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.722294+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.e","mappings":[{"from":7,"to":1}]},{"pgid":"3.15","mappings":[{"from":3,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-27T10:00:54.008 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.019+0000 7eff46800640 1 -- 172.21.15.57:0/1628511209 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7eff2006c530 msgr2=0x7eff2006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:54.008 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.019+0000 7eff46800640 1 --2- 172.21.15.57:0/1628511209 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7eff2006c530 0x7eff2006e9f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7eff400b1330 tx=0x7eff300039b0 comp rx=0 tx=0).stop 2024-03-27T10:00:54.008 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.019+0000 7eff46800640 1 -- 172.21.15.57:0/1628511209 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7eff40145820 msgr2=0x7eff40072080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:54.008 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.019+0000 7eff46800640 1 --2- 172.21.15.57:0/1628511209 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7eff40145820 0x7eff40072080 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7eff380090b0 tx=0x7eff380046c0 comp rx=0 tx=0).stop 2024-03-27T10:00:54.008 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.019+0000 7eff46800640 1 -- 172.21.15.57:0/1628511209 shutdown_connections 2024-03-27T10:00:54.008 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.019+0000 7eff46800640 1 --2- 172.21.15.57:0/1628511209 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7eff40145820 0x7eff40072080 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:54.008 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.019+0000 7eff46800640 1 --2- 172.21.15.57:0/1628511209 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7eff2006c530 0x7eff2006e9f0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:54.008 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.019+0000 7eff46800640 1 --2- 172.21.15.57:0/1628511209 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7eff400cf750 0x7eff40071b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:54.008 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.019+0000 7eff46800640 1 --2- 172.21.15.57:0/1628511209 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7eff4006b750 0x7eff4013c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:54.008 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.019+0000 7eff46800640 1 -- 172.21.15.57:0/1628511209 >> 172.21.15.57:0/1628511209 conn(0x7eff400b1c60 msgr2=0x7eff4015c6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:54.008 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.019+0000 7eff46800640 1 -- 172.21.15.57:0/1628511209 shutdown_connections 2024-03-27T10:00:54.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.019+0000 7eff46800640 1 -- 172.21.15.57:0/1628511209 wait complete. 2024-03-27T10:00:54.027 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-27T09:59:17.253008+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-27T09:59:26.690365+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-27T09:59:27.559059+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-27T09:59:31.187596+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-27T10:00:54.028 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-27T10:00:54.256 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.267+0000 7fa733e00640 1 Processor -- start 2024-03-27T10:00:54.256 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.268+0000 7fa733e00640 1 -- start start 2024-03-27T10:00:54.258 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.269+0000 7fa733e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa73415ae80 0x7fa7340cbcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:54.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.269+0000 7fa733e00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fa7340cd920 0x7fa73406ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:54.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.269+0000 7fa733e00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa73406ef50 0x7fa73415e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:54.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.269+0000 7fa733e00640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7fa7340ceaa0 con 0x7fa73406ef50 2024-03-27T10:00:54.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.269+0000 7fa733e00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7fa73415b260 con 0x7fa7340cd920 2024-03-27T10:00:54.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.269+0000 7fa733e00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fa7340cde90 con 0x7fa73415ae80 2024-03-27T10:00:54.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.270+0000 7fa733400640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa73406ef50 0x7fa73415e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:54.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.270+0000 7fa733400640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa73406ef50 0x7fa73415e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56132/0 (socket says 172.21.15.57:56132) 2024-03-27T10:00:54.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.270+0000 7fa733400640 1 -- 172.21.15.57:0/1350213340 learned_addr learned my addr 172.21.15.57:0/1350213340 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:54.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.270+0000 7fa732000640 1 --2- 172.21.15.57:0/1350213340 >> v2:172.21.15.118:3300/0 conn(0x7fa7340cd920 0x7fa73406ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:54.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.270+0000 7fa732a00640 1 --2- 172.21.15.57:0/1350213340 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa73415ae80 0x7fa7340cbcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:54.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.270+0000 7fa733400640 1 -- 172.21.15.57:0/1350213340 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa73415ae80 msgr2=0x7fa7340cbcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:54.259 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.270+0000 7fa733400640 1 --2- 172.21.15.57:0/1350213340 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa73415ae80 0x7fa7340cbcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:54.260 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.270+0000 7fa733400640 1 -- 172.21.15.57:0/1350213340 >> v2:172.21.15.118:3300/0 conn(0x7fa7340cd920 msgr2=0x7fa73406ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:54.260 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.270+0000 7fa733400640 1 --2- 172.21.15.57:0/1350213340 >> v2:172.21.15.118:3300/0 conn(0x7fa7340cd920 0x7fa73406ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:54.260 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.271+0000 7fa733400640 1 -- 172.21.15.57:0/1350213340 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7340ce170 con 0x7fa73406ef50 2024-03-27T10:00:54.260 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.272+0000 7fa733400640 1 --2- 172.21.15.57:0/1350213340 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa73406ef50 0x7fa73415e970 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fa7340752d0 tx=0x7fa72c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cdaed791ece9358 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:54.261 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.273+0000 7fa731600640 1 -- 172.21.15.57:0/1350213340 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa72c02ca70 con 0x7fa73406ef50 2024-03-27T10:00:54.261 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.273+0000 7fa731600640 1 -- 172.21.15.57:0/1350213340 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa72c02cc10 con 0x7fa73406ef50 2024-03-27T10:00:54.261 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.273+0000 7fa731600640 1 -- 172.21.15.57:0/1350213340 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa72c0343f0 con 0x7fa73406ef50 2024-03-27T10:00:54.262 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.273+0000 7fa733e00640 1 -- 172.21.15.57:0/1350213340 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa73406ef50 msgr2=0x7fa73415e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:54.262 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.273+0000 7fa733e00640 1 --2- 172.21.15.57:0/1350213340 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa73406ef50 0x7fa73415e970 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fa7340752d0 tx=0x7fa72c02bed0 comp rx=0 tx=0).stop 2024-03-27T10:00:54.262 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.273+0000 7fa733e00640 1 -- 172.21.15.57:0/1350213340 shutdown_connections 2024-03-27T10:00:54.262 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.273+0000 7fa733e00640 1 --2- 172.21.15.57:0/1350213340 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa73406ef50 0x7fa73415e970 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:54.262 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.273+0000 7fa733e00640 1 --2- 172.21.15.57:0/1350213340 >> v2:172.21.15.118:3300/0 conn(0x7fa7340cd920 0x7fa73406ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:54.262 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.273+0000 7fa733e00640 1 --2- 172.21.15.57:0/1350213340 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa73415ae80 0x7fa7340cbcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:54.262 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.273+0000 7fa733e00640 1 -- 172.21.15.57:0/1350213340 >> 172.21.15.57:0/1350213340 conn(0x7fa7340cfb40 msgr2=0x7fa7340cff20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:54.262 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.273+0000 7fa733e00640 1 -- 172.21.15.57:0/1350213340 shutdown_connections 2024-03-27T10:00:54.262 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.274+0000 7fa733e00640 1 -- 172.21.15.57:0/1350213340 wait complete. 2024-03-27T10:00:54.263 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.275+0000 7fa733e00640 1 Processor -- start 2024-03-27T10:00:54.263 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.275+0000 7fa733e00640 1 -- start start 2024-03-27T10:00:54.265 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.276+0000 7fa733e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa73406ef50 0x7fa7340c6c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:54.265 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.276+0000 7fa733e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa7340cd920 0x7fa73413e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:54.265 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.276+0000 7fa733e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa73415ae80 0x7fa73414c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:54.265 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.276+0000 7fa733e00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fa7340cc200 con 0x7fa73406ef50 2024-03-27T10:00:54.265 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.276+0000 7fa733e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fa7340ce730 con 0x7fa73415ae80 2024-03-27T10:00:54.265 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.276+0000 7fa733e00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fa7340cef30 con 0x7fa7340cd920 2024-03-27T10:00:54.265 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.277+0000 7fa732a00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa73406ef50 0x7fa7340c6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:54.265 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.277+0000 7fa732a00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa73406ef50 0x7fa7340c6c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56138/0 (socket says 172.21.15.57:56138) 2024-03-27T10:00:54.266 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.277+0000 7fa732a00640 1 -- 172.21.15.57:0/3457699161 learned_addr learned my addr 172.21.15.57:0/3457699161 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:54.266 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.277+0000 7fa732000640 1 --2- 172.21.15.57:0/3457699161 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa7340cd920 0x7fa73413e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:54.266 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.277+0000 7fa733400640 1 --2- 172.21.15.57:0/3457699161 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa73415ae80 0x7fa73414c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:54.267 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.277+0000 7fa732a00640 1 -- 172.21.15.57:0/3457699161 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa7340cd920 msgr2=0x7fa73413e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:54.267 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.277+0000 7fa732a00640 1 --2- 172.21.15.57:0/3457699161 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa7340cd920 0x7fa73413e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:54.267 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.277+0000 7fa732a00640 1 -- 172.21.15.57:0/3457699161 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa73415ae80 msgr2=0x7fa73414c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:54.267 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.277+0000 7fa732a00640 1 --2- 172.21.15.57:0/3457699161 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa73415ae80 0x7fa73414c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:54.267 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.277+0000 7fa732a00640 1 -- 172.21.15.57:0/3457699161 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7340c99c0 con 0x7fa73406ef50 2024-03-27T10:00:54.267 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.278+0000 7fa732a00640 1 --2- 172.21.15.57:0/3457699161 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa73406ef50 0x7fa7340c6c10 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fa72400e8a0 tx=0x7fa72400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:54.267 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.278+0000 7fa72aa00640 1 -- 172.21.15.57:0/3457699161 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa724017070 con 0x7fa73406ef50 2024-03-27T10:00:54.267 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.278+0000 7fa72aa00640 1 -- 172.21.15.57:0/3457699161 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa72400c940 con 0x7fa73406ef50 2024-03-27T10:00:54.267 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.278+0000 7fa733e00640 1 -- 172.21.15.57:0/3457699161 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa734072d80 con 0x7fa73406ef50 2024-03-27T10:00:54.268 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.278+0000 7fa72aa00640 1 -- 172.21.15.57:0/3457699161 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa72400cd30 con 0x7fa73406ef50 2024-03-27T10:00:54.268 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.278+0000 7fa733e00640 1 -- 172.21.15.57:0/3457699161 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7340710a0 con 0x7fa73406ef50 2024-03-27T10:00:54.268 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.279+0000 7fa733e00640 1 -- 172.21.15.57:0/3457699161 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa734068540 con 0x7fa73406ef50 2024-03-27T10:00:54.268 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.280+0000 7fa72aa00640 1 -- 172.21.15.57:0/3457699161 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fa72401a070 con 0x7fa73406ef50 2024-03-27T10:00:54.270 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.282+0000 7fa72aa00640 1 --2- 172.21.15.57:0/3457699161 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fa71406c530 0x7fa71406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:54.270 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.282+0000 7fa72aa00640 1 -- 172.21.15.57:0/3457699161 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fa72408b990 con 0x7fa73406ef50 2024-03-27T10:00:54.270 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.282+0000 7fa732000640 1 --2- 172.21.15.57:0/3457699161 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fa71406c530 0x7fa71406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:54.271 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.283+0000 7fa732000640 1 --2- 172.21.15.57:0/3457699161 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fa71406c530 0x7fa71406e9f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa73414dfc0 tx=0x7fa720008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:54.275 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.287+0000 7fa72aa00640 1 -- 172.21.15.57:0/3457699161 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7fa724059ba0 con 0x7fa73406ef50 2024-03-27T10:00:54.477 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.488+0000 7fa733e00640 1 -- 172.21.15.57:0/3457699161 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fa7340c6160 con 0x7fa73406ef50 2024-03-27T10:00:54.478 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.489+0000 7fa72aa00640 1 -- 172.21.15.57:0/3457699161 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) ==== 93+0+10 (secure 0 0 0) 0x7fa7240594a0 con 0x7fa73406ef50 2024-03-27T10:00:54.478 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2024-03-27T10:00:54.482 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.493+0000 7fa733e00640 1 -- 172.21.15.57:0/3457699161 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fa71406c530 msgr2=0x7fa71406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:54.482 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.494+0000 7fa733e00640 1 --2- 172.21.15.57:0/3457699161 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fa71406c530 0x7fa71406e9f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa73414dfc0 tx=0x7fa720008040 comp rx=0 tx=0).stop 2024-03-27T10:00:54.482 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.494+0000 7fa733e00640 1 -- 172.21.15.57:0/3457699161 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa73406ef50 msgr2=0x7fa7340c6c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:54.483 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.494+0000 7fa733e00640 1 --2- 172.21.15.57:0/3457699161 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa73406ef50 0x7fa7340c6c10 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fa72400e8a0 tx=0x7fa72400ed60 comp rx=0 tx=0).stop 2024-03-27T10:00:54.483 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.494+0000 7fa733e00640 1 -- 172.21.15.57:0/3457699161 shutdown_connections 2024-03-27T10:00:54.483 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.494+0000 7fa733e00640 1 --2- 172.21.15.57:0/3457699161 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fa71406c530 0x7fa71406e9f0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:54.483 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.494+0000 7fa733e00640 1 --2- 172.21.15.57:0/3457699161 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa73415ae80 0x7fa73414c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:54.483 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.494+0000 7fa733e00640 1 --2- 172.21.15.57:0/3457699161 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa7340cd920 0x7fa73413e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:54.483 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.494+0000 7fa733e00640 1 --2- 172.21.15.57:0/3457699161 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa73406ef50 0x7fa7340c6c10 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:54.484 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.494+0000 7fa733e00640 1 -- 172.21.15.57:0/3457699161 >> 172.21.15.57:0/3457699161 conn(0x7fa7340cfb40 msgr2=0x7fa7340ae570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:54.484 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.494+0000 7fa733e00640 1 -- 172.21.15.57:0/3457699161 shutdown_connections 2024-03-27T10:00:54.484 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.494+0000 7fa733e00640 1 -- 172.21.15.57:0/3457699161 wait complete. 2024-03-27T10:00:54.503 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-27T10:00:54.731 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.743+0000 7fb232e00640 1 Processor -- start 2024-03-27T10:00:54.731 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.743+0000 7fb232e00640 1 -- start start 2024-03-27T10:00:54.733 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.745+0000 7fb232e00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fb22c0ca6e0 0x7fb22c0c4e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:54.733 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.745+0000 7fb232e00640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb22c0cb720 con 0x7fb22c0cbb50 2024-03-27T10:00:54.733 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.745+0000 7fb232e00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb22c0c5570 con 0x7fb22c0ae8b0 2024-03-27T10:00:54.733 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.745+0000 7fb232e00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7fb22c0c5850 con 0x7fb22c0ca6e0 2024-03-27T10:00:54.736 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.745+0000 7fb231000640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fb22c0cbb50 0x7fb22c0caac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:49790/0 (socket says 172.21.15.57:49790) 2024-03-27T10:00:54.736 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.745+0000 7fb231000640 1 -- 172.21.15.57:0/691688074 learned_addr learned my addr 172.21.15.57:0/691688074 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T10:00:54.736 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.746+0000 7fb231a00640 1 --2- 172.21.15.57:0/691688074 >> v2:172.21.15.118:3300/0 conn(0x7fb22c0ca6e0 0x7fb22c0c4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:54.736 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.746+0000 7fb22be00640 1 -- 172.21.15.57:0/691688074 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3276869710 0 0) 0x7fb22c0cb720 con 0x7fb22c0cbb50 2024-03-27T10:00:54.736 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.746+0000 7fb22be00640 1 -- 172.21.15.57:0/691688074 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb214003520 con 0x7fb22c0cbb50 2024-03-27T10:00:54.736 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.746+0000 7fb22be00640 1 -- 172.21.15.57:0/691688074 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 789776363 0 0) 0x7fb214003520 con 0x7fb22c0cbb50 2024-03-27T10:00:54.736 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.746+0000 7fb22be00640 1 -- 172.21.15.57:0/691688074 >> v2:172.21.15.118:3300/0 conn(0x7fb22c0ca6e0 msgr2=0x7fb22c0c4e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:54.736 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.746+0000 7fb22be00640 1 --2- 172.21.15.57:0/691688074 >> v2:172.21.15.118:3300/0 conn(0x7fb22c0ca6e0 0x7fb22c0c4e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:54.736 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.746+0000 7fb22be00640 1 -- 172.21.15.57:0/691688074 >> v1:172.21.15.118:6789/0 conn(0x7fb22c0ae8b0 legacy=0x7fb22c167b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:54.736 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.746+0000 7fb22be00640 1 -- 172.21.15.57:0/691688074 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb22c0c5b30 con 0x7fb22c0cbb50 2024-03-27T10:00:54.736 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.746+0000 7fb22be00640 1 -- 172.21.15.57:0/691688074 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4227751516 0 0) 0x7fb21c001670 con 0x7fb22c0cbb50 2024-03-27T10:00:54.736 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.746+0000 7fb22be00640 1 -- 172.21.15.57:0/691688074 >> v1:172.21.15.57:6789/0 conn(0x7fb22c0cbb50 legacy=0x7fb22c0caac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:54.736 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.746+0000 7fb22be00640 1 --2- 172.21.15.57:0/691688074 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2140039b0 0x7fb214003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:54.737 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.746+0000 7fb22be00640 1 --2- 172.21.15.57:0/691688074 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb214004800 0x7fb214004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:54.737 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.746+0000 7fb22be00640 1 --2- 172.21.15.57:0/691688074 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb2140052e0 0x7fb21400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:54.737 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.746+0000 7fb22be00640 1 -- 172.21.15.57:0/691688074 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fb22c0c5850 con 0x7fb2140039b0 2024-03-27T10:00:54.737 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.746+0000 7fb22be00640 1 -- 172.21.15.57:0/691688074 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fb21400c1b0 con 0x7fb214004800 2024-03-27T10:00:54.737 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.746+0000 7fb22be00640 1 -- 172.21.15.57:0/691688074 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fb21400c3b0 con 0x7fb2140052e0 2024-03-27T10:00:54.737 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.747+0000 7fb231a00640 1 --2- 172.21.15.57:0/691688074 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2140039b0 0x7fb214003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:54.737 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.747+0000 7fb231000640 1 --2- 172.21.15.57:0/691688074 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb214004800 0x7fb214004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:54.737 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.747+0000 7fb232400640 1 --2- 172.21.15.57:0/691688074 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb2140052e0 0x7fb21400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:54.737 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.747+0000 7fb231a00640 1 -- 172.21.15.57:0/691688074 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb2140052e0 msgr2=0x7fb21400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:54.737 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.747+0000 7fb231a00640 1 --2- 172.21.15.57:0/691688074 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb2140052e0 0x7fb21400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:54.737 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.747+0000 7fb231a00640 1 -- 172.21.15.57:0/691688074 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb214004800 msgr2=0x7fb214004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:54.737 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.747+0000 7fb231a00640 1 --2- 172.21.15.57:0/691688074 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb214004800 0x7fb214004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:54.737 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.747+0000 7fb231a00640 1 -- 172.21.15.57:0/691688074 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb214003520 con 0x7fb2140039b0 2024-03-27T10:00:54.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.747+0000 7fb232400640 1 -- 172.21.15.57:0/691688074 reap_dead start 2024-03-27T10:00:54.739 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.748+0000 7fb231a00640 1 --2- 172.21.15.57:0/691688074 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2140039b0 0x7fb214003dd0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fb22000ba00 tx=0x7fb214005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d188749165227a8 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:54.739 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.748+0000 7fb22be00640 1 -- 172.21.15.57:0/691688074 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb220036020 con 0x7fb2140039b0 2024-03-27T10:00:54.739 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.749+0000 7fb22be00640 1 -- 172.21.15.57:0/691688074 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2200325f0 con 0x7fb2140039b0 2024-03-27T10:00:54.739 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.749+0000 7fb22be00640 1 -- 172.21.15.57:0/691688074 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb22000b600 con 0x7fb2140039b0 2024-03-27T10:00:54.739 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.749+0000 7fb232e00640 1 -- 172.21.15.57:0/691688074 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2140039b0 msgr2=0x7fb214003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:54.739 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.749+0000 7fb232e00640 1 --2- 172.21.15.57:0/691688074 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2140039b0 0x7fb214003dd0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fb22000ba00 tx=0x7fb214005830 comp rx=0 tx=0).stop 2024-03-27T10:00:54.739 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.749+0000 7fb232e00640 1 -- 172.21.15.57:0/691688074 shutdown_connections 2024-03-27T10:00:54.739 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.749+0000 7fb232e00640 1 --2- 172.21.15.57:0/691688074 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb2140039b0 0x7fb214003dd0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:54.739 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.749+0000 7fb232e00640 1 -- 172.21.15.57:0/691688074 >> 172.21.15.57:0/691688074 conn(0x7fb22c0cfb40 msgr2=0x7fb22c0cff20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:54.739 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.749+0000 7fb232e00640 1 -- 172.21.15.57:0/691688074 shutdown_connections 2024-03-27T10:00:54.739 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.749+0000 7fb232e00640 1 -- 172.21.15.57:0/691688074 wait complete. 2024-03-27T10:00:54.740 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.751+0000 7fb232e00640 1 Processor -- start 2024-03-27T10:00:54.740 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.751+0000 7fb232e00640 1 -- start start 2024-03-27T10:00:54.742 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.752+0000 7fb232e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb2140039b0 0x7fb22c153710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:54.742 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.752+0000 7fb232e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb22c15ae00 0x7fb22c0c8620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:54.742 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.752+0000 7fb232e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb22c0c6c10 0x7fb22c06d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:54.742 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.752+0000 7fb232e00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fb22c0c4e70 con 0x7fb22c15ae00 2024-03-27T10:00:54.742 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.752+0000 7fb232e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fb22c0c60f0 con 0x7fb22c0c6c10 2024-03-27T10:00:54.742 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.752+0000 7fb232e00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fb22c0c4ff0 con 0x7fb2140039b0 2024-03-27T10:00:54.743 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.753+0000 7fb231000640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb22c15ae00 0x7fb22c0c8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:54.743 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.753+0000 7fb231000640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb22c15ae00 0x7fb22c0c8620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56158/0 (socket says 172.21.15.57:56158) 2024-03-27T10:00:54.743 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.753+0000 7fb231000640 1 -- 172.21.15.57:0/505099705 learned_addr learned my addr 172.21.15.57:0/505099705 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:54.743 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.753+0000 7fb231a00640 1 --2- 172.21.15.57:0/505099705 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb2140039b0 0x7fb22c153710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:54.743 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.753+0000 7fb231000640 1 -- 172.21.15.57:0/505099705 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb2140039b0 msgr2=0x7fb22c153710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:54.743 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.753+0000 7fb231000640 1 --2- 172.21.15.57:0/505099705 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb2140039b0 0x7fb22c153710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:54.743 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.753+0000 7fb232400640 1 --2- 172.21.15.57:0/505099705 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb22c0c6c10 0x7fb22c06d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:54.743 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.753+0000 7fb231000640 1 -- 172.21.15.57:0/505099705 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb22c0c6c10 msgr2=0x7fb22c06d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:54.743 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.753+0000 7fb231000640 1 --2- 172.21.15.57:0/505099705 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb22c0c6c10 0x7fb22c06d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:54.743 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.753+0000 7fb231000640 1 -- 172.21.15.57:0/505099705 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb22c0c7580 con 0x7fb22c15ae00 2024-03-27T10:00:54.743 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.753+0000 7fb231000640 1 --2- 172.21.15.57:0/505099705 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb22c15ae00 0x7fb22c0c8620 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fb21c00e790 tx=0x7fb21c00ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:54.744 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.754+0000 7fb229600640 1 -- 172.21.15.57:0/505099705 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb21c00c8d0 con 0x7fb22c15ae00 2024-03-27T10:00:54.744 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.754+0000 7fb229600640 1 -- 172.21.15.57:0/505099705 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb21c018070 con 0x7fb22c15ae00 2024-03-27T10:00:54.744 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.754+0000 7fb232e00640 1 -- 172.21.15.57:0/505099705 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb22c0c7860 con 0x7fb22c15ae00 2024-03-27T10:00:54.744 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.754+0000 7fb229600640 1 -- 172.21.15.57:0/505099705 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb21c00ccd0 con 0x7fb22c15ae00 2024-03-27T10:00:54.744 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.754+0000 7fb232e00640 1 -- 172.21.15.57:0/505099705 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb22c0c7e20 con 0x7fb22c15ae00 2024-03-27T10:00:54.744 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.755+0000 7fb232e00640 1 -- 172.21.15.57:0/505099705 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb22c068540 con 0x7fb22c15ae00 2024-03-27T10:00:54.744 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.756+0000 7fb229600640 1 -- 172.21.15.57:0/505099705 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fb21c01d460 con 0x7fb22c15ae00 2024-03-27T10:00:54.745 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.757+0000 7fb229600640 1 --2- 172.21.15.57:0/505099705 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fb21006c530 0x7fb21006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:54.745 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.757+0000 7fb229600640 1 -- 172.21.15.57:0/505099705 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fb21c08bad0 con 0x7fb22c15ae00 2024-03-27T10:00:54.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.758+0000 7fb231a00640 1 --2- 172.21.15.57:0/505099705 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fb21006c530 0x7fb21006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:54.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.758+0000 7fb231a00640 1 --2- 172.21.15.57:0/505099705 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fb21006c530 0x7fb21006e9f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb214004780 tx=0x7fb22003d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:54.750 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.762+0000 7fb229600640 1 -- 172.21.15.57:0/505099705 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7fb21c059c50 con 0x7fb22c15ae00 2024-03-27T10:00:54.957 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.968+0000 7fb232e00640 1 -- 172.21.15.57:0/505099705 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fb22c0724a0 con 0x7fb22c15ae00 2024-03-27T10:00:54.957 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.969+0000 7fb229600640 1 -- 172.21.15.57:0/505099705 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) ==== 104+0+11 (secure 0 0 0) 0x7fb21c059550 con 0x7fb22c15ae00 2024-03-27T10:00:54.958 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2024-03-27T10:00:54.960 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.972+0000 7fb232e00640 1 -- 172.21.15.57:0/505099705 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fb21006c530 msgr2=0x7fb21006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:54.960 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.972+0000 7fb232e00640 1 --2- 172.21.15.57:0/505099705 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fb21006c530 0x7fb21006e9f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb214004780 tx=0x7fb22003d040 comp rx=0 tx=0).stop 2024-03-27T10:00:54.960 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.972+0000 7fb232e00640 1 -- 172.21.15.57:0/505099705 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb22c15ae00 msgr2=0x7fb22c0c8620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:54.960 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.972+0000 7fb232e00640 1 --2- 172.21.15.57:0/505099705 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb22c15ae00 0x7fb22c0c8620 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fb21c00e790 tx=0x7fb21c00ec50 comp rx=0 tx=0).stop 2024-03-27T10:00:54.960 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.972+0000 7fb232e00640 1 -- 172.21.15.57:0/505099705 shutdown_connections 2024-03-27T10:00:54.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.972+0000 7fb232e00640 1 --2- 172.21.15.57:0/505099705 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fb21006c530 0x7fb21006e9f0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:54.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.972+0000 7fb232e00640 1 --2- 172.21.15.57:0/505099705 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb22c0c6c10 0x7fb22c06d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:54.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.972+0000 7fb232e00640 1 --2- 172.21.15.57:0/505099705 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb22c15ae00 0x7fb22c0c8620 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:54.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.972+0000 7fb232e00640 1 --2- 172.21.15.57:0/505099705 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb2140039b0 0x7fb22c153710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:54.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.972+0000 7fb232e00640 1 -- 172.21.15.57:0/505099705 >> 172.21.15.57:0/505099705 conn(0x7fb22c0cfb40 msgr2=0x7fb22c0729c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:54.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.972+0000 7fb232e00640 1 -- 172.21.15.57:0/505099705 shutdown_connections 2024-03-27T10:00:54.961 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:54.972+0000 7fb232e00640 1 -- 172.21.15.57:0/505099705 wait complete. 2024-03-27T10:00:54.979 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-27T10:00:55.204 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.215+0000 7f5ccf000640 1 Processor -- start 2024-03-27T10:00:55.204 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.216+0000 7f5ccf000640 1 -- start start 2024-03-27T10:00:55.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.217+0000 7f5ccf000640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f5cc80d3770 0x7f5cc80cf210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:55.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.217+0000 7f5ccf000640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5cc80cf750 0x7f5cc806bf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:55.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.217+0000 7f5ccf000640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5cc80cfe40 con 0x7f5cc8161950 2024-03-27T10:00:55.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.217+0000 7f5ccf000640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f5cc8161d30 con 0x7f5cc80d3770 2024-03-27T10:00:55.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.217+0000 7f5ccf000640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f5cc80d0f10 con 0x7f5cc80cf750 2024-03-27T10:00:55.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.218+0000 7f5cce600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5cc80cf750 0x7f5cc806bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:55.207 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.218+0000 7f5ccd200640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f5cc80d3770 0x7f5cc80cf210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:55.207 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.218+0000 7f5cce600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5cc80cf750 0x7f5cc806bf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.57:38862/0 (socket says 172.21.15.57:38862) 2024-03-27T10:00:55.207 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.218+0000 7f5ccd200640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f5cc80d3770 0x7f5cc80cf210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.57:50620/0 (socket says 172.21.15.57:50620) 2024-03-27T10:00:55.207 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.218+0000 7f5cce600640 1 -- 172.21.15.57:0/1537163287 learned_addr learned my addr 172.21.15.57:0/1537163287 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:55.208 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.219+0000 7f5cce600640 1 -- 172.21.15.57:0/1537163287 >> v2:172.21.15.118:3300/0 conn(0x7f5cc80d3770 msgr2=0x7f5cc80cf210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:55.208 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.219+0000 7f5cce600640 1 --2- 172.21.15.57:0/1537163287 >> v2:172.21.15.118:3300/0 conn(0x7f5cc80d3770 0x7f5cc80cf210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:55.208 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.219+0000 7f5cce600640 1 -- 172.21.15.57:0/1537163287 >> v1:172.21.15.118:6789/0 conn(0x7f5cc8161950 legacy=0x7f5cc80ceb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:55.208 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.219+0000 7f5cc7e00640 1 -- 172.21.15.57:0/1537163287 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3071496503 0 0) 0x7f5cc80cfe40 con 0x7f5cc8161950 2024-03-27T10:00:55.208 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.219+0000 7f5cce600640 1 -- 172.21.15.57:0/1537163287 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cc80d11f0 con 0x7f5cc80cf750 2024-03-27T10:00:55.208 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.219+0000 7f5ccd200640 1 --2- 172.21.15.57:0/1537163287 >> v2:172.21.15.118:3300/0 conn(0x7f5cc80d3770 0x7f5cc80cf210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T10:00:55.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.221+0000 7f5cce600640 1 --2- 172.21.15.57:0/1537163287 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5cc80cf750 0x7f5cc806bf10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5cc0009e50 tx=0x7f5cc002bff0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ded183739ed7d094 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:55.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.221+0000 7f5cc7e00640 1 -- 172.21.15.57:0/1537163287 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cc002cb90 con 0x7f5cc80cf750 2024-03-27T10:00:55.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.221+0000 7f5cc7e00640 1 -- 172.21.15.57:0/1537163287 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cc002cd30 con 0x7f5cc80cf750 2024-03-27T10:00:55.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.221+0000 7f5cc7e00640 1 -- 172.21.15.57:0/1537163287 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cc0034610 con 0x7f5cc80cf750 2024-03-27T10:00:55.210 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.222+0000 7f5ccf000640 1 -- 172.21.15.57:0/1537163287 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5cc80cf750 msgr2=0x7f5cc806bf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:55.210 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.222+0000 7f5ccf000640 1 --2- 172.21.15.57:0/1537163287 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5cc80cf750 0x7f5cc806bf10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5cc0009e50 tx=0x7f5cc002bff0 comp rx=0 tx=0).stop 2024-03-27T10:00:55.211 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.222+0000 7f5ccf000640 1 -- 172.21.15.57:0/1537163287 shutdown_connections 2024-03-27T10:00:55.211 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.222+0000 7f5ccf000640 1 --2- 172.21.15.57:0/1537163287 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5cc80cf750 0x7f5cc806bf10 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:55.211 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.222+0000 7f5ccf000640 1 --2- 172.21.15.57:0/1537163287 >> v2:172.21.15.118:3300/0 conn(0x7f5cc80d3770 0x7f5cc80cf210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:55.211 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.222+0000 7f5ccf000640 1 -- 172.21.15.57:0/1537163287 >> 172.21.15.57:0/1537163287 conn(0x7f5cc80d3fc0 msgr2=0x7f5cc80d43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:55.211 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.222+0000 7f5ccf000640 1 -- 172.21.15.57:0/1537163287 shutdown_connections 2024-03-27T10:00:55.211 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.222+0000 7f5ccf000640 1 -- 172.21.15.57:0/1537163287 wait complete. 2024-03-27T10:00:55.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.224+0000 7f5ccf000640 1 Processor -- start 2024-03-27T10:00:55.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.224+0000 7f5ccf000640 1 -- start start 2024-03-27T10:00:55.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.225+0000 7f5ccf000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5cc80cf750 0x7f5cc80b7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:55.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.225+0000 7f5ccf000640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5cc80d3770 0x7f5cc815df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:55.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.225+0000 7f5ccf000640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5cc8161950 0x7f5cc814f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:55.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.225+0000 7f5ccf000640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f5cc80d2240 con 0x7f5cc80d3770 2024-03-27T10:00:55.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.225+0000 7f5ccf000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f5cc80d1f60 con 0x7f5cc80cf750 2024-03-27T10:00:55.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.225+0000 7f5ccf000640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f5cc80d17b0 con 0x7f5cc8161950 2024-03-27T10:00:55.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.225+0000 7f5ccd200640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5cc80d3770 0x7f5cc815df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:55.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.225+0000 7f5ccd200640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5cc80d3770 0x7f5cc815df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56166/0 (socket says 172.21.15.57:56166) 2024-03-27T10:00:55.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.225+0000 7f5ccd200640 1 -- 172.21.15.57:0/346897692 learned_addr learned my addr 172.21.15.57:0/346897692 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:55.215 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.226+0000 7f5ccdc00640 1 --2- 172.21.15.57:0/346897692 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5cc80cf750 0x7f5cc80b7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:55.215 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.226+0000 7f5cce600640 1 --2- 172.21.15.57:0/346897692 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5cc8161950 0x7f5cc814f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:55.215 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.226+0000 7f5ccd200640 1 -- 172.21.15.57:0/346897692 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5cc8161950 msgr2=0x7f5cc814f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:55.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.226+0000 7f5ccd200640 1 --2- 172.21.15.57:0/346897692 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5cc8161950 0x7f5cc814f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:55.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.226+0000 7f5ccd200640 1 -- 172.21.15.57:0/346897692 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5cc80cf750 msgr2=0x7f5cc80b7c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:55.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.226+0000 7f5ccd200640 1 --2- 172.21.15.57:0/346897692 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5cc80cf750 0x7f5cc80b7c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:55.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.226+0000 7f5ccd200640 1 -- 172.21.15.57:0/346897692 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cc80b86d0 con 0x7f5cc80d3770 2024-03-27T10:00:55.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.226+0000 7f5ccd200640 1 --2- 172.21.15.57:0/346897692 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5cc80d3770 0x7f5cc815df80 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f5cbc00ebe0 tx=0x7f5cbc00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:55.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.227+0000 7f5cc5600640 1 -- 172.21.15.57:0/346897692 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cbc017070 con 0x7f5cc80d3770 2024-03-27T10:00:55.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.227+0000 7f5cc5600640 1 -- 172.21.15.57:0/346897692 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cbc00cc30 con 0x7f5cc80d3770 2024-03-27T10:00:55.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.227+0000 7f5cc5600640 1 -- 172.21.15.57:0/346897692 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cbc013470 con 0x7f5cc80d3770 2024-03-27T10:00:55.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.227+0000 7f5ccf000640 1 -- 172.21.15.57:0/346897692 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cc80b89b0 con 0x7f5cc80d3770 2024-03-27T10:00:55.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.227+0000 7f5ccf000640 1 -- 172.21.15.57:0/346897692 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cc80b8f70 con 0x7f5cc80d3770 2024-03-27T10:00:55.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.228+0000 7f5ccf000640 1 -- 172.21.15.57:0/346897692 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5cc8068540 con 0x7f5cc80d3770 2024-03-27T10:00:55.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.229+0000 7f5cc5600640 1 -- 172.21.15.57:0/346897692 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f5cbc01a070 con 0x7f5cc80d3770 2024-03-27T10:00:55.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.230+0000 7f5cc5600640 1 --2- 172.21.15.57:0/346897692 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f5cac06c560 0x7f5cac06ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:55.219 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.230+0000 7f5cc5600640 1 -- 172.21.15.57:0/346897692 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f5cbc08be70 con 0x7f5cc80d3770 2024-03-27T10:00:55.219 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.230+0000 7f5ccdc00640 1 --2- 172.21.15.57:0/346897692 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f5cac06c560 0x7f5cac06ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:55.219 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.231+0000 7f5ccdc00640 1 --2- 172.21.15.57:0/346897692 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f5cac06c560 0x7f5cac06ea20 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5cb8007fd0 tx=0x7f5cb8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:55.223 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.235+0000 7f5cc5600640 1 -- 172.21.15.57:0/346897692 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f5cbc059ff0 con 0x7f5cc80d3770 2024-03-27T10:00:55.424 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.436+0000 7f5ccf000640 1 -- 172.21.15.57:0/346897692 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f5cc80b52a0 con 0x7f5cc80d3770 2024-03-27T10:00:55.425 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.437+0000 7f5cc5600640 1 -- 172.21.15.57:0/346897692 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) ==== 100+0+11 (secure 0 0 0) 0x7f5cbc0598f0 con 0x7f5cc80d3770 2024-03-27T10:00:55.426 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2024-03-27T10:00:55.429 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.441+0000 7f5ccf000640 1 -- 172.21.15.57:0/346897692 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f5cac06c560 msgr2=0x7f5cac06ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:55.429 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.441+0000 7f5ccf000640 1 --2- 172.21.15.57:0/346897692 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f5cac06c560 0x7f5cac06ea20 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5cb8007fd0 tx=0x7f5cb8009040 comp rx=0 tx=0).stop 2024-03-27T10:00:55.430 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.441+0000 7f5ccf000640 1 -- 172.21.15.57:0/346897692 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5cc80d3770 msgr2=0x7f5cc815df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:55.430 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.441+0000 7f5ccf000640 1 --2- 172.21.15.57:0/346897692 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5cc80d3770 0x7f5cc815df80 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f5cbc00ebe0 tx=0x7f5cbc00c520 comp rx=0 tx=0).stop 2024-03-27T10:00:55.430 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.441+0000 7f5ccf000640 1 -- 172.21.15.57:0/346897692 shutdown_connections 2024-03-27T10:00:55.430 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.441+0000 7f5ccf000640 1 --2- 172.21.15.57:0/346897692 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5cc8161950 0x7f5cc814f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:55.430 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.441+0000 7f5ccf000640 1 --2- 172.21.15.57:0/346897692 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5cc80d3770 0x7f5cc815df80 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:55.430 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.441+0000 7f5ccf000640 1 --2- 172.21.15.57:0/346897692 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f5cac06c560 0x7f5cac06ea20 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:55.430 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.441+0000 7f5ccf000640 1 --2- 172.21.15.57:0/346897692 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5cc80cf750 0x7f5cc80b7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:55.430 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.441+0000 7f5ccf000640 1 -- 172.21.15.57:0/346897692 >> 172.21.15.57:0/346897692 conn(0x7f5cc80d3fc0 msgr2=0x7f5cc80d25b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:55.430 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.441+0000 7f5ccf000640 1 -- 172.21.15.57:0/346897692 shutdown_connections 2024-03-27T10:00:55.430 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.441+0000 7f5ccf000640 1 -- 172.21.15.57:0/346897692 wait complete. 2024-03-27T10:00:55.448 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-27T10:00:55.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.687+0000 7f53f7200640 1 Processor -- start 2024-03-27T10:00:55.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.687+0000 7f53f7200640 1 -- start start 2024-03-27T10:00:55.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.688+0000 7f53f7200640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f53f81601a0 0x7f53f806d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:55.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.688+0000 7f53f7200640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f53f80ce720 0x7f53f80ceb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:55.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.688+0000 7f53f7200640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53f80cf070 con 0x7f53f81458e0 2024-03-27T10:00:55.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.688+0000 7f53f7200640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f53f80ca330 con 0x7f53f80ce720 2024-03-27T10:00:55.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.688+0000 7f53f7200640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f53f80ca610 con 0x7f53f81601a0 2024-03-27T10:00:55.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.689+0000 7f53f6800640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f53f80ce720 0x7f53f80ceb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:55.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.689+0000 7f53f6800640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f53f80ce720 0x7f53f80ceb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56176/0 (socket says 172.21.15.57:56176) 2024-03-27T10:00:55.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.689+0000 7f53f6800640 1 -- 172.21.15.57:0/943798289 learned_addr learned my addr 172.21.15.57:0/943798289 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:55.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.689+0000 7f53f5400640 1 --2- 172.21.15.57:0/943798289 >> v2:172.21.15.118:3300/0 conn(0x7f53f81601a0 0x7f53f806d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:55.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.689+0000 7f53f6800640 1 -- 172.21.15.57:0/943798289 >> v2:172.21.15.118:3300/0 conn(0x7f53f81601a0 msgr2=0x7f53f806d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:55.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.689+0000 7f53f6800640 1 --2- 172.21.15.57:0/943798289 >> v2:172.21.15.118:3300/0 conn(0x7f53f81601a0 0x7f53f806d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:55.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.689+0000 7f53f6800640 1 -- 172.21.15.57:0/943798289 >> v1:172.21.15.118:6789/0 conn(0x7f53f81458e0 legacy=0x7f53f815fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:55.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.689+0000 7f53f6800640 1 -- 172.21.15.57:0/943798289 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53f80ca8f0 con 0x7f53f80ce720 2024-03-27T10:00:55.680 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.690+0000 7f53f6800640 1 --2- 172.21.15.57:0/943798289 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f53f80ce720 0x7f53f80ceb30 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f53f80cc160 tx=0x7f53f002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f78a7b6b6b32fc6 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:55.680 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.691+0000 7f53f4a00640 1 -- 172.21.15.57:0/943798289 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53f0035020 con 0x7f53f80ce720 2024-03-27T10:00:55.680 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.691+0000 7f53f4a00640 1 -- 172.21.15.57:0/943798289 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53f0031870 con 0x7f53f80ce720 2024-03-27T10:00:55.680 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.691+0000 7f53f4a00640 1 -- 172.21.15.57:0/943798289 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53f0031c40 con 0x7f53f80ce720 2024-03-27T10:00:55.680 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.691+0000 7f53f7200640 1 -- 172.21.15.57:0/943798289 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f53f80ce720 msgr2=0x7f53f80ceb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:55.680 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.691+0000 7f53f7200640 1 --2- 172.21.15.57:0/943798289 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f53f80ce720 0x7f53f80ceb30 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f53f80cc160 tx=0x7f53f002b910 comp rx=0 tx=0).stop 2024-03-27T10:00:55.680 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.692+0000 7f53f7200640 1 -- 172.21.15.57:0/943798289 shutdown_connections 2024-03-27T10:00:55.680 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.692+0000 7f53f7200640 1 --2- 172.21.15.57:0/943798289 >> v2:172.21.15.118:3300/0 conn(0x7f53f81601a0 0x7f53f806d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:55.681 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.692+0000 7f53f7200640 1 --2- 172.21.15.57:0/943798289 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f53f80ce720 0x7f53f80ceb30 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:55.681 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.692+0000 7f53f7200640 1 -- 172.21.15.57:0/943798289 >> 172.21.15.57:0/943798289 conn(0x7f53f80cfb40 msgr2=0x7f53f80cff20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:55.681 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.692+0000 7f53f7200640 1 -- 172.21.15.57:0/943798289 shutdown_connections 2024-03-27T10:00:55.681 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.692+0000 7f53f7200640 1 -- 172.21.15.57:0/943798289 wait complete. 2024-03-27T10:00:55.682 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.694+0000 7f53f7200640 1 Processor -- start 2024-03-27T10:00:55.682 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.694+0000 7f53f7200640 1 -- start start 2024-03-27T10:00:55.685 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.695+0000 7f53f7200640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f53f80ce720 0x7f53f80b1020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:55.685 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.695+0000 7f53f7200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f53f81458e0 0x7f53f8143f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:55.685 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.695+0000 7f53f7200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f53f81601a0 0x7f53f8144460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:55.685 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.695+0000 7f53f7200640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f53f80cb270 con 0x7f53f80ce720 2024-03-27T10:00:55.685 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.695+0000 7f53f7200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f53f80cb0f0 con 0x7f53f81601a0 2024-03-27T10:00:55.685 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.695+0000 7f53f7200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f53f80cb3f0 con 0x7f53f81458e0 2024-03-27T10:00:55.685 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.695+0000 7f53f5e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f53f80ce720 0x7f53f80b1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:55.685 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.695+0000 7f53f5e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f53f80ce720 0x7f53f80b1020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56190/0 (socket says 172.21.15.57:56190) 2024-03-27T10:00:55.685 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.695+0000 7f53f5e00640 1 -- 172.21.15.57:0/3402096049 learned_addr learned my addr 172.21.15.57:0/3402096049 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:55.685 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.696+0000 7f53f6800640 1 --2- 172.21.15.57:0/3402096049 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f53f81601a0 0x7f53f8144460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:55.685 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.696+0000 7f53f5400640 1 --2- 172.21.15.57:0/3402096049 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f53f81458e0 0x7f53f8143f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:55.686 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.696+0000 7f53f5e00640 1 -- 172.21.15.57:0/3402096049 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f53f81458e0 msgr2=0x7f53f8143f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:55.686 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.696+0000 7f53f5e00640 1 --2- 172.21.15.57:0/3402096049 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f53f81458e0 0x7f53f8143f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:55.686 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.696+0000 7f53f5e00640 1 -- 172.21.15.57:0/3402096049 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f53f81601a0 msgr2=0x7f53f8144460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:55.686 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.696+0000 7f53f5e00640 1 --2- 172.21.15.57:0/3402096049 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f53f81601a0 0x7f53f8144460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:55.686 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.696+0000 7f53f5e00640 1 -- 172.21.15.57:0/3402096049 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53f80b29a0 con 0x7f53f80ce720 2024-03-27T10:00:55.686 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.696+0000 7f53f5e00640 1 --2- 172.21.15.57:0/3402096049 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f53f80ce720 0x7f53f80b1020 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f53e800c430 tx=0x7f53e800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:55.686 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.696+0000 7f53ee000640 1 -- 172.21.15.57:0/3402096049 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53e8011790 con 0x7f53f80ce720 2024-03-27T10:00:55.686 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.696+0000 7f53ee000640 1 -- 172.21.15.57:0/3402096049 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53e8017070 con 0x7f53f80ce720 2024-03-27T10:00:55.686 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.696+0000 7f53ee000640 1 -- 172.21.15.57:0/3402096049 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53e8011bb0 con 0x7f53f80ce720 2024-03-27T10:00:55.686 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.696+0000 7f53f7200640 1 -- 172.21.15.57:0/3402096049 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53f80b2c80 con 0x7f53f80ce720 2024-03-27T10:00:55.686 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.697+0000 7f53f7200640 1 -- 172.21.15.57:0/3402096049 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53f80b3240 con 0x7f53f80ce720 2024-03-27T10:00:55.687 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.698+0000 7f53f7200640 1 -- 172.21.15.57:0/3402096049 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53f80b3440 con 0x7f53f80ce720 2024-03-27T10:00:55.687 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.699+0000 7f53ee000640 1 -- 172.21.15.57:0/3402096049 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f53e801c460 con 0x7f53f80ce720 2024-03-27T10:00:55.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.700+0000 7f53ee000640 1 --2- 172.21.15.57:0/3402096049 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f53d406c530 0x7f53d406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:55.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.700+0000 7f53ee000640 1 -- 172.21.15.57:0/3402096049 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f53e808b9e0 con 0x7f53f80ce720 2024-03-27T10:00:55.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.700+0000 7f53f5400640 1 --2- 172.21.15.57:0/3402096049 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f53d406c530 0x7f53d406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:55.689 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.701+0000 7f53f5400640 1 --2- 172.21.15.57:0/3402096049 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f53d406c530 0x7f53d406e9f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f53f80b5820 tx=0x7f53e000b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:55.693 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.705+0000 7f53ee000640 1 -- 172.21.15.57:0/3402096049 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f53e8059c00 con 0x7f53f80ce720 2024-03-27T10:00:55.898 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.910+0000 7f53f7200640 1 -- 172.21.15.57:0/3402096049 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f53f8068540 con 0x7f53f80ce720 2024-03-27T10:00:55.899 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.911+0000 7f53ee000640 1 -- 172.21.15.57:0/3402096049 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) ==== 103+0+11 (secure 0 0 0) 0x7f53e8059500 con 0x7f53f80ce720 2024-03-27T10:00:55.899 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2024-03-27T10:00:55.902 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.914+0000 7f53f7200640 1 -- 172.21.15.57:0/3402096049 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f53d406c530 msgr2=0x7f53d406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:55.902 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.914+0000 7f53f7200640 1 --2- 172.21.15.57:0/3402096049 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f53d406c530 0x7f53d406e9f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f53f80b5820 tx=0x7f53e000b040 comp rx=0 tx=0).stop 2024-03-27T10:00:55.902 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.914+0000 7f53f7200640 1 -- 172.21.15.57:0/3402096049 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f53f80ce720 msgr2=0x7f53f80b1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:55.902 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.914+0000 7f53f7200640 1 --2- 172.21.15.57:0/3402096049 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f53f80ce720 0x7f53f80b1020 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f53e800c430 tx=0x7f53e800c8f0 comp rx=0 tx=0).stop 2024-03-27T10:00:55.903 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.914+0000 7f53f7200640 1 -- 172.21.15.57:0/3402096049 shutdown_connections 2024-03-27T10:00:55.903 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.914+0000 7f53f7200640 1 --2- 172.21.15.57:0/3402096049 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f53d406c530 0x7f53d406e9f0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:55.903 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.914+0000 7f53f7200640 1 --2- 172.21.15.57:0/3402096049 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f53f81601a0 0x7f53f8144460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:55.903 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.914+0000 7f53f7200640 1 --2- 172.21.15.57:0/3402096049 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f53f81458e0 0x7f53f8143f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:55.903 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.914+0000 7f53f7200640 1 --2- 172.21.15.57:0/3402096049 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f53f80ce720 0x7f53f80b1020 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:55.903 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.914+0000 7f53f7200640 1 -- 172.21.15.57:0/3402096049 >> 172.21.15.57:0/3402096049 conn(0x7f53f80cfb40 msgr2=0x7f53f81419c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:55.903 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.914+0000 7f53f7200640 1 -- 172.21.15.57:0/3402096049 shutdown_connections 2024-03-27T10:00:55.903 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:55.914+0000 7f53f7200640 1 -- 172.21.15.57:0/3402096049 wait complete. 2024-03-27T10:00:55.920 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-27T10:00:56.136 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.147+0000 7f3aae400640 1 Processor -- start 2024-03-27T10:00:56.136 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.148+0000 7f3aae400640 1 -- start start 2024-03-27T10:00:56.138 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.149+0000 7f3aae400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3aa80d0cb0 0x7f3aa80d1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:56.138 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.149+0000 7f3aae400640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3aa80d2710 con 0x7f3aa815c120 2024-03-27T10:00:56.138 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.149+0000 7f3aae400640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3aa80b3020 con 0x7f3aa80d2280 2024-03-27T10:00:56.138 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.149+0000 7f3aae400640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f3aa80cfc10 con 0x7f3aa80d0cb0 2024-03-27T10:00:56.138 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.149+0000 7f3aa7400640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f3aa815c120 0x7f3aa80b2910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:49792/0 (socket says 172.21.15.57:49792) 2024-03-27T10:00:56.138 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.149+0000 7f3aa7400640 1 -- 172.21.15.57:0/1432787590 learned_addr learned my addr 172.21.15.57:0/1432787590 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T10:00:56.140 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.150+0000 7f3aa6a00640 1 --2- 172.21.15.57:0/1432787590 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3aa80d0cb0 0x7f3aa80d1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:56.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.150+0000 7f3aa6000640 1 -- 172.21.15.57:0/1432787590 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2872874958 0 0) 0x7f3aa80d2710 con 0x7f3aa815c120 2024-03-27T10:00:56.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.150+0000 7f3aa6000640 1 -- 172.21.15.57:0/1432787590 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3a8c003520 con 0x7f3aa815c120 2024-03-27T10:00:56.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.150+0000 7f3aa6000640 1 -- 172.21.15.57:0/1432787590 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1446055731 0 0) 0x7f3a8c003520 con 0x7f3aa815c120 2024-03-27T10:00:56.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.150+0000 7f3aa6000640 1 -- 172.21.15.57:0/1432787590 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3aa80d0cb0 msgr2=0x7f3aa80d1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:56.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.150+0000 7f3aa6000640 1 --2- 172.21.15.57:0/1432787590 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3aa80d0cb0 0x7f3aa80d1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:56.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.150+0000 7f3aa6000640 1 -- 172.21.15.57:0/1432787590 >> v1:172.21.15.118:6789/0 conn(0x7f3aa80d2280 legacy=0x7f3aa80b0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:56.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.150+0000 7f3aa6000640 1 -- 172.21.15.57:0/1432787590 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3aa80cfef0 con 0x7f3aa815c120 2024-03-27T10:00:56.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.150+0000 7f3aa6000640 1 -- 172.21.15.57:0/1432787590 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4227751516 0 0) 0x7f3a90001670 con 0x7f3aa815c120 2024-03-27T10:00:56.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.150+0000 7f3aa6000640 1 -- 172.21.15.57:0/1432787590 >> v1:172.21.15.57:6789/0 conn(0x7f3aa815c120 legacy=0x7f3aa80b2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:56.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.151+0000 7f3aa6000640 1 --2- 172.21.15.57:0/1432787590 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a8c0039e0 0x7f3a8c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:56.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.151+0000 7f3aa6000640 1 --2- 172.21.15.57:0/1432787590 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3aa80d0cb0 0x7f3a8c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:56.142 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.151+0000 7f3aa6000640 1 --2- 172.21.15.57:0/1432787590 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a8c004d40 0x7f3a8c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:56.142 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.151+0000 7f3aa6000640 1 -- 172.21.15.57:0/1432787590 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f3aa80cfc10 con 0x7f3a8c004d40 2024-03-27T10:00:56.142 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.151+0000 7f3aa6000640 1 -- 172.21.15.57:0/1432787590 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f3a8c00bc40 con 0x7f3a8c0039e0 2024-03-27T10:00:56.142 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.151+0000 7f3aa6000640 1 -- 172.21.15.57:0/1432787590 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f3a8c00be40 con 0x7f3aa80d0cb0 2024-03-27T10:00:56.142 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.151+0000 7f3aa7e00640 1 --2- 172.21.15.57:0/1432787590 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a8c004d40 0x7f3a8c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:56.142 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.151+0000 7f3aa6a00640 1 --2- 172.21.15.57:0/1432787590 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3aa80d0cb0 0x7f3a8c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:56.142 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.151+0000 7f3aa7400640 1 --2- 172.21.15.57:0/1432787590 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a8c0039e0 0x7f3a8c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:56.142 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.152+0000 7f3aa7e00640 1 -- 172.21.15.57:0/1432787590 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3aa80d0cb0 msgr2=0x7f3a8c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:56.142 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.152+0000 7f3aa7e00640 1 --2- 172.21.15.57:0/1432787590 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3aa80d0cb0 0x7f3a8c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:56.142 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.152+0000 7f3aa7e00640 1 -- 172.21.15.57:0/1432787590 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a8c0039e0 msgr2=0x7f3a8c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:56.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.152+0000 7f3aa7e00640 1 --2- 172.21.15.57:0/1432787590 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a8c0039e0 0x7f3a8c003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:56.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.152+0000 7f3aa7e00640 1 -- 172.21.15.57:0/1432787590 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a8c003520 con 0x7f3a8c004d40 2024-03-27T10:00:56.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.152+0000 7f3aa7400640 1 --2- 172.21.15.57:0/1432787590 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3a8c0039e0 0x7f3a8c003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T10:00:56.144 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.153+0000 7f3aa7e00640 1 --2- 172.21.15.57:0/1432787590 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a8c004d40 0x7f3a8c0051c0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f3aa0001e50 tx=0x7f3a8c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56d7c63a04d05a71 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:56.144 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.153+0000 7f3aa6000640 1 -- 172.21.15.57:0/1432787590 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aa0001a70 con 0x7f3a8c004d40 2024-03-27T10:00:56.144 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.153+0000 7f3aa6000640 1 -- 172.21.15.57:0/1432787590 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3aa0003b70 con 0x7f3a8c004d40 2024-03-27T10:00:56.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.153+0000 7f3aa6000640 1 -- 172.21.15.57:0/1432787590 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aa00050d0 con 0x7f3a8c004d40 2024-03-27T10:00:56.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.154+0000 7f3aae400640 1 -- 172.21.15.57:0/1432787590 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a8c004d40 msgr2=0x7f3a8c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:56.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.154+0000 7f3aae400640 1 --2- 172.21.15.57:0/1432787590 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3a8c004d40 0x7f3a8c0051c0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f3aa0001e50 tx=0x7f3a8c005830 comp rx=0 tx=0).stop 2024-03-27T10:00:56.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.154+0000 7f3aa7e00640 1 -- 172.21.15.57:0/1432787590 reap_dead start 2024-03-27T10:00:56.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.154+0000 7f3aae400640 1 -- 172.21.15.57:0/1432787590 shutdown_connections 2024-03-27T10:00:56.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.154+0000 7f3aae400640 1 -- 172.21.15.57:0/1432787590 >> 172.21.15.57:0/1432787590 conn(0x7f3aa809aa30 msgr2=0x7f3aa809ae40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:56.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.154+0000 7f3aae400640 1 -- 172.21.15.57:0/1432787590 shutdown_connections 2024-03-27T10:00:56.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.154+0000 7f3aae400640 1 -- 172.21.15.57:0/1432787590 wait complete. 2024-03-27T10:00:56.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.156+0000 7f3aae400640 1 Processor -- start 2024-03-27T10:00:56.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.156+0000 7f3aae400640 1 -- start start 2024-03-27T10:00:56.147 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.157+0000 7f3aae400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3a8c004d40 0x7f3aa8159a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:56.147 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.157+0000 7f3aae400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3aa809f7e0 0x7f3aa815e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:56.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.157+0000 7f3aae400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3aa815a790 0x7f3aa815edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:56.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.157+0000 7f3aae400640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f3aa80d0790 con 0x7f3aa815a790 2024-03-27T10:00:56.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.157+0000 7f3aae400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f3aa80d04b0 con 0x7f3aa809f7e0 2024-03-27T10:00:56.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.157+0000 7f3aae400640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f3aa80cea40 con 0x7f3a8c004d40 2024-03-27T10:00:56.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.157+0000 7f3aa7e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3aa815a790 0x7f3aa815edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:56.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.157+0000 7f3aa7e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3aa815a790 0x7f3aa815edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56208/0 (socket says 172.21.15.57:56208) 2024-03-27T10:00:56.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.157+0000 7f3aa7e00640 1 -- 172.21.15.57:0/3867550531 learned_addr learned my addr 172.21.15.57:0/3867550531 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:56.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.158+0000 7f3aa6a00640 1 --2- 172.21.15.57:0/3867550531 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3aa809f7e0 0x7f3aa815e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:56.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.158+0000 7f3aa7400640 1 --2- 172.21.15.57:0/3867550531 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3a8c004d40 0x7f3aa8159a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:56.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.158+0000 7f3aa7e00640 1 -- 172.21.15.57:0/3867550531 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3a8c004d40 msgr2=0x7f3aa8159a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:56.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.158+0000 7f3aa7e00640 1 --2- 172.21.15.57:0/3867550531 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3a8c004d40 0x7f3aa8159a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:56.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.158+0000 7f3aa7e00640 1 -- 172.21.15.57:0/3867550531 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3aa809f7e0 msgr2=0x7f3aa815e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:56.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.158+0000 7f3aa7e00640 1 --2- 172.21.15.57:0/3867550531 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3aa809f7e0 0x7f3aa815e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:56.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.158+0000 7f3aa7e00640 1 -- 172.21.15.57:0/3867550531 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3aa80c9180 con 0x7f3aa815a790 2024-03-27T10:00:56.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.158+0000 7f3aa6a00640 1 --2- 172.21.15.57:0/3867550531 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3aa809f7e0 0x7f3aa815e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T10:00:56.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.158+0000 7f3aa7400640 1 --2- 172.21.15.57:0/3867550531 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3a8c004d40 0x7f3aa8159a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T10:00:56.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.158+0000 7f3aa7e00640 1 --2- 172.21.15.57:0/3867550531 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3aa815a790 0x7f3aa815edf0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f3aa002c060 tx=0x7f3aa00014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:56.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.159+0000 7f3a9f400640 1 -- 172.21.15.57:0/3867550531 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aa0007db0 con 0x7f3aa815a790 2024-03-27T10:00:56.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.159+0000 7f3a9f400640 1 -- 172.21.15.57:0/3867550531 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3aa0003970 con 0x7f3aa815a790 2024-03-27T10:00:56.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.159+0000 7f3a9f400640 1 -- 172.21.15.57:0/3867550531 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aa0006d70 con 0x7f3aa815a790 2024-03-27T10:00:56.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.159+0000 7f3aae400640 1 -- 172.21.15.57:0/3867550531 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3aa80c9460 con 0x7f3aa815a790 2024-03-27T10:00:56.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.159+0000 7f3aae400640 1 -- 172.21.15.57:0/3867550531 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3aa815a1b0 con 0x7f3aa815a790 2024-03-27T10:00:56.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.160+0000 7f3aae400640 1 -- 172.21.15.57:0/3867550531 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3aa8068620 con 0x7f3aa815a790 2024-03-27T10:00:56.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.161+0000 7f3a9f400640 1 -- 172.21.15.57:0/3867550531 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f3aa0007030 con 0x7f3aa815a790 2024-03-27T10:00:56.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.162+0000 7f3a9f400640 1 --2- 172.21.15.57:0/3867550531 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f3a8406c530 0x7f3a8406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:56.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.162+0000 7f3a9f400640 1 -- 172.21.15.57:0/3867550531 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f3aa00ace60 con 0x7f3aa815a790 2024-03-27T10:00:56.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.162+0000 7f3aa7400640 1 --2- 172.21.15.57:0/3867550531 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f3a8406c530 0x7f3a8406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:56.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.163+0000 7f3aa7400640 1 --2- 172.21.15.57:0/3867550531 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f3a8406c530 0x7f3a8406e9f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3a90001eb0 tx=0x7f3a90009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:56.155 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.167+0000 7f3a9f400640 1 -- 172.21.15.57:0/3867550531 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f3aa0033020 con 0x7f3aa815a790 2024-03-27T10:00:56.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.385+0000 7f3aae400640 1 -- 172.21.15.57:0/3867550531 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f3aa809ae40 con 0x7f3aa815a790 2024-03-27T10:00:56.374 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.386+0000 7f3a9f400640 1 -- 172.21.15.57:0/3867550531 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) ==== 80+0+0 (secure 0 0 0) 0x7f3aa007afd0 con 0x7f3aa815a790 2024-03-27T10:00:56.374 INFO:teuthology.orchestra.run.smithi057.stderr:listed 0 entries 2024-03-27T10:00:56.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.389+0000 7f3aae400640 1 -- 172.21.15.57:0/3867550531 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f3a8406c530 msgr2=0x7f3a8406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:56.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.389+0000 7f3aae400640 1 --2- 172.21.15.57:0/3867550531 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f3a8406c530 0x7f3a8406e9f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3a90001eb0 tx=0x7f3a90009040 comp rx=0 tx=0).stop 2024-03-27T10:00:56.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.389+0000 7f3aae400640 1 -- 172.21.15.57:0/3867550531 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3aa815a790 msgr2=0x7f3aa815edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:56.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.389+0000 7f3aae400640 1 --2- 172.21.15.57:0/3867550531 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3aa815a790 0x7f3aa815edf0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f3aa002c060 tx=0x7f3aa00014a0 comp rx=0 tx=0).stop 2024-03-27T10:00:56.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.389+0000 7f3aae400640 1 -- 172.21.15.57:0/3867550531 shutdown_connections 2024-03-27T10:00:56.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.389+0000 7f3aae400640 1 --2- 172.21.15.57:0/3867550531 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3aa815a790 0x7f3aa815edf0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:56.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.389+0000 7f3aae400640 1 --2- 172.21.15.57:0/3867550531 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f3a8406c530 0x7f3a8406e9f0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:56.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.389+0000 7f3aae400640 1 --2- 172.21.15.57:0/3867550531 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3aa809f7e0 0x7f3aa815e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:56.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.389+0000 7f3aae400640 1 --2- 172.21.15.57:0/3867550531 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3a8c004d40 0x7f3aa8159a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:56.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.389+0000 7f3aae400640 1 -- 172.21.15.57:0/3867550531 >> 172.21.15.57:0/3867550531 conn(0x7f3aa809aa30 msgr2=0x7f3aa80c7a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:56.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.389+0000 7f3aae400640 1 -- 172.21.15.57:0/3867550531 shutdown_connections 2024-03-27T10:00:56.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.389+0000 7f3aae400640 1 -- 172.21.15.57:0/3867550531 wait complete. 2024-03-27T10:00:56.395 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-03-27T10:00:56.395 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-27T10:00:56.450 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-27T10:00:56.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.689+0000 7f7739200640 1 Processor -- start 2024-03-27T10:00:56.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.689+0000 7f7739200640 1 -- start start 2024-03-27T10:00:56.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.691+0000 7f7739200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f77340cd330 0x7f77340cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:56.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.691+0000 7f7739200640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f773415eb00 con 0x7f773415f5c0 2024-03-27T10:00:56.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.691+0000 7f7739200640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f773406dc70 con 0x7f773406b7a0 2024-03-27T10:00:56.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.691+0000 7f7739200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f773415fa10 con 0x7f77340cd330 2024-03-27T10:00:56.680 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.691+0000 7f7731400640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f773415f5c0 0x7f773406d1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:49798/0 (socket says 172.21.15.57:49798) 2024-03-27T10:00:56.680 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.691+0000 7f7731400640 1 -- 172.21.15.57:0/3108942680 learned_addr learned my addr 172.21.15.57:0/3108942680 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T10:00:56.680 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.691+0000 7f7732800640 1 --2- 172.21.15.57:0/3108942680 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f77340cd330 0x7f77340cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:56.680 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.692+0000 7f7730a00640 1 -- 172.21.15.57:0/3108942680 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1490253527 0 0) 0x7f773415eb00 con 0x7f773415f5c0 2024-03-27T10:00:56.680 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.692+0000 7f7730a00640 1 -- 172.21.15.57:0/3108942680 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7718003520 con 0x7f773415f5c0 2024-03-27T10:00:56.680 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.692+0000 7f7732800640 1 -- 172.21.15.57:0/3108942680 >> v1:172.21.15.118:6789/0 conn(0x7f773406b7a0 legacy=0x7f773406bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:56.680 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.692+0000 7f7730a00640 1 -- 172.21.15.57:0/3108942680 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1015639060 0 0) 0x7f773406dc70 con 0x7f773406b7a0 2024-03-27T10:00:56.681 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.692+0000 7f7732800640 1 -- 172.21.15.57:0/3108942680 >> v1:172.21.15.57:6789/0 conn(0x7f773415f5c0 legacy=0x7f773406d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:56.681 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.692+0000 7f7732800640 1 -- 172.21.15.57:0/3108942680 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f773406df50 con 0x7f77340cd330 2024-03-27T10:00:56.681 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.693+0000 7f7732800640 1 --2- 172.21.15.57:0/3108942680 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f77340cd330 0x7f77340cd7c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f772c0097d0 tx=0x7f772c02b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b686747b907ba69d server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:56.682 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.694+0000 7f7730a00640 1 -- 172.21.15.57:0/3108942680 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f772c035020 con 0x7f77340cd330 2024-03-27T10:00:56.682 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.694+0000 7f7730a00640 1 -- 172.21.15.57:0/3108942680 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f772c031810 con 0x7f77340cd330 2024-03-27T10:00:56.682 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.694+0000 7f7730a00640 1 -- 172.21.15.57:0/3108942680 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f772c031bc0 con 0x7f77340cd330 2024-03-27T10:00:56.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.694+0000 7f7739200640 1 -- 172.21.15.57:0/3108942680 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f77340cd330 msgr2=0x7f77340cd7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:56.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.694+0000 7f7739200640 1 --2- 172.21.15.57:0/3108942680 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f77340cd330 0x7f77340cd7c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f772c0097d0 tx=0x7f772c02b8b0 comp rx=0 tx=0).stop 2024-03-27T10:00:56.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.695+0000 7f7739200640 1 -- 172.21.15.57:0/3108942680 shutdown_connections 2024-03-27T10:00:56.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.695+0000 7f7739200640 1 --2- 172.21.15.57:0/3108942680 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f77340cd330 0x7f77340cd7c0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:56.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.695+0000 7f7739200640 1 -- 172.21.15.57:0/3108942680 >> 172.21.15.57:0/3108942680 conn(0x7f77340b1c60 msgr2=0x7f77340b2070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:56.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.695+0000 7f7739200640 1 -- 172.21.15.57:0/3108942680 shutdown_connections 2024-03-27T10:00:56.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.695+0000 7f7739200640 1 -- 172.21.15.57:0/3108942680 wait complete. 2024-03-27T10:00:56.684 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.696+0000 7f7739200640 1 Processor -- start 2024-03-27T10:00:56.685 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.697+0000 7f7739200640 1 -- start start 2024-03-27T10:00:56.687 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.697+0000 7f7739200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f773406b7a0 0x7f773413da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:56.687 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.697+0000 7f7739200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f77340cd330 0x7f77341431b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:56.687 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.698+0000 7f7739200640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f773415f5c0 0x7f77340ce820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:56.687 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.698+0000 7f7739200640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f77340726b0 con 0x7f773415f5c0 2024-03-27T10:00:56.687 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.698+0000 7f7739200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f773415f0a0 con 0x7f773406b7a0 2024-03-27T10:00:56.687 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.698+0000 7f7739200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f773406d8c0 con 0x7f77340cd330 2024-03-27T10:00:56.687 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.698+0000 7f7732800640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f773415f5c0 0x7f77340ce820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:56.687 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.698+0000 7f7732800640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f773415f5c0 0x7f77340ce820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56220/0 (socket says 172.21.15.57:56220) 2024-03-27T10:00:56.687 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.698+0000 7f7732800640 1 -- 172.21.15.57:0/2829535041 learned_addr learned my addr 172.21.15.57:0/2829535041 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:56.687 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.698+0000 7f7731e00640 1 --2- 172.21.15.57:0/2829535041 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f773406b7a0 0x7f773413da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:56.687 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.698+0000 7f7731400640 1 --2- 172.21.15.57:0/2829535041 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f77340cd330 0x7f77341431b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:56.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.698+0000 7f7732800640 1 -- 172.21.15.57:0/2829535041 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f77340cd330 msgr2=0x7f77341431b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:56.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.698+0000 7f7732800640 1 --2- 172.21.15.57:0/2829535041 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f77340cd330 0x7f77341431b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:56.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.698+0000 7f7732800640 1 -- 172.21.15.57:0/2829535041 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f773406b7a0 msgr2=0x7f773413da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:56.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.698+0000 7f7732800640 1 --2- 172.21.15.57:0/2829535041 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f773406b7a0 0x7f773413da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:56.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.698+0000 7f7732800640 1 -- 172.21.15.57:0/2829535041 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7734143900 con 0x7f773415f5c0 2024-03-27T10:00:56.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.698+0000 7f7731e00640 1 --2- 172.21.15.57:0/2829535041 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f773406b7a0 0x7f773413da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T10:00:56.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.699+0000 7f7732800640 1 --2- 172.21.15.57:0/2829535041 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f773415f5c0 0x7f77340ce820 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f772c02b8f0 tx=0x7f772c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:56.689 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.699+0000 7f772a000640 1 -- 172.21.15.57:0/2829535041 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f772c035040 con 0x7f773415f5c0 2024-03-27T10:00:56.689 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.699+0000 7f772a000640 1 -- 172.21.15.57:0/2829535041 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f772c003820 con 0x7f773415f5c0 2024-03-27T10:00:56.689 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.699+0000 7f7739200640 1 -- 172.21.15.57:0/2829535041 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7734143be0 con 0x7f773415f5c0 2024-03-27T10:00:56.689 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.699+0000 7f772a000640 1 -- 172.21.15.57:0/2829535041 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f772c003c10 con 0x7f773415f5c0 2024-03-27T10:00:56.689 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.699+0000 7f7739200640 1 -- 172.21.15.57:0/2829535041 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77340ada40 con 0x7f773415f5c0 2024-03-27T10:00:56.689 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.701+0000 7f7739200640 1 -- 172.21.15.57:0/2829535041 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77340cda70 con 0x7f773415f5c0 2024-03-27T10:00:56.690 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.701+0000 7f772a000640 1 -- 172.21.15.57:0/2829535041 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f772c038020 con 0x7f773415f5c0 2024-03-27T10:00:56.690 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.702+0000 7f772a000640 1 --2- 172.21.15.57:0/2829535041 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f771006c560 0x7f771006ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:56.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.703+0000 7f772a000640 1 -- 172.21.15.57:0/2829535041 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f772c0ade90 con 0x7f773415f5c0 2024-03-27T10:00:56.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.703+0000 7f7731e00640 1 --2- 172.21.15.57:0/2829535041 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f771006c560 0x7f771006ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:56.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.703+0000 7f7731e00640 1 --2- 172.21.15.57:0/2829535041 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f771006c560 0x7f771006ea20 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f771c000f60 tx=0x7f771c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:56.695 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.707+0000 7f772a000640 1 -- 172.21.15.57:0/2829535041 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f772c0453e0 con 0x7f773415f5c0 2024-03-27T10:00:56.901 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.913+0000 7f7739200640 1 -- 172.21.15.57:0/2829535041 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7734068620 con 0x7f773415f5c0 2024-03-27T10:00:56.903 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.915+0000 7f772a000640 1 -- 172.21.15.57:0/2829535041 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) ==== 74+0+18888 (secure 0 0 0) 0x7f772c07c0c0 con 0x7f773415f5c0 2024-03-27T10:00:56.903 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:00:56.903 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":28,"fsid":"7ac43f86-2c16-4a97-98fb-715d3cebc75c","created":"2024-03-27T09:59:04.033417+0000","modified":"2024-03-27T10:00:10.462391+0000","last_up_change":"2024-03-27T09:59:16.969624+0000","last_in_change":"2024-03-27T09:59:07.421690+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-27T09:59:17.253008+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-27T09:59:26.690365+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-27T09:59:27.559059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-27T09:59:31.187596+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"47b44362-7302-4f2a-b735-582c6c3850cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6801","nonce":2020036298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6803","nonce":2020036298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6807","nonce":2020036298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6805","nonce":2020036298}]},"public_addr":"172.21.15.57:6801/2020036298","cluster_addr":"172.21.15.57:6803/2020036298","heartbeat_back_addr":"172.21.15.57:6807/2020036298","heartbeat_front_addr":"172.21.15.57:6805/2020036298","state":["exists","up"]},{"osd":1,"uuid":"feaf96f0-9431-4188-9a09-da505b40e934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6809","nonce":3190929242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6811","nonce":3190929242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6815","nonce":3190929242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6813","nonce":3190929242}]},"public_addr":"172.21.15.57:6809/3190929242","cluster_addr":"172.21.15.57:6811/3190929242","heartbeat_back_addr":"172.21.15.57:6815/3190929242","heartbeat_front_addr":"172.21.15.57:6813/3190929242","state":["exists","up"]},{"osd":2,"uuid":"21e406e6-cfbc-4fe7-a816-e2420487c95d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6817","nonce":4065849973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6819","nonce":4065849973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6823","nonce":4065849973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6821","nonce":4065849973}]},"public_addr":"172.21.15.57:6817/4065849973","cluster_addr":"172.21.15.57:6819/4065849973","heartbeat_back_addr":"172.21.15.57:6823/4065849973","heartbeat_front_addr":"172.21.15.57:6821/4065849973","state":["exists","up"]},{"osd":3,"uuid":"a389af1d-76c4-4dfc-b215-f983f4931257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6825","nonce":158084809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6827","nonce":158084809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6831","nonce":158084809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6829","nonce":158084809}]},"public_addr":"172.21.15.57:6825/158084809","cluster_addr":"172.21.15.57:6827/158084809","heartbeat_back_addr":"172.21.15.57:6831/158084809","heartbeat_front_addr":"172.21.15.57:6829/158084809","state":["exists","up"]},{"osd":4,"uuid":"e9b05dca-557a-43ee-b43f-9ce5b7d28304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6823","nonce":108719401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6827","nonce":108719401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6831","nonce":108719401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6829","nonce":108719401}]},"public_addr":"172.21.15.118:6823/108719401","cluster_addr":"172.21.15.118:6827/108719401","heartbeat_back_addr":"172.21.15.118:6831/108719401","heartbeat_front_addr":"172.21.15.118:6829/108719401","state":["exists","up"]},{"osd":5,"uuid":"d968177d-44ff-499a-b00a-b147ed879253","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6817","nonce":2704605866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6819","nonce":2704605866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6826","nonce":2704605866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6822","nonce":2704605866}]},"public_addr":"172.21.15.118:6817/2704605866","cluster_addr":"172.21.15.118:6819/2704605866","heartbeat_back_addr":"172.21.15.118:6826/2704605866","heartbeat_front_addr":"172.21.15.118:6822/2704605866","state":["exists","up"]},{"osd":6,"uuid":"e8f98052-e6ad-4cfe-a4a9-0b17a434d54e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6801","nonce":1963659095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6803","nonce":1963659095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6807","nonce":1963659095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6805","nonce":1963659095}]},"public_addr":"172.21.15.118:6801/1963659095","cluster_addr":"172.21.15.118:6803/1963659095","heartbeat_back_addr":"172.21.15.118:6807/1963659095","heartbeat_front_addr":"172.21.15.118:6805/1963659095","state":["exists","up"]},{"osd":7,"uuid":"eccff987-8e51-4a63-845a-cf0a3196d7fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6809","nonce":1955879596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6811","nonce":1955879596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6815","nonce":1955879596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6813","nonce":1955879596}]},"public_addr":"172.21.15.118:6809/1955879596","cluster_addr":"172.21.15.118:6811/1955879596","heartbeat_back_addr":"172.21.15.118:6815/1955879596","heartbeat_front_addr":"172.21.15.118:6813/1955879596","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.721258+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.696610+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.777895+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.806769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.743259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.845687+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:13.020165+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.722294+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.e","mappings":[{"from":7,"to":1}]},{"pgid":"3.15","mappings":[{"from":3,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-27T10:00:56.906 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.917+0000 7f7739200640 1 -- 172.21.15.57:0/2829535041 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f771006c560 msgr2=0x7f771006ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:56.906 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.917+0000 7f7739200640 1 --2- 172.21.15.57:0/2829535041 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f771006c560 0x7f771006ea20 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f771c000f60 tx=0x7f771c009040 comp rx=0 tx=0).stop 2024-03-27T10:00:56.906 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.917+0000 7f7739200640 1 -- 172.21.15.57:0/2829535041 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f773415f5c0 msgr2=0x7f77340ce820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:56.906 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.917+0000 7f7739200640 1 --2- 172.21.15.57:0/2829535041 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f773415f5c0 0x7f77340ce820 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f772c02b8f0 tx=0x7f772c0046c0 comp rx=0 tx=0).stop 2024-03-27T10:00:56.906 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.918+0000 7f7739200640 1 -- 172.21.15.57:0/2829535041 shutdown_connections 2024-03-27T10:00:56.906 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.918+0000 7f7739200640 1 --2- 172.21.15.57:0/2829535041 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f773415f5c0 0x7f77340ce820 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:56.906 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.918+0000 7f7739200640 1 --2- 172.21.15.57:0/2829535041 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f77340cd330 0x7f77341431b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:56.906 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.918+0000 7f7739200640 1 --2- 172.21.15.57:0/2829535041 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f771006c560 0x7f771006ea20 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:56.907 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.918+0000 7f7739200640 1 --2- 172.21.15.57:0/2829535041 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f773406b7a0 0x7f773413da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:56.907 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.918+0000 7f7739200640 1 -- 172.21.15.57:0/2829535041 >> 172.21.15.57:0/2829535041 conn(0x7f77340b1c60 msgr2=0x7f7734074990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:56.907 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.918+0000 7f7739200640 1 -- 172.21.15.57:0/2829535041 shutdown_connections 2024-03-27T10:00:56.907 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:56.918+0000 7f7739200640 1 -- 172.21.15.57:0/2829535041 wait complete. 2024-03-27T10:00:56.926 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-27T09:59:17.253008+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-27T09:59:26.690365+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-27T09:59:27.559059+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-27T09:59:31.187596+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-27T10:00:56.926 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-27T10:00:57.159 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.171+0000 7f9bf0c00640 1 Processor -- start 2024-03-27T10:00:57.159 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.171+0000 7f9bf0c00640 1 -- start start 2024-03-27T10:00:57.161 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.173+0000 7f9bf0c00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9bec06cf20 0x7f9bec169010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:57.161 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.173+0000 7f9bf0c00640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bec0cfe40 con 0x7f9bec161950 2024-03-27T10:00:57.161 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.173+0000 7f9bf0c00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bec161d30 con 0x7f9bec0d3770 2024-03-27T10:00:57.162 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.173+0000 7f9bf0c00640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f9bec0d0f10 con 0x7f9bec06cf20 2024-03-27T10:00:57.162 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.173+0000 7f9bebe00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f9bec06cf20 0x7f9bec169010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:57.162 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.173+0000 7f9beb400640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f9bec161950 0x7f9bec0ceb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:49806/0 (socket says 172.21.15.57:49806) 2024-03-27T10:00:57.162 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.173+0000 7f9beb400640 1 -- 172.21.15.57:0/298111573 learned_addr learned my addr 172.21.15.57:0/298111573 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T10:00:57.162 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.174+0000 7f9bebe00640 1 -- 172.21.15.57:0/298111573 >> v1:172.21.15.118:6789/0 conn(0x7f9bec0d3770 legacy=0x7f9bec0cf210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:57.162 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.174+0000 7f9bebe00640 1 -- 172.21.15.57:0/298111573 >> v1:172.21.15.57:6789/0 conn(0x7f9bec161950 legacy=0x7f9bec0ceb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:57.162 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.174+0000 7f9bebe00640 1 -- 172.21.15.57:0/298111573 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bec0d11f0 con 0x7f9bec06cf20 2024-03-27T10:00:57.163 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.175+0000 7f9bebe00640 1 --2- 172.21.15.57:0/298111573 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9bec06cf20 0x7f9bec169010 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f9be40097a0 tx=0x7f9be402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d50a23c6c540978a server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:57.163 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.175+0000 7f9beaa00640 1 -- 172.21.15.57:0/298111573 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9be4034070 con 0x7f9bec06cf20 2024-03-27T10:00:57.163 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.175+0000 7f9beaa00640 1 -- 172.21.15.57:0/298111573 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9be4030610 con 0x7f9bec06cf20 2024-03-27T10:00:57.163 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.175+0000 7f9beaa00640 1 -- 172.21.15.57:0/298111573 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9be40309e0 con 0x7f9bec06cf20 2024-03-27T10:00:57.164 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.176+0000 7f9bf0c00640 1 -- 172.21.15.57:0/298111573 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9bec06cf20 msgr2=0x7f9bec169010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:57.164 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.176+0000 7f9bf0c00640 1 --2- 172.21.15.57:0/298111573 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9bec06cf20 0x7f9bec169010 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f9be40097a0 tx=0x7f9be402b960 comp rx=0 tx=0).stop 2024-03-27T10:00:57.165 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.176+0000 7f9bf0c00640 1 -- 172.21.15.57:0/298111573 shutdown_connections 2024-03-27T10:00:57.165 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.176+0000 7f9bf0c00640 1 --2- 172.21.15.57:0/298111573 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9bec06cf20 0x7f9bec169010 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:57.165 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.176+0000 7f9bf0c00640 1 -- 172.21.15.57:0/298111573 >> 172.21.15.57:0/298111573 conn(0x7f9bec0d3fc0 msgr2=0x7f9bec0d43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:57.165 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.176+0000 7f9bf0c00640 1 -- 172.21.15.57:0/298111573 shutdown_connections 2024-03-27T10:00:57.165 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.176+0000 7f9bf0c00640 1 -- 172.21.15.57:0/298111573 wait complete. 2024-03-27T10:00:57.166 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.178+0000 7f9bf0c00640 1 Processor -- start 2024-03-27T10:00:57.166 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.178+0000 7f9bf0c00640 1 -- start start 2024-03-27T10:00:57.168 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.179+0000 7f9bf0c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9bec06cf20 0x7f9bec15d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:57.168 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.179+0000 7f9bf0c00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9bec0d3770 0x7f9bec0cd190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:57.168 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.179+0000 7f9bf0c00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9bec161950 0x7f9bec0cd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:57.168 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.179+0000 7f9bf0c00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f9bec0d2240 con 0x7f9bec0d3770 2024-03-27T10:00:57.168 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.179+0000 7f9bf0c00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f9bec0d1f60 con 0x7f9bec06cf20 2024-03-27T10:00:57.168 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.179+0000 7f9bf0c00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f9bec0cf920 con 0x7f9bec161950 2024-03-27T10:00:57.168 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.179+0000 7f9be2a00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9bec0d3770 0x7f9bec0cd190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:57.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.180+0000 7f9be2a00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9bec0d3770 0x7f9bec0cd190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56242/0 (socket says 172.21.15.57:56242) 2024-03-27T10:00:57.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.180+0000 7f9be2a00640 1 -- 172.21.15.57:0/1359574556 learned_addr learned my addr 172.21.15.57:0/1359574556 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:57.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.180+0000 7f9beb400640 1 --2- 172.21.15.57:0/1359574556 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9bec06cf20 0x7f9bec15d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:57.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.180+0000 7f9bebe00640 1 --2- 172.21.15.57:0/1359574556 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9bec161950 0x7f9bec0cd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:57.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.180+0000 7f9be2a00640 1 -- 172.21.15.57:0/1359574556 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9bec161950 msgr2=0x7f9bec0cd6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:57.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.180+0000 7f9be2a00640 1 --2- 172.21.15.57:0/1359574556 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9bec161950 0x7f9bec0cd6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:57.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.180+0000 7f9be2a00640 1 -- 172.21.15.57:0/1359574556 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9bec06cf20 msgr2=0x7f9bec15d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:57.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.180+0000 7f9be2a00640 1 --2- 172.21.15.57:0/1359574556 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9bec06cf20 0x7f9bec15d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:57.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.180+0000 7f9be2a00640 1 -- 172.21.15.57:0/1359574556 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bec0b7a50 con 0x7f9bec0d3770 2024-03-27T10:00:57.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.180+0000 7f9be2a00640 1 --2- 172.21.15.57:0/1359574556 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9bec0d3770 0x7f9bec0cd190 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f9bd400c7c0 tx=0x7f9bd400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:57.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.181+0000 7f9be3e00640 1 -- 172.21.15.57:0/1359574556 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bd4016020 con 0x7f9bec0d3770 2024-03-27T10:00:57.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.181+0000 7f9be3e00640 1 -- 172.21.15.57:0/1359574556 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bd400aa50 con 0x7f9bec0d3770 2024-03-27T10:00:57.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.181+0000 7f9be3e00640 1 -- 172.21.15.57:0/1359574556 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bd4012420 con 0x7f9bec0d3770 2024-03-27T10:00:57.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.181+0000 7f9bf0c00640 1 -- 172.21.15.57:0/1359574556 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bec0b7d30 con 0x7f9bec0d3770 2024-03-27T10:00:57.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.181+0000 7f9bf0c00640 1 -- 172.21.15.57:0/1359574556 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bec0b82f0 con 0x7f9bec0d3770 2024-03-27T10:00:57.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.182+0000 7f9bf0c00640 1 -- 172.21.15.57:0/1359574556 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9bec068540 con 0x7f9bec0d3770 2024-03-27T10:00:57.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.183+0000 7f9be3e00640 1 -- 172.21.15.57:0/1359574556 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f9bd4019020 con 0x7f9bec0d3770 2024-03-27T10:00:57.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.184+0000 7f9be3e00640 1 --2- 172.21.15.57:0/1359574556 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f9bc806c530 0x7f9bc806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:57.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.184+0000 7f9be3e00640 1 -- 172.21.15.57:0/1359574556 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f9bd408b8a0 con 0x7f9bec0d3770 2024-03-27T10:00:57.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.184+0000 7f9beb400640 1 --2- 172.21.15.57:0/1359574556 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f9bc806c530 0x7f9bc806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:57.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.185+0000 7f9beb400640 1 --2- 172.21.15.57:0/1359574556 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f9bc806c530 0x7f9bc806e9f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc000f60 tx=0x7f9bdc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:57.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.189+0000 7f9be3e00640 1 -- 172.21.15.57:0/1359574556 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f9bd4020070 con 0x7f9bec0d3770 2024-03-27T10:00:57.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.392+0000 7f9bf0c00640 1 -- 172.21.15.57:0/1359574556 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f9bec0d45b0 con 0x7f9bec0d3770 2024-03-27T10:00:57.381 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.393+0000 7f9be3e00640 1 -- 172.21.15.57:0/1359574556 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) ==== 93+0+10 (secure 0 0 0) 0x7f9bd4059ab0 con 0x7f9bec0d3770 2024-03-27T10:00:57.381 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2024-03-27T10:00:57.385 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.396+0000 7f9bf0c00640 1 -- 172.21.15.57:0/1359574556 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f9bc806c530 msgr2=0x7f9bc806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:57.385 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.396+0000 7f9bf0c00640 1 --2- 172.21.15.57:0/1359574556 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f9bc806c530 0x7f9bc806e9f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc000f60 tx=0x7f9bdc009040 comp rx=0 tx=0).stop 2024-03-27T10:00:57.385 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.396+0000 7f9bf0c00640 1 -- 172.21.15.57:0/1359574556 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9bec0d3770 msgr2=0x7f9bec0cd190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:57.385 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.396+0000 7f9bf0c00640 1 --2- 172.21.15.57:0/1359574556 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9bec0d3770 0x7f9bec0cd190 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f9bd400c7c0 tx=0x7f9bd400cc80 comp rx=0 tx=0).stop 2024-03-27T10:00:57.385 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.396+0000 7f9bf0c00640 1 -- 172.21.15.57:0/1359574556 shutdown_connections 2024-03-27T10:00:57.385 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.396+0000 7f9bf0c00640 1 --2- 172.21.15.57:0/1359574556 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f9bec161950 0x7f9bec0cd6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:57.385 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.396+0000 7f9bf0c00640 1 --2- 172.21.15.57:0/1359574556 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f9bec0d3770 0x7f9bec0cd190 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:57.385 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.396+0000 7f9bf0c00640 1 --2- 172.21.15.57:0/1359574556 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f9bc806c530 0x7f9bc806e9f0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:57.385 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.396+0000 7f9bf0c00640 1 --2- 172.21.15.57:0/1359574556 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f9bec06cf20 0x7f9bec15d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:57.385 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.396+0000 7f9bf0c00640 1 -- 172.21.15.57:0/1359574556 >> 172.21.15.57:0/1359574556 conn(0x7f9bec0d3fc0 msgr2=0x7f9bec0b61a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:57.386 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.396+0000 7f9bf0c00640 1 -- 172.21.15.57:0/1359574556 shutdown_connections 2024-03-27T10:00:57.386 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.396+0000 7f9bf0c00640 1 -- 172.21.15.57:0/1359574556 wait complete. 2024-03-27T10:00:57.404 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-27T10:00:57.634 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.646+0000 7fe2d9a00640 1 Processor -- start 2024-03-27T10:00:57.634 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.646+0000 7fe2d9a00640 1 -- start start 2024-03-27T10:00:57.636 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.648+0000 7fe2d9a00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fe2d41458e0 0x7fe2d406d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:57.636 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.648+0000 7fe2d9a00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe2d415fa90 0x7fe2d415fef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:57.636 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.648+0000 7fe2d9a00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe2d40cb0f0 0x7fe2d40cb540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:57.636 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.648+0000 7fe2d9a00640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7fe2d4160430 con 0x7fe2d40cb0f0 2024-03-27T10:00:57.637 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.648+0000 7fe2d9a00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7fe2d40ca330 con 0x7fe2d41458e0 2024-03-27T10:00:57.637 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.648+0000 7fe2d9a00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fe2d40ca610 con 0x7fe2d415fa90 2024-03-27T10:00:57.637 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.648+0000 7fe2d9000640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe2d40cb0f0 0x7fe2d40cb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:57.637 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.648+0000 7fe2d9000640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe2d40cb0f0 0x7fe2d40cb540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56250/0 (socket says 172.21.15.57:56250) 2024-03-27T10:00:57.637 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.648+0000 7fe2d9000640 1 -- 172.21.15.57:0/3680920676 learned_addr learned my addr 172.21.15.57:0/3680920676 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:57.637 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.649+0000 7fe2d3e00640 1 --2- 172.21.15.57:0/3680920676 >> v2:172.21.15.118:3300/0 conn(0x7fe2d41458e0 0x7fe2d406d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:57.638 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.649+0000 7fe2d3400640 1 --2- 172.21.15.57:0/3680920676 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe2d415fa90 0x7fe2d415fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:57.638 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.649+0000 7fe2d9000640 1 -- 172.21.15.57:0/3680920676 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe2d415fa90 msgr2=0x7fe2d415fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:57.638 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.649+0000 7fe2d9000640 1 --2- 172.21.15.57:0/3680920676 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe2d415fa90 0x7fe2d415fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:57.638 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.649+0000 7fe2d9000640 1 -- 172.21.15.57:0/3680920676 >> v2:172.21.15.118:3300/0 conn(0x7fe2d41458e0 msgr2=0x7fe2d406d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:57.638 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.649+0000 7fe2d9000640 1 --2- 172.21.15.57:0/3680920676 >> v2:172.21.15.118:3300/0 conn(0x7fe2d41458e0 0x7fe2d406d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:57.638 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.649+0000 7fe2d9000640 1 -- 172.21.15.57:0/3680920676 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2d40ca8f0 con 0x7fe2d40cb0f0 2024-03-27T10:00:57.638 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.650+0000 7fe2d9000640 1 --2- 172.21.15.57:0/3680920676 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe2d40cb0f0 0x7fe2d40cb540 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fe2d40508d0 tx=0x7fe2cc02b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4665220799a6fb79 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:57.639 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.651+0000 7fe2d2a00640 1 -- 172.21.15.57:0/3680920676 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2cc035020 con 0x7fe2d40cb0f0 2024-03-27T10:00:57.639 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.651+0000 7fe2d2a00640 1 -- 172.21.15.57:0/3680920676 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2cc02d040 con 0x7fe2d40cb0f0 2024-03-27T10:00:57.639 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.651+0000 7fe2d2a00640 1 -- 172.21.15.57:0/3680920676 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2cc031a80 con 0x7fe2d40cb0f0 2024-03-27T10:00:57.640 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.651+0000 7fe2d9a00640 1 -- 172.21.15.57:0/3680920676 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe2d40cb0f0 msgr2=0x7fe2d40cb540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:57.640 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.651+0000 7fe2d9a00640 1 --2- 172.21.15.57:0/3680920676 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe2d40cb0f0 0x7fe2d40cb540 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fe2d40508d0 tx=0x7fe2cc02b900 comp rx=0 tx=0).stop 2024-03-27T10:00:57.640 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.651+0000 7fe2d9a00640 1 -- 172.21.15.57:0/3680920676 shutdown_connections 2024-03-27T10:00:57.640 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.651+0000 7fe2d9a00640 1 --2- 172.21.15.57:0/3680920676 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe2d40cb0f0 0x7fe2d40cb540 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:57.640 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.651+0000 7fe2d9a00640 1 --2- 172.21.15.57:0/3680920676 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe2d415fa90 0x7fe2d415fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:57.640 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.651+0000 7fe2d9a00640 1 --2- 172.21.15.57:0/3680920676 >> v2:172.21.15.118:3300/0 conn(0x7fe2d41458e0 0x7fe2d406d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:57.640 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.651+0000 7fe2d9a00640 1 -- 172.21.15.57:0/3680920676 >> 172.21.15.57:0/3680920676 conn(0x7fe2d40cfb40 msgr2=0x7fe2d40cff20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:57.640 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.652+0000 7fe2d9a00640 1 -- 172.21.15.57:0/3680920676 shutdown_connections 2024-03-27T10:00:57.640 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.652+0000 7fe2d9a00640 1 -- 172.21.15.57:0/3680920676 wait complete. 2024-03-27T10:00:57.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.653+0000 7fe2d9a00640 1 Processor -- start 2024-03-27T10:00:57.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.654+0000 7fe2d9a00640 1 -- start start 2024-03-27T10:00:57.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.655+0000 7fe2d9a00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe2d40cb0f0 0x7fe2d41f6f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:57.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.655+0000 7fe2d9a00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe2d41458e0 0x7fe2d40c96b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:57.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.655+0000 7fe2d9a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe2d415fa90 0x7fe2d40c53f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:57.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.655+0000 7fe2d9a00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fe2d40cbc00 con 0x7fe2d41458e0 2024-03-27T10:00:57.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.655+0000 7fe2d9a00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fe2d40cba80 con 0x7fe2d415fa90 2024-03-27T10:00:57.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.655+0000 7fe2d9a00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fe2d40cbd80 con 0x7fe2d40cb0f0 2024-03-27T10:00:57.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.655+0000 7fe2d3400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe2d41458e0 0x7fe2d40c96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:57.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.655+0000 7fe2d3400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe2d41458e0 0x7fe2d40c96b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56262/0 (socket says 172.21.15.57:56262) 2024-03-27T10:00:57.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.655+0000 7fe2d3400640 1 -- 172.21.15.57:0/587668266 learned_addr learned my addr 172.21.15.57:0/587668266 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:57.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.655+0000 7fe2d3e00640 1 --2- 172.21.15.57:0/587668266 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe2d40cb0f0 0x7fe2d41f6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:57.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.655+0000 7fe2d9000640 1 --2- 172.21.15.57:0/587668266 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe2d415fa90 0x7fe2d40c53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:57.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.656+0000 7fe2d3400640 1 -- 172.21.15.57:0/587668266 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe2d40cb0f0 msgr2=0x7fe2d41f6f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:57.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.656+0000 7fe2d3400640 1 --2- 172.21.15.57:0/587668266 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe2d40cb0f0 0x7fe2d41f6f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:57.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.656+0000 7fe2d3400640 1 -- 172.21.15.57:0/587668266 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe2d415fa90 msgr2=0x7fe2d40c53f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:57.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.656+0000 7fe2d3400640 1 --2- 172.21.15.57:0/587668266 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe2d415fa90 0x7fe2d40c53f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:57.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.656+0000 7fe2d3400640 1 -- 172.21.15.57:0/587668266 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2d40c5b20 con 0x7fe2d41458e0 2024-03-27T10:00:57.646 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.656+0000 7fe2d3400640 1 --2- 172.21.15.57:0/587668266 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe2d41458e0 0x7fe2d40c96b0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc00d800 tx=0x7fe2bc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:57.646 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.656+0000 7fe2cbe00640 1 -- 172.21.15.57:0/587668266 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2bc00b6c0 con 0x7fe2d41458e0 2024-03-27T10:00:57.646 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.656+0000 7fe2cbe00640 1 -- 172.21.15.57:0/587668266 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2bc019070 con 0x7fe2d41458e0 2024-03-27T10:00:57.646 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.656+0000 7fe2d9a00640 1 -- 172.21.15.57:0/587668266 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2d40c5e00 con 0x7fe2d41458e0 2024-03-27T10:00:57.646 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.656+0000 7fe2cbe00640 1 -- 172.21.15.57:0/587668266 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2bc00ba80 con 0x7fe2d41458e0 2024-03-27T10:00:57.646 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.656+0000 7fe2d9a00640 1 -- 172.21.15.57:0/587668266 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2d40c63c0 con 0x7fe2d41458e0 2024-03-27T10:00:57.646 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.658+0000 7fe2d9a00640 1 -- 172.21.15.57:0/587668266 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2d4068540 con 0x7fe2d41458e0 2024-03-27T10:00:57.647 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.659+0000 7fe2cbe00640 1 -- 172.21.15.57:0/587668266 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fe2bc00bc20 con 0x7fe2d41458e0 2024-03-27T10:00:57.648 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.660+0000 7fe2cbe00640 1 --2- 172.21.15.57:0/587668266 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fe2b006c530 0x7fe2b006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:57.648 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.660+0000 7fe2cbe00640 1 -- 172.21.15.57:0/587668266 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fe2bc08bff0 con 0x7fe2d41458e0 2024-03-27T10:00:57.648 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.660+0000 7fe2d3e00640 1 --2- 172.21.15.57:0/587668266 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fe2b006c530 0x7fe2b006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:57.649 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.661+0000 7fe2d3e00640 1 --2- 172.21.15.57:0/587668266 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fe2b006c530 0x7fe2b006e9f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe2c4004410 tx=0x7fe2c40039f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:57.653 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.665+0000 7fe2cbe00640 1 -- 172.21.15.57:0/587668266 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7fe2bc05a210 con 0x7fe2d41458e0 2024-03-27T10:00:57.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.868+0000 7fe2d9a00640 1 -- 172.21.15.57:0/587668266 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fe2d40cf490 con 0x7fe2d41458e0 2024-03-27T10:00:57.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.869+0000 7fe2cbe00640 1 -- 172.21.15.57:0/587668266 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) ==== 104+0+11 (secure 0 0 0) 0x7fe2bc059b10 con 0x7fe2d41458e0 2024-03-27T10:00:57.857 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2024-03-27T10:00:57.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.872+0000 7fe2d9a00640 1 -- 172.21.15.57:0/587668266 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fe2b006c530 msgr2=0x7fe2b006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:57.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.872+0000 7fe2d9a00640 1 --2- 172.21.15.57:0/587668266 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fe2b006c530 0x7fe2b006e9f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe2c4004410 tx=0x7fe2c40039f0 comp rx=0 tx=0).stop 2024-03-27T10:00:57.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.872+0000 7fe2d9a00640 1 -- 172.21.15.57:0/587668266 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe2d41458e0 msgr2=0x7fe2d40c96b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:57.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.872+0000 7fe2d9a00640 1 --2- 172.21.15.57:0/587668266 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe2d41458e0 0x7fe2d40c96b0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc00d800 tx=0x7fe2bc00dcc0 comp rx=0 tx=0).stop 2024-03-27T10:00:57.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.872+0000 7fe2d9a00640 1 -- 172.21.15.57:0/587668266 shutdown_connections 2024-03-27T10:00:57.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.872+0000 7fe2d9a00640 1 --2- 172.21.15.57:0/587668266 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fe2b006c530 0x7fe2b006e9f0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:57.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.872+0000 7fe2d9a00640 1 --2- 172.21.15.57:0/587668266 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe2d415fa90 0x7fe2d40c53f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:57.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.872+0000 7fe2d9a00640 1 --2- 172.21.15.57:0/587668266 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe2d41458e0 0x7fe2d40c96b0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:57.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.872+0000 7fe2d9a00640 1 --2- 172.21.15.57:0/587668266 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe2d40cb0f0 0x7fe2d41f6f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:57.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.872+0000 7fe2d9a00640 1 -- 172.21.15.57:0/587668266 >> 172.21.15.57:0/587668266 conn(0x7fe2d40cfb40 msgr2=0x7fe2d40cd6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:57.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.872+0000 7fe2d9a00640 1 -- 172.21.15.57:0/587668266 shutdown_connections 2024-03-27T10:00:57.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:57.872+0000 7fe2d9a00640 1 -- 172.21.15.57:0/587668266 wait complete. 2024-03-27T10:00:57.881 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-27T10:00:58.108 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.120+0000 7f17e5600640 1 Processor -- start 2024-03-27T10:00:58.108 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.120+0000 7f17e5600640 1 -- start start 2024-03-27T10:00:58.110 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.122+0000 7f17e5600640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f17e015ae80 0x7f17e00cbcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:58.110 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.122+0000 7f17e5600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f17e00cd920 0x7f17e006ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:58.110 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.122+0000 7f17e5600640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17e015b260 con 0x7f17e006ef50 2024-03-27T10:00:58.110 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.122+0000 7f17e5600640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f17e00ceaa0 con 0x7f17e015ae80 2024-03-27T10:00:58.110 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.122+0000 7f17e5600640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f17e00c59f0 con 0x7f17e00cd920 2024-03-27T10:00:58.111 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.123+0000 7f17dfe00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f17e015ae80 0x7f17e00cbcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:58.111 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.123+0000 7f17dfe00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f17e015ae80 0x7f17e00cbcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.57:50710/0 (socket says 172.21.15.57:50710) 2024-03-27T10:00:58.111 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.123+0000 7f17dfe00640 1 -- 172.21.15.57:0/1598922697 learned_addr learned my addr 172.21.15.57:0/1598922697 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:58.111 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.123+0000 7f17df400640 1 --2- 172.21.15.57:0/1598922697 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f17e00cd920 0x7f17e006ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:58.112 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.123+0000 7f17dfe00640 1 -- 172.21.15.57:0/1598922697 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f17e00cd920 msgr2=0x7f17e006ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:58.112 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.123+0000 7f17dfe00640 1 --2- 172.21.15.57:0/1598922697 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f17e00cd920 0x7f17e006ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:58.112 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.123+0000 7f17dfe00640 1 -- 172.21.15.57:0/1598922697 >> v1:172.21.15.118:6789/0 conn(0x7f17e006ef50 legacy=0x7f17e015e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:58.112 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.123+0000 7f17dfe00640 1 -- 172.21.15.57:0/1598922697 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17e00cde90 con 0x7f17e015ae80 2024-03-27T10:00:58.112 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.123+0000 7f17df400640 1 --2- 172.21.15.57:0/1598922697 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f17e00cd920 0x7f17e006ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T10:00:58.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.125+0000 7f17dfe00640 1 --2- 172.21.15.57:0/1598922697 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f17e015ae80 0x7f17e00cbcc0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f17d0009870 tx=0x7f17d002b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c6eb6348f3dc6aa2 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:58.114 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.125+0000 7f17dea00640 1 -- 172.21.15.57:0/1598922697 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17d0034070 con 0x7f17e015ae80 2024-03-27T10:00:58.114 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.126+0000 7f17dea00640 1 -- 172.21.15.57:0/1598922697 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17d0030840 con 0x7f17e015ae80 2024-03-27T10:00:58.114 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.126+0000 7f17dea00640 1 -- 172.21.15.57:0/1598922697 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17d0030c10 con 0x7f17e015ae80 2024-03-27T10:00:58.115 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.126+0000 7f17e5600640 1 -- 172.21.15.57:0/1598922697 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f17e015ae80 msgr2=0x7f17e00cbcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:58.115 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.126+0000 7f17e5600640 1 --2- 172.21.15.57:0/1598922697 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f17e015ae80 0x7f17e00cbcc0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f17d0009870 tx=0x7f17d002b980 comp rx=0 tx=0).stop 2024-03-27T10:00:58.115 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.126+0000 7f17e5600640 1 -- 172.21.15.57:0/1598922697 shutdown_connections 2024-03-27T10:00:58.115 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.126+0000 7f17e5600640 1 --2- 172.21.15.57:0/1598922697 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f17e00cd920 0x7f17e006ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:58.115 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.126+0000 7f17e5600640 1 --2- 172.21.15.57:0/1598922697 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f17e015ae80 0x7f17e00cbcc0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:58.115 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.126+0000 7f17e5600640 1 -- 172.21.15.57:0/1598922697 >> 172.21.15.57:0/1598922697 conn(0x7f17e00cfb40 msgr2=0x7f17e00cff20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:58.115 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.126+0000 7f17e5600640 1 -- 172.21.15.57:0/1598922697 shutdown_connections 2024-03-27T10:00:58.115 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.126+0000 7f17e5600640 1 -- 172.21.15.57:0/1598922697 wait complete. 2024-03-27T10:00:58.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.128+0000 7f17e5600640 1 Processor -- start 2024-03-27T10:00:58.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.128+0000 7f17e5600640 1 -- start start 2024-03-27T10:00:58.117 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.129+0000 7f17e5600640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17e006ef50 0x7f17e01686d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:58.117 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.129+0000 7f17e5600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f17e00cd920 0x7f17e0072230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:58.117 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.129+0000 7f17e5600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f17e015ae80 0x7f17e0140ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:58.118 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.129+0000 7f17e5600640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f17e00ce730 con 0x7f17e006ef50 2024-03-27T10:00:58.118 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.129+0000 7f17e5600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f17e00ce450 con 0x7f17e015ae80 2024-03-27T10:00:58.118 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.129+0000 7f17e5600640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f17e00cc200 con 0x7f17e00cd920 2024-03-27T10:00:58.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.130+0000 7f17dfe00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17e006ef50 0x7f17e01686d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:58.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.130+0000 7f17dfe00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17e006ef50 0x7f17e01686d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56268/0 (socket says 172.21.15.57:56268) 2024-03-27T10:00:58.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.130+0000 7f17dfe00640 1 -- 172.21.15.57:0/2834631051 learned_addr learned my addr 172.21.15.57:0/2834631051 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:58.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.130+0000 7f17df400640 1 --2- 172.21.15.57:0/2834631051 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f17e00cd920 0x7f17e0072230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:58.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.130+0000 7f17e4c00640 1 --2- 172.21.15.57:0/2834631051 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f17e015ae80 0x7f17e0140ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:58.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.130+0000 7f17dfe00640 1 -- 172.21.15.57:0/2834631051 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f17e00cd920 msgr2=0x7f17e0072230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:58.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.130+0000 7f17dfe00640 1 --2- 172.21.15.57:0/2834631051 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f17e00cd920 0x7f17e0072230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:58.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.130+0000 7f17dfe00640 1 -- 172.21.15.57:0/2834631051 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f17e015ae80 msgr2=0x7f17e0140ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:58.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.130+0000 7f17dfe00640 1 --2- 172.21.15.57:0/2834631051 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f17e015ae80 0x7f17e0140ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:58.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.130+0000 7f17dfe00640 1 -- 172.21.15.57:0/2834631051 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17e014e790 con 0x7f17e006ef50 2024-03-27T10:00:58.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.131+0000 7f17dfe00640 1 --2- 172.21.15.57:0/2834631051 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17e006ef50 0x7f17e01686d0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f17d0009870 tx=0x7f17d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:58.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.131+0000 7f17d7e00640 1 -- 172.21.15.57:0/2834631051 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17d0034040 con 0x7f17e006ef50 2024-03-27T10:00:58.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.131+0000 7f17d7e00640 1 -- 172.21.15.57:0/2834631051 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17d0039d90 con 0x7f17e006ef50 2024-03-27T10:00:58.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.131+0000 7f17d7e00640 1 -- 172.21.15.57:0/2834631051 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17d0043630 con 0x7f17e006ef50 2024-03-27T10:00:58.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.131+0000 7f17e5600640 1 -- 172.21.15.57:0/2834631051 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17e014ea70 con 0x7f17e006ef50 2024-03-27T10:00:58.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.131+0000 7f17e5600640 1 -- 172.21.15.57:0/2834631051 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17e014f030 con 0x7f17e006ef50 2024-03-27T10:00:58.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.132+0000 7f17e5600640 1 -- 172.21.15.57:0/2834631051 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17e0068540 con 0x7f17e006ef50 2024-03-27T10:00:58.121 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.133+0000 7f17d7e00640 1 -- 172.21.15.57:0/2834631051 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f17d004a060 con 0x7f17e006ef50 2024-03-27T10:00:58.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.134+0000 7f17d7e00640 1 --2- 172.21.15.57:0/2834631051 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f17c006c530 0x7f17c006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:58.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.134+0000 7f17d7e00640 1 -- 172.21.15.57:0/2834631051 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f17d00adbb0 con 0x7f17e006ef50 2024-03-27T10:00:58.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.135+0000 7f17df400640 1 --2- 172.21.15.57:0/2834631051 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f17c006c530 0x7f17c006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:58.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.135+0000 7f17df400640 1 --2- 172.21.15.57:0/2834631051 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f17c006c530 0x7f17c006e9f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f17e0073500 tx=0x7f17cc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:58.127 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.139+0000 7f17d7e00640 1 -- 172.21.15.57:0/2834631051 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f17d003e070 con 0x7f17e006ef50 2024-03-27T10:00:58.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.341+0000 7f17e5600640 1 -- 172.21.15.57:0/2834631051 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f17e006d290 con 0x7f17e006ef50 2024-03-27T10:00:58.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.342+0000 7f17d7e00640 1 -- 172.21.15.57:0/2834631051 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) ==== 100+0+11 (secure 0 0 0) 0x7f17d002d330 con 0x7f17e006ef50 2024-03-27T10:00:58.331 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2024-03-27T10:00:58.333 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.345+0000 7f17e5600640 1 -- 172.21.15.57:0/2834631051 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f17c006c530 msgr2=0x7f17c006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:58.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.345+0000 7f17e5600640 1 --2- 172.21.15.57:0/2834631051 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f17c006c530 0x7f17c006e9f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f17e0073500 tx=0x7f17cc008040 comp rx=0 tx=0).stop 2024-03-27T10:00:58.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.345+0000 7f17e5600640 1 -- 172.21.15.57:0/2834631051 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17e006ef50 msgr2=0x7f17e01686d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:58.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.345+0000 7f17e5600640 1 --2- 172.21.15.57:0/2834631051 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17e006ef50 0x7f17e01686d0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f17d0009870 tx=0x7f17d00046c0 comp rx=0 tx=0).stop 2024-03-27T10:00:58.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.345+0000 7f17e5600640 1 -- 172.21.15.57:0/2834631051 shutdown_connections 2024-03-27T10:00:58.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.345+0000 7f17e5600640 1 --2- 172.21.15.57:0/2834631051 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f17c006c530 0x7f17c006e9f0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:58.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.345+0000 7f17e5600640 1 --2- 172.21.15.57:0/2834631051 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f17e015ae80 0x7f17e0140ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:58.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.345+0000 7f17e5600640 1 --2- 172.21.15.57:0/2834631051 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f17e00cd920 0x7f17e0072230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:58.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.345+0000 7f17e5600640 1 --2- 172.21.15.57:0/2834631051 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f17e006ef50 0x7f17e01686d0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:58.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.345+0000 7f17e5600640 1 -- 172.21.15.57:0/2834631051 >> 172.21.15.57:0/2834631051 conn(0x7f17e00cfb40 msgr2=0x7f17e00cc4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:58.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.345+0000 7f17e5600640 1 -- 172.21.15.57:0/2834631051 shutdown_connections 2024-03-27T10:00:58.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.345+0000 7f17e5600640 1 -- 172.21.15.57:0/2834631051 wait complete. 2024-03-27T10:00:58.352 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-27T10:00:58.574 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.585+0000 7f244e600640 1 Processor -- start 2024-03-27T10:00:58.574 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.585+0000 7f244e600640 1 -- start start 2024-03-27T10:00:58.575 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.587+0000 7f244e600640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f244815d1a0 0x7f24480acd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:58.576 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.587+0000 7f244e600640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f244815d630 con 0x7f244806cf30 2024-03-27T10:00:58.576 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.587+0000 7f244e600640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f244815c4c0 con 0x7f24480aea20 2024-03-27T10:00:58.576 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.587+0000 7f244e600640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f2448072600 con 0x7f244815d1a0 2024-03-27T10:00:58.576 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.588+0000 7f2447e00640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f244806cf30 0x7f244806d310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:49822/0 (socket says 172.21.15.57:49822) 2024-03-27T10:00:58.576 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.588+0000 7f2447e00640 1 -- 172.21.15.57:0/2803847550 learned_addr learned my addr 172.21.15.57:0/2803847550 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T10:00:58.578 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.588+0000 7f2446a00640 1 --2- 172.21.15.57:0/2803847550 >> v2:172.21.15.118:3300/0 conn(0x7f244815d1a0 0x7f24480acd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:58.578 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.588+0000 7f2446000640 1 -- 172.21.15.57:0/2803847550 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 502891545 0 0) 0x7f244815d630 con 0x7f244806cf30 2024-03-27T10:00:58.578 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.588+0000 7f2446000640 1 -- 172.21.15.57:0/2803847550 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f242c003520 con 0x7f244806cf30 2024-03-27T10:00:58.578 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.589+0000 7f2446000640 1 -- 172.21.15.57:0/2803847550 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3831168641 0 0) 0x7f242c003520 con 0x7f244806cf30 2024-03-27T10:00:58.578 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.589+0000 7f2446000640 1 -- 172.21.15.57:0/2803847550 >> v2:172.21.15.118:3300/0 conn(0x7f244815d1a0 msgr2=0x7f24480acd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:58.578 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.589+0000 7f2446000640 1 --2- 172.21.15.57:0/2803847550 >> v2:172.21.15.118:3300/0 conn(0x7f244815d1a0 0x7f24480acd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:58.578 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.589+0000 7f2446000640 1 -- 172.21.15.57:0/2803847550 >> v1:172.21.15.118:6789/0 conn(0x7f24480aea20 legacy=0x7f24480aee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:58.578 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.589+0000 7f2446000640 1 -- 172.21.15.57:0/2803847550 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24480728e0 con 0x7f244806cf30 2024-03-27T10:00:58.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.589+0000 7f2446000640 1 -- 172.21.15.57:0/2803847550 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4227751516 0 0) 0x7f2440001670 con 0x7f244806cf30 2024-03-27T10:00:58.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.589+0000 7f2446000640 1 -- 172.21.15.57:0/2803847550 >> v1:172.21.15.57:6789/0 conn(0x7f244806cf30 legacy=0x7f244806d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:58.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.589+0000 7f2446000640 1 --2- 172.21.15.57:0/2803847550 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f242c003a00 0x7f242c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:58.581 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.589+0000 7f2446000640 1 --2- 172.21.15.57:0/2803847550 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f242c004800 0x7f242c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:58.581 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.589+0000 7f2446000640 1 --2- 172.21.15.57:0/2803847550 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f242c005210 0x7f242c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:58.581 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.589+0000 7f2446000640 1 -- 172.21.15.57:0/2803847550 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f2448072600 con 0x7f242c004800 2024-03-27T10:00:58.581 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.589+0000 7f2446000640 1 -- 172.21.15.57:0/2803847550 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f242c00c160 con 0x7f242c003a00 2024-03-27T10:00:58.581 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.589+0000 7f2446000640 1 -- 172.21.15.57:0/2803847550 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f242c00c360 con 0x7f242c005210 2024-03-27T10:00:58.582 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.589+0000 7f2446a00640 1 --2- 172.21.15.57:0/2803847550 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f242c004800 0x7f242c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:58.582 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.589+0000 7f2447400640 1 --2- 172.21.15.57:0/2803847550 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f242c003a00 0x7f242c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:58.582 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.589+0000 7f2446a00640 1 -- 172.21.15.57:0/2803847550 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f242c005210 msgr2=0x7f242c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:58.582 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.589+0000 7f2446a00640 1 --2- 172.21.15.57:0/2803847550 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f242c005210 0x7f242c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:58.582 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.589+0000 7f2446a00640 1 -- 172.21.15.57:0/2803847550 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f242c003a00 msgr2=0x7f242c003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:58.582 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.589+0000 7f2446a00640 1 --2- 172.21.15.57:0/2803847550 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f242c003a00 0x7f242c003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:58.582 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.589+0000 7f2446a00640 1 -- 172.21.15.57:0/2803847550 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f242c003520 con 0x7f242c004800 2024-03-27T10:00:58.582 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.590+0000 7f2447e00640 1 -- 172.21.15.57:0/2803847550 reap_dead start 2024-03-27T10:00:58.586 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.591+0000 7f2446a00640 1 --2- 172.21.15.57:0/2803847550 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f242c004800 0x7f242c004c80 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f2430009a90 tx=0x7f242c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3474e4cafb07c49 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:58.586 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.591+0000 7f2446000640 1 -- 172.21.15.57:0/2803847550 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2430039070 con 0x7f242c004800 2024-03-27T10:00:58.586 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.591+0000 7f2446000640 1 -- 172.21.15.57:0/2803847550 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f243002c6b0 con 0x7f242c004800 2024-03-27T10:00:58.586 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.591+0000 7f2446000640 1 -- 172.21.15.57:0/2803847550 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2430009690 con 0x7f242c004800 2024-03-27T10:00:58.586 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.591+0000 7f244e600640 1 -- 172.21.15.57:0/2803847550 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f242c004800 msgr2=0x7f242c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:58.586 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.591+0000 7f244e600640 1 --2- 172.21.15.57:0/2803847550 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f242c004800 0x7f242c004c80 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f2430009a90 tx=0x7f242c005830 comp rx=0 tx=0).stop 2024-03-27T10:00:58.586 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.592+0000 7f244e600640 1 -- 172.21.15.57:0/2803847550 shutdown_connections 2024-03-27T10:00:58.586 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.592+0000 7f244e600640 1 --2- 172.21.15.57:0/2803847550 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f242c004800 0x7f242c004c80 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:58.586 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.592+0000 7f244e600640 1 -- 172.21.15.57:0/2803847550 >> 172.21.15.57:0/2803847550 conn(0x7f24480b18a0 msgr2=0x7f24480b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:58.586 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.592+0000 7f244e600640 1 -- 172.21.15.57:0/2803847550 shutdown_connections 2024-03-27T10:00:58.586 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.592+0000 7f244e600640 1 -- 172.21.15.57:0/2803847550 wait complete. 2024-03-27T10:00:58.587 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.594+0000 7f244e600640 1 Processor -- start 2024-03-27T10:00:58.587 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.594+0000 7f244e600640 1 -- start start 2024-03-27T10:00:58.587 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.595+0000 7f244e600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f242c004800 0x7f24480cb740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:58.587 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.595+0000 7f244e600640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f24480cddf0 0x7f244809b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:58.587 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.595+0000 7f244e600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f244809be60 0x7f24480cc3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:58.587 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.595+0000 7f244e600640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f24480733c0 con 0x7f24480cddf0 2024-03-27T10:00:58.587 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.595+0000 7f244e600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f2448072ea0 con 0x7f244809be60 2024-03-27T10:00:58.587 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.595+0000 7f244e600640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f24480acd60 con 0x7f242c004800 2024-03-27T10:00:58.587 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.595+0000 7f2446a00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f24480cddf0 0x7f244809b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:58.587 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.595+0000 7f2446a00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f24480cddf0 0x7f244809b920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56298/0 (socket says 172.21.15.57:56298) 2024-03-27T10:00:58.587 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.595+0000 7f2446a00640 1 -- 172.21.15.57:0/1355941593 learned_addr learned my addr 172.21.15.57:0/1355941593 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:58.587 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.595+0000 7f2447400640 1 --2- 172.21.15.57:0/1355941593 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f242c004800 0x7f24480cb740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:58.587 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.595+0000 7f2447e00640 1 --2- 172.21.15.57:0/1355941593 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f244809be60 0x7f24480cc3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:58.587 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.595+0000 7f2446a00640 1 -- 172.21.15.57:0/1355941593 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f242c004800 msgr2=0x7f24480cb740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:58.588 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.595+0000 7f2446a00640 1 --2- 172.21.15.57:0/1355941593 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f242c004800 0x7f24480cb740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:58.588 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.595+0000 7f2446a00640 1 -- 172.21.15.57:0/1355941593 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f244809be60 msgr2=0x7f24480cc3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:58.588 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.596+0000 7f2446a00640 1 --2- 172.21.15.57:0/1355941593 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f244809be60 0x7f24480cc3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:58.588 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.596+0000 7f2446a00640 1 -- 172.21.15.57:0/1355941593 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f244809ab60 con 0x7f24480cddf0 2024-03-27T10:00:58.588 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.596+0000 7f2447e00640 1 --2- 172.21.15.57:0/1355941593 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f244809be60 0x7f24480cc3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T10:00:58.588 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.596+0000 7f2446a00640 1 --2- 172.21.15.57:0/1355941593 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f24480cddf0 0x7f244809b920 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f2430037040 tx=0x7f2430004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:58.588 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.596+0000 7f243f400640 1 -- 172.21.15.57:0/1355941593 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2430039050 con 0x7f24480cddf0 2024-03-27T10:00:58.588 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.596+0000 7f243f400640 1 -- 172.21.15.57:0/1355941593 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f243003a040 con 0x7f24480cddf0 2024-03-27T10:00:58.588 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.596+0000 7f243f400640 1 -- 172.21.15.57:0/1355941593 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2430009690 con 0x7f24480cddf0 2024-03-27T10:00:58.588 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.596+0000 7f244e600640 1 -- 172.21.15.57:0/1355941593 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f244809ae40 con 0x7f24480cddf0 2024-03-27T10:00:58.588 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.597+0000 7f244e600640 1 -- 172.21.15.57:0/1355941593 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f244809b400 con 0x7f24480cddf0 2024-03-27T10:00:58.589 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.598+0000 7f244e600640 1 -- 172.21.15.57:0/1355941593 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24480757d0 con 0x7f24480cddf0 2024-03-27T10:00:58.589 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.599+0000 7f243f400640 1 -- 172.21.15.57:0/1355941593 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f2430047020 con 0x7f24480cddf0 2024-03-27T10:00:58.589 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.600+0000 7f243f400640 1 --2- 172.21.15.57:0/1355941593 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f242406c530 0x7f242406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:58.589 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.600+0000 7f243f400640 1 -- 172.21.15.57:0/1355941593 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f24300ad3f0 con 0x7f24480cddf0 2024-03-27T10:00:58.589 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.600+0000 7f2447400640 1 --2- 172.21.15.57:0/1355941593 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f242406c530 0x7f242406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:58.589 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.601+0000 7f2447400640 1 --2- 172.21.15.57:0/1355941593 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f242406c530 0x7f242406e9f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2438007fd0 tx=0x7f2438009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:58.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.605+0000 7f243f400640 1 -- 172.21.15.57:0/1355941593 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f243007b610 con 0x7f24480cddf0 2024-03-27T10:00:58.799 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.811+0000 7f244e600640 1 -- 172.21.15.57:0/1355941593 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f2448068540 con 0x7f24480cddf0 2024-03-27T10:00:58.801 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.813+0000 7f243f400640 1 -- 172.21.15.57:0/1355941593 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) ==== 103+0+11 (secure 0 0 0) 0x7f243007af10 con 0x7f24480cddf0 2024-03-27T10:00:58.801 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2024-03-27T10:00:58.804 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.816+0000 7f244e600640 1 -- 172.21.15.57:0/1355941593 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f242406c530 msgr2=0x7f242406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:58.804 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.816+0000 7f244e600640 1 --2- 172.21.15.57:0/1355941593 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f242406c530 0x7f242406e9f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2438007fd0 tx=0x7f2438009040 comp rx=0 tx=0).stop 2024-03-27T10:00:58.804 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.816+0000 7f244e600640 1 -- 172.21.15.57:0/1355941593 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f24480cddf0 msgr2=0x7f244809b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:58.805 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.816+0000 7f244e600640 1 --2- 172.21.15.57:0/1355941593 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f24480cddf0 0x7f244809b920 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f2430037040 tx=0x7f2430004730 comp rx=0 tx=0).stop 2024-03-27T10:00:58.805 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.816+0000 7f244e600640 1 -- 172.21.15.57:0/1355941593 shutdown_connections 2024-03-27T10:00:58.805 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.816+0000 7f244e600640 1 --2- 172.21.15.57:0/1355941593 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f242406c530 0x7f242406e9f0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:58.805 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.816+0000 7f244e600640 1 --2- 172.21.15.57:0/1355941593 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f244809be60 0x7f24480cc3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:58.805 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.816+0000 7f244e600640 1 --2- 172.21.15.57:0/1355941593 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f24480cddf0 0x7f244809b920 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:58.805 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.816+0000 7f244e600640 1 --2- 172.21.15.57:0/1355941593 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f242c004800 0x7f24480cb740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:58.805 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.816+0000 7f244e600640 1 -- 172.21.15.57:0/1355941593 >> 172.21.15.57:0/1355941593 conn(0x7f24480b18a0 msgr2=0x7f244815d820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:58.805 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.816+0000 7f244e600640 1 -- 172.21.15.57:0/1355941593 shutdown_connections 2024-03-27T10:00:58.805 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:58.816+0000 7f244e600640 1 -- 172.21.15.57:0/1355941593 wait complete. 2024-03-27T10:00:58.824 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-27T10:00:59.041 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.053+0000 7f5921e00640 1 Processor -- start 2024-03-27T10:00:59.042 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.053+0000 7f5921e00640 1 -- start start 2024-03-27T10:00:59.043 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.055+0000 7f5921e00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f591c0d2820 0x7f591c0d0780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:59.043 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.055+0000 7f5921e00640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f591c0d2d90 con 0x7f591c161830 2024-03-27T10:00:59.043 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.055+0000 7f5921e00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f591c0cee90 con 0x7f591c0d4b50 2024-03-27T10:00:59.044 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.055+0000 7f5921e00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f591c0cf4e0 con 0x7f591c0d2820 2024-03-27T10:00:59.044 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.055+0000 7f5920a00640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f591c161830 0x7f591c0cf970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:49838/0 (socket says 172.21.15.57:49838) 2024-03-27T10:00:59.044 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.055+0000 7f5920a00640 1 -- 172.21.15.57:0/3518978276 learned_addr learned my addr 172.21.15.57:0/3518978276 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T10:00:59.046 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.056+0000 7f591be00640 1 --2- 172.21.15.57:0/3518978276 >> v2:172.21.15.118:3300/0 conn(0x7f591c0d2820 0x7f591c0d0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:59.046 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.056+0000 7f591b400640 1 -- 172.21.15.57:0/3518978276 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2573174666 0 0) 0x7f591c0d2d90 con 0x7f591c161830 2024-03-27T10:00:59.046 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.056+0000 7f591b400640 1 -- 172.21.15.57:0/3518978276 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5904003520 con 0x7f591c161830 2024-03-27T10:00:59.046 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.056+0000 7f591b400640 1 -- 172.21.15.57:0/3518978276 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3174704402 0 0) 0x7f5904003520 con 0x7f591c161830 2024-03-27T10:00:59.046 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.056+0000 7f591b400640 1 -- 172.21.15.57:0/3518978276 >> v2:172.21.15.118:3300/0 conn(0x7f591c0d2820 msgr2=0x7f591c0d0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:59.046 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.056+0000 7f591b400640 1 --2- 172.21.15.57:0/3518978276 >> v2:172.21.15.118:3300/0 conn(0x7f591c0d2820 0x7f591c0d0780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:59.046 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.056+0000 7f591b400640 1 -- 172.21.15.57:0/3518978276 >> v1:172.21.15.118:6789/0 conn(0x7f591c0d4b50 legacy=0x7f591c0c7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:59.046 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.056+0000 7f591b400640 1 -- 172.21.15.57:0/3518978276 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f591c0cf170 con 0x7f591c161830 2024-03-27T10:00:59.046 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.056+0000 7f591b400640 1 -- 172.21.15.57:0/3518978276 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4227751516 0 0) 0x7f5910001670 con 0x7f591c161830 2024-03-27T10:00:59.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.056+0000 7f591b400640 1 -- 172.21.15.57:0/3518978276 >> v1:172.21.15.57:6789/0 conn(0x7f591c161830 legacy=0x7f591c0cf970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:59.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.057+0000 7f591b400640 1 --2- 172.21.15.57:0/3518978276 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f59040039b0 0x7f5904003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:59.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.057+0000 7f591b400640 1 --2- 172.21.15.57:0/3518978276 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5904004800 0x7f5904004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:59.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.057+0000 7f591b400640 1 --2- 172.21.15.57:0/3518978276 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59040051c0 0x7f590400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:59.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.057+0000 7f591b400640 1 -- 172.21.15.57:0/3518978276 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f591c0cf4e0 con 0x7f59040051c0 2024-03-27T10:00:59.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.057+0000 7f591b400640 1 -- 172.21.15.57:0/3518978276 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f590400c160 con 0x7f5904004800 2024-03-27T10:00:59.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.057+0000 7f591b400640 1 -- 172.21.15.57:0/3518978276 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f590400c360 con 0x7f59040039b0 2024-03-27T10:00:59.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.057+0000 7f5921400640 1 --2- 172.21.15.57:0/3518978276 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59040051c0 0x7f590400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:59.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.057+0000 7f591be00640 1 --2- 172.21.15.57:0/3518978276 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5904004800 0x7f5904004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:59.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.057+0000 7f5920a00640 1 --2- 172.21.15.57:0/3518978276 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f59040039b0 0x7f5904003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:59.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.057+0000 7f5921400640 1 -- 172.21.15.57:0/3518978276 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f59040039b0 msgr2=0x7f5904003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:59.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.057+0000 7f5921400640 1 --2- 172.21.15.57:0/3518978276 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f59040039b0 0x7f5904003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:59.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.057+0000 7f5921400640 1 -- 172.21.15.57:0/3518978276 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5904004800 msgr2=0x7f5904004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:59.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.057+0000 7f5921400640 1 --2- 172.21.15.57:0/3518978276 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5904004800 0x7f5904004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:59.048 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.057+0000 7f5921400640 1 -- 172.21.15.57:0/3518978276 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5904003520 con 0x7f59040051c0 2024-03-27T10:00:59.048 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.057+0000 7f5920a00640 1 --2- 172.21.15.57:0/3518978276 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f59040039b0 0x7f5904003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T10:00:59.048 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.057+0000 7f591be00640 1 --2- 172.21.15.57:0/3518978276 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5904004800 0x7f5904004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T10:00:59.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.058+0000 7f5921400640 1 -- 172.21.15.57:0/3518978276 reap_dead start 2024-03-27T10:00:59.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.059+0000 7f5921400640 1 --2- 172.21.15.57:0/3518978276 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59040051c0 0x7f590400b9c0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f5914001e50 tx=0x7f5904005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5885286d3a2f198d server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:59.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.059+0000 7f591b400640 1 -- 172.21.15.57:0/3518978276 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5914001a70 con 0x7f59040051c0 2024-03-27T10:00:59.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.059+0000 7f591b400640 1 -- 172.21.15.57:0/3518978276 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5914003bb0 con 0x7f59040051c0 2024-03-27T10:00:59.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.059+0000 7f591b400640 1 -- 172.21.15.57:0/3518978276 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59140050d0 con 0x7f59040051c0 2024-03-27T10:00:59.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.059+0000 7f5921e00640 1 -- 172.21.15.57:0/3518978276 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59040051c0 msgr2=0x7f590400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:59.050 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.059+0000 7f5921e00640 1 --2- 172.21.15.57:0/3518978276 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59040051c0 0x7f590400b9c0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f5914001e50 tx=0x7f5904005830 comp rx=0 tx=0).stop 2024-03-27T10:00:59.050 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.060+0000 7f5921e00640 1 -- 172.21.15.57:0/3518978276 shutdown_connections 2024-03-27T10:00:59.050 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.060+0000 7f5921e00640 1 --2- 172.21.15.57:0/3518978276 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59040051c0 0x7f590400b9c0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:59.050 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.060+0000 7f5921e00640 1 -- 172.21.15.57:0/3518978276 >> 172.21.15.57:0/3518978276 conn(0x7f591c0d4030 msgr2=0x7f591c0d4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:59.050 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.060+0000 7f5921e00640 1 -- 172.21.15.57:0/3518978276 shutdown_connections 2024-03-27T10:00:59.050 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.060+0000 7f5921e00640 1 -- 172.21.15.57:0/3518978276 wait complete. 2024-03-27T10:00:59.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.061+0000 7f5921e00640 1 Processor -- start 2024-03-27T10:00:59.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.062+0000 7f5921e00640 1 -- start start 2024-03-27T10:00:59.053 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.062+0000 7f5921e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f59040051c0 0x7f591c1f3e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:59.053 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.062+0000 7f5921e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f591c159270 0x7f591c1596f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:59.053 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.063+0000 7f5921e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f591c0cca60 0x7f591c0ccee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:59.053 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.063+0000 7f5921e00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f591c0ce4b0 con 0x7f591c159270 2024-03-27T10:00:59.053 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.063+0000 7f5921e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f591c0ce330 con 0x7f591c0cca60 2024-03-27T10:00:59.053 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.063+0000 7f5921e00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f591c161c10 con 0x7f59040051c0 2024-03-27T10:00:59.053 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.063+0000 7f591be00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f591c159270 0x7f591c1596f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:59.053 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.063+0000 7f591be00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f591c159270 0x7f591c1596f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56312/0 (socket says 172.21.15.57:56312) 2024-03-27T10:00:59.053 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.063+0000 7f591be00640 1 -- 172.21.15.57:0/2911601384 learned_addr learned my addr 172.21.15.57:0/2911601384 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:59.053 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.063+0000 7f5920a00640 1 --2- 172.21.15.57:0/2911601384 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f59040051c0 0x7f591c1f3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:59.053 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.063+0000 7f5921400640 1 --2- 172.21.15.57:0/2911601384 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f591c0cca60 0x7f591c0ccee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:59.053 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.063+0000 7f591be00640 1 -- 172.21.15.57:0/2911601384 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f59040051c0 msgr2=0x7f591c1f3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:59.053 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.063+0000 7f591be00640 1 --2- 172.21.15.57:0/2911601384 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f59040051c0 0x7f591c1f3e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:59.053 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.063+0000 7f591be00640 1 -- 172.21.15.57:0/2911601384 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f591c0cca60 msgr2=0x7f591c0ccee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:59.054 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.063+0000 7f591be00640 1 --2- 172.21.15.57:0/2911601384 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f591c0cca60 0x7f591c0ccee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:59.054 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.063+0000 7f591be00640 1 -- 172.21.15.57:0/2911601384 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f591c159de0 con 0x7f591c159270 2024-03-27T10:00:59.054 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.064+0000 7f591be00640 1 --2- 172.21.15.57:0/2911601384 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f591c159270 0x7f591c1596f0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f59080108b0 tx=0x7f5908010d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:59.054 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.064+0000 7f5918c00640 1 -- 172.21.15.57:0/2911601384 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f590800f040 con 0x7f591c159270 2024-03-27T10:00:59.054 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.064+0000 7f5918c00640 1 -- 172.21.15.57:0/2911601384 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f590800eb60 con 0x7f591c159270 2024-03-27T10:00:59.054 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.064+0000 7f5918c00640 1 -- 172.21.15.57:0/2911601384 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f590801c400 con 0x7f591c159270 2024-03-27T10:00:59.054 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.064+0000 7f5921e00640 1 -- 172.21.15.57:0/2911601384 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f591c15a0c0 con 0x7f591c159270 2024-03-27T10:00:59.054 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.064+0000 7f5921e00640 1 -- 172.21.15.57:0/2911601384 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f591c14ab90 con 0x7f591c159270 2024-03-27T10:00:59.055 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.065+0000 7f5921e00640 1 -- 172.21.15.57:0/2911601384 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f591c068540 con 0x7f591c159270 2024-03-27T10:00:59.055 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.066+0000 7f5918c00640 1 -- 172.21.15.57:0/2911601384 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f590801c5a0 con 0x7f591c159270 2024-03-27T10:00:59.055 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.067+0000 7f5918c00640 1 --2- 172.21.15.57:0/2911601384 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f58fc06c560 0x7f58fc06ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:59.055 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.067+0000 7f5918c00640 1 -- 172.21.15.57:0/2911601384 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f590808c160 con 0x7f591c159270 2024-03-27T10:00:59.056 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.068+0000 7f5920a00640 1 --2- 172.21.15.57:0/2911601384 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f58fc06c560 0x7f58fc06ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:59.056 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.068+0000 7f5920a00640 1 --2- 172.21.15.57:0/2911601384 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f58fc06c560 0x7f58fc06ea20 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f59100017e0 tx=0x7f5910009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:59.060 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.072+0000 7f5918c00640 1 -- 172.21.15.57:0/2911601384 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f5908018030 con 0x7f591c159270 2024-03-27T10:00:59.276 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.288+0000 7f5921e00640 1 -- 172.21.15.57:0/2911601384 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f591c08d780 con 0x7f591c159270 2024-03-27T10:00:59.276 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.288+0000 7f5918c00640 1 -- 172.21.15.57:0/2911601384 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) ==== 80+0+0 (secure 0 0 0) 0x7f5908060030 con 0x7f591c159270 2024-03-27T10:00:59.277 INFO:teuthology.orchestra.run.smithi057.stderr:listed 0 entries 2024-03-27T10:00:59.279 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.291+0000 7f5921e00640 1 -- 172.21.15.57:0/2911601384 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f58fc06c560 msgr2=0x7f58fc06ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:59.279 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.291+0000 7f5921e00640 1 --2- 172.21.15.57:0/2911601384 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f58fc06c560 0x7f58fc06ea20 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f59100017e0 tx=0x7f5910009040 comp rx=0 tx=0).stop 2024-03-27T10:00:59.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.291+0000 7f5921e00640 1 -- 172.21.15.57:0/2911601384 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f591c159270 msgr2=0x7f591c1596f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:59.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.291+0000 7f5921e00640 1 --2- 172.21.15.57:0/2911601384 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f591c159270 0x7f591c1596f0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f59080108b0 tx=0x7f5908010d70 comp rx=0 tx=0).stop 2024-03-27T10:00:59.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.291+0000 7f5921e00640 1 -- 172.21.15.57:0/2911601384 shutdown_connections 2024-03-27T10:00:59.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.291+0000 7f5921e00640 1 --2- 172.21.15.57:0/2911601384 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f58fc06c560 0x7f58fc06ea20 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:59.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.291+0000 7f5921e00640 1 --2- 172.21.15.57:0/2911601384 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f591c0cca60 0x7f591c0ccee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:59.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.291+0000 7f5921e00640 1 --2- 172.21.15.57:0/2911601384 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f591c159270 0x7f591c1596f0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:59.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.291+0000 7f5921e00640 1 --2- 172.21.15.57:0/2911601384 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f59040051c0 0x7f591c1f3e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:59.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.291+0000 7f5921e00640 1 -- 172.21.15.57:0/2911601384 >> 172.21.15.57:0/2911601384 conn(0x7f591c0d4030 msgr2=0x7f591c0d0430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:59.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.291+0000 7f5921e00640 1 -- 172.21.15.57:0/2911601384 shutdown_connections 2024-03-27T10:00:59.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.291+0000 7f5921e00640 1 -- 172.21.15.57:0/2911601384 wait complete. 2024-03-27T10:00:59.299 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi057.front.sepia.ceph.com... 2024-03-27T10:00:59.299 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T10:00:59.299 DEBUG:teuthology.orchestra.run.smithi057:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2024-03-27T10:00:59.386 INFO:teuthology.orchestra.run:waiting for 300 2024-03-27T10:00:59.386 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi057.front.sepia.ceph.com 2024-03-27T10:00:59.386 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T10:00:59.386 DEBUG:teuthology.orchestra.run.smithi057:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-03-27T10:00:59.438 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-03-27T10:00:59.438 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-27T10:00:59.495 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-03-27T10:00:59.495 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-27T10:00:59.546 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-27T10:00:59.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.786+0000 7f02f5400640 1 Processor -- start 2024-03-27T10:00:59.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.786+0000 7f02f5400640 1 -- start start 2024-03-27T10:00:59.776 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.788+0000 7f02f5400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f02f0145820 0x7f02f00cc950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:59.776 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.788+0000 7f02f5400640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f02f006b750 0x7f02f006bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:59.776 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.788+0000 7f02f5400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f02f00b2b70 0x7f02f00b2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:59.777 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.788+0000 7f02f5400640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f02f006c100 con 0x7f02f006b750 2024-03-27T10:00:59.777 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.788+0000 7f02f5400640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f02f0160b60 con 0x7f02f0145820 2024-03-27T10:00:59.777 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.788+0000 7f02f5400640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f02f00cce90 con 0x7f02f00b2b70 2024-03-27T10:00:59.778 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.789+0000 7f02e5e00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f02f006b750 0x7f02f006bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:59.778 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.789+0000 7f02e5e00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f02f006b750 0x7f02f006bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56314/0 (socket says 172.21.15.57:56314) 2024-03-27T10:00:59.778 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.789+0000 7f02e5e00640 1 -- 172.21.15.57:0/1039118177 learned_addr learned my addr 172.21.15.57:0/1039118177 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:59.778 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.789+0000 7f02ef200640 1 --2- 172.21.15.57:0/1039118177 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f02f00b2b70 0x7f02f00b2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:59.778 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.789+0000 7f02ee800640 1 --2- 172.21.15.57:0/1039118177 >> v2:172.21.15.118:3300/0 conn(0x7f02f0145820 0x7f02f00cc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:59.778 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.789+0000 7f02e5e00640 1 -- 172.21.15.57:0/1039118177 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f02f00b2b70 msgr2=0x7f02f00b2fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:59.778 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.789+0000 7f02e5e00640 1 --2- 172.21.15.57:0/1039118177 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f02f00b2b70 0x7f02f00b2fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:59.778 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.789+0000 7f02e5e00640 1 -- 172.21.15.57:0/1039118177 >> v2:172.21.15.118:3300/0 conn(0x7f02f0145820 msgr2=0x7f02f00cc950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:00:59.778 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.789+0000 7f02e5e00640 1 --2- 172.21.15.57:0/1039118177 >> v2:172.21.15.118:3300/0 conn(0x7f02f0145820 0x7f02f00cc950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:59.778 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.789+0000 7f02e5e00640 1 -- 172.21.15.57:0/1039118177 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02f015fc70 con 0x7f02f006b750 2024-03-27T10:00:59.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.791+0000 7f02e5e00640 1 --2- 172.21.15.57:0/1039118177 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f02f006b750 0x7f02f006bbc0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f02f00b4fc0 tx=0x7f02d802b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc03a3f5f5f7b947 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:59.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.791+0000 7f02ede00640 1 -- 172.21.15.57:0/1039118177 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02d8035020 con 0x7f02f006b750 2024-03-27T10:00:59.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.791+0000 7f02ede00640 1 -- 172.21.15.57:0/1039118177 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02d802d040 con 0x7f02f006b750 2024-03-27T10:00:59.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.791+0000 7f02ede00640 1 -- 172.21.15.57:0/1039118177 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02d8031a80 con 0x7f02f006b750 2024-03-27T10:00:59.780 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.792+0000 7f02f5400640 1 -- 172.21.15.57:0/1039118177 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f02f006b750 msgr2=0x7f02f006bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:59.780 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.792+0000 7f02f5400640 1 --2- 172.21.15.57:0/1039118177 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f02f006b750 0x7f02f006bbc0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f02f00b4fc0 tx=0x7f02d802b900 comp rx=0 tx=0).stop 2024-03-27T10:00:59.780 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.792+0000 7f02f5400640 1 -- 172.21.15.57:0/1039118177 shutdown_connections 2024-03-27T10:00:59.780 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.792+0000 7f02f5400640 1 --2- 172.21.15.57:0/1039118177 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f02f00b2b70 0x7f02f00b2fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:59.780 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.792+0000 7f02f5400640 1 --2- 172.21.15.57:0/1039118177 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f02f006b750 0x7f02f006bbc0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:59.780 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.792+0000 7f02f5400640 1 --2- 172.21.15.57:0/1039118177 >> v2:172.21.15.118:3300/0 conn(0x7f02f0145820 0x7f02f00cc950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:59.780 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.792+0000 7f02f5400640 1 -- 172.21.15.57:0/1039118177 >> 172.21.15.57:0/1039118177 conn(0x7f02f00b1c60 msgr2=0x7f02f00b2070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:00:59.780 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.792+0000 7f02f5400640 1 -- 172.21.15.57:0/1039118177 shutdown_connections 2024-03-27T10:00:59.781 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.792+0000 7f02f5400640 1 -- 172.21.15.57:0/1039118177 wait complete. 2024-03-27T10:00:59.782 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.794+0000 7f02f5400640 1 Processor -- start 2024-03-27T10:00:59.782 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.794+0000 7f02f5400640 1 -- start start 2024-03-27T10:00:59.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.796+0000 7f02f5400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f02f006b750 0x7f02f0132e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:59.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.796+0000 7f02f5400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f02f00b2b70 0x7f02f013e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:59.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.796+0000 7f02f5400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02f0145820 0x7f02f0071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:59.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.796+0000 7f02f5400640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f02f0160510 con 0x7f02f006b750 2024-03-27T10:00:59.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.796+0000 7f02f5400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f02f0160230 con 0x7f02f0145820 2024-03-27T10:00:59.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.796+0000 7f02f5400640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f02f01607f0 con 0x7f02f00b2b70 2024-03-27T10:00:59.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.796+0000 7f02ee800640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f02f006b750 0x7f02f0132e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:59.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.796+0000 7f02ee800640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f02f006b750 0x7f02f0132e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56324/0 (socket says 172.21.15.57:56324) 2024-03-27T10:00:59.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.796+0000 7f02ee800640 1 -- 172.21.15.57:0/1377746720 learned_addr learned my addr 172.21.15.57:0/1377746720 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:00:59.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.796+0000 7f02ef200640 1 --2- 172.21.15.57:0/1377746720 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02f0145820 0x7f02f0071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:59.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.797+0000 7f02e5e00640 1 --2- 172.21.15.57:0/1377746720 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f02f00b2b70 0x7f02f013e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:59.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.797+0000 7f02ee800640 1 -- 172.21.15.57:0/1377746720 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f02f00b2b70 msgr2=0x7f02f013e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:59.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.797+0000 7f02ee800640 1 --2- 172.21.15.57:0/1377746720 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f02f00b2b70 0x7f02f013e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:59.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.797+0000 7f02ee800640 1 -- 172.21.15.57:0/1377746720 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02f0145820 msgr2=0x7f02f0071200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:00:59.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.797+0000 7f02ee800640 1 --2- 172.21.15.57:0/1377746720 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02f0145820 0x7f02f0071200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:00:59.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.797+0000 7f02ee800640 1 -- 172.21.15.57:0/1377746720 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02f0071970 con 0x7f02f006b750 2024-03-27T10:00:59.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.797+0000 7f02ee800640 1 --2- 172.21.15.57:0/1377746720 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f02f006b750 0x7f02f0132e50 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f02e000d5f0 tx=0x7f02e000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:59.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.797+0000 7f02e7400640 1 -- 172.21.15.57:0/1377746720 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02e00125f0 con 0x7f02f006b750 2024-03-27T10:00:59.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.797+0000 7f02e7400640 1 -- 172.21.15.57:0/1377746720 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02e0019070 con 0x7f02f006b750 2024-03-27T10:00:59.788 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.798+0000 7f02f5400640 1 -- 172.21.15.57:0/1377746720 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02f0071c50 con 0x7f02f006b750 2024-03-27T10:00:59.788 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.798+0000 7f02e7400640 1 -- 172.21.15.57:0/1377746720 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02e00129d0 con 0x7f02f006b750 2024-03-27T10:00:59.788 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.798+0000 7f02f5400640 1 -- 172.21.15.57:0/1377746720 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02f0072210 con 0x7f02f006b750 2024-03-27T10:00:59.788 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.799+0000 7f02f5400640 1 -- 172.21.15.57:0/1377746720 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02f0068620 con 0x7f02f006b750 2024-03-27T10:00:59.788 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.800+0000 7f02e7400640 1 -- 172.21.15.57:0/1377746720 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f02e0012b70 con 0x7f02f006b750 2024-03-27T10:00:59.789 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.801+0000 7f02e7400640 1 --2- 172.21.15.57:0/1377746720 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f02cc06c560 0x7f02cc06ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:00:59.789 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.801+0000 7f02e7400640 1 -- 172.21.15.57:0/1377746720 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f02e008be90 con 0x7f02f006b750 2024-03-27T10:00:59.789 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.801+0000 7f02e5e00640 1 --2- 172.21.15.57:0/1377746720 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f02cc06c560 0x7f02cc06ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:00:59.790 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.802+0000 7f02e5e00640 1 --2- 172.21.15.57:0/1377746720 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f02cc06c560 0x7f02cc06ea20 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f02d8036000 tx=0x7f02d803c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:00:59.793 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:00:59.806+0000 7f02e7400640 1 -- 172.21.15.57:0/1377746720 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f02e005a0a0 con 0x7f02f006b750 2024-03-27T10:00:59.995 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.007+0000 7f02f5400640 1 -- 172.21.15.57:0/1377746720 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f02f00b4a70 con 0x7f02f006b750 2024-03-27T10:00:59.999 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.010+0000 7f02e7400640 1 -- 172.21.15.57:0/1377746720 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) ==== 74+0+18888 (secure 0 0 0) 0x7f02e00599a0 con 0x7f02f006b750 2024-03-27T10:00:59.999 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:00:59.999 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":28,"fsid":"7ac43f86-2c16-4a97-98fb-715d3cebc75c","created":"2024-03-27T09:59:04.033417+0000","modified":"2024-03-27T10:00:10.462391+0000","last_up_change":"2024-03-27T09:59:16.969624+0000","last_in_change":"2024-03-27T09:59:07.421690+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-27T09:59:17.253008+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-27T09:59:26.690365+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-27T09:59:27.559059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-27T09:59:31.187596+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"47b44362-7302-4f2a-b735-582c6c3850cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6801","nonce":2020036298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6803","nonce":2020036298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6807","nonce":2020036298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6805","nonce":2020036298}]},"public_addr":"172.21.15.57:6801/2020036298","cluster_addr":"172.21.15.57:6803/2020036298","heartbeat_back_addr":"172.21.15.57:6807/2020036298","heartbeat_front_addr":"172.21.15.57:6805/2020036298","state":["exists","up"]},{"osd":1,"uuid":"feaf96f0-9431-4188-9a09-da505b40e934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6809","nonce":3190929242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6811","nonce":3190929242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6815","nonce":3190929242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6813","nonce":3190929242}]},"public_addr":"172.21.15.57:6809/3190929242","cluster_addr":"172.21.15.57:6811/3190929242","heartbeat_back_addr":"172.21.15.57:6815/3190929242","heartbeat_front_addr":"172.21.15.57:6813/3190929242","state":["exists","up"]},{"osd":2,"uuid":"21e406e6-cfbc-4fe7-a816-e2420487c95d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6817","nonce":4065849973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6819","nonce":4065849973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6823","nonce":4065849973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6821","nonce":4065849973}]},"public_addr":"172.21.15.57:6817/4065849973","cluster_addr":"172.21.15.57:6819/4065849973","heartbeat_back_addr":"172.21.15.57:6823/4065849973","heartbeat_front_addr":"172.21.15.57:6821/4065849973","state":["exists","up"]},{"osd":3,"uuid":"a389af1d-76c4-4dfc-b215-f983f4931257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6825","nonce":158084809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6827","nonce":158084809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6831","nonce":158084809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6829","nonce":158084809}]},"public_addr":"172.21.15.57:6825/158084809","cluster_addr":"172.21.15.57:6827/158084809","heartbeat_back_addr":"172.21.15.57:6831/158084809","heartbeat_front_addr":"172.21.15.57:6829/158084809","state":["exists","up"]},{"osd":4,"uuid":"e9b05dca-557a-43ee-b43f-9ce5b7d28304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6823","nonce":108719401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6827","nonce":108719401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6831","nonce":108719401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6829","nonce":108719401}]},"public_addr":"172.21.15.118:6823/108719401","cluster_addr":"172.21.15.118:6827/108719401","heartbeat_back_addr":"172.21.15.118:6831/108719401","heartbeat_front_addr":"172.21.15.118:6829/108719401","state":["exists","up"]},{"osd":5,"uuid":"d968177d-44ff-499a-b00a-b147ed879253","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6817","nonce":2704605866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6819","nonce":2704605866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6826","nonce":2704605866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6822","nonce":2704605866}]},"public_addr":"172.21.15.118:6817/2704605866","cluster_addr":"172.21.15.118:6819/2704605866","heartbeat_back_addr":"172.21.15.118:6826/2704605866","heartbeat_front_addr":"172.21.15.118:6822/2704605866","state":["exists","up"]},{"osd":6,"uuid":"e8f98052-e6ad-4cfe-a4a9-0b17a434d54e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6801","nonce":1963659095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6803","nonce":1963659095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6807","nonce":1963659095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6805","nonce":1963659095}]},"public_addr":"172.21.15.118:6801/1963659095","cluster_addr":"172.21.15.118:6803/1963659095","heartbeat_back_addr":"172.21.15.118:6807/1963659095","heartbeat_front_addr":"172.21.15.118:6805/1963659095","state":["exists","up"]},{"osd":7,"uuid":"eccff987-8e51-4a63-845a-cf0a3196d7fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6809","nonce":1955879596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6811","nonce":1955879596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6815","nonce":1955879596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6813","nonce":1955879596}]},"public_addr":"172.21.15.118:6809/1955879596","cluster_addr":"172.21.15.118:6811/1955879596","heartbeat_back_addr":"172.21.15.118:6815/1955879596","heartbeat_front_addr":"172.21.15.118:6813/1955879596","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.721258+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.696610+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.777895+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.806769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.743259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.845687+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:13.020165+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.722294+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.e","mappings":[{"from":7,"to":1}]},{"pgid":"3.15","mappings":[{"from":3,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-27T10:01:00.001 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.013+0000 7f02f5400640 1 -- 172.21.15.57:0/1377746720 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f02cc06c560 msgr2=0x7f02cc06ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:00.001 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.013+0000 7f02f5400640 1 --2- 172.21.15.57:0/1377746720 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f02cc06c560 0x7f02cc06ea20 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f02d8036000 tx=0x7f02d803c040 comp rx=0 tx=0).stop 2024-03-27T10:01:00.001 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.013+0000 7f02f5400640 1 -- 172.21.15.57:0/1377746720 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f02f006b750 msgr2=0x7f02f0132e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:00.001 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.013+0000 7f02f5400640 1 --2- 172.21.15.57:0/1377746720 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f02f006b750 0x7f02f0132e50 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f02e000d5f0 tx=0x7f02e000dab0 comp rx=0 tx=0).stop 2024-03-27T10:01:00.002 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.013+0000 7f02f5400640 1 -- 172.21.15.57:0/1377746720 shutdown_connections 2024-03-27T10:01:00.002 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.013+0000 7f02f5400640 1 --2- 172.21.15.57:0/1377746720 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f02cc06c560 0x7f02cc06ea20 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:00.002 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.013+0000 7f02f5400640 1 --2- 172.21.15.57:0/1377746720 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02f0145820 0x7f02f0071200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:00.002 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.013+0000 7f02f5400640 1 --2- 172.21.15.57:0/1377746720 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f02f00b2b70 0x7f02f013e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:00.002 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.013+0000 7f02f5400640 1 --2- 172.21.15.57:0/1377746720 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f02f006b750 0x7f02f0132e50 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:00.002 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.013+0000 7f02f5400640 1 -- 172.21.15.57:0/1377746720 >> 172.21.15.57:0/1377746720 conn(0x7f02f00b1c60 msgr2=0x7f02f015d890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:00.004 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.013+0000 7f02f5400640 1 -- 172.21.15.57:0/1377746720 shutdown_connections 2024-03-27T10:01:00.004 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.013+0000 7f02f5400640 1 -- 172.21.15.57:0/1377746720 wait complete. 2024-03-27T10:01:00.024 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-27T09:59:17.253008+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-27T09:59:26.690365+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-27T09:59:27.559059+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-27T09:59:31.187596+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-27T10:01:00.025 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-27T10:01:00.241 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.252+0000 7fa1b7000640 1 Processor -- start 2024-03-27T10:01:00.241 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.252+0000 7fa1b7000640 1 -- start start 2024-03-27T10:01:00.242 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.254+0000 7fa1b7000640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa1b00d3770 0x7fa1b00cf210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:00.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.254+0000 7fa1b7000640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa1b00cf750 0x7fa1b006bf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:00.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.254+0000 7fa1b7000640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1b00cfe40 con 0x7fa1b0161950 2024-03-27T10:01:00.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.254+0000 7fa1b7000640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7fa1b0161d30 con 0x7fa1b00cf750 2024-03-27T10:01:00.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.254+0000 7fa1b7000640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fa1b00d0f10 con 0x7fa1b00d3770 2024-03-27T10:01:00.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.254+0000 7fa1b5c00640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fa1b0161950 0x7fa1b00ceb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:49840/0 (socket says 172.21.15.57:49840) 2024-03-27T10:01:00.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.254+0000 7fa1b5c00640 1 -- 172.21.15.57:0/3680966350 learned_addr learned my addr 172.21.15.57:0/3680966350 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T10:01:00.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.254+0000 7fa1b6600640 1 --2- 172.21.15.57:0/3680966350 >> v2:172.21.15.57:3300/0 conn(0x7fa1b00cf750 0x7fa1b006bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:00.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.255+0000 7fa1b5200640 1 --2- 172.21.15.57:0/3680966350 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa1b00d3770 0x7fa1b00cf210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:00.244 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.255+0000 7fa1afe00640 1 -- 172.21.15.57:0/3680966350 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3891457656 0 0) 0x7fa1b00cfe40 con 0x7fa1b0161950 2024-03-27T10:01:00.244 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.255+0000 7fa1afe00640 1 -- 172.21.15.57:0/3680966350 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa198003520 con 0x7fa1b0161950 2024-03-27T10:01:00.244 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.255+0000 7fa1b6600640 1 -- 172.21.15.57:0/3680966350 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa1b00d3770 msgr2=0x7fa1b00cf210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:01:00.244 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.255+0000 7fa1b6600640 1 --2- 172.21.15.57:0/3680966350 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa1b00d3770 0x7fa1b00cf210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:00.244 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.255+0000 7fa1b6600640 1 -- 172.21.15.57:0/3680966350 >> v1:172.21.15.57:6789/0 conn(0x7fa1b0161950 legacy=0x7fa1b00ceb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:00.244 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.255+0000 7fa1b6600640 1 -- 172.21.15.57:0/3680966350 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1b00d11f0 con 0x7fa1b00cf750 2024-03-27T10:01:00.245 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.256+0000 7fa1b6600640 1 --2- 172.21.15.57:0/3680966350 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa1b00cf750 0x7fa1b006bf10 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fa1a8009d90 tx=0x7fa1a802bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b49b47faaabac45b server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:00.245 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.256+0000 7fa1afe00640 1 -- 172.21.15.57:0/3680966350 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1a8039070 con 0x7fa1b00cf750 2024-03-27T10:01:00.246 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.256+0000 7fa1afe00640 1 -- 172.21.15.57:0/3680966350 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1a802cce0 con 0x7fa1b00cf750 2024-03-27T10:01:00.246 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.256+0000 7fa1afe00640 1 -- 172.21.15.57:0/3680966350 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1a8034640 con 0x7fa1b00cf750 2024-03-27T10:01:00.246 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.257+0000 7fa1b7000640 1 -- 172.21.15.57:0/3680966350 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa1b00cf750 msgr2=0x7fa1b006bf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:00.246 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.257+0000 7fa1b7000640 1 --2- 172.21.15.57:0/3680966350 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa1b00cf750 0x7fa1b006bf10 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fa1a8009d90 tx=0x7fa1a802bf30 comp rx=0 tx=0).stop 2024-03-27T10:01:00.246 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.257+0000 7fa1b7000640 1 -- 172.21.15.57:0/3680966350 shutdown_connections 2024-03-27T10:01:00.246 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.257+0000 7fa1b7000640 1 --2- 172.21.15.57:0/3680966350 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa1b00d3770 0x7fa1b00cf210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:00.246 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.257+0000 7fa1b7000640 1 --2- 172.21.15.57:0/3680966350 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa1b00cf750 0x7fa1b006bf10 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:00.246 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.257+0000 7fa1b7000640 1 -- 172.21.15.57:0/3680966350 >> 172.21.15.57:0/3680966350 conn(0x7fa1b00d3fc0 msgr2=0x7fa1b00d43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:00.246 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.257+0000 7fa1b7000640 1 -- 172.21.15.57:0/3680966350 shutdown_connections 2024-03-27T10:01:00.246 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.257+0000 7fa1b7000640 1 -- 172.21.15.57:0/3680966350 wait complete. 2024-03-27T10:01:00.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.259+0000 7fa1b7000640 1 Processor -- start 2024-03-27T10:01:00.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.259+0000 7fa1b7000640 1 -- start start 2024-03-27T10:01:00.248 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.260+0000 7fa1b7000640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa1b00cf750 0x7fa1b015ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:00.248 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.260+0000 7fa1b7000640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa1b00d3770 0x7fa1b00cbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:00.248 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.260+0000 7fa1b7000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa1b0161950 0x7fa1b015ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:00.249 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.260+0000 7fa1b7000640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fa1b00d2240 con 0x7fa1b00d3770 2024-03-27T10:01:00.249 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.260+0000 7fa1b7000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fa1b00d1f60 con 0x7fa1b0161950 2024-03-27T10:01:00.249 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.260+0000 7fa1b7000640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fa1b00d17b0 con 0x7fa1b00cf750 2024-03-27T10:01:00.249 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.260+0000 7fa1b5200640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa1b00d3770 0x7fa1b00cbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:00.249 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.260+0000 7fa1b5200640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa1b00d3770 0x7fa1b00cbaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56342/0 (socket says 172.21.15.57:56342) 2024-03-27T10:01:00.249 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.260+0000 7fa1b5200640 1 -- 172.21.15.57:0/1318575319 learned_addr learned my addr 172.21.15.57:0/1318575319 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:01:00.250 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.261+0000 7fa1b6600640 1 --2- 172.21.15.57:0/1318575319 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa1b0161950 0x7fa1b015ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:00.251 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.261+0000 7fa1b5c00640 1 --2- 172.21.15.57:0/1318575319 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa1b00cf750 0x7fa1b015ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:00.251 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.261+0000 7fa1b5200640 1 -- 172.21.15.57:0/1318575319 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa1b00cf750 msgr2=0x7fa1b015ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:00.251 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.261+0000 7fa1b5200640 1 --2- 172.21.15.57:0/1318575319 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa1b00cf750 0x7fa1b015ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:00.251 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.261+0000 7fa1b5200640 1 -- 172.21.15.57:0/1318575319 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa1b0161950 msgr2=0x7fa1b015ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:00.251 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.261+0000 7fa1b5200640 1 --2- 172.21.15.57:0/1318575319 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa1b0161950 0x7fa1b015ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:00.251 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.261+0000 7fa1b5200640 1 -- 172.21.15.57:0/1318575319 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1b00cc520 con 0x7fa1b00d3770 2024-03-27T10:01:00.251 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.261+0000 7fa1b5200640 1 --2- 172.21.15.57:0/1318575319 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa1b00d3770 0x7fa1b00cbaa0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fa19c00e9b0 tx=0x7fa19c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:00.251 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.262+0000 7fa1ad600640 1 -- 172.21.15.57:0/1318575319 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa19c017070 con 0x7fa1b00d3770 2024-03-27T10:01:00.251 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.262+0000 7fa1ad600640 1 -- 172.21.15.57:0/1318575319 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa19c00c9a0 con 0x7fa1b00d3770 2024-03-27T10:01:00.251 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.262+0000 7fa1ad600640 1 -- 172.21.15.57:0/1318575319 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa19c00cd90 con 0x7fa1b00d3770 2024-03-27T10:01:00.251 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.262+0000 7fa1b7000640 1 -- 172.21.15.57:0/1318575319 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1b00cc800 con 0x7fa1b00d3770 2024-03-27T10:01:00.251 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.262+0000 7fa1b7000640 1 -- 172.21.15.57:0/1318575319 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1b00ccdc0 con 0x7fa1b00d3770 2024-03-27T10:01:00.252 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.263+0000 7fa1b7000640 1 -- 172.21.15.57:0/1318575319 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1b0068540 con 0x7fa1b00d3770 2024-03-27T10:01:00.252 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.264+0000 7fa1ad600640 1 -- 172.21.15.57:0/1318575319 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fa19c01a070 con 0x7fa1b00d3770 2024-03-27T10:01:00.253 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.265+0000 7fa1ad600640 1 --2- 172.21.15.57:0/1318575319 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fa19006c530 0x7fa19006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:00.253 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.265+0000 7fa1ad600640 1 -- 172.21.15.57:0/1318575319 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fa19c08bf70 con 0x7fa1b00d3770 2024-03-27T10:01:00.253 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.265+0000 7fa1b5c00640 1 --2- 172.21.15.57:0/1318575319 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fa19006c530 0x7fa19006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:00.254 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.266+0000 7fa1b5c00640 1 --2- 172.21.15.57:0/1318575319 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fa19006c530 0x7fa19006e9f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa1a4005880 tx=0x7fa1a4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:00.257 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.269+0000 7fa1ad600640 1 -- 172.21.15.57:0/1318575319 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7fa19c05a0f0 con 0x7fa1b00d3770 2024-03-27T10:01:00.456 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.467+0000 7fa1b7000640 1 -- 172.21.15.57:0/1318575319 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fa1b00b9e50 con 0x7fa1b00d3770 2024-03-27T10:01:00.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.468+0000 7fa1ad600640 1 -- 172.21.15.57:0/1318575319 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) ==== 93+0+10 (secure 0 0 0) 0x7fa19c0599f0 con 0x7fa1b00d3770 2024-03-27T10:01:00.457 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2024-03-27T10:01:00.459 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.471+0000 7fa1b7000640 1 -- 172.21.15.57:0/1318575319 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fa19006c530 msgr2=0x7fa19006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:00.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.471+0000 7fa1b7000640 1 --2- 172.21.15.57:0/1318575319 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fa19006c530 0x7fa19006e9f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa1a4005880 tx=0x7fa1a4009040 comp rx=0 tx=0).stop 2024-03-27T10:01:00.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.471+0000 7fa1b7000640 1 -- 172.21.15.57:0/1318575319 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa1b00d3770 msgr2=0x7fa1b00cbaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:00.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.471+0000 7fa1b7000640 1 --2- 172.21.15.57:0/1318575319 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa1b00d3770 0x7fa1b00cbaa0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fa19c00e9b0 tx=0x7fa19c00ee70 comp rx=0 tx=0).stop 2024-03-27T10:01:00.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.471+0000 7fa1b7000640 1 -- 172.21.15.57:0/1318575319 shutdown_connections 2024-03-27T10:01:00.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.471+0000 7fa1b7000640 1 --2- 172.21.15.57:0/1318575319 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fa19006c530 0x7fa19006e9f0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:00.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.471+0000 7fa1b7000640 1 --2- 172.21.15.57:0/1318575319 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa1b0161950 0x7fa1b015ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:00.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.471+0000 7fa1b7000640 1 --2- 172.21.15.57:0/1318575319 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa1b00d3770 0x7fa1b00cbaa0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:00.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.471+0000 7fa1b7000640 1 --2- 172.21.15.57:0/1318575319 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa1b00cf750 0x7fa1b015ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:00.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.471+0000 7fa1b7000640 1 -- 172.21.15.57:0/1318575319 >> 172.21.15.57:0/1318575319 conn(0x7fa1b00d3fc0 msgr2=0x7fa1b00b4350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:00.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.471+0000 7fa1b7000640 1 -- 172.21.15.57:0/1318575319 shutdown_connections 2024-03-27T10:01:00.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.471+0000 7fa1b7000640 1 -- 172.21.15.57:0/1318575319 wait complete. 2024-03-27T10:01:00.477 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-27T10:01:00.694 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.705+0000 7fbae7400640 1 Processor -- start 2024-03-27T10:01:00.694 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.705+0000 7fbae7400640 1 -- start start 2024-03-27T10:01:00.696 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.707+0000 7fbae7400640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbae015e370 0x7fbae00b35d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:00.696 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.707+0000 7fbae7400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fbae006db80 0x7fbae00b3b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:00.696 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.707+0000 7fbae7400640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbae015eac0 con 0x7fbae006f720 2024-03-27T10:01:00.696 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.707+0000 7fbae7400640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7fbae006ec20 con 0x7fbae015e370 2024-03-27T10:01:00.696 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.707+0000 7fbae7400640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7fbae015eda0 con 0x7fbae006db80 2024-03-27T10:01:00.696 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.707+0000 7fbae4a00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbae015e370 0x7fbae00b35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:00.696 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.707+0000 7fbadfe00640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fbae006f720 0x7fbae0161df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:49850/0 (socket says 172.21.15.57:49850) 2024-03-27T10:01:00.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.707+0000 7fbadfe00640 1 -- 172.21.15.57:0/4164905724 learned_addr learned my addr 172.21.15.57:0/4164905724 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T10:01:00.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.707+0000 7fbae5400640 1 --2- 172.21.15.57:0/4164905724 >> v2:172.21.15.118:3300/0 conn(0x7fbae006db80 0x7fbae00b3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:00.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.708+0000 7fbae4a00640 1 -- 172.21.15.57:0/4164905724 >> v2:172.21.15.118:3300/0 conn(0x7fbae006db80 msgr2=0x7fbae00b3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:01:00.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.708+0000 7fbae4a00640 1 --2- 172.21.15.57:0/4164905724 >> v2:172.21.15.118:3300/0 conn(0x7fbae006db80 0x7fbae00b3b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:00.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.708+0000 7fbae4a00640 1 -- 172.21.15.57:0/4164905724 >> v1:172.21.15.57:6789/0 conn(0x7fbae006f720 legacy=0x7fbae0161df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:00.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.708+0000 7fbae4a00640 1 -- 172.21.15.57:0/4164905724 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbae015f080 con 0x7fbae015e370 2024-03-27T10:01:00.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.708+0000 7fbadf400640 1 -- 172.21.15.57:0/4164905724 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 579909693 0 0) 0x7fbae015eac0 con 0x7fbae006f720 2024-03-27T10:01:00.698 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.709+0000 7fbae4a00640 1 --2- 172.21.15.57:0/4164905724 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbae015e370 0x7fbae00b35d0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fbae00b2260 tx=0x7fbad402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f80212aac02f965 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:00.698 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.709+0000 7fbadf400640 1 -- 172.21.15.57:0/4164905724 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbad4035020 con 0x7fbae015e370 2024-03-27T10:01:00.698 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.709+0000 7fbadf400640 1 -- 172.21.15.57:0/4164905724 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbad4031830 con 0x7fbae015e370 2024-03-27T10:01:00.699 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.709+0000 7fbadf400640 1 -- 172.21.15.57:0/4164905724 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbad4031c00 con 0x7fbae015e370 2024-03-27T10:01:00.699 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.710+0000 7fbae7400640 1 -- 172.21.15.57:0/4164905724 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbae015e370 msgr2=0x7fbae00b35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:00.699 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.710+0000 7fbae7400640 1 --2- 172.21.15.57:0/4164905724 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbae015e370 0x7fbae00b35d0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fbae00b2260 tx=0x7fbad402b8d0 comp rx=0 tx=0).stop 2024-03-27T10:01:00.699 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.710+0000 7fbae7400640 1 -- 172.21.15.57:0/4164905724 shutdown_connections 2024-03-27T10:01:00.699 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.710+0000 7fbae7400640 1 --2- 172.21.15.57:0/4164905724 >> v2:172.21.15.118:3300/0 conn(0x7fbae006db80 0x7fbae00b3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:00.699 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.710+0000 7fbae7400640 1 --2- 172.21.15.57:0/4164905724 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbae015e370 0x7fbae00b35d0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:00.699 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.710+0000 7fbae7400640 1 -- 172.21.15.57:0/4164905724 >> 172.21.15.57:0/4164905724 conn(0x7fbae00d05e0 msgr2=0x7fbae00d09f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:00.699 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.710+0000 7fbae7400640 1 -- 172.21.15.57:0/4164905724 shutdown_connections 2024-03-27T10:01:00.699 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.710+0000 7fbae7400640 1 -- 172.21.15.57:0/4164905724 wait complete. 2024-03-27T10:01:00.700 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.712+0000 7fbae7400640 1 Processor -- start 2024-03-27T10:01:00.700 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.712+0000 7fbae7400640 1 -- start start 2024-03-27T10:01:00.702 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.713+0000 7fbae7400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbae006db80 0x7fbae014c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:00.702 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.713+0000 7fbae7400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbae006f720 0x7fbae0161030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:00.702 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.713+0000 7fbae7400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbae015e370 0x7fbae00cd760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:00.702 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.713+0000 7fbae7400640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fbae015e750 con 0x7fbae006f720 2024-03-27T10:01:00.703 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.713+0000 7fbae7400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fbae015f640 con 0x7fbae015e370 2024-03-27T10:01:00.703 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.713+0000 7fbae7400640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fbae006c550 con 0x7fbae006db80 2024-03-27T10:01:00.703 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.713+0000 7fbadfe00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbae006f720 0x7fbae0161030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:00.703 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.713+0000 7fbadfe00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbae006f720 0x7fbae0161030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56366/0 (socket says 172.21.15.57:56366) 2024-03-27T10:01:00.703 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.713+0000 7fbadfe00640 1 -- 172.21.15.57:0/3065950099 learned_addr learned my addr 172.21.15.57:0/3065950099 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:01:00.703 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.713+0000 7fbae5400640 1 --2- 172.21.15.57:0/3065950099 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbae015e370 0x7fbae00cd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:00.703 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.713+0000 7fbae4a00640 1 --2- 172.21.15.57:0/3065950099 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbae006db80 0x7fbae014c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:00.703 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.713+0000 7fbadfe00640 1 -- 172.21.15.57:0/3065950099 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbae006db80 msgr2=0x7fbae014c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:00.703 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.713+0000 7fbadfe00640 1 --2- 172.21.15.57:0/3065950099 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbae006db80 0x7fbae014c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:00.703 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.713+0000 7fbadfe00640 1 -- 172.21.15.57:0/3065950099 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbae015e370 msgr2=0x7fbae00cd760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:00.703 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.713+0000 7fbadfe00640 1 --2- 172.21.15.57:0/3065950099 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbae015e370 0x7fbae00cd760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:00.703 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.713+0000 7fbadfe00640 1 -- 172.21.15.57:0/3065950099 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbae014c600 con 0x7fbae006f720 2024-03-27T10:01:00.703 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.713+0000 7fbae4a00640 1 --2- 172.21.15.57:0/3065950099 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbae006db80 0x7fbae014c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T10:01:00.704 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.714+0000 7fbadfe00640 1 --2- 172.21.15.57:0/3065950099 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbae006f720 0x7fbae0161030 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fbacc00c4b0 tx=0x7fbacc00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:00.704 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.714+0000 7fbadcc00640 1 -- 172.21.15.57:0/3065950099 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbacc018070 con 0x7fbae006f720 2024-03-27T10:01:00.704 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.714+0000 7fbadcc00640 1 -- 172.21.15.57:0/3065950099 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbacc007500 con 0x7fbae006f720 2024-03-27T10:01:00.704 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.714+0000 7fbadcc00640 1 -- 172.21.15.57:0/3065950099 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbacc004a20 con 0x7fbae006f720 2024-03-27T10:01:00.704 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.714+0000 7fbae7400640 1 -- 172.21.15.57:0/3065950099 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbae0161860 con 0x7fbae006f720 2024-03-27T10:01:00.704 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.714+0000 7fbae7400640 1 -- 172.21.15.57:0/3065950099 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbae0161e20 con 0x7fbae006f720 2024-03-27T10:01:00.704 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.715+0000 7fbae7400640 1 -- 172.21.15.57:0/3065950099 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbae0068540 con 0x7fbae006f720 2024-03-27T10:01:00.705 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.716+0000 7fbadcc00640 1 -- 172.21.15.57:0/3065950099 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fbacc01b070 con 0x7fbae006f720 2024-03-27T10:01:00.706 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.718+0000 7fbadcc00640 1 --2- 172.21.15.57:0/3065950099 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fbac006c530 0x7fbac006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:00.706 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.718+0000 7fbadcc00640 1 -- 172.21.15.57:0/3065950099 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fbacc08aea0 con 0x7fbae006f720 2024-03-27T10:01:00.706 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.718+0000 7fbae4a00640 1 --2- 172.21.15.57:0/3065950099 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fbac006c530 0x7fbac006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:00.707 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.719+0000 7fbae4a00640 1 --2- 172.21.15.57:0/3065950099 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fbac006c530 0x7fbac006e9f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fbad4036000 tx=0x7fbad4008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:00.710 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.722+0000 7fbadcc00640 1 -- 172.21.15.57:0/3065950099 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7fbae014c600 con 0x7fbae006f720 2024-03-27T10:01:00.921 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.933+0000 7fbae7400640 1 -- 172.21.15.57:0/3065950099 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fbae00d0e20 con 0x7fbae006f720 2024-03-27T10:01:00.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.934+0000 7fbadcc00640 1 -- 172.21.15.57:0/3065950099 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) ==== 104+0+11 (secure 0 0 0) 0x7fbacc0590e0 con 0x7fbae006f720 2024-03-27T10:01:00.922 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2024-03-27T10:01:00.924 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.936+0000 7fbae7400640 1 -- 172.21.15.57:0/3065950099 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fbac006c530 msgr2=0x7fbac006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:00.924 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.936+0000 7fbae7400640 1 --2- 172.21.15.57:0/3065950099 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fbac006c530 0x7fbac006e9f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fbad4036000 tx=0x7fbad4008030 comp rx=0 tx=0).stop 2024-03-27T10:01:00.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.936+0000 7fbae7400640 1 -- 172.21.15.57:0/3065950099 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbae006f720 msgr2=0x7fbae0161030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:00.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.936+0000 7fbae7400640 1 --2- 172.21.15.57:0/3065950099 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbae006f720 0x7fbae0161030 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fbacc00c4b0 tx=0x7fbacc00c970 comp rx=0 tx=0).stop 2024-03-27T10:01:00.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.936+0000 7fbae7400640 1 -- 172.21.15.57:0/3065950099 shutdown_connections 2024-03-27T10:01:00.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.936+0000 7fbae7400640 1 --2- 172.21.15.57:0/3065950099 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fbac006c530 0x7fbac006e9f0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:00.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.936+0000 7fbae7400640 1 --2- 172.21.15.57:0/3065950099 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbae015e370 0x7fbae00cd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:00.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.936+0000 7fbae7400640 1 --2- 172.21.15.57:0/3065950099 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbae006f720 0x7fbae0161030 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:00.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.936+0000 7fbae7400640 1 --2- 172.21.15.57:0/3065950099 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbae006db80 0x7fbae014c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:00.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.936+0000 7fbae7400640 1 -- 172.21.15.57:0/3065950099 >> 172.21.15.57:0/3065950099 conn(0x7fbae00d05e0 msgr2=0x7fbae00ccff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:00.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.936+0000 7fbae7400640 1 -- 172.21.15.57:0/3065950099 shutdown_connections 2024-03-27T10:01:00.925 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:00.936+0000 7fbae7400640 1 -- 172.21.15.57:0/3065950099 wait complete. 2024-03-27T10:01:00.944 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-27T10:01:01.166 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.178+0000 7f4902400640 1 Processor -- start 2024-03-27T10:01:01.167 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.178+0000 7f4902400640 1 -- start start 2024-03-27T10:01:01.168 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.180+0000 7f4902400640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f48fc0cbb50 0x7f48fc0c4e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:01.168 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.180+0000 7f4902400640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48fc0cb720 con 0x7f48fc0ae8b0 2024-03-27T10:01:01.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.180+0000 7f4902400640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48fc0c5570 con 0x7f48fc0ca6e0 2024-03-27T10:01:01.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.180+0000 7f4902400640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f48fc0c5850 con 0x7f48fc0cbb50 2024-03-27T10:01:01.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.181+0000 7f4901a00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f48fc0cbb50 0x7f48fc0c4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:01.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.181+0000 7f48fbe00640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f48fc0ae8b0 0x7f48fc165b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:49858/0 (socket says 172.21.15.57:49858) 2024-03-27T10:01:01.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.181+0000 7f48fbe00640 1 -- 172.21.15.57:0/703920595 learned_addr learned my addr 172.21.15.57:0/703920595 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T10:01:01.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.181+0000 7f4901a00640 1 -- 172.21.15.57:0/703920595 >> v1:172.21.15.118:6789/0 conn(0x7f48fc0ca6e0 legacy=0x7f48fc0caac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:01.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.181+0000 7f4901a00640 1 -- 172.21.15.57:0/703920595 >> v1:172.21.15.57:6789/0 conn(0x7f48fc0ae8b0 legacy=0x7f48fc165b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:01.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.181+0000 7f4901a00640 1 -- 172.21.15.57:0/703920595 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48fc0c5b30 con 0x7f48fc0cbb50 2024-03-27T10:01:01.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.182+0000 7f4901a00640 1 --2- 172.21.15.57:0/703920595 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f48fc0cbb50 0x7f48fc0c4e70 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f48f40097a0 tx=0x7f48f402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=472eb97cfc6de4bf server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:01.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.183+0000 7f48fb400640 1 -- 172.21.15.57:0/703920595 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48f4035020 con 0x7f48fc0cbb50 2024-03-27T10:01:01.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.183+0000 7f48fb400640 1 -- 172.21.15.57:0/703920595 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48f4031830 con 0x7f48fc0cbb50 2024-03-27T10:01:01.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.183+0000 7f48fb400640 1 -- 172.21.15.57:0/703920595 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48f4031c00 con 0x7f48fc0cbb50 2024-03-27T10:01:01.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.183+0000 7f4902400640 1 -- 172.21.15.57:0/703920595 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f48fc0cbb50 msgr2=0x7f48fc0c4e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:01.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.183+0000 7f4902400640 1 --2- 172.21.15.57:0/703920595 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f48fc0cbb50 0x7f48fc0c4e70 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f48f40097a0 tx=0x7f48f402b8d0 comp rx=0 tx=0).stop 2024-03-27T10:01:01.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.184+0000 7f4902400640 1 -- 172.21.15.57:0/703920595 shutdown_connections 2024-03-27T10:01:01.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.184+0000 7f4902400640 1 --2- 172.21.15.57:0/703920595 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f48fc0cbb50 0x7f48fc0c4e70 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:01.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.184+0000 7f4902400640 1 -- 172.21.15.57:0/703920595 >> 172.21.15.57:0/703920595 conn(0x7f48fc0cfb40 msgr2=0x7f48fc0cff20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:01.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.184+0000 7f4902400640 1 -- 172.21.15.57:0/703920595 shutdown_connections 2024-03-27T10:01:01.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.184+0000 7f4902400640 1 -- 172.21.15.57:0/703920595 wait complete. 2024-03-27T10:01:01.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.186+0000 7f4902400640 1 Processor -- start 2024-03-27T10:01:01.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.186+0000 7f4902400640 1 -- start start 2024-03-27T10:01:01.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.187+0000 7f4902400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f48fc0ae8b0 0x7f48fc15dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:01.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.187+0000 7f4902400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f48fc0ca6e0 0x7f48fc154840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:01.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.187+0000 7f4902400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f48fc0cbb50 0x7f48fc15cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:01.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.187+0000 7f4902400640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f48fc0cb1d0 con 0x7f48fc0ae8b0 2024-03-27T10:01:01.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.187+0000 7f4902400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f48fc0c60f0 con 0x7f48fc0cbb50 2024-03-27T10:01:01.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.187+0000 7f4902400640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f48fc1692b0 con 0x7f48fc0ca6e0 2024-03-27T10:01:01.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.187+0000 7f4901000640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f48fc0ae8b0 0x7f48fc15dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:01.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.187+0000 7f4901000640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f48fc0ae8b0 0x7f48fc15dc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56388/0 (socket says 172.21.15.57:56388) 2024-03-27T10:01:01.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.187+0000 7f4901000640 1 -- 172.21.15.57:0/3116133134 learned_addr learned my addr 172.21.15.57:0/3116133134 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:01:01.177 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.187+0000 7f4901a00640 1 --2- 172.21.15.57:0/3116133134 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f48fc0cbb50 0x7f48fc15cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:01.177 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.187+0000 7f4901000640 1 -- 172.21.15.57:0/3116133134 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f48fc0ca6e0 msgr2=0x7f48fc154840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:01.177 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.187+0000 7f4901000640 1 --2- 172.21.15.57:0/3116133134 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f48fc0ca6e0 0x7f48fc154840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:01.177 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.188+0000 7f4901000640 1 -- 172.21.15.57:0/3116133134 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f48fc0cbb50 msgr2=0x7f48fc15cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:01.177 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.188+0000 7f4901000640 1 --2- 172.21.15.57:0/3116133134 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f48fc0cbb50 0x7f48fc15cfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:01.177 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.188+0000 7f4901000640 1 -- 172.21.15.57:0/3116133134 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48fc06f2c0 con 0x7f48fc0ae8b0 2024-03-27T10:01:01.177 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.188+0000 7f4901000640 1 --2- 172.21.15.57:0/3116133134 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f48fc0ae8b0 0x7f48fc15dc20 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f48ec00c450 tx=0x7f48ec00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:01.177 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.188+0000 7f48f8c00640 1 -- 172.21.15.57:0/3116133134 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48ec0052d0 con 0x7f48fc0ae8b0 2024-03-27T10:01:01.177 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.188+0000 7f48f8c00640 1 -- 172.21.15.57:0/3116133134 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48ec005470 con 0x7f48fc0ae8b0 2024-03-27T10:01:01.177 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.188+0000 7f48f8c00640 1 -- 172.21.15.57:0/3116133134 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48ec012870 con 0x7f48fc0ae8b0 2024-03-27T10:01:01.177 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.188+0000 7f4902400640 1 -- 172.21.15.57:0/3116133134 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48fc159b70 con 0x7f48fc0ae8b0 2024-03-27T10:01:01.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.188+0000 7f4902400640 1 -- 172.21.15.57:0/3116133134 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48fc15a0f0 con 0x7f48fc0ae8b0 2024-03-27T10:01:01.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.189+0000 7f4902400640 1 -- 172.21.15.57:0/3116133134 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48fc068540 con 0x7f48fc0ae8b0 2024-03-27T10:01:01.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.190+0000 7f48f8c00640 1 -- 172.21.15.57:0/3116133134 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f48ec012a10 con 0x7f48fc0ae8b0 2024-03-27T10:01:01.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.191+0000 7f48f8c00640 1 --2- 172.21.15.57:0/3116133134 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f48d806c530 0x7f48d806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:01.180 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.191+0000 7f48f8c00640 1 -- 172.21.15.57:0/3116133134 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f48ec08b700 con 0x7f48fc0ae8b0 2024-03-27T10:01:01.180 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.192+0000 7f48fbe00640 1 --2- 172.21.15.57:0/3116133134 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f48d806c530 0x7f48d806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:01.180 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.192+0000 7f48fbe00640 1 --2- 172.21.15.57:0/3116133134 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f48d806c530 0x7f48d806e9f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f48fc0712c0 tx=0x7f48e4001660 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:01.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.196+0000 7f48f8c00640 1 -- 172.21.15.57:0/3116133134 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f48ec059910 con 0x7f48fc0ae8b0 2024-03-27T10:01:01.390 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.402+0000 7f4902400640 1 -- 172.21.15.57:0/3116133134 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f48fc0ce560 con 0x7f48fc0ae8b0 2024-03-27T10:01:01.391 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.403+0000 7f48f8c00640 1 -- 172.21.15.57:0/3116133134 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) ==== 100+0+11 (secure 0 0 0) 0x7f48ec059210 con 0x7f48fc0ae8b0 2024-03-27T10:01:01.391 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2024-03-27T10:01:01.394 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.406+0000 7f4902400640 1 -- 172.21.15.57:0/3116133134 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f48d806c530 msgr2=0x7f48d806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:01.394 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.406+0000 7f4902400640 1 --2- 172.21.15.57:0/3116133134 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f48d806c530 0x7f48d806e9f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f48fc0712c0 tx=0x7f48e4001660 comp rx=0 tx=0).stop 2024-03-27T10:01:01.394 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.406+0000 7f4902400640 1 -- 172.21.15.57:0/3116133134 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f48fc0ae8b0 msgr2=0x7f48fc15dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:01.395 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.406+0000 7f4902400640 1 --2- 172.21.15.57:0/3116133134 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f48fc0ae8b0 0x7f48fc15dc20 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f48ec00c450 tx=0x7f48ec00c910 comp rx=0 tx=0).stop 2024-03-27T10:01:01.395 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.406+0000 7f4902400640 1 -- 172.21.15.57:0/3116133134 shutdown_connections 2024-03-27T10:01:01.395 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.406+0000 7f4902400640 1 --2- 172.21.15.57:0/3116133134 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f48d806c530 0x7f48d806e9f0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:01.395 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.406+0000 7f4902400640 1 --2- 172.21.15.57:0/3116133134 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f48fc0cbb50 0x7f48fc15cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:01.395 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.406+0000 7f4902400640 1 --2- 172.21.15.57:0/3116133134 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f48fc0ca6e0 0x7f48fc154840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:01.395 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.406+0000 7f4902400640 1 --2- 172.21.15.57:0/3116133134 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f48fc0ae8b0 0x7f48fc15dc20 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:01.395 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.406+0000 7f4902400640 1 -- 172.21.15.57:0/3116133134 >> 172.21.15.57:0/3116133134 conn(0x7f48fc0cfb40 msgr2=0x7f48fc0ccde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:01.395 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.406+0000 7f4902400640 1 -- 172.21.15.57:0/3116133134 shutdown_connections 2024-03-27T10:01:01.395 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.406+0000 7f4902400640 1 -- 172.21.15.57:0/3116133134 wait complete. 2024-03-27T10:01:01.413 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-27T10:01:01.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.644+0000 7fde8b200640 1 Processor -- start 2024-03-27T10:01:01.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.644+0000 7fde8b200640 1 -- start start 2024-03-27T10:01:01.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.645+0000 7fde8b200640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fde8c1601a0 0x7fde8c06d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:01.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.645+0000 7fde8b200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fde8c0ce720 0x7fde8c0ceb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:01.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.645+0000 7fde8b200640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde8c0ca330 con 0x7fde8c1458e0 2024-03-27T10:01:01.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.645+0000 7fde8b200640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7fde8c0cf0b0 con 0x7fde8c1601a0 2024-03-27T10:01:01.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.645+0000 7fde8b200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fde8c0ca610 con 0x7fde8c0ce720 2024-03-27T10:01:01.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.646+0000 7fde89e00640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fde8c1458e0 0x7fde8c15fa90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:49872/0 (socket says 172.21.15.57:49872) 2024-03-27T10:01:01.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.646+0000 7fde89e00640 1 -- 172.21.15.57:0/432749232 learned_addr learned my addr 172.21.15.57:0/432749232 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T10:01:01.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.646+0000 7fde89400640 1 --2- 172.21.15.57:0/432749232 >> v2:172.21.15.57:3300/0 conn(0x7fde8c1601a0 0x7fde8c06d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:01.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.646+0000 7fde8a800640 1 --2- 172.21.15.57:0/432749232 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fde8c0ce720 0x7fde8c0ceb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:01.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.646+0000 7fde88a00640 1 -- 172.21.15.57:0/432749232 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 489776417 0 0) 0x7fde8c0ca330 con 0x7fde8c1458e0 2024-03-27T10:01:01.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.646+0000 7fde88a00640 1 -- 172.21.15.57:0/432749232 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fde70003520 con 0x7fde8c1458e0 2024-03-27T10:01:01.636 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.646+0000 7fde89400640 1 -- 172.21.15.57:0/432749232 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fde8c0ce720 msgr2=0x7fde8c0ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:01:01.636 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.646+0000 7fde89400640 1 --2- 172.21.15.57:0/432749232 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fde8c0ce720 0x7fde8c0ceb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:01.636 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.646+0000 7fde89400640 1 -- 172.21.15.57:0/432749232 >> v1:172.21.15.57:6789/0 conn(0x7fde8c1458e0 legacy=0x7fde8c15fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:01.636 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.646+0000 7fde89400640 1 -- 172.21.15.57:0/432749232 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde8c0ca8f0 con 0x7fde8c1601a0 2024-03-27T10:01:01.636 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.646+0000 7fde8a800640 1 --2- 172.21.15.57:0/432749232 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fde8c0ce720 0x7fde8c0ceb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T10:01:01.637 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.648+0000 7fde89400640 1 --2- 172.21.15.57:0/432749232 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde8c1601a0 0x7fde8c06d070 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fde780097a0 tx=0x7fde7802b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b0c4a3bbb8a9727 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:01.637 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.648+0000 7fde88a00640 1 -- 172.21.15.57:0/432749232 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde78035020 con 0x7fde8c1601a0 2024-03-27T10:01:01.637 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.648+0000 7fde88a00640 1 -- 172.21.15.57:0/432749232 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde78031810 con 0x7fde8c1601a0 2024-03-27T10:01:01.637 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.648+0000 7fde88a00640 1 -- 172.21.15.57:0/432749232 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde78031be0 con 0x7fde8c1601a0 2024-03-27T10:01:01.637 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.648+0000 7fde8b200640 1 -- 172.21.15.57:0/432749232 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde8c1601a0 msgr2=0x7fde8c06d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:01.637 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.649+0000 7fde8b200640 1 --2- 172.21.15.57:0/432749232 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde8c1601a0 0x7fde8c06d070 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fde780097a0 tx=0x7fde7802b8b0 comp rx=0 tx=0).stop 2024-03-27T10:01:01.637 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.649+0000 7fde8b200640 1 -- 172.21.15.57:0/432749232 shutdown_connections 2024-03-27T10:01:01.638 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.649+0000 7fde8b200640 1 --2- 172.21.15.57:0/432749232 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fde8c0ce720 0x7fde8c0ceb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:01.638 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.649+0000 7fde8b200640 1 --2- 172.21.15.57:0/432749232 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde8c1601a0 0x7fde8c06d070 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:01.638 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.649+0000 7fde8b200640 1 -- 172.21.15.57:0/432749232 >> 172.21.15.57:0/432749232 conn(0x7fde8c0cfb40 msgr2=0x7fde8c0cff20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:01.638 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.649+0000 7fde8b200640 1 -- 172.21.15.57:0/432749232 shutdown_connections 2024-03-27T10:01:01.638 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.649+0000 7fde8b200640 1 -- 172.21.15.57:0/432749232 wait complete. 2024-03-27T10:01:01.638 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.650+0000 7fde8b200640 1 Processor -- start 2024-03-27T10:01:01.639 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.651+0000 7fde8b200640 1 -- start start 2024-03-27T10:01:01.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.652+0000 7fde8b200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fde8c0ce720 0x7fde8c140240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:01.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.652+0000 7fde8b200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fde8c1458e0 0x7fde8c140780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:01.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.652+0000 7fde8b200640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde8c1601a0 0x7fde8c15e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:01.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.652+0000 7fde8b200640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fde8c0cb270 con 0x7fde8c1601a0 2024-03-27T10:01:01.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.652+0000 7fde8b200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fde8c0cb0f0 con 0x7fde8c0ce720 2024-03-27T10:01:01.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.652+0000 7fde8b200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fde8c0cb3f0 con 0x7fde8c1458e0 2024-03-27T10:01:01.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.652+0000 7fde8a800640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde8c1601a0 0x7fde8c15e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:01.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.652+0000 7fde8a800640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde8c1601a0 0x7fde8c15e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56396/0 (socket says 172.21.15.57:56396) 2024-03-27T10:01:01.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.652+0000 7fde8a800640 1 -- 172.21.15.57:0/256426442 learned_addr learned my addr 172.21.15.57:0/256426442 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:01:01.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.652+0000 7fde89e00640 1 --2- 172.21.15.57:0/256426442 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fde8c0ce720 0x7fde8c140240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:01.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.652+0000 7fde89400640 1 --2- 172.21.15.57:0/256426442 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fde8c1458e0 0x7fde8c140780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:01.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.652+0000 7fde8a800640 1 -- 172.21.15.57:0/256426442 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fde8c1458e0 msgr2=0x7fde8c140780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:01.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.652+0000 7fde8a800640 1 --2- 172.21.15.57:0/256426442 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fde8c1458e0 0x7fde8c140780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:01.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.652+0000 7fde8a800640 1 -- 172.21.15.57:0/256426442 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fde8c0ce720 msgr2=0x7fde8c140240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:01.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.652+0000 7fde8a800640 1 --2- 172.21.15.57:0/256426442 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fde8c0ce720 0x7fde8c140240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:01.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.652+0000 7fde8a800640 1 -- 172.21.15.57:0/256426442 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde8c142fe0 con 0x7fde8c1601a0 2024-03-27T10:01:01.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.653+0000 7fde8a800640 1 --2- 172.21.15.57:0/256426442 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde8c1601a0 0x7fde8c15e210 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fde8400cef0 tx=0x7fde8400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:01.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.653+0000 7fde82000640 1 -- 172.21.15.57:0/256426442 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde8401a070 con 0x7fde8c1601a0 2024-03-27T10:01:01.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.653+0000 7fde82000640 1 -- 172.21.15.57:0/256426442 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde8400d860 con 0x7fde8c1601a0 2024-03-27T10:01:01.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.653+0000 7fde82000640 1 -- 172.21.15.57:0/256426442 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde8400dc50 con 0x7fde8c1601a0 2024-03-27T10:01:01.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.653+0000 7fde8b200640 1 -- 172.21.15.57:0/256426442 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde8c1432c0 con 0x7fde8c1601a0 2024-03-27T10:01:01.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.653+0000 7fde8b200640 1 -- 172.21.15.57:0/256426442 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde8c143880 con 0x7fde8c1601a0 2024-03-27T10:01:01.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.654+0000 7fde8b200640 1 -- 172.21.15.57:0/256426442 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde8c068540 con 0x7fde8c1601a0 2024-03-27T10:01:01.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.655+0000 7fde82000640 1 -- 172.21.15.57:0/256426442 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fde8401d070 con 0x7fde8c1601a0 2024-03-27T10:01:01.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.657+0000 7fde82000640 1 --2- 172.21.15.57:0/256426442 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fde6c06c530 0x7fde6c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:01.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.657+0000 7fde82000640 1 -- 172.21.15.57:0/256426442 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fde8408c440 con 0x7fde8c1601a0 2024-03-27T10:01:01.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.657+0000 7fde89e00640 1 --2- 172.21.15.57:0/256426442 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fde6c06c530 0x7fde6c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:01.646 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.658+0000 7fde89e00640 1 --2- 172.21.15.57:0/256426442 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fde6c06c530 0x7fde6c06e9f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fde7c005880 tx=0x7fde7c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:01.649 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.661+0000 7fde82000640 1 -- 172.21.15.57:0/256426442 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7fde8405a680 con 0x7fde8c1601a0 2024-03-27T10:01:01.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.871+0000 7fde8b200640 1 -- 172.21.15.57:0/256426442 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fde8c0cf490 con 0x7fde8c1601a0 2024-03-27T10:01:01.860 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.872+0000 7fde82000640 1 -- 172.21.15.57:0/256426442 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) ==== 103+0+11 (secure 0 0 0) 0x7fde84059f80 con 0x7fde8c1601a0 2024-03-27T10:01:01.860 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2024-03-27T10:01:01.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.875+0000 7fde8b200640 1 -- 172.21.15.57:0/256426442 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fde6c06c530 msgr2=0x7fde6c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:01.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.875+0000 7fde8b200640 1 --2- 172.21.15.57:0/256426442 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fde6c06c530 0x7fde6c06e9f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fde7c005880 tx=0x7fde7c009040 comp rx=0 tx=0).stop 2024-03-27T10:01:01.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.875+0000 7fde8b200640 1 -- 172.21.15.57:0/256426442 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde8c1601a0 msgr2=0x7fde8c15e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:01.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.875+0000 7fde8b200640 1 --2- 172.21.15.57:0/256426442 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde8c1601a0 0x7fde8c15e210 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fde8400cef0 tx=0x7fde8400a710 comp rx=0 tx=0).stop 2024-03-27T10:01:01.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.875+0000 7fde8b200640 1 -- 172.21.15.57:0/256426442 shutdown_connections 2024-03-27T10:01:01.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.875+0000 7fde8b200640 1 --2- 172.21.15.57:0/256426442 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fde8c1601a0 0x7fde8c15e210 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:01.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.875+0000 7fde8b200640 1 --2- 172.21.15.57:0/256426442 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fde8c1458e0 0x7fde8c140780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:01.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.875+0000 7fde8b200640 1 --2- 172.21.15.57:0/256426442 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fde6c06c530 0x7fde6c06e9f0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:01.865 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.875+0000 7fde8b200640 1 --2- 172.21.15.57:0/256426442 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fde8c0ce720 0x7fde8c140240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:01.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.875+0000 7fde8b200640 1 -- 172.21.15.57:0/256426442 >> 172.21.15.57:0/256426442 conn(0x7fde8c0cfb40 msgr2=0x7fde8c06d070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:01.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.876+0000 7fde8b200640 1 -- 172.21.15.57:0/256426442 shutdown_connections 2024-03-27T10:01:01.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:01.876+0000 7fde8b200640 1 -- 172.21.15.57:0/256426442 wait complete. 2024-03-27T10:01:01.884 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-27T10:01:02.107 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.119+0000 7fca15c00640 1 Processor -- start 2024-03-27T10:01:02.107 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.119+0000 7fca15c00640 1 -- start start 2024-03-27T10:01:02.109 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.120+0000 7fca15c00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fca101455a0 0x7fca10071010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:02.109 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.120+0000 7fca15c00640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca100cf570 con 0x7fca100cecd0 2024-03-27T10:01:02.109 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.120+0000 7fca15c00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca100cf290 con 0x7fca10071550 2024-03-27T10:01:02.109 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.120+0000 7fca15c00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7fca1006f2d0 con 0x7fca101455a0 2024-03-27T10:01:02.109 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.121+0000 7fca15200640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fca100cecd0 0x7fca1015c3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:39652/0 (socket says 172.21.15.57:39652) 2024-03-27T10:01:02.109 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.121+0000 7fca15200640 1 -- 172.21.15.57:0/3744861082 learned_addr learned my addr 172.21.15.57:0/3744861082 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T10:01:02.111 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.121+0000 7fca0fe00640 1 --2- 172.21.15.57:0/3744861082 >> v2:172.21.15.118:3300/0 conn(0x7fca101455a0 0x7fca10071010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:02.111 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.121+0000 7fca0f400640 1 -- 172.21.15.57:0/3744861082 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3787727299 0 0) 0x7fca100cf570 con 0x7fca100cecd0 2024-03-27T10:01:02.112 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.121+0000 7fca0f400640 1 -- 172.21.15.57:0/3744861082 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc9f4003520 con 0x7fca100cecd0 2024-03-27T10:01:02.112 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.122+0000 7fca0f400640 1 -- 172.21.15.57:0/3744861082 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2823576599 0 0) 0x7fc9f4003520 con 0x7fca100cecd0 2024-03-27T10:01:02.112 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.122+0000 7fca0f400640 1 -- 172.21.15.57:0/3744861082 >> v2:172.21.15.118:3300/0 conn(0x7fca101455a0 msgr2=0x7fca10071010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:01:02.112 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.122+0000 7fca0f400640 1 --2- 172.21.15.57:0/3744861082 >> v2:172.21.15.118:3300/0 conn(0x7fca101455a0 0x7fca10071010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:02.112 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.122+0000 7fca0f400640 1 -- 172.21.15.57:0/3744861082 >> v1:172.21.15.118:6789/0 conn(0x7fca10071550 legacy=0x7fca1006dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:01:02.112 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.122+0000 7fca0f400640 1 -- 172.21.15.57:0/3744861082 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca1006d300 con 0x7fca100cecd0 2024-03-27T10:01:02.112 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.122+0000 7fca0f400640 1 -- 172.21.15.57:0/3744861082 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4227751516 0 0) 0x7fca080019f0 con 0x7fca100cecd0 2024-03-27T10:01:02.112 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.122+0000 7fca0f400640 1 -- 172.21.15.57:0/3744861082 >> v1:172.21.15.57:6789/0 conn(0x7fca100cecd0 legacy=0x7fca1015c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:02.112 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.122+0000 7fca0f400640 1 --2- 172.21.15.57:0/3744861082 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9f40039b0 0x7fc9f4003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:02.112 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.122+0000 7fca0f400640 1 --2- 172.21.15.57:0/3744861082 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc9f4004800 0x7fc9f4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:02.112 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.122+0000 7fca0f400640 1 --2- 172.21.15.57:0/3744861082 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc9f40051c0 0x7fc9f400fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:02.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.122+0000 7fca0f400640 1 -- 172.21.15.57:0/3744861082 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fca1006f2d0 con 0x7fc9f40039b0 2024-03-27T10:01:02.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.122+0000 7fca0f400640 1 -- 172.21.15.57:0/3744861082 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fc9f4010500 con 0x7fc9f4004800 2024-03-27T10:01:02.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.122+0000 7fca0f400640 1 -- 172.21.15.57:0/3744861082 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fc9f4010700 con 0x7fc9f40051c0 2024-03-27T10:01:02.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.122+0000 7fca0fe00640 1 --2- 172.21.15.57:0/3744861082 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9f40039b0 0x7fc9f4003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:02.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.122+0000 7fca07400640 1 --2- 172.21.15.57:0/3744861082 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc9f4004800 0x7fc9f4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:02.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.123+0000 7fca15200640 1 --2- 172.21.15.57:0/3744861082 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc9f40051c0 0x7fc9f400fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:02.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.123+0000 7fca0fe00640 1 -- 172.21.15.57:0/3744861082 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc9f40051c0 msgr2=0x7fc9f400fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:01:02.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.123+0000 7fca0fe00640 1 --2- 172.21.15.57:0/3744861082 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc9f40051c0 0x7fc9f400fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:02.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.123+0000 7fca0fe00640 1 -- 172.21.15.57:0/3744861082 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc9f4004800 msgr2=0x7fc9f4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:01:02.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.123+0000 7fca0fe00640 1 --2- 172.21.15.57:0/3744861082 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc9f4004800 0x7fc9f4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:02.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.123+0000 7fca0fe00640 1 -- 172.21.15.57:0/3744861082 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9f4003520 con 0x7fc9f40039b0 2024-03-27T10:01:02.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.123+0000 7fca15200640 1 --2- 172.21.15.57:0/3744861082 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc9f40051c0 0x7fc9f400fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T10:01:02.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.123+0000 7fca15200640 1 -- 172.21.15.57:0/3744861082 reap_dead start 2024-03-27T10:01:02.115 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.124+0000 7fca0fe00640 1 --2- 172.21.15.57:0/3744861082 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9f40039b0 0x7fc9f4003db0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fca00009ac0 tx=0x7fc9f4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dcf95fd97c31820 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:02.115 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.124+0000 7fca0f400640 1 -- 172.21.15.57:0/3744861082 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca00039070 con 0x7fc9f40039b0 2024-03-27T10:01:02.115 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.124+0000 7fca0f400640 1 -- 172.21.15.57:0/3744861082 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca0002c6b0 con 0x7fc9f40039b0 2024-03-27T10:01:02.115 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.124+0000 7fca0f400640 1 -- 172.21.15.57:0/3744861082 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca00009690 con 0x7fc9f40039b0 2024-03-27T10:01:02.115 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.125+0000 7fca15c00640 1 -- 172.21.15.57:0/3744861082 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9f40039b0 msgr2=0x7fc9f4003db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:02.115 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.125+0000 7fca15c00640 1 --2- 172.21.15.57:0/3744861082 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9f40039b0 0x7fc9f4003db0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fca00009ac0 tx=0x7fc9f4005830 comp rx=0 tx=0).stop 2024-03-27T10:01:02.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.125+0000 7fca15c00640 1 -- 172.21.15.57:0/3744861082 shutdown_connections 2024-03-27T10:01:02.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.125+0000 7fca15c00640 1 --2- 172.21.15.57:0/3744861082 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9f40039b0 0x7fc9f4003db0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:02.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.125+0000 7fca15c00640 1 -- 172.21.15.57:0/3744861082 >> 172.21.15.57:0/3744861082 conn(0x7fca100b1770 msgr2=0x7fca100b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:02.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.125+0000 7fca15c00640 1 -- 172.21.15.57:0/3744861082 shutdown_connections 2024-03-27T10:01:02.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.125+0000 7fca15c00640 1 -- 172.21.15.57:0/3744861082 wait complete. 2024-03-27T10:01:02.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.127+0000 7fca15c00640 1 Processor -- start 2024-03-27T10:01:02.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.127+0000 7fca15c00640 1 -- start start 2024-03-27T10:01:02.118 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.128+0000 7fca15c00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9f40039b0 0x7fca10153070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:02.118 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.128+0000 7fca15c00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fca10153e70 0x7fca101542f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:02.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.128+0000 7fca15c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca10155ae0 0x7fca10155f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:02.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.128+0000 7fca15c00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fca10145980 con 0x7fc9f40039b0 2024-03-27T10:01:02.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.128+0000 7fca15c00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fca1006d8c0 con 0x7fca10155ae0 2024-03-27T10:01:02.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.128+0000 7fca15c00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fca10071010 con 0x7fca10153e70 2024-03-27T10:01:02.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.128+0000 7fca0fe00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9f40039b0 0x7fca10153070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:02.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.128+0000 7fca0fe00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9f40039b0 0x7fca10153070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56600/0 (socket says 172.21.15.57:56600) 2024-03-27T10:01:02.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.128+0000 7fca0fe00640 1 -- 172.21.15.57:0/2948466884 learned_addr learned my addr 172.21.15.57:0/2948466884 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:01:02.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.129+0000 7fca15200640 1 --2- 172.21.15.57:0/2948466884 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca10155ae0 0x7fca10155f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:02.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.129+0000 7fca07400640 1 --2- 172.21.15.57:0/2948466884 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fca10153e70 0x7fca101542f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:02.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.129+0000 7fca0fe00640 1 -- 172.21.15.57:0/2948466884 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fca10153e70 msgr2=0x7fca101542f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:02.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.129+0000 7fca0fe00640 1 --2- 172.21.15.57:0/2948466884 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fca10153e70 0x7fca101542f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:02.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.129+0000 7fca0fe00640 1 -- 172.21.15.57:0/2948466884 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca10155ae0 msgr2=0x7fca10155f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:02.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.129+0000 7fca0fe00640 1 --2- 172.21.15.57:0/2948466884 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca10155ae0 0x7fca10155f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:02.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.129+0000 7fca0fe00640 1 -- 172.21.15.57:0/2948466884 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca10156a40 con 0x7fc9f40039b0 2024-03-27T10:01:02.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.129+0000 7fca15200640 1 --2- 172.21.15.57:0/2948466884 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca10155ae0 0x7fca10155f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T10:01:02.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.129+0000 7fca0fe00640 1 --2- 172.21.15.57:0/2948466884 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9f40039b0 0x7fca10153070 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fca00037040 tx=0x7fca00004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:02.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.129+0000 7fca0cc00640 1 -- 172.21.15.57:0/2948466884 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca00042020 con 0x7fc9f40039b0 2024-03-27T10:01:02.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.129+0000 7fca0cc00640 1 -- 172.21.15.57:0/2948466884 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca0003a040 con 0x7fc9f40039b0 2024-03-27T10:01:02.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.129+0000 7fca0cc00640 1 -- 172.21.15.57:0/2948466884 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca00039070 con 0x7fc9f40039b0 2024-03-27T10:01:02.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.129+0000 7fca15c00640 1 -- 172.21.15.57:0/2948466884 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca10156d20 con 0x7fc9f40039b0 2024-03-27T10:01:02.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.130+0000 7fca15c00640 1 -- 172.21.15.57:0/2948466884 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca1013e820 con 0x7fc9f40039b0 2024-03-27T10:01:02.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.131+0000 7fca15c00640 1 -- 172.21.15.57:0/2948466884 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca10068540 con 0x7fc9f40039b0 2024-03-27T10:01:02.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.132+0000 7fca0cc00640 1 -- 172.21.15.57:0/2948466884 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fca00045020 con 0x7fc9f40039b0 2024-03-27T10:01:02.121 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.133+0000 7fca0cc00640 1 --2- 172.21.15.57:0/2948466884 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fc9ec06c530 0x7fc9ec06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:02.121 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.133+0000 7fca0cc00640 1 -- 172.21.15.57:0/2948466884 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fca000acf70 con 0x7fc9f40039b0 2024-03-27T10:01:02.121 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.133+0000 7fca07400640 1 --2- 172.21.15.57:0/2948466884 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fc9ec06c530 0x7fc9ec06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:02.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.134+0000 7fca07400640 1 --2- 172.21.15.57:0/2948466884 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fc9ec06c530 0x7fc9ec06e9f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc9f8007fd0 tx=0x7fc9f8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:02.126 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.138+0000 7fca0cc00640 1 -- 172.21.15.57:0/2948466884 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7fca0004c070 con 0x7fc9f40039b0 2024-03-27T10:01:02.345 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.356+0000 7fca15c00640 1 -- 172.21.15.57:0/2948466884 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fca100ccc80 con 0x7fc9f40039b0 2024-03-27T10:01:02.345 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.356+0000 7fca0cc00640 1 -- 172.21.15.57:0/2948466884 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) ==== 80+0+0 (secure 0 0 0) 0x7fca0007b0f0 con 0x7fc9f40039b0 2024-03-27T10:01:02.346 INFO:teuthology.orchestra.run.smithi057.stderr:listed 0 entries 2024-03-27T10:01:02.349 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.359+0000 7fca15c00640 1 -- 172.21.15.57:0/2948466884 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fc9ec06c530 msgr2=0x7fc9ec06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:02.349 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.359+0000 7fca15c00640 1 --2- 172.21.15.57:0/2948466884 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fc9ec06c530 0x7fc9ec06e9f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc9f8007fd0 tx=0x7fc9f8009040 comp rx=0 tx=0).stop 2024-03-27T10:01:02.349 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.359+0000 7fca15c00640 1 -- 172.21.15.57:0/2948466884 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9f40039b0 msgr2=0x7fca10153070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:02.349 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.359+0000 7fca15c00640 1 --2- 172.21.15.57:0/2948466884 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9f40039b0 0x7fca10153070 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fca00037040 tx=0x7fca00004730 comp rx=0 tx=0).stop 2024-03-27T10:01:02.349 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.359+0000 7fca15c00640 1 -- 172.21.15.57:0/2948466884 shutdown_connections 2024-03-27T10:01:02.349 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.359+0000 7fca15c00640 1 --2- 172.21.15.57:0/2948466884 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fc9ec06c530 0x7fc9ec06e9f0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:02.349 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.359+0000 7fca15c00640 1 --2- 172.21.15.57:0/2948466884 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fca10155ae0 0x7fca10155f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:02.349 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.359+0000 7fca15c00640 1 --2- 172.21.15.57:0/2948466884 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fca10153e70 0x7fca101542f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:02.349 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.359+0000 7fca15c00640 1 --2- 172.21.15.57:0/2948466884 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc9f40039b0 0x7fca10153070 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:02.349 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.359+0000 7fca15c00640 1 -- 172.21.15.57:0/2948466884 >> 172.21.15.57:0/2948466884 conn(0x7fca100b1770 msgr2=0x7fca100cfb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:02.349 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.360+0000 7fca15c00640 1 -- 172.21.15.57:0/2948466884 shutdown_connections 2024-03-27T10:01:02.349 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.360+0000 7fca15c00640 1 -- 172.21.15.57:0/2948466884 wait complete. 2024-03-27T10:01:02.369 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-03-27T10:01:02.369 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-27T10:01:02.425 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-27T10:01:02.658 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.668+0000 7fdda5a00640 1 Processor -- start 2024-03-27T10:01:02.658 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.669+0000 7fdda5a00640 1 -- start start 2024-03-27T10:01:02.659 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.670+0000 7fdda5a00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fdda015e510 0x7fdda00d28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:02.659 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.670+0000 7fdda5a00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fdda00d2de0 0x7fdda00d3db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:02.659 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.670+0000 7fdda5a00640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdda00d47a0 con 0x7fdda00d42f0 2024-03-27T10:01:02.659 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.670+0000 7fdda5a00640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7fdda015e8f0 con 0x7fdda015e510 2024-03-27T10:01:02.660 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.670+0000 7fdda5a00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7fdda00b4110 con 0x7fdda00d2de0 2024-03-27T10:01:02.660 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.671+0000 7fdd9ea00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fdda015e510 0x7fdda00d28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:02.660 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.671+0000 7fdd9f400640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fdda00d42f0 0x7fdda00d0af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:39662/0 (socket says 172.21.15.57:39662) 2024-03-27T10:01:02.660 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.671+0000 7fdd9e000640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fdda00d2de0 0x7fdda00d3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:02.661 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.671+0000 7fdd9f400640 1 -- 172.21.15.57:0/2543399581 learned_addr learned my addr 172.21.15.57:0/2543399581 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T10:01:02.661 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.671+0000 7fdd9ea00640 1 -- 172.21.15.57:0/2543399581 >> v2:172.21.15.118:3300/0 conn(0x7fdda00d2de0 msgr2=0x7fdda00d3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:01:02.661 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.671+0000 7fdd9ea00640 1 --2- 172.21.15.57:0/2543399581 >> v2:172.21.15.118:3300/0 conn(0x7fdda00d2de0 0x7fdda00d3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:02.661 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.671+0000 7fdd9ea00640 1 -- 172.21.15.57:0/2543399581 >> v1:172.21.15.57:6789/0 conn(0x7fdda00d42f0 legacy=0x7fdda00d0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:02.661 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.671+0000 7fdd9ea00640 1 -- 172.21.15.57:0/2543399581 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdda00b43f0 con 0x7fdda015e510 2024-03-27T10:01:02.661 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.672+0000 7fdd9ea00640 1 --2- 172.21.15.57:0/2543399581 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdda015e510 0x7fdda00d28a0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fdda00d3740 tx=0x7fdd9002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5a0cce409575186 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:02.662 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.673+0000 7fdd9d600640 1 -- 172.21.15.57:0/2543399581 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd900315a0 con 0x7fdda015e510 2024-03-27T10:01:02.662 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.673+0000 7fdd9d600640 1 -- 172.21.15.57:0/2543399581 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd90037070 con 0x7fdda015e510 2024-03-27T10:01:02.662 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.673+0000 7fdd9d600640 1 -- 172.21.15.57:0/2543399581 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd90031960 con 0x7fdda015e510 2024-03-27T10:01:02.663 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.673+0000 7fdda5a00640 1 -- 172.21.15.57:0/2543399581 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdda015e510 msgr2=0x7fdda00d28a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:02.663 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.673+0000 7fdda5a00640 1 --2- 172.21.15.57:0/2543399581 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdda015e510 0x7fdda00d28a0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fdda00d3740 tx=0x7fdd9002b840 comp rx=0 tx=0).stop 2024-03-27T10:01:02.663 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.674+0000 7fdda5a00640 1 -- 172.21.15.57:0/2543399581 shutdown_connections 2024-03-27T10:01:02.663 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.674+0000 7fdda5a00640 1 --2- 172.21.15.57:0/2543399581 >> v2:172.21.15.118:3300/0 conn(0x7fdda00d2de0 0x7fdda00d3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:02.663 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.674+0000 7fdda5a00640 1 --2- 172.21.15.57:0/2543399581 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdda015e510 0x7fdda00d28a0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:02.663 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.674+0000 7fdda5a00640 1 -- 172.21.15.57:0/2543399581 >> 172.21.15.57:0/2543399581 conn(0x7fdda0067c00 msgr2=0x7fdda009d440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:02.663 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.674+0000 7fdda5a00640 1 -- 172.21.15.57:0/2543399581 shutdown_connections 2024-03-27T10:01:02.663 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.674+0000 7fdda5a00640 1 -- 172.21.15.57:0/2543399581 wait complete. 2024-03-27T10:01:02.665 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.676+0000 7fdda5a00640 1 Processor -- start 2024-03-27T10:01:02.665 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.676+0000 7fdda5a00640 1 -- start start 2024-03-27T10:01:02.666 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.677+0000 7fdda5a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdda00d2de0 0x7fdda00b97d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:02.667 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.677+0000 7fdda5a00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdda00d42f0 0x7fdda00c9d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:02.667 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.677+0000 7fdda5a00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdda015e510 0x7fdda01537c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:02.667 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.677+0000 7fdda5a00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fdda00b4c90 con 0x7fdda015e510 2024-03-27T10:01:02.667 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.677+0000 7fdda5a00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fdda00b49b0 con 0x7fdda00d2de0 2024-03-27T10:01:02.667 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.677+0000 7fdda5a00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fdda00b3d70 con 0x7fdda00d42f0 2024-03-27T10:01:02.667 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.678+0000 7fdd9f400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdda015e510 0x7fdda01537c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:02.667 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.678+0000 7fdd9f400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdda015e510 0x7fdda01537c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56616/0 (socket says 172.21.15.57:56616) 2024-03-27T10:01:02.667 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.678+0000 7fdd9f400640 1 -- 172.21.15.57:0/3447573569 learned_addr learned my addr 172.21.15.57:0/3447573569 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:01:02.668 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.678+0000 7fdd9ea00640 1 --2- 172.21.15.57:0/3447573569 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdda00d2de0 0x7fdda00b97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:02.668 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.678+0000 7fdd9e000640 1 --2- 172.21.15.57:0/3447573569 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdda00d42f0 0x7fdda00c9d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:02.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.678+0000 7fdd9f400640 1 -- 172.21.15.57:0/3447573569 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdda00d42f0 msgr2=0x7fdda00c9d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:02.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.678+0000 7fdd9f400640 1 --2- 172.21.15.57:0/3447573569 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdda00d42f0 0x7fdda00c9d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:02.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.678+0000 7fdd9f400640 1 -- 172.21.15.57:0/3447573569 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdda00d2de0 msgr2=0x7fdda00b97d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:02.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.678+0000 7fdd9f400640 1 --2- 172.21.15.57:0/3447573569 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdda00d2de0 0x7fdda00b97d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:02.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.678+0000 7fdd9f400640 1 -- 172.21.15.57:0/3447573569 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdda01f4150 con 0x7fdda015e510 2024-03-27T10:01:02.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.678+0000 7fdd9ea00640 1 --2- 172.21.15.57:0/3447573569 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdda00d2de0 0x7fdda00b97d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T10:01:02.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.678+0000 7fdd9f400640 1 --2- 172.21.15.57:0/3447573569 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdda015e510 0x7fdda01537c0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fdd9800c9f0 tx=0x7fdd9800ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:02.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.679+0000 7fdd96a00640 1 -- 172.21.15.57:0/3447573569 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd98017070 con 0x7fdda015e510 2024-03-27T10:01:02.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.679+0000 7fdd96a00640 1 -- 172.21.15.57:0/3447573569 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd9800ab70 con 0x7fdda015e510 2024-03-27T10:01:02.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.679+0000 7fdd96a00640 1 -- 172.21.15.57:0/3447573569 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd98012400 con 0x7fdda015e510 2024-03-27T10:01:02.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.679+0000 7fdda5a00640 1 -- 172.21.15.57:0/3447573569 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdda00ca260 con 0x7fdda015e510 2024-03-27T10:01:02.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.679+0000 7fdda5a00640 1 -- 172.21.15.57:0/3447573569 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdda00ca7e0 con 0x7fdda015e510 2024-03-27T10:01:02.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.680+0000 7fdda5a00640 1 -- 172.21.15.57:0/3447573569 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdda0068c50 con 0x7fdda015e510 2024-03-27T10:01:02.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.681+0000 7fdd96a00640 1 -- 172.21.15.57:0/3447573569 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fdd9801a070 con 0x7fdda015e510 2024-03-27T10:01:02.671 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.682+0000 7fdd96a00640 1 --2- 172.21.15.57:0/3447573569 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fdd7c06c560 0x7fdd7c06ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:02.671 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.682+0000 7fdd96a00640 1 -- 172.21.15.57:0/3447573569 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fdd9808b640 con 0x7fdda015e510 2024-03-27T10:01:02.671 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.682+0000 7fdd9ea00640 1 --2- 172.21.15.57:0/3447573569 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fdd7c06c560 0x7fdd7c06ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:02.672 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.683+0000 7fdd9ea00640 1 --2- 172.21.15.57:0/3447573569 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fdd7c06c560 0x7fdd7c06ea20 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fdd90036000 tx=0x7fdd90008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:02.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.687+0000 7fdd96a00640 1 -- 172.21.15.57:0/3447573569 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7fdda00d47a0 con 0x7fdda015e510 2024-03-27T10:01:02.881 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.892+0000 7fdda5a00640 1 -- 172.21.15.57:0/3447573569 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdda00c7580 con 0x7fdda015e510 2024-03-27T10:01:02.885 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.894+0000 7fdd96a00640 1 -- 172.21.15.57:0/3447573569 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) ==== 74+0+18888 (secure 0 0 0) 0x7fdd98059200 con 0x7fdda015e510 2024-03-27T10:01:02.886 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:01:02.886 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":28,"fsid":"7ac43f86-2c16-4a97-98fb-715d3cebc75c","created":"2024-03-27T09:59:04.033417+0000","modified":"2024-03-27T10:00:10.462391+0000","last_up_change":"2024-03-27T09:59:16.969624+0000","last_in_change":"2024-03-27T09:59:07.421690+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-27T09:59:17.253008+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-27T09:59:26.690365+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-27T09:59:27.559059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-27T09:59:31.187596+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"47b44362-7302-4f2a-b735-582c6c3850cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6801","nonce":2020036298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6803","nonce":2020036298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6807","nonce":2020036298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6805","nonce":2020036298}]},"public_addr":"172.21.15.57:6801/2020036298","cluster_addr":"172.21.15.57:6803/2020036298","heartbeat_back_addr":"172.21.15.57:6807/2020036298","heartbeat_front_addr":"172.21.15.57:6805/2020036298","state":["exists","up"]},{"osd":1,"uuid":"feaf96f0-9431-4188-9a09-da505b40e934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6809","nonce":3190929242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6811","nonce":3190929242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6815","nonce":3190929242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6813","nonce":3190929242}]},"public_addr":"172.21.15.57:6809/3190929242","cluster_addr":"172.21.15.57:6811/3190929242","heartbeat_back_addr":"172.21.15.57:6815/3190929242","heartbeat_front_addr":"172.21.15.57:6813/3190929242","state":["exists","up"]},{"osd":2,"uuid":"21e406e6-cfbc-4fe7-a816-e2420487c95d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6817","nonce":4065849973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6819","nonce":4065849973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6823","nonce":4065849973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6821","nonce":4065849973}]},"public_addr":"172.21.15.57:6817/4065849973","cluster_addr":"172.21.15.57:6819/4065849973","heartbeat_back_addr":"172.21.15.57:6823/4065849973","heartbeat_front_addr":"172.21.15.57:6821/4065849973","state":["exists","up"]},{"osd":3,"uuid":"a389af1d-76c4-4dfc-b215-f983f4931257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6825","nonce":158084809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6827","nonce":158084809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6831","nonce":158084809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6829","nonce":158084809}]},"public_addr":"172.21.15.57:6825/158084809","cluster_addr":"172.21.15.57:6827/158084809","heartbeat_back_addr":"172.21.15.57:6831/158084809","heartbeat_front_addr":"172.21.15.57:6829/158084809","state":["exists","up"]},{"osd":4,"uuid":"e9b05dca-557a-43ee-b43f-9ce5b7d28304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6823","nonce":108719401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6827","nonce":108719401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6831","nonce":108719401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6829","nonce":108719401}]},"public_addr":"172.21.15.118:6823/108719401","cluster_addr":"172.21.15.118:6827/108719401","heartbeat_back_addr":"172.21.15.118:6831/108719401","heartbeat_front_addr":"172.21.15.118:6829/108719401","state":["exists","up"]},{"osd":5,"uuid":"d968177d-44ff-499a-b00a-b147ed879253","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6817","nonce":2704605866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6819","nonce":2704605866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6826","nonce":2704605866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6822","nonce":2704605866}]},"public_addr":"172.21.15.118:6817/2704605866","cluster_addr":"172.21.15.118:6819/2704605866","heartbeat_back_addr":"172.21.15.118:6826/2704605866","heartbeat_front_addr":"172.21.15.118:6822/2704605866","state":["exists","up"]},{"osd":6,"uuid":"e8f98052-e6ad-4cfe-a4a9-0b17a434d54e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6801","nonce":1963659095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6803","nonce":1963659095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6807","nonce":1963659095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6805","nonce":1963659095}]},"public_addr":"172.21.15.118:6801/1963659095","cluster_addr":"172.21.15.118:6803/1963659095","heartbeat_back_addr":"172.21.15.118:6807/1963659095","heartbeat_front_addr":"172.21.15.118:6805/1963659095","state":["exists","up"]},{"osd":7,"uuid":"eccff987-8e51-4a63-845a-cf0a3196d7fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6809","nonce":1955879596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6811","nonce":1955879596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6815","nonce":1955879596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6813","nonce":1955879596}]},"public_addr":"172.21.15.118:6809/1955879596","cluster_addr":"172.21.15.118:6811/1955879596","heartbeat_back_addr":"172.21.15.118:6815/1955879596","heartbeat_front_addr":"172.21.15.118:6813/1955879596","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.721258+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.696610+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.777895+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.806769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.743259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.845687+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:13.020165+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.722294+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.e","mappings":[{"from":7,"to":1}]},{"pgid":"3.15","mappings":[{"from":3,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-27T10:01:02.887 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.897+0000 7fdda5a00640 1 -- 172.21.15.57:0/3447573569 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fdd7c06c560 msgr2=0x7fdd7c06ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:02.887 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.897+0000 7fdda5a00640 1 --2- 172.21.15.57:0/3447573569 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fdd7c06c560 0x7fdd7c06ea20 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fdd90036000 tx=0x7fdd90008030 comp rx=0 tx=0).stop 2024-03-27T10:01:02.887 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.897+0000 7fdda5a00640 1 -- 172.21.15.57:0/3447573569 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdda015e510 msgr2=0x7fdda01537c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:02.887 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.897+0000 7fdda5a00640 1 --2- 172.21.15.57:0/3447573569 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdda015e510 0x7fdda01537c0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fdd9800c9f0 tx=0x7fdd9800ceb0 comp rx=0 tx=0).stop 2024-03-27T10:01:02.887 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.897+0000 7fdda5a00640 1 -- 172.21.15.57:0/3447573569 shutdown_connections 2024-03-27T10:01:02.887 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.897+0000 7fdda5a00640 1 --2- 172.21.15.57:0/3447573569 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdda015e510 0x7fdda01537c0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:02.887 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.897+0000 7fdda5a00640 1 --2- 172.21.15.57:0/3447573569 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdda00d42f0 0x7fdda00c9d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:02.887 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.897+0000 7fdda5a00640 1 --2- 172.21.15.57:0/3447573569 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fdd7c06c560 0x7fdd7c06ea20 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:02.887 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.898+0000 7fdda5a00640 1 --2- 172.21.15.57:0/3447573569 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdda00d2de0 0x7fdda00b97d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:02.888 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.898+0000 7fdda5a00640 1 -- 172.21.15.57:0/3447573569 >> 172.21.15.57:0/3447573569 conn(0x7fdda0067c00 msgr2=0x7fdda00d0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:02.888 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.898+0000 7fdda5a00640 1 -- 172.21.15.57:0/3447573569 shutdown_connections 2024-03-27T10:01:02.888 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:02.898+0000 7fdda5a00640 1 -- 172.21.15.57:0/3447573569 wait complete. 2024-03-27T10:01:02.908 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-27T09:59:17.253008+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-27T09:59:26.690365+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-27T09:59:27.559059+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-27T09:59:31.187596+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-27T10:01:02.909 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-27T10:01:03.131 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.142+0000 7f5d04a00640 1 Processor -- start 2024-03-27T10:01:03.131 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.142+0000 7f5d04a00640 1 -- start start 2024-03-27T10:01:03.134 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.143+0000 7f5d04a00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f5d000b48f0 0x7f5d000d4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:03.134 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.143+0000 7f5d04a00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5d000b4cd0 0x7f5d00161e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:03.134 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.143+0000 7f5d04a00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5d00162360 0x7f5d000d08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:03.134 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.143+0000 7f5d04a00640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f5d000cea20 con 0x7f5d00162360 2024-03-27T10:01:03.134 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.143+0000 7f5d04a00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f5d000d2ec0 con 0x7f5d000b48f0 2024-03-27T10:01:03.134 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.143+0000 7f5d04a00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f5d00162c30 con 0x7f5d000b4cd0 2024-03-27T10:01:03.134 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.144+0000 7f5cff200640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5d00162360 0x7f5d000d08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:03.134 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.144+0000 7f5cff200640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5d00162360 0x7f5d000d08f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56618/0 (socket says 172.21.15.57:56618) 2024-03-27T10:01:03.134 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.144+0000 7f5cff200640 1 -- 172.21.15.57:0/3129494615 learned_addr learned my addr 172.21.15.57:0/3129494615 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:01:03.134 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.144+0000 7f5cfe800640 1 --2- 172.21.15.57:0/3129494615 >> v2:172.21.15.118:3300/0 conn(0x7f5d000b48f0 0x7f5d000d4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:03.135 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.144+0000 7f5cfde00640 1 --2- 172.21.15.57:0/3129494615 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5d000b4cd0 0x7f5d00161e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:03.135 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.145+0000 7f5cff200640 1 -- 172.21.15.57:0/3129494615 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5d000b4cd0 msgr2=0x7f5d00161e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:01:03.135 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.145+0000 7f5cff200640 1 --2- 172.21.15.57:0/3129494615 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5d000b4cd0 0x7f5d00161e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:03.135 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.145+0000 7f5cff200640 1 -- 172.21.15.57:0/3129494615 >> v2:172.21.15.118:3300/0 conn(0x7f5d000b48f0 msgr2=0x7f5d000d4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:01:03.135 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.145+0000 7f5cff200640 1 --2- 172.21.15.57:0/3129494615 >> v2:172.21.15.118:3300/0 conn(0x7f5d000b48f0 0x7f5d000d4ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:03.135 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.145+0000 7f5cff200640 1 -- 172.21.15.57:0/3129494615 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d000d2590 con 0x7f5d00162360 2024-03-27T10:01:03.136 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.146+0000 7f5cff200640 1 --2- 172.21.15.57:0/3129494615 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5d00162360 0x7f5d000d08f0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f5d0006bda0 tx=0x7f5cf802b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6a75a744fac39aa server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:03.136 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.146+0000 7f5cfd400640 1 -- 172.21.15.57:0/3129494615 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf80317c0 con 0x7f5d00162360 2024-03-27T10:01:03.136 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.146+0000 7f5cfd400640 1 -- 172.21.15.57:0/3129494615 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cf8037070 con 0x7f5d00162360 2024-03-27T10:01:03.136 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.146+0000 7f5cfd400640 1 -- 172.21.15.57:0/3129494615 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf8031b80 con 0x7f5d00162360 2024-03-27T10:01:03.136 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.147+0000 7f5d04a00640 1 -- 172.21.15.57:0/3129494615 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5d00162360 msgr2=0x7f5d000d08f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:03.136 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.147+0000 7f5d04a00640 1 --2- 172.21.15.57:0/3129494615 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5d00162360 0x7f5d000d08f0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f5d0006bda0 tx=0x7f5cf802b860 comp rx=0 tx=0).stop 2024-03-27T10:01:03.136 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.147+0000 7f5d04a00640 1 -- 172.21.15.57:0/3129494615 shutdown_connections 2024-03-27T10:01:03.137 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.147+0000 7f5d04a00640 1 --2- 172.21.15.57:0/3129494615 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5d00162360 0x7f5d000d08f0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:03.137 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.147+0000 7f5d04a00640 1 --2- 172.21.15.57:0/3129494615 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5d000b4cd0 0x7f5d00161e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:03.137 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.147+0000 7f5d04a00640 1 --2- 172.21.15.57:0/3129494615 >> v2:172.21.15.118:3300/0 conn(0x7f5d000b48f0 0x7f5d000d4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:03.137 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.147+0000 7f5d04a00640 1 -- 172.21.15.57:0/3129494615 >> 172.21.15.57:0/3129494615 conn(0x7f5d000d3fb0 msgr2=0x7f5d000d43c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:03.137 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.147+0000 7f5d04a00640 1 -- 172.21.15.57:0/3129494615 shutdown_connections 2024-03-27T10:01:03.137 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.147+0000 7f5d04a00640 1 -- 172.21.15.57:0/3129494615 wait complete. 2024-03-27T10:01:03.138 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.149+0000 7f5d04a00640 1 Processor -- start 2024-03-27T10:01:03.138 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.149+0000 7f5d04a00640 1 -- start start 2024-03-27T10:01:03.140 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.150+0000 7f5d04a00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5d000b48f0 0x7f5d0015cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:03.140 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.150+0000 7f5d04a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5d000b4cd0 0x7f5d000ccae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:03.140 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.150+0000 7f5d04a00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5d00162360 0x7f5d000b8550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:03.140 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.150+0000 7f5d04a00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f5d000b6e00 con 0x7f5d000b48f0 2024-03-27T10:01:03.140 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.150+0000 7f5d04a00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f5d000d2b50 con 0x7f5d000b4cd0 2024-03-27T10:01:03.140 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.150+0000 7f5d04a00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f5d000b6f80 con 0x7f5d00162360 2024-03-27T10:01:03.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.150+0000 7f5cfe800640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5d000b48f0 0x7f5d0015cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:03.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.150+0000 7f5cfe800640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5d000b48f0 0x7f5d0015cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56628/0 (socket says 172.21.15.57:56628) 2024-03-27T10:01:03.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.150+0000 7f5cfe800640 1 -- 172.21.15.57:0/3356598388 learned_addr learned my addr 172.21.15.57:0/3356598388 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:01:03.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.151+0000 7f5cfe800640 1 -- 172.21.15.57:0/3356598388 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5d00162360 msgr2=0x7f5d000b8550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:03.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.151+0000 7f5cfde00640 1 --2- 172.21.15.57:0/3356598388 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5d000b4cd0 0x7f5d000ccae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:03.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.151+0000 7f5cff200640 1 --2- 172.21.15.57:0/3356598388 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5d00162360 0x7f5d000b8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:03.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.151+0000 7f5cfe800640 1 --2- 172.21.15.57:0/3356598388 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5d00162360 0x7f5d000b8550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:03.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.151+0000 7f5cfe800640 1 -- 172.21.15.57:0/3356598388 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5d000b4cd0 msgr2=0x7f5d000ccae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:03.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.151+0000 7f5cfe800640 1 --2- 172.21.15.57:0/3356598388 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5d000b4cd0 0x7f5d000ccae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:03.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.151+0000 7f5cfe800640 1 -- 172.21.15.57:0/3356598388 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d0015b780 con 0x7f5d000b48f0 2024-03-27T10:01:03.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.151+0000 7f5cfde00640 1 --2- 172.21.15.57:0/3356598388 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5d000b4cd0 0x7f5d000ccae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T10:01:03.141 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.151+0000 7f5cfe800640 1 --2- 172.21.15.57:0/3356598388 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5d000b48f0 0x7f5d0015cb00 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f5ce800d800 tx=0x7f5ce800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:03.142 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.151+0000 7f5cf6a00640 1 -- 172.21.15.57:0/3356598388 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ce8018020 con 0x7f5d000b48f0 2024-03-27T10:01:03.142 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.152+0000 7f5cf6a00640 1 -- 172.21.15.57:0/3356598388 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ce80096a0 con 0x7f5d000b48f0 2024-03-27T10:01:03.142 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.152+0000 7f5cf6a00640 1 -- 172.21.15.57:0/3356598388 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ce8009a70 con 0x7f5d000b48f0 2024-03-27T10:01:03.142 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.152+0000 7f5d04a00640 1 -- 172.21.15.57:0/3356598388 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d0015ba60 con 0x7f5d000b48f0 2024-03-27T10:01:03.142 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.152+0000 7f5d04a00640 1 -- 172.21.15.57:0/3356598388 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d0015c020 con 0x7f5d000b48f0 2024-03-27T10:01:03.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.153+0000 7f5d04a00640 1 -- 172.21.15.57:0/3356598388 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d00068540 con 0x7f5d000b48f0 2024-03-27T10:01:03.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.154+0000 7f5cf6a00640 1 -- 172.21.15.57:0/3356598388 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f5ce801b020 con 0x7f5d000b48f0 2024-03-27T10:01:03.144 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.155+0000 7f5cf6a00640 1 --2- 172.21.15.57:0/3356598388 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f5cdc06c530 0x7f5cdc06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:03.144 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.155+0000 7f5cf6a00640 1 -- 172.21.15.57:0/3356598388 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f5ce808c100 con 0x7f5d000b48f0 2024-03-27T10:01:03.144 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.155+0000 7f5cfde00640 1 --2- 172.21.15.57:0/3356598388 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f5cdc06c530 0x7f5cdc06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:03.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.156+0000 7f5cfde00640 1 --2- 172.21.15.57:0/3356598388 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f5cdc06c530 0x7f5cdc06e9f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f5d000cd6e0 tx=0x7f5cf000b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:03.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.160+0000 7f5cf6a00640 1 -- 172.21.15.57:0/3356598388 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f5ce8022020 con 0x7f5d000b48f0 2024-03-27T10:01:03.352 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.362+0000 7f5d04a00640 1 -- 172.21.15.57:0/3356598388 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f5d0008e000 con 0x7f5d000b48f0 2024-03-27T10:01:03.353 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.364+0000 7f5cf6a00640 1 -- 172.21.15.57:0/3356598388 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) ==== 93+0+10 (secure 0 0 0) 0x7f5ce8059c30 con 0x7f5d000b48f0 2024-03-27T10:01:03.353 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2024-03-27T10:01:03.356 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.366+0000 7f5d04a00640 1 -- 172.21.15.57:0/3356598388 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f5cdc06c530 msgr2=0x7f5cdc06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:03.356 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.366+0000 7f5d04a00640 1 --2- 172.21.15.57:0/3356598388 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f5cdc06c530 0x7f5cdc06e9f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f5d000cd6e0 tx=0x7f5cf000b040 comp rx=0 tx=0).stop 2024-03-27T10:01:03.356 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.366+0000 7f5d04a00640 1 -- 172.21.15.57:0/3356598388 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5d000b48f0 msgr2=0x7f5d0015cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:03.356 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.366+0000 7f5d04a00640 1 --2- 172.21.15.57:0/3356598388 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5d000b48f0 0x7f5d0015cb00 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f5ce800d800 tx=0x7f5ce800dcc0 comp rx=0 tx=0).stop 2024-03-27T10:01:03.356 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.367+0000 7f5d04a00640 1 -- 172.21.15.57:0/3356598388 shutdown_connections 2024-03-27T10:01:03.356 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.367+0000 7f5d04a00640 1 --2- 172.21.15.57:0/3356598388 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5d00162360 0x7f5d000b8550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:03.357 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.367+0000 7f5d04a00640 1 --2- 172.21.15.57:0/3356598388 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f5cdc06c530 0x7f5cdc06e9f0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:03.357 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.367+0000 7f5d04a00640 1 --2- 172.21.15.57:0/3356598388 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5d000b4cd0 0x7f5d000ccae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:03.357 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.367+0000 7f5d04a00640 1 --2- 172.21.15.57:0/3356598388 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5d000b48f0 0x7f5d0015cb00 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:03.357 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.367+0000 7f5d04a00640 1 -- 172.21.15.57:0/3356598388 >> 172.21.15.57:0/3356598388 conn(0x7f5d000d3fb0 msgr2=0x7f5d0006cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:03.357 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.367+0000 7f5d04a00640 1 -- 172.21.15.57:0/3356598388 shutdown_connections 2024-03-27T10:01:03.357 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.367+0000 7f5d04a00640 1 -- 172.21.15.57:0/3356598388 wait complete. 2024-03-27T10:01:03.376 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-27T10:01:03.600 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.611+0000 7f93ba400640 1 Processor -- start 2024-03-27T10:01:03.601 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.612+0000 7f93ba400640 1 -- start start 2024-03-27T10:01:03.602 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.613+0000 7f93ba400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f93b4161950 0x7f93b40ceb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:03.603 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.613+0000 7f93ba400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f93b40cf040 0x7f93b40cf480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:03.603 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.613+0000 7f93ba400640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93b40cfe40 con 0x7f93b40d2760 2024-03-27T10:01:03.603 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.613+0000 7f93ba400640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f93b40cf9c0 con 0x7f93b4161950 2024-03-27T10:01:03.603 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.613+0000 7f93ba400640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f93b4161d30 con 0x7f93b40cf040 2024-03-27T10:01:03.603 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.614+0000 7f93b9a00640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f93b40d2760 0x7f93b40d2bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:39678/0 (socket says 172.21.15.57:39678) 2024-03-27T10:01:03.603 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.614+0000 7f93b9a00640 1 -- 172.21.15.57:0/1035830159 learned_addr learned my addr 172.21.15.57:0/1035830159 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T10:01:03.604 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.614+0000 7f93b9000640 1 --2- 172.21.15.57:0/1035830159 >> v2:172.21.15.118:3300/0 conn(0x7f93b4161950 0x7f93b40ceb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:03.604 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.614+0000 7f93abe00640 1 --2- 172.21.15.57:0/1035830159 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f93b40cf040 0x7f93b40cf480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:03.604 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.614+0000 7f93b3e00640 1 -- 172.21.15.57:0/1035830159 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1004222261 0 0) 0x7f93b40cfe40 con 0x7f93b40d2760 2024-03-27T10:01:03.604 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.614+0000 7f93b3e00640 1 -- 172.21.15.57:0/1035830159 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9394003520 con 0x7f93b40d2760 2024-03-27T10:01:03.604 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.615+0000 7f93b9000640 1 -- 172.21.15.57:0/1035830159 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f93b40cf040 msgr2=0x7f93b40cf480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:01:03.604 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.615+0000 7f93b9000640 1 --2- 172.21.15.57:0/1035830159 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f93b40cf040 0x7f93b40cf480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:03.604 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.615+0000 7f93b9000640 1 -- 172.21.15.57:0/1035830159 >> v1:172.21.15.57:6789/0 conn(0x7f93b40d2760 legacy=0x7f93b40d2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:03.604 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.615+0000 7f93b3e00640 1 -- 172.21.15.57:0/1035830159 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 36195044 0 0) 0x7f9394003520 con 0x7f93b40d2760 2024-03-27T10:01:03.604 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.615+0000 7f93b9000640 1 -- 172.21.15.57:0/1035830159 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93b40d0f10 con 0x7f93b4161950 2024-03-27T10:01:03.605 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.617+0000 7f93b9000640 1 --2- 172.21.15.57:0/1035830159 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f93b4161950 0x7f93b40ceb00 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f93a40097a0 tx=0x7f93a402b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1872f80d662af722 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:03.606 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.617+0000 7f93b3e00640 1 -- 172.21.15.57:0/1035830159 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93a4038070 con 0x7f93b4161950 2024-03-27T10:01:03.606 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.617+0000 7f93b3e00640 1 -- 172.21.15.57:0/1035830159 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93a4031500 con 0x7f93b4161950 2024-03-27T10:01:03.606 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.617+0000 7f93b3e00640 1 -- 172.21.15.57:0/1035830159 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93ac0019f0 con 0x7f93b4161950 2024-03-27T10:01:03.607 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.618+0000 7f93ba400640 1 -- 172.21.15.57:0/1035830159 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f93b4161950 msgr2=0x7f93b40ceb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:03.607 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.618+0000 7f93ba400640 1 --2- 172.21.15.57:0/1035830159 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f93b4161950 0x7f93b40ceb00 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f93a40097a0 tx=0x7f93a402b820 comp rx=0 tx=0).stop 2024-03-27T10:01:03.607 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.618+0000 7f93ba400640 1 -- 172.21.15.57:0/1035830159 shutdown_connections 2024-03-27T10:01:03.607 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.618+0000 7f93ba400640 1 --2- 172.21.15.57:0/1035830159 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f93b40cf040 0x7f93b40cf480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:03.607 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.618+0000 7f93ba400640 1 --2- 172.21.15.57:0/1035830159 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f93b4161950 0x7f93b40ceb00 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:03.607 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.618+0000 7f93ba400640 1 -- 172.21.15.57:0/1035830159 >> 172.21.15.57:0/1035830159 conn(0x7f93b40d3fc0 msgr2=0x7f93b40d43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:03.607 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.618+0000 7f93ba400640 1 -- 172.21.15.57:0/1035830159 shutdown_connections 2024-03-27T10:01:03.608 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.618+0000 7f93ba400640 1 -- 172.21.15.57:0/1035830159 wait complete. 2024-03-27T10:01:03.609 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.620+0000 7f93ba400640 1 Processor -- start 2024-03-27T10:01:03.609 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.620+0000 7f93ba400640 1 -- start start 2024-03-27T10:01:03.611 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.621+0000 7f93ba400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f93b40cf040 0x7f93b40ca5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:03.611 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.621+0000 7f93ba400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f93b40d2760 0x7f93b41f4f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:03.611 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.621+0000 7f93ba400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f93b4161950 0x7f93b40cd0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:03.611 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.621+0000 7f93ba400640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f93b40d1f60 con 0x7f93b40cf040 2024-03-27T10:01:03.611 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.621+0000 7f93ba400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f93b40d14d0 con 0x7f93b40d2760 2024-03-27T10:01:03.611 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.621+0000 7f93ba400640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f93b40d2240 con 0x7f93b4161950 2024-03-27T10:01:03.611 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.621+0000 7f93b9000640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f93b40cf040 0x7f93b40ca5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:03.611 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.621+0000 7f93b9000640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f93b40cf040 0x7f93b40ca5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56630/0 (socket says 172.21.15.57:56630) 2024-03-27T10:01:03.611 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.621+0000 7f93b9000640 1 -- 172.21.15.57:0/3214558759 learned_addr learned my addr 172.21.15.57:0/3214558759 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:01:03.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.622+0000 7f93abe00640 1 --2- 172.21.15.57:0/3214558759 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f93b40d2760 0x7f93b41f4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:03.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.622+0000 7f93b9a00640 1 --2- 172.21.15.57:0/3214558759 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f93b4161950 0x7f93b40cd0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:03.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.622+0000 7f93b9000640 1 -- 172.21.15.57:0/3214558759 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f93b4161950 msgr2=0x7f93b40cd0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:03.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.622+0000 7f93b9000640 1 --2- 172.21.15.57:0/3214558759 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f93b4161950 0x7f93b40cd0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:03.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.622+0000 7f93b9000640 1 -- 172.21.15.57:0/3214558759 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f93b40d2760 msgr2=0x7f93b41f4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:03.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.622+0000 7f93b9000640 1 --2- 172.21.15.57:0/3214558759 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f93b40d2760 0x7f93b41f4f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:03.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.622+0000 7f93b9000640 1 -- 172.21.15.57:0/3214558759 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93b40cc330 con 0x7f93b40cf040 2024-03-27T10:01:03.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.622+0000 7f93abe00640 1 --2- 172.21.15.57:0/3214558759 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f93b40d2760 0x7f93b41f4f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T10:01:03.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.622+0000 7f93b9a00640 1 --2- 172.21.15.57:0/3214558759 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f93b4161950 0x7f93b40cd0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T10:01:03.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.622+0000 7f93b9000640 1 --2- 172.21.15.57:0/3214558759 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f93b40cf040 0x7f93b40ca5b0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f93a40097a0 tx=0x7f93a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:03.613 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.622+0000 7f93b1600640 1 -- 172.21.15.57:0/3214558759 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93a4043070 con 0x7f93b40cf040 2024-03-27T10:01:03.613 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.622+0000 7f93b1600640 1 -- 172.21.15.57:0/3214558759 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93a403f870 con 0x7f93b40cf040 2024-03-27T10:01:03.613 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.622+0000 7f93b1600640 1 -- 172.21.15.57:0/3214558759 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93a4038040 con 0x7f93b40cf040 2024-03-27T10:01:03.613 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.622+0000 7f93ba400640 1 -- 172.21.15.57:0/3214558759 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93b40cc610 con 0x7f93b40cf040 2024-03-27T10:01:03.613 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.623+0000 7f93ba400640 1 -- 172.21.15.57:0/3214558759 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93b41f16e0 con 0x7f93b40cf040 2024-03-27T10:01:03.614 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.624+0000 7f93ba400640 1 -- 172.21.15.57:0/3214558759 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93b4068540 con 0x7f93b40cf040 2024-03-27T10:01:03.614 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.625+0000 7f93b1600640 1 -- 172.21.15.57:0/3214558759 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f93a4046070 con 0x7f93b40cf040 2024-03-27T10:01:03.615 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.626+0000 7f93b1600640 1 --2- 172.21.15.57:0/3214558759 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f939006c530 0x7f939006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:03.615 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.626+0000 7f93b1600640 1 -- 172.21.15.57:0/3214558759 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f93a40ad840 con 0x7f93b40cf040 2024-03-27T10:01:03.615 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.626+0000 7f93abe00640 1 --2- 172.21.15.57:0/3214558759 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f939006c530 0x7f939006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:03.616 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.627+0000 7f93abe00640 1 --2- 172.21.15.57:0/3214558759 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f939006c530 0x7f939006e9f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f93b415e880 tx=0x7f939c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:03.620 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.631+0000 7f93b1600640 1 -- 172.21.15.57:0/3214558759 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f93a4030070 con 0x7f93b40cf040 2024-03-27T10:01:03.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.840+0000 7f93ba400640 1 -- 172.21.15.57:0/3214558759 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f93b40b15c0 con 0x7f93b40cf040 2024-03-27T10:01:03.832 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.843+0000 7f93b1600640 1 -- 172.21.15.57:0/3214558759 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) ==== 104+0+11 (secure 0 0 0) 0x7f93a407bc10 con 0x7f93b40cf040 2024-03-27T10:01:03.832 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2024-03-27T10:01:03.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.846+0000 7f93ba400640 1 -- 172.21.15.57:0/3214558759 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f939006c530 msgr2=0x7f939006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:03.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.846+0000 7f93ba400640 1 --2- 172.21.15.57:0/3214558759 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f939006c530 0x7f939006e9f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f93b415e880 tx=0x7f939c008040 comp rx=0 tx=0).stop 2024-03-27T10:01:03.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.846+0000 7f93ba400640 1 -- 172.21.15.57:0/3214558759 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f93b40cf040 msgr2=0x7f93b40ca5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:03.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.846+0000 7f93ba400640 1 --2- 172.21.15.57:0/3214558759 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f93b40cf040 0x7f93b40ca5b0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f93a40097a0 tx=0x7f93a40046c0 comp rx=0 tx=0).stop 2024-03-27T10:01:03.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.846+0000 7f93ba400640 1 -- 172.21.15.57:0/3214558759 shutdown_connections 2024-03-27T10:01:03.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.846+0000 7f93ba400640 1 --2- 172.21.15.57:0/3214558759 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f93b4161950 0x7f93b40cd0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:03.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.846+0000 7f93ba400640 1 --2- 172.21.15.57:0/3214558759 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f939006c530 0x7f939006e9f0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:03.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.846+0000 7f93ba400640 1 --2- 172.21.15.57:0/3214558759 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f93b40d2760 0x7f93b41f4f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:03.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.846+0000 7f93ba400640 1 --2- 172.21.15.57:0/3214558759 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f93b40cf040 0x7f93b40ca5b0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:03.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.846+0000 7f93ba400640 1 -- 172.21.15.57:0/3214558759 >> 172.21.15.57:0/3214558759 conn(0x7f93b40d3fc0 msgr2=0x7f93b40b52a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:03.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.846+0000 7f93ba400640 1 -- 172.21.15.57:0/3214558759 shutdown_connections 2024-03-27T10:01:03.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:03.846+0000 7f93ba400640 1 -- 172.21.15.57:0/3214558759 wait complete. 2024-03-27T10:01:03.856 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-27T10:01:04.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.087+0000 7fe47b200640 1 Processor -- start 2024-03-27T10:01:04.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.087+0000 7fe47b200640 1 -- start start 2024-03-27T10:01:04.078 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.089+0000 7fe47b200640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fe47c06f120 0x7fe47c165d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:04.078 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.089+0000 7fe47b200640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe47c15b260 con 0x7fe47c15ae80 2024-03-27T10:01:04.078 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.089+0000 7fe47b200640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe47c0cde90 con 0x7fe47c0cd920 2024-03-27T10:01:04.078 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.089+0000 7fe47b200640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7fe47c0ceaa0 con 0x7fe47c06f120 2024-03-27T10:01:04.078 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.089+0000 7fe479e00640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fe47c15ae80 0x7fe47c0cbcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:39682/0 (socket says 172.21.15.57:39682) 2024-03-27T10:01:04.078 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.089+0000 7fe479e00640 1 -- 172.21.15.57:0/1840279519 learned_addr learned my addr 172.21.15.57:0/1840279519 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T10:01:04.080 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.090+0000 7fe47a800640 1 --2- 172.21.15.57:0/1840279519 >> v2:172.21.15.118:3300/0 conn(0x7fe47c06f120 0x7fe47c165d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:04.080 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.090+0000 7fe479400640 1 -- 172.21.15.57:0/1840279519 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 994681907 0 0) 0x7fe47c15b260 con 0x7fe47c15ae80 2024-03-27T10:01:04.081 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.090+0000 7fe479400640 1 -- 172.21.15.57:0/1840279519 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe45c005730 con 0x7fe47c15ae80 2024-03-27T10:01:04.081 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.090+0000 7fe479400640 1 -- 172.21.15.57:0/1840279519 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2898391479 0 0) 0x7fe45c005730 con 0x7fe47c15ae80 2024-03-27T10:01:04.081 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.090+0000 7fe479400640 1 -- 172.21.15.57:0/1840279519 >> v2:172.21.15.118:3300/0 conn(0x7fe47c06f120 msgr2=0x7fe47c165d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:01:04.081 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.090+0000 7fe479400640 1 --2- 172.21.15.57:0/1840279519 >> v2:172.21.15.118:3300/0 conn(0x7fe47c06f120 0x7fe47c165d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:04.081 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.090+0000 7fe479400640 1 -- 172.21.15.57:0/1840279519 >> v1:172.21.15.118:6789/0 conn(0x7fe47c0cd920 legacy=0x7fe47c06ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:04.081 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.090+0000 7fe479400640 1 -- 172.21.15.57:0/1840279519 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe47c0ce170 con 0x7fe47c15ae80 2024-03-27T10:01:04.081 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.090+0000 7fe479400640 1 -- 172.21.15.57:0/1840279519 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4227751516 0 0) 0x7fe46c001670 con 0x7fe47c15ae80 2024-03-27T10:01:04.081 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.090+0000 7fe479400640 1 -- 172.21.15.57:0/1840279519 >> v1:172.21.15.57:6789/0 conn(0x7fe47c15ae80 legacy=0x7fe47c0cbcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:04.081 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.090+0000 7fe479400640 1 --2- 172.21.15.57:0/1840279519 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe45c005bc0 0x7fe45c005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:04.081 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.090+0000 7fe479400640 1 --2- 172.21.15.57:0/1840279519 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe45c006a10 0x7fe45c006e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:04.081 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.090+0000 7fe479400640 1 --2- 172.21.15.57:0/1840279519 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe45c0073d0 0x7fe45c00dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:04.081 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.090+0000 7fe479400640 1 -- 172.21.15.57:0/1840279519 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fe47c0ceaa0 con 0x7fe45c0073d0 2024-03-27T10:01:04.081 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.090+0000 7fe479400640 1 -- 172.21.15.57:0/1840279519 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fe45c00e270 con 0x7fe45c005bc0 2024-03-27T10:01:04.081 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.090+0000 7fe479400640 1 -- 172.21.15.57:0/1840279519 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fe45c00e470 con 0x7fe45c006a10 2024-03-27T10:01:04.082 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.091+0000 7fe47a800640 1 --2- 172.21.15.57:0/1840279519 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe45c0073d0 0x7fe45c00dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:04.082 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.091+0000 7fe479e00640 1 --2- 172.21.15.57:0/1840279519 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe45c005bc0 0x7fe45c005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:04.082 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.091+0000 7fe473e00640 1 --2- 172.21.15.57:0/1840279519 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe45c006a10 0x7fe45c006e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:04.082 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.091+0000 7fe47a800640 1 -- 172.21.15.57:0/1840279519 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe45c006a10 msgr2=0x7fe45c006e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:01:04.082 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.091+0000 7fe47a800640 1 --2- 172.21.15.57:0/1840279519 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe45c006a10 0x7fe45c006e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:04.082 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.091+0000 7fe47a800640 1 -- 172.21.15.57:0/1840279519 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe45c005bc0 msgr2=0x7fe45c005fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:01:04.082 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.091+0000 7fe47a800640 1 --2- 172.21.15.57:0/1840279519 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe45c005bc0 0x7fe45c005fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:04.082 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.091+0000 7fe47a800640 1 -- 172.21.15.57:0/1840279519 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe45c005730 con 0x7fe45c0073d0 2024-03-27T10:01:04.082 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.091+0000 7fe473e00640 1 --2- 172.21.15.57:0/1840279519 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe45c006a10 0x7fe45c006e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T10:01:04.083 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.092+0000 7fe47a800640 1 -- 172.21.15.57:0/1840279519 reap_dead start 2024-03-27T10:01:04.083 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.092+0000 7fe47a800640 1 --2- 172.21.15.57:0/1840279519 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe45c0073d0 0x7fe45c00dbd0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fe474009f90 tx=0x7fe45c007a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7c00bcba3903ac4 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:04.084 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.093+0000 7fe479400640 1 -- 172.21.15.57:0/1840279519 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe474009c10 con 0x7fe45c0073d0 2024-03-27T10:01:04.084 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.093+0000 7fe479400640 1 -- 172.21.15.57:0/1840279519 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe47402cc20 con 0x7fe45c0073d0 2024-03-27T10:01:04.084 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.093+0000 7fe479400640 1 -- 172.21.15.57:0/1840279519 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe474003990 con 0x7fe45c0073d0 2024-03-27T10:01:04.084 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.093+0000 7fe47b200640 1 -- 172.21.15.57:0/1840279519 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe45c0073d0 msgr2=0x7fe45c00dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:04.084 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.093+0000 7fe47b200640 1 --2- 172.21.15.57:0/1840279519 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe45c0073d0 0x7fe45c00dbd0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fe474009f90 tx=0x7fe45c007a40 comp rx=0 tx=0).stop 2024-03-27T10:01:04.084 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.093+0000 7fe47b200640 1 -- 172.21.15.57:0/1840279519 shutdown_connections 2024-03-27T10:01:04.084 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.093+0000 7fe47b200640 1 --2- 172.21.15.57:0/1840279519 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe45c0073d0 0x7fe45c00dbd0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:04.084 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.093+0000 7fe47b200640 1 -- 172.21.15.57:0/1840279519 >> 172.21.15.57:0/1840279519 conn(0x7fe47c0cfb40 msgr2=0x7fe47c0cff20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:04.084 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.093+0000 7fe47b200640 1 -- 172.21.15.57:0/1840279519 shutdown_connections 2024-03-27T10:01:04.084 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.093+0000 7fe47b200640 1 -- 172.21.15.57:0/1840279519 wait complete. 2024-03-27T10:01:04.085 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.095+0000 7fe47b200640 1 Processor -- start 2024-03-27T10:01:04.085 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.095+0000 7fe47b200640 1 -- start start 2024-03-27T10:01:04.086 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.096+0000 7fe47b200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe45c0073d0 0x7fe47c0b3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:04.086 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.096+0000 7fe47b200640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe47c15dc20 0x7fe47c0b31c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:04.086 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.096+0000 7fe47b200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe47c0b3700 0x7fe47c157150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:04.086 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.096+0000 7fe47b200640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fe47c0cef30 con 0x7fe47c15dc20 2024-03-27T10:01:04.086 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.096+0000 7fe47b200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fe47c0ce730 con 0x7fe47c0b3700 2024-03-27T10:01:04.086 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.096+0000 7fe47b200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fe47c0b4940 con 0x7fe45c0073d0 2024-03-27T10:01:04.086 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.097+0000 7fe473e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe47c15dc20 0x7fe47c0b31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:04.086 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.097+0000 7fe473e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe47c15dc20 0x7fe47c0b31c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56640/0 (socket says 172.21.15.57:56640) 2024-03-27T10:01:04.086 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.097+0000 7fe473e00640 1 -- 172.21.15.57:0/3374249209 learned_addr learned my addr 172.21.15.57:0/3374249209 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:01:04.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.097+0000 7fe47a800640 1 --2- 172.21.15.57:0/3374249209 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe47c0b3700 0x7fe47c157150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:04.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.097+0000 7fe479e00640 1 --2- 172.21.15.57:0/3374249209 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe45c0073d0 0x7fe47c0b3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:04.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.097+0000 7fe473e00640 1 -- 172.21.15.57:0/3374249209 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe45c0073d0 msgr2=0x7fe47c0b3ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:04.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.097+0000 7fe473e00640 1 --2- 172.21.15.57:0/3374249209 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe45c0073d0 0x7fe47c0b3ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:04.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.097+0000 7fe473e00640 1 -- 172.21.15.57:0/3374249209 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe47c0b3700 msgr2=0x7fe47c157150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:04.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.097+0000 7fe473e00640 1 --2- 172.21.15.57:0/3374249209 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe47c0b3700 0x7fe47c157150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:04.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.097+0000 7fe473e00640 1 -- 172.21.15.57:0/3374249209 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe47c0b4380 con 0x7fe47c15dc20 2024-03-27T10:01:04.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.097+0000 7fe47a800640 1 --2- 172.21.15.57:0/3374249209 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe47c0b3700 0x7fe47c157150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T10:01:04.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.098+0000 7fe473e00640 1 --2- 172.21.15.57:0/3374249209 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe47c15dc20 0x7fe47c0b31c0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fe46400d7a0 tx=0x7fe46400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:04.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.098+0000 7fe472000640 1 -- 172.21.15.57:0/3374249209 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe464005270 con 0x7fe47c15dc20 2024-03-27T10:01:04.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.098+0000 7fe472000640 1 -- 172.21.15.57:0/3374249209 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe464017070 con 0x7fe47c15dc20 2024-03-27T10:01:04.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.098+0000 7fe472000640 1 -- 172.21.15.57:0/3374249209 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe46400b650 con 0x7fe47c15dc20 2024-03-27T10:01:04.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.098+0000 7fe47b200640 1 -- 172.21.15.57:0/3374249209 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe47c0b4660 con 0x7fe47c15dc20 2024-03-27T10:01:04.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.098+0000 7fe47b200640 1 -- 172.21.15.57:0/3374249209 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe47c0b2ca0 con 0x7fe47c15dc20 2024-03-27T10:01:04.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.099+0000 7fe47b200640 1 -- 172.21.15.57:0/3374249209 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe47c068540 con 0x7fe47c15dc20 2024-03-27T10:01:04.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.100+0000 7fe472000640 1 -- 172.21.15.57:0/3374249209 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fe46400b7f0 con 0x7fe47c15dc20 2024-03-27T10:01:04.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.101+0000 7fe472000640 1 --2- 172.21.15.57:0/3374249209 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fe45806c560 0x7fe45806ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:04.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.101+0000 7fe472000640 1 -- 172.21.15.57:0/3374249209 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fe46408b890 con 0x7fe47c15dc20 2024-03-27T10:01:04.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.101+0000 7fe479e00640 1 --2- 172.21.15.57:0/3374249209 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fe45806c560 0x7fe45806ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:04.091 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.102+0000 7fe479e00640 1 --2- 172.21.15.57:0/3374249209 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fe45806c560 0x7fe45806ea20 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe46c001050 tx=0x7fe46c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:04.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.106+0000 7fe472000640 1 -- 172.21.15.57:0/3374249209 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7fe464059a10 con 0x7fe47c15dc20 2024-03-27T10:01:04.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.309+0000 7fe47b200640 1 -- 172.21.15.57:0/3374249209 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fe47c06d290 con 0x7fe47c15dc20 2024-03-27T10:01:04.299 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.310+0000 7fe472000640 1 -- 172.21.15.57:0/3374249209 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) ==== 100+0+11 (secure 0 0 0) 0x7fe464001230 con 0x7fe47c15dc20 2024-03-27T10:01:04.299 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2024-03-27T10:01:04.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.312+0000 7fe47b200640 1 -- 172.21.15.57:0/3374249209 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fe45806c560 msgr2=0x7fe45806ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:04.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.312+0000 7fe47b200640 1 --2- 172.21.15.57:0/3374249209 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fe45806c560 0x7fe45806ea20 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe46c001050 tx=0x7fe46c009040 comp rx=0 tx=0).stop 2024-03-27T10:01:04.303 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.312+0000 7fe47b200640 1 -- 172.21.15.57:0/3374249209 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe47c15dc20 msgr2=0x7fe47c0b31c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:04.303 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.312+0000 7fe47b200640 1 --2- 172.21.15.57:0/3374249209 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe47c15dc20 0x7fe47c0b31c0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fe46400d7a0 tx=0x7fe46400dc60 comp rx=0 tx=0).stop 2024-03-27T10:01:04.303 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.313+0000 7fe47b200640 1 -- 172.21.15.57:0/3374249209 shutdown_connections 2024-03-27T10:01:04.303 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.313+0000 7fe47b200640 1 --2- 172.21.15.57:0/3374249209 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fe45806c560 0x7fe45806ea20 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:04.303 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.313+0000 7fe47b200640 1 --2- 172.21.15.57:0/3374249209 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe47c0b3700 0x7fe47c157150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:04.303 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.313+0000 7fe47b200640 1 --2- 172.21.15.57:0/3374249209 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe47c15dc20 0x7fe47c0b31c0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:04.303 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.313+0000 7fe47b200640 1 --2- 172.21.15.57:0/3374249209 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe45c0073d0 0x7fe47c0b3ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:04.303 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.313+0000 7fe47b200640 1 -- 172.21.15.57:0/3374249209 >> 172.21.15.57:0/3374249209 conn(0x7fe47c0cfb40 msgr2=0x7fe47c0ccfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:04.303 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.313+0000 7fe47b200640 1 -- 172.21.15.57:0/3374249209 shutdown_connections 2024-03-27T10:01:04.303 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.313+0000 7fe47b200640 1 -- 172.21.15.57:0/3374249209 wait complete. 2024-03-27T10:01:04.321 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-27T10:01:04.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.546+0000 7fdb9da00640 1 Processor -- start 2024-03-27T10:01:04.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.546+0000 7fdb9da00640 1 -- start start 2024-03-27T10:01:04.537 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.548+0000 7fdb9da00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fdb980aea20 0x7fdb9815d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:04.537 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.548+0000 7fdb9da00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fdb980acd60 0x7fdb980aee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:04.537 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.548+0000 7fdb9da00640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb980af340 con 0x7fdb980711b0 2024-03-27T10:01:04.537 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.548+0000 7fdb9da00640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7fdb980ad1d0 con 0x7fdb980acd60 2024-03-27T10:01:04.537 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.548+0000 7fdb9da00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7fdb9806df40 con 0x7fdb980aea20 2024-03-27T10:01:04.538 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.548+0000 7fdb96000640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fdb980acd60 0x7fdb980aee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:04.538 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.548+0000 7fdb97400640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fdb980711b0 0x7fdb980715b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:39694/0 (socket says 172.21.15.57:39694) 2024-03-27T10:01:04.538 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.548+0000 7fdb97400640 1 -- 172.21.15.57:0/2141087504 learned_addr learned my addr 172.21.15.57:0/2141087504 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T10:01:04.538 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.549+0000 7fdb96a00640 1 --2- 172.21.15.57:0/2141087504 >> v2:172.21.15.118:3300/0 conn(0x7fdb980aea20 0x7fdb9815d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:04.538 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.549+0000 7fdb96000640 1 -- 172.21.15.57:0/2141087504 >> v2:172.21.15.118:3300/0 conn(0x7fdb980aea20 msgr2=0x7fdb9815d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:01:04.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.549+0000 7fdb96000640 1 --2- 172.21.15.57:0/2141087504 >> v2:172.21.15.118:3300/0 conn(0x7fdb980aea20 0x7fdb9815d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:04.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.549+0000 7fdb96000640 1 -- 172.21.15.57:0/2141087504 >> v1:172.21.15.57:6789/0 conn(0x7fdb980711b0 legacy=0x7fdb980715b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:04.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.549+0000 7fdb96000640 1 -- 172.21.15.57:0/2141087504 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb9815c4c0 con 0x7fdb980acd60 2024-03-27T10:01:04.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.550+0000 7fdb96000640 1 --2- 172.21.15.57:0/2141087504 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb980acd60 0x7fdb980aee00 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fdb980753a0 tx=0x7fdb8402be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d3d1aca385fbdae server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:04.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.550+0000 7fdb95600640 1 -- 172.21.15.57:0/2141087504 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb84039070 con 0x7fdb980acd60 2024-03-27T10:01:04.539 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.550+0000 7fdb95600640 1 -- 172.21.15.57:0/2141087504 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb8402cbe0 con 0x7fdb980acd60 2024-03-27T10:01:04.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.550+0000 7fdb95600640 1 -- 172.21.15.57:0/2141087504 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb84034440 con 0x7fdb980acd60 2024-03-27T10:01:04.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.551+0000 7fdb9da00640 1 -- 172.21.15.57:0/2141087504 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb980acd60 msgr2=0x7fdb980aee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:04.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.551+0000 7fdb9da00640 1 --2- 172.21.15.57:0/2141087504 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb980acd60 0x7fdb980aee00 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fdb980753a0 tx=0x7fdb8402be30 comp rx=0 tx=0).stop 2024-03-27T10:01:04.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.551+0000 7fdb9da00640 1 -- 172.21.15.57:0/2141087504 shutdown_connections 2024-03-27T10:01:04.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.551+0000 7fdb9da00640 1 --2- 172.21.15.57:0/2141087504 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb980acd60 0x7fdb980aee00 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:04.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.551+0000 7fdb9da00640 1 --2- 172.21.15.57:0/2141087504 >> v2:172.21.15.118:3300/0 conn(0x7fdb980aea20 0x7fdb9815d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:04.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.551+0000 7fdb9da00640 1 -- 172.21.15.57:0/2141087504 >> 172.21.15.57:0/2141087504 conn(0x7fdb980b18a0 msgr2=0x7fdb980b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:04.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.551+0000 7fdb9da00640 1 -- 172.21.15.57:0/2141087504 shutdown_connections 2024-03-27T10:01:04.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.551+0000 7fdb9da00640 1 -- 172.21.15.57:0/2141087504 wait complete. 2024-03-27T10:01:04.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.553+0000 7fdb9da00640 1 Processor -- start 2024-03-27T10:01:04.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.553+0000 7fdb9da00640 1 -- start start 2024-03-27T10:01:04.544 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.554+0000 7fdb9da00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb980711b0 0x7fdb98152db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:04.544 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.554+0000 7fdb9da00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdb980acd60 0x7fdb9815e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:04.544 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.554+0000 7fdb9da00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdb980aea20 0x7fdb9814fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:04.544 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.554+0000 7fdb9da00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fdb98072bc0 con 0x7fdb980711b0 2024-03-27T10:01:04.544 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.554+0000 7fdb9da00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fdb980728e0 con 0x7fdb980aea20 2024-03-27T10:01:04.544 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.554+0000 7fdb9da00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fdb98072ea0 con 0x7fdb980acd60 2024-03-27T10:01:04.545 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.554+0000 7fdb96a00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb980711b0 0x7fdb98152db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:04.545 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.554+0000 7fdb96a00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb980711b0 0x7fdb98152db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56658/0 (socket says 172.21.15.57:56658) 2024-03-27T10:01:04.545 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.554+0000 7fdb96a00640 1 -- 172.21.15.57:0/1614105141 learned_addr learned my addr 172.21.15.57:0/1614105141 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:01:04.545 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.555+0000 7fdb97400640 1 --2- 172.21.15.57:0/1614105141 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdb980aea20 0x7fdb9814fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:04.545 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.555+0000 7fdb96000640 1 --2- 172.21.15.57:0/1614105141 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdb980acd60 0x7fdb9815e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:04.545 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.555+0000 7fdb96a00640 1 -- 172.21.15.57:0/1614105141 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdb980acd60 msgr2=0x7fdb9815e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:04.545 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.555+0000 7fdb96a00640 1 --2- 172.21.15.57:0/1614105141 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdb980acd60 0x7fdb9815e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:04.545 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.555+0000 7fdb96a00640 1 -- 172.21.15.57:0/1614105141 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdb980aea20 msgr2=0x7fdb9814fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:04.545 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.555+0000 7fdb96a00640 1 --2- 172.21.15.57:0/1614105141 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdb980aea20 0x7fdb9814fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:04.545 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.555+0000 7fdb96a00640 1 -- 172.21.15.57:0/1614105141 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb9815ef10 con 0x7fdb980711b0 2024-03-27T10:01:04.545 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.555+0000 7fdb96a00640 1 --2- 172.21.15.57:0/1614105141 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb980711b0 0x7fdb98152db0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fdb8800d620 tx=0x7fdb8800dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:04.546 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.555+0000 7fdb8ea00640 1 -- 172.21.15.57:0/1614105141 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb8800b620 con 0x7fdb980711b0 2024-03-27T10:01:04.546 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.556+0000 7fdb8ea00640 1 -- 172.21.15.57:0/1614105141 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb88019070 con 0x7fdb980711b0 2024-03-27T10:01:04.546 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.556+0000 7fdb9da00640 1 -- 172.21.15.57:0/1614105141 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb9815f770 con 0x7fdb980711b0 2024-03-27T10:01:04.546 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.556+0000 7fdb8ea00640 1 -- 172.21.15.57:0/1614105141 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb8800ba00 con 0x7fdb980711b0 2024-03-27T10:01:04.547 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.556+0000 7fdb9da00640 1 -- 172.21.15.57:0/1614105141 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb9814f420 con 0x7fdb980711b0 2024-03-27T10:01:04.547 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.557+0000 7fdb9da00640 1 -- 172.21.15.57:0/1614105141 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb980757d0 con 0x7fdb980711b0 2024-03-27T10:01:04.547 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.558+0000 7fdb8ea00640 1 -- 172.21.15.57:0/1614105141 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fdb8800bba0 con 0x7fdb980711b0 2024-03-27T10:01:04.548 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.559+0000 7fdb8ea00640 1 --2- 172.21.15.57:0/1614105141 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fdb7806c530 0x7fdb7806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:04.548 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.559+0000 7fdb8ea00640 1 -- 172.21.15.57:0/1614105141 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fdb8808bf90 con 0x7fdb980711b0 2024-03-27T10:01:04.548 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.559+0000 7fdb96000640 1 --2- 172.21.15.57:0/1614105141 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fdb7806c530 0x7fdb7806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:04.548 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.560+0000 7fdb96000640 1 --2- 172.21.15.57:0/1614105141 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fdb7806c530 0x7fdb7806e9f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fdb84036000 tx=0x7fdb84030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:04.552 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.563+0000 7fdb8ea00640 1 -- 172.21.15.57:0/1614105141 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7fdb8805a110 con 0x7fdb980711b0 2024-03-27T10:01:04.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.763+0000 7fdb9da00640 1 -- 172.21.15.57:0/1614105141 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fdb98068540 con 0x7fdb980711b0 2024-03-27T10:01:04.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.764+0000 7fdb8ea00640 1 -- 172.21.15.57:0/1614105141 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) ==== 103+0+11 (secure 0 0 0) 0x7fdb88059a10 con 0x7fdb980711b0 2024-03-27T10:01:04.754 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2024-03-27T10:01:04.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.767+0000 7fdb9da00640 1 -- 172.21.15.57:0/1614105141 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fdb7806c530 msgr2=0x7fdb7806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:04.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.767+0000 7fdb9da00640 1 --2- 172.21.15.57:0/1614105141 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fdb7806c530 0x7fdb7806e9f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fdb84036000 tx=0x7fdb84030000 comp rx=0 tx=0).stop 2024-03-27T10:01:04.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.767+0000 7fdb9da00640 1 -- 172.21.15.57:0/1614105141 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb980711b0 msgr2=0x7fdb98152db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:04.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.767+0000 7fdb9da00640 1 --2- 172.21.15.57:0/1614105141 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb980711b0 0x7fdb98152db0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fdb8800d620 tx=0x7fdb8800dae0 comp rx=0 tx=0).stop 2024-03-27T10:01:04.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.767+0000 7fdb9da00640 1 -- 172.21.15.57:0/1614105141 shutdown_connections 2024-03-27T10:01:04.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.767+0000 7fdb9da00640 1 --2- 172.21.15.57:0/1614105141 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fdb7806c530 0x7fdb7806e9f0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:04.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.767+0000 7fdb9da00640 1 --2- 172.21.15.57:0/1614105141 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdb980aea20 0x7fdb9814fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:04.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.767+0000 7fdb9da00640 1 --2- 172.21.15.57:0/1614105141 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdb980acd60 0x7fdb9815e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:04.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.767+0000 7fdb9da00640 1 --2- 172.21.15.57:0/1614105141 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb980711b0 0x7fdb98152db0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:04.758 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.767+0000 7fdb9da00640 1 -- 172.21.15.57:0/1614105141 >> 172.21.15.57:0/1614105141 conn(0x7fdb980b18a0 msgr2=0x7fdb980afe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:04.758 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.768+0000 7fdb9da00640 1 -- 172.21.15.57:0/1614105141 shutdown_connections 2024-03-27T10:01:04.758 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:04.768+0000 7fdb9da00640 1 -- 172.21.15.57:0/1614105141 wait complete. 2024-03-27T10:01:04.776 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-27T10:01:04.998 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.009+0000 7fb1a1000640 1 Processor -- start 2024-03-27T10:01:04.998 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.009+0000 7fb1a1000640 1 -- start start 2024-03-27T10:01:05.000 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.011+0000 7fb1a1000640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fb19c0d0e90 0x7fb19c0c7b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:05.000 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.011+0000 7fb1a1000640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb19c0d2d90 con 0x7fb19c0d2820 2024-03-27T10:01:05.000 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.011+0000 7fb1a1000640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb19c0cee90 con 0x7fb19c161830 2024-03-27T10:01:05.000 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.011+0000 7fb1a1000640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7fb19c0cf4e0 con 0x7fb19c0d0e90 2024-03-27T10:01:05.000 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.011+0000 7fb19aa00640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fb19c0d2820 0x7fb19c0d0780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:39698/0 (socket says 172.21.15.57:39698) 2024-03-27T10:01:05.000 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.011+0000 7fb19aa00640 1 -- 172.21.15.57:0/1142168095 learned_addr learned my addr 172.21.15.57:0/1142168095 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T10:01:05.002 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.011+0000 7fb19be00640 1 --2- 172.21.15.57:0/1142168095 >> v2:172.21.15.118:3300/0 conn(0x7fb19c0d0e90 0x7fb19c0c7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:05.002 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.011+0000 7fb19a000640 1 -- 172.21.15.57:0/1142168095 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 435176725 0 0) 0x7fb19c0d2d90 con 0x7fb19c0d2820 2024-03-27T10:01:05.002 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.011+0000 7fb19a000640 1 -- 172.21.15.57:0/1142168095 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb180003520 con 0x7fb19c0d2820 2024-03-27T10:01:05.002 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.012+0000 7fb19a000640 1 -- 172.21.15.57:0/1142168095 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2263687441 0 0) 0x7fb180003520 con 0x7fb19c0d2820 2024-03-27T10:01:05.002 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.012+0000 7fb19a000640 1 -- 172.21.15.57:0/1142168095 >> v2:172.21.15.118:3300/0 conn(0x7fb19c0d0e90 msgr2=0x7fb19c0c7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:01:05.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.012+0000 7fb19a000640 1 --2- 172.21.15.57:0/1142168095 >> v2:172.21.15.118:3300/0 conn(0x7fb19c0d0e90 0x7fb19c0c7b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:05.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.012+0000 7fb19a000640 1 -- 172.21.15.57:0/1142168095 >> v1:172.21.15.118:6789/0 conn(0x7fb19c161830 legacy=0x7fb19c0cf970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:05.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.012+0000 7fb19a000640 1 -- 172.21.15.57:0/1142168095 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb19c0cf170 con 0x7fb19c0d2820 2024-03-27T10:01:05.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.012+0000 7fb19a000640 1 -- 172.21.15.57:0/1142168095 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4227751516 0 0) 0x7fb188001670 con 0x7fb19c0d2820 2024-03-27T10:01:05.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.012+0000 7fb19a000640 1 -- 172.21.15.57:0/1142168095 >> v1:172.21.15.57:6789/0 conn(0x7fb19c0d2820 legacy=0x7fb19c0d0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:05.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.012+0000 7fb19a000640 1 --2- 172.21.15.57:0/1142168095 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb180003a00 0x7fb180003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:05.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.012+0000 7fb19a000640 1 --2- 172.21.15.57:0/1142168095 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb180004800 0x7fb180004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:05.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.012+0000 7fb19a000640 1 --2- 172.21.15.57:0/1142168095 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb180005210 0x7fb18000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:05.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.012+0000 7fb19a000640 1 -- 172.21.15.57:0/1142168095 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fb19c0cf4e0 con 0x7fb180004800 2024-03-27T10:01:05.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.012+0000 7fb19a000640 1 -- 172.21.15.57:0/1142168095 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fb18000c160 con 0x7fb180003a00 2024-03-27T10:01:05.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.012+0000 7fb19a000640 1 -- 172.21.15.57:0/1142168095 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fb18000c360 con 0x7fb180005210 2024-03-27T10:01:05.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.012+0000 7fb19aa00640 1 --2- 172.21.15.57:0/1142168095 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb180004800 0x7fb180004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:05.004 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.013+0000 7fb19b400640 1 --2- 172.21.15.57:0/1142168095 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb180003a00 0x7fb180003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:05.004 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.013+0000 7fb19be00640 1 --2- 172.21.15.57:0/1142168095 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb180005210 0x7fb18000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:05.004 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.013+0000 7fb19aa00640 1 -- 172.21.15.57:0/1142168095 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb180005210 msgr2=0x7fb18000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:01:05.004 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.013+0000 7fb19aa00640 1 --2- 172.21.15.57:0/1142168095 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb180005210 0x7fb18000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:05.004 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.013+0000 7fb19aa00640 1 -- 172.21.15.57:0/1142168095 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb180003a00 msgr2=0x7fb180003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:01:05.004 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.013+0000 7fb19aa00640 1 --2- 172.21.15.57:0/1142168095 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb180003a00 0x7fb180003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:05.004 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.013+0000 7fb19aa00640 1 -- 172.21.15.57:0/1142168095 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb180003520 con 0x7fb180004800 2024-03-27T10:01:05.004 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.013+0000 7fb19be00640 1 -- 172.21.15.57:0/1142168095 reap_dead start 2024-03-27T10:01:05.005 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.014+0000 7fb19aa00640 1 --2- 172.21.15.57:0/1142168095 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb180004800 0x7fb180004c80 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fb18800c0e0 tx=0x7fb180005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f413b7d8a4e2524 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:05.005 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.014+0000 7fb19a000640 1 -- 172.21.15.57:0/1142168095 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb188007c40 con 0x7fb180004800 2024-03-27T10:01:05.005 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.014+0000 7fb19a000640 1 -- 172.21.15.57:0/1142168095 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb188030070 con 0x7fb180004800 2024-03-27T10:01:05.006 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.014+0000 7fb19a000640 1 -- 172.21.15.57:0/1142168095 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb188005db0 con 0x7fb180004800 2024-03-27T10:01:05.006 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.015+0000 7fb1a1000640 1 -- 172.21.15.57:0/1142168095 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb180004800 msgr2=0x7fb180004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:05.006 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.015+0000 7fb1a1000640 1 --2- 172.21.15.57:0/1142168095 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb180004800 0x7fb180004c80 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fb18800c0e0 tx=0x7fb180005830 comp rx=0 tx=0).stop 2024-03-27T10:01:05.006 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.015+0000 7fb1a1000640 1 -- 172.21.15.57:0/1142168095 shutdown_connections 2024-03-27T10:01:05.006 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.015+0000 7fb1a1000640 1 --2- 172.21.15.57:0/1142168095 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb180004800 0x7fb180004c80 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:05.006 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.015+0000 7fb1a1000640 1 -- 172.21.15.57:0/1142168095 >> 172.21.15.57:0/1142168095 conn(0x7fb19c0d4030 msgr2=0x7fb19c0d4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:05.006 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.015+0000 7fb1a1000640 1 -- 172.21.15.57:0/1142168095 shutdown_connections 2024-03-27T10:01:05.006 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.015+0000 7fb1a1000640 1 -- 172.21.15.57:0/1142168095 wait complete. 2024-03-27T10:01:05.008 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.017+0000 7fb1a1000640 1 Processor -- start 2024-03-27T10:01:05.008 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.017+0000 7fb1a1000640 1 -- start start 2024-03-27T10:01:05.008 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.018+0000 7fb1a1000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb180004800 0x7fb19c154ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:05.008 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.018+0000 7fb1a1000640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb19c156ee0 0x7fb19c1f3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:05.008 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.018+0000 7fb1a1000640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb19c1f3ec0 0x7fb19c159860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:05.008 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.018+0000 7fb1a1000640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fb19c0ce4b0 con 0x7fb19c1f3ec0 2024-03-27T10:01:05.008 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.018+0000 7fb1a1000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fb19c0ce330 con 0x7fb180004800 2024-03-27T10:01:05.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.018+0000 7fb1a1000640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fb19c161c10 con 0x7fb19c156ee0 2024-03-27T10:01:05.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.018+0000 7fb19be00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb19c1f3ec0 0x7fb19c159860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:05.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.018+0000 7fb19be00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb19c1f3ec0 0x7fb19c159860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56678/0 (socket says 172.21.15.57:56678) 2024-03-27T10:01:05.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.018+0000 7fb19be00640 1 -- 172.21.15.57:0/4058165105 learned_addr learned my addr 172.21.15.57:0/4058165105 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:01:05.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.019+0000 7fb19b400640 1 --2- 172.21.15.57:0/4058165105 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb180004800 0x7fb19c154ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:05.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.019+0000 7fb19aa00640 1 --2- 172.21.15.57:0/4058165105 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb19c156ee0 0x7fb19c1f3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:05.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.019+0000 7fb19be00640 1 -- 172.21.15.57:0/4058165105 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb19c156ee0 msgr2=0x7fb19c1f3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:05.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.019+0000 7fb19be00640 1 --2- 172.21.15.57:0/4058165105 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb19c156ee0 0x7fb19c1f3980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:05.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.019+0000 7fb19be00640 1 -- 172.21.15.57:0/4058165105 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb180004800 msgr2=0x7fb19c154ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:05.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.019+0000 7fb19be00640 1 --2- 172.21.15.57:0/4058165105 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb180004800 0x7fb19c154ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:05.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.019+0000 7fb19be00640 1 -- 172.21.15.57:0/4058165105 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb19c1550e0 con 0x7fb19c1f3ec0 2024-03-27T10:01:05.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.019+0000 7fb19be00640 1 --2- 172.21.15.57:0/4058165105 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb19c1f3ec0 0x7fb19c159860 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fb19c08c600 tx=0x7fb1940115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:05.010 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.019+0000 7fb193400640 1 -- 172.21.15.57:0/4058165105 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb194011db0 con 0x7fb19c1f3ec0 2024-03-27T10:01:05.010 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.019+0000 7fb193400640 1 -- 172.21.15.57:0/4058165105 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb19401b070 con 0x7fb19c1f3ec0 2024-03-27T10:01:05.011 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.019+0000 7fb193400640 1 -- 172.21.15.57:0/4058165105 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb194003990 con 0x7fb19c1f3ec0 2024-03-27T10:01:05.011 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.019+0000 7fb1a1000640 1 -- 172.21.15.57:0/4058165105 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb19c1553c0 con 0x7fb19c1f3ec0 2024-03-27T10:01:05.011 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.020+0000 7fb1a1000640 1 -- 172.21.15.57:0/4058165105 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb19c155980 con 0x7fb19c1f3ec0 2024-03-27T10:01:05.011 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.020+0000 7fb1a1000640 1 -- 172.21.15.57:0/4058165105 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb19c068540 con 0x7fb19c1f3ec0 2024-03-27T10:01:05.011 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.022+0000 7fb193400640 1 -- 172.21.15.57:0/4058165105 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fb194003b30 con 0x7fb19c1f3ec0 2024-03-27T10:01:05.012 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.023+0000 7fb193400640 1 --2- 172.21.15.57:0/4058165105 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fb17c06c580 0x7fb17c06ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:05.012 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.023+0000 7fb193400640 1 -- 172.21.15.57:0/4058165105 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fb19408c420 con 0x7fb19c1f3ec0 2024-03-27T10:01:05.012 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.023+0000 7fb19b400640 1 --2- 172.21.15.57:0/4058165105 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fb17c06c580 0x7fb17c06ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:05.013 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.024+0000 7fb19b400640 1 --2- 172.21.15.57:0/4058165105 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fb17c06c580 0x7fb17c06ea40 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb18c007fd0 tx=0x7fb18c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:05.016 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.027+0000 7fb193400640 1 -- 172.21.15.57:0/4058165105 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7fb194003e20 con 0x7fb19c1f3ec0 2024-03-27T10:01:05.236 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.247+0000 7fb1a1000640 1 -- 172.21.15.57:0/4058165105 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fb19c08d780 con 0x7fb19c1f3ec0 2024-03-27T10:01:05.237 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.248+0000 7fb193400640 1 -- 172.21.15.57:0/4058165105 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) ==== 80+0+0 (secure 0 0 0) 0x7fb19405a620 con 0x7fb19c1f3ec0 2024-03-27T10:01:05.237 INFO:teuthology.orchestra.run.smithi057.stderr:listed 0 entries 2024-03-27T10:01:05.240 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.251+0000 7fb1a1000640 1 -- 172.21.15.57:0/4058165105 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fb17c06c580 msgr2=0x7fb17c06ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:05.240 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.251+0000 7fb1a1000640 1 --2- 172.21.15.57:0/4058165105 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fb17c06c580 0x7fb17c06ea40 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb18c007fd0 tx=0x7fb18c009040 comp rx=0 tx=0).stop 2024-03-27T10:01:05.240 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.251+0000 7fb1a1000640 1 -- 172.21.15.57:0/4058165105 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb19c1f3ec0 msgr2=0x7fb19c159860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:05.240 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.251+0000 7fb1a1000640 1 --2- 172.21.15.57:0/4058165105 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb19c1f3ec0 0x7fb19c159860 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fb19c08c600 tx=0x7fb1940115a0 comp rx=0 tx=0).stop 2024-03-27T10:01:05.240 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.251+0000 7fb1a1000640 1 -- 172.21.15.57:0/4058165105 shutdown_connections 2024-03-27T10:01:05.240 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.251+0000 7fb1a1000640 1 --2- 172.21.15.57:0/4058165105 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb19c1f3ec0 0x7fb19c159860 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:05.241 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.251+0000 7fb1a1000640 1 --2- 172.21.15.57:0/4058165105 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb19c156ee0 0x7fb19c1f3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:05.241 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.251+0000 7fb1a1000640 1 --2- 172.21.15.57:0/4058165105 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fb17c06c580 0x7fb17c06ea40 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:05.241 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.251+0000 7fb1a1000640 1 --2- 172.21.15.57:0/4058165105 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb180004800 0x7fb19c154ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:05.241 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.251+0000 7fb1a1000640 1 -- 172.21.15.57:0/4058165105 >> 172.21.15.57:0/4058165105 conn(0x7fb19c0d4030 msgr2=0x7fb19c0d4a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:05.241 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.251+0000 7fb1a1000640 1 -- 172.21.15.57:0/4058165105 shutdown_connections 2024-03-27T10:01:05.241 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.251+0000 7fb1a1000640 1 -- 172.21.15.57:0/4058165105 wait complete. 2024-03-27T10:01:05.260 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi118.front.sepia.ceph.com... 2024-03-27T10:01:05.260 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T10:01:05.261 DEBUG:teuthology.orchestra.run.smithi118:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2024-03-27T10:01:05.353 INFO:teuthology.orchestra.run:waiting for 300 2024-03-27T10:01:05.354 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi118.front.sepia.ceph.com 2024-03-27T10:01:05.354 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T10:01:05.354 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-03-27T10:01:05.405 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-03-27T10:01:05.405 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-27T10:01:05.634 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.644+0000 7f5efbe00640 1 Processor -- start 2024-03-27T10:01:05.634 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.644+0000 7f5efbe00640 1 -- start start 2024-03-27T10:01:05.636 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.646+0000 7f5efbe00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f5ef4145820 0x7f5ef40cc950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:05.636 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.646+0000 7f5efbe00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5ef406b750 0x7f5ef406bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:05.636 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.646+0000 7f5efbe00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ef40cce90 con 0x7f5ef40b2b70 2024-03-27T10:01:05.636 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.646+0000 7f5efbe00640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f5ef406c100 con 0x7f5ef406b750 2024-03-27T10:01:05.636 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.646+0000 7f5efbe00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f5ef4160b60 con 0x7f5ef4145820 2024-03-27T10:01:05.636 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.646+0000 7f5ef8a00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5ef406b750 0x7f5ef406bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:05.637 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.646+0000 7f5ef8a00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f5ef406b750 0x7f5ef406bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56682/0 (socket says 172.21.15.57:56682) 2024-03-27T10:01:05.637 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.646+0000 7f5ef8a00640 1 -- 172.21.15.57:0/3309838109 learned_addr learned my addr 172.21.15.57:0/3309838109 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:01:05.637 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.647+0000 7f5ef9400640 1 --2- 172.21.15.57:0/3309838109 >> v2:172.21.15.118:3300/0 conn(0x7f5ef4145820 0x7f5ef40cc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:05.637 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.647+0000 7f5ef8a00640 1 -- 172.21.15.57:0/3309838109 >> v2:172.21.15.118:3300/0 conn(0x7f5ef4145820 msgr2=0x7f5ef40cc950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:01:05.637 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.647+0000 7f5ef8a00640 1 --2- 172.21.15.57:0/3309838109 >> v2:172.21.15.118:3300/0 conn(0x7f5ef4145820 0x7f5ef40cc950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:05.637 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.647+0000 7f5ef8a00640 1 -- 172.21.15.57:0/3309838109 >> v1:172.21.15.118:6789/0 conn(0x7f5ef40b2b70 legacy=0x7f5ef40b2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:01:05.637 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.647+0000 7f5ef8a00640 1 -- 172.21.15.57:0/3309838109 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ef415fc70 con 0x7f5ef406b750 2024-03-27T10:01:05.639 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.648+0000 7f5ef8a00640 1 --2- 172.21.15.57:0/3309838109 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ef406b750 0x7f5ef406bbc0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f5ef406c520 tx=0x7f5ee002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d2679f73d8a5e9a server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:05.639 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.648+0000 7f5ef3e00640 1 -- 172.21.15.57:0/3309838109 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ee0035020 con 0x7f5ef406b750 2024-03-27T10:01:05.639 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.648+0000 7f5ef3e00640 1 -- 172.21.15.57:0/3309838109 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ee0031640 con 0x7f5ef406b750 2024-03-27T10:01:05.639 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.648+0000 7f5ef3e00640 1 -- 172.21.15.57:0/3309838109 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ee002d040 con 0x7f5ef406b750 2024-03-27T10:01:05.639 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.649+0000 7f5efbe00640 1 -- 172.21.15.57:0/3309838109 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ef406b750 msgr2=0x7f5ef406bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:05.639 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.649+0000 7f5efbe00640 1 --2- 172.21.15.57:0/3309838109 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ef406b750 0x7f5ef406bbc0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f5ef406c520 tx=0x7f5ee002b8f0 comp rx=0 tx=0).stop 2024-03-27T10:01:05.639 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.649+0000 7f5efbe00640 1 -- 172.21.15.57:0/3309838109 shutdown_connections 2024-03-27T10:01:05.639 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.649+0000 7f5efbe00640 1 --2- 172.21.15.57:0/3309838109 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ef406b750 0x7f5ef406bbc0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:05.639 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.649+0000 7f5efbe00640 1 --2- 172.21.15.57:0/3309838109 >> v2:172.21.15.118:3300/0 conn(0x7f5ef4145820 0x7f5ef40cc950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:05.639 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.649+0000 7f5efbe00640 1 -- 172.21.15.57:0/3309838109 >> 172.21.15.57:0/3309838109 conn(0x7f5ef40b1c60 msgr2=0x7f5ef40b2070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:05.639 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.649+0000 7f5efbe00640 1 -- 172.21.15.57:0/3309838109 shutdown_connections 2024-03-27T10:01:05.639 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.649+0000 7f5efbe00640 1 -- 172.21.15.57:0/3309838109 wait complete. 2024-03-27T10:01:05.640 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.651+0000 7f5efbe00640 1 Processor -- start 2024-03-27T10:01:05.640 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.651+0000 7f5efbe00640 1 -- start start 2024-03-27T10:01:05.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.652+0000 7f5efbe00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ef406b750 0x7f5ef40aa960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:05.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.652+0000 7f5efbe00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5ef40b2b70 0x7f5ef41f49b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:05.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.652+0000 7f5efbe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ef4145820 0x7f5ef415b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:05.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.652+0000 7f5efbe00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f5ef4160510 con 0x7f5ef406b750 2024-03-27T10:01:05.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.652+0000 7f5efbe00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f5ef4160230 con 0x7f5ef4145820 2024-03-27T10:01:05.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.652+0000 7f5efbe00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f5ef41607f0 con 0x7f5ef40b2b70 2024-03-27T10:01:05.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.653+0000 7f5ef9400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ef406b750 0x7f5ef40aa960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:05.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.653+0000 7f5ef9400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ef406b750 0x7f5ef40aa960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56684/0 (socket says 172.21.15.57:56684) 2024-03-27T10:01:05.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.653+0000 7f5ef9400640 1 -- 172.21.15.57:0/3740751631 learned_addr learned my addr 172.21.15.57:0/3740751631 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:01:05.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.653+0000 7f5ef8a00640 1 --2- 172.21.15.57:0/3740751631 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5ef40b2b70 0x7f5ef41f49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:05.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.653+0000 7f5ef9e00640 1 --2- 172.21.15.57:0/3740751631 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ef4145820 0x7f5ef415b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:05.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.653+0000 7f5ef9400640 1 -- 172.21.15.57:0/3740751631 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5ef40b2b70 msgr2=0x7f5ef41f49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:05.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.653+0000 7f5ef9400640 1 --2- 172.21.15.57:0/3740751631 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5ef40b2b70 0x7f5ef41f49b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:05.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.653+0000 7f5ef9400640 1 -- 172.21.15.57:0/3740751631 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ef4145820 msgr2=0x7f5ef415b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:05.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.653+0000 7f5ef9400640 1 --2- 172.21.15.57:0/3740751631 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ef4145820 0x7f5ef415b150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:05.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.653+0000 7f5ef9400640 1 -- 172.21.15.57:0/3740751631 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ef40cff20 con 0x7f5ef406b750 2024-03-27T10:01:05.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.653+0000 7f5ef9400640 1 --2- 172.21.15.57:0/3740751631 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ef406b750 0x7f5ef40aa960 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f5ee800d5f0 tx=0x7f5ee800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:05.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.654+0000 7f5ef1600640 1 -- 172.21.15.57:0/3740751631 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ee80125f0 con 0x7f5ef406b750 2024-03-27T10:01:05.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.654+0000 7f5ef1600640 1 -- 172.21.15.57:0/3740751631 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ee8019070 con 0x7f5ef406b750 2024-03-27T10:01:05.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.654+0000 7f5ef1600640 1 -- 172.21.15.57:0/3740751631 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ee80129d0 con 0x7f5ef406b750 2024-03-27T10:01:05.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.654+0000 7f5efbe00640 1 -- 172.21.15.57:0/3740751631 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ef40d0200 con 0x7f5ef406b750 2024-03-27T10:01:05.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.654+0000 7f5efbe00640 1 -- 172.21.15.57:0/3740751631 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ef41f4490 con 0x7f5ef406b750 2024-03-27T10:01:05.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.655+0000 7f5efbe00640 1 -- 172.21.15.57:0/3740751631 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ef4068620 con 0x7f5ef406b750 2024-03-27T10:01:05.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.656+0000 7f5ef1600640 1 -- 172.21.15.57:0/3740751631 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f5ee8012b70 con 0x7f5ef406b750 2024-03-27T10:01:05.646 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.657+0000 7f5ef1600640 1 --2- 172.21.15.57:0/3740751631 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f5ed406c530 0x7f5ed406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:05.646 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.657+0000 7f5ef1600640 1 -- 172.21.15.57:0/3740751631 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f5ee808bef0 con 0x7f5ef406b750 2024-03-27T10:01:05.646 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.657+0000 7f5ef8a00640 1 --2- 172.21.15.57:0/3740751631 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f5ed406c530 0x7f5ed406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:05.647 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.658+0000 7f5ef8a00640 1 --2- 172.21.15.57:0/3740751631 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f5ed406c530 0x7f5ed406e9f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5ee0036000 tx=0x7f5ee0008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:05.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.663+0000 7f5ef1600640 1 -- 172.21.15.57:0/3740751631 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f5ee805a100 con 0x7f5ef406b750 2024-03-27T10:01:05.894 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.905+0000 7f5efbe00640 1 -- 172.21.15.57:0/3740751631 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5ef40b2290 con 0x7f5ef406b750 2024-03-27T10:01:05.895 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.906+0000 7f5ef1600640 1 -- 172.21.15.57:0/3740751631 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5183 (secure 0 0 0) 0x7f5ee8059a00 con 0x7f5ef406b750 2024-03-27T10:01:05.895 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:01:05.895 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/1178943431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1178943431},{"type":"v1","addr":"172.21.15.118:6834","nonce":1178943431}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6836/1248533620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6835","nonce":1248533620},{"type":"v1","addr":"172.21.15.57:6836","nonce":1248533620}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6837/4133386889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":4133386889},{"type":"v1","addr":"172.21.15.57:6837","nonce":4133386889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-27T09:59:28.571425+0000","modified":"2024-03-27T09:59:55.863525+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6835/1823694233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":1823694233},{"type":"v1","addr":"172.21.15.118:6835","nonce":1823694233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4282,"qdb_cluster":[4282]},"id":1}]} 2024-03-27T10:01:05.895 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 9 2024-03-27T10:01:05.898 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.908+0000 7f5efbe00640 1 -- 172.21.15.57:0/3740751631 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f5ed406c530 msgr2=0x7f5ed406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:05.898 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.908+0000 7f5efbe00640 1 --2- 172.21.15.57:0/3740751631 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f5ed406c530 0x7f5ed406e9f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5ee0036000 tx=0x7f5ee0008030 comp rx=0 tx=0).stop 2024-03-27T10:01:05.898 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.908+0000 7f5efbe00640 1 -- 172.21.15.57:0/3740751631 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ef406b750 msgr2=0x7f5ef40aa960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:05.898 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.908+0000 7f5efbe00640 1 --2- 172.21.15.57:0/3740751631 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ef406b750 0x7f5ef40aa960 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f5ee800d5f0 tx=0x7f5ee800dab0 comp rx=0 tx=0).stop 2024-03-27T10:01:05.898 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.908+0000 7f5efbe00640 1 -- 172.21.15.57:0/3740751631 shutdown_connections 2024-03-27T10:01:05.898 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.908+0000 7f5efbe00640 1 --2- 172.21.15.57:0/3740751631 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f5ed406c530 0x7f5ed406e9f0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:05.898 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.908+0000 7f5efbe00640 1 --2- 172.21.15.57:0/3740751631 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f5ef4145820 0x7f5ef415b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:05.898 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.908+0000 7f5efbe00640 1 --2- 172.21.15.57:0/3740751631 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f5ef40b2b70 0x7f5ef41f49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:05.898 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.908+0000 7f5efbe00640 1 --2- 172.21.15.57:0/3740751631 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f5ef406b750 0x7f5ef40aa960 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:05.898 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.908+0000 7f5efbe00640 1 -- 172.21.15.57:0/3740751631 >> 172.21.15.57:0/3740751631 conn(0x7f5ef40b1c60 msgr2=0x7f5ef40b0e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:05.899 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.909+0000 7f5efbe00640 1 -- 172.21.15.57:0/3740751631 shutdown_connections 2024-03-27T10:01:05.899 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:05.909+0000 7f5efbe00640 1 -- 172.21.15.57:0/3740751631 wait complete. 2024-03-27T10:01:05.919 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-27T10:01:06.146 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.157+0000 7f659d600640 1 Processor -- start 2024-03-27T10:01:06.146 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.157+0000 7f659d600640 1 -- start start 2024-03-27T10:01:06.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.159+0000 7f659d600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f659815ded0 0x7f659815e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:06.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.159+0000 7f659d600640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f659806f2f0 0x7f6598161d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:06.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.159+0000 7f659d600640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6598162a30 con 0x7f65980b4260 2024-03-27T10:01:06.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.159+0000 7f659d600640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f6598162d10 con 0x7f659806f2f0 2024-03-27T10:01:06.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.159+0000 7f659d600640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f65980b3dd0 con 0x7f659815ded0 2024-03-27T10:01:06.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.159+0000 7f6597400640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f659806f2f0 0x7f6598161d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:06.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.159+0000 7f6597400640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f659806f2f0 0x7f6598161d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56696/0 (socket says 172.21.15.57:56696) 2024-03-27T10:01:06.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.159+0000 7f6597400640 1 -- 172.21.15.57:0/2278480794 learned_addr learned my addr 172.21.15.57:0/2278480794 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:01:06.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.160+0000 7f6597400640 1 -- 172.21.15.57:0/2278480794 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f659815ded0 msgr2=0x7f659815e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:01:06.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.160+0000 7f6597400640 1 --2- 172.21.15.57:0/2278480794 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f659815ded0 0x7f659815e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:06.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.160+0000 7f6597400640 1 -- 172.21.15.57:0/2278480794 >> v1:172.21.15.118:6789/0 conn(0x7f65980b4260 legacy=0x7f659806ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:01:06.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.160+0000 7f6597400640 1 -- 172.21.15.57:0/2278480794 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65980b3780 con 0x7f659806f2f0 2024-03-27T10:01:06.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.161+0000 7f6597400640 1 --2- 172.21.15.57:0/2278480794 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f659806f2f0 0x7f6598161d70 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f6590009e50 tx=0x7f659002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa2d546de3516d8c server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:06.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.161+0000 7f6595600640 1 -- 172.21.15.57:0/2278480794 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f659002ca70 con 0x7f659806f2f0 2024-03-27T10:01:06.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.161+0000 7f6595600640 1 -- 172.21.15.57:0/2278480794 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f659002cc10 con 0x7f659806f2f0 2024-03-27T10:01:06.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.161+0000 7f6595600640 1 -- 172.21.15.57:0/2278480794 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65900343f0 con 0x7f659806f2f0 2024-03-27T10:01:06.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.162+0000 7f659d600640 1 -- 172.21.15.57:0/2278480794 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f659806f2f0 msgr2=0x7f6598161d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:06.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.162+0000 7f659d600640 1 --2- 172.21.15.57:0/2278480794 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f659806f2f0 0x7f6598161d70 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f6590009e50 tx=0x7f659002bed0 comp rx=0 tx=0).stop 2024-03-27T10:01:06.152 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.162+0000 7f659d600640 1 -- 172.21.15.57:0/2278480794 shutdown_connections 2024-03-27T10:01:06.152 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.162+0000 7f659d600640 1 --2- 172.21.15.57:0/2278480794 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f659806f2f0 0x7f6598161d70 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:06.152 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.162+0000 7f659d600640 1 --2- 172.21.15.57:0/2278480794 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f659815ded0 0x7f659815e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:06.152 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.162+0000 7f659d600640 1 -- 172.21.15.57:0/2278480794 >> 172.21.15.57:0/2278480794 conn(0x7f65980b1c60 msgr2=0x7f65980b2070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:06.152 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.162+0000 7f659d600640 1 -- 172.21.15.57:0/2278480794 shutdown_connections 2024-03-27T10:01:06.152 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.162+0000 7f659d600640 1 -- 172.21.15.57:0/2278480794 wait complete. 2024-03-27T10:01:06.153 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.164+0000 7f659d600640 1 Processor -- start 2024-03-27T10:01:06.153 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.164+0000 7f659d600640 1 -- start start 2024-03-27T10:01:06.155 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.165+0000 7f659d600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f659806f2f0 0x7f65981557e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:06.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.165+0000 7f659d600640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f65980b4260 0x7f659815aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:06.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.165+0000 7f659d600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f659815ded0 0x7f659815f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:06.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.165+0000 7f659d600640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f65981622b0 con 0x7f65980b4260 2024-03-27T10:01:06.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.166+0000 7f659d600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f65980b46c0 con 0x7f659806f2f0 2024-03-27T10:01:06.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.166+0000 7f659d600640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f6598162430 con 0x7f659815ded0 2024-03-27T10:01:06.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.166+0000 7f6596000640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f65980b4260 0x7f659815aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:06.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.166+0000 7f6596000640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f65980b4260 0x7f659815aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56706/0 (socket says 172.21.15.57:56706) 2024-03-27T10:01:06.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.166+0000 7f6596000640 1 -- 172.21.15.57:0/2001311311 learned_addr learned my addr 172.21.15.57:0/2001311311 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:01:06.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.166+0000 7f6596a00640 1 --2- 172.21.15.57:0/2001311311 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f659806f2f0 0x7f65981557e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:06.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.166+0000 7f6597400640 1 --2- 172.21.15.57:0/2001311311 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f659815ded0 0x7f659815f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:06.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.166+0000 7f6596000640 1 -- 172.21.15.57:0/2001311311 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f659815ded0 msgr2=0x7f659815f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:06.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.166+0000 7f6596000640 1 --2- 172.21.15.57:0/2001311311 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f659815ded0 0x7f659815f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:06.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.166+0000 7f6596000640 1 -- 172.21.15.57:0/2001311311 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f659806f2f0 msgr2=0x7f65981557e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:06.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.166+0000 7f6596000640 1 --2- 172.21.15.57:0/2001311311 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f659806f2f0 0x7f65981557e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:06.157 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.166+0000 7f6596000640 1 -- 172.21.15.57:0/2001311311 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f659815e350 con 0x7f65980b4260 2024-03-27T10:01:06.157 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.166+0000 7f6596a00640 1 --2- 172.21.15.57:0/2001311311 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f659806f2f0 0x7f65981557e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T10:01:06.157 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.167+0000 7f6596000640 1 --2- 172.21.15.57:0/2001311311 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f65980b4260 0x7f659815aaa0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f658400c430 tx=0x7f658400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:06.157 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.167+0000 7f658ea00640 1 -- 172.21.15.57:0/2001311311 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6584011790 con 0x7f65980b4260 2024-03-27T10:01:06.158 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.167+0000 7f658ea00640 1 -- 172.21.15.57:0/2001311311 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6584017070 con 0x7f65980b4260 2024-03-27T10:01:06.158 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.167+0000 7f658ea00640 1 -- 172.21.15.57:0/2001311311 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6584011b70 con 0x7f65980b4260 2024-03-27T10:01:06.158 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.167+0000 7f659d600640 1 -- 172.21.15.57:0/2001311311 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f659815e630 con 0x7f65980b4260 2024-03-27T10:01:06.158 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.167+0000 7f659d600640 1 -- 172.21.15.57:0/2001311311 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f659815ebf0 con 0x7f65980b4260 2024-03-27T10:01:06.158 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.168+0000 7f659d600640 1 -- 172.21.15.57:0/2001311311 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6598068620 con 0x7f65980b4260 2024-03-27T10:01:06.159 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.170+0000 7f658ea00640 1 -- 172.21.15.57:0/2001311311 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f6584011d10 con 0x7f65980b4260 2024-03-27T10:01:06.159 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.170+0000 7f658ea00640 1 --2- 172.21.15.57:0/2001311311 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f657806c530 0x7f657806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:06.159 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.171+0000 7f658ea00640 1 -- 172.21.15.57:0/2001311311 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f658408b9a0 con 0x7f65980b4260 2024-03-27T10:01:06.160 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.171+0000 7f6596a00640 1 --2- 172.21.15.57:0/2001311311 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f657806c530 0x7f657806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:06.160 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.171+0000 7f6596a00640 1 --2- 172.21.15.57:0/2001311311 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f657806c530 0x7f657806e9f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f659815cf40 tx=0x7f6588008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:06.164 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.175+0000 7f658ea00640 1 -- 172.21.15.57:0/2001311311 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f6584059bb0 con 0x7f65980b4260 2024-03-27T10:01:06.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.381+0000 7f659d600640 1 -- 172.21.15.57:0/2001311311 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f65980cf390 con 0x7f65980b4260 2024-03-27T10:01:06.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.384+0000 7f658ea00640 1 -- 172.21.15.57:0/2001311311 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) ==== 74+0+18888 (secure 0 0 0) 0x7f65840594b0 con 0x7f65980b4260 2024-03-27T10:01:06.374 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:01:06.374 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":28,"fsid":"7ac43f86-2c16-4a97-98fb-715d3cebc75c","created":"2024-03-27T09:59:04.033417+0000","modified":"2024-03-27T10:00:10.462391+0000","last_up_change":"2024-03-27T09:59:16.969624+0000","last_in_change":"2024-03-27T09:59:07.421690+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-27T09:59:17.253008+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-27T09:59:26.690365+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-27T09:59:27.559059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-27T09:59:31.187596+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"47b44362-7302-4f2a-b735-582c6c3850cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6801","nonce":2020036298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6803","nonce":2020036298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6807","nonce":2020036298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6805","nonce":2020036298}]},"public_addr":"172.21.15.57:6801/2020036298","cluster_addr":"172.21.15.57:6803/2020036298","heartbeat_back_addr":"172.21.15.57:6807/2020036298","heartbeat_front_addr":"172.21.15.57:6805/2020036298","state":["exists","up"]},{"osd":1,"uuid":"feaf96f0-9431-4188-9a09-da505b40e934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6809","nonce":3190929242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6811","nonce":3190929242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6815","nonce":3190929242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6813","nonce":3190929242}]},"public_addr":"172.21.15.57:6809/3190929242","cluster_addr":"172.21.15.57:6811/3190929242","heartbeat_back_addr":"172.21.15.57:6815/3190929242","heartbeat_front_addr":"172.21.15.57:6813/3190929242","state":["exists","up"]},{"osd":2,"uuid":"21e406e6-cfbc-4fe7-a816-e2420487c95d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6817","nonce":4065849973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6819","nonce":4065849973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6823","nonce":4065849973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6821","nonce":4065849973}]},"public_addr":"172.21.15.57:6817/4065849973","cluster_addr":"172.21.15.57:6819/4065849973","heartbeat_back_addr":"172.21.15.57:6823/4065849973","heartbeat_front_addr":"172.21.15.57:6821/4065849973","state":["exists","up"]},{"osd":3,"uuid":"a389af1d-76c4-4dfc-b215-f983f4931257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6825","nonce":158084809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6827","nonce":158084809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6831","nonce":158084809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6829","nonce":158084809}]},"public_addr":"172.21.15.57:6825/158084809","cluster_addr":"172.21.15.57:6827/158084809","heartbeat_back_addr":"172.21.15.57:6831/158084809","heartbeat_front_addr":"172.21.15.57:6829/158084809","state":["exists","up"]},{"osd":4,"uuid":"e9b05dca-557a-43ee-b43f-9ce5b7d28304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6823","nonce":108719401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6827","nonce":108719401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6831","nonce":108719401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6829","nonce":108719401}]},"public_addr":"172.21.15.118:6823/108719401","cluster_addr":"172.21.15.118:6827/108719401","heartbeat_back_addr":"172.21.15.118:6831/108719401","heartbeat_front_addr":"172.21.15.118:6829/108719401","state":["exists","up"]},{"osd":5,"uuid":"d968177d-44ff-499a-b00a-b147ed879253","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6817","nonce":2704605866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6819","nonce":2704605866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6826","nonce":2704605866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6822","nonce":2704605866}]},"public_addr":"172.21.15.118:6817/2704605866","cluster_addr":"172.21.15.118:6819/2704605866","heartbeat_back_addr":"172.21.15.118:6826/2704605866","heartbeat_front_addr":"172.21.15.118:6822/2704605866","state":["exists","up"]},{"osd":6,"uuid":"e8f98052-e6ad-4cfe-a4a9-0b17a434d54e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6801","nonce":1963659095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6803","nonce":1963659095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6807","nonce":1963659095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6805","nonce":1963659095}]},"public_addr":"172.21.15.118:6801/1963659095","cluster_addr":"172.21.15.118:6803/1963659095","heartbeat_back_addr":"172.21.15.118:6807/1963659095","heartbeat_front_addr":"172.21.15.118:6805/1963659095","state":["exists","up"]},{"osd":7,"uuid":"eccff987-8e51-4a63-845a-cf0a3196d7fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6809","nonce":1955879596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6811","nonce":1955879596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6815","nonce":1955879596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6813","nonce":1955879596}]},"public_addr":"172.21.15.118:6809/1955879596","cluster_addr":"172.21.15.118:6811/1955879596","heartbeat_back_addr":"172.21.15.118:6815/1955879596","heartbeat_front_addr":"172.21.15.118:6813/1955879596","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.721258+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.696610+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.777895+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.806769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.743259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.845687+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:13.020165+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.722294+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.e","mappings":[{"from":7,"to":1}]},{"pgid":"3.15","mappings":[{"from":3,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-27T10:01:06.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.387+0000 7f659d600640 1 -- 172.21.15.57:0/2001311311 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f657806c530 msgr2=0x7f657806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:06.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.387+0000 7f659d600640 1 --2- 172.21.15.57:0/2001311311 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f657806c530 0x7f657806e9f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f659815cf40 tx=0x7f6588008040 comp rx=0 tx=0).stop 2024-03-27T10:01:06.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.387+0000 7f659d600640 1 -- 172.21.15.57:0/2001311311 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f65980b4260 msgr2=0x7f659815aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:06.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.387+0000 7f659d600640 1 --2- 172.21.15.57:0/2001311311 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f65980b4260 0x7f659815aaa0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f658400c430 tx=0x7f658400c8f0 comp rx=0 tx=0).stop 2024-03-27T10:01:06.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.387+0000 7f659d600640 1 -- 172.21.15.57:0/2001311311 shutdown_connections 2024-03-27T10:01:06.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.387+0000 7f659d600640 1 --2- 172.21.15.57:0/2001311311 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f659815ded0 0x7f659815f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:06.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.387+0000 7f659d600640 1 --2- 172.21.15.57:0/2001311311 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f65980b4260 0x7f659815aaa0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:06.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.387+0000 7f659d600640 1 --2- 172.21.15.57:0/2001311311 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f657806c530 0x7f657806e9f0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:06.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.387+0000 7f659d600640 1 --2- 172.21.15.57:0/2001311311 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f659806f2f0 0x7f65981557e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:06.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.387+0000 7f659d600640 1 -- 172.21.15.57:0/2001311311 >> 172.21.15.57:0/2001311311 conn(0x7f65980b1c60 msgr2=0x7f659815cf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:06.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.387+0000 7f659d600640 1 -- 172.21.15.57:0/2001311311 shutdown_connections 2024-03-27T10:01:06.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.387+0000 7f659d600640 1 -- 172.21.15.57:0/2001311311 wait complete. 2024-03-27T10:01:06.394 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-27T09:59:17.253008+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-27T09:59:26.690365+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-27T09:59:27.559059+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-03-27T09:59:31.187596+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-27T10:01:06.395 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-27T10:01:06.615 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.626+0000 7fcb4f200640 1 Processor -- start 2024-03-27T10:01:06.615 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.626+0000 7fcb4f200640 1 -- start start 2024-03-27T10:01:06.617 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.628+0000 7fcb4f200640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fcb48161800 0x7fcb480b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:06.617 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.628+0000 7fcb4f200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcb480d1070 0x7fcb480b7380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:06.617 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.628+0000 7fcb4f200640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb480cf6c0 con 0x7fcb480d1650 2024-03-27T10:01:06.617 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.628+0000 7fcb4f200640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7fcb480cf9a0 con 0x7fcb48161800 2024-03-27T10:01:06.617 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.628+0000 7fcb4f200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fcb480cfc80 con 0x7fcb480d1070 2024-03-27T10:01:06.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.628+0000 7fcb4e800640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcb480d1070 0x7fcb480b7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:06.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.629+0000 7fcb4e800640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcb480d1070 0x7fcb480b7380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.57:59480/0 (socket says 172.21.15.57:59480) 2024-03-27T10:01:06.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.629+0000 7fcb4e800640 1 -- 172.21.15.57:0/2612464940 learned_addr learned my addr 172.21.15.57:0/2612464940 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:01:06.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.629+0000 7fcb4de00640 1 --2- 172.21.15.57:0/2612464940 >> v2:172.21.15.118:3300/0 conn(0x7fcb48161800 0x7fcb480b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:06.619 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.629+0000 7fcb4e800640 1 -- 172.21.15.57:0/2612464940 >> v2:172.21.15.118:3300/0 conn(0x7fcb48161800 msgr2=0x7fcb480b4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:01:06.619 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.629+0000 7fcb4e800640 1 --2- 172.21.15.57:0/2612464940 >> v2:172.21.15.118:3300/0 conn(0x7fcb48161800 0x7fcb480b4ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:06.619 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.629+0000 7fcb4e800640 1 -- 172.21.15.57:0/2612464940 >> v1:172.21.15.118:6789/0 conn(0x7fcb480d1650 legacy=0x7fcb480d0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:06.619 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.630+0000 7fcb4e800640 1 -- 172.21.15.57:0/2612464940 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb480cff60 con 0x7fcb480d1070 2024-03-27T10:01:06.619 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.629+0000 7fcb4ca00640 1 -- 172.21.15.57:0/2612464940 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1888899286 0 0) 0x7fcb480cf6c0 con 0x7fcb480d1650 2024-03-27T10:01:06.620 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.631+0000 7fcb4e800640 1 --2- 172.21.15.57:0/2612464940 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcb480d1070 0x7fcb480b7380 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fcb44009e50 tx=0x7fcb4402bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5482d0d55eaefb80 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:06.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.631+0000 7fcb4ca00640 1 -- 172.21.15.57:0/2612464940 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb4402cb00 con 0x7fcb480d1070 2024-03-27T10:01:06.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.632+0000 7fcb4ca00640 1 -- 172.21.15.57:0/2612464940 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb4402cca0 con 0x7fcb480d1070 2024-03-27T10:01:06.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.632+0000 7fcb4ca00640 1 -- 172.21.15.57:0/2612464940 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb44034610 con 0x7fcb480d1070 2024-03-27T10:01:06.622 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.632+0000 7fcb4f200640 1 -- 172.21.15.57:0/2612464940 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcb480d1070 msgr2=0x7fcb480b7380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:06.622 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.632+0000 7fcb4f200640 1 --2- 172.21.15.57:0/2612464940 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcb480d1070 0x7fcb480b7380 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fcb44009e50 tx=0x7fcb4402bf60 comp rx=0 tx=0).stop 2024-03-27T10:01:06.622 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.632+0000 7fcb4f200640 1 -- 172.21.15.57:0/2612464940 shutdown_connections 2024-03-27T10:01:06.622 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.632+0000 7fcb4f200640 1 --2- 172.21.15.57:0/2612464940 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcb480d1070 0x7fcb480b7380 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:06.622 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.632+0000 7fcb4f200640 1 --2- 172.21.15.57:0/2612464940 >> v2:172.21.15.118:3300/0 conn(0x7fcb48161800 0x7fcb480b4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:06.622 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.632+0000 7fcb4f200640 1 -- 172.21.15.57:0/2612464940 >> 172.21.15.57:0/2612464940 conn(0x7fcb480d3f70 msgr2=0x7fcb480d4380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:06.622 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.632+0000 7fcb4f200640 1 -- 172.21.15.57:0/2612464940 shutdown_connections 2024-03-27T10:01:06.622 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.633+0000 7fcb4f200640 1 -- 172.21.15.57:0/2612464940 wait complete. 2024-03-27T10:01:06.623 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.634+0000 7fcb4f200640 1 Processor -- start 2024-03-27T10:01:06.623 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.634+0000 7fcb4f200640 1 -- start start 2024-03-27T10:01:06.624 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.635+0000 7fcb4f200640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb480d1070 0x7fcb480caa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:06.624 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.635+0000 7fcb4f200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcb480d1650 0x7fcb480b8670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:06.624 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.635+0000 7fcb4f200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcb48161800 0x7fcb48154330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:06.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.635+0000 7fcb4f200640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fcb480b5560 con 0x7fcb480d1070 2024-03-27T10:01:06.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.635+0000 7fcb4f200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fcb480b53e0 con 0x7fcb48161800 2024-03-27T10:01:06.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.635+0000 7fcb4f200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fcb48161be0 con 0x7fcb480d1650 2024-03-27T10:01:06.627 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.636+0000 7fcb4de00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb480d1070 0x7fcb480caa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:06.627 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.636+0000 7fcb4de00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb480d1070 0x7fcb480caa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56716/0 (socket says 172.21.15.57:56716) 2024-03-27T10:01:06.627 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.636+0000 7fcb4de00640 1 -- 172.21.15.57:0/409262624 learned_addr learned my addr 172.21.15.57:0/409262624 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:01:06.627 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.636+0000 7fcb4d400640 1 --2- 172.21.15.57:0/409262624 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcb480d1650 0x7fcb480b8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:06.627 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.636+0000 7fcb4e800640 1 --2- 172.21.15.57:0/409262624 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcb48161800 0x7fcb48154330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:06.627 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.636+0000 7fcb4de00640 1 -- 172.21.15.57:0/409262624 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcb480d1650 msgr2=0x7fcb480b8670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:06.627 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.636+0000 7fcb4de00640 1 --2- 172.21.15.57:0/409262624 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcb480d1650 0x7fcb480b8670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:06.627 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.636+0000 7fcb4de00640 1 -- 172.21.15.57:0/409262624 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcb48161800 msgr2=0x7fcb48154330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:06.627 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.636+0000 7fcb4de00640 1 --2- 172.21.15.57:0/409262624 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcb48161800 0x7fcb48154330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:06.628 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.636+0000 7fcb4de00640 1 -- 172.21.15.57:0/409262624 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb480b9910 con 0x7fcb480d1070 2024-03-27T10:01:06.628 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.637+0000 7fcb4de00640 1 --2- 172.21.15.57:0/409262624 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb480d1070 0x7fcb480caa70 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c00e9b0 tx=0x7fcb3c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:06.628 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.637+0000 7fcb42000640 1 -- 172.21.15.57:0/409262624 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb3c017070 con 0x7fcb480d1070 2024-03-27T10:01:06.628 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.637+0000 7fcb42000640 1 -- 172.21.15.57:0/409262624 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb3c00c9a0 con 0x7fcb480d1070 2024-03-27T10:01:06.628 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.637+0000 7fcb42000640 1 -- 172.21.15.57:0/409262624 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb3c00cd90 con 0x7fcb480d1070 2024-03-27T10:01:06.628 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.637+0000 7fcb4f200640 1 -- 172.21.15.57:0/409262624 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb480c7c40 con 0x7fcb480d1070 2024-03-27T10:01:06.628 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.637+0000 7fcb4f200640 1 -- 172.21.15.57:0/409262624 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb481586e0 con 0x7fcb480d1070 2024-03-27T10:01:06.628 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.638+0000 7fcb4f200640 1 -- 172.21.15.57:0/409262624 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb481584d0 con 0x7fcb480d1070 2024-03-27T10:01:06.628 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.639+0000 7fcb42000640 1 -- 172.21.15.57:0/409262624 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fcb3c01a070 con 0x7fcb480d1070 2024-03-27T10:01:06.630 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.641+0000 7fcb42000640 1 --2- 172.21.15.57:0/409262624 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fcb2c06c530 0x7fcb2c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:06.630 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.641+0000 7fcb42000640 1 -- 172.21.15.57:0/409262624 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fcb3c08bad0 con 0x7fcb480d1070 2024-03-27T10:01:06.630 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.641+0000 7fcb4d400640 1 --2- 172.21.15.57:0/409262624 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fcb2c06c530 0x7fcb2c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:06.630 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.642+0000 7fcb4d400640 1 --2- 172.21.15.57:0/409262624 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fcb2c06c530 0x7fcb2c06e9f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fcb4806c490 tx=0x7fcb38009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:06.634 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.645+0000 7fcb42000640 1 -- 172.21.15.57:0/409262624 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7fcb480b9910 con 0x7fcb480d1070 2024-03-27T10:01:06.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.849+0000 7fcb4f200640 1 -- 172.21.15.57:0/409262624 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fcb48068c50 con 0x7fcb480d1070 2024-03-27T10:01:06.839 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.849+0000 7fcb42000640 1 -- 172.21.15.57:0/409262624 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) ==== 93+0+10 (secure 0 0 0) 0x7fcb3c059ce0 con 0x7fcb480d1070 2024-03-27T10:01:06.839 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2024-03-27T10:01:06.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.852+0000 7fcb4f200640 1 -- 172.21.15.57:0/409262624 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fcb2c06c530 msgr2=0x7fcb2c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:06.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.852+0000 7fcb4f200640 1 --2- 172.21.15.57:0/409262624 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fcb2c06c530 0x7fcb2c06e9f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fcb4806c490 tx=0x7fcb38009040 comp rx=0 tx=0).stop 2024-03-27T10:01:06.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.852+0000 7fcb4f200640 1 -- 172.21.15.57:0/409262624 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb480d1070 msgr2=0x7fcb480caa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:06.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.852+0000 7fcb4f200640 1 --2- 172.21.15.57:0/409262624 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb480d1070 0x7fcb480caa70 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c00e9b0 tx=0x7fcb3c00ee70 comp rx=0 tx=0).stop 2024-03-27T10:01:06.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.852+0000 7fcb4f200640 1 -- 172.21.15.57:0/409262624 shutdown_connections 2024-03-27T10:01:06.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.852+0000 7fcb4f200640 1 --2- 172.21.15.57:0/409262624 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fcb2c06c530 0x7fcb2c06e9f0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:06.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.852+0000 7fcb4f200640 1 --2- 172.21.15.57:0/409262624 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcb48161800 0x7fcb48154330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:06.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.852+0000 7fcb4f200640 1 --2- 172.21.15.57:0/409262624 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcb480d1650 0x7fcb480b8670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:06.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.852+0000 7fcb4f200640 1 --2- 172.21.15.57:0/409262624 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb480d1070 0x7fcb480caa70 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:06.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.852+0000 7fcb4f200640 1 -- 172.21.15.57:0/409262624 >> 172.21.15.57:0/409262624 conn(0x7fcb480d3f70 msgr2=0x7fcb480d2960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:06.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.853+0000 7fcb4f200640 1 -- 172.21.15.57:0/409262624 shutdown_connections 2024-03-27T10:01:06.843 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:06.853+0000 7fcb4f200640 1 -- 172.21.15.57:0/409262624 wait complete. 2024-03-27T10:01:06.862 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-27T10:01:07.091 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.102+0000 7f2006400640 1 Processor -- start 2024-03-27T10:01:07.091 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.102+0000 7f2006400640 1 -- start start 2024-03-27T10:01:07.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.104+0000 7f2006400640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2000161850 0x7f20000b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:07.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.104+0000 7f2006400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f20000d0d70 0x7f20000b72d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:07.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.104+0000 7f2006400640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20000b6e20 con 0x7f2000161c30 2024-03-27T10:01:07.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.104+0000 7f2006400640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f20000cf650 con 0x7f2000161850 2024-03-27T10:01:07.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.104+0000 7f2006400640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f20000cf8a0 con 0x7f20000d0d70 2024-03-27T10:01:07.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.104+0000 7f1fffe00640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f2000161c30 0x7f20000d0660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:39712/0 (socket says 172.21.15.57:39712) 2024-03-27T10:01:07.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.104+0000 7f1fffe00640 1 -- 172.21.15.57:0/4282116857 learned_addr learned my addr 172.21.15.57:0/4282116857 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T10:01:07.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.104+0000 7f2005000640 1 --2- 172.21.15.57:0/4282116857 >> v2:172.21.15.57:3300/0 conn(0x7f2000161850 0x7f20000b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:07.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.105+0000 7f2005a00640 1 --2- 172.21.15.57:0/4282116857 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f20000d0d70 0x7f20000b72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:07.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.105+0000 7f2005000640 1 -- 172.21.15.57:0/4282116857 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f20000d0d70 msgr2=0x7f20000b72d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:01:07.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.105+0000 7f2005000640 1 --2- 172.21.15.57:0/4282116857 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f20000d0d70 0x7f20000b72d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:07.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.105+0000 7f2005000640 1 -- 172.21.15.57:0/4282116857 >> v1:172.21.15.57:6789/0 conn(0x7f2000161c30 legacy=0x7f20000d0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:07.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.105+0000 7f2005000640 1 -- 172.21.15.57:0/4282116857 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20000cfb80 con 0x7f2000161850 2024-03-27T10:01:07.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.105+0000 7f2005a00640 1 --2- 172.21.15.57:0/4282116857 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f20000d0d70 0x7f20000b72d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T10:01:07.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.105+0000 7f1fff400640 1 -- 172.21.15.57:0/4282116857 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1567084546 0 0) 0x7f20000b6e20 con 0x7f2000161c30 2024-03-27T10:01:07.096 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.106+0000 7f2005000640 1 --2- 172.21.15.57:0/4282116857 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2000161850 0x7f20000b4f30 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f1ff0009d90 tx=0x7f1ff002be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d16b7fd28b857ae server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:07.096 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.106+0000 7f1fff400640 1 -- 172.21.15.57:0/4282116857 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ff0039070 con 0x7f2000161850 2024-03-27T10:01:07.097 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.106+0000 7f1fff400640 1 -- 172.21.15.57:0/4282116857 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ff002cbd0 con 0x7f2000161850 2024-03-27T10:01:07.097 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.106+0000 7f1fff400640 1 -- 172.21.15.57:0/4282116857 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ff0034440 con 0x7f2000161850 2024-03-27T10:01:07.097 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.107+0000 7f2006400640 1 -- 172.21.15.57:0/4282116857 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2000161850 msgr2=0x7f20000b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:07.097 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.107+0000 7f2006400640 1 --2- 172.21.15.57:0/4282116857 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2000161850 0x7f20000b4f30 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f1ff0009d90 tx=0x7f1ff002be20 comp rx=0 tx=0).stop 2024-03-27T10:01:07.097 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.107+0000 7f2006400640 1 -- 172.21.15.57:0/4282116857 shutdown_connections 2024-03-27T10:01:07.097 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.107+0000 7f2006400640 1 --2- 172.21.15.57:0/4282116857 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f20000d0d70 0x7f20000b72d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:07.097 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.107+0000 7f2006400640 1 --2- 172.21.15.57:0/4282116857 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2000161850 0x7f20000b4f30 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:07.097 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.107+0000 7f2006400640 1 -- 172.21.15.57:0/4282116857 >> 172.21.15.57:0/4282116857 conn(0x7f20000d3f30 msgr2=0x7f20000d4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:07.097 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.107+0000 7f2006400640 1 -- 172.21.15.57:0/4282116857 shutdown_connections 2024-03-27T10:01:07.097 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.107+0000 7f2006400640 1 -- 172.21.15.57:0/4282116857 wait complete. 2024-03-27T10:01:07.098 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.109+0000 7f2006400640 1 Processor -- start 2024-03-27T10:01:07.098 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.109+0000 7f2006400640 1 -- start start 2024-03-27T10:01:07.100 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.110+0000 7f2006400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f20000d0d70 0x7f200015d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:07.100 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.110+0000 7f2006400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2000161850 0x7f200006ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:07.100 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.110+0000 7f2006400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f20000b21b0 0x7f200006d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:07.100 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.110+0000 7f2006400640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f20000d2f80 con 0x7f20000d0d70 2024-03-27T10:01:07.100 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.110+0000 7f2006400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f20000d2e00 con 0x7f2000161850 2024-03-27T10:01:07.100 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.110+0000 7f2006400640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f20000d4a50 con 0x7f20000b21b0 2024-03-27T10:01:07.100 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.110+0000 7f2005000640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f20000d0d70 0x7f200015d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:07.100 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.110+0000 7f2005000640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f20000d0d70 0x7f200015d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56726/0 (socket says 172.21.15.57:56726) 2024-03-27T10:01:07.100 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.110+0000 7f2005000640 1 -- 172.21.15.57:0/2884079472 learned_addr learned my addr 172.21.15.57:0/2884079472 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:01:07.100 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.110+0000 7f1fffe00640 1 --2- 172.21.15.57:0/2884079472 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2000161850 0x7f200006ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:07.100 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.110+0000 7f2005000640 1 -- 172.21.15.57:0/2884079472 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f20000b21b0 msgr2=0x7f200006d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:07.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.110+0000 7f2005000640 1 --2- 172.21.15.57:0/2884079472 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f20000b21b0 0x7f200006d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:07.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.110+0000 7f2005000640 1 -- 172.21.15.57:0/2884079472 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2000161850 msgr2=0x7f200006ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:07.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.111+0000 7f2005000640 1 --2- 172.21.15.57:0/2884079472 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2000161850 0x7f200006ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:07.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.111+0000 7f2005000640 1 -- 172.21.15.57:0/2884079472 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20000b1430 con 0x7f20000d0d70 2024-03-27T10:01:07.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.111+0000 7f1fffe00640 1 --2- 172.21.15.57:0/2884079472 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2000161850 0x7f200006ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T10:01:07.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.111+0000 7f2005000640 1 --2- 172.21.15.57:0/2884079472 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f20000d0d70 0x7f200015d310 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f1ff0037040 tx=0x7f1ff0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:07.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.111+0000 7f1ffcc00640 1 -- 172.21.15.57:0/2884079472 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ff0039050 con 0x7f20000d0d70 2024-03-27T10:01:07.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.111+0000 7f1ffcc00640 1 -- 172.21.15.57:0/2884079472 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ff0045070 con 0x7f20000d0d70 2024-03-27T10:01:07.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.111+0000 7f1ffcc00640 1 -- 172.21.15.57:0/2884079472 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ff003ea50 con 0x7f20000d0d70 2024-03-27T10:01:07.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.111+0000 7f2006400640 1 -- 172.21.15.57:0/2884079472 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20000b16d0 con 0x7f20000d0d70 2024-03-27T10:01:07.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.111+0000 7f2006400640 1 -- 172.21.15.57:0/2884079472 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20000b1c90 con 0x7f20000d0d70 2024-03-27T10:01:07.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.113+0000 7f2006400640 1 -- 172.21.15.57:0/2884079472 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2000068540 con 0x7f20000d0d70 2024-03-27T10:01:07.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.113+0000 7f1ffcc00640 1 -- 172.21.15.57:0/2884079472 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f1ff002ca50 con 0x7f20000d0d70 2024-03-27T10:01:07.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.115+0000 7f1ffcc00640 1 --2- 172.21.15.57:0/2884079472 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f1fdc06c530 0x7f1fdc06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:07.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.115+0000 7f1ffcc00640 1 -- 172.21.15.57:0/2884079472 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f1ff00aeab0 con 0x7f20000d0d70 2024-03-27T10:01:07.104 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.115+0000 7f1fffe00640 1 --2- 172.21.15.57:0/2884079472 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f1fdc06c530 0x7f1fdc06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:07.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.116+0000 7f1fffe00640 1 --2- 172.21.15.57:0/2884079472 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f1fdc06c530 0x7f1fdc06e9f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f20000cc860 tx=0x7f1fe8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:07.109 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.120+0000 7f1ffcc00640 1 -- 172.21.15.57:0/2884079472 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f1ff007cde0 con 0x7f20000d0d70 2024-03-27T10:01:07.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.326+0000 7f2006400640 1 -- 172.21.15.57:0/2884079472 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f20000ce3d0 con 0x7f20000d0d70 2024-03-27T10:01:07.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.327+0000 7f1ffcc00640 1 -- 172.21.15.57:0/2884079472 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) ==== 104+0+11 (secure 0 0 0) 0x7f1ff007c6e0 con 0x7f20000d0d70 2024-03-27T10:01:07.316 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2024-03-27T10:01:07.318 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.329+0000 7f2006400640 1 -- 172.21.15.57:0/2884079472 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f1fdc06c530 msgr2=0x7f1fdc06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:07.318 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.329+0000 7f2006400640 1 --2- 172.21.15.57:0/2884079472 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f1fdc06c530 0x7f1fdc06e9f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f20000cc860 tx=0x7f1fe8009040 comp rx=0 tx=0).stop 2024-03-27T10:01:07.318 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.329+0000 7f2006400640 1 -- 172.21.15.57:0/2884079472 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f20000d0d70 msgr2=0x7f200015d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:07.319 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.329+0000 7f2006400640 1 --2- 172.21.15.57:0/2884079472 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f20000d0d70 0x7f200015d310 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f1ff0037040 tx=0x7f1ff0004a40 comp rx=0 tx=0).stop 2024-03-27T10:01:07.319 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.329+0000 7f2006400640 1 -- 172.21.15.57:0/2884079472 shutdown_connections 2024-03-27T10:01:07.319 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.329+0000 7f2006400640 1 --2- 172.21.15.57:0/2884079472 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f20000b21b0 0x7f200006d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:07.319 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.329+0000 7f2006400640 1 --2- 172.21.15.57:0/2884079472 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f1fdc06c530 0x7f1fdc06e9f0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:07.319 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.329+0000 7f2006400640 1 --2- 172.21.15.57:0/2884079472 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2000161850 0x7f200006ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:07.319 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.329+0000 7f2006400640 1 --2- 172.21.15.57:0/2884079472 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f20000d0d70 0x7f200015d310 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:07.319 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.329+0000 7f2006400640 1 -- 172.21.15.57:0/2884079472 >> 172.21.15.57:0/2884079472 conn(0x7f20000d3f30 msgr2=0x7f20000d0330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:07.320 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.330+0000 7f2006400640 1 -- 172.21.15.57:0/2884079472 shutdown_connections 2024-03-27T10:01:07.320 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.330+0000 7f2006400640 1 -- 172.21.15.57:0/2884079472 wait complete. 2024-03-27T10:01:07.340 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-27T10:01:07.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.580+0000 7f0251400640 1 Processor -- start 2024-03-27T10:01:07.569 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.580+0000 7f0251400640 1 -- start start 2024-03-27T10:01:07.570 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.581+0000 7f0251400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f024c15f540 0x7f024c06b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:07.571 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.581+0000 7f0251400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f024c0af580 0x7f024c06ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:07.571 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.581+0000 7f0251400640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f024c0ae120 con 0x7f024c0adbb0 2024-03-27T10:01:07.571 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.581+0000 7f0251400640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f024c0ae400 con 0x7f024c0af580 2024-03-27T10:01:07.571 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.581+0000 7f0251400640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f024c0ae6e0 con 0x7f024c15f540 2024-03-27T10:01:07.571 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.582+0000 7f0250a00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f024c0af580 0x7f024c06ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:07.572 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.582+0000 7f024be00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f024c15f540 0x7f024c06b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:07.572 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.582+0000 7f0250a00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f024c0af580 0x7f024c06ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.57:60886/0 (socket says 172.21.15.57:60886) 2024-03-27T10:01:07.572 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.582+0000 7f0250a00640 1 -- 172.21.15.57:0/3342841468 learned_addr learned my addr 172.21.15.57:0/3342841468 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:01:07.572 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.583+0000 7f0250a00640 1 -- 172.21.15.57:0/3342841468 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f024c15f540 msgr2=0x7f024c06b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:01:07.572 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.583+0000 7f0250a00640 1 --2- 172.21.15.57:0/3342841468 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f024c15f540 0x7f024c06b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:07.572 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.583+0000 7f0250a00640 1 -- 172.21.15.57:0/3342841468 >> v1:172.21.15.118:6789/0 conn(0x7f024c0adbb0 legacy=0x7f024c072c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:07.572 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.583+0000 7f0250a00640 1 -- 172.21.15.57:0/3342841468 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f024c0ae9c0 con 0x7f024c0af580 2024-03-27T10:01:07.573 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.584+0000 7f0250a00640 1 --2- 172.21.15.57:0/3342841468 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f024c0af580 0x7f024c06ba80 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0244009e50 tx=0x7f024402bee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ded5ad0541514927 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:07.574 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.585+0000 7f024aa00640 1 -- 172.21.15.57:0/3342841468 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f024402ca80 con 0x7f024c0af580 2024-03-27T10:01:07.574 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.585+0000 7f024aa00640 1 -- 172.21.15.57:0/3342841468 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f024402cc20 con 0x7f024c0af580 2024-03-27T10:01:07.574 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.585+0000 7f024aa00640 1 -- 172.21.15.57:0/3342841468 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02440343f0 con 0x7f024c0af580 2024-03-27T10:01:07.575 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.586+0000 7f0251400640 1 -- 172.21.15.57:0/3342841468 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f024c0af580 msgr2=0x7f024c06ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:07.575 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.586+0000 7f0251400640 1 --2- 172.21.15.57:0/3342841468 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f024c0af580 0x7f024c06ba80 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0244009e50 tx=0x7f024402bee0 comp rx=0 tx=0).stop 2024-03-27T10:01:07.575 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.586+0000 7f0251400640 1 -- 172.21.15.57:0/3342841468 shutdown_connections 2024-03-27T10:01:07.575 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.586+0000 7f0251400640 1 --2- 172.21.15.57:0/3342841468 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f024c0af580 0x7f024c06ba80 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:07.575 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.586+0000 7f0251400640 1 --2- 172.21.15.57:0/3342841468 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f024c15f540 0x7f024c06b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:07.575 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.586+0000 7f0251400640 1 -- 172.21.15.57:0/3342841468 >> 172.21.15.57:0/3342841468 conn(0x7f024c0b3300 msgr2=0x7f024c0b3710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:07.575 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.586+0000 7f0251400640 1 -- 172.21.15.57:0/3342841468 shutdown_connections 2024-03-27T10:01:07.576 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.586+0000 7f0251400640 1 -- 172.21.15.57:0/3342841468 wait complete. 2024-03-27T10:01:07.577 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.588+0000 7f0251400640 1 Processor -- start 2024-03-27T10:01:07.577 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.588+0000 7f0251400640 1 -- start start 2024-03-27T10:01:07.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.589+0000 7f0251400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f024c0adbb0 0x7f024c157c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:07.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.589+0000 7f0251400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f024c0af580 0x7f024c0c4f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:07.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.589+0000 7f0251400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f024c15f540 0x7f024c0b2280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:07.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.589+0000 7f0251400640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f024c0cf320 con 0x7f024c15f540 2024-03-27T10:01:07.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.589+0000 7f0251400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f024c15f920 con 0x7f024c0af580 2024-03-27T10:01:07.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.589+0000 7f0251400640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f024c0af1c0 con 0x7f024c0adbb0 2024-03-27T10:01:07.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.589+0000 7f0250a00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f024c15f540 0x7f024c0b2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:07.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.589+0000 7f0250a00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f024c15f540 0x7f024c0b2280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56738/0 (socket says 172.21.15.57:56738) 2024-03-27T10:01:07.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.589+0000 7f0250a00640 1 -- 172.21.15.57:0/3071363933 learned_addr learned my addr 172.21.15.57:0/3071363933 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:01:07.580 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.590+0000 7f024b400640 1 --2- 172.21.15.57:0/3071363933 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f024c0af580 0x7f024c0c4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:07.580 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.590+0000 7f024be00640 1 --2- 172.21.15.57:0/3071363933 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f024c0adbb0 0x7f024c157c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:07.580 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.590+0000 7f0250a00640 1 -- 172.21.15.57:0/3071363933 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f024c0adbb0 msgr2=0x7f024c157c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:07.580 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.590+0000 7f0250a00640 1 --2- 172.21.15.57:0/3071363933 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f024c0adbb0 0x7f024c157c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:07.580 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.590+0000 7f0250a00640 1 -- 172.21.15.57:0/3071363933 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f024c0af580 msgr2=0x7f024c0c4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:07.580 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.590+0000 7f0250a00640 1 --2- 172.21.15.57:0/3071363933 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f024c0af580 0x7f024c0c4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:07.580 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.590+0000 7f0250a00640 1 -- 172.21.15.57:0/3071363933 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f024c0b1680 con 0x7f024c15f540 2024-03-27T10:01:07.580 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.590+0000 7f024be00640 1 --2- 172.21.15.57:0/3071363933 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f024c0adbb0 0x7f024c157c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T10:01:07.581 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.590+0000 7f0250a00640 1 --2- 172.21.15.57:0/3071363933 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f024c15f540 0x7f024c0b2280 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f0244009e50 tx=0x7f0244004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:07.581 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.591+0000 7f0243e00640 1 -- 172.21.15.57:0/3071363933 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0244043020 con 0x7f024c15f540 2024-03-27T10:01:07.581 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.591+0000 7f0243e00640 1 -- 172.21.15.57:0/3071363933 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f024403e450 con 0x7f024c15f540 2024-03-27T10:01:07.581 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.591+0000 7f0243e00640 1 -- 172.21.15.57:0/3071363933 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f024403e840 con 0x7f024c15f540 2024-03-27T10:01:07.581 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.591+0000 7f0251400640 1 -- 172.21.15.57:0/3071363933 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f024c1582e0 con 0x7f024c15f540 2024-03-27T10:01:07.581 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.591+0000 7f0251400640 1 -- 172.21.15.57:0/3071363933 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f024c158860 con 0x7f024c15f540 2024-03-27T10:01:07.581 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.592+0000 7f0251400640 1 -- 172.21.15.57:0/3071363933 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f024c068c50 con 0x7f024c15f540 2024-03-27T10:01:07.582 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.593+0000 7f0243e00640 1 -- 172.21.15.57:0/3071363933 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f0244046020 con 0x7f024c15f540 2024-03-27T10:01:07.583 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.594+0000 7f0243e00640 1 --2- 172.21.15.57:0/3071363933 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f022c06c530 0x7f022c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:07.583 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.594+0000 7f0243e00640 1 -- 172.21.15.57:0/3071363933 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f02440ae330 con 0x7f024c15f540 2024-03-27T10:01:07.583 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.594+0000 7f024be00640 1 --2- 172.21.15.57:0/3071363933 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f022c06c530 0x7f022c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:07.584 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.595+0000 7f024be00640 1 --2- 172.21.15.57:0/3071363933 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f022c06c530 0x7f022c06e9f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f023c009ac0 tx=0x7f023c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:07.587 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.599+0000 7f0243e00640 1 -- 172.21.15.57:0/3071363933 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f024404d030 con 0x7f024c15f540 2024-03-27T10:01:07.789 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.800+0000 7f0251400640 1 -- 172.21.15.57:0/3071363933 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f024c0b38f0 con 0x7f024c15f540 2024-03-27T10:01:07.789 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.800+0000 7f0243e00640 1 -- 172.21.15.57:0/3071363933 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) ==== 100+0+11 (secure 0 0 0) 0x7f024407c430 con 0x7f024c15f540 2024-03-27T10:01:07.790 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2024-03-27T10:01:07.795 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.803+0000 7f0251400640 1 -- 172.21.15.57:0/3071363933 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f022c06c530 msgr2=0x7f022c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:07.795 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.803+0000 7f0251400640 1 --2- 172.21.15.57:0/3071363933 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f022c06c530 0x7f022c06e9f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f023c009ac0 tx=0x7f023c008040 comp rx=0 tx=0).stop 2024-03-27T10:01:07.795 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.803+0000 7f0251400640 1 -- 172.21.15.57:0/3071363933 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f024c15f540 msgr2=0x7f024c0b2280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:07.795 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.803+0000 7f0251400640 1 --2- 172.21.15.57:0/3071363933 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f024c15f540 0x7f024c0b2280 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f0244009e50 tx=0x7f0244004a40 comp rx=0 tx=0).stop 2024-03-27T10:01:07.795 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.803+0000 7f0251400640 1 -- 172.21.15.57:0/3071363933 shutdown_connections 2024-03-27T10:01:07.795 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.803+0000 7f0251400640 1 --2- 172.21.15.57:0/3071363933 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f024c15f540 0x7f024c0b2280 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:07.795 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.803+0000 7f0251400640 1 --2- 172.21.15.57:0/3071363933 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f022c06c530 0x7f022c06e9f0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:07.795 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.803+0000 7f0251400640 1 --2- 172.21.15.57:0/3071363933 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f024c0af580 0x7f024c0c4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:07.795 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.803+0000 7f0251400640 1 --2- 172.21.15.57:0/3071363933 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f024c0adbb0 0x7f024c157c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:07.795 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.803+0000 7f0251400640 1 -- 172.21.15.57:0/3071363933 >> 172.21.15.57:0/3071363933 conn(0x7f024c0b3300 msgr2=0x7f024c0cf4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:07.795 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.803+0000 7f0251400640 1 -- 172.21.15.57:0/3071363933 shutdown_connections 2024-03-27T10:01:07.796 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:07.803+0000 7f0251400640 1 -- 172.21.15.57:0/3071363933 wait complete. 2024-03-27T10:01:07.814 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-03-27T10:01:08.042 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.052+0000 7fcde8e00640 1 Processor -- start 2024-03-27T10:01:08.042 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.053+0000 7fcde8e00640 1 -- start start 2024-03-27T10:01:08.043 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.054+0000 7fcde8e00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fcde40d1070 0x7fcde415da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:08.044 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.054+0000 7fcde8e00640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcde40b1170 con 0x7fcde40cecf0 2024-03-27T10:01:08.044 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.054+0000 7fcde8e00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcde40afca0 con 0x7fcde406c8d0 2024-03-27T10:01:08.044 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.054+0000 7fcde8e00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7fcde40afa50 con 0x7fcde40d1070 2024-03-27T10:01:08.044 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.055+0000 7fcde3400640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fcde40cecf0 0x7fcde40b0a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:39716/0 (socket says 172.21.15.57:39716) 2024-03-27T10:01:08.044 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.055+0000 7fcde3400640 1 -- 172.21.15.57:0/4022865496 learned_addr learned my addr 172.21.15.57:0/4022865496 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T10:01:08.046 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.055+0000 7fcde3e00640 1 --2- 172.21.15.57:0/4022865496 >> v2:172.21.15.118:3300/0 conn(0x7fcde40d1070 0x7fcde415da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:08.046 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.055+0000 7fcde2000640 1 -- 172.21.15.57:0/4022865496 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 12122653 0 0) 0x7fcde40b1170 con 0x7fcde40cecf0 2024-03-27T10:01:08.046 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.055+0000 7fcde2000640 1 -- 172.21.15.57:0/4022865496 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcdc8003520 con 0x7fcde40cecf0 2024-03-27T10:01:08.046 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.056+0000 7fcde2000640 1 -- 172.21.15.57:0/4022865496 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2940683737 0 0) 0x7fcdc8003520 con 0x7fcde40cecf0 2024-03-27T10:01:08.046 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.056+0000 7fcde2000640 1 -- 172.21.15.57:0/4022865496 >> v2:172.21.15.118:3300/0 conn(0x7fcde40d1070 msgr2=0x7fcde415da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:01:08.046 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.056+0000 7fcde2000640 1 --2- 172.21.15.57:0/4022865496 >> v2:172.21.15.118:3300/0 conn(0x7fcde40d1070 0x7fcde415da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:08.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.056+0000 7fcde2000640 1 -- 172.21.15.57:0/4022865496 >> v1:172.21.15.118:6789/0 conn(0x7fcde406c8d0 legacy=0x7fcde40b1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:08.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.056+0000 7fcde2000640 1 -- 172.21.15.57:0/4022865496 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcde40aff80 con 0x7fcde40cecf0 2024-03-27T10:01:08.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.056+0000 7fcde2000640 1 -- 172.21.15.57:0/4022865496 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4227751516 0 0) 0x7fcdd4001670 con 0x7fcde40cecf0 2024-03-27T10:01:08.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.056+0000 7fcde2000640 1 -- 172.21.15.57:0/4022865496 >> v1:172.21.15.57:6789/0 conn(0x7fcde40cecf0 legacy=0x7fcde40b0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:08.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.056+0000 7fcde2000640 1 --2- 172.21.15.57:0/4022865496 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcdc8003a00 0x7fcdc8003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:08.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.056+0000 7fcde2000640 1 --2- 172.21.15.57:0/4022865496 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcdc8004800 0x7fcdc8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:08.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.056+0000 7fcde2000640 1 --2- 172.21.15.57:0/4022865496 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcdc80052c0 0x7fcdc800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:08.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.056+0000 7fcde2000640 1 -- 172.21.15.57:0/4022865496 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fcde40afa50 con 0x7fcdc8003a00 2024-03-27T10:01:08.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.056+0000 7fcde2000640 1 -- 172.21.15.57:0/4022865496 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fcdc800c200 con 0x7fcdc80052c0 2024-03-27T10:01:08.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.056+0000 7fcde2000640 1 -- 172.21.15.57:0/4022865496 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fcdc800c400 con 0x7fcdc8004800 2024-03-27T10:01:08.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.056+0000 7fcde3400640 1 --2- 172.21.15.57:0/4022865496 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcdc8003a00 0x7fcdc8003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:08.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.057+0000 7fcde2a00640 1 --2- 172.21.15.57:0/4022865496 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcdc8004800 0x7fcdc8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:08.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.057+0000 7fcde3400640 1 -- 172.21.15.57:0/4022865496 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcdc8004800 msgr2=0x7fcdc8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:01:08.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.057+0000 7fcde3400640 1 --2- 172.21.15.57:0/4022865496 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcdc8004800 0x7fcdc8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:08.048 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.057+0000 7fcde3400640 1 -- 172.21.15.57:0/4022865496 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcdc80052c0 msgr2=0x7fcdc800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:01:08.048 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.057+0000 7fcde3400640 1 --2- 172.21.15.57:0/4022865496 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcdc80052c0 0x7fcdc800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:08.048 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.057+0000 7fcde3400640 1 -- 172.21.15.57:0/4022865496 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdc8003520 con 0x7fcdc8003a00 2024-03-27T10:01:08.048 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.057+0000 7fcde3e00640 1 -- 172.21.15.57:0/4022865496 reap_dead start 2024-03-27T10:01:08.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.058+0000 7fcde3400640 1 --2- 172.21.15.57:0/4022865496 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcdc8003a00 0x7fcdc8003e40 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fcdd400c190 tx=0x7fcdc8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2c578bb19e051cd server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:08.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.058+0000 7fcde2000640 1 -- 172.21.15.57:0/4022865496 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdd4007c60 con 0x7fcdc8003a00 2024-03-27T10:01:08.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.058+0000 7fcde2000640 1 -- 172.21.15.57:0/4022865496 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdd4030070 con 0x7fcdc8003a00 2024-03-27T10:01:08.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.058+0000 7fcde2000640 1 -- 172.21.15.57:0/4022865496 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdd4005d10 con 0x7fcdc8003a00 2024-03-27T10:01:08.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.059+0000 7fcde8e00640 1 -- 172.21.15.57:0/4022865496 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcdc8003a00 msgr2=0x7fcdc8003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:08.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.059+0000 7fcde8e00640 1 --2- 172.21.15.57:0/4022865496 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcdc8003a00 0x7fcdc8003e40 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fcdd400c190 tx=0x7fcdc8005830 comp rx=0 tx=0).stop 2024-03-27T10:01:08.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.059+0000 7fcde8e00640 1 -- 172.21.15.57:0/4022865496 shutdown_connections 2024-03-27T10:01:08.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.059+0000 7fcde8e00640 1 --2- 172.21.15.57:0/4022865496 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcdc8003a00 0x7fcdc8003e40 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:08.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.059+0000 7fcde8e00640 1 -- 172.21.15.57:0/4022865496 >> 172.21.15.57:0/4022865496 conn(0x7fcde40d1d90 msgr2=0x7fcde40d21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:08.049 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.059+0000 7fcde8e00640 1 -- 172.21.15.57:0/4022865496 shutdown_connections 2024-03-27T10:01:08.050 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.059+0000 7fcde8e00640 1 -- 172.21.15.57:0/4022865496 wait complete. 2024-03-27T10:01:08.050 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.061+0000 7fcde8e00640 1 Processor -- start 2024-03-27T10:01:08.050 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.061+0000 7fcde8e00640 1 -- start start 2024-03-27T10:01:08.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.062+0000 7fcde8e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcdc8003a00 0x7fcde415a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:08.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.062+0000 7fcde8e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcde415b590 0x7fcde41581a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:08.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.062+0000 7fcde8e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcde414d9e0 0x7fcde41f7280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:08.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.062+0000 7fcde8e00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fcde40cf0d0 con 0x7fcdc8003a00 2024-03-27T10:01:08.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.062+0000 7fcde8e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fcde40b0540 con 0x7fcde415b590 2024-03-27T10:01:08.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.062+0000 7fcde8e00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fcde40b0a60 con 0x7fcde414d9e0 2024-03-27T10:01:08.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.062+0000 7fcde3400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcdc8003a00 0x7fcde415a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:08.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.062+0000 7fcde3400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcdc8003a00 0x7fcde415a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56760/0 (socket says 172.21.15.57:56760) 2024-03-27T10:01:08.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.062+0000 7fcde3400640 1 -- 172.21.15.57:0/4215778629 learned_addr learned my addr 172.21.15.57:0/4215778629 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:01:08.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.062+0000 7fcde2a00640 1 --2- 172.21.15.57:0/4215778629 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcde415b590 0x7fcde41581a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:08.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.062+0000 7fcde3400640 1 -- 172.21.15.57:0/4215778629 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcde414d9e0 msgr2=0x7fcde41f7280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:08.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.062+0000 7fcde3400640 1 --2- 172.21.15.57:0/4215778629 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcde414d9e0 0x7fcde41f7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:08.053 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.062+0000 7fcde3400640 1 -- 172.21.15.57:0/4215778629 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcde415b590 msgr2=0x7fcde41581a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:08.053 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.062+0000 7fcde3400640 1 --2- 172.21.15.57:0/4215778629 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcde415b590 0x7fcde41581a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:08.053 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.063+0000 7fcde3400640 1 -- 172.21.15.57:0/4215778629 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcde415ae20 con 0x7fcdc8003a00 2024-03-27T10:01:08.053 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.063+0000 7fcde2a00640 1 --2- 172.21.15.57:0/4215778629 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcde415b590 0x7fcde41581a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T10:01:08.053 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.063+0000 7fcde3400640 1 --2- 172.21.15.57:0/4215778629 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcdc8003a00 0x7fcde415a8e0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fcdd4000c00 tx=0x7fcde40cfbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:08.054 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.063+0000 7fcddb400640 1 -- 172.21.15.57:0/4215778629 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdd4045070 con 0x7fcdc8003a00 2024-03-27T10:01:08.054 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.063+0000 7fcddb400640 1 -- 172.21.15.57:0/4215778629 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdd40049f0 con 0x7fcdc8003a00 2024-03-27T10:01:08.054 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.063+0000 7fcddb400640 1 -- 172.21.15.57:0/4215778629 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdd4007c60 con 0x7fcdc8003a00 2024-03-27T10:01:08.054 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.063+0000 7fcde8e00640 1 -- 172.21.15.57:0/4215778629 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcde415e260 con 0x7fcdc8003a00 2024-03-27T10:01:08.054 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.063+0000 7fcde8e00640 1 -- 172.21.15.57:0/4215778629 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcde40b64b0 con 0x7fcdc8003a00 2024-03-27T10:01:08.054 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.065+0000 7fcde8e00640 1 -- 172.21.15.57:0/4215778629 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcde4068c50 con 0x7fcdc8003a00 2024-03-27T10:01:08.054 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.066+0000 7fcddb400640 1 -- 172.21.15.57:0/4215778629 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fcdd4007070 con 0x7fcdc8003a00 2024-03-27T10:01:08.056 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.067+0000 7fcddb400640 1 --2- 172.21.15.57:0/4215778629 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fcdc006c560 0x7fcdc006ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:08.056 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.067+0000 7fcddb400640 1 -- 172.21.15.57:0/4215778629 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fcdd40ac6b0 con 0x7fcdc8003a00 2024-03-27T10:01:08.056 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.068+0000 7fcde2a00640 1 --2- 172.21.15.57:0/4215778629 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fcdc006c560 0x7fcdc006ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:08.057 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.068+0000 7fcde2a00640 1 --2- 172.21.15.57:0/4215778629 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fcdc006c560 0x7fcdc006ea20 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fcde41f8380 tx=0x7fcdcc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:08.061 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.072+0000 7fcddb400640 1 -- 172.21.15.57:0/4215778629 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7fcdd407a830 con 0x7fcdc8003a00 2024-03-27T10:01:08.264 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.275+0000 7fcde8e00640 1 -- 172.21.15.57:0/4215778629 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fcde40b2390 con 0x7fcdc8003a00 2024-03-27T10:01:08.265 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.276+0000 7fcddb400640 1 -- 172.21.15.57:0/4215778629 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) ==== 103+0+11 (secure 0 0 0) 0x7fcdd407a130 con 0x7fcdc8003a00 2024-03-27T10:01:08.265 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2024-03-27T10:01:08.268 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.278+0000 7fcde8e00640 1 -- 172.21.15.57:0/4215778629 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fcdc006c560 msgr2=0x7fcdc006ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:08.268 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.278+0000 7fcde8e00640 1 --2- 172.21.15.57:0/4215778629 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fcdc006c560 0x7fcdc006ea20 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fcde41f8380 tx=0x7fcdcc009040 comp rx=0 tx=0).stop 2024-03-27T10:01:08.268 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.279+0000 7fcde8e00640 1 -- 172.21.15.57:0/4215778629 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcdc8003a00 msgr2=0x7fcde415a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:08.268 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.279+0000 7fcde8e00640 1 --2- 172.21.15.57:0/4215778629 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcdc8003a00 0x7fcde415a8e0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fcdd4000c00 tx=0x7fcde40cfbd0 comp rx=0 tx=0).stop 2024-03-27T10:01:08.268 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.279+0000 7fcde8e00640 1 -- 172.21.15.57:0/4215778629 shutdown_connections 2024-03-27T10:01:08.268 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.279+0000 7fcde8e00640 1 --2- 172.21.15.57:0/4215778629 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcde414d9e0 0x7fcde41f7280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:08.268 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.279+0000 7fcde8e00640 1 --2- 172.21.15.57:0/4215778629 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fcdc006c560 0x7fcdc006ea20 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:08.268 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.279+0000 7fcde8e00640 1 --2- 172.21.15.57:0/4215778629 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcde415b590 0x7fcde41581a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:08.268 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.279+0000 7fcde8e00640 1 --2- 172.21.15.57:0/4215778629 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcdc8003a00 0x7fcde415a8e0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:08.268 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.279+0000 7fcde8e00640 1 -- 172.21.15.57:0/4215778629 >> 172.21.15.57:0/4215778629 conn(0x7fcde40d1d90 msgr2=0x7fcde40ce350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:08.269 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.279+0000 7fcde8e00640 1 -- 172.21.15.57:0/4215778629 shutdown_connections 2024-03-27T10:01:08.269 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.279+0000 7fcde8e00640 1 -- 172.21.15.57:0/4215778629 wait complete. 2024-03-27T10:01:08.289 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-27T10:01:08.513 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.524+0000 7f55cac00640 1 Processor -- start 2024-03-27T10:01:08.513 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.524+0000 7f55cac00640 1 -- start start 2024-03-27T10:01:08.515 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.526+0000 7f55cac00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f55c406cd90 0x7f55c40714e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:08.515 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.526+0000 7f55cac00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f55c40b2cb0 0x7f55c40b3120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:08.515 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.526+0000 7f55cac00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55c41639d0 con 0x7f55c4163540 2024-03-27T10:01:08.515 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.526+0000 7f55cac00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f55c4160440 con 0x7f55c406cd90 2024-03-27T10:01:08.515 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.526+0000 7f55cac00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f55c4071be0 con 0x7f55c40b2cb0 2024-03-27T10:01:08.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.527+0000 7f55c9800640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f55c406cd90 0x7f55c40714e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:08.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.527+0000 7f55ca200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f55c40b2cb0 0x7f55c40b3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:08.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.527+0000 7f55c9800640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f55c406cd90 0x7f55c40714e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.57:60952/0 (socket says 172.21.15.57:60952) 2024-03-27T10:01:08.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.527+0000 7f55c9800640 1 -- 172.21.15.57:0/896211367 learned_addr learned my addr 172.21.15.57:0/896211367 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:01:08.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.528+0000 7f55c9800640 1 -- 172.21.15.57:0/896211367 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f55c40b2cb0 msgr2=0x7f55c40b3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:01:08.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.528+0000 7f55c9800640 1 --2- 172.21.15.57:0/896211367 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f55c40b2cb0 0x7f55c40b3120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:08.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.528+0000 7f55c9800640 1 -- 172.21.15.57:0/896211367 >> v1:172.21.15.118:6789/0 conn(0x7f55c4163540 legacy=0x7f55c406d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:08.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.528+0000 7f55c9800640 1 -- 172.21.15.57:0/896211367 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55c4071ec0 con 0x7f55c406cd90 2024-03-27T10:01:08.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.528+0000 7f55ca200640 1 --2- 172.21.15.57:0/896211367 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f55c40b2cb0 0x7f55c40b3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T10:01:08.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.529+0000 7f55c9800640 1 --2- 172.21.15.57:0/896211367 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f55c406cd90 0x7f55c40714e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f55b8009870 tx=0x7f55b802b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b9f32b242f60f1fb server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:08.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.529+0000 7f55c3e00640 1 -- 172.21.15.57:0/896211367 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55b8034070 con 0x7f55c406cd90 2024-03-27T10:01:08.519 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.530+0000 7f55c3e00640 1 -- 172.21.15.57:0/896211367 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55b8030840 con 0x7f55c406cd90 2024-03-27T10:01:08.519 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.530+0000 7f55c3e00640 1 -- 172.21.15.57:0/896211367 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55b8030c10 con 0x7f55c406cd90 2024-03-27T10:01:08.519 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.530+0000 7f55cac00640 1 -- 172.21.15.57:0/896211367 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f55c406cd90 msgr2=0x7f55c40714e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:08.519 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.530+0000 7f55cac00640 1 --2- 172.21.15.57:0/896211367 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f55c406cd90 0x7f55c40714e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f55b8009870 tx=0x7f55b802b980 comp rx=0 tx=0).stop 2024-03-27T10:01:08.520 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.531+0000 7f55cac00640 1 -- 172.21.15.57:0/896211367 shutdown_connections 2024-03-27T10:01:08.520 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.531+0000 7f55cac00640 1 --2- 172.21.15.57:0/896211367 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f55c40b2cb0 0x7f55c40b3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:08.520 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.531+0000 7f55cac00640 1 --2- 172.21.15.57:0/896211367 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f55c406cd90 0x7f55c40714e0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:08.520 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.531+0000 7f55cac00640 1 -- 172.21.15.57:0/896211367 >> 172.21.15.57:0/896211367 conn(0x7f55c40b1770 msgr2=0x7f55c40b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:08.520 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.531+0000 7f55cac00640 1 -- 172.21.15.57:0/896211367 shutdown_connections 2024-03-27T10:01:08.520 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.531+0000 7f55cac00640 1 -- 172.21.15.57:0/896211367 wait complete. 2024-03-27T10:01:08.522 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.533+0000 7f55cac00640 1 Processor -- start 2024-03-27T10:01:08.522 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.533+0000 7f55cac00640 1 -- start start 2024-03-27T10:01:08.524 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.535+0000 7f55cac00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f55c406cd90 0x7f55c41f8700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:08.524 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.535+0000 7f55cac00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f55c40b2cb0 0x7f55c41f8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:08.524 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.535+0000 7f55cac00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f55c4163540 0x7f55c41f9180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:08.524 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.535+0000 7f55cac00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f55c4072760 con 0x7f55c4163540 2024-03-27T10:01:08.524 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.535+0000 7f55cac00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f55c4072480 con 0x7f55c40b2cb0 2024-03-27T10:01:08.525 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.535+0000 7f55cac00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f55c40b3660 con 0x7f55c406cd90 2024-03-27T10:01:08.525 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.535+0000 7f55ca200640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f55c4163540 0x7f55c41f9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:08.525 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.535+0000 7f55ca200640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f55c4163540 0x7f55c41f9180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56772/0 (socket says 172.21.15.57:56772) 2024-03-27T10:01:08.525 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.535+0000 7f55ca200640 1 -- 172.21.15.57:0/297236779 learned_addr learned my addr 172.21.15.57:0/297236779 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:01:08.525 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.535+0000 7f55c9800640 1 --2- 172.21.15.57:0/297236779 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f55c406cd90 0x7f55c41f8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:08.525 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.535+0000 7f55c8e00640 1 --2- 172.21.15.57:0/297236779 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f55c40b2cb0 0x7f55c41f8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:08.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.536+0000 7f55ca200640 1 -- 172.21.15.57:0/297236779 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f55c406cd90 msgr2=0x7f55c41f8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:08.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.536+0000 7f55ca200640 1 --2- 172.21.15.57:0/297236779 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f55c406cd90 0x7f55c41f8700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:08.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.536+0000 7f55ca200640 1 -- 172.21.15.57:0/297236779 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f55c40b2cb0 msgr2=0x7f55c41f8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:08.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.536+0000 7f55ca200640 1 --2- 172.21.15.57:0/297236779 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f55c40b2cb0 0x7f55c41f8c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:08.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.536+0000 7f55ca200640 1 -- 172.21.15.57:0/297236779 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55c415fc60 con 0x7f55c4163540 2024-03-27T10:01:08.527 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.536+0000 7f55ca200640 1 --2- 172.21.15.57:0/297236779 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f55c4163540 0x7f55c41f9180 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f55bc00efc0 tx=0x7f55bc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:08.527 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.536+0000 7f55c1600640 1 -- 172.21.15.57:0/297236779 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55bc018030 con 0x7f55c4163540 2024-03-27T10:01:08.527 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.536+0000 7f55c1600640 1 -- 172.21.15.57:0/297236779 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55bc00cd30 con 0x7f55c4163540 2024-03-27T10:01:08.527 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.536+0000 7f55c1600640 1 -- 172.21.15.57:0/297236779 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55bc003bb0 con 0x7f55c4163540 2024-03-27T10:01:08.527 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.536+0000 7f55cac00640 1 -- 172.21.15.57:0/297236779 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55c415f3c0 con 0x7f55c4163540 2024-03-27T10:01:08.527 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.536+0000 7f55cac00640 1 -- 172.21.15.57:0/297236779 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55c4164cc0 con 0x7f55c4163540 2024-03-27T10:01:08.527 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.538+0000 7f55cac00640 1 -- 172.21.15.57:0/297236779 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55c4068540 con 0x7f55c4163540 2024-03-27T10:01:08.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.539+0000 7f55c1600640 1 -- 172.21.15.57:0/297236779 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f55bc005d10 con 0x7f55c4163540 2024-03-27T10:01:08.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.539+0000 7f55c1600640 1 --2- 172.21.15.57:0/297236779 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f55a406c530 0x7f55a406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:08.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.540+0000 7f55c1600640 1 -- 172.21.15.57:0/297236779 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f55bc08c4a0 con 0x7f55c4163540 2024-03-27T10:01:08.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.540+0000 7f55c9800640 1 --2- 172.21.15.57:0/297236779 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f55a406c530 0x7f55a406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:08.530 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.541+0000 7f55c9800640 1 --2- 172.21.15.57:0/297236779 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f55a406c530 0x7f55a406e9f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f55b8036000 tx=0x7f55b803b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:08.533 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.544+0000 7f55c1600640 1 -- 172.21.15.57:0/297236779 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f55bc022070 con 0x7f55c4163540 2024-03-27T10:01:08.780 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.791+0000 7f55cac00640 1 -- 172.21.15.57:0/297236779 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f55c40b4ca0 con 0x7f55c4163540 2024-03-27T10:01:08.781 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.792+0000 7f55c1600640 1 -- 172.21.15.57:0/297236779 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5183 (secure 0 0 0) 0x7f55bc010040 con 0x7f55c4163540 2024-03-27T10:01:08.781 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:01:08.781 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/1178943431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1178943431},{"type":"v1","addr":"172.21.15.118:6834","nonce":1178943431}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6836/1248533620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6835","nonce":1248533620},{"type":"v1","addr":"172.21.15.57:6836","nonce":1248533620}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6837/4133386889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":4133386889},{"type":"v1","addr":"172.21.15.57:6837","nonce":4133386889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-27T09:59:28.571425+0000","modified":"2024-03-27T09:59:55.863525+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6835/1823694233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":1823694233},{"type":"v1","addr":"172.21.15.118:6835","nonce":1823694233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4282,"qdb_cluster":[4282]},"id":1}]} 2024-03-27T10:01:08.781 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 9 2024-03-27T10:01:08.784 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.795+0000 7f55cac00640 1 -- 172.21.15.57:0/297236779 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f55a406c530 msgr2=0x7f55a406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:08.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.795+0000 7f55cac00640 1 --2- 172.21.15.57:0/297236779 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f55a406c530 0x7f55a406e9f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f55b8036000 tx=0x7f55b803b040 comp rx=0 tx=0).stop 2024-03-27T10:01:08.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.795+0000 7f55cac00640 1 -- 172.21.15.57:0/297236779 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f55c4163540 msgr2=0x7f55c41f9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:08.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.795+0000 7f55cac00640 1 --2- 172.21.15.57:0/297236779 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f55c4163540 0x7f55c41f9180 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f55bc00efc0 tx=0x7f55bc00c490 comp rx=0 tx=0).stop 2024-03-27T10:01:08.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.795+0000 7f55cac00640 1 -- 172.21.15.57:0/297236779 shutdown_connections 2024-03-27T10:01:08.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.795+0000 7f55cac00640 1 --2- 172.21.15.57:0/297236779 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f55c4163540 0x7f55c41f9180 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:08.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.795+0000 7f55cac00640 1 --2- 172.21.15.57:0/297236779 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f55a406c530 0x7f55a406e9f0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:08.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.795+0000 7f55cac00640 1 --2- 172.21.15.57:0/297236779 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f55c40b2cb0 0x7f55c41f8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:08.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.795+0000 7f55cac00640 1 --2- 172.21.15.57:0/297236779 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f55c406cd90 0x7f55c41f8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:08.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.795+0000 7f55cac00640 1 -- 172.21.15.57:0/297236779 >> 172.21.15.57:0/297236779 conn(0x7f55c40b1770 msgr2=0x7f55c40afc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:08.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.795+0000 7f55cac00640 1 -- 172.21.15.57:0/297236779 shutdown_connections 2024-03-27T10:01:08.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:08.795+0000 7f55cac00640 1 -- 172.21.15.57:0/297236779 wait complete. 2024-03-27T10:01:08.805 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-27T10:01:09.032 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.043+0000 7fc029400640 1 Processor -- start 2024-03-27T10:01:09.033 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.043+0000 7fc029400640 1 -- start start 2024-03-27T10:01:09.035 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.045+0000 7fc029400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fc024145820 0x7fc0240cc950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:09.035 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.045+0000 7fc029400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc02406b750 0x7fc02406bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:09.035 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.045+0000 7fc029400640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc0240b2b70 0x7fc0240b2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:09.035 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.045+0000 7fc029400640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7fc024160b60 con 0x7fc0240b2b70 2024-03-27T10:01:09.035 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.045+0000 7fc029400640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7fc02406c0d0 con 0x7fc024145820 2024-03-27T10:01:09.036 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.045+0000 7fc029400640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fc0240cce90 con 0x7fc02406b750 2024-03-27T10:01:09.036 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.045+0000 7fc023200640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc0240b2b70 0x7fc0240b2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:09.036 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.046+0000 7fc023200640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc0240b2b70 0x7fc0240b2fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56774/0 (socket says 172.21.15.57:56774) 2024-03-27T10:01:09.036 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.046+0000 7fc023200640 1 -- 172.21.15.57:0/733572324 learned_addr learned my addr 172.21.15.57:0/733572324 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:01:09.036 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.046+0000 7fc019e00640 1 --2- 172.21.15.57:0/733572324 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc02406b750 0x7fc02406bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:09.036 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.046+0000 7fc022800640 1 --2- 172.21.15.57:0/733572324 >> v2:172.21.15.118:3300/0 conn(0x7fc024145820 0x7fc0240cc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:09.036 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.046+0000 7fc023200640 1 -- 172.21.15.57:0/733572324 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc02406b750 msgr2=0x7fc02406bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:01:09.036 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.046+0000 7fc023200640 1 --2- 172.21.15.57:0/733572324 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc02406b750 0x7fc02406bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:09.036 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.046+0000 7fc023200640 1 -- 172.21.15.57:0/733572324 >> v2:172.21.15.118:3300/0 conn(0x7fc024145820 msgr2=0x7fc0240cc950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:01:09.036 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.046+0000 7fc023200640 1 --2- 172.21.15.57:0/733572324 >> v2:172.21.15.118:3300/0 conn(0x7fc024145820 0x7fc0240cc950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:09.036 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.046+0000 7fc023200640 1 -- 172.21.15.57:0/733572324 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc02415fc70 con 0x7fc0240b2b70 2024-03-27T10:01:09.037 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.047+0000 7fc023200640 1 --2- 172.21.15.57:0/733572324 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0240b2b70 0x7fc0240b2fe0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fc0240b4fc0 tx=0x7fc01c02b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=136adbdfcb678452 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:09.037 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.048+0000 7fc021e00640 1 -- 172.21.15.57:0/733572324 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc01c035020 con 0x7fc0240b2b70 2024-03-27T10:01:09.038 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.048+0000 7fc021e00640 1 -- 172.21.15.57:0/733572324 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc01c02d040 con 0x7fc0240b2b70 2024-03-27T10:01:09.038 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.048+0000 7fc021e00640 1 -- 172.21.15.57:0/733572324 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc01c031a80 con 0x7fc0240b2b70 2024-03-27T10:01:09.038 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.048+0000 7fc029400640 1 -- 172.21.15.57:0/733572324 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0240b2b70 msgr2=0x7fc0240b2fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:09.038 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.048+0000 7fc029400640 1 --2- 172.21.15.57:0/733572324 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0240b2b70 0x7fc0240b2fe0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fc0240b4fc0 tx=0x7fc01c02b900 comp rx=0 tx=0).stop 2024-03-27T10:01:09.038 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.048+0000 7fc029400640 1 -- 172.21.15.57:0/733572324 shutdown_connections 2024-03-27T10:01:09.038 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.048+0000 7fc029400640 1 --2- 172.21.15.57:0/733572324 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0240b2b70 0x7fc0240b2fe0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:09.038 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.048+0000 7fc029400640 1 --2- 172.21.15.57:0/733572324 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc02406b750 0x7fc02406bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:09.038 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.048+0000 7fc029400640 1 --2- 172.21.15.57:0/733572324 >> v2:172.21.15.118:3300/0 conn(0x7fc024145820 0x7fc0240cc950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:09.038 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.048+0000 7fc029400640 1 -- 172.21.15.57:0/733572324 >> 172.21.15.57:0/733572324 conn(0x7fc0240b1c60 msgr2=0x7fc0240b2070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:09.038 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.048+0000 7fc029400640 1 -- 172.21.15.57:0/733572324 shutdown_connections 2024-03-27T10:01:09.038 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.049+0000 7fc029400640 1 -- 172.21.15.57:0/733572324 wait complete. 2024-03-27T10:01:09.039 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.050+0000 7fc029400640 1 Processor -- start 2024-03-27T10:01:09.039 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.050+0000 7fc029400640 1 -- start start 2024-03-27T10:01:09.041 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.051+0000 7fc029400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc02406b750 0x7fc024155bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:09.041 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.051+0000 7fc029400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0240b2b70 0x7fc0240cf840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:09.041 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.051+0000 7fc029400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc024145820 0x7fc0241f5770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:09.041 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.051+0000 7fc029400640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fc024160510 con 0x7fc0240b2b70 2024-03-27T10:01:09.041 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.051+0000 7fc029400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fc024160230 con 0x7fc02406b750 2024-03-27T10:01:09.041 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.051+0000 7fc029400640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fc0241607f0 con 0x7fc024145820 2024-03-27T10:01:09.041 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.052+0000 7fc019e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0240b2b70 0x7fc0240cf840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:09.041 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.052+0000 7fc019e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0240b2b70 0x7fc0240cf840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56782/0 (socket says 172.21.15.57:56782) 2024-03-27T10:01:09.041 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.052+0000 7fc019e00640 1 -- 172.21.15.57:0/4070124632 learned_addr learned my addr 172.21.15.57:0/4070124632 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:01:09.041 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.052+0000 7fc022800640 1 --2- 172.21.15.57:0/4070124632 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc02406b750 0x7fc024155bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:09.041 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.052+0000 7fc023200640 1 --2- 172.21.15.57:0/4070124632 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc024145820 0x7fc0241f5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:09.042 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.052+0000 7fc019e00640 1 -- 172.21.15.57:0/4070124632 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc024145820 msgr2=0x7fc0241f5770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:09.043 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.052+0000 7fc019e00640 1 --2- 172.21.15.57:0/4070124632 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc024145820 0x7fc0241f5770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:09.043 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.052+0000 7fc019e00640 1 -- 172.21.15.57:0/4070124632 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc02406b750 msgr2=0x7fc024155bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:09.043 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.052+0000 7fc019e00640 1 --2- 172.21.15.57:0/4070124632 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc02406b750 0x7fc024155bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:09.043 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.052+0000 7fc019e00640 1 -- 172.21.15.57:0/4070124632 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc024156100 con 0x7fc0240b2b70 2024-03-27T10:01:09.043 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.052+0000 7fc023200640 1 --2- 172.21.15.57:0/4070124632 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc024145820 0x7fc0241f5770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T10:01:09.043 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.053+0000 7fc019e00640 1 --2- 172.21.15.57:0/4070124632 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0240b2b70 0x7fc0240cf840 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fc00c00d800 tx=0x7fc00c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:09.043 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.053+0000 7fc01b400640 1 -- 172.21.15.57:0/4070124632 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc00c018020 con 0x7fc0240b2b70 2024-03-27T10:01:09.043 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.053+0000 7fc01b400640 1 -- 172.21.15.57:0/4070124632 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc00c0096a0 con 0x7fc0240b2b70 2024-03-27T10:01:09.043 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.053+0000 7fc01b400640 1 -- 172.21.15.57:0/4070124632 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc00c009a70 con 0x7fc0240b2b70 2024-03-27T10:01:09.043 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.053+0000 7fc029400640 1 -- 172.21.15.57:0/4070124632 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0241e5c70 con 0x7fc0240b2b70 2024-03-27T10:01:09.043 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.053+0000 7fc029400640 1 -- 172.21.15.57:0/4070124632 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0240cf040 con 0x7fc0240b2b70 2024-03-27T10:01:09.044 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.054+0000 7fc029400640 1 -- 172.21.15.57:0/4070124632 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc024068620 con 0x7fc0240b2b70 2024-03-27T10:01:09.044 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.055+0000 7fc01b400640 1 -- 172.21.15.57:0/4070124632 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fc00c01b020 con 0x7fc0240b2b70 2024-03-27T10:01:09.045 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.056+0000 7fc01b400640 1 --2- 172.21.15.57:0/4070124632 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fc00006c530 0x7fc00006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:09.045 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.056+0000 7fc01b400640 1 -- 172.21.15.57:0/4070124632 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fc00c08bf30 con 0x7fc0240b2b70 2024-03-27T10:01:09.046 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.057+0000 7fc022800640 1 --2- 172.21.15.57:0/4070124632 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fc00006c530 0x7fc00006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:09.046 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.057+0000 7fc022800640 1 --2- 172.21.15.57:0/4070124632 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fc00006c530 0x7fc00006e9f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc014003aa0 tx=0x7fc014009830 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:09.050 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.061+0000 7fc01b400640 1 -- 172.21.15.57:0/4070124632 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7fc00c022020 con 0x7fc0240b2b70 2024-03-27T10:01:09.258 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.269+0000 7fc029400640 1 -- 172.21.15.57:0/4070124632 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc024144c80 con 0x7fc0240b2b70 2024-03-27T10:01:09.262 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.272+0000 7fc01b400640 1 -- 172.21.15.57:0/4070124632 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) ==== 74+0+18888 (secure 0 0 0) 0x7fc00c05a140 con 0x7fc0240b2b70 2024-03-27T10:01:09.262 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:01:09.262 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":28,"fsid":"7ac43f86-2c16-4a97-98fb-715d3cebc75c","created":"2024-03-27T09:59:04.033417+0000","modified":"2024-03-27T10:00:10.462391+0000","last_up_change":"2024-03-27T09:59:16.969624+0000","last_in_change":"2024-03-27T09:59:07.421690+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-27T09:59:17.253008+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-27T09:59:26.690365+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-27T09:59:27.559059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-27T09:59:31.187596+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"47b44362-7302-4f2a-b735-582c6c3850cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6801","nonce":2020036298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6803","nonce":2020036298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6807","nonce":2020036298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6805","nonce":2020036298}]},"public_addr":"172.21.15.57:6801/2020036298","cluster_addr":"172.21.15.57:6803/2020036298","heartbeat_back_addr":"172.21.15.57:6807/2020036298","heartbeat_front_addr":"172.21.15.57:6805/2020036298","state":["exists","up"]},{"osd":1,"uuid":"feaf96f0-9431-4188-9a09-da505b40e934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6809","nonce":3190929242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6811","nonce":3190929242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6815","nonce":3190929242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6813","nonce":3190929242}]},"public_addr":"172.21.15.57:6809/3190929242","cluster_addr":"172.21.15.57:6811/3190929242","heartbeat_back_addr":"172.21.15.57:6815/3190929242","heartbeat_front_addr":"172.21.15.57:6813/3190929242","state":["exists","up"]},{"osd":2,"uuid":"21e406e6-cfbc-4fe7-a816-e2420487c95d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6817","nonce":4065849973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6819","nonce":4065849973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6823","nonce":4065849973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6821","nonce":4065849973}]},"public_addr":"172.21.15.57:6817/4065849973","cluster_addr":"172.21.15.57:6819/4065849973","heartbeat_back_addr":"172.21.15.57:6823/4065849973","heartbeat_front_addr":"172.21.15.57:6821/4065849973","state":["exists","up"]},{"osd":3,"uuid":"a389af1d-76c4-4dfc-b215-f983f4931257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6825","nonce":158084809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6827","nonce":158084809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6831","nonce":158084809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6829","nonce":158084809}]},"public_addr":"172.21.15.57:6825/158084809","cluster_addr":"172.21.15.57:6827/158084809","heartbeat_back_addr":"172.21.15.57:6831/158084809","heartbeat_front_addr":"172.21.15.57:6829/158084809","state":["exists","up"]},{"osd":4,"uuid":"e9b05dca-557a-43ee-b43f-9ce5b7d28304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6823","nonce":108719401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6827","nonce":108719401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6831","nonce":108719401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6829","nonce":108719401}]},"public_addr":"172.21.15.118:6823/108719401","cluster_addr":"172.21.15.118:6827/108719401","heartbeat_back_addr":"172.21.15.118:6831/108719401","heartbeat_front_addr":"172.21.15.118:6829/108719401","state":["exists","up"]},{"osd":5,"uuid":"d968177d-44ff-499a-b00a-b147ed879253","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6817","nonce":2704605866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6819","nonce":2704605866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6826","nonce":2704605866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6822","nonce":2704605866}]},"public_addr":"172.21.15.118:6817/2704605866","cluster_addr":"172.21.15.118:6819/2704605866","heartbeat_back_addr":"172.21.15.118:6826/2704605866","heartbeat_front_addr":"172.21.15.118:6822/2704605866","state":["exists","up"]},{"osd":6,"uuid":"e8f98052-e6ad-4cfe-a4a9-0b17a434d54e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6801","nonce":1963659095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6803","nonce":1963659095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6807","nonce":1963659095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6805","nonce":1963659095}]},"public_addr":"172.21.15.118:6801/1963659095","cluster_addr":"172.21.15.118:6803/1963659095","heartbeat_back_addr":"172.21.15.118:6807/1963659095","heartbeat_front_addr":"172.21.15.118:6805/1963659095","state":["exists","up"]},{"osd":7,"uuid":"eccff987-8e51-4a63-845a-cf0a3196d7fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6809","nonce":1955879596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6811","nonce":1955879596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6815","nonce":1955879596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6813","nonce":1955879596}]},"public_addr":"172.21.15.118:6809/1955879596","cluster_addr":"172.21.15.118:6811/1955879596","heartbeat_back_addr":"172.21.15.118:6815/1955879596","heartbeat_front_addr":"172.21.15.118:6813/1955879596","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.721258+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.696610+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.777895+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.806769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.743259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.845687+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:13.020165+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.722294+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.e","mappings":[{"from":7,"to":1}]},{"pgid":"3.15","mappings":[{"from":3,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-27T10:01:09.264 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.275+0000 7fc029400640 1 -- 172.21.15.57:0/4070124632 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fc00006c530 msgr2=0x7fc00006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:09.264 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.275+0000 7fc029400640 1 --2- 172.21.15.57:0/4070124632 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fc00006c530 0x7fc00006e9f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc014003aa0 tx=0x7fc014009830 comp rx=0 tx=0).stop 2024-03-27T10:01:09.265 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.275+0000 7fc029400640 1 -- 172.21.15.57:0/4070124632 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0240b2b70 msgr2=0x7fc0240cf840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:09.265 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.275+0000 7fc029400640 1 --2- 172.21.15.57:0/4070124632 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0240b2b70 0x7fc0240cf840 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fc00c00d800 tx=0x7fc00c00dcc0 comp rx=0 tx=0).stop 2024-03-27T10:01:09.265 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.275+0000 7fc029400640 1 -- 172.21.15.57:0/4070124632 shutdown_connections 2024-03-27T10:01:09.265 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.275+0000 7fc029400640 1 --2- 172.21.15.57:0/4070124632 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc024145820 0x7fc0241f5770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:09.265 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.275+0000 7fc029400640 1 --2- 172.21.15.57:0/4070124632 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc0240b2b70 0x7fc0240cf840 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:09.265 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.275+0000 7fc029400640 1 --2- 172.21.15.57:0/4070124632 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fc00006c530 0x7fc00006e9f0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:09.265 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.275+0000 7fc029400640 1 --2- 172.21.15.57:0/4070124632 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc02406b750 0x7fc024155bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:09.265 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.275+0000 7fc029400640 1 -- 172.21.15.57:0/4070124632 >> 172.21.15.57:0/4070124632 conn(0x7fc0240b1c60 msgr2=0x7fc02415d900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:09.265 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.275+0000 7fc029400640 1 -- 172.21.15.57:0/4070124632 shutdown_connections 2024-03-27T10:01:09.265 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.276+0000 7fc029400640 1 -- 172.21.15.57:0/4070124632 wait complete. 2024-03-27T10:01:09.287 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-03-27T10:01:09.288 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-27T10:01:09.499 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.509+0000 7f755ec00640 1 Processor -- start 2024-03-27T10:01:09.499 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.510+0000 7f755ec00640 1 -- start start 2024-03-27T10:01:09.500 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.511+0000 7f755ec00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f755806b7a0 0x7f755815f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:09.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.511+0000 7f755ec00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f75580cd330 0x7f75580cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:09.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.511+0000 7f755ec00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f755815eb00 con 0x7f755806bb80 2024-03-27T10:01:09.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.512+0000 7f755ec00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f755806dc70 con 0x7f75580cd330 2024-03-27T10:01:09.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.512+0000 7f755ec00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f755806df50 con 0x7f755806b7a0 2024-03-27T10:01:09.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.512+0000 7f7557e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f755806b7a0 0x7f755815f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:09.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.512+0000 7f755cc00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f75580cd330 0x7f75580cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:09.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.512+0000 7f755cc00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f75580cd330 0x7f75580cd7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.57:60992/0 (socket says 172.21.15.57:60992) 2024-03-27T10:01:09.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.512+0000 7f755cc00640 1 -- 172.21.15.57:0/986924172 learned_addr learned my addr 172.21.15.57:0/986924172 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:01:09.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.513+0000 7f755cc00640 1 -- 172.21.15.57:0/986924172 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f755806b7a0 msgr2=0x7f755815f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:01:09.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.513+0000 7f755cc00640 1 --2- 172.21.15.57:0/986924172 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f755806b7a0 0x7f755815f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:09.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.513+0000 7f755cc00640 1 -- 172.21.15.57:0/986924172 >> v1:172.21.15.118:6789/0 conn(0x7f755806bb80 legacy=0x7f755806d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:09.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.513+0000 7f755cc00640 1 -- 172.21.15.57:0/986924172 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f755815edc0 con 0x7f75580cd330 2024-03-27T10:01:09.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.514+0000 7f755cc00640 1 --2- 172.21.15.57:0/986924172 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f75580cd330 0x7f75580cd7c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f755000d150 tx=0x7f755002e0e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59849a63bb572f54 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:09.504 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.515+0000 7f7557400640 1 -- 172.21.15.57:0/986924172 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f755002ea80 con 0x7f75580cd330 2024-03-27T10:01:09.504 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.515+0000 7f7557400640 1 -- 172.21.15.57:0/986924172 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f755002ec20 con 0x7f75580cd330 2024-03-27T10:01:09.504 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.515+0000 7f7557400640 1 -- 172.21.15.57:0/986924172 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7550009600 con 0x7f75580cd330 2024-03-27T10:01:09.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.516+0000 7f755ec00640 1 -- 172.21.15.57:0/986924172 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f75580cd330 msgr2=0x7f75580cd7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:09.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.516+0000 7f755ec00640 1 --2- 172.21.15.57:0/986924172 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f75580cd330 0x7f75580cd7c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f755000d150 tx=0x7f755002e0e0 comp rx=0 tx=0).stop 2024-03-27T10:01:09.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.516+0000 7f755ec00640 1 -- 172.21.15.57:0/986924172 shutdown_connections 2024-03-27T10:01:09.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.516+0000 7f755ec00640 1 --2- 172.21.15.57:0/986924172 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f75580cd330 0x7f75580cd7c0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:09.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.516+0000 7f755ec00640 1 --2- 172.21.15.57:0/986924172 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f755806b7a0 0x7f755815f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:09.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.516+0000 7f755ec00640 1 -- 172.21.15.57:0/986924172 >> 172.21.15.57:0/986924172 conn(0x7f75580b1c60 msgr2=0x7f75580b2070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:09.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.516+0000 7f755ec00640 1 -- 172.21.15.57:0/986924172 shutdown_connections 2024-03-27T10:01:09.506 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.516+0000 7f755ec00640 1 -- 172.21.15.57:0/986924172 wait complete. 2024-03-27T10:01:09.507 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.518+0000 7f755ec00640 1 Processor -- start 2024-03-27T10:01:09.507 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.518+0000 7f755ec00640 1 -- start start 2024-03-27T10:01:09.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.520+0000 7f755ec00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f755806b7a0 0x7f75580cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:09.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.520+0000 7f755ec00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f755806bb80 0x7f755815b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:09.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.520+0000 7f755ec00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f75580cd330 0x7f755815a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:09.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.520+0000 7f755ec00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f755806d8c0 con 0x7f75580cd330 2024-03-27T10:01:09.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.520+0000 7f755ec00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f75580726b0 con 0x7f755806bb80 2024-03-27T10:01:09.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.520+0000 7f755ec00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f755815cb50 con 0x7f755806b7a0 2024-03-27T10:01:09.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.520+0000 7f755cc00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f75580cd330 0x7f755815a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:09.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.520+0000 7f755cc00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f75580cd330 0x7f755815a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56796/0 (socket says 172.21.15.57:56796) 2024-03-27T10:01:09.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.520+0000 7f755cc00640 1 -- 172.21.15.57:0/928774787 learned_addr learned my addr 172.21.15.57:0/928774787 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:01:09.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.520+0000 7f754fe00640 1 --2- 172.21.15.57:0/928774787 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f755806bb80 0x7f755815b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:09.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.520+0000 7f7557e00640 1 --2- 172.21.15.57:0/928774787 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f755806b7a0 0x7f75580cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:09.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.521+0000 7f755cc00640 1 -- 172.21.15.57:0/928774787 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f755806b7a0 msgr2=0x7f75580cefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:09.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.521+0000 7f755cc00640 1 --2- 172.21.15.57:0/928774787 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f755806b7a0 0x7f75580cefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:09.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.521+0000 7f755cc00640 1 -- 172.21.15.57:0/928774787 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f755806bb80 msgr2=0x7f755815b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:09.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.521+0000 7f755cc00640 1 --2- 172.21.15.57:0/928774787 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f755806bb80 0x7f755815b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:09.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.521+0000 7f755cc00640 1 -- 172.21.15.57:0/928774787 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f755815bf40 con 0x7f75580cd330 2024-03-27T10:01:09.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.521+0000 7f755cc00640 1 --2- 172.21.15.57:0/928774787 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f75580cd330 0x7f755815a3e0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f755000d270 tx=0x7f7550004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:09.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.521+0000 7f7554c00640 1 -- 172.21.15.57:0/928774787 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f755002ea80 con 0x7f75580cd330 2024-03-27T10:01:09.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.521+0000 7f7554c00640 1 -- 172.21.15.57:0/928774787 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7550045070 con 0x7f75580cd330 2024-03-27T10:01:09.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.521+0000 7f7554c00640 1 -- 172.21.15.57:0/928774787 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f755000b720 con 0x7f75580cd330 2024-03-27T10:01:09.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.521+0000 7f755ec00640 1 -- 172.21.15.57:0/928774787 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f755815c220 con 0x7f75580cd330 2024-03-27T10:01:09.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.522+0000 7f755ec00640 1 -- 172.21.15.57:0/928774787 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f755815c7e0 con 0x7f75580cd330 2024-03-27T10:01:09.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.523+0000 7f755ec00640 1 -- 172.21.15.57:0/928774787 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7558068620 con 0x7f75580cd330 2024-03-27T10:01:09.513 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.524+0000 7f7554c00640 1 -- 172.21.15.57:0/928774787 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f7550036a60 con 0x7f75580cd330 2024-03-27T10:01:09.514 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.525+0000 7f7554c00640 1 --2- 172.21.15.57:0/928774787 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f753406c560 0x7f753406ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:09.514 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.525+0000 7f7554c00640 1 -- 172.21.15.57:0/928774787 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f75500ae940 con 0x7f75580cd330 2024-03-27T10:01:09.514 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.525+0000 7f7557e00640 1 --2- 172.21.15.57:0/928774787 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f753406c560 0x7f753406ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:09.515 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.526+0000 7f7557e00640 1 --2- 172.21.15.57:0/928774787 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f753406c560 0x7f753406ea20 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f7548009ad0 tx=0x7f7548008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:09.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.530+0000 7f7554c00640 1 -- 172.21.15.57:0/928774787 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f7550035e40 con 0x7f75580cd330 2024-03-27T10:01:09.774 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.784+0000 7f755ec00640 1 -- 172.21.15.57:0/928774787 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7558072030 con 0x7f75580cd330 2024-03-27T10:01:09.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.786+0000 7f7554c00640 1 -- 172.21.15.57:0/928774787 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5183 (secure 0 0 0) 0x7f755007cad0 con 0x7f75580cd330 2024-03-27T10:01:09.775 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:01:09.775 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/1178943431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1178943431},{"type":"v1","addr":"172.21.15.118:6834","nonce":1178943431}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6836/1248533620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6835","nonce":1248533620},{"type":"v1","addr":"172.21.15.57:6836","nonce":1248533620}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6837/4133386889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":4133386889},{"type":"v1","addr":"172.21.15.57:6837","nonce":4133386889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-27T09:59:28.571425+0000","modified":"2024-03-27T09:59:55.863525+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6835/1823694233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":1823694233},{"type":"v1","addr":"172.21.15.118:6835","nonce":1823694233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4282,"qdb_cluster":[4282]},"id":1}]} 2024-03-27T10:01:09.775 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 9 2024-03-27T10:01:09.778 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.789+0000 7f755ec00640 1 -- 172.21.15.57:0/928774787 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f753406c560 msgr2=0x7f753406ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:09.778 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.789+0000 7f755ec00640 1 --2- 172.21.15.57:0/928774787 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f753406c560 0x7f753406ea20 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f7548009ad0 tx=0x7f7548008040 comp rx=0 tx=0).stop 2024-03-27T10:01:09.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.789+0000 7f755ec00640 1 -- 172.21.15.57:0/928774787 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f75580cd330 msgr2=0x7f755815a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:09.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.789+0000 7f755ec00640 1 --2- 172.21.15.57:0/928774787 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f75580cd330 0x7f755815a3e0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f755000d270 tx=0x7f7550004a40 comp rx=0 tx=0).stop 2024-03-27T10:01:09.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.789+0000 7f755ec00640 1 -- 172.21.15.57:0/928774787 shutdown_connections 2024-03-27T10:01:09.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.789+0000 7f755ec00640 1 --2- 172.21.15.57:0/928774787 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f75580cd330 0x7f755815a3e0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:09.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.789+0000 7f755ec00640 1 --2- 172.21.15.57:0/928774787 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f753406c560 0x7f753406ea20 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:09.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.789+0000 7f755ec00640 1 --2- 172.21.15.57:0/928774787 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f755806bb80 0x7f755815b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:09.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.789+0000 7f755ec00640 1 --2- 172.21.15.57:0/928774787 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f755806b7a0 0x7f75580cefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:09.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.789+0000 7f755ec00640 1 -- 172.21.15.57:0/928774787 >> 172.21.15.57:0/928774787 conn(0x7f75580b1c60 msgr2=0x7f75580ad8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:09.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.789+0000 7f755ec00640 1 -- 172.21.15.57:0/928774787 shutdown_connections 2024-03-27T10:01:09.779 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:09.789+0000 7f755ec00640 1 -- 172.21.15.57:0/928774787 wait complete. 2024-03-27T10:01:09.797 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-27T10:01:10.017 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.028+0000 7f4127600640 1 Processor -- start 2024-03-27T10:01:10.017 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.028+0000 7f4127600640 1 -- start start 2024-03-27T10:01:10.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.029+0000 7f4127600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f412015c1d0 0x7f41200b1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:10.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.029+0000 7f4127600640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f41200d2210 0x7f41200b1b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:10.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.030+0000 7f4127600640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41200cfff0 con 0x7f41200b0e00 2024-03-27T10:01:10.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.030+0000 7f4127600640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f41200cc960 con 0x7f41200d2210 2024-03-27T10:01:10.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.030+0000 7f4127600640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f41200ccb90 con 0x7f412015c1d0 2024-03-27T10:01:10.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.030+0000 7f4125600640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f41200d2210 0x7f41200b1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:10.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.030+0000 7f4125600640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f41200d2210 0x7f41200b1b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56808/0 (socket says 172.21.15.57:56808) 2024-03-27T10:01:10.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.030+0000 7f4125600640 1 -- 172.21.15.57:0/1381510292 learned_addr learned my addr 172.21.15.57:0/1381510292 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:01:10.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.030+0000 7f4124c00640 1 --2- 172.21.15.57:0/1381510292 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f412015c1d0 0x7f41200b1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:10.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.030+0000 7f4125600640 1 -- 172.21.15.57:0/1381510292 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f412015c1d0 msgr2=0x7f41200b1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:01:10.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.030+0000 7f4125600640 1 --2- 172.21.15.57:0/1381510292 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f412015c1d0 0x7f41200b1350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:10.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.030+0000 7f4125600640 1 -- 172.21.15.57:0/1381510292 >> v1:172.21.15.118:6789/0 conn(0x7f41200b0e00 legacy=0x7f41200d1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:01:10.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.031+0000 7f4125600640 1 -- 172.21.15.57:0/1381510292 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41200cce30 con 0x7f41200d2210 2024-03-27T10:01:10.021 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.032+0000 7f4125600640 1 --2- 172.21.15.57:0/1381510292 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f41200d2210 0x7f41200b1b30 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f4118009e50 tx=0x7f411802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b98aff2ec2c59c19 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:10.021 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.032+0000 7f411f400640 1 -- 172.21.15.57:0/1381510292 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f411802ca70 con 0x7f41200d2210 2024-03-27T10:01:10.021 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.032+0000 7f411f400640 1 -- 172.21.15.57:0/1381510292 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f411802cc10 con 0x7f41200d2210 2024-03-27T10:01:10.021 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.032+0000 7f411f400640 1 -- 172.21.15.57:0/1381510292 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41180343f0 con 0x7f41200d2210 2024-03-27T10:01:10.022 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.033+0000 7f4127600640 1 -- 172.21.15.57:0/1381510292 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f41200d2210 msgr2=0x7f41200b1b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:10.022 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.033+0000 7f4127600640 1 --2- 172.21.15.57:0/1381510292 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f41200d2210 0x7f41200b1b30 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f4118009e50 tx=0x7f411802bed0 comp rx=0 tx=0).stop 2024-03-27T10:01:10.022 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.033+0000 7f4127600640 1 -- 172.21.15.57:0/1381510292 shutdown_connections 2024-03-27T10:01:10.022 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.033+0000 7f4127600640 1 --2- 172.21.15.57:0/1381510292 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f41200d2210 0x7f41200b1b30 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:10.022 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.033+0000 7f4127600640 1 --2- 172.21.15.57:0/1381510292 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f412015c1d0 0x7f41200b1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:10.022 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.033+0000 7f4127600640 1 -- 172.21.15.57:0/1381510292 >> 172.21.15.57:0/1381510292 conn(0x7f412009aa30 msgr2=0x7f412009ae40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:10.022 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.033+0000 7f4127600640 1 -- 172.21.15.57:0/1381510292 shutdown_connections 2024-03-27T10:01:10.023 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.033+0000 7f4127600640 1 -- 172.21.15.57:0/1381510292 wait complete. 2024-03-27T10:01:10.024 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.035+0000 7f4127600640 1 Processor -- start 2024-03-27T10:01:10.024 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.035+0000 7f4127600640 1 -- start start 2024-03-27T10:01:10.026 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.036+0000 7f4127600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f41200b0e00 0x7f41201e58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:10.026 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.036+0000 7f4127600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f41200d2210 0x7f41201549d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:10.026 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.036+0000 7f4127600640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f412015c1d0 0x7f412006cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:10.026 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.036+0000 7f4127600640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f41200cd6d0 con 0x7f412015c1d0 2024-03-27T10:01:10.026 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.036+0000 7f4127600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f41200cd3f0 con 0x7f41200b0e00 2024-03-27T10:01:10.026 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.036+0000 7f4127600640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f41200cdbf0 con 0x7f41200d2210 2024-03-27T10:01:10.026 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.036+0000 7f4125600640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f412015c1d0 0x7f412006cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:10.026 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.036+0000 7f4125600640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f412015c1d0 0x7f412006cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56818/0 (socket says 172.21.15.57:56818) 2024-03-27T10:01:10.026 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.036+0000 7f4125600640 1 -- 172.21.15.57:0/1699097203 learned_addr learned my addr 172.21.15.57:0/1699097203 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:01:10.026 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.036+0000 7f4124c00640 1 --2- 172.21.15.57:0/1699097203 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f41200b0e00 0x7f41201e58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:10.026 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.036+0000 7f411fe00640 1 --2- 172.21.15.57:0/1699097203 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f41200d2210 0x7f41201549d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:10.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.037+0000 7f4125600640 1 -- 172.21.15.57:0/1699097203 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f41200d2210 msgr2=0x7f41201549d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:10.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.037+0000 7f4125600640 1 --2- 172.21.15.57:0/1699097203 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f41200d2210 0x7f41201549d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:10.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.037+0000 7f4125600640 1 -- 172.21.15.57:0/1699097203 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f41200b0e00 msgr2=0x7f41201e58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:10.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.037+0000 7f4125600640 1 --2- 172.21.15.57:0/1699097203 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f41200b0e00 0x7f41201e58e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:10.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.037+0000 7f4125600640 1 -- 172.21.15.57:0/1699097203 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41200b5cb0 con 0x7f412015c1d0 2024-03-27T10:01:10.027 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.037+0000 7f4125600640 1 --2- 172.21.15.57:0/1699097203 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f412015c1d0 0x7f412006cc40 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f4118009e50 tx=0x7f4118004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:10.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.037+0000 7f411cc00640 1 -- 172.21.15.57:0/1699097203 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4118043020 con 0x7f412015c1d0 2024-03-27T10:01:10.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.037+0000 7f411cc00640 1 -- 172.21.15.57:0/1699097203 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f411803e450 con 0x7f412015c1d0 2024-03-27T10:01:10.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.037+0000 7f411cc00640 1 -- 172.21.15.57:0/1699097203 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4118009510 con 0x7f412015c1d0 2024-03-27T10:01:10.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.037+0000 7f4127600640 1 -- 172.21.15.57:0/1699097203 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41200b5f90 con 0x7f412015c1d0 2024-03-27T10:01:10.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.038+0000 7f4127600640 1 -- 172.21.15.57:0/1699097203 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4120154f10 con 0x7f412015c1d0 2024-03-27T10:01:10.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.039+0000 7f4127600640 1 -- 172.21.15.57:0/1699097203 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4120068c50 con 0x7f412015c1d0 2024-03-27T10:01:10.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.040+0000 7f411cc00640 1 -- 172.21.15.57:0/1699097203 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f4118046020 con 0x7f412015c1d0 2024-03-27T10:01:10.030 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.041+0000 7f411cc00640 1 --2- 172.21.15.57:0/1699097203 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f410006c530 0x7f410006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:10.030 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.041+0000 7f411cc00640 1 -- 172.21.15.57:0/1699097203 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f41180ae450 con 0x7f412015c1d0 2024-03-27T10:01:10.030 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.041+0000 7f4124c00640 1 --2- 172.21.15.57:0/1699097203 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f410006c530 0x7f410006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:10.030 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.042+0000 7f4124c00640 1 --2- 172.21.15.57:0/1699097203 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f410006c530 0x7f410006e9f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f4114006fd0 tx=0x7f4114008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:10.034 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.045+0000 7f411cc00640 1 -- 172.21.15.57:0/1699097203 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f411804d030 con 0x7f412015c1d0 2024-03-27T10:01:10.276 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.286+0000 7f4127600640 1 -- 172.21.15.57:0/1699097203 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f41200cebf0 con 0x7f412015c1d0 2024-03-27T10:01:10.276 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.287+0000 7f411cc00640 1 -- 172.21.15.57:0/1699097203 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5183 (secure 0 0 0) 0x7f411807c540 con 0x7f412015c1d0 2024-03-27T10:01:10.277 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:01:10.277 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4220,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/1178943431","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1178943431},{"type":"v1","addr":"172.21.15.118:6834","nonce":1178943431}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4269,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6836/1248533620","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6835","nonce":1248533620},{"type":"v1","addr":"172.21.15.57:6836","nonce":1248533620}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4272,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6837/4133386889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":4133386889},{"type":"v1","addr":"172.21.15.57:6837","nonce":4133386889}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-27T09:59:28.571425+0000","modified":"2024-03-27T09:59:55.863525+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.118:6835/1823694233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":1823694233},{"type":"v1","addr":"172.21.15.118:6835","nonce":1823694233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4282,"qdb_cluster":[4282]},"id":1}]} 2024-03-27T10:01:10.277 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 9 2024-03-27T10:01:10.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.290+0000 7f4127600640 1 -- 172.21.15.57:0/1699097203 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f410006c530 msgr2=0x7f410006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:10.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.290+0000 7f4127600640 1 --2- 172.21.15.57:0/1699097203 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f410006c530 0x7f410006e9f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f4114006fd0 tx=0x7f4114008040 comp rx=0 tx=0).stop 2024-03-27T10:01:10.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.290+0000 7f4127600640 1 -- 172.21.15.57:0/1699097203 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f412015c1d0 msgr2=0x7f412006cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:10.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.290+0000 7f4127600640 1 --2- 172.21.15.57:0/1699097203 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f412015c1d0 0x7f412006cc40 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f4118009e50 tx=0x7f4118004a40 comp rx=0 tx=0).stop 2024-03-27T10:01:10.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.291+0000 7f4127600640 1 -- 172.21.15.57:0/1699097203 shutdown_connections 2024-03-27T10:01:10.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.291+0000 7f4127600640 1 --2- 172.21.15.57:0/1699097203 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f412015c1d0 0x7f412006cc40 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:10.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.291+0000 7f4127600640 1 --2- 172.21.15.57:0/1699097203 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f41200d2210 0x7f41201549d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:10.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.291+0000 7f4127600640 1 --2- 172.21.15.57:0/1699097203 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f410006c530 0x7f410006e9f0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:10.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.291+0000 7f4127600640 1 --2- 172.21.15.57:0/1699097203 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f41200b0e00 0x7f41201e58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:10.280 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.291+0000 7f4127600640 1 -- 172.21.15.57:0/1699097203 >> 172.21.15.57:0/1699097203 conn(0x7f412009aa30 msgr2=0x7f41200cde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:10.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.291+0000 7f4127600640 1 -- 172.21.15.57:0/1699097203 shutdown_connections 2024-03-27T10:01:10.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.291+0000 7f4127600640 1 -- 172.21.15.57:0/1699097203 wait complete. 2024-03-27T10:01:10.298 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-27T10:01:10.515 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.526+0000 7fe2b9200640 1 Processor -- start 2024-03-27T10:01:10.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.526+0000 7fe2b9200640 1 -- start start 2024-03-27T10:01:10.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.528+0000 7fe2b9200640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe2b406b750 0x7fe2b406bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:10.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.528+0000 7fe2b9200640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fe2b40ce740 0x7fe2b40ceb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:10.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.528+0000 7fe2b9200640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2b415fc70 con 0x7fe2b4145820 2024-03-27T10:01:10.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.528+0000 7fe2b9200640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7fe2b4160b60 con 0x7fe2b406b750 2024-03-27T10:01:10.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.528+0000 7fe2b9200640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7fe2b406c0d0 con 0x7fe2b40ce740 2024-03-27T10:01:10.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.528+0000 7fe2b1400640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe2b406b750 0x7fe2b406bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:10.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.528+0000 7fe2b1e00640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fe2b4145820 0x7fe2b40cc950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:39718/0 (socket says 172.21.15.57:39718) 2024-03-27T10:01:10.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.528+0000 7fe2b1e00640 1 -- 172.21.15.57:0/2609812678 learned_addr learned my addr 172.21.15.57:0/2609812678 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T10:01:10.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.528+0000 7fe2b2800640 1 --2- 172.21.15.57:0/2609812678 >> v2:172.21.15.118:3300/0 conn(0x7fe2b40ce740 0x7fe2b40ceb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:10.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.529+0000 7fe2b1400640 1 -- 172.21.15.57:0/2609812678 >> v2:172.21.15.118:3300/0 conn(0x7fe2b40ce740 msgr2=0x7fe2b40ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:01:10.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.529+0000 7fe2b1400640 1 --2- 172.21.15.57:0/2609812678 >> v2:172.21.15.118:3300/0 conn(0x7fe2b40ce740 0x7fe2b40ceb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:10.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.529+0000 7fe2b1400640 1 -- 172.21.15.57:0/2609812678 >> v1:172.21.15.57:6789/0 conn(0x7fe2b4145820 legacy=0x7fe2b40cc950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:10.519 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.529+0000 7fe2b0a00640 1 -- 172.21.15.57:0/2609812678 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1763381958 0 0) 0x7fe2b415fc70 con 0x7fe2b4145820 2024-03-27T10:01:10.519 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.529+0000 7fe2b1400640 1 -- 172.21.15.57:0/2609812678 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2b415ff50 con 0x7fe2b406b750 2024-03-27T10:01:10.519 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.530+0000 7fe2b1400640 1 --2- 172.21.15.57:0/2609812678 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe2b406b750 0x7fe2b406bb90 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fe2b40af610 tx=0x7fe2a002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62eb67220dd3e38a server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:10.519 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.530+0000 7fe2b0a00640 1 -- 172.21.15.57:0/2609812678 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2a0035020 con 0x7fe2b406b750 2024-03-27T10:01:10.519 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.530+0000 7fe2b0a00640 1 -- 172.21.15.57:0/2609812678 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2a0031830 con 0x7fe2b406b750 2024-03-27T10:01:10.519 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.530+0000 7fe2b0a00640 1 -- 172.21.15.57:0/2609812678 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2a0031c00 con 0x7fe2b406b750 2024-03-27T10:01:10.520 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.531+0000 7fe2b9200640 1 -- 172.21.15.57:0/2609812678 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe2b406b750 msgr2=0x7fe2b406bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:10.520 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.531+0000 7fe2b9200640 1 --2- 172.21.15.57:0/2609812678 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe2b406b750 0x7fe2b406bb90 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fe2b40af610 tx=0x7fe2a002b8d0 comp rx=0 tx=0).stop 2024-03-27T10:01:10.520 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.531+0000 7fe2b9200640 1 -- 172.21.15.57:0/2609812678 shutdown_connections 2024-03-27T10:01:10.520 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.531+0000 7fe2b9200640 1 --2- 172.21.15.57:0/2609812678 >> v2:172.21.15.118:3300/0 conn(0x7fe2b40ce740 0x7fe2b40ceb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:10.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.531+0000 7fe2b9200640 1 --2- 172.21.15.57:0/2609812678 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe2b406b750 0x7fe2b406bb90 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:10.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.531+0000 7fe2b9200640 1 -- 172.21.15.57:0/2609812678 >> 172.21.15.57:0/2609812678 conn(0x7fe2b40b1c60 msgr2=0x7fe2b40b2070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:10.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.531+0000 7fe2b9200640 1 -- 172.21.15.57:0/2609812678 shutdown_connections 2024-03-27T10:01:10.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.531+0000 7fe2b9200640 1 -- 172.21.15.57:0/2609812678 wait complete. 2024-03-27T10:01:10.522 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.533+0000 7fe2b9200640 1 Processor -- start 2024-03-27T10:01:10.522 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.533+0000 7fe2b9200640 1 -- start start 2024-03-27T10:01:10.523 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.534+0000 7fe2b9200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe2b406b750 0x7fe2b413fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:10.523 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.534+0000 7fe2b9200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe2b40ce740 0x7fe2b4143890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:10.523 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.534+0000 7fe2b9200640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe2b4145820 0x7fe2b4143dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:10.523 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.534+0000 7fe2b9200640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fe2b41607f0 con 0x7fe2b4145820 2024-03-27T10:01:10.523 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.534+0000 7fe2b9200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fe2b4160510 con 0x7fe2b40ce740 2024-03-27T10:01:10.524 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.534+0000 7fe2b9200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fe2b4145c00 con 0x7fe2b406b750 2024-03-27T10:01:10.525 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.535+0000 7fe2b2800640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe2b4145820 0x7fe2b4143dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:10.525 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.535+0000 7fe2b2800640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe2b4145820 0x7fe2b4143dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56834/0 (socket says 172.21.15.57:56834) 2024-03-27T10:01:10.525 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.535+0000 7fe2b2800640 1 -- 172.21.15.57:0/2351049362 learned_addr learned my addr 172.21.15.57:0/2351049362 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:01:10.525 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.535+0000 7fe2b1400640 1 --2- 172.21.15.57:0/2351049362 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe2b40ce740 0x7fe2b4143890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:10.525 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.535+0000 7fe2b1e00640 1 --2- 172.21.15.57:0/2351049362 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe2b406b750 0x7fe2b413fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:10.525 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.535+0000 7fe2b2800640 1 -- 172.21.15.57:0/2351049362 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe2b406b750 msgr2=0x7fe2b413fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:10.525 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.535+0000 7fe2b2800640 1 --2- 172.21.15.57:0/2351049362 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe2b406b750 0x7fe2b413fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:10.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.535+0000 7fe2b2800640 1 -- 172.21.15.57:0/2351049362 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe2b40ce740 msgr2=0x7fe2b4143890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:10.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.535+0000 7fe2b2800640 1 --2- 172.21.15.57:0/2351049362 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe2b40ce740 0x7fe2b4143890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:10.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.535+0000 7fe2b2800640 1 -- 172.21.15.57:0/2351049362 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2b41401c0 con 0x7fe2b4145820 2024-03-27T10:01:10.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.535+0000 7fe2b1e00640 1 --2- 172.21.15.57:0/2351049362 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe2b406b750 0x7fe2b413fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T10:01:10.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.536+0000 7fe2b2800640 1 --2- 172.21.15.57:0/2351049362 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe2b4145820 0x7fe2b4143dd0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac007e40 tx=0x7fe2ac00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:10.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.536+0000 7fe2aa000640 1 -- 172.21.15.57:0/2351049362 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2ac014620 con 0x7fe2b4145820 2024-03-27T10:01:10.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.536+0000 7fe2aa000640 1 -- 172.21.15.57:0/2351049362 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2ac019070 con 0x7fe2b4145820 2024-03-27T10:01:10.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.536+0000 7fe2b9200640 1 -- 172.21.15.57:0/2351049362 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2b41404a0 con 0x7fe2b4145820 2024-03-27T10:01:10.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.536+0000 7fe2aa000640 1 -- 172.21.15.57:0/2351049362 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2ac014a20 con 0x7fe2b4145820 2024-03-27T10:01:10.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.536+0000 7fe2b9200640 1 -- 172.21.15.57:0/2351049362 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2b4140a60 con 0x7fe2b4145820 2024-03-27T10:01:10.527 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.537+0000 7fe2b9200640 1 -- 172.21.15.57:0/2351049362 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2b406dd00 con 0x7fe2b4145820 2024-03-27T10:01:10.527 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.538+0000 7fe2aa000640 1 -- 172.21.15.57:0/2351049362 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fe2ac014bc0 con 0x7fe2b4145820 2024-03-27T10:01:10.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.539+0000 7fe2aa000640 1 --2- 172.21.15.57:0/2351049362 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fe29406c560 0x7fe29406ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:10.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.540+0000 7fe2aa000640 1 -- 172.21.15.57:0/2351049362 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7fe2ac08c300 con 0x7fe2b4145820 2024-03-27T10:01:10.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.540+0000 7fe2b1e00640 1 --2- 172.21.15.57:0/2351049362 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fe29406c560 0x7fe29406ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:10.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.540+0000 7fe2b1e00640 1 --2- 172.21.15.57:0/2351049362 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fe29406c560 0x7fe29406ea20 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe2a4000f60 tx=0x7fe2a4007ca0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:10.532 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.544+0000 7fe2aa000640 1 -- 172.21.15.57:0/2351049362 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7fe2b406dd00 con 0x7fe2b4145820 2024-03-27T10:01:10.735 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.746+0000 7fe2b9200640 1 -- 172.21.15.57:0/2351049362 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe2b4068620 con 0x7fe2b4145820 2024-03-27T10:01:10.737 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.748+0000 7fe2aa000640 1 -- 172.21.15.57:0/2351049362 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) ==== 74+0+18888 (secure 0 0 0) 0x7fe2ac05a510 con 0x7fe2b4145820 2024-03-27T10:01:10.738 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:01:10.738 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":28,"fsid":"7ac43f86-2c16-4a97-98fb-715d3cebc75c","created":"2024-03-27T09:59:04.033417+0000","modified":"2024-03-27T10:00:10.462391+0000","last_up_change":"2024-03-27T09:59:16.969624+0000","last_in_change":"2024-03-27T09:59:07.421690+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-27T09:59:17.253008+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-27T09:59:26.690365+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-27T09:59:27.559059+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-03-27T09:59:31.187596+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"47b44362-7302-4f2a-b735-582c6c3850cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6801","nonce":2020036298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6803","nonce":2020036298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6807","nonce":2020036298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6805","nonce":2020036298}]},"public_addr":"172.21.15.57:6801/2020036298","cluster_addr":"172.21.15.57:6803/2020036298","heartbeat_back_addr":"172.21.15.57:6807/2020036298","heartbeat_front_addr":"172.21.15.57:6805/2020036298","state":["exists","up"]},{"osd":1,"uuid":"feaf96f0-9431-4188-9a09-da505b40e934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6809","nonce":3190929242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6811","nonce":3190929242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6815","nonce":3190929242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6813","nonce":3190929242}]},"public_addr":"172.21.15.57:6809/3190929242","cluster_addr":"172.21.15.57:6811/3190929242","heartbeat_back_addr":"172.21.15.57:6815/3190929242","heartbeat_front_addr":"172.21.15.57:6813/3190929242","state":["exists","up"]},{"osd":2,"uuid":"21e406e6-cfbc-4fe7-a816-e2420487c95d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6817","nonce":4065849973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6819","nonce":4065849973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6823","nonce":4065849973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6821","nonce":4065849973}]},"public_addr":"172.21.15.57:6817/4065849973","cluster_addr":"172.21.15.57:6819/4065849973","heartbeat_back_addr":"172.21.15.57:6823/4065849973","heartbeat_front_addr":"172.21.15.57:6821/4065849973","state":["exists","up"]},{"osd":3,"uuid":"a389af1d-76c4-4dfc-b215-f983f4931257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6825","nonce":158084809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6827","nonce":158084809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6831","nonce":158084809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6829","nonce":158084809}]},"public_addr":"172.21.15.57:6825/158084809","cluster_addr":"172.21.15.57:6827/158084809","heartbeat_back_addr":"172.21.15.57:6831/158084809","heartbeat_front_addr":"172.21.15.57:6829/158084809","state":["exists","up"]},{"osd":4,"uuid":"e9b05dca-557a-43ee-b43f-9ce5b7d28304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6823","nonce":108719401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6827","nonce":108719401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6831","nonce":108719401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6829","nonce":108719401}]},"public_addr":"172.21.15.118:6823/108719401","cluster_addr":"172.21.15.118:6827/108719401","heartbeat_back_addr":"172.21.15.118:6831/108719401","heartbeat_front_addr":"172.21.15.118:6829/108719401","state":["exists","up"]},{"osd":5,"uuid":"d968177d-44ff-499a-b00a-b147ed879253","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6817","nonce":2704605866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6819","nonce":2704605866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6826","nonce":2704605866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6822","nonce":2704605866}]},"public_addr":"172.21.15.118:6817/2704605866","cluster_addr":"172.21.15.118:6819/2704605866","heartbeat_back_addr":"172.21.15.118:6826/2704605866","heartbeat_front_addr":"172.21.15.118:6822/2704605866","state":["exists","up"]},{"osd":6,"uuid":"e8f98052-e6ad-4cfe-a4a9-0b17a434d54e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6801","nonce":1963659095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6803","nonce":1963659095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6807","nonce":1963659095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6805","nonce":1963659095}]},"public_addr":"172.21.15.118:6801/1963659095","cluster_addr":"172.21.15.118:6803/1963659095","heartbeat_back_addr":"172.21.15.118:6807/1963659095","heartbeat_front_addr":"172.21.15.118:6805/1963659095","state":["exists","up"]},{"osd":7,"uuid":"eccff987-8e51-4a63-845a-cf0a3196d7fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6809","nonce":1955879596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6811","nonce":1955879596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6815","nonce":1955879596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6813","nonce":1955879596}]},"public_addr":"172.21.15.118:6809/1955879596","cluster_addr":"172.21.15.118:6811/1955879596","heartbeat_back_addr":"172.21.15.118:6815/1955879596","heartbeat_front_addr":"172.21.15.118:6813/1955879596","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.721258+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.696610+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.777895+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.806769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.743259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.845687+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:13.020165+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.722294+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.e","mappings":[{"from":7,"to":1}]},{"pgid":"3.15","mappings":[{"from":3,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-27T10:01:10.740 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.751+0000 7fe2b9200640 1 -- 172.21.15.57:0/2351049362 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fe29406c560 msgr2=0x7fe29406ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:10.740 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.751+0000 7fe2b9200640 1 --2- 172.21.15.57:0/2351049362 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fe29406c560 0x7fe29406ea20 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe2a4000f60 tx=0x7fe2a4007ca0 comp rx=0 tx=0).stop 2024-03-27T10:01:10.740 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.751+0000 7fe2b9200640 1 -- 172.21.15.57:0/2351049362 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe2b4145820 msgr2=0x7fe2b4143dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:10.740 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.751+0000 7fe2b9200640 1 --2- 172.21.15.57:0/2351049362 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe2b4145820 0x7fe2b4143dd0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac007e40 tx=0x7fe2ac00e4b0 comp rx=0 tx=0).stop 2024-03-27T10:01:10.741 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.751+0000 7fe2b9200640 1 -- 172.21.15.57:0/2351049362 shutdown_connections 2024-03-27T10:01:10.741 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.751+0000 7fe2b9200640 1 --2- 172.21.15.57:0/2351049362 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe2b4145820 0x7fe2b4143dd0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:10.741 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.751+0000 7fe2b9200640 1 --2- 172.21.15.57:0/2351049362 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fe29406c560 0x7fe29406ea20 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:10.741 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.751+0000 7fe2b9200640 1 --2- 172.21.15.57:0/2351049362 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe2b40ce740 0x7fe2b4143890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:10.741 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.751+0000 7fe2b9200640 1 --2- 172.21.15.57:0/2351049362 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe2b406b750 0x7fe2b413fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:10.741 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.751+0000 7fe2b9200640 1 -- 172.21.15.57:0/2351049362 >> 172.21.15.57:0/2351049362 conn(0x7fe2b40b1c60 msgr2=0x7fe2b40b2040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:10.741 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.751+0000 7fe2b9200640 1 -- 172.21.15.57:0/2351049362 shutdown_connections 2024-03-27T10:01:10.741 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.751+0000 7fe2b9200640 1 -- 172.21.15.57:0/2351049362 wait complete. 2024-03-27T10:01:10.760 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-03-27T10:01:10.984 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.995+0000 7f2ad5a00640 1 Processor -- start 2024-03-27T10:01:10.984 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.995+0000 7f2ad5a00640 1 -- start start 2024-03-27T10:01:10.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.997+0000 7f2ad5a00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2ad006ee40 0x7f2ad0071fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:10.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.997+0000 7f2ad5a00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2ad00b3bb0 0x7f2ad00724e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:10.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.997+0000 7f2ad5a00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ad00b2b10 con 0x7f2ad015af80 2024-03-27T10:01:10.986 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.997+0000 7f2ad5a00640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f2ad00b2df0 con 0x7f2ad00b3bb0 2024-03-27T10:01:10.987 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.997+0000 7f2ad5a00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f2ad00b30d0 con 0x7f2ad006ee40 2024-03-27T10:01:10.987 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.997+0000 7f2ad5000640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2ad00b3bb0 0x7f2ad00724e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:10.987 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.997+0000 7f2ad5000640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f2ad00b3bb0 0x7f2ad00724e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56842/0 (socket says 172.21.15.57:56842) 2024-03-27T10:01:10.987 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.997+0000 7f2ad5000640 1 -- 172.21.15.57:0/3508668581 learned_addr learned my addr 172.21.15.57:0/3508668581 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:01:10.987 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.997+0000 7f2acf400640 1 --2- 172.21.15.57:0/3508668581 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2ad006ee40 0x7f2ad0071fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:10.987 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.998+0000 7f2ad5000640 1 -- 172.21.15.57:0/3508668581 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2ad006ee40 msgr2=0x7f2ad0071fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:01:10.987 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.998+0000 7f2ad5000640 1 --2- 172.21.15.57:0/3508668581 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2ad006ee40 0x7f2ad0071fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:10.987 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.998+0000 7f2ad5000640 1 -- 172.21.15.57:0/3508668581 >> v1:172.21.15.118:6789/0 conn(0x7f2ad015af80 legacy=0x7f2ad006e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:10.988 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.998+0000 7f2ad5000640 1 -- 172.21.15.57:0/3508668581 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ad00b33b0 con 0x7f2ad00b3bb0 2024-03-27T10:01:10.988 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.999+0000 7f2ad5000640 1 --2- 172.21.15.57:0/3508668581 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2ad00b3bb0 0x7f2ad00724e0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f2ac8009e50 tx=0x7f2ac802bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d216a0104e786d2 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:10.988 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.999+0000 7f2acea00640 1 -- 172.21.15.57:0/3508668581 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ac802caf0 con 0x7f2ad00b3bb0 2024-03-27T10:01:10.988 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.999+0000 7f2acea00640 1 -- 172.21.15.57:0/3508668581 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ac802cc90 con 0x7f2ad00b3bb0 2024-03-27T10:01:10.988 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:10.999+0000 7f2acea00640 1 -- 172.21.15.57:0/3508668581 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ac8034610 con 0x7f2ad00b3bb0 2024-03-27T10:01:10.989 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.000+0000 7f2ad5a00640 1 -- 172.21.15.57:0/3508668581 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2ad00b3bb0 msgr2=0x7f2ad00724e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:10.989 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.000+0000 7f2ad5a00640 1 --2- 172.21.15.57:0/3508668581 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2ad00b3bb0 0x7f2ad00724e0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f2ac8009e50 tx=0x7f2ac802bf50 comp rx=0 tx=0).stop 2024-03-27T10:01:10.989 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.000+0000 7f2ad5a00640 1 -- 172.21.15.57:0/3508668581 shutdown_connections 2024-03-27T10:01:10.989 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.000+0000 7f2ad5a00640 1 --2- 172.21.15.57:0/3508668581 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2ad006ee40 0x7f2ad0071fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:10.989 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.000+0000 7f2ad5a00640 1 --2- 172.21.15.57:0/3508668581 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2ad00b3bb0 0x7f2ad00724e0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:10.989 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.000+0000 7f2ad5a00640 1 -- 172.21.15.57:0/3508668581 >> 172.21.15.57:0/3508668581 conn(0x7f2ad00b1770 msgr2=0x7f2ad00b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:10.989 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.000+0000 7f2ad5a00640 1 -- 172.21.15.57:0/3508668581 shutdown_connections 2024-03-27T10:01:10.990 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.000+0000 7f2ad5a00640 1 -- 172.21.15.57:0/3508668581 wait complete. 2024-03-27T10:01:10.991 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.002+0000 7f2ad5a00640 1 Processor -- start 2024-03-27T10:01:10.991 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.002+0000 7f2ad5a00640 1 -- start start 2024-03-27T10:01:10.992 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.003+0000 7f2ad5a00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2ad006ee40 0x7f2ad013e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:10.992 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.003+0000 7f2ad5a00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2ad00b3bb0 0x7f2ad0150db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:10.992 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.003+0000 7f2ad5a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ad015af80 0x7f2ad00cdf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:10.992 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.003+0000 7f2ad5a00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f2ad00cd250 con 0x7f2ad00b3bb0 2024-03-27T10:01:10.992 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.003+0000 7f2ad5a00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f2ad00cd0d0 con 0x7f2ad015af80 2024-03-27T10:01:10.993 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.003+0000 7f2ad5a00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f2ad00cd3d0 con 0x7f2ad006ee40 2024-03-27T10:01:10.993 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.003+0000 7f2acf400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2ad00b3bb0 0x7f2ad0150db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:10.993 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.003+0000 7f2acf400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2ad00b3bb0 0x7f2ad0150db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56854/0 (socket says 172.21.15.57:56854) 2024-03-27T10:01:10.993 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.003+0000 7f2acf400640 1 -- 172.21.15.57:0/2814140952 learned_addr learned my addr 172.21.15.57:0/2814140952 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:01:10.994 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.004+0000 7f2acf400640 1 -- 172.21.15.57:0/2814140952 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2ad006ee40 msgr2=0x7f2ad013e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:10.994 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.004+0000 7f2ad5000640 1 --2- 172.21.15.57:0/2814140952 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ad015af80 0x7f2ad00cdf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:10.994 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.004+0000 7f2acfe00640 1 --2- 172.21.15.57:0/2814140952 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2ad006ee40 0x7f2ad013e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:10.994 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.004+0000 7f2acf400640 1 --2- 172.21.15.57:0/2814140952 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2ad006ee40 0x7f2ad013e400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:10.994 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.004+0000 7f2acf400640 1 -- 172.21.15.57:0/2814140952 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ad015af80 msgr2=0x7f2ad00cdf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:10.994 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.004+0000 7f2acf400640 1 --2- 172.21.15.57:0/2814140952 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ad015af80 0x7f2ad00cdf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:10.994 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.004+0000 7f2acf400640 1 -- 172.21.15.57:0/2814140952 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ad01556e0 con 0x7f2ad00b3bb0 2024-03-27T10:01:10.995 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.004+0000 7f2ad5000640 1 --2- 172.21.15.57:0/2814140952 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ad015af80 0x7f2ad00cdf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T10:01:10.995 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.004+0000 7f2acf400640 1 --2- 172.21.15.57:0/2814140952 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2ad00b3bb0 0x7f2ad0150db0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f2abc00d800 tx=0x7f2abc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:10.995 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.004+0000 7f2ac7e00640 1 -- 172.21.15.57:0/2814140952 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2abc00b6c0 con 0x7f2ad00b3bb0 2024-03-27T10:01:10.995 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.004+0000 7f2ac7e00640 1 -- 172.21.15.57:0/2814140952 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2abc019070 con 0x7f2ad00b3bb0 2024-03-27T10:01:10.995 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.004+0000 7f2ac7e00640 1 -- 172.21.15.57:0/2814140952 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2abc00ba80 con 0x7f2ad00b3bb0 2024-03-27T10:01:10.995 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.004+0000 7f2ad5a00640 1 -- 172.21.15.57:0/2814140952 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ad0155980 con 0x7f2ad00b3bb0 2024-03-27T10:01:10.995 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.005+0000 7f2ad5a00640 1 -- 172.21.15.57:0/2814140952 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ad0155f40 con 0x7f2ad00b3bb0 2024-03-27T10:01:10.995 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.006+0000 7f2ad5a00640 1 -- 172.21.15.57:0/2814140952 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ad0068540 con 0x7f2ad00b3bb0 2024-03-27T10:01:10.995 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.007+0000 7f2ac7e00640 1 -- 172.21.15.57:0/2814140952 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f2abc00bc20 con 0x7f2ad00b3bb0 2024-03-27T10:01:10.997 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.008+0000 7f2ac7e00640 1 --2- 172.21.15.57:0/2814140952 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f2ab006c530 0x7f2ab006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:10.997 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.008+0000 7f2ac7e00640 1 -- 172.21.15.57:0/2814140952 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6735+0+0 (secure 0 0 0) 0x7f2abc08bfb0 con 0x7f2ad00b3bb0 2024-03-27T10:01:10.997 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.008+0000 7f2acfe00640 1 --2- 172.21.15.57:0/2814140952 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f2ab006c530 0x7f2ab006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:10.997 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.009+0000 7f2acfe00640 1 --2- 172.21.15.57:0/2814140952 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f2ab006c530 0x7f2ab006e9f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2ac0001500 tx=0x7f2ac0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:11.001 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.012+0000 7f2ac7e00640 1 -- 172.21.15.57:0/2814140952 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f2abc05a1c0 con 0x7f2ad00b3bb0 2024-03-27T10:01:11.249 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.260+0000 7f2ad5a00640 1 -- 172.21.15.57:0/2814140952 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f2ad006d0a0 con 0x7f2ad00b3bb0 2024-03-27T10:01:11.250 INFO:tasks.ceph.mon.a.smithi057.stderr:2024-03-27T10:01:11.261+0000 7f5623400640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-27T10:01:11.254 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.265+0000 7f2ac7e00640 1 -- 172.21.15.57:0/2814140952 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) ==== 161+0+0 (secure 0 0 0) 0x7f2abc059ac0 con 0x7f2ad00b3bb0 2024-03-27T10:01:11.254 INFO:teuthology.orchestra.run.smithi057.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-03-27T10:01:11.256 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.267+0000 7f2ad5a00640 1 -- 172.21.15.57:0/2814140952 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f2ab006c530 msgr2=0x7f2ab006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:11.256 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.267+0000 7f2ad5a00640 1 --2- 172.21.15.57:0/2814140952 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f2ab006c530 0x7f2ab006e9f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2ac0001500 tx=0x7f2ac0009040 comp rx=0 tx=0).stop 2024-03-27T10:01:11.256 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.267+0000 7f2ad5a00640 1 -- 172.21.15.57:0/2814140952 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2ad00b3bb0 msgr2=0x7f2ad0150db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:11.257 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.267+0000 7f2ad5a00640 1 --2- 172.21.15.57:0/2814140952 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2ad00b3bb0 0x7f2ad0150db0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f2abc00d800 tx=0x7f2abc00dcc0 comp rx=0 tx=0).stop 2024-03-27T10:01:11.257 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.268+0000 7f2ad5a00640 1 -- 172.21.15.57:0/2814140952 shutdown_connections 2024-03-27T10:01:11.257 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.268+0000 7f2ad5a00640 1 --2- 172.21.15.57:0/2814140952 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f2ab006c530 0x7f2ab006e9f0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:11.257 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.268+0000 7f2ad5a00640 1 --2- 172.21.15.57:0/2814140952 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2ad015af80 0x7f2ad00cdf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:11.257 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.268+0000 7f2ad5a00640 1 --2- 172.21.15.57:0/2814140952 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2ad00b3bb0 0x7f2ad0150db0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:11.257 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.268+0000 7f2ad5a00640 1 --2- 172.21.15.57:0/2814140952 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2ad006ee40 0x7f2ad013e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:11.257 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.268+0000 7f2ad5a00640 1 -- 172.21.15.57:0/2814140952 >> 172.21.15.57:0/2814140952 conn(0x7f2ad00b1770 msgr2=0x7f2ad0158b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:11.258 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.269+0000 7f2ad5a00640 1 -- 172.21.15.57:0/2814140952 shutdown_connections 2024-03-27T10:01:11.258 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.269+0000 7f2ad5a00640 1 -- 172.21.15.57:0/2814140952 wait complete. 2024-03-27T10:01:11.280 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-03-27T10:01:11.291 INFO:tasks.ceph.mds.d.smithi118.stderr: -6176> 2024-03-27T09:59:34.628+0000 7fb47bc00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-27T10:01:11.365 INFO:tasks.ceph.mds.d.smithi118.stdout:starting mds.d at 2024-03-27T10:01:11.492 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.502+0000 7f49ebc00640 1 Processor -- start 2024-03-27T10:01:11.492 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.502+0000 7f49ebc00640 1 -- start start 2024-03-27T10:01:11.493 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.504+0000 7f49ebc00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f49e40aea20 0x7f49e415d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:11.493 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.504+0000 7f49ebc00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f49e40acd60 0x7f49e40aee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:11.493 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.504+0000 7f49ebc00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49e40af340 con 0x7f49e40711b0 2024-03-27T10:01:11.494 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.504+0000 7f49ebc00640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f49e40ad1d0 con 0x7f49e40acd60 2024-03-27T10:01:11.494 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.504+0000 7f49ebc00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f49e406df40 con 0x7f49e40aea20 2024-03-27T10:01:11.494 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.504+0000 7f49e3e00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f49e40acd60 0x7f49e40aee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:11.494 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.504+0000 7f49e3e00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f49e40acd60 0x7f49e40aee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56856/0 (socket says 172.21.15.57:56856) 2024-03-27T10:01:11.494 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.504+0000 7f49e3e00640 1 -- 172.21.15.57:0/2215559592 learned_addr learned my addr 172.21.15.57:0/2215559592 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:01:11.494 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.505+0000 7f49e9200640 1 --2- 172.21.15.57:0/2215559592 >> v2:172.21.15.118:3300/0 conn(0x7f49e40aea20 0x7f49e415d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:11.495 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.505+0000 7f49e3e00640 1 -- 172.21.15.57:0/2215559592 >> v2:172.21.15.118:3300/0 conn(0x7f49e40aea20 msgr2=0x7f49e415d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:01:11.495 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.505+0000 7f49e3e00640 1 --2- 172.21.15.57:0/2215559592 >> v2:172.21.15.118:3300/0 conn(0x7f49e40aea20 0x7f49e415d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:11.495 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.505+0000 7f49e3e00640 1 -- 172.21.15.57:0/2215559592 >> v1:172.21.15.118:6789/0 conn(0x7f49e40711b0 legacy=0x7f49e40715b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:01:11.495 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.505+0000 7f49e3e00640 1 -- 172.21.15.57:0/2215559592 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49e415c4c0 con 0x7f49e40acd60 2024-03-27T10:01:11.495 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.505+0000 7f49e9200640 1 --2- 172.21.15.57:0/2215559592 >> v2:172.21.15.118:3300/0 conn(0x7f49e40aea20 0x7f49e415d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T10:01:11.495 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.506+0000 7f49e3e00640 1 --2- 172.21.15.57:0/2215559592 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f49e40acd60 0x7f49e40aee00 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f49e40753a0 tx=0x7f49d002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95abc89aab51b2e0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:11.496 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.506+0000 7f49e3400640 1 -- 172.21.15.57:0/2215559592 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49d002e070 con 0x7f49e40acd60 2024-03-27T10:01:11.496 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.507+0000 7f49e3400640 1 -- 172.21.15.57:0/2215559592 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49d0037070 con 0x7f49e40acd60 2024-03-27T10:01:11.496 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.507+0000 7f49e3400640 1 -- 172.21.15.57:0/2215559592 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49d0031a00 con 0x7f49e40acd60 2024-03-27T10:01:11.496 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.507+0000 7f49ebc00640 1 -- 172.21.15.57:0/2215559592 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f49e40acd60 msgr2=0x7f49e40aee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:11.496 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.507+0000 7f49ebc00640 1 --2- 172.21.15.57:0/2215559592 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f49e40acd60 0x7f49e40aee00 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f49e40753a0 tx=0x7f49d002b880 comp rx=0 tx=0).stop 2024-03-27T10:01:11.496 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.507+0000 7f49ebc00640 1 -- 172.21.15.57:0/2215559592 shutdown_connections 2024-03-27T10:01:11.496 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.507+0000 7f49ebc00640 1 --2- 172.21.15.57:0/2215559592 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f49e40acd60 0x7f49e40aee00 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:11.496 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.507+0000 7f49ebc00640 1 --2- 172.21.15.57:0/2215559592 >> v2:172.21.15.118:3300/0 conn(0x7f49e40aea20 0x7f49e415d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:11.496 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.507+0000 7f49ebc00640 1 -- 172.21.15.57:0/2215559592 >> 172.21.15.57:0/2215559592 conn(0x7f49e40b18a0 msgr2=0x7f49e40b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:11.497 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.508+0000 7f49ebc00640 1 -- 172.21.15.57:0/2215559592 shutdown_connections 2024-03-27T10:01:11.497 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.508+0000 7f49ebc00640 1 -- 172.21.15.57:0/2215559592 wait complete. 2024-03-27T10:01:11.498 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.509+0000 7f49ebc00640 1 Processor -- start 2024-03-27T10:01:11.498 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.509+0000 7f49ebc00640 1 -- start start 2024-03-27T10:01:11.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.510+0000 7f49ebc00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f49e40711b0 0x7f49e41f7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:11.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.510+0000 7f49ebc00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f49e40acd60 0x7f49e415cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:11.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.510+0000 7f49ebc00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f49e40aea20 0x7f49e414c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:11.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.510+0000 7f49ebc00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f49e4072bc0 con 0x7f49e40aea20 2024-03-27T10:01:11.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.510+0000 7f49ebc00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f49e40728e0 con 0x7f49e40711b0 2024-03-27T10:01:11.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.510+0000 7f49ebc00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f49e4072ea0 con 0x7f49e40acd60 2024-03-27T10:01:11.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.511+0000 7f49e9c00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f49e40aea20 0x7f49e414c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:11.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.511+0000 7f49e9c00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f49e40aea20 0x7f49e414c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56860/0 (socket says 172.21.15.57:56860) 2024-03-27T10:01:11.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.511+0000 7f49e9c00640 1 -- 172.21.15.57:0/2193389402 learned_addr learned my addr 172.21.15.57:0/2193389402 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:01:11.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.511+0000 7f49e9200640 1 --2- 172.21.15.57:0/2193389402 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f49e40711b0 0x7f49e41f7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:11.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.511+0000 7f49e9c00640 1 -- 172.21.15.57:0/2193389402 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f49e40acd60 msgr2=0x7f49e415cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:11.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.511+0000 7f49e9c00640 1 --2- 172.21.15.57:0/2193389402 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f49e40acd60 0x7f49e415cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:11.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.511+0000 7f49e9c00640 1 -- 172.21.15.57:0/2193389402 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f49e40711b0 msgr2=0x7f49e41f7bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:11.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.511+0000 7f49e9c00640 1 --2- 172.21.15.57:0/2193389402 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f49e40711b0 0x7f49e41f7bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:11.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.511+0000 7f49e9c00640 1 -- 172.21.15.57:0/2193389402 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49e414f160 con 0x7f49e40aea20 2024-03-27T10:01:11.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.512+0000 7f49e9c00640 1 --2- 172.21.15.57:0/2193389402 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f49e40aea20 0x7f49e414c470 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f49dc00c780 tx=0x7f49dc00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:11.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.512+0000 7f49e0c00640 1 -- 172.21.15.57:0/2193389402 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49dc004b60 con 0x7f49e40aea20 2024-03-27T10:01:11.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.512+0000 7f49e0c00640 1 -- 172.21.15.57:0/2193389402 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49dc004d00 con 0x7f49e40aea20 2024-03-27T10:01:11.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.512+0000 7f49e0c00640 1 -- 172.21.15.57:0/2193389402 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49dc00aa90 con 0x7f49e40aea20 2024-03-27T10:01:11.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.512+0000 7f49ebc00640 1 -- 172.21.15.57:0/2193389402 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49e41f8100 con 0x7f49e40aea20 2024-03-27T10:01:11.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.512+0000 7f49ebc00640 1 -- 172.21.15.57:0/2193389402 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49e414f6c0 con 0x7f49e40aea20 2024-03-27T10:01:11.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.513+0000 7f49ebc00640 1 -- 172.21.15.57:0/2193389402 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49e4150060 con 0x7f49e40aea20 2024-03-27T10:01:11.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.514+0000 7f49e0c00640 1 -- 172.21.15.57:0/2193389402 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f49dc00ac30 con 0x7f49e40aea20 2024-03-27T10:01:11.504 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.515+0000 7f49e0c00640 1 --2- 172.21.15.57:0/2193389402 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f49c406c530 0x7f49c406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:11.504 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.515+0000 7f49e0c00640 1 -- 172.21.15.57:0/2193389402 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6821+0+0 (secure 0 0 0) 0x7f49dc08be00 con 0x7f49e40aea20 2024-03-27T10:01:11.504 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.516+0000 7f49e9200640 1 --2- 172.21.15.57:0/2193389402 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f49c406c530 0x7f49c406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:11.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.516+0000 7f49e9200640 1 --2- 172.21.15.57:0/2193389402 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f49c406c530 0x7f49c406e9f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f49d800a950 tx=0x7f49d8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:11.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.520+0000 7f49e0c00640 1 -- 172.21.15.57:0/2193389402 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f49e4150060 con 0x7f49e40aea20 2024-03-27T10:01:11.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:11.764+0000 7f49ebc00640 1 -- 172.21.15.57:0/2193389402 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f49e40adac0 con 0x7f49e40aea20 2024-03-27T10:01:12.257 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:12.268+0000 7f49e0c00640 1 -- 172.21.15.57:0/2193389402 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7f49dc020070 con 0x7f49e40aea20 2024-03-27T10:01:12.261 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:12.272+0000 7f49ebc00640 1 -- 172.21.15.57:0/2193389402 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f49c406c530 msgr2=0x7f49c406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:12.261 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:12.272+0000 7f49ebc00640 1 --2- 172.21.15.57:0/2193389402 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f49c406c530 0x7f49c406e9f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f49d800a950 tx=0x7f49d8008040 comp rx=0 tx=0).stop 2024-03-27T10:01:12.261 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:12.272+0000 7f49ebc00640 1 -- 172.21.15.57:0/2193389402 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f49e40aea20 msgr2=0x7f49e414c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:12.262 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:12.272+0000 7f49ebc00640 1 --2- 172.21.15.57:0/2193389402 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f49e40aea20 0x7f49e414c470 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f49dc00c780 tx=0x7f49dc00cc40 comp rx=0 tx=0).stop 2024-03-27T10:01:12.262 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:12.272+0000 7f49ebc00640 1 -- 172.21.15.57:0/2193389402 shutdown_connections 2024-03-27T10:01:12.262 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:12.272+0000 7f49ebc00640 1 --2- 172.21.15.57:0/2193389402 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f49e40aea20 0x7f49e414c470 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:12.262 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:12.272+0000 7f49ebc00640 1 --2- 172.21.15.57:0/2193389402 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f49e40acd60 0x7f49e415cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:12.262 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:12.272+0000 7f49ebc00640 1 --2- 172.21.15.57:0/2193389402 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f49c406c530 0x7f49c406e9f0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:12.262 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:12.272+0000 7f49ebc00640 1 --2- 172.21.15.57:0/2193389402 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f49e40711b0 0x7f49e41f7bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:12.262 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:12.272+0000 7f49ebc00640 1 -- 172.21.15.57:0/2193389402 >> 172.21.15.57:0/2193389402 conn(0x7f49e40b18a0 msgr2=0x7f49e40af710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:12.262 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:12.272+0000 7f49ebc00640 1 -- 172.21.15.57:0/2193389402 shutdown_connections 2024-03-27T10:01:12.262 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:12.272+0000 7f49ebc00640 1 -- 172.21.15.57:0/2193389402 wait complete. 2024-03-27T10:01:12.283 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-03-27T10:01:12.498 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:12.508+0000 7fb6d1a00640 1 Processor -- start 2024-03-27T10:01:12.498 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:12.509+0000 7fb6d1a00640 1 -- start start 2024-03-27T10:01:12.499 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:12.510+0000 7fb6d1a00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb6cc15e040 0x7fb6cc0cf810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:12.500 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:12.510+0000 7fb6d1a00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fb6cc0cfd50 0x7fb6cc0d0940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:12.500 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:12.510+0000 7fb6d1a00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb6cc15e420 0x7fb6cc0d0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:12.500 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:12.510+0000 7fb6d1a00640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7fb6cc0d2b10 con 0x7fb6cc15e040 2024-03-27T10:01:12.500 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:12.510+0000 7fb6d1a00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7fb6cc0d2fa0 con 0x7fb6cc0cfd50 2024-03-27T10:01:12.500 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:12.510+0000 7fb6d1a00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fb6cc0d1f00 con 0x7fb6cc15e420 2024-03-27T10:01:12.500 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:12.510+0000 7fb6cbe00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb6cc15e040 0x7fb6cc0cf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:12.500 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:12.511+0000 7fb6cbe00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb6cc15e040 0x7fb6cc0cf810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58570/0 (socket says 172.21.15.57:58570) 2024-03-27T10:01:12.500 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:12.511+0000 7fb6cbe00640 1 -- 172.21.15.57:0/529948347 learned_addr learned my addr 172.21.15.57:0/529948347 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:01:12.500 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:12.511+0000 7fb6d1000640 1 --2- 172.21.15.57:0/529948347 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb6cc15e420 0x7fb6cc0d0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:12.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:12.511+0000 7fb6cb400640 1 --2- 172.21.15.57:0/529948347 >> v2:172.21.15.118:3300/0 conn(0x7fb6cc0cfd50 0x7fb6cc0d0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:12.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:12.511+0000 7fb6cbe00640 1 -- 172.21.15.57:0/529948347 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb6cc15e420 msgr2=0x7fb6cc0d0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:01:12.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:12.511+0000 7fb6cbe00640 1 --2- 172.21.15.57:0/529948347 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb6cc15e420 0x7fb6cc0d0e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:12.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:12.511+0000 7fb6cbe00640 1 -- 172.21.15.57:0/529948347 >> v2:172.21.15.118:3300/0 conn(0x7fb6cc0cfd50 msgr2=0x7fb6cc0d0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:01:12.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:12.511+0000 7fb6cbe00640 1 --2- 172.21.15.57:0/529948347 >> v2:172.21.15.118:3300/0 conn(0x7fb6cc0cfd50 0x7fb6cc0d0940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:12.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:12.511+0000 7fb6cbe00640 1 -- 172.21.15.57:0/529948347 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6cc0d21e0 con 0x7fb6cc15e040 2024-03-27T10:01:12.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:12.512+0000 7fb6cbe00640 1 --2- 172.21.15.57:0/529948347 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb6cc15e040 0x7fb6cc0cf810 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fb6cc0d4fc0 tx=0x7fb6bc02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=601146081bd60119 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:12.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:12.512+0000 7fb6caa00640 1 -- 172.21.15.57:0/529948347 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6bc02ca70 con 0x7fb6cc15e040 2024-03-27T10:01:12.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:12.513+0000 7fb6caa00640 1 -- 172.21.15.57:0/529948347 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6bc02cc10 con 0x7fb6cc15e040 2024-03-27T10:01:12.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:12.513+0000 7fb6caa00640 1 -- 172.21.15.57:0/529948347 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6bc0343f0 con 0x7fb6cc15e040 2024-03-27T10:01:12.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:12.513+0000 7fb6d1a00640 1 -- 172.21.15.57:0/529948347 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb6cc15e040 msgr2=0x7fb6cc0cf810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:12.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:12.513+0000 7fb6d1a00640 1 --2- 172.21.15.57:0/529948347 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb6cc15e040 0x7fb6cc0cf810 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fb6cc0d4fc0 tx=0x7fb6bc02bed0 comp rx=0 tx=0).stop 2024-03-27T10:01:12.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:12.513+0000 7fb6d1a00640 1 -- 172.21.15.57:0/529948347 shutdown_connections 2024-03-27T10:01:12.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:12.513+0000 7fb6d1a00640 1 --2- 172.21.15.57:0/529948347 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb6cc15e420 0x7fb6cc0d0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:12.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:12.513+0000 7fb6d1a00640 1 --2- 172.21.15.57:0/529948347 >> v2:172.21.15.118:3300/0 conn(0x7fb6cc0cfd50 0x7fb6cc0d0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:12.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:12.513+0000 7fb6d1a00640 1 --2- 172.21.15.57:0/529948347 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb6cc15e040 0x7fb6cc0cf810 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:12.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:12.513+0000 7fb6d1a00640 1 -- 172.21.15.57:0/529948347 >> 172.21.15.57:0/529948347 conn(0x7fb6cc09d2c0 msgr2=0x7fb6cc0d3f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:12.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:12.513+0000 7fb6d1a00640 1 -- 172.21.15.57:0/529948347 shutdown_connections 2024-03-27T10:01:12.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:12.514+0000 7fb6d1a00640 1 -- 172.21.15.57:0/529948347 wait complete. 2024-03-27T10:01:12.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:12.516+0000 7fb6d1a00640 1 Processor -- start 2024-03-27T10:01:12.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:12.516+0000 7fb6d1a00640 1 -- start start 2024-03-27T10:01:12.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:12.517+0000 7fb6d1a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb6cc0cfd50 0x7fb6cc15a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:12.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:12.517+0000 7fb6d1a00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb6cc15e040 0x7fb6cc0ca010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:12.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:12.517+0000 7fb6d1a00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb6cc15e420 0x7fb6cc0ccc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:12.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:12.517+0000 7fb6d1a00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fb6cc0d1b20 con 0x7fb6cc15e420 2024-03-27T10:01:12.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:12.517+0000 7fb6d1a00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fb6cc0d27a0 con 0x7fb6cc0cfd50 2024-03-27T10:01:12.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:12.517+0000 7fb6d1a00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fb6cc0d1ca0 con 0x7fb6cc15e040 2024-03-27T10:01:12.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:12.518+0000 7fb6d1000640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb6cc15e420 0x7fb6cc0ccc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:12.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:12.518+0000 7fb6d1000640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb6cc15e420 0x7fb6cc0ccc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58576/0 (socket says 172.21.15.57:58576) 2024-03-27T10:01:12.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:12.518+0000 7fb6d1000640 1 -- 172.21.15.57:0/2084024704 learned_addr learned my addr 172.21.15.57:0/2084024704 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:01:12.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:12.518+0000 7fb6cbe00640 1 --2- 172.21.15.57:0/2084024704 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb6cc0cfd50 0x7fb6cc15a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:12.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:12.518+0000 7fb6cb400640 1 --2- 172.21.15.57:0/2084024704 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb6cc15e040 0x7fb6cc0ca010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:12.508 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:12.518+0000 7fb6d1000640 1 -- 172.21.15.57:0/2084024704 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb6cc15e040 msgr2=0x7fb6cc0ca010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:12.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:12.518+0000 7fb6d1000640 1 --2- 172.21.15.57:0/2084024704 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb6cc15e040 0x7fb6cc0ca010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:12.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:12.518+0000 7fb6d1000640 1 -- 172.21.15.57:0/2084024704 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb6cc0cfd50 msgr2=0x7fb6cc15a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:12.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:12.518+0000 7fb6d1000640 1 --2- 172.21.15.57:0/2084024704 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb6cc0cfd50 0x7fb6cc15a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:12.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:12.518+0000 7fb6d1000640 1 -- 172.21.15.57:0/2084024704 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6cc0cbdd0 con 0x7fb6cc15e420 2024-03-27T10:01:12.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:12.518+0000 7fb6d1000640 1 --2- 172.21.15.57:0/2084024704 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb6cc15e420 0x7fb6cc0ccc40 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fb6c400d5a0 tx=0x7fb6c400da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:12.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:12.519+0000 7fb6c3e00640 1 -- 172.21.15.57:0/2084024704 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6c40125f0 con 0x7fb6cc15e420 2024-03-27T10:01:12.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:12.519+0000 7fb6c3e00640 1 -- 172.21.15.57:0/2084024704 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6c4019070 con 0x7fb6cc15e420 2024-03-27T10:01:12.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:12.519+0000 7fb6d1a00640 1 -- 172.21.15.57:0/2084024704 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6cc0cc0b0 con 0x7fb6cc15e420 2024-03-27T10:01:12.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:12.519+0000 7fb6c3e00640 1 -- 172.21.15.57:0/2084024704 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6c40129f0 con 0x7fb6cc15e420 2024-03-27T10:01:12.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:12.519+0000 7fb6d1a00640 1 -- 172.21.15.57:0/2084024704 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6cc0c78b0 con 0x7fb6cc15e420 2024-03-27T10:01:12.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:12.520+0000 7fb6d1a00640 1 -- 172.21.15.57:0/2084024704 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6cc068540 con 0x7fb6cc15e420 2024-03-27T10:01:12.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:12.521+0000 7fb6c3e00640 1 -- 172.21.15.57:0/2084024704 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fb6c4012b90 con 0x7fb6cc15e420 2024-03-27T10:01:12.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:12.522+0000 7fb6c3e00640 1 --2- 172.21.15.57:0/2084024704 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fb6a806c530 0x7fb6a806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:12.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:12.522+0000 7fb6c3e00640 1 -- 172.21.15.57:0/2084024704 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6821+0+0 (secure 0 0 0) 0x7fb6c408bfc0 con 0x7fb6cc15e420 2024-03-27T10:01:12.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:12.522+0000 7fb6cbe00640 1 --2- 172.21.15.57:0/2084024704 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fb6a806c530 0x7fb6a806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:12.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:12.523+0000 7fb6cbe00640 1 --2- 172.21.15.57:0/2084024704 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fb6a806c530 0x7fb6a806e9f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc035000 tx=0x7fb6bc030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:12.515 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:12.526+0000 7fb6c3e00640 1 -- 172.21.15.57:0/2084024704 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7fb6c405a0f0 con 0x7fb6cc15e420 2024-03-27T10:01:12.716 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:12.727+0000 7fb6d1a00640 1 -- 172.21.15.57:0/2084024704 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fb6cc0d4660 con 0x7fb6cc15e420 2024-03-27T10:01:13.264 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:13.275+0000 7fb6c3e00640 1 -- 172.21.15.57:0/2084024704 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v30) ==== 181+0+0 (secure 0 0 0) 0x7fb6c40599f0 con 0x7fb6cc15e420 2024-03-27T10:01:13.264 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_metadata' removed 2024-03-27T10:01:13.267 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:13.278+0000 7fb6d1a00640 1 -- 172.21.15.57:0/2084024704 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fb6a806c530 msgr2=0x7fb6a806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:13.267 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:13.278+0000 7fb6d1a00640 1 --2- 172.21.15.57:0/2084024704 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fb6a806c530 0x7fb6a806e9f0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc035000 tx=0x7fb6bc030000 comp rx=0 tx=0).stop 2024-03-27T10:01:13.268 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:13.278+0000 7fb6d1a00640 1 -- 172.21.15.57:0/2084024704 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb6cc15e420 msgr2=0x7fb6cc0ccc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:13.268 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:13.278+0000 7fb6d1a00640 1 --2- 172.21.15.57:0/2084024704 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb6cc15e420 0x7fb6cc0ccc40 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fb6c400d5a0 tx=0x7fb6c400da60 comp rx=0 tx=0).stop 2024-03-27T10:01:13.268 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:13.279+0000 7fb6d1a00640 1 -- 172.21.15.57:0/2084024704 shutdown_connections 2024-03-27T10:01:13.268 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:13.279+0000 7fb6d1a00640 1 --2- 172.21.15.57:0/2084024704 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb6cc15e420 0x7fb6cc0ccc40 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:13.268 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:13.279+0000 7fb6d1a00640 1 --2- 172.21.15.57:0/2084024704 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb6cc15e040 0x7fb6cc0ca010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:13.268 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:13.279+0000 7fb6d1a00640 1 --2- 172.21.15.57:0/2084024704 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fb6a806c530 0x7fb6a806e9f0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:13.268 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:13.279+0000 7fb6d1a00640 1 --2- 172.21.15.57:0/2084024704 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb6cc0cfd50 0x7fb6cc15a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:13.269 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:13.279+0000 7fb6d1a00640 1 -- 172.21.15.57:0/2084024704 >> 172.21.15.57:0/2084024704 conn(0x7fb6cc09d2c0 msgr2=0x7fb6cc06d7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:13.269 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:13.279+0000 7fb6d1a00640 1 -- 172.21.15.57:0/2084024704 shutdown_connections 2024-03-27T10:01:13.269 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:13.279+0000 7fb6d1a00640 1 -- 172.21.15.57:0/2084024704 wait complete. 2024-03-27T10:01:13.290 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-03-27T10:01:13.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:13.520+0000 7f0fd0400640 1 Processor -- start 2024-03-27T10:01:13.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:13.520+0000 7f0fd0400640 1 -- start start 2024-03-27T10:01:13.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:13.521+0000 7f0fd0400640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0fc80b5500 0x7f0fc815e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:13.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:13.521+0000 7f0fd0400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f0fc815e7d0 0x7f0fc80b3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:13.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:13.521+0000 7f0fd0400640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0fc815ec60 con 0x7f0fc80d2260 2024-03-27T10:01:13.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:13.521+0000 7f0fd0400640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f0fc80d3290 con 0x7f0fc80b5500 2024-03-27T10:01:13.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:13.521+0000 7f0fd0400640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f0fc80cf8c0 con 0x7f0fc815e7d0 2024-03-27T10:01:13.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:13.522+0000 7f0fcd000640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0fc80b5500 0x7f0fc815e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:13.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:13.522+0000 7f0fcd000640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0fc80b5500 0x7f0fc815e290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58588/0 (socket says 172.21.15.57:58588) 2024-03-27T10:01:13.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:13.522+0000 7f0fcd000640 1 -- 172.21.15.57:0/3547444915 learned_addr learned my addr 172.21.15.57:0/3547444915 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:01:13.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:13.522+0000 7f0fce400640 1 --2- 172.21.15.57:0/3547444915 >> v2:172.21.15.118:3300/0 conn(0x7f0fc815e7d0 0x7f0fc80b3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:13.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:13.522+0000 7f0fcd000640 1 -- 172.21.15.57:0/3547444915 >> v2:172.21.15.118:3300/0 conn(0x7f0fc815e7d0 msgr2=0x7f0fc80b3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:01:13.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:13.522+0000 7f0fcd000640 1 --2- 172.21.15.57:0/3547444915 >> v2:172.21.15.118:3300/0 conn(0x7f0fc815e7d0 0x7f0fc80b3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:13.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:13.522+0000 7f0fcd000640 1 -- 172.21.15.57:0/3547444915 >> v1:172.21.15.118:6789/0 conn(0x7f0fc80d2260 legacy=0x7f0fc80d2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:01:13.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:13.522+0000 7f0fcd000640 1 -- 172.21.15.57:0/3547444915 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fc80d2fb0 con 0x7f0fc80b5500 2024-03-27T10:01:13.512 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:13.522+0000 7f0fce400640 1 --2- 172.21.15.57:0/3547444915 >> v2:172.21.15.118:3300/0 conn(0x7f0fc815e7d0 0x7f0fc80b3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T10:01:13.514 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:13.524+0000 7f0fcd000640 1 --2- 172.21.15.57:0/3547444915 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0fc80b5500 0x7f0fc815e290 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f0fc8075440 tx=0x7f0fb802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=497643f440f6d27b server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:13.514 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:13.524+0000 7f0fc7e00640 1 -- 172.21.15.57:0/3547444915 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb802ca80 con 0x7f0fc80b5500 2024-03-27T10:01:13.514 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:13.524+0000 7f0fc7e00640 1 -- 172.21.15.57:0/3547444915 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fb802cc20 con 0x7f0fc80b5500 2024-03-27T10:01:13.514 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:13.524+0000 7f0fc7e00640 1 -- 172.21.15.57:0/3547444915 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fb80343f0 con 0x7f0fc80b5500 2024-03-27T10:01:13.514 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:13.524+0000 7f0fd0400640 1 -- 172.21.15.57:0/3547444915 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0fc80b5500 msgr2=0x7f0fc815e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:13.514 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:13.524+0000 7f0fd0400640 1 --2- 172.21.15.57:0/3547444915 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0fc80b5500 0x7f0fc815e290 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f0fc8075440 tx=0x7f0fb802bee0 comp rx=0 tx=0).stop 2024-03-27T10:01:13.514 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:13.525+0000 7f0fd0400640 1 -- 172.21.15.57:0/3547444915 shutdown_connections 2024-03-27T10:01:13.514 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:13.525+0000 7f0fd0400640 1 --2- 172.21.15.57:0/3547444915 >> v2:172.21.15.118:3300/0 conn(0x7f0fc815e7d0 0x7f0fc80b3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:13.514 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:13.525+0000 7f0fd0400640 1 --2- 172.21.15.57:0/3547444915 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0fc80b5500 0x7f0fc815e290 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:13.514 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:13.525+0000 7f0fd0400640 1 -- 172.21.15.57:0/3547444915 >> 172.21.15.57:0/3547444915 conn(0x7f0fc80d40f0 msgr2=0x7f0fc80d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:13.515 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:13.525+0000 7f0fd0400640 1 -- 172.21.15.57:0/3547444915 shutdown_connections 2024-03-27T10:01:13.515 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:13.525+0000 7f0fd0400640 1 -- 172.21.15.57:0/3547444915 wait complete. 2024-03-27T10:01:13.515 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:13.526+0000 7f0fd0400640 1 Processor -- start 2024-03-27T10:01:13.515 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:13.527+0000 7f0fd0400640 1 -- start start 2024-03-27T10:01:13.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:13.527+0000 7f0fd0400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0fc80b5500 0x7f0fc8160850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:13.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:13.528+0000 7f0fd0400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0fc80d2260 0x7f0fc80cbe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:13.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:13.528+0000 7f0fd0400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0fc815e7d0 0x7f0fc81521d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:13.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:13.528+0000 7f0fd0400640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f0fc80d2d50 con 0x7f0fc815e7d0 2024-03-27T10:01:13.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:13.528+0000 7f0fd0400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f0fc80d0160 con 0x7f0fc80b5500 2024-03-27T10:01:13.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:13.528+0000 7f0fd0400640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f0fc80cfdf0 con 0x7f0fc80d2260 2024-03-27T10:01:13.518 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:13.528+0000 7f0fce400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0fc815e7d0 0x7f0fc81521d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:13.519 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:13.528+0000 7f0fce400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0fc815e7d0 0x7f0fc81521d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58602/0 (socket says 172.21.15.57:58602) 2024-03-27T10:01:13.519 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:13.528+0000 7f0fce400640 1 -- 172.21.15.57:0/4177469820 learned_addr learned my addr 172.21.15.57:0/4177469820 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:01:13.519 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:13.528+0000 7f0fcd000640 1 --2- 172.21.15.57:0/4177469820 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0fc80d2260 0x7f0fc80cbe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:13.519 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:13.528+0000 7f0fcda00640 1 --2- 172.21.15.57:0/4177469820 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0fc80b5500 0x7f0fc8160850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:13.519 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:13.528+0000 7f0fce400640 1 -- 172.21.15.57:0/4177469820 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0fc80d2260 msgr2=0x7f0fc80cbe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:13.519 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:13.528+0000 7f0fce400640 1 --2- 172.21.15.57:0/4177469820 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0fc80d2260 0x7f0fc80cbe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:13.519 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:13.529+0000 7f0fce400640 1 -- 172.21.15.57:0/4177469820 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0fc80b5500 msgr2=0x7f0fc8160850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:13.519 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:13.529+0000 7f0fce400640 1 --2- 172.21.15.57:0/4177469820 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0fc80b5500 0x7f0fc8160850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:13.519 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:13.529+0000 7f0fce400640 1 -- 172.21.15.57:0/4177469820 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fc81610a0 con 0x7f0fc815e7d0 2024-03-27T10:01:13.519 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:13.529+0000 7f0fcda00640 1 --2- 172.21.15.57:0/4177469820 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0fc80b5500 0x7f0fc8160850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T10:01:13.519 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:13.529+0000 7f0fcd000640 1 --2- 172.21.15.57:0/4177469820 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0fc80d2260 0x7f0fc80cbe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T10:01:13.519 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:13.529+0000 7f0fce400640 1 --2- 172.21.15.57:0/4177469820 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0fc815e7d0 0x7f0fc81521d0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f0fc000c820 tx=0x7f0fc000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:13.520 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:13.529+0000 7f0fc5600640 1 -- 172.21.15.57:0/4177469820 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fc0015070 con 0x7f0fc815e7d0 2024-03-27T10:01:13.520 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:13.529+0000 7f0fc5600640 1 -- 172.21.15.57:0/4177469820 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0fc0007a30 con 0x7f0fc815e7d0 2024-03-27T10:01:13.520 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:13.529+0000 7f0fc5600640 1 -- 172.21.15.57:0/4177469820 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fc0007e20 con 0x7f0fc815e7d0 2024-03-27T10:01:13.520 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:13.529+0000 7f0fd0400640 1 -- 172.21.15.57:0/4177469820 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fc8161380 con 0x7f0fc815e7d0 2024-03-27T10:01:13.520 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:13.529+0000 7f0fd0400640 1 -- 172.21.15.57:0/4177469820 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fc8161940 con 0x7f0fc815e7d0 2024-03-27T10:01:13.520 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:13.530+0000 7f0fd0400640 1 -- 172.21.15.57:0/4177469820 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fc808e180 con 0x7f0fc815e7d0 2024-03-27T10:01:13.520 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:13.531+0000 7f0fc5600640 1 -- 172.21.15.57:0/4177469820 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f0fc0018070 con 0x7f0fc815e7d0 2024-03-27T10:01:13.522 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:13.533+0000 7f0fc5600640 1 --2- 172.21.15.57:0/4177469820 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f0fac06c530 0x7f0fac06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:13.522 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:13.533+0000 7f0fc5600640 1 -- 172.21.15.57:0/4177469820 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6383+0+0 (secure 0 0 0) 0x7f0fc008b950 con 0x7f0fc815e7d0 2024-03-27T10:01:13.522 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:13.533+0000 7f0fcda00640 1 --2- 172.21.15.57:0/4177469820 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f0fac06c530 0x7f0fac06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:13.523 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:13.534+0000 7f0fcda00640 1 --2- 172.21.15.57:0/4177469820 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f0fac06c530 0x7f0fac06e9f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc00a830 tx=0x7f0fbc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:13.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:13.538+0000 7f0fc5600640 1 -- 172.21.15.57:0/4177469820 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f0fc808e180 con 0x7f0fc815e7d0 2024-03-27T10:01:13.729 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:13.740+0000 7f0fd0400640 1 -- 172.21.15.57:0/4177469820 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f0fc8068620 con 0x7f0fc815e7d0 2024-03-27T10:01:14.276 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:14.287+0000 7f0fc5600640 1 -- 172.21.15.57:0/4177469820 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v31) ==== 169+0+0 (secure 0 0 0) 0x7f0fc0059cc0 con 0x7f0fc815e7d0 2024-03-27T10:01:14.276 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_data' removed 2024-03-27T10:01:14.282 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:14.291+0000 7f0fd0400640 1 -- 172.21.15.57:0/4177469820 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f0fac06c530 msgr2=0x7f0fac06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:14.282 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:14.291+0000 7f0fd0400640 1 --2- 172.21.15.57:0/4177469820 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f0fac06c530 0x7f0fac06e9f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc00a830 tx=0x7f0fbc008040 comp rx=0 tx=0).stop 2024-03-27T10:01:14.282 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:14.291+0000 7f0fd0400640 1 -- 172.21.15.57:0/4177469820 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0fc815e7d0 msgr2=0x7f0fc81521d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:14.282 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:14.291+0000 7f0fd0400640 1 --2- 172.21.15.57:0/4177469820 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0fc815e7d0 0x7f0fc81521d0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f0fc000c820 tx=0x7f0fc000cce0 comp rx=0 tx=0).stop 2024-03-27T10:01:14.282 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:14.292+0000 7f0fd0400640 1 -- 172.21.15.57:0/4177469820 shutdown_connections 2024-03-27T10:01:14.283 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:14.292+0000 7f0fd0400640 1 --2- 172.21.15.57:0/4177469820 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0fc815e7d0 0x7f0fc81521d0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:14.283 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:14.292+0000 7f0fd0400640 1 --2- 172.21.15.57:0/4177469820 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0fc80d2260 0x7f0fc80cbe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:14.283 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:14.292+0000 7f0fd0400640 1 --2- 172.21.15.57:0/4177469820 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f0fac06c530 0x7f0fac06e9f0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:14.283 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:14.292+0000 7f0fd0400640 1 --2- 172.21.15.57:0/4177469820 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0fc80b5500 0x7f0fc8160850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:14.283 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:14.292+0000 7f0fd0400640 1 -- 172.21.15.57:0/4177469820 >> 172.21.15.57:0/4177469820 conn(0x7f0fc80d40f0 msgr2=0x7f0fc80b4aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:14.283 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:14.293+0000 7f0fd0400640 1 -- 172.21.15.57:0/4177469820 shutdown_connections 2024-03-27T10:01:14.283 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:14.294+0000 7f0fd0400640 1 -- 172.21.15.57:0/4177469820 wait complete. 2024-03-27T10:01:14.308 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-03-27T10:01:14.523 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:14.534+0000 7f6927200640 1 Processor -- start 2024-03-27T10:01:14.524 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:14.534+0000 7f6927200640 1 -- start start 2024-03-27T10:01:14.525 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:14.536+0000 7f6927200640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f692815e040 0x7f69280cf810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:14.525 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:14.536+0000 7f6927200640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f69280d1050 0x7f69280b4b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:14.525 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:14.536+0000 7f6927200640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69280d2fa0 con 0x7f69280cfd50 2024-03-27T10:01:14.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:14.536+0000 7f6927200640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f69280d2b10 con 0x7f692815e040 2024-03-27T10:01:14.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:14.536+0000 7f6927200640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f69280d1f00 con 0x7f69280d1050 2024-03-27T10:01:14.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:14.536+0000 7f6925e00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f692815e040 0x7f69280cf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:14.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:14.536+0000 7f6925e00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f692815e040 0x7f69280cf810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58604/0 (socket says 172.21.15.57:58604) 2024-03-27T10:01:14.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:14.536+0000 7f6925e00640 1 -- 172.21.15.57:0/2159835402 learned_addr learned my addr 172.21.15.57:0/2159835402 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:01:14.527 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:14.537+0000 7f6926800640 1 --2- 172.21.15.57:0/2159835402 >> v2:172.21.15.118:3300/0 conn(0x7f69280d1050 0x7f69280b4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:14.527 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:14.537+0000 7f6925e00640 1 -- 172.21.15.57:0/2159835402 >> v2:172.21.15.118:3300/0 conn(0x7f69280d1050 msgr2=0x7f69280b4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:01:14.527 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:14.537+0000 7f6925e00640 1 --2- 172.21.15.57:0/2159835402 >> v2:172.21.15.118:3300/0 conn(0x7f69280d1050 0x7f69280b4b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:14.527 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:14.537+0000 7f6925e00640 1 -- 172.21.15.57:0/2159835402 >> v1:172.21.15.118:6789/0 conn(0x7f69280cfd50 legacy=0x7f69280d0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:01:14.527 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:14.537+0000 7f6925e00640 1 -- 172.21.15.57:0/2159835402 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69280d21e0 con 0x7f692815e040 2024-03-27T10:01:14.527 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:14.537+0000 7f6926800640 1 --2- 172.21.15.57:0/2159835402 >> v2:172.21.15.118:3300/0 conn(0x7f69280d1050 0x7f69280b4b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T10:01:14.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:14.538+0000 7f6925e00640 1 --2- 172.21.15.57:0/2159835402 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f692815e040 0x7f69280cf810 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f69280d3ca0 tx=0x7f691802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9180952edb875f9 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:14.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:14.539+0000 7f6925400640 1 -- 172.21.15.57:0/2159835402 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6918035020 con 0x7f692815e040 2024-03-27T10:01:14.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:14.539+0000 7f6925400640 1 -- 172.21.15.57:0/2159835402 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6918031870 con 0x7f692815e040 2024-03-27T10:01:14.528 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:14.539+0000 7f6925400640 1 -- 172.21.15.57:0/2159835402 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6918031c40 con 0x7f692815e040 2024-03-27T10:01:14.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:14.539+0000 7f6927200640 1 -- 172.21.15.57:0/2159835402 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f692815e040 msgr2=0x7f69280cf810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:14.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:14.539+0000 7f6927200640 1 --2- 172.21.15.57:0/2159835402 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f692815e040 0x7f69280cf810 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f69280d3ca0 tx=0x7f691802b910 comp rx=0 tx=0).stop 2024-03-27T10:01:14.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:14.540+0000 7f6927200640 1 -- 172.21.15.57:0/2159835402 shutdown_connections 2024-03-27T10:01:14.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:14.540+0000 7f6927200640 1 --2- 172.21.15.57:0/2159835402 >> v2:172.21.15.118:3300/0 conn(0x7f69280d1050 0x7f69280b4b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:14.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:14.540+0000 7f6927200640 1 --2- 172.21.15.57:0/2159835402 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f692815e040 0x7f69280cf810 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:14.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:14.540+0000 7f6927200640 1 -- 172.21.15.57:0/2159835402 >> 172.21.15.57:0/2159835402 conn(0x7f692809d2c0 msgr2=0x7f69280d3f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:14.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:14.540+0000 7f6927200640 1 -- 172.21.15.57:0/2159835402 shutdown_connections 2024-03-27T10:01:14.529 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:14.540+0000 7f6927200640 1 -- 172.21.15.57:0/2159835402 wait complete. 2024-03-27T10:01:14.530 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:14.541+0000 7f6927200640 1 Processor -- start 2024-03-27T10:01:14.530 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:14.542+0000 7f6927200640 1 -- start start 2024-03-27T10:01:14.532 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:14.543+0000 7f6927200640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69280cfd50 0x7f69280ce010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:14.532 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:14.543+0000 7f6927200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f69280d1050 0x7f69280cba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:14.532 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:14.543+0000 7f6927200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f692815e040 0x7f692814e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:14.532 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:14.543+0000 7f6927200640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f69280d1b20 con 0x7f69280cfd50 2024-03-27T10:01:14.532 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:14.543+0000 7f6927200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f69280d27a0 con 0x7f69280d1050 2024-03-27T10:01:14.532 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:14.543+0000 7f6927200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f69280d1ca0 con 0x7f692815e040 2024-03-27T10:01:14.532 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:14.543+0000 7f6925e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69280cfd50 0x7f69280ce010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:14.532 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:14.543+0000 7f6925e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69280cfd50 0x7f69280ce010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58616/0 (socket says 172.21.15.57:58616) 2024-03-27T10:01:14.532 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:14.543+0000 7f6925e00640 1 -- 172.21.15.57:0/1132178852 learned_addr learned my addr 172.21.15.57:0/1132178852 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:01:14.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:14.543+0000 7f691fe00640 1 --2- 172.21.15.57:0/1132178852 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f69280d1050 0x7f69280cba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:14.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:14.543+0000 7f6926800640 1 --2- 172.21.15.57:0/1132178852 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f692815e040 0x7f692814e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:14.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:14.543+0000 7f6925e00640 1 -- 172.21.15.57:0/1132178852 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f692815e040 msgr2=0x7f692814e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:14.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:14.543+0000 7f6925e00640 1 --2- 172.21.15.57:0/1132178852 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f692815e040 0x7f692814e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:14.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:14.543+0000 7f6925e00640 1 -- 172.21.15.57:0/1132178852 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f69280d1050 msgr2=0x7f69280cba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:14.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:14.543+0000 7f6925e00640 1 --2- 172.21.15.57:0/1132178852 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f69280d1050 0x7f69280cba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:14.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:14.543+0000 7f6925e00640 1 -- 172.21.15.57:0/1132178852 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69280cbf40 con 0x7f69280cfd50 2024-03-27T10:01:14.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:14.543+0000 7f6926800640 1 --2- 172.21.15.57:0/1132178852 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f692815e040 0x7f692814e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T10:01:14.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:14.544+0000 7f6925e00640 1 --2- 172.21.15.57:0/1132178852 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69280cfd50 0x7f69280ce010 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f6918000c00 tx=0x7f69180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:14.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:14.544+0000 7f691e000640 1 -- 172.21.15.57:0/1132178852 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69180443f0 con 0x7f69280cfd50 2024-03-27T10:01:14.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:14.544+0000 7f691e000640 1 -- 172.21.15.57:0/1132178852 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6918044590 con 0x7f69280cfd50 2024-03-27T10:01:14.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:14.544+0000 7f6927200640 1 -- 172.21.15.57:0/1132178852 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69280cc210 con 0x7f69280cfd50 2024-03-27T10:01:14.534 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:14.544+0000 7f691e000640 1 -- 172.21.15.57:0/1132178852 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6918044980 con 0x7f69280cfd50 2024-03-27T10:01:14.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:14.544+0000 7f6927200640 1 -- 172.21.15.57:0/1132178852 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69280cc7d0 con 0x7f69280cfd50 2024-03-27T10:01:14.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:14.545+0000 7f6927200640 1 -- 172.21.15.57:0/1132178852 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6928068540 con 0x7f69280cfd50 2024-03-27T10:01:14.535 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:14.546+0000 7f691e000640 1 -- 172.21.15.57:0/1132178852 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f691804b060 con 0x7f69280cfd50 2024-03-27T10:01:14.536 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:14.547+0000 7f691e000640 1 --2- 172.21.15.57:0/1132178852 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f690406c530 0x7f690406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:14.536 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:14.547+0000 7f691e000640 1 -- 172.21.15.57:0/1132178852 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5853+0+0 (secure 0 0 0) 0x7f69180ada70 con 0x7f69280cfd50 2024-03-27T10:01:14.536 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:14.548+0000 7f691fe00640 1 --2- 172.21.15.57:0/1132178852 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f690406c530 0x7f690406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:14.537 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:14.548+0000 7f691fe00640 1 --2- 172.21.15.57:0/1132178852 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f690406c530 0x7f690406e9f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f69280cccd0 tx=0x7f6910009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:14.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:14.552+0000 7f691e000640 1 -- 172.21.15.57:0/1132178852 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f691803f070 con 0x7f69280cfd50 2024-03-27T10:01:14.745 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:14.755+0000 7f6927200640 1 -- 172.21.15.57:0/1132178852 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7f69280d0340 con 0x7f69280cfd50 2024-03-27T10:01:15.286 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:15.297+0000 7f691e000640 1 -- 172.21.15.57:0/1132178852 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v32) ==== 178+0+0 (secure 0 0 0) 0x7f691802f320 con 0x7f69280cfd50 2024-03-27T10:01:15.286 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_data_ec' removed 2024-03-27T10:01:15.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:15.301+0000 7f6927200640 1 -- 172.21.15.57:0/1132178852 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f690406c530 msgr2=0x7f690406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:15.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:15.301+0000 7f6927200640 1 --2- 172.21.15.57:0/1132178852 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f690406c530 0x7f690406e9f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f69280cccd0 tx=0x7f6910009040 comp rx=0 tx=0).stop 2024-03-27T10:01:15.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:15.301+0000 7f6927200640 1 -- 172.21.15.57:0/1132178852 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69280cfd50 msgr2=0x7f69280ce010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:15.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:15.301+0000 7f6927200640 1 --2- 172.21.15.57:0/1132178852 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69280cfd50 0x7f69280ce010 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f6918000c00 tx=0x7f69180046c0 comp rx=0 tx=0).stop 2024-03-27T10:01:15.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:15.301+0000 7f6927200640 1 -- 172.21.15.57:0/1132178852 shutdown_connections 2024-03-27T10:01:15.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:15.301+0000 7f6927200640 1 --2- 172.21.15.57:0/1132178852 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f692815e040 0x7f692814e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:15.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:15.301+0000 7f6927200640 1 --2- 172.21.15.57:0/1132178852 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f690406c530 0x7f690406e9f0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:15.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:15.301+0000 7f6927200640 1 --2- 172.21.15.57:0/1132178852 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f69280d1050 0x7f69280cba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:15.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:15.301+0000 7f6927200640 1 --2- 172.21.15.57:0/1132178852 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f69280cfd50 0x7f69280ce010 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:15.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:15.301+0000 7f6927200640 1 -- 172.21.15.57:0/1132178852 >> 172.21.15.57:0/1132178852 conn(0x7f692809d2c0 msgr2=0x7f692815e4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:15.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:15.303+0000 7f6927200640 1 -- 172.21.15.57:0/1132178852 shutdown_connections 2024-03-27T10:01:15.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:15.304+0000 7f6927200640 1 -- 172.21.15.57:0/1132178852 wait complete. 2024-03-27T10:01:15.318 INFO:tasks.ceph.mds.a:Restarting daemon 2024-03-27T10:01:15.318 INFO:tasks.ceph.mds.a:Stopping old one... 2024-03-27T10:01:15.319 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-03-27T10:01:15.319 INFO:teuthology.orchestra.run:waiting for 300 2024-03-27T10:01:15.319 INFO:tasks.ceph.mds.c:Restarting daemon 2024-03-27T10:01:15.319 INFO:tasks.ceph.mds.c:Stopping old one... 2024-03-27T10:01:15.319 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-03-27T10:01:15.319 INFO:teuthology.orchestra.run:waiting for 300 2024-03-27T10:01:15.319 INFO:tasks.ceph.mds.b:Restarting daemon 2024-03-27T10:01:15.320 INFO:tasks.ceph.mds.b:Stopping old one... 2024-03-27T10:01:15.320 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-03-27T10:01:15.320 INFO:teuthology.orchestra.run:waiting for 300 2024-03-27T10:01:15.320 INFO:tasks.ceph.mds.d:Restarting daemon 2024-03-27T10:01:15.320 INFO:tasks.ceph.mds.d:Stopping old one... 2024-03-27T10:01:15.320 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-03-27T10:01:15.320 INFO:teuthology.orchestra.run:waiting for 300 2024-03-27T10:01:15.341 INFO:tasks.ceph.mds.c:Stopped 2024-03-27T10:01:15.341 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-03-27T10:01:15.342 INFO:tasks.ceph.mds.a:Stopped 2024-03-27T10:01:15.342 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-03-27T10:01:15.343 INFO:tasks.ceph.mds.d:Stopped 2024-03-27T10:01:15.344 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-03-27T10:01:15.352 INFO:tasks.ceph.mds.b:Stopped 2024-03-27T10:01:15.352 DEBUG:teuthology.orchestra.run.smithi118:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-03-27T10:01:15.389 INFO:tasks.ceph.mds.c:Started 2024-03-27T10:01:15.390 DEBUG:teuthology.parallel:result is None 2024-03-27T10:01:15.395 INFO:tasks.ceph.mds.a:Started 2024-03-27T10:01:15.395 DEBUG:teuthology.parallel:result is None 2024-03-27T10:01:15.398 INFO:tasks.ceph.mds.d:Started 2024-03-27T10:01:15.399 DEBUG:teuthology.parallel:result is None 2024-03-27T10:01:15.405 INFO:tasks.ceph.mds.b:Started 2024-03-27T10:01:15.405 DEBUG:teuthology.parallel:result is None 2024-03-27T10:01:15.405 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-03-27T10:01:15.558 INFO:tasks.ceph.mds.c.smithi057.stdout:starting mds.c at 2024-03-27T10:01:15.562 INFO:tasks.ceph.mds.a.smithi057.stdout:starting mds.a at 2024-03-27T10:01:15.564 INFO:tasks.ceph.mds.d.smithi118.stdout:starting mds.d at 2024-03-27T10:01:15.564 INFO:tasks.ceph.mds.b.smithi118.stdout:starting mds.b at 2024-03-27T10:01:15.602 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:15.613+0000 7fa55d800640 1 Processor -- start 2024-03-27T10:01:15.603 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:15.613+0000 7fa55d800640 1 -- start start 2024-03-27T10:01:15.604 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:15.615+0000 7fa55d800640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa5580d3fe0 0x7fa5580d4440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:15.604 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:15.615+0000 7fa55d800640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fa5580ceee0 0x7fa5580cf330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:15.604 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:15.615+0000 7fa55d800640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa55815f850 con 0x7fa55815e4a0 2024-03-27T10:01:15.605 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:15.615+0000 7fa55d800640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7fa5580d0a10 con 0x7fa5580d3fe0 2024-03-27T10:01:15.605 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:15.615+0000 7fa55d800640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7fa5580d0cf0 con 0x7fa5580ceee0 2024-03-27T10:01:15.606 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:15.616+0000 7fa557400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fa5580ceee0 0x7fa5580cf330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:15.606 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:15.616+0000 7fa557400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fa5580ceee0 0x7fa5580cf330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.57:40178/0 (socket says 172.21.15.57:40178) 2024-03-27T10:01:15.606 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:15.616+0000 7fa557400640 1 -- 172.21.15.57:0/2339701173 learned_addr learned my addr 172.21.15.57:0/2339701173 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:01:15.606 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:15.616+0000 7fa54e000640 1 --2- 172.21.15.57:0/2339701173 >> v2:172.21.15.57:3300/0 conn(0x7fa5580d3fe0 0x7fa5580d4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:15.606 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:15.617+0000 7fa54e000640 1 -- 172.21.15.57:0/2339701173 >> v2:172.21.15.118:3300/0 conn(0x7fa5580ceee0 msgr2=0x7fa5580cf330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:01:15.606 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:15.617+0000 7fa54e000640 1 --2- 172.21.15.57:0/2339701173 >> v2:172.21.15.118:3300/0 conn(0x7fa5580ceee0 0x7fa5580cf330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:15.606 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:15.617+0000 7fa54e000640 1 -- 172.21.15.57:0/2339701173 >> v1:172.21.15.57:6789/0 conn(0x7fa55815e4a0 legacy=0x7fa5580d14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:15.606 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:15.617+0000 7fa54e000640 1 -- 172.21.15.57:0/2339701173 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5580d4980 con 0x7fa5580d3fe0 2024-03-27T10:01:15.607 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:15.618+0000 7fa54e000640 1 --2- 172.21.15.57:0/2339701173 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5580d3fe0 0x7fa5580d4440 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fa558161fd0 tx=0x7fa54002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d789f4a0e612871e server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:15.607 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:15.618+0000 7fa556000640 1 -- 172.21.15.57:0/2339701173 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa540035020 con 0x7fa5580d3fe0 2024-03-27T10:01:15.607 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:15.618+0000 7fa556000640 1 -- 172.21.15.57:0/2339701173 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa540031830 con 0x7fa5580d3fe0 2024-03-27T10:01:15.607 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:15.618+0000 7fa556000640 1 -- 172.21.15.57:0/2339701173 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa540031c00 con 0x7fa5580d3fe0 2024-03-27T10:01:15.608 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:15.619+0000 7fa55d800640 1 -- 172.21.15.57:0/2339701173 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5580d3fe0 msgr2=0x7fa5580d4440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:15.608 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:15.619+0000 7fa55d800640 1 --2- 172.21.15.57:0/2339701173 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5580d3fe0 0x7fa5580d4440 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fa558161fd0 tx=0x7fa54002b8d0 comp rx=0 tx=0).stop 2024-03-27T10:01:15.608 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:15.619+0000 7fa55d800640 1 -- 172.21.15.57:0/2339701173 shutdown_connections 2024-03-27T10:01:15.609 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:15.619+0000 7fa55d800640 1 --2- 172.21.15.57:0/2339701173 >> v2:172.21.15.118:3300/0 conn(0x7fa5580ceee0 0x7fa5580cf330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:15.609 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:15.619+0000 7fa55d800640 1 --2- 172.21.15.57:0/2339701173 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5580d3fe0 0x7fa5580d4440 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:15.609 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:15.619+0000 7fa55d800640 1 -- 172.21.15.57:0/2339701173 >> 172.21.15.57:0/2339701173 conn(0x7fa55808db50 msgr2=0x7fa55809d470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:15.609 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:15.620+0000 7fa55d800640 1 -- 172.21.15.57:0/2339701173 shutdown_connections 2024-03-27T10:01:15.609 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:15.620+0000 7fa55d800640 1 -- 172.21.15.57:0/2339701173 wait complete. 2024-03-27T10:01:15.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:15.621+0000 7fa55d800640 1 Processor -- start 2024-03-27T10:01:15.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:15.622+0000 7fa55d800640 1 -- start start 2024-03-27T10:01:15.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:15.622+0000 7fa55d800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5580ceee0 0x7fa558157460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:15.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:15.622+0000 7fa55d800640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5580d3fe0 0x7fa5580b3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:15.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:15.622+0000 7fa55d800640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa55815e4a0 0x7fa55815a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:15.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:15.622+0000 7fa55d800640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fa5580b3000 con 0x7fa5580d3fe0 2024-03-27T10:01:15.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:15.622+0000 7fa55d800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fa5580b2e80 con 0x7fa5580ceee0 2024-03-27T10:01:15.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:15.622+0000 7fa55d800640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fa5580b3180 con 0x7fa55815e4a0 2024-03-27T10:01:15.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:15.623+0000 7fa54e000640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5580d3fe0 0x7fa5580b3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:15.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:15.623+0000 7fa54e000640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5580d3fe0 0x7fa5580b3540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58670/0 (socket says 172.21.15.57:58670) 2024-03-27T10:01:15.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:15.623+0000 7fa54e000640 1 -- 172.21.15.57:0/185301357 learned_addr learned my addr 172.21.15.57:0/185301357 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:01:15.614 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:15.623+0000 7fa557400640 1 --2- 172.21.15.57:0/185301357 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa55815e4a0 0x7fa55815a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:15.614 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:15.623+0000 7fa556a00640 1 --2- 172.21.15.57:0/185301357 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5580ceee0 0x7fa558157460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:15.614 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:15.623+0000 7fa54e000640 1 -- 172.21.15.57:0/185301357 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa55815e4a0 msgr2=0x7fa55815a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:15.614 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:15.623+0000 7fa54e000640 1 --2- 172.21.15.57:0/185301357 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa55815e4a0 0x7fa55815a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:15.614 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:15.623+0000 7fa54e000640 1 -- 172.21.15.57:0/185301357 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5580ceee0 msgr2=0x7fa558157460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:15.615 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:15.623+0000 7fa54e000640 1 --2- 172.21.15.57:0/185301357 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5580ceee0 0x7fa558157460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:15.615 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:15.623+0000 7fa54e000640 1 -- 172.21.15.57:0/185301357 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5580b3fe0 con 0x7fa5580d3fe0 2024-03-27T10:01:15.615 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:15.624+0000 7fa54e000640 1 --2- 172.21.15.57:0/185301357 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5580d3fe0 0x7fa5580b3540 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fa540009890 tx=0x7fa5400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:15.615 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:15.624+0000 7fa54f400640 1 -- 172.21.15.57:0/185301357 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa540041070 con 0x7fa5580d3fe0 2024-03-27T10:01:15.615 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:15.624+0000 7fa54f400640 1 -- 172.21.15.57:0/185301357 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa54003b920 con 0x7fa5580d3fe0 2024-03-27T10:01:15.615 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:15.624+0000 7fa54f400640 1 -- 172.21.15.57:0/185301357 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa540035040 con 0x7fa5580d3fe0 2024-03-27T10:01:15.615 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:15.624+0000 7fa55d800640 1 -- 172.21.15.57:0/185301357 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5580b42c0 con 0x7fa5580d3fe0 2024-03-27T10:01:15.615 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:15.624+0000 7fa55d800640 1 -- 172.21.15.57:0/185301357 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5580b4880 con 0x7fa5580d3fe0 2024-03-27T10:01:15.616 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:15.626+0000 7fa55d800640 1 -- 172.21.15.57:0/185301357 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa55806c120 con 0x7fa5580d3fe0 2024-03-27T10:01:15.617 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:15.628+0000 7fa54f400640 1 -- 172.21.15.57:0/185301357 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fa540038020 con 0x7fa5580d3fe0 2024-03-27T10:01:15.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:15.629+0000 7fa54f400640 1 --2- 172.21.15.57:0/185301357 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fa53406c530 0x7fa53406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:15.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:15.629+0000 7fa54f400640 1 -- 172.21.15.57:0/185301357 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5335+0+0 (secure 0 0 0) 0x7fa5400acd60 con 0x7fa5580d3fe0 2024-03-27T10:01:15.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:15.629+0000 7fa556a00640 1 --2- 172.21.15.57:0/185301357 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fa53406c530 0x7fa53406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:15.619 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:15.630+0000 7fa556a00640 1 --2- 172.21.15.57:0/185301357 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fa53406c530 0x7fa53406e9f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa5580b6cf0 tx=0x7fa548009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:15.623 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:15.634+0000 7fa54f400640 1 -- 172.21.15.57:0/185301357 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7fa55806c120 con 0x7fa5580d3fe0 2024-03-27T10:01:15.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:15.847+0000 7fa55d800640 1 -- 172.21.15.57:0/185301357 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fa5580c7750 con 0x7fa5580d3fe0 2024-03-27T10:01:16.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:16.321+0000 7fa54f400640 1 -- 172.21.15.57:0/185301357 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v34) ==== 97+0+0 (secure 0 0 0) 0x7fa5580c7750 con 0x7fa5580d3fe0 2024-03-27T10:01:16.311 INFO:teuthology.orchestra.run.smithi057.stderr: removed all blocklist entries 2024-03-27T10:01:16.314 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:16.325+0000 7fa55d800640 1 -- 172.21.15.57:0/185301357 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fa53406c530 msgr2=0x7fa53406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:16.314 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:16.325+0000 7fa55d800640 1 --2- 172.21.15.57:0/185301357 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fa53406c530 0x7fa53406e9f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa5580b6cf0 tx=0x7fa548009040 comp rx=0 tx=0).stop 2024-03-27T10:01:16.314 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:16.325+0000 7fa55d800640 1 -- 172.21.15.57:0/185301357 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5580d3fe0 msgr2=0x7fa5580b3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:16.314 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:16.325+0000 7fa55d800640 1 --2- 172.21.15.57:0/185301357 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5580d3fe0 0x7fa5580b3540 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fa540009890 tx=0x7fa5400046c0 comp rx=0 tx=0).stop 2024-03-27T10:01:16.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:16.325+0000 7fa55d800640 1 -- 172.21.15.57:0/185301357 shutdown_connections 2024-03-27T10:01:16.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:16.325+0000 7fa55d800640 1 --2- 172.21.15.57:0/185301357 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa55815e4a0 0x7fa55815a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:16.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:16.325+0000 7fa55d800640 1 --2- 172.21.15.57:0/185301357 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa5580d3fe0 0x7fa5580b3540 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:16.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:16.325+0000 7fa55d800640 1 --2- 172.21.15.57:0/185301357 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fa53406c530 0x7fa53406e9f0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:16.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:16.325+0000 7fa55d800640 1 --2- 172.21.15.57:0/185301357 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa5580ceee0 0x7fa558157460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:16.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:16.325+0000 7fa55d800640 1 -- 172.21.15.57:0/185301357 >> 172.21.15.57:0/185301357 conn(0x7fa55808db50 msgr2=0x7fa55806cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:16.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:16.325+0000 7fa55d800640 1 -- 172.21.15.57:0/185301357 shutdown_connections 2024-03-27T10:01:16.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:16.326+0000 7fa55d800640 1 -- 172.21.15.57:0/185301357 wait complete. 2024-03-27T10:01:16.338 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-03-27T10:01:16.544 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:16.555+0000 7f267d200640 1 Processor -- start 2024-03-27T10:01:16.545 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:16.555+0000 7f267d200640 1 -- start start 2024-03-27T10:01:16.546 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:16.557+0000 7f267d200640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f267806db20 0x7f26780cff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:16.546 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:16.557+0000 7f267d200640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26780adab0 con 0x7f26780d04c0 2024-03-27T10:01:16.546 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:16.557+0000 7f267d200640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26780add90 con 0x7f26781615c0 2024-03-27T10:01:16.546 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:16.557+0000 7f267d200640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f26780d0910 con 0x7f267806db20 2024-03-27T10:01:16.547 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:16.557+0000 7f266ea00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f267806db20 0x7f26780cff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:16.547 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:16.557+0000 7f2677e00640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f26780d04c0 0x7f2678167cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:58146/0 (socket says 172.21.15.57:58146) 2024-03-27T10:01:16.547 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:16.557+0000 7f2677e00640 1 -- 172.21.15.57:0/1802635295 learned_addr learned my addr 172.21.15.57:0/1802635295 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T10:01:16.547 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:16.558+0000 7f266ea00640 1 -- 172.21.15.57:0/1802635295 >> v1:172.21.15.118:6789/0 conn(0x7f26781615c0 legacy=0x7f26780b4590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:16.547 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:16.558+0000 7f266ea00640 1 -- 172.21.15.57:0/1802635295 >> v1:172.21.15.57:6789/0 conn(0x7f26780d04c0 legacy=0x7f2678167cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:16.547 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:16.558+0000 7f266ea00640 1 -- 172.21.15.57:0/1802635295 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26780ae070 con 0x7f267806db20 2024-03-27T10:01:16.547 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:16.558+0000 7f2676a00640 1 -- 172.21.15.57:0/1802635295 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3663547285 0 0) 0x7f26780adab0 con 0x7f26780d04c0 2024-03-27T10:01:16.548 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:16.559+0000 7f266ea00640 1 --2- 172.21.15.57:0/1802635295 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f267806db20 0x7f26780cff80 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f2660009d90 tx=0x7f266002bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3316bf79e88f7ef8 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:16.548 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:16.559+0000 7f2676a00640 1 -- 172.21.15.57:0/1802635295 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2660039070 con 0x7f267806db20 2024-03-27T10:01:16.549 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:16.560+0000 7f2676a00640 1 -- 172.21.15.57:0/1802635295 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f266002ccf0 con 0x7f267806db20 2024-03-27T10:01:16.549 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:16.560+0000 7f2676a00640 1 -- 172.21.15.57:0/1802635295 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2660034660 con 0x7f267806db20 2024-03-27T10:01:16.550 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:16.560+0000 7f267d200640 1 -- 172.21.15.57:0/1802635295 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f267806db20 msgr2=0x7f26780cff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:16.550 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:16.560+0000 7f267d200640 1 --2- 172.21.15.57:0/1802635295 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f267806db20 0x7f26780cff80 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f2660009d90 tx=0x7f266002bf40 comp rx=0 tx=0).stop 2024-03-27T10:01:16.550 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:16.560+0000 7f267d200640 1 -- 172.21.15.57:0/1802635295 shutdown_connections 2024-03-27T10:01:16.550 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:16.560+0000 7f267d200640 1 --2- 172.21.15.57:0/1802635295 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f267806db20 0x7f26780cff80 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:16.550 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:16.560+0000 7f267d200640 1 -- 172.21.15.57:0/1802635295 >> 172.21.15.57:0/1802635295 conn(0x7f267806b990 msgr2=0x7f267806bda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:16.550 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:16.560+0000 7f267d200640 1 -- 172.21.15.57:0/1802635295 shutdown_connections 2024-03-27T10:01:16.550 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:16.560+0000 7f267d200640 1 -- 172.21.15.57:0/1802635295 wait complete. 2024-03-27T10:01:16.551 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:16.562+0000 7f267d200640 1 Processor -- start 2024-03-27T10:01:16.551 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:16.562+0000 7f267d200640 1 -- start start 2024-03-27T10:01:16.554 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:16.563+0000 7f267d200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f267806db20 0x7f2678158750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:16.554 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:16.563+0000 7f267d200640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26780d04c0 0x7f267814d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:16.554 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:16.563+0000 7f267d200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f26781615c0 0x7f2678159ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:16.554 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:16.563+0000 7f267d200640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f26780ae870 con 0x7f26780d04c0 2024-03-27T10:01:16.555 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:16.563+0000 7f267d200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f26780ae3e0 con 0x7f26781615c0 2024-03-27T10:01:16.555 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:16.563+0000 7f267d200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f26780b3d80 con 0x7f267806db20 2024-03-27T10:01:16.555 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:16.564+0000 7f266ea00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26780d04c0 0x7f267814d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:16.555 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:16.564+0000 7f266ea00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26780d04c0 0x7f267814d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58686/0 (socket says 172.21.15.57:58686) 2024-03-27T10:01:16.555 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:16.564+0000 7f266ea00640 1 -- 172.21.15.57:0/788992204 learned_addr learned my addr 172.21.15.57:0/788992204 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:01:16.555 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:16.564+0000 7f2677e00640 1 --2- 172.21.15.57:0/788992204 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f26781615c0 0x7f2678159ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:16.555 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:16.564+0000 7f2677400640 1 --2- 172.21.15.57:0/788992204 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f267806db20 0x7f2678158750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:16.555 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:16.564+0000 7f266ea00640 1 -- 172.21.15.57:0/788992204 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f267806db20 msgr2=0x7f2678158750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:16.555 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:16.564+0000 7f266ea00640 1 --2- 172.21.15.57:0/788992204 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f267806db20 0x7f2678158750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:16.555 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:16.564+0000 7f266ea00640 1 -- 172.21.15.57:0/788992204 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f26781615c0 msgr2=0x7f2678159ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:16.555 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:16.564+0000 7f266ea00640 1 --2- 172.21.15.57:0/788992204 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f26781615c0 0x7f2678159ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:16.555 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:16.564+0000 7f266ea00640 1 -- 172.21.15.57:0/788992204 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26781576b0 con 0x7f26780d04c0 2024-03-27T10:01:16.555 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:16.564+0000 7f2677e00640 1 --2- 172.21.15.57:0/788992204 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f26781615c0 0x7f2678159ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T10:01:16.556 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:16.564+0000 7f2677400640 1 --2- 172.21.15.57:0/788992204 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f267806db20 0x7f2678158750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T10:01:16.556 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:16.564+0000 7f266ea00640 1 --2- 172.21.15.57:0/788992204 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26780d04c0 0x7f267814d5f0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f2660037040 tx=0x7f2660004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:16.556 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:16.565+0000 7f266fe00640 1 -- 172.21.15.57:0/788992204 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2660039050 con 0x7f26780d04c0 2024-03-27T10:01:16.556 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:16.565+0000 7f266fe00640 1 -- 172.21.15.57:0/788992204 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2660045070 con 0x7f26780d04c0 2024-03-27T10:01:16.556 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:16.565+0000 7f266fe00640 1 -- 172.21.15.57:0/788992204 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f266003ea50 con 0x7f26780d04c0 2024-03-27T10:01:16.556 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:16.565+0000 7f267d200640 1 -- 172.21.15.57:0/788992204 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2678157990 con 0x7f26780d04c0 2024-03-27T10:01:16.556 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:16.565+0000 7f267d200640 1 -- 172.21.15.57:0/788992204 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2678157f50 con 0x7f26780d04c0 2024-03-27T10:01:16.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:16.566+0000 7f267d200640 1 -- 172.21.15.57:0/788992204 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2678068540 con 0x7f26780d04c0 2024-03-27T10:01:16.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:16.567+0000 7f266fe00640 1 -- 172.21.15.57:0/788992204 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f266002cbb0 con 0x7f26780d04c0 2024-03-27T10:01:16.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:16.568+0000 7f266fe00640 1 --2- 172.21.15.57:0/788992204 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f265406c530 0x7f265406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:16.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:16.568+0000 7f266fe00640 1 -- 172.21.15.57:0/788992204 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5249+0+0 (secure 0 0 0) 0x7f26600ae3b0 con 0x7f26780d04c0 2024-03-27T10:01:16.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:16.568+0000 7f2677400640 1 --2- 172.21.15.57:0/788992204 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f265406c530 0x7f265406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:16.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:16.569+0000 7f2677400640 1 --2- 172.21.15.57:0/788992204 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f265406c530 0x7f265406e9f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f2668000f60 tx=0x7f2668009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:16.561 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:16.572+0000 7f266fe00640 1 -- 172.21.15.57:0/788992204 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f266007cca0 con 0x7f26780d04c0 2024-03-27T10:01:16.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:16.851+0000 7f267d200640 1 -- 172.21.15.57:0/788992204 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f26780b2080 con 0x7f26780d04c0 2024-03-27T10:01:16.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:16.852+0000 7f266fe00640 1 -- 172.21.15.57:0/788992204 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) ==== 80+0+6645 (secure 0 0 0) 0x7f26600ace20 con 0x7f26780d04c0 2024-03-27T10:01:16.841 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:01:16.841 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-03-27T10:01:16.842 INFO:teuthology.orchestra.run.smithi057.stdout: "auth_dump": [ 2024-03-27T10:01:16.842 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-03-27T10:01:16.842 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "mds.a", 2024-03-27T10:01:16.842 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQC97QNm1UjAHBAAM8YkW/+bFTakcW1kKXBU+w==", 2024-03-27T10:01:16.842 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2024-03-27T10:01:16.842 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2024-03-27T10:01:16.842 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2024-03-27T10:01:16.842 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2024-03-27T10:01:16.842 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2024-03-27T10:01:16.842 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-03-27T10:01:16.842 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-03-27T10:01:16.842 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-03-27T10:01:16.842 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "mds.b", 2024-03-27T10:01:16.843 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQC+7QNmrH74AxAATqJERncRRZ/yOIxIm4G0PA==", 2024-03-27T10:01:16.843 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2024-03-27T10:01:16.843 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2024-03-27T10:01:16.843 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2024-03-27T10:01:16.843 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2024-03-27T10:01:16.843 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2024-03-27T10:01:16.843 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-03-27T10:01:16.843 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-03-27T10:01:16.843 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-03-27T10:01:16.843 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "mds.c", 2024-03-27T10:01:16.843 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQC97QNm1FJDLhAANmYE6RPQZJj259837Wvbbg==", 2024-03-27T10:01:16.843 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2024-03-27T10:01:16.843 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2024-03-27T10:01:16.844 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2024-03-27T10:01:16.844 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2024-03-27T10:01:16.844 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2024-03-27T10:01:16.844 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-03-27T10:01:16.844 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-03-27T10:01:16.844 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-03-27T10:01:16.844 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "mds.d", 2024-03-27T10:01:16.844 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQC+7QNmXshqFBAA0mWCMkVTr0RkfVWsBa76hw==", 2024-03-27T10:01:16.844 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2024-03-27T10:01:16.844 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2024-03-27T10:01:16.844 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2024-03-27T10:01:16.844 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2024-03-27T10:01:16.844 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2024-03-27T10:01:16.845 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-03-27T10:01:16.845 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-03-27T10:01:16.845 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-03-27T10:01:16.845 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.0", 2024-03-27T10:01:16.845 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQDG7QNmgzVUFxAAqHn/Eiu9z8dlUQQE6QJG0Q==", 2024-03-27T10:01:16.845 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2024-03-27T10:01:16.845 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow profile osd", 2024-03-27T10:01:16.845 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile osd", 2024-03-27T10:01:16.845 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2024-03-27T10:01:16.845 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-03-27T10:01:16.845 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-03-27T10:01:16.845 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-03-27T10:01:16.845 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.1", 2024-03-27T10:01:16.845 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQDJ7QNmyGcDMhAAExVMrJEpgSQYdexRiny27A==", 2024-03-27T10:01:16.845 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2024-03-27T10:01:16.846 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow profile osd", 2024-03-27T10:01:16.846 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile osd", 2024-03-27T10:01:16.846 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2024-03-27T10:01:16.846 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-03-27T10:01:16.846 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-03-27T10:01:16.846 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-03-27T10:01:16.846 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.2", 2024-03-27T10:01:16.846 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQDN7QNmJMb/ARAAweNIzEFo93f4kXLABJdBLg==", 2024-03-27T10:01:16.846 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2024-03-27T10:01:16.846 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow profile osd", 2024-03-27T10:01:16.846 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile osd", 2024-03-27T10:01:16.846 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2024-03-27T10:01:16.846 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-03-27T10:01:16.847 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-03-27T10:01:16.847 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-03-27T10:01:16.847 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.3", 2024-03-27T10:01:16.847 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQDQ7QNmogzCGxAABb5ed1hkOPilbImgieF/zw==", 2024-03-27T10:01:16.847 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2024-03-27T10:01:16.847 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow profile osd", 2024-03-27T10:01:16.847 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile osd", 2024-03-27T10:01:16.847 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2024-03-27T10:01:16.847 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-03-27T10:01:16.847 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-03-27T10:01:16.847 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-03-27T10:01:16.847 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.4", 2024-03-27T10:01:16.847 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQDV7QNmLL9qIBAA9Ku2Dj+std9SY009kfIX3w==", 2024-03-27T10:01:16.847 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2024-03-27T10:01:16.847 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow profile osd", 2024-03-27T10:01:16.847 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile osd", 2024-03-27T10:01:16.847 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2024-03-27T10:01:16.848 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-03-27T10:01:16.848 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-03-27T10:01:16.848 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-03-27T10:01:16.848 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.5", 2024-03-27T10:01:16.848 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQDY7QNmxu4cKhAATTznqCyjgxXx1CEhgv57Lw==", 2024-03-27T10:01:16.848 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2024-03-27T10:01:16.848 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow profile osd", 2024-03-27T10:01:16.848 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile osd", 2024-03-27T10:01:16.848 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2024-03-27T10:01:16.848 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-03-27T10:01:16.848 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-03-27T10:01:16.848 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-03-27T10:01:16.848 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.6", 2024-03-27T10:01:16.848 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQDc7QNmQbYQBxAAScmF4t9D5TmfzZs0AJ9zxw==", 2024-03-27T10:01:16.848 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2024-03-27T10:01:16.848 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow profile osd", 2024-03-27T10:01:16.849 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile osd", 2024-03-27T10:01:16.849 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2024-03-27T10:01:16.849 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-03-27T10:01:16.849 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-03-27T10:01:16.849 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-03-27T10:01:16.849 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "osd.7", 2024-03-27T10:01:16.849 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQDf7QNmjh7WEBAAelu6kQpFXAFC6zkTCnuD3g==", 2024-03-27T10:01:16.849 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2024-03-27T10:01:16.849 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow profile osd", 2024-03-27T10:01:16.849 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile osd", 2024-03-27T10:01:16.849 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2024-03-27T10:01:16.849 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-03-27T10:01:16.849 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-03-27T10:01:16.849 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-03-27T10:01:16.849 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "client.0", 2024-03-27T10:01:16.849 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQC+7QNmRLHcIhAAr+U/Y0Vnin6pDQmxi8Dc+g==", 2024-03-27T10:01:16.850 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2024-03-27T10:01:16.850 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2024-03-27T10:01:16.850 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow r", 2024-03-27T10:01:16.850 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow rw", 2024-03-27T10:01:16.850 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow rwx" 2024-03-27T10:01:16.850 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-03-27T10:01:16.850 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-03-27T10:01:16.850 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-03-27T10:01:16.850 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "client.1", 2024-03-27T10:01:16.850 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQC+7QNmqbnXORAAlFtXuvc02QPow/MTuYe9Ag==", 2024-03-27T10:01:16.850 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2024-03-27T10:01:16.850 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2024-03-27T10:01:16.850 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow r", 2024-03-27T10:01:16.850 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow rw", 2024-03-27T10:01:16.851 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow rwx" 2024-03-27T10:01:16.851 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-03-27T10:01:16.851 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-03-27T10:01:16.851 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-03-27T10:01:16.851 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "client.2", 2024-03-27T10:01:16.851 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQC+7QNmnfZ8LhAAipIvyfiVbh5jCuSMdF75ug==", 2024-03-27T10:01:16.851 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2024-03-27T10:01:16.851 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2024-03-27T10:01:16.851 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow r", 2024-03-27T10:01:16.851 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow rw", 2024-03-27T10:01:16.851 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow rwx" 2024-03-27T10:01:16.851 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-03-27T10:01:16.851 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-03-27T10:01:16.851 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-03-27T10:01:16.851 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "client.3", 2024-03-27T10:01:16.851 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQC/7QNmwo2FCRAAhH8bFuvkHmgxXyVQ5YL4NQ==", 2024-03-27T10:01:16.851 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2024-03-27T10:01:16.852 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow", 2024-03-27T10:01:16.852 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow r", 2024-03-27T10:01:16.852 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow rw", 2024-03-27T10:01:16.852 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow rwx" 2024-03-27T10:01:16.852 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-03-27T10:01:16.852 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-03-27T10:01:16.852 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-03-27T10:01:16.852 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "client.admin", 2024-03-27T10:01:16.852 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQC87QNmHuDwChAAenKYfjfGbbXKNjBWOPqz+A==", 2024-03-27T10:01:16.852 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2024-03-27T10:01:16.852 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow *", 2024-03-27T10:01:16.852 INFO:teuthology.orchestra.run.smithi057.stdout: "mgr": "allow *", 2024-03-27T10:01:16.852 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow *", 2024-03-27T10:01:16.852 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2024-03-27T10:01:16.852 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-03-27T10:01:16.853 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-03-27T10:01:16.853 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-03-27T10:01:16.853 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "client.bootstrap-mds", 2024-03-27T10:01:16.853 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQDo7QNmn6QGAhAAY4wuPCtUB75XlPGEA5GeKw==", 2024-03-27T10:01:16.853 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2024-03-27T10:01:16.853 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile bootstrap-mds" 2024-03-27T10:01:16.853 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-03-27T10:01:16.853 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-03-27T10:01:16.853 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-03-27T10:01:16.853 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "client.bootstrap-mgr", 2024-03-27T10:01:16.853 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQDo7QNmIK8GAhAAPiJyRTRaGf7eoDh77Ul9qA==", 2024-03-27T10:01:16.853 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2024-03-27T10:01:16.853 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile bootstrap-mgr" 2024-03-27T10:01:16.853 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-03-27T10:01:16.853 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-03-27T10:01:16.854 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-03-27T10:01:16.854 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "client.bootstrap-osd", 2024-03-27T10:01:16.854 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQDo7QNmubgGAhAAuypqK2oZx6jRnoWjzCthTg==", 2024-03-27T10:01:16.854 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2024-03-27T10:01:16.854 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile bootstrap-osd" 2024-03-27T10:01:16.854 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-03-27T10:01:16.854 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-03-27T10:01:16.854 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-03-27T10:01:16.854 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "client.bootstrap-rbd", 2024-03-27T10:01:16.854 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQDo7QNmxcEGAhAADbjjl/EmgwXkB3SV77pUlQ==", 2024-03-27T10:01:16.854 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2024-03-27T10:01:16.854 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile bootstrap-rbd" 2024-03-27T10:01:16.854 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-03-27T10:01:16.854 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-03-27T10:01:16.854 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-03-27T10:01:16.855 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-03-27T10:01:16.855 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQDo7QNmQcsGAhAAupx6cHl4h+wYbiUlFr/dtQ==", 2024-03-27T10:01:16.855 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2024-03-27T10:01:16.855 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-03-27T10:01:16.855 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-03-27T10:01:16.855 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-03-27T10:01:16.855 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-03-27T10:01:16.855 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "client.bootstrap-rgw", 2024-03-27T10:01:16.855 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQDo7QNm9tQGAhAA7e9KKHLibIwOYotuZJYP8Q==", 2024-03-27T10:01:16.855 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2024-03-27T10:01:16.855 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile bootstrap-rgw" 2024-03-27T10:01:16.855 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-03-27T10:01:16.855 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-03-27T10:01:16.855 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-03-27T10:01:16.855 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "mgr.x", 2024-03-27T10:01:16.855 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQC97QNm2V3+EBAASy4uJOAHidIFQV4TqMKshQ==", 2024-03-27T10:01:16.856 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2024-03-27T10:01:16.856 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow *", 2024-03-27T10:01:16.856 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile mgr", 2024-03-27T10:01:16.856 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2024-03-27T10:01:16.856 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-03-27T10:01:16.856 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-03-27T10:01:16.856 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-03-27T10:01:16.856 INFO:teuthology.orchestra.run.smithi057.stdout: "entity": "mgr.y", 2024-03-27T10:01:16.856 INFO:teuthology.orchestra.run.smithi057.stdout: "key": "AQC97QNmUHKjAhAACmO/ZpBl/wFmQu91OMg5Vg==", 2024-03-27T10:01:16.856 INFO:teuthology.orchestra.run.smithi057.stdout: "caps": { 2024-03-27T10:01:16.856 INFO:teuthology.orchestra.run.smithi057.stdout: "mds": "allow *", 2024-03-27T10:01:16.856 INFO:teuthology.orchestra.run.smithi057.stdout: "mon": "allow profile mgr", 2024-03-27T10:01:16.856 INFO:teuthology.orchestra.run.smithi057.stdout: "osd": "allow *" 2024-03-27T10:01:16.856 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-03-27T10:01:16.856 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-03-27T10:01:16.857 INFO:teuthology.orchestra.run.smithi057.stdout: ] 2024-03-27T10:01:16.857 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-03-27T10:01:16.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:16.854+0000 7f267d200640 1 -- 172.21.15.57:0/788992204 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f265406c530 msgr2=0x7f265406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:16.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:16.854+0000 7f267d200640 1 --2- 172.21.15.57:0/788992204 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f265406c530 0x7f265406e9f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f2668000f60 tx=0x7f2668009040 comp rx=0 tx=0).stop 2024-03-27T10:01:16.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:16.854+0000 7f267d200640 1 -- 172.21.15.57:0/788992204 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26780d04c0 msgr2=0x7f267814d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:16.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:16.854+0000 7f267d200640 1 --2- 172.21.15.57:0/788992204 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26780d04c0 0x7f267814d5f0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f2660037040 tx=0x7f2660004a40 comp rx=0 tx=0).stop 2024-03-27T10:01:16.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:16.855+0000 7f267d200640 1 -- 172.21.15.57:0/788992204 shutdown_connections 2024-03-27T10:01:16.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:16.855+0000 7f267d200640 1 --2- 172.21.15.57:0/788992204 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f265406c530 0x7f265406e9f0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:16.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:16.855+0000 7f267d200640 1 --2- 172.21.15.57:0/788992204 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f26781615c0 0x7f2678159ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:16.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:16.855+0000 7f267d200640 1 --2- 172.21.15.57:0/788992204 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26780d04c0 0x7f267814d5f0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:16.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:16.855+0000 7f267d200640 1 --2- 172.21.15.57:0/788992204 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f267806db20 0x7f2678158750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:16.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:16.855+0000 7f267d200640 1 -- 172.21.15.57:0/788992204 >> 172.21.15.57:0/788992204 conn(0x7f267806b990 msgr2=0x7f26780aff60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:16.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:16.855+0000 7f267d200640 1 -- 172.21.15.57:0/788992204 shutdown_connections 2024-03-27T10:01:16.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:16.855+0000 7f267d200640 1 -- 172.21.15.57:0/788992204 wait complete. 2024-03-27T10:01:16.862 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-03-27T10:01:17.084 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.095+0000 7fe81d800640 1 Processor -- start 2024-03-27T10:01:17.084 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.095+0000 7fe81d800640 1 -- start start 2024-03-27T10:01:17.086 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.097+0000 7fe81d800640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe81806e790 0x7fe8180cb5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:17.087 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.097+0000 7fe81d800640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe818160640 0x7fe8180cbb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:17.087 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.097+0000 7fe81d800640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe81806eb70 con 0x7fe81815c3d0 2024-03-27T10:01:17.087 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.097+0000 7fe81d800640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7fe8181601b0 con 0x7fe818160640 2024-03-27T10:01:17.087 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.097+0000 7fe81d800640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fe81815d090 con 0x7fe81806e790 2024-03-27T10:01:17.087 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.097+0000 7fe81ce00640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fe81815c3d0 0x7fe81815c860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:58158/0 (socket says 172.21.15.57:58158) 2024-03-27T10:01:17.087 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.097+0000 7fe81ce00640 1 -- 172.21.15.57:0/2913904720 learned_addr learned my addr 172.21.15.57:0/2913904720 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T10:01:17.087 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.098+0000 7fe80f400640 1 --2- 172.21.15.57:0/2913904720 >> v2:172.21.15.57:3300/0 conn(0x7fe818160640 0x7fe8180cbb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:17.087 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.098+0000 7fe817e00640 1 --2- 172.21.15.57:0/2913904720 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe81806e790 0x7fe8180cb5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:17.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.098+0000 7fe817400640 1 -- 172.21.15.57:0/2913904720 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2088288714 0 0) 0x7fe81806eb70 con 0x7fe81815c3d0 2024-03-27T10:01:17.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.098+0000 7fe817400640 1 -- 172.21.15.57:0/2913904720 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe7fc003520 con 0x7fe81815c3d0 2024-03-27T10:01:17.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.098+0000 7fe80f400640 1 -- 172.21.15.57:0/2913904720 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe81806e790 msgr2=0x7fe8180cb5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:01:17.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.098+0000 7fe80f400640 1 --2- 172.21.15.57:0/2913904720 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe81806e790 0x7fe8180cb5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:17.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.098+0000 7fe80f400640 1 -- 172.21.15.57:0/2913904720 >> v1:172.21.15.57:6789/0 conn(0x7fe81815c3d0 legacy=0x7fe81815c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:17.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.098+0000 7fe80f400640 1 -- 172.21.15.57:0/2913904720 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe81815fb60 con 0x7fe818160640 2024-03-27T10:01:17.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.099+0000 7fe80f400640 1 --2- 172.21.15.57:0/2913904720 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe818160640 0x7fe8180cbb20 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fe8000097a0 tx=0x7fe80002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=840d70b00c8ef5df server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:17.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.099+0000 7fe817400640 1 -- 172.21.15.57:0/2913904720 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe800035020 con 0x7fe818160640 2024-03-27T10:01:17.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.100+0000 7fe817400640 1 -- 172.21.15.57:0/2913904720 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe800031830 con 0x7fe818160640 2024-03-27T10:01:17.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.100+0000 7fe817400640 1 -- 172.21.15.57:0/2913904720 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe800031c00 con 0x7fe818160640 2024-03-27T10:01:17.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.100+0000 7fe81d800640 1 -- 172.21.15.57:0/2913904720 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe818160640 msgr2=0x7fe8180cbb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:17.089 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.100+0000 7fe81d800640 1 --2- 172.21.15.57:0/2913904720 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe818160640 0x7fe8180cbb20 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fe8000097a0 tx=0x7fe80002b8d0 comp rx=0 tx=0).stop 2024-03-27T10:01:17.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.100+0000 7fe81d800640 1 -- 172.21.15.57:0/2913904720 shutdown_connections 2024-03-27T10:01:17.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.100+0000 7fe81d800640 1 --2- 172.21.15.57:0/2913904720 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe818160640 0x7fe8180cbb20 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:17.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.100+0000 7fe81d800640 1 --2- 172.21.15.57:0/2913904720 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe81806e790 0x7fe8180cb5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:17.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.100+0000 7fe81d800640 1 -- 172.21.15.57:0/2913904720 >> 172.21.15.57:0/2913904720 conn(0x7fe8180cfac0 msgr2=0x7fe8180cfed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:17.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.100+0000 7fe81d800640 1 -- 172.21.15.57:0/2913904720 shutdown_connections 2024-03-27T10:01:17.090 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.101+0000 7fe81d800640 1 -- 172.21.15.57:0/2913904720 wait complete. 2024-03-27T10:01:17.091 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.102+0000 7fe81d800640 1 Processor -- start 2024-03-27T10:01:17.091 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.102+0000 7fe81d800640 1 -- start start 2024-03-27T10:01:17.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.103+0000 7fe81d800640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe81806e790 0x7fe818155e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:17.092 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.103+0000 7fe81d800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe81815c3d0 0x7fe8180c8f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:17.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.103+0000 7fe81d800640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe818160640 0x7fe8180cedc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:17.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.103+0000 7fe81d800640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fe8180b4b30 con 0x7fe818160640 2024-03-27T10:01:17.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.103+0000 7fe81d800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fe8180b49b0 con 0x7fe81815c3d0 2024-03-27T10:01:17.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.103+0000 7fe81d800640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fe8180b4cb0 con 0x7fe81806e790 2024-03-27T10:01:17.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.104+0000 7fe81ce00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe818160640 0x7fe8180cedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:17.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.104+0000 7fe81ce00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe818160640 0x7fe8180cedc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58712/0 (socket says 172.21.15.57:58712) 2024-03-27T10:01:17.093 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.104+0000 7fe81ce00640 1 -- 172.21.15.57:0/1924662613 learned_addr learned my addr 172.21.15.57:0/1924662613 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:01:17.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.104+0000 7fe80f400640 1 --2- 172.21.15.57:0/1924662613 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe81815c3d0 0x7fe8180c8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:17.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.104+0000 7fe817e00640 1 --2- 172.21.15.57:0/1924662613 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe81806e790 0x7fe818155e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:17.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.104+0000 7fe81ce00640 1 -- 172.21.15.57:0/1924662613 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe81806e790 msgr2=0x7fe818155e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:17.094 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.104+0000 7fe81ce00640 1 --2- 172.21.15.57:0/1924662613 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe81806e790 0x7fe818155e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:17.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.104+0000 7fe81ce00640 1 -- 172.21.15.57:0/1924662613 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe81815c3d0 msgr2=0x7fe8180c8f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:17.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.104+0000 7fe81ce00640 1 --2- 172.21.15.57:0/1924662613 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe81815c3d0 0x7fe8180c8f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:17.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.104+0000 7fe81ce00640 1 -- 172.21.15.57:0/1924662613 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8180c7be0 con 0x7fe818160640 2024-03-27T10:01:17.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.104+0000 7fe81ce00640 1 --2- 172.21.15.57:0/1924662613 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe818160640 0x7fe8180cedc0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fe81000cb40 tx=0x7fe81000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:17.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.105+0000 7fe814c00640 1 -- 172.21.15.57:0/1924662613 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe810017070 con 0x7fe818160640 2024-03-27T10:01:17.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.105+0000 7fe814c00640 1 -- 172.21.15.57:0/1924662613 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe81000aca0 con 0x7fe818160640 2024-03-27T10:01:17.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.105+0000 7fe814c00640 1 -- 172.21.15.57:0/1924662613 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe810012620 con 0x7fe818160640 2024-03-27T10:01:17.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.105+0000 7fe81d800640 1 -- 172.21.15.57:0/1924662613 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8180c7ec0 con 0x7fe818160640 2024-03-27T10:01:17.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.105+0000 7fe81d800640 1 -- 172.21.15.57:0/1924662613 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8180c8480 con 0x7fe818160640 2024-03-27T10:01:17.095 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.106+0000 7fe81d800640 1 -- 172.21.15.57:0/1924662613 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe818068540 con 0x7fe818160640 2024-03-27T10:01:17.096 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.107+0000 7fe814c00640 1 -- 172.21.15.57:0/1924662613 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fe81001a070 con 0x7fe818160640 2024-03-27T10:01:17.097 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.108+0000 7fe814c00640 1 --2- 172.21.15.57:0/1924662613 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fe7f406c560 0x7fe7f406ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:17.097 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.108+0000 7fe814c00640 1 -- 172.21.15.57:0/1924662613 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5249+0+0 (secure 0 0 0) 0x7fe81008b410 con 0x7fe818160640 2024-03-27T10:01:17.097 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.108+0000 7fe817e00640 1 --2- 172.21.15.57:0/1924662613 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fe7f406c560 0x7fe7f406ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:17.098 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.109+0000 7fe817e00640 1 --2- 172.21.15.57:0/1924662613 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fe7f406c560 0x7fe7f406ea20 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe808009ad0 tx=0x7fe808008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:17.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.112+0000 7fe814c00640 1 -- 172.21.15.57:0/1924662613 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7fe810059be0 con 0x7fe818160640 2024-03-27T10:01:17.390 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.401+0000 7fe81d800640 1 -- 172.21.15.57:0/1924662613 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7fe8181563d0 con 0x7fe818160640 2024-03-27T10:01:17.394 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.405+0000 7fe814c00640 1 -- 172.21.15.57:0/1924662613 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) ==== 90+0+0 (secure 0 0 0) 0x7fe8100594e0 con 0x7fe818160640 2024-03-27T10:01:17.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.408+0000 7fe81d800640 1 -- 172.21.15.57:0/1924662613 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fe7f406c560 msgr2=0x7fe7f406ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:17.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.408+0000 7fe81d800640 1 --2- 172.21.15.57:0/1924662613 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fe7f406c560 0x7fe7f406ea20 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fe808009ad0 tx=0x7fe808008040 comp rx=0 tx=0).stop 2024-03-27T10:01:17.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.408+0000 7fe81d800640 1 -- 172.21.15.57:0/1924662613 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe818160640 msgr2=0x7fe8180cedc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:17.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.408+0000 7fe81d800640 1 --2- 172.21.15.57:0/1924662613 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe818160640 0x7fe8180cedc0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fe81000cb40 tx=0x7fe81000a060 comp rx=0 tx=0).stop 2024-03-27T10:01:17.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.408+0000 7fe81d800640 1 -- 172.21.15.57:0/1924662613 shutdown_connections 2024-03-27T10:01:17.398 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.408+0000 7fe81d800640 1 --2- 172.21.15.57:0/1924662613 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe818160640 0x7fe8180cedc0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:17.398 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.408+0000 7fe81d800640 1 --2- 172.21.15.57:0/1924662613 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fe7f406c560 0x7fe7f406ea20 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:17.398 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.408+0000 7fe81d800640 1 --2- 172.21.15.57:0/1924662613 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe81815c3d0 0x7fe8180c8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:17.398 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.408+0000 7fe81d800640 1 --2- 172.21.15.57:0/1924662613 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe81806e790 0x7fe818155e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:17.398 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.408+0000 7fe81d800640 1 -- 172.21.15.57:0/1924662613 >> 172.21.15.57:0/1924662613 conn(0x7fe8180cfac0 msgr2=0x7fe8180ca0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:17.398 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.408+0000 7fe81d800640 1 -- 172.21.15.57:0/1924662613 shutdown_connections 2024-03-27T10:01:17.398 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.408+0000 7fe81d800640 1 -- 172.21.15.57:0/1924662613 wait complete. 2024-03-27T10:01:17.416 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-03-27T10:01:17.636 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.647+0000 7f18d4c00640 1 Processor -- start 2024-03-27T10:01:17.636 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.647+0000 7f18d4c00640 1 -- start start 2024-03-27T10:01:17.638 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.648+0000 7f18d4c00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f18d015e390 0x7f18d00b5b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:17.638 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.649+0000 7f18d4c00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f18d006b540 0x7f18d006b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:17.638 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.649+0000 7f18d4c00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18d00b4400 con 0x7f18d00b3c90 2024-03-27T10:01:17.638 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.649+0000 7f18d4c00640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f18d006e830 con 0x7f18d006b540 2024-03-27T10:01:17.638 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.649+0000 7f18d4c00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f18d006bed0 con 0x7f18d015e390 2024-03-27T10:01:17.638 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.649+0000 7f18ce800640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f18d006b540 0x7f18d006b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:17.638 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.649+0000 7f18ce800640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f18d006b540 0x7f18d006b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58718/0 (socket says 172.21.15.57:58718) 2024-03-27T10:01:17.639 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.649+0000 7f18ce800640 1 -- 172.21.15.57:0/1815033489 learned_addr learned my addr 172.21.15.57:0/1815033489 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:01:17.639 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.650+0000 7f18ce800640 1 -- 172.21.15.57:0/1815033489 >> v2:172.21.15.118:3300/0 conn(0x7f18d015e390 msgr2=0x7f18d00b5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:01:17.639 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.650+0000 7f18ce800640 1 --2- 172.21.15.57:0/1815033489 >> v2:172.21.15.118:3300/0 conn(0x7f18d015e390 0x7f18d00b5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:17.640 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.650+0000 7f18ce800640 1 -- 172.21.15.57:0/1815033489 >> v1:172.21.15.118:6789/0 conn(0x7f18d00b3c90 legacy=0x7f18d006e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:01:17.640 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.650+0000 7f18ce800640 1 -- 172.21.15.57:0/1815033489 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18d006fac0 con 0x7f18d006b540 2024-03-27T10:01:17.640 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.651+0000 7f18ce800640 1 --2- 172.21.15.57:0/1815033489 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f18d006b540 0x7f18d006b990 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f18d009f0c0 tx=0x7f18c802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68dd531711807d75 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:17.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.651+0000 7f18cca00640 1 -- 172.21.15.57:0/1815033489 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18c802ca80 con 0x7f18d006b540 2024-03-27T10:01:17.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.651+0000 7f18cca00640 1 -- 172.21.15.57:0/1815033489 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18c802cc20 con 0x7f18d006b540 2024-03-27T10:01:17.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.651+0000 7f18cca00640 1 -- 172.21.15.57:0/1815033489 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18c80343f0 con 0x7f18d006b540 2024-03-27T10:01:17.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.652+0000 7f18d4c00640 1 -- 172.21.15.57:0/1815033489 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f18d006b540 msgr2=0x7f18d006b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:17.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.652+0000 7f18d4c00640 1 --2- 172.21.15.57:0/1815033489 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f18d006b540 0x7f18d006b990 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f18d009f0c0 tx=0x7f18c802bee0 comp rx=0 tx=0).stop 2024-03-27T10:01:17.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.652+0000 7f18d4c00640 1 -- 172.21.15.57:0/1815033489 shutdown_connections 2024-03-27T10:01:17.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.652+0000 7f18d4c00640 1 --2- 172.21.15.57:0/1815033489 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f18d006b540 0x7f18d006b990 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:17.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.652+0000 7f18d4c00640 1 --2- 172.21.15.57:0/1815033489 >> v2:172.21.15.118:3300/0 conn(0x7f18d015e390 0x7f18d00b5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:17.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.652+0000 7f18d4c00640 1 -- 172.21.15.57:0/1815033489 >> 172.21.15.57:0/1815033489 conn(0x7f18d006c650 msgr2=0x7f18d006ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:17.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.652+0000 7f18d4c00640 1 -- 172.21.15.57:0/1815033489 shutdown_connections 2024-03-27T10:01:17.642 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.652+0000 7f18d4c00640 1 -- 172.21.15.57:0/1815033489 wait complete. 2024-03-27T10:01:17.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.654+0000 7f18d4c00640 1 Processor -- start 2024-03-27T10:01:17.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.654+0000 7f18d4c00640 1 -- start start 2024-03-27T10:01:17.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.655+0000 7f18d4c00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f18d006b540 0x7f18d015a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:17.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.655+0000 7f18d4c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f18d00b3c90 0x7f18d01ea170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:17.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.655+0000 7f18d4c00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f18d015e390 0x7f18d00ae8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:17.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.655+0000 7f18d4c00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f18d00d0ca0 con 0x7f18d015e390 2024-03-27T10:01:17.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.655+0000 7f18d4c00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f18d0070080 con 0x7f18d00b3c90 2024-03-27T10:01:17.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.655+0000 7f18d4c00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f18d00b40f0 con 0x7f18d006b540 2024-03-27T10:01:17.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.655+0000 7f18ce800640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f18d015e390 0x7f18d00ae8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:17.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.655+0000 7f18ce800640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f18d015e390 0x7f18d00ae8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58736/0 (socket says 172.21.15.57:58736) 2024-03-27T10:01:17.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.655+0000 7f18ce800640 1 -- 172.21.15.57:0/1443422090 learned_addr learned my addr 172.21.15.57:0/1443422090 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:01:17.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.655+0000 7f18cde00640 1 --2- 172.21.15.57:0/1443422090 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f18d006b540 0x7f18d015a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:17.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.655+0000 7f18ce800640 1 -- 172.21.15.57:0/1443422090 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f18d006b540 msgr2=0x7f18d015a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:17.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.655+0000 7f18ce800640 1 --2- 172.21.15.57:0/1443422090 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f18d006b540 0x7f18d015a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:17.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.655+0000 7f18cd400640 1 --2- 172.21.15.57:0/1443422090 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f18d00b3c90 0x7f18d01ea170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:17.646 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.655+0000 7f18ce800640 1 -- 172.21.15.57:0/1443422090 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f18d00b3c90 msgr2=0x7f18d01ea170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:17.646 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.656+0000 7f18ce800640 1 --2- 172.21.15.57:0/1443422090 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f18d00b3c90 0x7f18d01ea170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:17.646 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.656+0000 7f18ce800640 1 -- 172.21.15.57:0/1443422090 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18d01e90d0 con 0x7f18d015e390 2024-03-27T10:01:17.646 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.656+0000 7f18cd400640 1 --2- 172.21.15.57:0/1443422090 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f18d00b3c90 0x7f18d01ea170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T10:01:17.646 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.656+0000 7f18ce800640 1 --2- 172.21.15.57:0/1443422090 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f18d015e390 0x7f18d00ae8d0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f18c8036040 tx=0x7f18c8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:17.647 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.656+0000 7f18c6000640 1 -- 172.21.15.57:0/1443422090 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18c8043020 con 0x7f18d015e390 2024-03-27T10:01:17.647 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.656+0000 7f18c6000640 1 -- 172.21.15.57:0/1443422090 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18c803e450 con 0x7f18d015e390 2024-03-27T10:01:17.647 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.656+0000 7f18c6000640 1 -- 172.21.15.57:0/1443422090 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18c803e820 con 0x7f18d015e390 2024-03-27T10:01:17.647 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.656+0000 7f18d4c00640 1 -- 172.21.15.57:0/1443422090 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18d01e93b0 con 0x7f18d015e390 2024-03-27T10:01:17.647 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.656+0000 7f18d4c00640 1 -- 172.21.15.57:0/1443422090 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18d01e9970 con 0x7f18d015e390 2024-03-27T10:01:17.647 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.658+0000 7f18d4c00640 1 -- 172.21.15.57:0/1443422090 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18d0068590 con 0x7f18d015e390 2024-03-27T10:01:17.647 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.659+0000 7f18c6000640 1 -- 172.21.15.57:0/1443422090 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f18c8046020 con 0x7f18d015e390 2024-03-27T10:01:17.649 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.660+0000 7f18c6000640 1 --2- 172.21.15.57:0/1443422090 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f18ac06c530 0x7f18ac06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:17.649 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.660+0000 7f18c6000640 1 -- 172.21.15.57:0/1443422090 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5249+0+0 (secure 0 0 0) 0x7f18c80aded0 con 0x7f18d015e390 2024-03-27T10:01:17.649 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.660+0000 7f18cde00640 1 --2- 172.21.15.57:0/1443422090 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f18ac06c530 0x7f18ac06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:17.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.661+0000 7f18cde00640 1 --2- 172.21.15.57:0/1443422090 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f18ac06c530 0x7f18ac06e9f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f18c000b810 tx=0x7f18c0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:17.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.665+0000 7f18c6000640 1 -- 172.21.15.57:0/1443422090 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f18c804d030 con 0x7f18d015e390 2024-03-27T10:01:17.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.944+0000 7f18d4c00640 1 -- 172.21.15.57:0/1443422090 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7f18d0074270 con 0x7f18d015e390 2024-03-27T10:01:17.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.949+0000 7f18c6000640 1 -- 172.21.15.57:0/1443422090 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) ==== 90+0+0 (secure 0 0 0) 0x7f18c807c6b0 con 0x7f18d015e390 2024-03-27T10:01:17.941 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.952+0000 7f18d4c00640 1 -- 172.21.15.57:0/1443422090 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f18ac06c530 msgr2=0x7f18ac06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:17.941 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.952+0000 7f18d4c00640 1 --2- 172.21.15.57:0/1443422090 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f18ac06c530 0x7f18ac06e9f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f18c000b810 tx=0x7f18c0008040 comp rx=0 tx=0).stop 2024-03-27T10:01:17.941 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.952+0000 7f18d4c00640 1 -- 172.21.15.57:0/1443422090 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f18d015e390 msgr2=0x7f18d00ae8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:17.941 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.952+0000 7f18d4c00640 1 --2- 172.21.15.57:0/1443422090 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f18d015e390 0x7f18d00ae8d0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f18c8036040 tx=0x7f18c8004a40 comp rx=0 tx=0).stop 2024-03-27T10:01:17.941 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.952+0000 7f18d4c00640 1 -- 172.21.15.57:0/1443422090 shutdown_connections 2024-03-27T10:01:17.942 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.952+0000 7f18d4c00640 1 --2- 172.21.15.57:0/1443422090 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f18d015e390 0x7f18d00ae8d0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:17.942 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.952+0000 7f18d4c00640 1 --2- 172.21.15.57:0/1443422090 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f18ac06c530 0x7f18ac06e9f0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:17.942 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.952+0000 7f18d4c00640 1 --2- 172.21.15.57:0/1443422090 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f18d00b3c90 0x7f18d01ea170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:17.942 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.952+0000 7f18d4c00640 1 --2- 172.21.15.57:0/1443422090 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f18d006b540 0x7f18d015a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:17.942 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.952+0000 7f18d4c00640 1 -- 172.21.15.57:0/1443422090 >> 172.21.15.57:0/1443422090 conn(0x7f18d006c650 msgr2=0x7f18d00b1ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:17.942 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.952+0000 7f18d4c00640 1 -- 172.21.15.57:0/1443422090 shutdown_connections 2024-03-27T10:01:17.942 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:17.952+0000 7f18d4c00640 1 -- 172.21.15.57:0/1443422090 wait complete. 2024-03-27T10:01:17.961 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-03-27T10:01:18.138 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:01:18.145 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:01:18.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.194+0000 7f64ffa00640 1 Processor -- start 2024-03-27T10:01:18.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.194+0000 7f64ffa00640 1 -- start start 2024-03-27T10:01:18.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.195+0000 7f64ffa00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f64f80afb70 0x7f64f80b5130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:18.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.195+0000 7f64ffa00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f64f8162040 0x7f64f8162490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:18.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.196+0000 7f64ffa00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64f80b3890 con 0x7f64f806b7b0 2024-03-27T10:01:18.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.196+0000 7f64ffa00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f64f81639e0 con 0x7f64f80afb70 2024-03-27T10:01:18.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.196+0000 7f64ffa00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f64f80ad940 con 0x7f64f8162040 2024-03-27T10:01:18.186 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.196+0000 7f64f7e00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f64f80afb70 0x7f64f80b5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:18.186 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.196+0000 7f64fd000640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f64f806b7b0 0x7f64f806bb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.57:33990/0 (socket says 172.21.15.57:33990) 2024-03-27T10:01:18.186 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.196+0000 7f64fd000640 1 -- 172.21.15.57:0/671300749 learned_addr learned my addr 172.21.15.57:0/671300749 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T10:01:18.186 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.196+0000 7f64fda00640 1 --2- 172.21.15.57:0/671300749 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f64f8162040 0x7f64f8162490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:18.186 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.197+0000 7f64f7400640 1 -- 172.21.15.57:0/671300749 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1308781910 0 0) 0x7f64f80b3890 con 0x7f64f806b7b0 2024-03-27T10:01:18.186 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.197+0000 7f64f7400640 1 -- 172.21.15.57:0/671300749 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f64e0003520 con 0x7f64f806b7b0 2024-03-27T10:01:18.186 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.197+0000 7f64f7e00640 1 -- 172.21.15.57:0/671300749 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f64f8162040 msgr2=0x7f64f8162490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:01:18.186 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.197+0000 7f64f7e00640 1 --2- 172.21.15.57:0/671300749 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f64f8162040 0x7f64f8162490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:18.186 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.197+0000 7f64f7e00640 1 -- 172.21.15.57:0/671300749 >> v1:172.21.15.118:6789/0 conn(0x7f64f806b7b0 legacy=0x7f64f806bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:18.186 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.197+0000 7f64f7e00640 1 -- 172.21.15.57:0/671300749 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64f80adc20 con 0x7f64f80afb70 2024-03-27T10:01:18.187 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.198+0000 7f64f7e00640 1 --2- 172.21.15.57:0/671300749 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f64f80afb70 0x7f64f80b5130 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f64e40097a0 tx=0x7f64e402b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a39f836dec5fbb2d server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:18.187 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.199+0000 7f64f7400640 1 -- 172.21.15.57:0/671300749 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64e40315a0 con 0x7f64f80afb70 2024-03-27T10:01:18.187 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.199+0000 7f64f7400640 1 -- 172.21.15.57:0/671300749 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64e4037070 con 0x7f64f80afb70 2024-03-27T10:01:18.187 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.199+0000 7f64f7400640 1 -- 172.21.15.57:0/671300749 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64e4031960 con 0x7f64f80afb70 2024-03-27T10:01:18.188 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.199+0000 7f64ffa00640 1 -- 172.21.15.57:0/671300749 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f64f80afb70 msgr2=0x7f64f80b5130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:18.188 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.199+0000 7f64ffa00640 1 --2- 172.21.15.57:0/671300749 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f64f80afb70 0x7f64f80b5130 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f64e40097a0 tx=0x7f64e402b840 comp rx=0 tx=0).stop 2024-03-27T10:01:18.188 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.199+0000 7f64ffa00640 1 -- 172.21.15.57:0/671300749 shutdown_connections 2024-03-27T10:01:18.188 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.199+0000 7f64ffa00640 1 --2- 172.21.15.57:0/671300749 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f64f8162040 0x7f64f8162490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:18.189 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.199+0000 7f64ffa00640 1 --2- 172.21.15.57:0/671300749 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f64f80afb70 0x7f64f80b5130 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:18.189 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.199+0000 7f64ffa00640 1 -- 172.21.15.57:0/671300749 >> 172.21.15.57:0/671300749 conn(0x7f64f80cd050 msgr2=0x7f64f80cd460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:18.189 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.199+0000 7f64ffa00640 1 -- 172.21.15.57:0/671300749 shutdown_connections 2024-03-27T10:01:18.189 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.200+0000 7f64ffa00640 1 -- 172.21.15.57:0/671300749 wait complete. 2024-03-27T10:01:18.190 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.201+0000 7f64ffa00640 1 Processor -- start 2024-03-27T10:01:18.190 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.201+0000 7f64ffa00640 1 -- start start 2024-03-27T10:01:18.192 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.202+0000 7f64ffa00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f64f806b7b0 0x7f64f814e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:18.192 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.202+0000 7f64ffa00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f64f80afb70 0x7f64f80aeb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:18.192 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.202+0000 7f64ffa00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f64f8162040 0x7f64f80af050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:18.192 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.202+0000 7f64ffa00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f64f806c2a0 con 0x7f64f8162040 2024-03-27T10:01:18.192 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.202+0000 7f64ffa00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f64f80b3540 con 0x7f64f806b7b0 2024-03-27T10:01:18.192 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.202+0000 7f64ffa00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f64f80b3b70 con 0x7f64f80afb70 2024-03-27T10:01:18.192 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.203+0000 7f64fda00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f64f8162040 0x7f64f80af050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:18.192 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.203+0000 7f64fd000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f64f806b7b0 0x7f64f814e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:18.192 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.203+0000 7f64fda00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f64f8162040 0x7f64f80af050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58748/0 (socket says 172.21.15.57:58748) 2024-03-27T10:01:18.192 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.203+0000 7f64fd000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f64f806b7b0 0x7f64f814e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.57:40230/0 (socket says 172.21.15.57:40230) 2024-03-27T10:01:18.192 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.203+0000 7f64fda00640 1 -- 172.21.15.57:0/4112523410 learned_addr learned my addr 172.21.15.57:0/4112523410 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:01:18.193 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.203+0000 7f64f7e00640 1 --2- 172.21.15.57:0/4112523410 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f64f80afb70 0x7f64f80aeb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:18.194 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.203+0000 7f64fda00640 1 -- 172.21.15.57:0/4112523410 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f64f80afb70 msgr2=0x7f64f80aeb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:18.194 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.203+0000 7f64fda00640 1 --2- 172.21.15.57:0/4112523410 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f64f80afb70 0x7f64f80aeb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:18.194 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.203+0000 7f64fda00640 1 -- 172.21.15.57:0/4112523410 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f64f806b7b0 msgr2=0x7f64f814e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:18.194 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.203+0000 7f64fda00640 1 --2- 172.21.15.57:0/4112523410 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f64f806b7b0 0x7f64f814e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:18.194 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.203+0000 7f64fda00640 1 -- 172.21.15.57:0/4112523410 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64f8160e50 con 0x7f64f8162040 2024-03-27T10:01:18.194 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.203+0000 7f64fd000640 1 --2- 172.21.15.57:0/4112523410 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f64f806b7b0 0x7f64f814e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T10:01:18.194 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.204+0000 7f64fda00640 1 --2- 172.21.15.57:0/4112523410 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f64f8162040 0x7f64f80af050 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f64f0009dd0 tx=0x7f64f000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:18.194 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.204+0000 7f64f4c00640 1 -- 172.21.15.57:0/4112523410 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64f0018020 con 0x7f64f8162040 2024-03-27T10:01:18.194 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.204+0000 7f64f4c00640 1 -- 172.21.15.57:0/4112523410 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64f0014480 con 0x7f64f8162040 2024-03-27T10:01:18.194 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.204+0000 7f64f4c00640 1 -- 172.21.15.57:0/4112523410 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64f0014870 con 0x7f64f8162040 2024-03-27T10:01:18.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.204+0000 7f64ffa00640 1 -- 172.21.15.57:0/4112523410 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64f8161130 con 0x7f64f8162040 2024-03-27T10:01:18.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.204+0000 7f64ffa00640 1 -- 172.21.15.57:0/4112523410 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64f814e580 con 0x7f64f8162040 2024-03-27T10:01:18.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.205+0000 7f64ffa00640 1 -- 172.21.15.57:0/4112523410 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64f80685b0 con 0x7f64f8162040 2024-03-27T10:01:18.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.206+0000 7f64f4c00640 1 -- 172.21.15.57:0/4112523410 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f64f0005d10 con 0x7f64f8162040 2024-03-27T10:01:18.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.207+0000 7f64f4c00640 1 --2- 172.21.15.57:0/4112523410 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f64d806c530 0x7f64d806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:18.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.207+0000 7f64f4c00640 1 -- 172.21.15.57:0/4112523410 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5249+0+0 (secure 0 0 0) 0x7f64f008bfa0 con 0x7f64f8162040 2024-03-27T10:01:18.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.207+0000 7f64fd000640 1 --2- 172.21.15.57:0/4112523410 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f64d806c530 0x7f64d806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:18.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.208+0000 7f64fd000640 1 --2- 172.21.15.57:0/4112523410 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f64d806c530 0x7f64d806e9f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f64ec001200 tx=0x7f64ec000bc0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:18.201 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.212+0000 7f64f4c00640 1 -- 172.21.15.57:0/4112523410 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f64f0022070 con 0x7f64f8162040 2024-03-27T10:01:18.484 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.495+0000 7f64ffa00640 1 -- 172.21.15.57:0/4112523410 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7f64f8161b10 con 0x7f64f8162040 2024-03-27T10:01:18.488 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.499+0000 7f64f4c00640 1 -- 172.21.15.57:0/4112523410 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) ==== 90+0+0 (secure 0 0 0) 0x7f64f0010040 con 0x7f64f8162040 2024-03-27T10:01:18.492 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.502+0000 7f64ffa00640 1 -- 172.21.15.57:0/4112523410 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f64d806c530 msgr2=0x7f64d806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:18.492 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.502+0000 7f64ffa00640 1 --2- 172.21.15.57:0/4112523410 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f64d806c530 0x7f64d806e9f0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f64ec001200 tx=0x7f64ec000bc0 comp rx=0 tx=0).stop 2024-03-27T10:01:18.492 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.502+0000 7f64ffa00640 1 -- 172.21.15.57:0/4112523410 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f64f8162040 msgr2=0x7f64f80af050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:18.492 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.502+0000 7f64ffa00640 1 --2- 172.21.15.57:0/4112523410 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f64f8162040 0x7f64f80af050 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f64f0009dd0 tx=0x7f64f000c490 comp rx=0 tx=0).stop 2024-03-27T10:01:18.492 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.503+0000 7f64ffa00640 1 -- 172.21.15.57:0/4112523410 shutdown_connections 2024-03-27T10:01:18.492 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.503+0000 7f64ffa00640 1 --2- 172.21.15.57:0/4112523410 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f64f8162040 0x7f64f80af050 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:18.492 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.503+0000 7f64ffa00640 1 --2- 172.21.15.57:0/4112523410 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f64f80afb70 0x7f64f80aeb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:18.492 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.503+0000 7f64ffa00640 1 --2- 172.21.15.57:0/4112523410 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f64d806c530 0x7f64d806e9f0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:18.492 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.503+0000 7f64ffa00640 1 --2- 172.21.15.57:0/4112523410 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f64f806b7b0 0x7f64f814e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:18.492 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.503+0000 7f64ffa00640 1 -- 172.21.15.57:0/4112523410 >> 172.21.15.57:0/4112523410 conn(0x7f64f80cd050 msgr2=0x7f64f81631e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:18.492 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.503+0000 7f64ffa00640 1 -- 172.21.15.57:0/4112523410 shutdown_connections 2024-03-27T10:01:18.493 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.503+0000 7f64ffa00640 1 -- 172.21.15.57:0/4112523410 wait complete. 2024-03-27T10:01:18.511 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-03-27T10:01:18.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.740+0000 7f996be00640 1 Processor -- start 2024-03-27T10:01:18.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.741+0000 7f996be00640 1 -- start start 2024-03-27T10:01:18.731 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.742+0000 7f996be00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f996c0d4b60 0x7f996c0d2500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:18.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.742+0000 7f996be00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f996c0d2a40 0x7f996c06c470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:18.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.742+0000 7f996be00640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f996c0cf430 con 0x7f996c161740 2024-03-27T10:01:18.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.742+0000 7f996be00640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f996c0cf710 con 0x7f996c0d4b60 2024-03-27T10:01:18.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.742+0000 7f996be00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f996c0cf9f0 con 0x7f996c0d2a40 2024-03-27T10:01:18.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.743+0000 7f996a000640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f996c0d4b60 0x7f996c0d2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:18.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.743+0000 7f996aa00640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f996c161740 0x7f996c0ceb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:58168/0 (socket says 172.21.15.57:58168) 2024-03-27T10:01:18.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.743+0000 7f996a000640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f996c0d4b60 0x7f996c0d2500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58762/0 (socket says 172.21.15.57:58762) 2024-03-27T10:01:18.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.743+0000 7f996aa00640 1 -- 172.21.15.57:0/3179259677 learned_addr learned my addr 172.21.15.57:0/3179259677 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T10:01:18.733 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.743+0000 7f996b400640 1 --2- 172.21.15.57:0/3179259677 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f996c0d2a40 0x7f996c06c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:18.733 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.743+0000 7f996a000640 1 -- 172.21.15.57:0/3179259677 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f996c0d2a40 msgr2=0x7f996c06c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:01:18.733 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.743+0000 7f996a000640 1 --2- 172.21.15.57:0/3179259677 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f996c0d2a40 0x7f996c06c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:18.734 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.743+0000 7f996a000640 1 -- 172.21.15.57:0/3179259677 >> v1:172.21.15.57:6789/0 conn(0x7f996c161740 legacy=0x7f996c0ceb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:18.734 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.743+0000 7f996a000640 1 -- 172.21.15.57:0/3179259677 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f996c0cfcd0 con 0x7f996c0d4b60 2024-03-27T10:01:18.734 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.743+0000 7f9969600640 1 -- 172.21.15.57:0/3179259677 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1105128321 0 0) 0x7f996c0cf430 con 0x7f996c161740 2024-03-27T10:01:18.734 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.743+0000 7f996b400640 1 --2- 172.21.15.57:0/3179259677 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f996c0d2a40 0x7f996c06c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T10:01:18.734 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.744+0000 7f996a000640 1 --2- 172.21.15.57:0/3179259677 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f996c0d4b60 0x7f996c0d2500 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f99540097d0 tx=0x7f995402b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e43c4f0ad5e4f4c8 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:18.735 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.745+0000 7f9969600640 1 -- 172.21.15.57:0/3179259677 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9954035020 con 0x7f996c0d4b60 2024-03-27T10:01:18.735 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.745+0000 7f9969600640 1 -- 172.21.15.57:0/3179259677 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9954031800 con 0x7f996c0d4b60 2024-03-27T10:01:18.735 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.745+0000 7f9969600640 1 -- 172.21.15.57:0/3179259677 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9954031bd0 con 0x7f996c0d4b60 2024-03-27T10:01:18.735 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.745+0000 7f996be00640 1 -- 172.21.15.57:0/3179259677 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f996c0d4b60 msgr2=0x7f996c0d2500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:18.735 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.745+0000 7f996be00640 1 --2- 172.21.15.57:0/3179259677 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f996c0d4b60 0x7f996c0d2500 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f99540097d0 tx=0x7f995402b8a0 comp rx=0 tx=0).stop 2024-03-27T10:01:18.735 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.745+0000 7f996be00640 1 -- 172.21.15.57:0/3179259677 shutdown_connections 2024-03-27T10:01:18.735 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.745+0000 7f996be00640 1 --2- 172.21.15.57:0/3179259677 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f996c0d2a40 0x7f996c06c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:18.735 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.745+0000 7f996be00640 1 --2- 172.21.15.57:0/3179259677 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f996c0d4b60 0x7f996c0d2500 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:18.735 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.746+0000 7f996be00640 1 -- 172.21.15.57:0/3179259677 >> 172.21.15.57:0/3179259677 conn(0x7f996c0d3f20 msgr2=0x7f996c0d4330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:18.735 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.746+0000 7f996be00640 1 -- 172.21.15.57:0/3179259677 shutdown_connections 2024-03-27T10:01:18.736 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.746+0000 7f996be00640 1 -- 172.21.15.57:0/3179259677 wait complete. 2024-03-27T10:01:18.736 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.747+0000 7f996be00640 1 Processor -- start 2024-03-27T10:01:18.736 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.747+0000 7f996be00640 1 -- start start 2024-03-27T10:01:18.739 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.748+0000 7f996be00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f996c0d2a40 0x7f996c158470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:18.739 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.748+0000 7f996be00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f996c0d4b60 0x7f996c0b3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:18.739 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.748+0000 7f996be00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f996c161740 0x7f996c0b3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:18.739 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.748+0000 7f996be00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f996c06c9b0 con 0x7f996c0d4b60 2024-03-27T10:01:18.739 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.748+0000 7f996be00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f996c161b20 con 0x7f996c161740 2024-03-27T10:01:18.739 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.748+0000 7f996be00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f996c06cb30 con 0x7f996c0d2a40 2024-03-27T10:01:18.739 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.749+0000 7f996a000640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f996c0d4b60 0x7f996c0b3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:18.739 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.749+0000 7f996a000640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f996c0d4b60 0x7f996c0b3980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58774/0 (socket says 172.21.15.57:58774) 2024-03-27T10:01:18.739 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.749+0000 7f996a000640 1 -- 172.21.15.57:0/581443698 learned_addr learned my addr 172.21.15.57:0/581443698 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:01:18.739 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.749+0000 7f996aa00640 1 --2- 172.21.15.57:0/581443698 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f996c0d2a40 0x7f996c158470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:18.740 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.749+0000 7f996b400640 1 --2- 172.21.15.57:0/581443698 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f996c161740 0x7f996c0b3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:18.740 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.749+0000 7f996a000640 1 -- 172.21.15.57:0/581443698 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f996c0d2a40 msgr2=0x7f996c158470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:18.740 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.749+0000 7f996a000640 1 --2- 172.21.15.57:0/581443698 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f996c0d2a40 0x7f996c158470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:18.740 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.749+0000 7f996a000640 1 -- 172.21.15.57:0/581443698 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f996c161740 msgr2=0x7f996c0b3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:18.740 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.749+0000 7f996a000640 1 --2- 172.21.15.57:0/581443698 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f996c161740 0x7f996c0b3ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:18.740 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.749+0000 7f996a000640 1 -- 172.21.15.57:0/581443698 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f996c0b4540 con 0x7f996c0d4b60 2024-03-27T10:01:18.740 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.750+0000 7f996a000640 1 --2- 172.21.15.57:0/581443698 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f996c0d4b60 0x7f996c0b3980 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f99540098f0 tx=0x7f99540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:18.740 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.750+0000 7f9962a00640 1 -- 172.21.15.57:0/581443698 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9954041070 con 0x7f996c0d4b60 2024-03-27T10:01:18.740 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.750+0000 7f9962a00640 1 -- 172.21.15.57:0/581443698 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f995403b430 con 0x7f996c0d4b60 2024-03-27T10:01:18.740 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.750+0000 7f9962a00640 1 -- 172.21.15.57:0/581443698 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9954035040 con 0x7f996c0d4b60 2024-03-27T10:01:18.740 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.750+0000 7f996be00640 1 -- 172.21.15.57:0/581443698 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f996c0b4820 con 0x7f996c0d4b60 2024-03-27T10:01:18.740 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.750+0000 7f996be00640 1 -- 172.21.15.57:0/581443698 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f996c0b4de0 con 0x7f996c0d4b60 2024-03-27T10:01:18.741 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.751+0000 7f996be00640 1 -- 172.21.15.57:0/581443698 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f996c068540 con 0x7f996c0d4b60 2024-03-27T10:01:18.741 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.752+0000 7f9962a00640 1 -- 172.21.15.57:0/581443698 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f9954038020 con 0x7f996c0d4b60 2024-03-27T10:01:18.742 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.753+0000 7f9962a00640 1 --2- 172.21.15.57:0/581443698 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f994806c580 0x7f994806ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:18.742 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.753+0000 7f9962a00640 1 -- 172.21.15.57:0/581443698 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5249+0+0 (secure 0 0 0) 0x7f99540ad190 con 0x7f996c0d4b60 2024-03-27T10:01:18.742 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.753+0000 7f996aa00640 1 --2- 172.21.15.57:0/581443698 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f994806c580 0x7f994806ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:18.743 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.754+0000 7f996aa00640 1 --2- 172.21.15.57:0/581443698 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f994806c580 0x7f994806ea40 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f995c000f60 tx=0x7f995c007c00 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:18.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:18.758+0000 7f9962a00640 1 -- 172.21.15.57:0/581443698 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f995407b9e0 con 0x7f996c0d4b60 2024-03-27T10:01:19.026 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.037+0000 7f996be00640 1 -- 172.21.15.57:0/581443698 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7f996c0ceb90 con 0x7f996c0d4b60 2024-03-27T10:01:19.031 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.042+0000 7f9962a00640 1 -- 172.21.15.57:0/581443698 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) ==== 90+0+0 (secure 0 0 0) 0x7f995407b2e0 con 0x7f996c0d4b60 2024-03-27T10:01:19.034 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.045+0000 7f996be00640 1 -- 172.21.15.57:0/581443698 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f994806c580 msgr2=0x7f994806ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:19.035 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.045+0000 7f996be00640 1 --2- 172.21.15.57:0/581443698 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f994806c580 0x7f994806ea40 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f995c000f60 tx=0x7f995c007c00 comp rx=0 tx=0).stop 2024-03-27T10:01:19.035 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.045+0000 7f996be00640 1 -- 172.21.15.57:0/581443698 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f996c0d4b60 msgr2=0x7f996c0b3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:19.035 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.045+0000 7f996be00640 1 --2- 172.21.15.57:0/581443698 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f996c0d4b60 0x7f996c0b3980 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f99540098f0 tx=0x7f99540046c0 comp rx=0 tx=0).stop 2024-03-27T10:01:19.035 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.045+0000 7f996be00640 1 -- 172.21.15.57:0/581443698 shutdown_connections 2024-03-27T10:01:19.035 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.045+0000 7f996be00640 1 --2- 172.21.15.57:0/581443698 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f994806c580 0x7f994806ea40 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:19.035 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.045+0000 7f996be00640 1 --2- 172.21.15.57:0/581443698 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f996c161740 0x7f996c0b3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:19.035 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.045+0000 7f996be00640 1 --2- 172.21.15.57:0/581443698 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f996c0d4b60 0x7f996c0b3980 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:19.035 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.045+0000 7f996be00640 1 --2- 172.21.15.57:0/581443698 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f996c0d2a40 0x7f996c158470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:19.035 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.045+0000 7f996be00640 1 -- 172.21.15.57:0/581443698 >> 172.21.15.57:0/581443698 conn(0x7f996c0d3f20 msgr2=0x7f996c06cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:19.035 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.046+0000 7f996be00640 1 -- 172.21.15.57:0/581443698 shutdown_connections 2024-03-27T10:01:19.035 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.046+0000 7f996be00640 1 -- 172.21.15.57:0/581443698 wait complete. 2024-03-27T10:01:19.056 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-03-27T10:01:19.277 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.288+0000 7fdb11000640 1 Processor -- start 2024-03-27T10:01:19.277 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.288+0000 7fdb11000640 1 -- start start 2024-03-27T10:01:19.279 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.290+0000 7fdb11000640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdb0c0d2c10 0x7fdb0c168e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:19.279 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.290+0000 7fdb11000640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb0c0cf430 con 0x7fdb0c0d4b60 2024-03-27T10:01:19.279 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.290+0000 7fdb11000640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb0c0cf710 con 0x7fdb0c161740 2024-03-27T10:01:19.279 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.290+0000 7fdb11000640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fdb0c0cf9f0 con 0x7fdb0c0d2c10 2024-03-27T10:01:19.279 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.290+0000 7fdb0aa00640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fdb0c0d4b60 0x7fdb0c0d2500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:58178/0 (socket says 172.21.15.57:58178) 2024-03-27T10:01:19.279 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.290+0000 7fdb0aa00640 1 -- 172.21.15.57:0/1872920245 learned_addr learned my addr 172.21.15.57:0/1872920245 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T10:01:19.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.290+0000 7fdb0be00640 1 --2- 172.21.15.57:0/1872920245 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdb0c0d2c10 0x7fdb0c168e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:19.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.291+0000 7fdb0a000640 1 -- 172.21.15.57:0/1872920245 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1525258648 0 0) 0x7fdb0c0cf430 con 0x7fdb0c0d4b60 2024-03-27T10:01:19.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.291+0000 7fdb0a000640 1 -- 172.21.15.57:0/1872920245 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdaf0003520 con 0x7fdb0c0d4b60 2024-03-27T10:01:19.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.291+0000 7fdb0a000640 1 -- 172.21.15.57:0/1872920245 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2803793351 0 0) 0x7fdaf0003520 con 0x7fdb0c0d4b60 2024-03-27T10:01:19.281 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.291+0000 7fdb0a000640 1 -- 172.21.15.57:0/1872920245 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdb0c0d2c10 msgr2=0x7fdb0c168e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:01:19.282 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.291+0000 7fdb0a000640 1 --2- 172.21.15.57:0/1872920245 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdb0c0d2c10 0x7fdb0c168e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:19.282 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.291+0000 7fdb0a000640 1 -- 172.21.15.57:0/1872920245 >> v1:172.21.15.118:6789/0 conn(0x7fdb0c161740 legacy=0x7fdb0c0ceb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:19.282 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.291+0000 7fdb0a000640 1 -- 172.21.15.57:0/1872920245 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb0c0cfcd0 con 0x7fdb0c0d4b60 2024-03-27T10:01:19.282 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.291+0000 7fdb0a000640 1 -- 172.21.15.57:0/1872920245 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4227751516 0 0) 0x7fdaf8001670 con 0x7fdb0c0d4b60 2024-03-27T10:01:19.282 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.291+0000 7fdb0a000640 1 -- 172.21.15.57:0/1872920245 >> v1:172.21.15.57:6789/0 conn(0x7fdb0c0d4b60 legacy=0x7fdb0c0d2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:19.282 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.291+0000 7fdb0a000640 1 --2- 172.21.15.57:0/1872920245 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdaf00039e0 0x7fdaf0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:19.282 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.291+0000 7fdb0a000640 1 --2- 172.21.15.57:0/1872920245 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdb0c0d2c10 0x7fdaf0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:19.282 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.291+0000 7fdb0a000640 1 --2- 172.21.15.57:0/1872920245 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdaf0004d40 0x7fdaf00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:19.283 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.291+0000 7fdb0a000640 1 -- 172.21.15.57:0/1872920245 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fdb0c0cf9f0 con 0x7fdaf00039e0 2024-03-27T10:01:19.283 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.291+0000 7fdb0a000640 1 -- 172.21.15.57:0/1872920245 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fdaf000bad0 con 0x7fdaf0004d40 2024-03-27T10:01:19.283 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.291+0000 7fdb0a000640 1 -- 172.21.15.57:0/1872920245 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fdaf000bcd0 con 0x7fdb0c0d2c10 2024-03-27T10:01:19.283 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.292+0000 7fdb0b400640 1 --2- 172.21.15.57:0/1872920245 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdaf00039e0 0x7fdaf0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:19.283 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.292+0000 7fdb0aa00640 1 --2- 172.21.15.57:0/1872920245 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdb0c0d2c10 0x7fdaf0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:19.283 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.292+0000 7fdb0b400640 1 -- 172.21.15.57:0/1872920245 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdb0c0d2c10 msgr2=0x7fdaf0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:01:19.283 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.292+0000 7fdb0b400640 1 --2- 172.21.15.57:0/1872920245 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdb0c0d2c10 0x7fdaf0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:19.283 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.292+0000 7fdb0b400640 1 -- 172.21.15.57:0/1872920245 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdaf0004d40 msgr2=0x7fdaf00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:01:19.283 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.292+0000 7fdb0b400640 1 --2- 172.21.15.57:0/1872920245 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdaf0004d40 0x7fdaf00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:19.283 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.292+0000 7fdb0b400640 1 -- 172.21.15.57:0/1872920245 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdaf0003520 con 0x7fdaf00039e0 2024-03-27T10:01:19.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.293+0000 7fdb0b400640 1 --2- 172.21.15.57:0/1872920245 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdaf00039e0 0x7fdaf0003e00 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fdafc001720 tx=0x7fdaf0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=940e95bac2d85c78 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:19.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.294+0000 7fdb0a000640 1 -- 172.21.15.57:0/1872920245 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdafc001370 con 0x7fdaf00039e0 2024-03-27T10:01:19.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.294+0000 7fdb0a000640 1 -- 172.21.15.57:0/1872920245 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdafc0052d0 con 0x7fdaf00039e0 2024-03-27T10:01:19.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.294+0000 7fdb0a000640 1 -- 172.21.15.57:0/1872920245 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdafc003830 con 0x7fdaf00039e0 2024-03-27T10:01:19.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.294+0000 7fdb11000640 1 -- 172.21.15.57:0/1872920245 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdaf00039e0 msgr2=0x7fdaf0003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:19.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.294+0000 7fdb11000640 1 --2- 172.21.15.57:0/1872920245 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdaf00039e0 0x7fdaf0003e00 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fdafc001720 tx=0x7fdaf0005830 comp rx=0 tx=0).stop 2024-03-27T10:01:19.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.294+0000 7fdb0be00640 1 -- 172.21.15.57:0/1872920245 reap_dead start 2024-03-27T10:01:19.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.294+0000 7fdb11000640 1 -- 172.21.15.57:0/1872920245 shutdown_connections 2024-03-27T10:01:19.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.294+0000 7fdb11000640 1 -- 172.21.15.57:0/1872920245 >> 172.21.15.57:0/1872920245 conn(0x7fdb0c0d3f20 msgr2=0x7fdb0c0d4330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:19.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.294+0000 7fdb11000640 1 -- 172.21.15.57:0/1872920245 shutdown_connections 2024-03-27T10:01:19.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.294+0000 7fdb11000640 1 -- 172.21.15.57:0/1872920245 wait complete. 2024-03-27T10:01:19.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.296+0000 7fdb11000640 1 Processor -- start 2024-03-27T10:01:19.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.296+0000 7fdb11000640 1 -- start start 2024-03-27T10:01:19.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.297+0000 7fdb11000640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdaf00039e0 0x7fdb0c15c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:19.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.297+0000 7fdb11000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdb0c0cd300 0x7fdb0c0b6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:19.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.297+0000 7fdb11000640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb0c0c9aa0 0x7fdb0c0c9f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:19.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.297+0000 7fdb11000640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fdb0c06d480 con 0x7fdb0c0c9aa0 2024-03-27T10:01:19.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.297+0000 7fdb11000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fdb0c161b20 con 0x7fdb0c0cd300 2024-03-27T10:01:19.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.297+0000 7fdb11000640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fdb0c06d600 con 0x7fdaf00039e0 2024-03-27T10:01:19.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.298+0000 7fdb0be00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb0c0c9aa0 0x7fdb0c0c9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:19.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.298+0000 7fdb0be00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb0c0c9aa0 0x7fdb0c0c9f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58794/0 (socket says 172.21.15.57:58794) 2024-03-27T10:01:19.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.298+0000 7fdb0be00640 1 -- 172.21.15.57:0/2938568672 learned_addr learned my addr 172.21.15.57:0/2938568672 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:01:19.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.298+0000 7fdb0b400640 1 --2- 172.21.15.57:0/2938568672 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdaf00039e0 0x7fdb0c15c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:19.291 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.298+0000 7fdb0aa00640 1 --2- 172.21.15.57:0/2938568672 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdb0c0cd300 0x7fdb0c0b6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:19.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.298+0000 7fdb0be00640 1 -- 172.21.15.57:0/2938568672 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdaf00039e0 msgr2=0x7fdb0c15c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:19.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.298+0000 7fdb0be00640 1 --2- 172.21.15.57:0/2938568672 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdaf00039e0 0x7fdb0c15c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:19.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.298+0000 7fdb0be00640 1 -- 172.21.15.57:0/2938568672 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdb0c0cd300 msgr2=0x7fdb0c0b6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:19.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.298+0000 7fdb0be00640 1 --2- 172.21.15.57:0/2938568672 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdb0c0cd300 0x7fdb0c0b6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:19.292 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.298+0000 7fdb0be00640 1 -- 172.21.15.57:0/2938568672 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb0c0b54b0 con 0x7fdb0c0c9aa0 2024-03-27T10:01:19.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.298+0000 7fdb0be00640 1 --2- 172.21.15.57:0/2938568672 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb0c0c9aa0 0x7fdb0c0c9f30 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c0c79c0 tx=0x7fdb0400b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:19.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.299+0000 7fdb03400640 1 -- 172.21.15.57:0/2938568672 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb0400bce0 con 0x7fdb0c0c9aa0 2024-03-27T10:01:19.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.299+0000 7fdb03400640 1 -- 172.21.15.57:0/2938568672 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb0401a070 con 0x7fdb0c0c9aa0 2024-03-27T10:01:19.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.299+0000 7fdb03400640 1 -- 172.21.15.57:0/2938568672 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb04014640 con 0x7fdb0c0c9aa0 2024-03-27T10:01:19.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.299+0000 7fdb11000640 1 -- 172.21.15.57:0/2938568672 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb0c0b4410 con 0x7fdb0c0c9aa0 2024-03-27T10:01:19.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.299+0000 7fdb11000640 1 -- 172.21.15.57:0/2938568672 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb0c0b49d0 con 0x7fdb0c0c9aa0 2024-03-27T10:01:19.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.300+0000 7fdb11000640 1 -- 172.21.15.57:0/2938568672 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb0c068540 con 0x7fdb0c0c9aa0 2024-03-27T10:01:19.295 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.301+0000 7fdb03400640 1 -- 172.21.15.57:0/2938568672 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fdb04005d10 con 0x7fdb0c0c9aa0 2024-03-27T10:01:19.296 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.302+0000 7fdb03400640 1 --2- 172.21.15.57:0/2938568672 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fdaec06c530 0x7fdaec06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:19.296 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.302+0000 7fdb03400640 1 -- 172.21.15.57:0/2938568672 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5249+0+0 (secure 0 0 0) 0x7fdb0408b8d0 con 0x7fdb0c0c9aa0 2024-03-27T10:01:19.296 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.302+0000 7fdb0b400640 1 --2- 172.21.15.57:0/2938568672 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fdaec06c530 0x7fdaec06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:19.296 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.303+0000 7fdb0b400640 1 --2- 172.21.15.57:0/2938568672 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fdaec06c530 0x7fdaec06e9f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fdafc033000 tx=0x7fdafc009030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:19.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.307+0000 7fdb03400640 1 -- 172.21.15.57:0/2938568672 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7fdb04024020 con 0x7fdb0c0c9aa0 2024-03-27T10:01:19.578 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.589+0000 7fdb11000640 1 -- 172.21.15.57:0/2938568672 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7fdb0c0d1db0 con 0x7fdb0c0c9aa0 2024-03-27T10:01:19.583 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.594+0000 7fdb03400640 1 -- 172.21.15.57:0/2938568672 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) ==== 97+0+0 (secure 0 0 0) 0x7fdb0405a010 con 0x7fdb0c0c9aa0 2024-03-27T10:01:19.586 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.597+0000 7fdb11000640 1 -- 172.21.15.57:0/2938568672 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fdaec06c530 msgr2=0x7fdaec06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:19.587 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.597+0000 7fdb11000640 1 --2- 172.21.15.57:0/2938568672 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fdaec06c530 0x7fdaec06e9f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fdafc033000 tx=0x7fdafc009030 comp rx=0 tx=0).stop 2024-03-27T10:01:19.587 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.597+0000 7fdb11000640 1 -- 172.21.15.57:0/2938568672 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb0c0c9aa0 msgr2=0x7fdb0c0c9f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:19.587 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.597+0000 7fdb11000640 1 --2- 172.21.15.57:0/2938568672 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb0c0c9aa0 0x7fdb0c0c9f30 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c0c79c0 tx=0x7fdb0400b480 comp rx=0 tx=0).stop 2024-03-27T10:01:19.587 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.597+0000 7fdb11000640 1 -- 172.21.15.57:0/2938568672 shutdown_connections 2024-03-27T10:01:19.587 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.597+0000 7fdb11000640 1 --2- 172.21.15.57:0/2938568672 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdb0c0c9aa0 0x7fdb0c0c9f30 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:19.587 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.597+0000 7fdb11000640 1 --2- 172.21.15.57:0/2938568672 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fdaec06c530 0x7fdaec06e9f0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:19.587 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.597+0000 7fdb11000640 1 --2- 172.21.15.57:0/2938568672 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdb0c0cd300 0x7fdb0c0b6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:19.587 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.597+0000 7fdb11000640 1 --2- 172.21.15.57:0/2938568672 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdaf00039e0 0x7fdb0c15c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:19.587 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.597+0000 7fdb11000640 1 -- 172.21.15.57:0/2938568672 >> 172.21.15.57:0/2938568672 conn(0x7fdb0c0d3f20 msgr2=0x7fdb0c0b0cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:19.587 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.598+0000 7fdb11000640 1 -- 172.21.15.57:0/2938568672 shutdown_connections 2024-03-27T10:01:19.587 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.598+0000 7fdb11000640 1 -- 172.21.15.57:0/2938568672 wait complete. 2024-03-27T10:01:19.607 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-03-27T10:01:19.829 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.840+0000 7f14d6600640 1 Processor -- start 2024-03-27T10:01:19.829 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.840+0000 7f14d6600640 1 -- start start 2024-03-27T10:01:19.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.842+0000 7f14d6600640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f14d00cc6f0 0x7f14d00ccb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:19.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.842+0000 7f14d6600640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14d006cef0 con 0x7f14d00c3080 2024-03-27T10:01:19.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.842+0000 7f14d6600640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14d0166840 con 0x7f14d01662f0 2024-03-27T10:01:19.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.842+0000 7f14d6600640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f14d0071880 con 0x7f14d00cc6f0 2024-03-27T10:01:19.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.842+0000 7f14cf400640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f14d00c3080 0x7f14d00ca370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:58192/0 (socket says 172.21.15.57:58192) 2024-03-27T10:01:19.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.842+0000 7f14cf400640 1 -- 172.21.15.57:0/189347235 learned_addr learned my addr 172.21.15.57:0/189347235 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T10:01:19.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.842+0000 7f14cfe00640 1 --2- 172.21.15.57:0/189347235 >> v2:172.21.15.57:3300/0 conn(0x7f14d00cc6f0 0x7f14d00ccb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:19.832 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.842+0000 7f14cfe00640 1 -- 172.21.15.57:0/189347235 >> v1:172.21.15.118:6789/0 conn(0x7f14d01662f0 legacy=0x7f14d0071170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:01:19.832 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.842+0000 7f14cfe00640 1 -- 172.21.15.57:0/189347235 >> v1:172.21.15.57:6789/0 conn(0x7f14d00c3080 legacy=0x7f14d00ca370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:19.832 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.843+0000 7f14cfe00640 1 -- 172.21.15.57:0/189347235 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14d0166b20 con 0x7f14d00cc6f0 2024-03-27T10:01:19.832 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.843+0000 7f14cea00640 1 -- 172.21.15.57:0/189347235 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1732618146 0 0) 0x7f14d006cef0 con 0x7f14d00c3080 2024-03-27T10:01:19.833 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.844+0000 7f14cfe00640 1 --2- 172.21.15.57:0/189347235 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14d00cc6f0 0x7f14d00ccb80 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f14c8009d90 tx=0x7f14c802bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=558b5f9f0c395f4e server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:19.833 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.844+0000 7f14cea00640 1 -- 172.21.15.57:0/189347235 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14c8039070 con 0x7f14d00cc6f0 2024-03-27T10:01:19.833 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.844+0000 7f14cea00640 1 -- 172.21.15.57:0/189347235 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14c802cd00 con 0x7f14d00cc6f0 2024-03-27T10:01:19.833 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.844+0000 7f14cea00640 1 -- 172.21.15.57:0/189347235 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14c8034660 con 0x7f14d00cc6f0 2024-03-27T10:01:19.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.845+0000 7f14d6600640 1 -- 172.21.15.57:0/189347235 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14d00cc6f0 msgr2=0x7f14d00ccb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:19.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.845+0000 7f14d6600640 1 --2- 172.21.15.57:0/189347235 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14d00cc6f0 0x7f14d00ccb80 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f14c8009d90 tx=0x7f14c802bf50 comp rx=0 tx=0).stop 2024-03-27T10:01:19.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.845+0000 7f14d6600640 1 -- 172.21.15.57:0/189347235 shutdown_connections 2024-03-27T10:01:19.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.845+0000 7f14d6600640 1 --2- 172.21.15.57:0/189347235 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14d00cc6f0 0x7f14d00ccb80 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:19.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.845+0000 7f14d6600640 1 -- 172.21.15.57:0/189347235 >> 172.21.15.57:0/189347235 conn(0x7f14d00b1a50 msgr2=0x7f14d00b1e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:19.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.845+0000 7f14d6600640 1 -- 172.21.15.57:0/189347235 shutdown_connections 2024-03-27T10:01:19.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.845+0000 7f14d6600640 1 -- 172.21.15.57:0/189347235 wait complete. 2024-03-27T10:01:19.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.846+0000 7f14d6600640 1 Processor -- start 2024-03-27T10:01:19.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.847+0000 7f14d6600640 1 -- start start 2024-03-27T10:01:19.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.848+0000 7f14d6600640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14d00c3080 0x7f14d015fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:19.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.848+0000 7f14d6600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f14d00cc6f0 0x7f14d00b3b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:19.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.848+0000 7f14d6600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f14d01662f0 0x7f14d0071a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:19.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.848+0000 7f14d6600640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f14d01670e0 con 0x7f14d00c3080 2024-03-27T10:01:19.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.848+0000 7f14d6600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f14d00cd0c0 con 0x7f14d00cc6f0 2024-03-27T10:01:19.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.848+0000 7f14d6600640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f14d00c3460 con 0x7f14d01662f0 2024-03-27T10:01:19.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.848+0000 7f14cf400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14d00c3080 0x7f14d015fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:19.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.848+0000 7f14cf400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14d00c3080 0x7f14d015fed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58810/0 (socket says 172.21.15.57:58810) 2024-03-27T10:01:19.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.848+0000 7f14cf400640 1 -- 172.21.15.57:0/1569568018 learned_addr learned my addr 172.21.15.57:0/1569568018 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:01:19.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.848+0000 7f14cfe00640 1 --2- 172.21.15.57:0/1569568018 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f14d01662f0 0x7f14d0071a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:19.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.848+0000 7f14c7e00640 1 --2- 172.21.15.57:0/1569568018 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f14d00cc6f0 0x7f14d00b3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:19.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.848+0000 7f14cf400640 1 -- 172.21.15.57:0/1569568018 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f14d01662f0 msgr2=0x7f14d0071a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:19.839 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.848+0000 7f14cf400640 1 --2- 172.21.15.57:0/1569568018 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f14d01662f0 0x7f14d0071a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:19.839 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.848+0000 7f14cf400640 1 -- 172.21.15.57:0/1569568018 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f14d00cc6f0 msgr2=0x7f14d00b3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:19.839 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.848+0000 7f14cf400640 1 --2- 172.21.15.57:0/1569568018 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f14d00cc6f0 0x7f14d00b3b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:19.839 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.849+0000 7f14cf400640 1 -- 172.21.15.57:0/1569568018 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14d0160410 con 0x7f14d00c3080 2024-03-27T10:01:19.839 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.849+0000 7f14cf400640 1 --2- 172.21.15.57:0/1569568018 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14d00c3080 0x7f14d015fed0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f14c000c4d0 tx=0x7f14c000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:19.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.849+0000 7f14c7400640 1 -- 172.21.15.57:0/1569568018 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14c0018070 con 0x7f14d00c3080 2024-03-27T10:01:19.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.849+0000 7f14c7400640 1 -- 172.21.15.57:0/1569568018 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14c0007500 con 0x7f14d00c3080 2024-03-27T10:01:19.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.849+0000 7f14c7400640 1 -- 172.21.15.57:0/1569568018 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14c0004a20 con 0x7f14d00c3080 2024-03-27T10:01:19.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.849+0000 7f14d6600640 1 -- 172.21.15.57:0/1569568018 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14d00b4470 con 0x7f14d00c3080 2024-03-27T10:01:19.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.849+0000 7f14d6600640 1 -- 172.21.15.57:0/1569568018 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14d00b4a30 con 0x7f14d00c3080 2024-03-27T10:01:19.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.850+0000 7f14d6600640 1 -- 172.21.15.57:0/1569568018 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14d00685b0 con 0x7f14d00c3080 2024-03-27T10:01:19.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.852+0000 7f14c7400640 1 -- 172.21.15.57:0/1569568018 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f14c0004bc0 con 0x7f14d00c3080 2024-03-27T10:01:19.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.852+0000 7f14c7400640 1 --2- 172.21.15.57:0/1569568018 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f14ac06c530 0x7f14ac06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:19.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.852+0000 7f14c7400640 1 -- 172.21.15.57:0/1569568018 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5249+0+0 (secure 0 0 0) 0x7f14c008a870 con 0x7f14d00c3080 2024-03-27T10:01:19.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.853+0000 7f14c7e00640 1 --2- 172.21.15.57:0/1569568018 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f14ac06c530 0x7f14ac06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:19.842 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.853+0000 7f14c7e00640 1 --2- 172.21.15.57:0/1569568018 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f14ac06c530 0x7f14ac06e9f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f14d00b17d0 tx=0x7f14b8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:19.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:19.857+0000 7f14c7400640 1 -- 172.21.15.57:0/1569568018 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f14c0058fb0 con 0x7f14d00c3080 2024-03-27T10:01:20.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.131+0000 7f14d6600640 1 -- 172.21.15.57:0/1569568018 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7f14d006e7c0 con 0x7f14d00c3080 2024-03-27T10:01:20.124 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.135+0000 7f14c7400640 1 -- 172.21.15.57:0/1569568018 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) ==== 90+0+0 (secure 0 0 0) 0x7f14c00588b0 con 0x7f14d00c3080 2024-03-27T10:01:20.127 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.138+0000 7f14d6600640 1 -- 172.21.15.57:0/1569568018 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f14ac06c530 msgr2=0x7f14ac06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:20.127 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.138+0000 7f14d6600640 1 --2- 172.21.15.57:0/1569568018 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f14ac06c530 0x7f14ac06e9f0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f14d00b17d0 tx=0x7f14b8008040 comp rx=0 tx=0).stop 2024-03-27T10:01:20.127 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.138+0000 7f14d6600640 1 -- 172.21.15.57:0/1569568018 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14d00c3080 msgr2=0x7f14d015fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:20.128 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.138+0000 7f14d6600640 1 --2- 172.21.15.57:0/1569568018 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14d00c3080 0x7f14d015fed0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f14c000c4d0 tx=0x7f14c000c990 comp rx=0 tx=0).stop 2024-03-27T10:01:20.128 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.138+0000 7f14d6600640 1 -- 172.21.15.57:0/1569568018 shutdown_connections 2024-03-27T10:01:20.128 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.138+0000 7f14d6600640 1 --2- 172.21.15.57:0/1569568018 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f14d01662f0 0x7f14d0071a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:20.128 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.138+0000 7f14d6600640 1 --2- 172.21.15.57:0/1569568018 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f14ac06c530 0x7f14ac06e9f0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:20.128 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.138+0000 7f14d6600640 1 --2- 172.21.15.57:0/1569568018 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f14d00cc6f0 0x7f14d00b3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:20.128 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.138+0000 7f14d6600640 1 --2- 172.21.15.57:0/1569568018 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f14d00c3080 0x7f14d015fed0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:20.128 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.138+0000 7f14d6600640 1 -- 172.21.15.57:0/1569568018 >> 172.21.15.57:0/1569568018 conn(0x7f14d00b1a50 msgr2=0x7f14d01631a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:20.128 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.138+0000 7f14d6600640 1 -- 172.21.15.57:0/1569568018 shutdown_connections 2024-03-27T10:01:20.128 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.138+0000 7f14d6600640 1 -- 172.21.15.57:0/1569568018 wait complete. 2024-03-27T10:01:20.146 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-27T10:01:20.367 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.378+0000 7f2010c00640 1 Processor -- start 2024-03-27T10:01:20.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.379+0000 7f2010c00640 1 -- start start 2024-03-27T10:01:20.369 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.380+0000 7f2010c00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f200c15c120 0x7f200c0d0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:20.369 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.380+0000 7f2010c00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f200c0b2910 0x7f200c0d1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:20.369 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.380+0000 7f2010c00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f200c0cfc10 con 0x7f200c0b2d70 2024-03-27T10:01:20.369 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.380+0000 7f2010c00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f200c0cfef0 con 0x7f200c15c120 2024-03-27T10:01:20.369 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.380+0000 7f2010c00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f200c0d01d0 con 0x7f200c0b2910 2024-03-27T10:01:20.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.381+0000 7f2009400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f200c0b2910 0x7f200c0d1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:20.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.381+0000 7f200a800640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f200c0b2d70 0x7f200c0b0b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.57:34008/0 (socket says 172.21.15.57:34008) 2024-03-27T10:01:20.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.381+0000 7f200a800640 1 -- 172.21.15.57:0/2390160254 learned_addr learned my addr 172.21.15.57:0/2390160254 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T10:01:20.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.381+0000 7f2009e00640 1 --2- 172.21.15.57:0/2390160254 >> v2:172.21.15.118:3300/0 conn(0x7f200c15c120 0x7f200c0d0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:20.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.382+0000 7f2009400640 1 -- 172.21.15.57:0/2390160254 >> v2:172.21.15.118:3300/0 conn(0x7f200c15c120 msgr2=0x7f200c0d0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:01:20.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.382+0000 7f2009400640 1 --2- 172.21.15.57:0/2390160254 >> v2:172.21.15.118:3300/0 conn(0x7f200c15c120 0x7f200c0d0cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:20.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.382+0000 7f2009400640 1 -- 172.21.15.57:0/2390160254 >> v1:172.21.15.118:6789/0 conn(0x7f200c0b2d70 legacy=0x7f200c0b0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:20.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.382+0000 7f2009400640 1 -- 172.21.15.57:0/2390160254 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f200c0d04b0 con 0x7f200c0b2910 2024-03-27T10:01:20.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.382+0000 7f2008a00640 1 -- 172.21.15.57:0/2390160254 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2623590379 0 0) 0x7f200c0cfc10 con 0x7f200c0b2d70 2024-03-27T10:01:20.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.382+0000 7f2009e00640 1 --2- 172.21.15.57:0/2390160254 >> v2:172.21.15.118:3300/0 conn(0x7f200c15c120 0x7f200c0d0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T10:01:20.372 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.383+0000 7f2009400640 1 --2- 172.21.15.57:0/2390160254 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f200c0b2910 0x7f200c0d1d40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc009d90 tx=0x7f1ffc02be20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd599000b09744c5 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:20.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.384+0000 7f2008a00640 1 -- 172.21.15.57:0/2390160254 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ffc039070 con 0x7f200c0b2910 2024-03-27T10:01:20.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.384+0000 7f2008a00640 1 -- 172.21.15.57:0/2390160254 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ffc02cbd0 con 0x7f200c0b2910 2024-03-27T10:01:20.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.384+0000 7f2008a00640 1 -- 172.21.15.57:0/2390160254 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ffc034440 con 0x7f200c0b2910 2024-03-27T10:01:20.374 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.385+0000 7f2010c00640 1 -- 172.21.15.57:0/2390160254 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f200c0b2910 msgr2=0x7f200c0d1d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:20.374 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.385+0000 7f2010c00640 1 --2- 172.21.15.57:0/2390160254 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f200c0b2910 0x7f200c0d1d40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc009d90 tx=0x7f1ffc02be20 comp rx=0 tx=0).stop 2024-03-27T10:01:20.374 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.385+0000 7f2010c00640 1 -- 172.21.15.57:0/2390160254 shutdown_connections 2024-03-27T10:01:20.374 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.385+0000 7f2010c00640 1 --2- 172.21.15.57:0/2390160254 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f200c0b2910 0x7f200c0d1d40 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:20.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.385+0000 7f2010c00640 1 --2- 172.21.15.57:0/2390160254 >> v2:172.21.15.118:3300/0 conn(0x7f200c15c120 0x7f200c0d0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:20.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.385+0000 7f2010c00640 1 -- 172.21.15.57:0/2390160254 >> 172.21.15.57:0/2390160254 conn(0x7f200c09aa30 msgr2=0x7f200c09ae40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:20.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.385+0000 7f2010c00640 1 -- 172.21.15.57:0/2390160254 shutdown_connections 2024-03-27T10:01:20.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.385+0000 7f2010c00640 1 -- 172.21.15.57:0/2390160254 wait complete. 2024-03-27T10:01:20.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.387+0000 7f2010c00640 1 Processor -- start 2024-03-27T10:01:20.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.388+0000 7f2010c00640 1 -- start start 2024-03-27T10:01:20.379 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.389+0000 7f2010c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f200c0b2910 0x7f200c1f7440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:20.379 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.389+0000 7f2010c00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f200c0b2d70 0x7f200c1f7980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:20.379 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.389+0000 7f2010c00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f200c15c120 0x7f200c14ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:20.379 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.389+0000 7f2010c00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f200c0cebc0 con 0x7f200c0b2d70 2024-03-27T10:01:20.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.389+0000 7f2010c00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f200c0cea40 con 0x7f200c0b2910 2024-03-27T10:01:20.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.389+0000 7f2010c00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f200c15c500 con 0x7f200c15c120 2024-03-27T10:01:20.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.389+0000 7f2009400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f200c0b2d70 0x7f200c1f7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:20.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.389+0000 7f2009400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f200c0b2d70 0x7f200c1f7980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58826/0 (socket says 172.21.15.57:58826) 2024-03-27T10:01:20.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.389+0000 7f2009400640 1 -- 172.21.15.57:0/521748228 learned_addr learned my addr 172.21.15.57:0/521748228 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:01:20.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.389+0000 7f2009e00640 1 --2- 172.21.15.57:0/521748228 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f200c0b2910 0x7f200c1f7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:20.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.389+0000 7f200a800640 1 --2- 172.21.15.57:0/521748228 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f200c15c120 0x7f200c14ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:20.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.390+0000 7f2009400640 1 -- 172.21.15.57:0/521748228 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f200c15c120 msgr2=0x7f200c14ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:20.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.390+0000 7f2009400640 1 --2- 172.21.15.57:0/521748228 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f200c15c120 0x7f200c14ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:20.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.390+0000 7f2009400640 1 -- 172.21.15.57:0/521748228 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f200c0b2910 msgr2=0x7f200c1f7440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:20.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.390+0000 7f2009400640 1 --2- 172.21.15.57:0/521748228 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f200c0b2910 0x7f200c1f7440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:20.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.390+0000 7f2009400640 1 -- 172.21.15.57:0/521748228 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f200c0c8880 con 0x7f200c0b2d70 2024-03-27T10:01:20.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.390+0000 7f2009e00640 1 --2- 172.21.15.57:0/521748228 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f200c0b2910 0x7f200c1f7440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T10:01:20.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.390+0000 7f200a800640 1 --2- 172.21.15.57:0/521748228 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f200c15c120 0x7f200c14ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T10:01:20.381 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.390+0000 7f2009400640 1 --2- 172.21.15.57:0/521748228 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f200c0b2d70 0x7f200c1f7980 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc037040 tx=0x7f1ffc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:20.381 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.390+0000 7f2002000640 1 -- 172.21.15.57:0/521748228 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ffc039050 con 0x7f200c0b2d70 2024-03-27T10:01:20.381 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.390+0000 7f2002000640 1 -- 172.21.15.57:0/521748228 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ffc045070 con 0x7f200c0b2d70 2024-03-27T10:01:20.381 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.390+0000 7f2002000640 1 -- 172.21.15.57:0/521748228 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ffc03e830 con 0x7f200c0b2d70 2024-03-27T10:01:20.381 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.390+0000 7f2010c00640 1 -- 172.21.15.57:0/521748228 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f200c0af6b0 con 0x7f200c0b2d70 2024-03-27T10:01:20.381 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.390+0000 7f2010c00640 1 -- 172.21.15.57:0/521748228 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f200c0afc70 con 0x7f200c0b2d70 2024-03-27T10:01:20.381 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.392+0000 7f2010c00640 1 -- 172.21.15.57:0/521748228 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f200c068620 con 0x7f200c0b2d70 2024-03-27T10:01:20.381 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.393+0000 7f2002000640 1 -- 172.21.15.57:0/521748228 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f1ffc03e9d0 con 0x7f200c0b2d70 2024-03-27T10:01:20.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.394+0000 7f2002000640 1 --2- 172.21.15.57:0/521748228 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f1fe806c560 0x7f1fe806ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:20.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.394+0000 7f2002000640 1 -- 172.21.15.57:0/521748228 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5249+0+0 (secure 0 0 0) 0x7f1ffc0adbc0 con 0x7f200c0b2d70 2024-03-27T10:01:20.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.394+0000 7f2009e00640 1 --2- 172.21.15.57:0/521748228 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f1fe806c560 0x7f1fe806ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:20.384 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.395+0000 7f2009e00640 1 --2- 172.21.15.57:0/521748228 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f1fe806c560 0x7f1fe806ea20 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f1ff4009a20 tx=0x7f1ff4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:20.388 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.399+0000 7f2002000640 1 -- 172.21.15.57:0/521748228 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f1ffc04e020 con 0x7f200c0b2d70 2024-03-27T10:01:20.596 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.607+0000 7f2010c00640 1 -- 172.21.15.57:0/521748228 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f200c0ceff0 con 0x7f200c0b2d70 2024-03-27T10:01:20.598 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.609+0000 7f2002000640 1 -- 172.21.15.57:0/521748228 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) ==== 74+0+13152 (secure 0 0 0) 0x7f1ffc032e20 con 0x7f200c0b2d70 2024-03-27T10:01:20.598 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:01:20.598 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":36,"fsid":"7ac43f86-2c16-4a97-98fb-715d3cebc75c","created":"2024-03-27T09:59:04.033417+0000","modified":"2024-03-27T10:01:16.333556+0000","last_up_change":"2024-03-27T09:59:16.969624+0000","last_in_change":"2024-03-27T09:59:07.421690+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-27T09:59:17.253008+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"47b44362-7302-4f2a-b735-582c6c3850cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6801","nonce":2020036298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6803","nonce":2020036298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6807","nonce":2020036298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6805","nonce":2020036298}]},"public_addr":"172.21.15.57:6801/2020036298","cluster_addr":"172.21.15.57:6803/2020036298","heartbeat_back_addr":"172.21.15.57:6807/2020036298","heartbeat_front_addr":"172.21.15.57:6805/2020036298","state":["exists","up"]},{"osd":1,"uuid":"feaf96f0-9431-4188-9a09-da505b40e934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6809","nonce":3190929242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6811","nonce":3190929242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6815","nonce":3190929242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6813","nonce":3190929242}]},"public_addr":"172.21.15.57:6809/3190929242","cluster_addr":"172.21.15.57:6811/3190929242","heartbeat_back_addr":"172.21.15.57:6815/3190929242","heartbeat_front_addr":"172.21.15.57:6813/3190929242","state":["exists","up"]},{"osd":2,"uuid":"21e406e6-cfbc-4fe7-a816-e2420487c95d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6817","nonce":4065849973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6819","nonce":4065849973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6823","nonce":4065849973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6821","nonce":4065849973}]},"public_addr":"172.21.15.57:6817/4065849973","cluster_addr":"172.21.15.57:6819/4065849973","heartbeat_back_addr":"172.21.15.57:6823/4065849973","heartbeat_front_addr":"172.21.15.57:6821/4065849973","state":["exists","up"]},{"osd":3,"uuid":"a389af1d-76c4-4dfc-b215-f983f4931257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6825","nonce":158084809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6827","nonce":158084809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6831","nonce":158084809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6829","nonce":158084809}]},"public_addr":"172.21.15.57:6825/158084809","cluster_addr":"172.21.15.57:6827/158084809","heartbeat_back_addr":"172.21.15.57:6831/158084809","heartbeat_front_addr":"172.21.15.57:6829/158084809","state":["exists","up"]},{"osd":4,"uuid":"e9b05dca-557a-43ee-b43f-9ce5b7d28304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6823","nonce":108719401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6827","nonce":108719401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6831","nonce":108719401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6829","nonce":108719401}]},"public_addr":"172.21.15.118:6823/108719401","cluster_addr":"172.21.15.118:6827/108719401","heartbeat_back_addr":"172.21.15.118:6831/108719401","heartbeat_front_addr":"172.21.15.118:6829/108719401","state":["exists","up"]},{"osd":5,"uuid":"d968177d-44ff-499a-b00a-b147ed879253","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6817","nonce":2704605866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6819","nonce":2704605866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6826","nonce":2704605866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6822","nonce":2704605866}]},"public_addr":"172.21.15.118:6817/2704605866","cluster_addr":"172.21.15.118:6819/2704605866","heartbeat_back_addr":"172.21.15.118:6826/2704605866","heartbeat_front_addr":"172.21.15.118:6822/2704605866","state":["exists","up"]},{"osd":6,"uuid":"e8f98052-e6ad-4cfe-a4a9-0b17a434d54e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6801","nonce":1963659095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6803","nonce":1963659095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6807","nonce":1963659095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6805","nonce":1963659095}]},"public_addr":"172.21.15.118:6801/1963659095","cluster_addr":"172.21.15.118:6803/1963659095","heartbeat_back_addr":"172.21.15.118:6807/1963659095","heartbeat_front_addr":"172.21.15.118:6805/1963659095","state":["exists","up"]},{"osd":7,"uuid":"eccff987-8e51-4a63-845a-cf0a3196d7fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6809","nonce":1955879596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6811","nonce":1955879596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6815","nonce":1955879596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6813","nonce":1955879596}]},"public_addr":"172.21.15.118:6809/1955879596","cluster_addr":"172.21.15.118:6811/1955879596","heartbeat_back_addr":"172.21.15.118:6815/1955879596","heartbeat_front_addr":"172.21.15.118:6813/1955879596","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.721258+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.696610+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.777895+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.806769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.743259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.845687+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:13.020165+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.722294+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-27T10:01:20.601 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.612+0000 7f2010c00640 1 -- 172.21.15.57:0/521748228 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f1fe806c560 msgr2=0x7f1fe806ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:20.601 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.612+0000 7f2010c00640 1 --2- 172.21.15.57:0/521748228 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f1fe806c560 0x7f1fe806ea20 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f1ff4009a20 tx=0x7f1ff4008040 comp rx=0 tx=0).stop 2024-03-27T10:01:20.601 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.612+0000 7f2010c00640 1 -- 172.21.15.57:0/521748228 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f200c0b2d70 msgr2=0x7f200c1f7980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:20.601 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.612+0000 7f2010c00640 1 --2- 172.21.15.57:0/521748228 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f200c0b2d70 0x7f200c1f7980 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc037040 tx=0x7f1ffc004a40 comp rx=0 tx=0).stop 2024-03-27T10:01:20.601 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.612+0000 7f2010c00640 1 -- 172.21.15.57:0/521748228 shutdown_connections 2024-03-27T10:01:20.601 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.612+0000 7f2010c00640 1 --2- 172.21.15.57:0/521748228 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f200c15c120 0x7f200c14ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:20.601 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.612+0000 7f2010c00640 1 --2- 172.21.15.57:0/521748228 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f200c0b2d70 0x7f200c1f7980 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:20.601 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.612+0000 7f2010c00640 1 --2- 172.21.15.57:0/521748228 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f1fe806c560 0x7f1fe806ea20 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:20.602 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.612+0000 7f2010c00640 1 --2- 172.21.15.57:0/521748228 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f200c0b2910 0x7f200c1f7440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:20.602 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.612+0000 7f2010c00640 1 -- 172.21.15.57:0/521748228 >> 172.21.15.57:0/521748228 conn(0x7f200c09aa30 msgr2=0x7f200c0d17e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:20.602 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.612+0000 7f2010c00640 1 -- 172.21.15.57:0/521748228 shutdown_connections 2024-03-27T10:01:20.602 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.612+0000 7f2010c00640 1 -- 172.21.15.57:0/521748228 wait complete. 2024-03-27T10:01:20.621 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-27T09:59:17.253008+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-27T10:01:20.622 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-27T10:01:20.848 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.858+0000 7fc341c00640 1 Processor -- start 2024-03-27T10:01:20.848 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.859+0000 7fc341c00640 1 -- start start 2024-03-27T10:01:20.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.861+0000 7fc341c00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc33c0ca190 0x7fc33c162bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:20.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.861+0000 7fc341c00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc33c0cdc20 0x7fc33c0ca570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:20.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.861+0000 7fc341c00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fc33c1661a0 0x7fc33c166620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:20.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.861+0000 7fc341c00640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7fc33c0ce060 con 0x7fc33c0ca190 2024-03-27T10:01:20.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.861+0000 7fc341c00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7fc33c0ceea0 con 0x7fc33c1661a0 2024-03-27T10:01:20.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.861+0000 7fc341c00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fc33c0caab0 con 0x7fc33c0cdc20 2024-03-27T10:01:20.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.861+0000 7fc33be00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc33c0ca190 0x7fc33c162bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:20.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.861+0000 7fc33be00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fc33c0ca190 0x7fc33c162bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58832/0 (socket says 172.21.15.57:58832) 2024-03-27T10:01:20.851 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.861+0000 7fc33be00640 1 -- 172.21.15.57:0/334798454 learned_addr learned my addr 172.21.15.57:0/334798454 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:01:20.851 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.861+0000 7fc333e00640 1 --2- 172.21.15.57:0/334798454 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc33c0cdc20 0x7fc33c0ca570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:20.851 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.861+0000 7fc341200640 1 --2- 172.21.15.57:0/334798454 >> v2:172.21.15.118:3300/0 conn(0x7fc33c1661a0 0x7fc33c166620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:20.851 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.862+0000 7fc33be00640 1 -- 172.21.15.57:0/334798454 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc33c0cdc20 msgr2=0x7fc33c0ca570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:01:20.851 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.862+0000 7fc33be00640 1 --2- 172.21.15.57:0/334798454 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc33c0cdc20 0x7fc33c0ca570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:20.851 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.862+0000 7fc33be00640 1 -- 172.21.15.57:0/334798454 >> v2:172.21.15.118:3300/0 conn(0x7fc33c1661a0 msgr2=0x7fc33c166620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:01:20.852 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.862+0000 7fc33be00640 1 --2- 172.21.15.57:0/334798454 >> v2:172.21.15.118:3300/0 conn(0x7fc33c1661a0 0x7fc33c166620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:20.852 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.862+0000 7fc33be00640 1 -- 172.21.15.57:0/334798454 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc33c0ce290 con 0x7fc33c0ca190 2024-03-27T10:01:20.852 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.862+0000 7fc341200640 1 --2- 172.21.15.57:0/334798454 >> v2:172.21.15.118:3300/0 conn(0x7fc33c1661a0 0x7fc33c166620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T10:01:20.852 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.863+0000 7fc33be00640 1 --2- 172.21.15.57:0/334798454 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc33c0ca190 0x7fc33c162bd0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fc33c0cbb00 tx=0x7fc32c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2778301be99af6d server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:20.853 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.864+0000 7fc33b400640 1 -- 172.21.15.57:0/334798454 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc32c034070 con 0x7fc33c0ca190 2024-03-27T10:01:20.853 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.864+0000 7fc33b400640 1 -- 172.21.15.57:0/334798454 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc32c030860 con 0x7fc33c0ca190 2024-03-27T10:01:20.853 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.864+0000 7fc33b400640 1 -- 172.21.15.57:0/334798454 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc32c030c30 con 0x7fc33c0ca190 2024-03-27T10:01:20.854 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.864+0000 7fc341c00640 1 -- 172.21.15.57:0/334798454 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc33c0ca190 msgr2=0x7fc33c162bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:20.854 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.864+0000 7fc341c00640 1 --2- 172.21.15.57:0/334798454 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc33c0ca190 0x7fc33c162bd0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fc33c0cbb00 tx=0x7fc32c02b9a0 comp rx=0 tx=0).stop 2024-03-27T10:01:20.854 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.865+0000 7fc341c00640 1 -- 172.21.15.57:0/334798454 shutdown_connections 2024-03-27T10:01:20.854 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.865+0000 7fc341c00640 1 --2- 172.21.15.57:0/334798454 >> v2:172.21.15.118:3300/0 conn(0x7fc33c1661a0 0x7fc33c166620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:20.854 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.865+0000 7fc341c00640 1 --2- 172.21.15.57:0/334798454 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc33c0cdc20 0x7fc33c0ca570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:20.854 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.865+0000 7fc341c00640 1 --2- 172.21.15.57:0/334798454 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc33c0ca190 0x7fc33c162bd0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:20.854 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.865+0000 7fc341c00640 1 -- 172.21.15.57:0/334798454 >> 172.21.15.57:0/334798454 conn(0x7fc33c0cfb40 msgr2=0x7fc33c0cff20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:20.854 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.865+0000 7fc341c00640 1 -- 172.21.15.57:0/334798454 shutdown_connections 2024-03-27T10:01:20.854 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.865+0000 7fc341c00640 1 -- 172.21.15.57:0/334798454 wait complete. 2024-03-27T10:01:20.855 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.867+0000 7fc341c00640 1 Processor -- start 2024-03-27T10:01:20.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.867+0000 7fc341c00640 1 -- start start 2024-03-27T10:01:20.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.868+0000 7fc341c00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc33c0ca190 0x7fc33c165890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:20.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.868+0000 7fc341c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc33c0cdc20 0x7fc33c0c8850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:20.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.868+0000 7fc341c00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc33c1661a0 0x7fc33c0c8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:20.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.868+0000 7fc341c00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fc33c0ceb30 con 0x7fc33c0ca190 2024-03-27T10:01:20.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.868+0000 7fc341c00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fc33c0ce850 con 0x7fc33c0cdc20 2024-03-27T10:01:20.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.868+0000 7fc341c00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fc33c0cd940 con 0x7fc33c1661a0 2024-03-27T10:01:20.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.868+0000 7fc33be00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc33c0ca190 0x7fc33c165890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:20.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.868+0000 7fc33be00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc33c0ca190 0x7fc33c165890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58834/0 (socket says 172.21.15.57:58834) 2024-03-27T10:01:20.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.868+0000 7fc33be00640 1 -- 172.21.15.57:0/416307678 learned_addr learned my addr 172.21.15.57:0/416307678 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:01:20.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.868+0000 7fc341200640 1 --2- 172.21.15.57:0/416307678 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc33c1661a0 0x7fc33c0c8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:20.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.868+0000 7fc33be00640 1 -- 172.21.15.57:0/416307678 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc33c1661a0 msgr2=0x7fc33c0c8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:20.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.868+0000 7fc33be00640 1 --2- 172.21.15.57:0/416307678 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc33c1661a0 0x7fc33c0c8d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:20.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.869+0000 7fc333e00640 1 --2- 172.21.15.57:0/416307678 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc33c0cdc20 0x7fc33c0c8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:20.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.869+0000 7fc33be00640 1 -- 172.21.15.57:0/416307678 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc33c0cdc20 msgr2=0x7fc33c0c8850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:20.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.869+0000 7fc33be00640 1 --2- 172.21.15.57:0/416307678 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc33c0cdc20 0x7fc33c0c8850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:20.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.869+0000 7fc33be00640 1 -- 172.21.15.57:0/416307678 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc33c0c79c0 con 0x7fc33c0ca190 2024-03-27T10:01:20.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.869+0000 7fc33be00640 1 --2- 172.21.15.57:0/416307678 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc33c0ca190 0x7fc33c165890 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fc32c0097c0 tx=0x7fc32c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:20.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.869+0000 7fc338c00640 1 -- 172.21.15.57:0/416307678 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc32c034040 con 0x7fc33c0ca190 2024-03-27T10:01:20.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.869+0000 7fc338c00640 1 -- 172.21.15.57:0/416307678 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc32c039d90 con 0x7fc33c0ca190 2024-03-27T10:01:20.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.869+0000 7fc338c00640 1 -- 172.21.15.57:0/416307678 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc32c043630 con 0x7fc33c0ca190 2024-03-27T10:01:20.860 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.869+0000 7fc341c00640 1 -- 172.21.15.57:0/416307678 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc33c0c7ca0 con 0x7fc33c0ca190 2024-03-27T10:01:20.860 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.869+0000 7fc341c00640 1 -- 172.21.15.57:0/416307678 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc33c0c8260 con 0x7fc33c0ca190 2024-03-27T10:01:20.860 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.871+0000 7fc341c00640 1 -- 172.21.15.57:0/416307678 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc33c068540 con 0x7fc33c0ca190 2024-03-27T10:01:20.860 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.871+0000 7fc338c00640 1 -- 172.21.15.57:0/416307678 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fc32c04a060 con 0x7fc33c0ca190 2024-03-27T10:01:20.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.873+0000 7fc338c00640 1 --2- 172.21.15.57:0/416307678 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fc31806c530 0x7fc31806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:20.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.873+0000 7fc338c00640 1 -- 172.21.15.57:0/416307678 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5249+0+0 (secure 0 0 0) 0x7fc32c0ad550 con 0x7fc33c0ca190 2024-03-27T10:01:20.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.873+0000 7fc333e00640 1 --2- 172.21.15.57:0/416307678 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fc31806c530 0x7fc31806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:20.863 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.874+0000 7fc333e00640 1 --2- 172.21.15.57:0/416307678 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fc31806c530 0x7fc31806e9f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc33c0b4960 tx=0x7fc324008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:20.866 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:20.878+0000 7fc338c00640 1 -- 172.21.15.57:0/416307678 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7fc32c03e070 con 0x7fc33c0ca190 2024-03-27T10:01:21.068 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.079+0000 7fc341c00640 1 -- 172.21.15.57:0/416307678 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc33c0b0930 con 0x7fc33c0ca190 2024-03-27T10:01:21.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.080+0000 7fc338c00640 1 -- 172.21.15.57:0/416307678 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v36) ==== 93+0+10 (secure 0 0 0) 0x7fc32c037360 con 0x7fc33c0ca190 2024-03-27T10:01:21.069 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2024-03-27T10:01:21.072 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.083+0000 7fc341c00640 1 -- 172.21.15.57:0/416307678 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fc31806c530 msgr2=0x7fc31806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:21.072 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.083+0000 7fc341c00640 1 --2- 172.21.15.57:0/416307678 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fc31806c530 0x7fc31806e9f0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc33c0b4960 tx=0x7fc324008040 comp rx=0 tx=0).stop 2024-03-27T10:01:21.072 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.083+0000 7fc341c00640 1 -- 172.21.15.57:0/416307678 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc33c0ca190 msgr2=0x7fc33c165890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:21.072 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.083+0000 7fc341c00640 1 --2- 172.21.15.57:0/416307678 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc33c0ca190 0x7fc33c165890 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fc32c0097c0 tx=0x7fc32c0046c0 comp rx=0 tx=0).stop 2024-03-27T10:01:21.073 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.083+0000 7fc341c00640 1 -- 172.21.15.57:0/416307678 shutdown_connections 2024-03-27T10:01:21.073 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.083+0000 7fc341c00640 1 --2- 172.21.15.57:0/416307678 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fc33c1661a0 0x7fc33c0c8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:21.073 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.083+0000 7fc341c00640 1 --2- 172.21.15.57:0/416307678 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fc31806c530 0x7fc31806e9f0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:21.073 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.083+0000 7fc341c00640 1 --2- 172.21.15.57:0/416307678 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fc33c0cdc20 0x7fc33c0c8850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:21.073 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.083+0000 7fc341c00640 1 --2- 172.21.15.57:0/416307678 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fc33c0ca190 0x7fc33c165890 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:21.073 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.083+0000 7fc341c00640 1 -- 172.21.15.57:0/416307678 >> 172.21.15.57:0/416307678 conn(0x7fc33c0cfb40 msgr2=0x7fc33c0723a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:21.073 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.083+0000 7fc341c00640 1 -- 172.21.15.57:0/416307678 shutdown_connections 2024-03-27T10:01:21.073 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.084+0000 7fc341c00640 1 -- 172.21.15.57:0/416307678 wait complete. 2024-03-27T10:01:21.092 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-03-27T10:01:21.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.316+0000 7f0b13200640 1 Processor -- start 2024-03-27T10:01:21.306 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.317+0000 7f0b13200640 1 -- start start 2024-03-27T10:01:21.307 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.318+0000 7f0b13200640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0b140d2c20 0x7f0b140b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:21.308 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.318+0000 7f0b13200640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b140b3a30 con 0x7f0b140d4a50 2024-03-27T10:01:21.308 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.318+0000 7f0b13200640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b140b3cd0 con 0x7f0b14161a60 2024-03-27T10:01:21.308 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.318+0000 7f0b13200640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f0b140d4ee0 con 0x7f0b140d2c20 2024-03-27T10:01:21.308 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.319+0000 7f0b11400640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f0b140d4a50 0x7f0b140b47b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:58204/0 (socket says 172.21.15.57:58204) 2024-03-27T10:01:21.308 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.319+0000 7f0b11400640 1 -- 172.21.15.57:0/512204713 learned_addr learned my addr 172.21.15.57:0/512204713 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T10:01:21.308 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.319+0000 7f0b12800640 1 --2- 172.21.15.57:0/512204713 >> v2:172.21.15.57:3300/0 conn(0x7f0b140d2c20 0x7f0b140b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:21.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.319+0000 7f0b10a00640 1 -- 172.21.15.57:0/512204713 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1192098590 0 0) 0x7f0b140b3a30 con 0x7f0b140d4a50 2024-03-27T10:01:21.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.319+0000 7f0b10a00640 1 -- 172.21.15.57:0/512204713 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0af4003520 con 0x7f0b140d4a50 2024-03-27T10:01:21.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.319+0000 7f0b12800640 1 -- 172.21.15.57:0/512204713 >> v1:172.21.15.118:6789/0 conn(0x7f0b14161a60 legacy=0x7f0b140d2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:01:21.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.319+0000 7f0b12800640 1 -- 172.21.15.57:0/512204713 >> v1:172.21.15.57:6789/0 conn(0x7f0b140d4a50 legacy=0x7f0b140b47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:21.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.319+0000 7f0b12800640 1 -- 172.21.15.57:0/512204713 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b140b3fb0 con 0x7f0b140d2c20 2024-03-27T10:01:21.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.320+0000 7f0b12800640 1 --2- 172.21.15.57:0/512204713 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b140d2c20 0x7f0b140b4ec0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c0097d0 tx=0x7f0b0c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afcd6ae96f192584 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:21.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.321+0000 7f0b10a00640 1 -- 172.21.15.57:0/512204713 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b0c0315a0 con 0x7f0b140d2c20 2024-03-27T10:01:21.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.321+0000 7f0b10a00640 1 -- 172.21.15.57:0/512204713 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b0c037070 con 0x7f0b140d2c20 2024-03-27T10:01:21.311 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.321+0000 7f0b10a00640 1 -- 172.21.15.57:0/512204713 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b0c031940 con 0x7f0b140d2c20 2024-03-27T10:01:21.311 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.321+0000 7f0b13200640 1 -- 172.21.15.57:0/512204713 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b140d2c20 msgr2=0x7f0b140b4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:21.311 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.321+0000 7f0b13200640 1 --2- 172.21.15.57:0/512204713 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b140d2c20 0x7f0b140b4ec0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c0097d0 tx=0x7f0b0c02b840 comp rx=0 tx=0).stop 2024-03-27T10:01:21.311 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.321+0000 7f0b13200640 1 -- 172.21.15.57:0/512204713 shutdown_connections 2024-03-27T10:01:21.311 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.321+0000 7f0b13200640 1 --2- 172.21.15.57:0/512204713 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b140d2c20 0x7f0b140b4ec0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:21.311 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.321+0000 7f0b13200640 1 -- 172.21.15.57:0/512204713 >> 172.21.15.57:0/512204713 conn(0x7f0b140d3f30 msgr2=0x7f0b140d4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:21.311 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.322+0000 7f0b13200640 1 -- 172.21.15.57:0/512204713 shutdown_connections 2024-03-27T10:01:21.311 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.322+0000 7f0b13200640 1 -- 172.21.15.57:0/512204713 wait complete. 2024-03-27T10:01:21.312 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.323+0000 7f0b13200640 1 Processor -- start 2024-03-27T10:01:21.312 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.323+0000 7f0b13200640 1 -- start start 2024-03-27T10:01:21.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.324+0000 7f0b13200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0b140d2c20 0x7f0b140c8940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:21.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.324+0000 7f0b13200640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b14161a60 0x7f0b140cbd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:21.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.324+0000 7f0b13200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b140cdaf0 0x7f0b14151bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:21.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.324+0000 7f0b13200640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f0b140d1090 con 0x7f0b14161a60 2024-03-27T10:01:21.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.324+0000 7f0b13200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f0b140b0cc0 con 0x7f0b140cdaf0 2024-03-27T10:01:21.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.324+0000 7f0b13200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f0b140d1210 con 0x7f0b140d2c20 2024-03-27T10:01:21.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.325+0000 7f0b11400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b14161a60 0x7f0b140cbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:21.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.325+0000 7f0b11400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b14161a60 0x7f0b140cbd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58850/0 (socket says 172.21.15.57:58850) 2024-03-27T10:01:21.315 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.325+0000 7f0b11400640 1 -- 172.21.15.57:0/1374660780 learned_addr learned my addr 172.21.15.57:0/1374660780 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:01:21.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.325+0000 7f0b12800640 1 --2- 172.21.15.57:0/1374660780 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b140cdaf0 0x7f0b14151bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:21.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.325+0000 7f0b11e00640 1 --2- 172.21.15.57:0/1374660780 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0b140d2c20 0x7f0b140c8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:21.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.325+0000 7f0b11400640 1 -- 172.21.15.57:0/1374660780 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0b140d2c20 msgr2=0x7f0b140c8940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:21.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.325+0000 7f0b11400640 1 --2- 172.21.15.57:0/1374660780 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0b140d2c20 0x7f0b140c8940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:21.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.325+0000 7f0b11400640 1 -- 172.21.15.57:0/1374660780 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b140cdaf0 msgr2=0x7f0b14151bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:21.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.325+0000 7f0b11400640 1 --2- 172.21.15.57:0/1374660780 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b140cdaf0 0x7f0b14151bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:21.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.325+0000 7f0b11400640 1 -- 172.21.15.57:0/1374660780 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b140c8fd0 con 0x7f0b14161a60 2024-03-27T10:01:21.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.325+0000 7f0b11e00640 1 --2- 172.21.15.57:0/1374660780 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0b140d2c20 0x7f0b140c8940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T10:01:21.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.326+0000 7f0b11400640 1 --2- 172.21.15.57:0/1374660780 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b14161a60 0x7f0b140cbd90 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f0afc00cb40 tx=0x7f0afc00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:21.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.326+0000 7f0b0a000640 1 -- 172.21.15.57:0/1374660780 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0afc017070 con 0x7f0b14161a60 2024-03-27T10:01:21.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.326+0000 7f0b0a000640 1 -- 172.21.15.57:0/1374660780 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0afc00aca0 con 0x7f0b14161a60 2024-03-27T10:01:21.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.326+0000 7f0b0a000640 1 -- 172.21.15.57:0/1374660780 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0afc012620 con 0x7f0b14161a60 2024-03-27T10:01:21.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.326+0000 7f0b13200640 1 -- 172.21.15.57:0/1374660780 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b140c92b0 con 0x7f0b14161a60 2024-03-27T10:01:21.316 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.326+0000 7f0b13200640 1 -- 172.21.15.57:0/1374660780 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b140c9b50 con 0x7f0b14161a60 2024-03-27T10:01:21.317 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.327+0000 7f0b13200640 1 -- 172.21.15.57:0/1374660780 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b140c9480 con 0x7f0b14161a60 2024-03-27T10:01:21.317 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.328+0000 7f0b0a000640 1 -- 172.21.15.57:0/1374660780 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f0afc01a070 con 0x7f0b14161a60 2024-03-27T10:01:21.318 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.330+0000 7f0b0a000640 1 --2- 172.21.15.57:0/1374660780 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f0af006c530 0x7f0af006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:21.318 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.330+0000 7f0b0a000640 1 -- 172.21.15.57:0/1374660780 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5249+0+0 (secure 0 0 0) 0x7f0afc08b440 con 0x7f0b14161a60 2024-03-27T10:01:21.319 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.330+0000 7f0b11e00640 1 --2- 172.21.15.57:0/1374660780 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f0af006c530 0x7f0af006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:21.319 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.331+0000 7f0b11e00640 1 --2- 172.21.15.57:0/1374660780 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f0af006c530 0x7f0af006e9f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f0b0400a830 tx=0x7f0b04008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:21.324 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.335+0000 7f0b0a000640 1 -- 172.21.15.57:0/1374660780 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f0afc059b80 con 0x7f0b14161a60 2024-03-27T10:01:21.532 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.543+0000 7f0b13200640 1 -- 172.21.15.57:0/1374660780 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f0b14068540 con 0x7f0b14161a60 2024-03-27T10:01:21.533 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.544+0000 7f0b0a000640 1 -- 172.21.15.57:0/1374660780 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v36) ==== 84+0+65 (secure 0 0 0) 0x7f0afc059480 con 0x7f0b14161a60 2024-03-27T10:01:21.533 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:01:21.533 INFO:teuthology.orchestra.run.smithi057.stdout:[ 2024-03-27T10:01:21.533 INFO:teuthology.orchestra.run.smithi057.stdout: { 2024-03-27T10:01:21.533 INFO:teuthology.orchestra.run.smithi057.stdout: "poolnum": 1, 2024-03-27T10:01:21.533 INFO:teuthology.orchestra.run.smithi057.stdout: "poolname": ".mgr" 2024-03-27T10:01:21.533 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-03-27T10:01:21.534 INFO:teuthology.orchestra.run.smithi057.stdout:] 2024-03-27T10:01:21.536 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.546+0000 7f0b13200640 1 -- 172.21.15.57:0/1374660780 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f0af006c530 msgr2=0x7f0af006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:21.536 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.546+0000 7f0b13200640 1 --2- 172.21.15.57:0/1374660780 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f0af006c530 0x7f0af006e9f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f0b0400a830 tx=0x7f0b04008040 comp rx=0 tx=0).stop 2024-03-27T10:01:21.536 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.546+0000 7f0b13200640 1 -- 172.21.15.57:0/1374660780 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b14161a60 msgr2=0x7f0b140cbd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:21.536 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.546+0000 7f0b13200640 1 --2- 172.21.15.57:0/1374660780 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b14161a60 0x7f0b140cbd90 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f0afc00cb40 tx=0x7f0afc00a060 comp rx=0 tx=0).stop 2024-03-27T10:01:21.536 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.547+0000 7f0b13200640 1 -- 172.21.15.57:0/1374660780 shutdown_connections 2024-03-27T10:01:21.537 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.547+0000 7f0b13200640 1 --2- 172.21.15.57:0/1374660780 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f0af006c530 0x7f0af006e9f0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:21.537 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.547+0000 7f0b13200640 1 --2- 172.21.15.57:0/1374660780 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b140cdaf0 0x7f0b14151bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:21.537 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.547+0000 7f0b13200640 1 --2- 172.21.15.57:0/1374660780 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b14161a60 0x7f0b140cbd90 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:21.537 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.547+0000 7f0b13200640 1 --2- 172.21.15.57:0/1374660780 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0b140d2c20 0x7f0b140c8940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:21.537 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.547+0000 7f0b13200640 1 -- 172.21.15.57:0/1374660780 >> 172.21.15.57:0/1374660780 conn(0x7f0b140d3f30 msgr2=0x7f0b1406c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:21.537 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.547+0000 7f0b13200640 1 -- 172.21.15.57:0/1374660780 shutdown_connections 2024-03-27T10:01:21.537 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.547+0000 7f0b13200640 1 -- 172.21.15.57:0/1374660780 wait complete. 2024-03-27T10:01:21.555 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-03-27T10:01:21.555 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-03-27T10:01:21.783 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.794+0000 7f30b5200640 1 Processor -- start 2024-03-27T10:01:21.783 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.794+0000 7f30b5200640 1 -- start start 2024-03-27T10:01:21.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.796+0000 7f30b5200640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f30b01459d0 0x7f30b00ce420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:21.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.796+0000 7f30b5200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f30b006dff0 0x7f30b0165bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:21.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.796+0000 7f30b5200640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30b00cea90 con 0x7f30b00cc890 2024-03-27T10:01:21.785 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.796+0000 7f30b5200640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f30b00ced70 con 0x7f30b01459d0 2024-03-27T10:01:21.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.796+0000 7f30b5200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f30b00cf050 con 0x7f30b006dff0 2024-03-27T10:01:21.786 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.797+0000 7f30afe00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f30b006dff0 0x7f30b0165bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:21.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.797+0000 7f30afe00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f30b006dff0 0x7f30b0165bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.57:36472/0 (socket says 172.21.15.57:36472) 2024-03-27T10:01:21.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.797+0000 7f30afe00640 1 -- 172.21.15.57:0/2703072326 learned_addr learned my addr 172.21.15.57:0/2703072326 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:01:21.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.797+0000 7f30af400640 1 --2- 172.21.15.57:0/2703072326 >> v2:172.21.15.118:3300/0 conn(0x7f30b01459d0 0x7f30b00ce420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:21.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.798+0000 7f30afe00640 1 -- 172.21.15.57:0/2703072326 >> v2:172.21.15.118:3300/0 conn(0x7f30b01459d0 msgr2=0x7f30b00ce420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:01:21.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.798+0000 7f30afe00640 1 --2- 172.21.15.57:0/2703072326 >> v2:172.21.15.118:3300/0 conn(0x7f30b01459d0 0x7f30b00ce420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:21.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.798+0000 7f30afe00640 1 -- 172.21.15.57:0/2703072326 >> v1:172.21.15.118:6789/0 conn(0x7f30b00cc890 legacy=0x7f30b015c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:21.787 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.798+0000 7f30afe00640 1 -- 172.21.15.57:0/2703072326 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30b00cf330 con 0x7f30b006dff0 2024-03-27T10:01:21.788 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.799+0000 7f30afe00640 1 --2- 172.21.15.57:0/2703072326 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f30b006dff0 0x7f30b0165bf0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f30a8009e50 tx=0x7f30a802be40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=48bd316fd6fda9f0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:21.788 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.800+0000 7f30ae000640 1 -- 172.21.15.57:0/2703072326 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a802c9e0 con 0x7f30b006dff0 2024-03-27T10:01:21.788 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.800+0000 7f30ae000640 1 -- 172.21.15.57:0/2703072326 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30a802cb80 con 0x7f30b006dff0 2024-03-27T10:01:21.789 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.800+0000 7f30ae000640 1 -- 172.21.15.57:0/2703072326 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a80343f0 con 0x7f30b006dff0 2024-03-27T10:01:21.789 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.800+0000 7f30b5200640 1 -- 172.21.15.57:0/2703072326 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f30b006dff0 msgr2=0x7f30b0165bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:21.789 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.800+0000 7f30b5200640 1 --2- 172.21.15.57:0/2703072326 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f30b006dff0 0x7f30b0165bf0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f30a8009e50 tx=0x7f30a802be40 comp rx=0 tx=0).stop 2024-03-27T10:01:21.789 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.800+0000 7f30b5200640 1 -- 172.21.15.57:0/2703072326 shutdown_connections 2024-03-27T10:01:21.790 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.800+0000 7f30b5200640 1 --2- 172.21.15.57:0/2703072326 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f30b006dff0 0x7f30b0165bf0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:21.790 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.800+0000 7f30b5200640 1 --2- 172.21.15.57:0/2703072326 >> v2:172.21.15.118:3300/0 conn(0x7f30b01459d0 0x7f30b00ce420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:21.790 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.800+0000 7f30b5200640 1 -- 172.21.15.57:0/2703072326 >> 172.21.15.57:0/2703072326 conn(0x7f30b006b540 msgr2=0x7f30b006b950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:21.790 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.800+0000 7f30b5200640 1 -- 172.21.15.57:0/2703072326 shutdown_connections 2024-03-27T10:01:21.790 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.800+0000 7f30b5200640 1 -- 172.21.15.57:0/2703072326 wait complete. 2024-03-27T10:01:21.791 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.802+0000 7f30b5200640 1 Processor -- start 2024-03-27T10:01:21.791 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.802+0000 7f30b5200640 1 -- start start 2024-03-27T10:01:21.793 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.803+0000 7f30b5200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f30b006dff0 0x7f30b01f4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:21.793 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.803+0000 7f30b5200640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f30b00cc890 0x7f30b00c5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:21.793 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.804+0000 7f30b5200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f30b01459d0 0x7f30b01f4910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:21.793 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.804+0000 7f30b5200640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f30b015ce50 con 0x7f30b00cc890 2024-03-27T10:01:21.793 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.804+0000 7f30b5200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f30b015ccd0 con 0x7f30b006dff0 2024-03-27T10:01:21.793 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.804+0000 7f30b5200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f30b015cfd0 con 0x7f30b01459d0 2024-03-27T10:01:21.793 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.804+0000 7f30aea00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f30b00cc890 0x7f30b00c5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:21.793 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.804+0000 7f30aea00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f30b00cc890 0x7f30b00c5a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:58866/0 (socket says 172.21.15.57:58866) 2024-03-27T10:01:21.793 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.804+0000 7f30aea00640 1 -- 172.21.15.57:0/3300450281 learned_addr learned my addr 172.21.15.57:0/3300450281 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:01:21.794 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.804+0000 7f30afe00640 1 --2- 172.21.15.57:0/3300450281 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f30b01459d0 0x7f30b01f4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:21.795 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.804+0000 7f30af400640 1 --2- 172.21.15.57:0/3300450281 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f30b006dff0 0x7f30b01f4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:21.795 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.804+0000 7f30aea00640 1 -- 172.21.15.57:0/3300450281 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f30b01459d0 msgr2=0x7f30b01f4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:21.795 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.804+0000 7f30aea00640 1 --2- 172.21.15.57:0/3300450281 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f30b01459d0 0x7f30b01f4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:21.795 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.804+0000 7f30aea00640 1 -- 172.21.15.57:0/3300450281 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f30b006dff0 msgr2=0x7f30b01f4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:21.795 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.804+0000 7f30aea00640 1 --2- 172.21.15.57:0/3300450281 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f30b006dff0 0x7f30b01f4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:21.795 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.805+0000 7f30aea00640 1 -- 172.21.15.57:0/3300450281 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30b00c6170 con 0x7f30b00cc890 2024-03-27T10:01:21.795 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.805+0000 7f30aea00640 1 --2- 172.21.15.57:0/3300450281 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f30b00cc890 0x7f30b00c5a60 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f309800c400 tx=0x7f309800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:21.795 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.805+0000 7f30a7400640 1 -- 172.21.15.57:0/3300450281 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30980052d0 con 0x7f30b00cc890 2024-03-27T10:01:21.795 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.805+0000 7f30a7400640 1 -- 172.21.15.57:0/3300450281 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3098005490 con 0x7f30b00cc890 2024-03-27T10:01:21.795 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.805+0000 7f30a7400640 1 -- 172.21.15.57:0/3300450281 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3098007260 con 0x7f30b00cc890 2024-03-27T10:01:21.795 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.805+0000 7f30b5200640 1 -- 172.21.15.57:0/3300450281 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30b00c6450 con 0x7f30b00cc890 2024-03-27T10:01:21.795 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.805+0000 7f30b5200640 1 -- 172.21.15.57:0/3300450281 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30b00b2b40 con 0x7f30b00cc890 2024-03-27T10:01:21.796 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.806+0000 7f30b5200640 1 -- 172.21.15.57:0/3300450281 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30b00b2680 con 0x7f30b00cc890 2024-03-27T10:01:21.796 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.808+0000 7f30a7400640 1 -- 172.21.15.57:0/3300450281 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f3098007400 con 0x7f30b00cc890 2024-03-27T10:01:21.797 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.809+0000 7f30a7400640 1 --2- 172.21.15.57:0/3300450281 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f308c06c560 0x7f308c06ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:21.798 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.809+0000 7f30a7400640 1 -- 172.21.15.57:0/3300450281 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5249+0+0 (secure 0 0 0) 0x7f309808aaf0 con 0x7f30b00cc890 2024-03-27T10:01:21.798 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.809+0000 7f30af400640 1 --2- 172.21.15.57:0/3300450281 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f308c06c560 0x7f308c06ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:21.798 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.810+0000 7f30af400640 1 --2- 172.21.15.57:0/3300450281 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f308c06c560 0x7f308c06ea20 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f30b015c110 tx=0x7f30a0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:21.802 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:21.813+0000 7f30a7400640 1 -- 172.21.15.57:0/3300450281 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f30b00b2680 con 0x7f30b00cc890 2024-03-27T10:01:22.007 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:22.018+0000 7f30b5200640 1 -- 172.21.15.57:0/3300450281 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f30b0068540 con 0x7f30b00cc890 2024-03-27T10:01:22.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:22.374+0000 7f30a7400640 1 -- 172.21.15.57:0/3300450281 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v37) ==== 138+0+0 (secure 0 0 0) 0x7f3098059230 con 0x7f30b00cc890 2024-03-27T10:01:22.364 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_metadata' created 2024-03-27T10:01:22.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:22.379+0000 7f30b5200640 1 -- 172.21.15.57:0/3300450281 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f308c06c560 msgr2=0x7f308c06ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:22.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:22.379+0000 7f30b5200640 1 --2- 172.21.15.57:0/3300450281 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f308c06c560 0x7f308c06ea20 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f30b015c110 tx=0x7f30a0008040 comp rx=0 tx=0).stop 2024-03-27T10:01:22.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:22.379+0000 7f30b5200640 1 -- 172.21.15.57:0/3300450281 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f30b00cc890 msgr2=0x7f30b00c5a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:22.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:22.379+0000 7f30b5200640 1 --2- 172.21.15.57:0/3300450281 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f30b00cc890 0x7f30b00c5a60 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f309800c400 tx=0x7f309800c8c0 comp rx=0 tx=0).stop 2024-03-27T10:01:22.369 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:22.380+0000 7f30b5200640 1 -- 172.21.15.57:0/3300450281 shutdown_connections 2024-03-27T10:01:22.369 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:22.380+0000 7f30b5200640 1 --2- 172.21.15.57:0/3300450281 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f30b01459d0 0x7f30b01f4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:22.369 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:22.380+0000 7f30b5200640 1 --2- 172.21.15.57:0/3300450281 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f30b00cc890 0x7f30b00c5a60 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:22.369 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:22.380+0000 7f30b5200640 1 --2- 172.21.15.57:0/3300450281 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f308c06c560 0x7f308c06ea20 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:22.369 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:22.380+0000 7f30b5200640 1 --2- 172.21.15.57:0/3300450281 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f30b006dff0 0x7f30b01f4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:22.369 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:22.380+0000 7f30b5200640 1 -- 172.21.15.57:0/3300450281 >> 172.21.15.57:0/3300450281 conn(0x7f30b006b540 msgr2=0x7f30b00cbc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:22.372 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:22.383+0000 7f30b5200640 1 -- 172.21.15.57:0/3300450281 shutdown_connections 2024-03-27T10:01:22.372 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:22.383+0000 7f30b5200640 1 -- 172.21.15.57:0/3300450281 wait complete. 2024-03-27T10:01:22.400 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-03-27T10:01:22.617 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:22.628+0000 7f0f58e00640 1 Processor -- start 2024-03-27T10:01:22.617 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:22.628+0000 7f0f58e00640 1 -- start start 2024-03-27T10:01:22.619 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:22.630+0000 7f0f58e00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0f54145870 0x7f0f54071090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:22.620 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:22.630+0000 7f0f58e00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f0f540715d0 0x7f0f5415fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:22.620 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:22.630+0000 7f0f58e00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f540cac60 con 0x7f0f5415ff90 2024-03-27T10:01:22.620 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:22.630+0000 7f0f58e00640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f0f540cbcc0 con 0x7f0f54145870 2024-03-27T10:01:22.620 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:22.630+0000 7f0f58e00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f0f541603e0 con 0x7f0f540715d0 2024-03-27T10:01:22.620 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:22.631+0000 7f0f53400640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0f54145870 0x7f0f54071090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:22.620 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:22.631+0000 7f0f53400640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f0f54145870 0x7f0f54071090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56066/0 (socket says 172.21.15.57:56066) 2024-03-27T10:01:22.620 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:22.631+0000 7f0f53400640 1 -- 172.21.15.57:0/1213510813 learned_addr learned my addr 172.21.15.57:0/1213510813 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:01:22.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:22.631+0000 7f0f52a00640 1 --2- 172.21.15.57:0/1213510813 >> v2:172.21.15.118:3300/0 conn(0x7f0f540715d0 0x7f0f5415fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:22.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:22.631+0000 7f0f53400640 1 -- 172.21.15.57:0/1213510813 >> v2:172.21.15.118:3300/0 conn(0x7f0f540715d0 msgr2=0x7f0f5415fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:01:22.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:22.631+0000 7f0f53400640 1 --2- 172.21.15.57:0/1213510813 >> v2:172.21.15.118:3300/0 conn(0x7f0f540715d0 0x7f0f5415fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:22.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:22.631+0000 7f0f53400640 1 -- 172.21.15.57:0/1213510813 >> v1:172.21.15.118:6789/0 conn(0x7f0f5415ff90 legacy=0x7f0f5415c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:22.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:22.632+0000 7f0f53400640 1 -- 172.21.15.57:0/1213510813 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f540caf00 con 0x7f0f54145870 2024-03-27T10:01:22.621 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:22.632+0000 7f0f52a00640 1 --2- 172.21.15.57:0/1213510813 >> v2:172.21.15.118:3300/0 conn(0x7f0f540715d0 0x7f0f5415fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T10:01:22.622 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:22.633+0000 7f0f53400640 1 --2- 172.21.15.57:0/1213510813 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0f54145870 0x7f0f54071090 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f0f54075250 tx=0x7f0f4402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fda669357a1803d server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:22.622 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:22.634+0000 7f0f52000640 1 -- 172.21.15.57:0/1213510813 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f44035020 con 0x7f0f54145870 2024-03-27T10:01:22.622 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:22.634+0000 7f0f52000640 1 -- 172.21.15.57:0/1213510813 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f44031870 con 0x7f0f54145870 2024-03-27T10:01:22.623 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:22.634+0000 7f0f52000640 1 -- 172.21.15.57:0/1213510813 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f44031c40 con 0x7f0f54145870 2024-03-27T10:01:22.623 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:22.634+0000 7f0f58e00640 1 -- 172.21.15.57:0/1213510813 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0f54145870 msgr2=0x7f0f54071090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:22.623 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:22.634+0000 7f0f58e00640 1 --2- 172.21.15.57:0/1213510813 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0f54145870 0x7f0f54071090 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f0f54075250 tx=0x7f0f4402b910 comp rx=0 tx=0).stop 2024-03-27T10:01:22.623 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:22.634+0000 7f0f58e00640 1 -- 172.21.15.57:0/1213510813 shutdown_connections 2024-03-27T10:01:22.624 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:22.634+0000 7f0f58e00640 1 --2- 172.21.15.57:0/1213510813 >> v2:172.21.15.118:3300/0 conn(0x7f0f540715d0 0x7f0f5415fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:22.624 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:22.634+0000 7f0f58e00640 1 --2- 172.21.15.57:0/1213510813 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0f54145870 0x7f0f54071090 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:22.624 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:22.634+0000 7f0f58e00640 1 -- 172.21.15.57:0/1213510813 >> 172.21.15.57:0/1213510813 conn(0x7f0f540cfb60 msgr2=0x7f0f540cff40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:22.624 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:22.634+0000 7f0f58e00640 1 -- 172.21.15.57:0/1213510813 shutdown_connections 2024-03-27T10:01:22.624 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:22.634+0000 7f0f58e00640 1 -- 172.21.15.57:0/1213510813 wait complete. 2024-03-27T10:01:22.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:22.636+0000 7f0f58e00640 1 Processor -- start 2024-03-27T10:01:22.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:22.636+0000 7f0f58e00640 1 -- start start 2024-03-27T10:01:22.627 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:22.637+0000 7f0f58e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0f540715d0 0x7f0f540c9790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:22.628 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:22.637+0000 7f0f58e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0f54145870 0x7f0f5415ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:22.628 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:22.637+0000 7f0f58e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0f5415ff90 0x7f0f540c75b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:22.628 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:22.637+0000 7f0f58e00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f0f540cb7a0 con 0x7f0f54145870 2024-03-27T10:01:22.628 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:22.637+0000 7f0f58e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f0f540cb4c0 con 0x7f0f540715d0 2024-03-27T10:01:22.628 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:22.637+0000 7f0f58e00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f0f540ce740 con 0x7f0f5415ff90 2024-03-27T10:01:22.628 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:22.638+0000 7f0f52a00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0f54145870 0x7f0f5415ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:22.628 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:22.638+0000 7f0f52a00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0f54145870 0x7f0f5415ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56078/0 (socket says 172.21.15.57:56078) 2024-03-27T10:01:22.628 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:22.638+0000 7f0f52a00640 1 -- 172.21.15.57:0/2765891281 learned_addr learned my addr 172.21.15.57:0/2765891281 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:01:22.628 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:22.638+0000 7f0f53400640 1 --2- 172.21.15.57:0/2765891281 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0f540715d0 0x7f0f540c9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:22.628 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:22.638+0000 7f0f53e00640 1 --2- 172.21.15.57:0/2765891281 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0f5415ff90 0x7f0f540c75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:22.628 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:22.638+0000 7f0f52a00640 1 -- 172.21.15.57:0/2765891281 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0f5415ff90 msgr2=0x7f0f540c75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:22.628 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:22.638+0000 7f0f52a00640 1 --2- 172.21.15.57:0/2765891281 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0f5415ff90 0x7f0f540c75b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:22.628 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:22.638+0000 7f0f52a00640 1 -- 172.21.15.57:0/2765891281 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0f540715d0 msgr2=0x7f0f540c9790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:22.629 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:22.638+0000 7f0f52a00640 1 --2- 172.21.15.57:0/2765891281 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0f540715d0 0x7f0f540c9790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:22.629 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:22.638+0000 7f0f52a00640 1 -- 172.21.15.57:0/2765891281 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f540c7af0 con 0x7f0f54145870 2024-03-27T10:01:22.629 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:22.638+0000 7f0f53e00640 1 --2- 172.21.15.57:0/2765891281 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0f5415ff90 0x7f0f540c75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T10:01:22.629 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:22.638+0000 7f0f52a00640 1 --2- 172.21.15.57:0/2765891281 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0f54145870 0x7f0f5415ed60 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f0f4000c820 tx=0x7f0f4000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:22.629 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:22.639+0000 7f0f4b400640 1 -- 172.21.15.57:0/2765891281 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f40015070 con 0x7f0f54145870 2024-03-27T10:01:22.629 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:22.639+0000 7f0f4b400640 1 -- 172.21.15.57:0/2765891281 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f40007a30 con 0x7f0f54145870 2024-03-27T10:01:22.629 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:22.639+0000 7f0f58e00640 1 -- 172.21.15.57:0/2765891281 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f5415dfa0 con 0x7f0f54145870 2024-03-27T10:01:22.629 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:22.639+0000 7f0f4b400640 1 -- 172.21.15.57:0/2765891281 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f40007e00 con 0x7f0f54145870 2024-03-27T10:01:22.629 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:22.639+0000 7f0f58e00640 1 -- 172.21.15.57:0/2765891281 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f5415e560 con 0x7f0f54145870 2024-03-27T10:01:22.629 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:22.640+0000 7f0f58e00640 1 -- 172.21.15.57:0/2765891281 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f54068540 con 0x7f0f54145870 2024-03-27T10:01:22.630 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:22.641+0000 7f0f4b400640 1 -- 172.21.15.57:0/2765891281 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f0f40018070 con 0x7f0f54145870 2024-03-27T10:01:22.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:22.642+0000 7f0f4b400640 1 --2- 172.21.15.57:0/2765891281 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f0f3406c530 0x7f0f3406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:22.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:22.642+0000 7f0f4b400640 1 -- 172.21.15.57:0/2765891281 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 5619+0+0 (secure 0 0 0) 0x7f0f4008b5d0 con 0x7f0f54145870 2024-03-27T10:01:22.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:22.642+0000 7f0f53400640 1 --2- 172.21.15.57:0/2765891281 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f0f3406c530 0x7f0f3406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:22.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:22.643+0000 7f0f53400640 1 --2- 172.21.15.57:0/2765891281 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f0f3406c530 0x7f0f3406e9f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f0f44036000 tx=0x7f0f4403c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:22.636 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:22.647+0000 7f0f4b400640 1 -- 172.21.15.57:0/2765891281 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f0f40059cd0 con 0x7f0f54145870 2024-03-27T10:01:22.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:22.851+0000 7f0f58e00640 1 -- 172.21.15.57:0/2765891281 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f0f540cf4b0 con 0x7f0f54145870 2024-03-27T10:01:23.379 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:23.389+0000 7f0f4b400640 1 -- 172.21.15.57:0/2765891281 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v38) ==== 170+0+0 (secure 0 0 0) 0x7f0f400595d0 con 0x7f0f54145870 2024-03-27T10:01:23.379 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_data' created 2024-03-27T10:01:23.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:23.393+0000 7f0f58e00640 1 -- 172.21.15.57:0/2765891281 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f0f3406c530 msgr2=0x7f0f3406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:23.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:23.393+0000 7f0f58e00640 1 --2- 172.21.15.57:0/2765891281 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f0f3406c530 0x7f0f3406e9f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f0f44036000 tx=0x7f0f4403c040 comp rx=0 tx=0).stop 2024-03-27T10:01:23.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:23.393+0000 7f0f58e00640 1 -- 172.21.15.57:0/2765891281 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0f54145870 msgr2=0x7f0f5415ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:23.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:23.393+0000 7f0f58e00640 1 --2- 172.21.15.57:0/2765891281 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0f54145870 0x7f0f5415ed60 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f0f4000c820 tx=0x7f0f4000cc20 comp rx=0 tx=0).stop 2024-03-27T10:01:23.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:23.394+0000 7f0f58e00640 1 -- 172.21.15.57:0/2765891281 shutdown_connections 2024-03-27T10:01:23.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:23.394+0000 7f0f58e00640 1 --2- 172.21.15.57:0/2765891281 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0f5415ff90 0x7f0f540c75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:23.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:23.394+0000 7f0f58e00640 1 --2- 172.21.15.57:0/2765891281 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0f54145870 0x7f0f5415ed60 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:23.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:23.394+0000 7f0f58e00640 1 --2- 172.21.15.57:0/2765891281 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f0f3406c530 0x7f0f3406e9f0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:23.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:23.394+0000 7f0f58e00640 1 --2- 172.21.15.57:0/2765891281 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0f540715d0 0x7f0f540c9790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:23.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:23.394+0000 7f0f58e00640 1 -- 172.21.15.57:0/2765891281 >> 172.21.15.57:0/2765891281 conn(0x7f0f540cfb60 msgr2=0x7f0f540af5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:23.384 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:23.394+0000 7f0f58e00640 1 -- 172.21.15.57:0/2765891281 shutdown_connections 2024-03-27T10:01:23.384 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:23.395+0000 7f0f58e00640 1 -- 172.21.15.57:0/2765891281 wait complete. 2024-03-27T10:01:23.416 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-03-27T10:01:23.606 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:23.617+0000 7f0288600640 1 Processor -- start 2024-03-27T10:01:23.606 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:23.617+0000 7f0288600640 1 -- start start 2024-03-27T10:01:23.608 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:23.619+0000 7f0288600640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f028015e9e0 0x7f02800d16c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:23.608 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:23.619+0000 7f0288600640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f02800ce790 0x7f02800cec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:23.608 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:23.619+0000 7f0288600640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f028006dc10 con 0x7f028015e600 2024-03-27T10:01:23.608 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:23.619+0000 7f0288600640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f02800d1230 con 0x7f02800ce790 2024-03-27T10:01:23.609 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:23.619+0000 7f0288600640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f02800d0380 con 0x7f028015e9e0 2024-03-27T10:01:23.609 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:23.619+0000 7f0286600640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f02800ce790 0x7f02800cec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:23.609 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:23.620+0000 7f0286600640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f02800ce790 0x7f02800cec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56092/0 (socket says 172.21.15.57:56092) 2024-03-27T10:01:23.609 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:23.620+0000 7f0286600640 1 -- 172.21.15.57:0/3787859353 learned_addr learned my addr 172.21.15.57:0/3787859353 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:01:23.609 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:23.620+0000 7f0285200640 1 --2- 172.21.15.57:0/3787859353 >> v2:172.21.15.118:3300/0 conn(0x7f028015e9e0 0x7f02800d16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:23.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:23.620+0000 7f0286600640 1 -- 172.21.15.57:0/3787859353 >> v2:172.21.15.118:3300/0 conn(0x7f028015e9e0 msgr2=0x7f02800d16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:01:23.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:23.620+0000 7f0286600640 1 --2- 172.21.15.57:0/3787859353 >> v2:172.21.15.118:3300/0 conn(0x7f028015e9e0 0x7f02800d16c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:23.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:23.620+0000 7f0286600640 1 -- 172.21.15.57:0/3787859353 >> v1:172.21.15.118:6789/0 conn(0x7f028015e600 legacy=0x7f028006d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:01:23.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:23.620+0000 7f0286600640 1 -- 172.21.15.57:0/3787859353 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02800d0620 con 0x7f02800ce790 2024-03-27T10:01:23.610 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:23.620+0000 7f0285200640 1 --2- 172.21.15.57:0/3787859353 >> v2:172.21.15.118:3300/0 conn(0x7f028015e9e0 0x7f02800d16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T10:01:23.611 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:23.621+0000 7f0286600640 1 --2- 172.21.15.57:0/3787859353 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f02800ce790 0x7f02800cec40 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f0278009870 tx=0x7f027802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=851c69b684514656 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:23.611 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:23.621+0000 7f027fe00640 1 -- 172.21.15.57:0/3787859353 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0278035020 con 0x7f02800ce790 2024-03-27T10:01:23.611 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:23.622+0000 7f027fe00640 1 -- 172.21.15.57:0/3787859353 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0278031870 con 0x7f02800ce790 2024-03-27T10:01:23.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:23.622+0000 7f027fe00640 1 -- 172.21.15.57:0/3787859353 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0278031c40 con 0x7f02800ce790 2024-03-27T10:01:23.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:23.622+0000 7f0288600640 1 -- 172.21.15.57:0/3787859353 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f02800ce790 msgr2=0x7f02800cec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:23.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:23.622+0000 7f0288600640 1 --2- 172.21.15.57:0/3787859353 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f02800ce790 0x7f02800cec40 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f0278009870 tx=0x7f027802b910 comp rx=0 tx=0).stop 2024-03-27T10:01:23.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:23.622+0000 7f0288600640 1 -- 172.21.15.57:0/3787859353 shutdown_connections 2024-03-27T10:01:23.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:23.622+0000 7f0288600640 1 --2- 172.21.15.57:0/3787859353 >> v2:172.21.15.118:3300/0 conn(0x7f028015e9e0 0x7f02800d16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:23.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:23.622+0000 7f0288600640 1 --2- 172.21.15.57:0/3787859353 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f02800ce790 0x7f02800cec40 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:23.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:23.622+0000 7f0288600640 1 -- 172.21.15.57:0/3787859353 >> 172.21.15.57:0/3787859353 conn(0x7f02800d1f10 msgr2=0x7f02800d2320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:23.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:23.622+0000 7f0288600640 1 -- 172.21.15.57:0/3787859353 shutdown_connections 2024-03-27T10:01:23.612 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:23.622+0000 7f0288600640 1 -- 172.21.15.57:0/3787859353 wait complete. 2024-03-27T10:01:23.613 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:23.624+0000 7f0288600640 1 Processor -- start 2024-03-27T10:01:23.613 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:23.624+0000 7f0288600640 1 -- start start 2024-03-27T10:01:23.615 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:23.625+0000 7f0288600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02800ce790 0x7f028014c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:23.615 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:23.625+0000 7f0288600640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f028015e600 0x7f02800b6360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:23.615 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:23.625+0000 7f0288600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f028015e9e0 0x7f02800c5a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:23.615 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:23.625+0000 7f0288600640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f02800d0ec0 con 0x7f028015e600 2024-03-27T10:01:23.615 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:23.625+0000 7f0288600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f02800d0be0 con 0x7f02800ce790 2024-03-27T10:01:23.616 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:23.625+0000 7f0288600640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f02800b35b0 con 0x7f028015e9e0 2024-03-27T10:01:23.616 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:23.626+0000 7f0285200640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f028015e600 0x7f02800b6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:23.616 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:23.626+0000 7f0285200640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f028015e600 0x7f02800b6360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56096/0 (socket says 172.21.15.57:56096) 2024-03-27T10:01:23.616 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:23.626+0000 7f0285200640 1 -- 172.21.15.57:0/3834914525 learned_addr learned my addr 172.21.15.57:0/3834914525 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:01:23.616 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:23.626+0000 7f0285c00640 1 --2- 172.21.15.57:0/3834914525 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02800ce790 0x7f028014c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:23.616 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:23.626+0000 7f0286600640 1 --2- 172.21.15.57:0/3834914525 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f028015e9e0 0x7f02800c5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:23.616 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:23.626+0000 7f0285200640 1 -- 172.21.15.57:0/3834914525 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f028015e9e0 msgr2=0x7f02800c5a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:23.616 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:23.626+0000 7f0285200640 1 --2- 172.21.15.57:0/3834914525 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f028015e9e0 0x7f02800c5a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:23.616 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:23.626+0000 7f0285200640 1 -- 172.21.15.57:0/3834914525 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02800ce790 msgr2=0x7f028014c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:23.616 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:23.626+0000 7f0285200640 1 --2- 172.21.15.57:0/3834914525 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02800ce790 0x7f028014c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:23.616 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:23.626+0000 7f0285200640 1 -- 172.21.15.57:0/3834914525 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02800c9c30 con 0x7f028015e600 2024-03-27T10:01:23.617 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:23.627+0000 7f0285200640 1 --2- 172.21.15.57:0/3834914525 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f028015e600 0x7f02800b6360 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f026c00c7f0 tx=0x7f026c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:23.617 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:23.627+0000 7f027d600640 1 -- 172.21.15.57:0/3834914525 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f026c015070 con 0x7f028015e600 2024-03-27T10:01:23.617 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:23.627+0000 7f027d600640 1 -- 172.21.15.57:0/3834914525 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f026c007820 con 0x7f028015e600 2024-03-27T10:01:23.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:23.627+0000 7f027d600640 1 -- 172.21.15.57:0/3834914525 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f026c007c10 con 0x7f028015e600 2024-03-27T10:01:23.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:23.627+0000 7f0288600640 1 -- 172.21.15.57:0/3834914525 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02800c9f10 con 0x7f028015e600 2024-03-27T10:01:23.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:23.627+0000 7f0288600640 1 -- 172.21.15.57:0/3834914525 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02800ca4d0 con 0x7f028015e600 2024-03-27T10:01:23.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:23.628+0000 7f0288600640 1 -- 172.21.15.57:0/3834914525 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02800cd340 con 0x7f028015e600 2024-03-27T10:01:23.618 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:23.629+0000 7f027d600640 1 -- 172.21.15.57:0/3834914525 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f026c018070 con 0x7f028015e600 2024-03-27T10:01:23.619 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:23.630+0000 7f027d600640 1 --2- 172.21.15.57:0/3834914525 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f026006c530 0x7f026006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:23.619 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:23.630+0000 7f027d600640 1 -- 172.21.15.57:0/3834914525 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6001+0+0 (secure 0 0 0) 0x7f026c08b650 con 0x7f028015e600 2024-03-27T10:01:23.619 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:23.631+0000 7f0285c00640 1 --2- 172.21.15.57:0/3834914525 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f026006c530 0x7f026006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:23.620 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:23.631+0000 7f0285c00640 1 --2- 172.21.15.57:0/3834914525 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f026006c530 0x7f026006e9f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0274009f20 tx=0x7f02740094d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:23.624 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:23.636+0000 7f027d600640 1 -- 172.21.15.57:0/3834914525 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f02800cd340 con 0x7f028015e600 2024-03-27T10:01:23.872 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:23.883+0000 7f0288600640 1 -- 172.21.15.57:0/3834914525 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f02800cdf10 con 0x7f028015e600 2024-03-27T10:01:24.415 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:24.426+0000 7f027d600640 1 -- 172.21.15.57:0/3834914525 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v14) ==== 172+0+0 (secure 0 0 0) 0x7f02800cdf10 con 0x7f028015e600 2024-03-27T10:01:24.415 INFO:teuthology.orchestra.run.smithi057.stderr:new fs with metadata pool 5 and data pool 6 2024-03-27T10:01:24.422 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:24.432+0000 7f0288600640 1 -- 172.21.15.57:0/3834914525 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f026006c530 msgr2=0x7f026006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:24.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:24.432+0000 7f0288600640 1 --2- 172.21.15.57:0/3834914525 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f026006c530 0x7f026006e9f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0274009f20 tx=0x7f02740094d0 comp rx=0 tx=0).stop 2024-03-27T10:01:24.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:24.432+0000 7f0288600640 1 -- 172.21.15.57:0/3834914525 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f028015e600 msgr2=0x7f02800b6360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:24.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:24.432+0000 7f0288600640 1 --2- 172.21.15.57:0/3834914525 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f028015e600 0x7f02800b6360 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f026c00c7f0 tx=0x7f026c00ccb0 comp rx=0 tx=0).stop 2024-03-27T10:01:24.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:24.433+0000 7f0288600640 1 -- 172.21.15.57:0/3834914525 shutdown_connections 2024-03-27T10:01:24.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:24.433+0000 7f0288600640 1 --2- 172.21.15.57:0/3834914525 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f028015e9e0 0x7f02800c5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:24.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:24.433+0000 7f0288600640 1 --2- 172.21.15.57:0/3834914525 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f028015e600 0x7f02800b6360 secure :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f026c00c7f0 tx=0x7f026c00ccb0 comp rx=0 tx=0).stop 2024-03-27T10:01:24.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:24.433+0000 7f0288600640 1 --2- 172.21.15.57:0/3834914525 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f026006c530 0x7f026006e9f0 secure :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0274009f20 tx=0x7f02740094d0 comp rx=0 tx=0).stop 2024-03-27T10:01:24.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:24.433+0000 7f0288600640 1 --2- 172.21.15.57:0/3834914525 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f02800ce790 0x7f028014c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:24.423 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:24.433+0000 7f0288600640 1 -- 172.21.15.57:0/3834914525 >> 172.21.15.57:0/3834914525 conn(0x7f02800d1f10 msgr2=0x7f02800cd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:24.424 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:24.434+0000 7f0288600640 1 -- 172.21.15.57:0/3834914525 shutdown_connections 2024-03-27T10:01:24.424 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:24.435+0000 7f0288600640 1 -- 172.21.15.57:0/3834914525 wait complete. 2024-03-27T10:01:24.459 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-27T10:01:24.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:24.654+0000 7f243f000640 1 Processor -- start 2024-03-27T10:01:24.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:24.654+0000 7f243f000640 1 -- start start 2024-03-27T10:01:24.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:24.656+0000 7f243f000640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f243806b7a0 0x7f243815f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:24.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:24.656+0000 7f243f000640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f243815eb00 con 0x7f243806bb80 2024-03-27T10:01:24.646 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:24.656+0000 7f243f000640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f243806dc70 con 0x7f24380cd330 2024-03-27T10:01:24.646 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:24.656+0000 7f243f000640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f243806df50 con 0x7f243806b7a0 2024-03-27T10:01:24.646 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:24.657+0000 7f242fe00640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f243806bb80 0x7f243806d1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:40342/0 (socket says 172.21.15.57:40342) 2024-03-27T10:01:24.646 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:24.657+0000 7f242fe00640 1 -- 172.21.15.57:0/736976485 learned_addr learned my addr 172.21.15.57:0/736976485 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T10:01:24.648 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:24.657+0000 7f2437e00640 1 --2- 172.21.15.57:0/736976485 >> v2:172.21.15.118:3300/0 conn(0x7f243806b7a0 0x7f243815f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:24.648 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:24.657+0000 7f2437400640 1 -- 172.21.15.57:0/736976485 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 595572785 0 0) 0x7f243815eb00 con 0x7f243806bb80 2024-03-27T10:01:24.648 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:24.657+0000 7f2437400640 1 -- 172.21.15.57:0/736976485 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f241c003520 con 0x7f243806bb80 2024-03-27T10:01:24.648 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:24.657+0000 7f2437400640 1 -- 172.21.15.57:0/736976485 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3860176589 0 0) 0x7f241c003520 con 0x7f243806bb80 2024-03-27T10:01:24.648 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:24.657+0000 7f2437400640 1 -- 172.21.15.57:0/736976485 >> v2:172.21.15.118:3300/0 conn(0x7f243806b7a0 msgr2=0x7f243815f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:01:24.648 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:24.657+0000 7f2437400640 1 --2- 172.21.15.57:0/736976485 >> v2:172.21.15.118:3300/0 conn(0x7f243806b7a0 0x7f243815f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:24.648 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:24.657+0000 7f2437400640 1 -- 172.21.15.57:0/736976485 >> v1:172.21.15.118:6789/0 conn(0x7f24380cd330 legacy=0x7f24380cd780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:24.648 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:24.657+0000 7f2437400640 1 -- 172.21.15.57:0/736976485 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f243815edc0 con 0x7f243806bb80 2024-03-27T10:01:24.648 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:24.657+0000 7f2437400640 1 -- 172.21.15.57:0/736976485 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4227751516 0 0) 0x7f2420001670 con 0x7f243806bb80 2024-03-27T10:01:24.649 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:24.658+0000 7f2437400640 1 -- 172.21.15.57:0/736976485 >> v1:172.21.15.57:6789/0 conn(0x7f243806bb80 legacy=0x7f243806d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:24.649 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:24.658+0000 7f2437400640 1 --2- 172.21.15.57:0/736976485 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f241c003a00 0x7f241c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:24.649 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:24.658+0000 7f2437400640 1 --2- 172.21.15.57:0/736976485 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f241c004800 0x7f241c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:24.649 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:24.658+0000 7f2437400640 1 --2- 172.21.15.57:0/736976485 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f241c005210 0x7f241c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:24.649 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:24.658+0000 7f2437400640 1 -- 172.21.15.57:0/736976485 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f243806df50 con 0x7f241c003a00 2024-03-27T10:01:24.649 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:24.658+0000 7f2437400640 1 -- 172.21.15.57:0/736976485 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f241c00c160 con 0x7f241c005210 2024-03-27T10:01:24.649 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:24.658+0000 7f2437400640 1 -- 172.21.15.57:0/736976485 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f241c00c360 con 0x7f241c004800 2024-03-27T10:01:24.649 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:24.658+0000 7f2437e00640 1 --2- 172.21.15.57:0/736976485 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f241c003a00 0x7f241c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:24.649 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:24.658+0000 7f242fe00640 1 --2- 172.21.15.57:0/736976485 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f241c004800 0x7f241c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:24.649 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:24.658+0000 7f243d000640 1 --2- 172.21.15.57:0/736976485 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f241c005210 0x7f241c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:24.649 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:24.658+0000 7f2437e00640 1 -- 172.21.15.57:0/736976485 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f241c004800 msgr2=0x7f241c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:01:24.649 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:24.658+0000 7f2437e00640 1 --2- 172.21.15.57:0/736976485 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f241c004800 0x7f241c004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:24.649 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:24.658+0000 7f2437e00640 1 -- 172.21.15.57:0/736976485 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f241c005210 msgr2=0x7f241c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:01:24.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:24.658+0000 7f2437e00640 1 --2- 172.21.15.57:0/736976485 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f241c005210 0x7f241c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:24.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:24.658+0000 7f2437e00640 1 -- 172.21.15.57:0/736976485 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f241c003520 con 0x7f241c003a00 2024-03-27T10:01:24.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:24.658+0000 7f243d000640 1 --2- 172.21.15.57:0/736976485 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f241c005210 0x7f241c00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T10:01:24.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:24.658+0000 7f243d000640 1 -- 172.21.15.57:0/736976485 reap_dead start 2024-03-27T10:01:24.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:24.659+0000 7f2437e00640 1 --2- 172.21.15.57:0/736976485 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f241c003a00 0x7f241c003e20 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f242800bd30 tx=0x7f241c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e1ab34ffd7a77b7 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:24.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:24.660+0000 7f2437400640 1 -- 172.21.15.57:0/736976485 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f242800b930 con 0x7f241c003a00 2024-03-27T10:01:24.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:24.660+0000 7f2437400640 1 -- 172.21.15.57:0/736976485 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2428030690 con 0x7f241c003a00 2024-03-27T10:01:24.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:24.660+0000 7f2437400640 1 -- 172.21.15.57:0/736976485 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2428030a60 con 0x7f241c003a00 2024-03-27T10:01:24.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:24.660+0000 7f243f000640 1 -- 172.21.15.57:0/736976485 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f241c003a00 msgr2=0x7f241c003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:24.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:24.660+0000 7f243f000640 1 --2- 172.21.15.57:0/736976485 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f241c003a00 0x7f241c003e20 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f242800bd30 tx=0x7f241c005830 comp rx=0 tx=0).stop 2024-03-27T10:01:24.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:24.661+0000 7f243f000640 1 -- 172.21.15.57:0/736976485 shutdown_connections 2024-03-27T10:01:24.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:24.661+0000 7f243f000640 1 --2- 172.21.15.57:0/736976485 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f241c003a00 0x7f241c003e20 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:24.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:24.661+0000 7f243f000640 1 -- 172.21.15.57:0/736976485 >> 172.21.15.57:0/736976485 conn(0x7f24380b1c60 msgr2=0x7f24380b2070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:24.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:24.661+0000 7f243f000640 1 -- 172.21.15.57:0/736976485 shutdown_connections 2024-03-27T10:01:24.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:24.661+0000 7f243f000640 1 -- 172.21.15.57:0/736976485 wait complete. 2024-03-27T10:01:24.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:24.663+0000 7f243f000640 1 Processor -- start 2024-03-27T10:01:24.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:24.663+0000 7f243f000640 1 -- start start 2024-03-27T10:01:24.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:24.664+0000 7f243f000640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f241c003a00 0x7f24381534e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:24.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:24.664+0000 7f243f000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f243813f700 0x7f243813fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:24.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:24.664+0000 7f243f000640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f243815b5a0 0x7f243815ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:24.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:24.664+0000 7f243f000640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f243806bfd0 con 0x7f243815b5a0 2024-03-27T10:01:24.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:24.664+0000 7f243f000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f24380726b0 con 0x7f243813f700 2024-03-27T10:01:24.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:24.664+0000 7f243f000640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f243806c150 con 0x7f241c003a00 2024-03-27T10:01:24.656 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:24.665+0000 7f243d000640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f243815b5a0 0x7f243815ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:24.656 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:24.665+0000 7f243d000640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f243815b5a0 0x7f243815ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56122/0 (socket says 172.21.15.57:56122) 2024-03-27T10:01:24.656 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:24.665+0000 7f243d000640 1 -- 172.21.15.57:0/186679741 learned_addr learned my addr 172.21.15.57:0/186679741 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:01:24.656 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:24.665+0000 7f2437e00640 1 --2- 172.21.15.57:0/186679741 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f241c003a00 0x7f24381534e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:24.656 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:24.665+0000 7f242fe00640 1 --2- 172.21.15.57:0/186679741 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f243813f700 0x7f243813fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:24.656 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:24.665+0000 7f243d000640 1 -- 172.21.15.57:0/186679741 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f241c003a00 msgr2=0x7f24381534e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:24.656 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:24.665+0000 7f243d000640 1 --2- 172.21.15.57:0/186679741 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f241c003a00 0x7f24381534e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:24.656 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:24.665+0000 7f243d000640 1 -- 172.21.15.57:0/186679741 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f243813f700 msgr2=0x7f243813fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:24.656 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:24.665+0000 7f243d000640 1 --2- 172.21.15.57:0/186679741 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f243813f700 0x7f243813fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:24.656 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:24.665+0000 7f243d000640 1 -- 172.21.15.57:0/186679741 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f243815c290 con 0x7f243815b5a0 2024-03-27T10:01:24.656 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:24.665+0000 7f243d000640 1 --2- 172.21.15.57:0/186679741 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f243815b5a0 0x7f243815ba20 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f243815ea60 tx=0x7f243000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:24.656 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:24.666+0000 7f2434c00640 1 -- 172.21.15.57:0/186679741 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2430018070 con 0x7f243815b5a0 2024-03-27T10:01:24.657 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:24.666+0000 7f2434c00640 1 -- 172.21.15.57:0/186679741 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2430003b70 con 0x7f243815b5a0 2024-03-27T10:01:24.657 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:24.666+0000 7f2434c00640 1 -- 172.21.15.57:0/186679741 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2430005070 con 0x7f243815b5a0 2024-03-27T10:01:24.657 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:24.666+0000 7f243f000640 1 -- 172.21.15.57:0/186679741 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f243813b030 con 0x7f243815b5a0 2024-03-27T10:01:24.657 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:24.666+0000 7f243f000640 1 -- 172.21.15.57:0/186679741 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f243815bf60 con 0x7f243815b5a0 2024-03-27T10:01:24.657 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:24.667+0000 7f243f000640 1 -- 172.21.15.57:0/186679741 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2438068620 con 0x7f243815b5a0 2024-03-27T10:01:24.657 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:24.668+0000 7f2434c00640 1 -- 172.21.15.57:0/186679741 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f243001b070 con 0x7f243815b5a0 2024-03-27T10:01:24.658 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:24.669+0000 7f2434c00640 1 --2- 172.21.15.57:0/186679741 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f241406c560 0x7f241406ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:24.658 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:24.669+0000 7f2434c00640 1 -- 172.21.15.57:0/186679741 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f243008af60 con 0x7f243815b5a0 2024-03-27T10:01:24.658 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:24.669+0000 7f2437e00640 1 --2- 172.21.15.57:0/186679741 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f241406c560 0x7f241406ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:24.659 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:24.670+0000 7f2437e00640 1 --2- 172.21.15.57:0/186679741 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f241406c560 0x7f241406ea20 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f2428039000 tx=0x7f2428008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:24.662 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:24.674+0000 7f2434c00640 1 -- 172.21.15.57:0/186679741 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f24300015b0 con 0x7f243815b5a0 2024-03-27T10:01:24.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:24.875+0000 7f243f000640 1 -- 172.21.15.57:0/186679741 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f243815eb00 con 0x7f243815b5a0 2024-03-27T10:01:24.868 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:24.879+0000 7f2434c00640 1 -- 172.21.15.57:0/186679741 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) ==== 74+0+16943 (secure 0 0 0) 0x7f24300593e0 con 0x7f243815b5a0 2024-03-27T10:01:24.868 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:01:24.868 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":39,"fsid":"7ac43f86-2c16-4a97-98fb-715d3cebc75c","created":"2024-03-27T09:59:04.033417+0000","modified":"2024-03-27T10:01:23.885762+0000","last_up_change":"2024-03-27T09:59:16.969624+0000","last_in_change":"2024-03-27T09:59:07.421690+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-27T09:59:17.253008+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-03-27T10:01:22.035595+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-03-27T10:01:22.866281+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"47b44362-7302-4f2a-b735-582c6c3850cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6801","nonce":2020036298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6803","nonce":2020036298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6807","nonce":2020036298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6805","nonce":2020036298}]},"public_addr":"172.21.15.57:6801/2020036298","cluster_addr":"172.21.15.57:6803/2020036298","heartbeat_back_addr":"172.21.15.57:6807/2020036298","heartbeat_front_addr":"172.21.15.57:6805/2020036298","state":["exists","up"]},{"osd":1,"uuid":"feaf96f0-9431-4188-9a09-da505b40e934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6809","nonce":3190929242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6811","nonce":3190929242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6815","nonce":3190929242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6813","nonce":3190929242}]},"public_addr":"172.21.15.57:6809/3190929242","cluster_addr":"172.21.15.57:6811/3190929242","heartbeat_back_addr":"172.21.15.57:6815/3190929242","heartbeat_front_addr":"172.21.15.57:6813/3190929242","state":["exists","up"]},{"osd":2,"uuid":"21e406e6-cfbc-4fe7-a816-e2420487c95d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6817","nonce":4065849973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6819","nonce":4065849973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6823","nonce":4065849973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6821","nonce":4065849973}]},"public_addr":"172.21.15.57:6817/4065849973","cluster_addr":"172.21.15.57:6819/4065849973","heartbeat_back_addr":"172.21.15.57:6823/4065849973","heartbeat_front_addr":"172.21.15.57:6821/4065849973","state":["exists","up"]},{"osd":3,"uuid":"a389af1d-76c4-4dfc-b215-f983f4931257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6825","nonce":158084809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6827","nonce":158084809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6831","nonce":158084809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6829","nonce":158084809}]},"public_addr":"172.21.15.57:6825/158084809","cluster_addr":"172.21.15.57:6827/158084809","heartbeat_back_addr":"172.21.15.57:6831/158084809","heartbeat_front_addr":"172.21.15.57:6829/158084809","state":["exists","up"]},{"osd":4,"uuid":"e9b05dca-557a-43ee-b43f-9ce5b7d28304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6823","nonce":108719401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6827","nonce":108719401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6831","nonce":108719401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6829","nonce":108719401}]},"public_addr":"172.21.15.118:6823/108719401","cluster_addr":"172.21.15.118:6827/108719401","heartbeat_back_addr":"172.21.15.118:6831/108719401","heartbeat_front_addr":"172.21.15.118:6829/108719401","state":["exists","up"]},{"osd":5,"uuid":"d968177d-44ff-499a-b00a-b147ed879253","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6817","nonce":2704605866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6819","nonce":2704605866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6826","nonce":2704605866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6822","nonce":2704605866}]},"public_addr":"172.21.15.118:6817/2704605866","cluster_addr":"172.21.15.118:6819/2704605866","heartbeat_back_addr":"172.21.15.118:6826/2704605866","heartbeat_front_addr":"172.21.15.118:6822/2704605866","state":["exists","up"]},{"osd":6,"uuid":"e8f98052-e6ad-4cfe-a4a9-0b17a434d54e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6801","nonce":1963659095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6803","nonce":1963659095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6807","nonce":1963659095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6805","nonce":1963659095}]},"public_addr":"172.21.15.118:6801/1963659095","cluster_addr":"172.21.15.118:6803/1963659095","heartbeat_back_addr":"172.21.15.118:6807/1963659095","heartbeat_front_addr":"172.21.15.118:6805/1963659095","state":["exists","up"]},{"osd":7,"uuid":"eccff987-8e51-4a63-845a-cf0a3196d7fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6809","nonce":1955879596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6811","nonce":1955879596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6815","nonce":1955879596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6813","nonce":1955879596}]},"public_addr":"172.21.15.118:6809/1955879596","cluster_addr":"172.21.15.118:6811/1955879596","heartbeat_back_addr":"172.21.15.118:6815/1955879596","heartbeat_front_addr":"172.21.15.118:6813/1955879596","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.721258+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.696610+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.777895+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.806769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.743259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.845687+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:13.020165+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.722294+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-27T10:01:24.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:24.881+0000 7f243f000640 1 -- 172.21.15.57:0/186679741 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f241406c560 msgr2=0x7f241406ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:24.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:24.881+0000 7f243f000640 1 --2- 172.21.15.57:0/186679741 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f241406c560 0x7f241406ea20 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f2428039000 tx=0x7f2428008040 comp rx=0 tx=0).stop 2024-03-27T10:01:24.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:24.881+0000 7f243f000640 1 -- 172.21.15.57:0/186679741 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f243815b5a0 msgr2=0x7f243815ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:24.870 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:24.881+0000 7f243f000640 1 --2- 172.21.15.57:0/186679741 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f243815b5a0 0x7f243815ba20 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f243815ea60 tx=0x7f243000dc00 comp rx=0 tx=0).stop 2024-03-27T10:01:24.871 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:24.881+0000 7f243f000640 1 -- 172.21.15.57:0/186679741 shutdown_connections 2024-03-27T10:01:24.871 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:24.881+0000 7f243f000640 1 --2- 172.21.15.57:0/186679741 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f243815b5a0 0x7f243815ba20 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:24.871 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:24.881+0000 7f243f000640 1 --2- 172.21.15.57:0/186679741 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f241406c560 0x7f241406ea20 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:24.871 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:24.881+0000 7f243f000640 1 --2- 172.21.15.57:0/186679741 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f243813f700 0x7f243813fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:24.871 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:24.881+0000 7f243f000640 1 --2- 172.21.15.57:0/186679741 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f241c003a00 0x7f24381534e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:24.871 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:24.881+0000 7f243f000640 1 -- 172.21.15.57:0/186679741 >> 172.21.15.57:0/186679741 conn(0x7f24380b1c60 msgr2=0x7f24380af760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:24.871 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:24.881+0000 7f243f000640 1 -- 172.21.15.57:0/186679741 shutdown_connections 2024-03-27T10:01:24.871 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:24.882+0000 7f243f000640 1 -- 172.21.15.57:0/186679741 wait complete. 2024-03-27T10:01:24.889 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-27T10:01:25.098 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.109+0000 7f2615000640 1 Processor -- start 2024-03-27T10:01:25.098 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.109+0000 7f2615000640 1 -- start start 2024-03-27T10:01:25.100 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.110+0000 7f2615000640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f2610161830 0x7f26100cf970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:25.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.110+0000 7f2615000640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f26100d0e90 0x7f26100c7b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:25.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.110+0000 7f2615000640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26100d2d90 con 0x7f26100cfeb0 2024-03-27T10:01:25.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.110+0000 7f2615000640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f26100cf4e0 con 0x7f2610161830 2024-03-27T10:01:25.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.110+0000 7f2615000640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f26100cee90 con 0x7f26100d0e90 2024-03-27T10:01:25.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.111+0000 7f260fe00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f26100d0e90 0x7f26100c7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:25.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.111+0000 7f260fe00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f26100d0e90 0x7f26100c7b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.57:51388/0 (socket says 172.21.15.57:51388) 2024-03-27T10:01:25.101 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.111+0000 7f260f400640 1 --2- 172.21.15.57:0/1831993358 >> v2:172.21.15.118:3300/0 conn(0x7f2610161830 0x7f26100cf970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:25.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.111+0000 7f260fe00640 1 -- 172.21.15.57:0/1831993358 learned_addr learned my addr 172.21.15.57:0/1831993358 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:01:25.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.111+0000 7f260ea00640 1 --1- 172.21.15.57:0/1831993358 >> v1:172.21.15.118:6789/0 conn(0x7f26100cfeb0 0x7f26100d0780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.57:50356/0 (socket says 172.21.15.57:50356) 2024-03-27T10:01:25.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.112+0000 7f260f400640 1 -- 172.21.15.57:0/1831993358 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f26100d0e90 msgr2=0x7f26100c7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:01:25.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.112+0000 7f260f400640 1 --2- 172.21.15.57:0/1831993358 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f26100d0e90 0x7f26100c7b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:25.102 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.112+0000 7f260f400640 1 -- 172.21.15.57:0/1831993358 >> v1:172.21.15.118:6789/0 conn(0x7f26100cfeb0 legacy=0x7f26100d0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:25.103 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.112+0000 7f260f400640 1 -- 172.21.15.57:0/1831993358 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26100cf170 con 0x7f2610161830 2024-03-27T10:01:25.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.113+0000 7f260f400640 1 --2- 172.21.15.57:0/1831993358 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2610161830 0x7f26100cf970 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f26000097a0 tx=0x7f260002b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da7e4e504a994561 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:25.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.114+0000 7f260e000640 1 -- 172.21.15.57:0/1831993358 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2600031780 con 0x7f2610161830 2024-03-27T10:01:25.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.114+0000 7f260e000640 1 -- 172.21.15.57:0/1831993358 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2600037070 con 0x7f2610161830 2024-03-27T10:01:25.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.114+0000 7f260e000640 1 -- 172.21.15.57:0/1831993358 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2600031b40 con 0x7f2610161830 2024-03-27T10:01:25.105 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.115+0000 7f2615000640 1 -- 172.21.15.57:0/1831993358 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2610161830 msgr2=0x7f26100cf970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:25.106 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.115+0000 7f2615000640 1 --2- 172.21.15.57:0/1831993358 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2610161830 0x7f26100cf970 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f26000097a0 tx=0x7f260002b820 comp rx=0 tx=0).stop 2024-03-27T10:01:25.106 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.115+0000 7f2615000640 1 -- 172.21.15.57:0/1831993358 shutdown_connections 2024-03-27T10:01:25.106 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.115+0000 7f2615000640 1 --2- 172.21.15.57:0/1831993358 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f26100d0e90 0x7f26100c7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:25.106 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.115+0000 7f2615000640 1 --2- 172.21.15.57:0/1831993358 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2610161830 0x7f26100cf970 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:25.106 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.115+0000 7f2615000640 1 -- 172.21.15.57:0/1831993358 >> 172.21.15.57:0/1831993358 conn(0x7f26100d4030 msgr2=0x7f26100d4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:25.106 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.115+0000 7f2615000640 1 -- 172.21.15.57:0/1831993358 shutdown_connections 2024-03-27T10:01:25.107 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.115+0000 7f2615000640 1 -- 172.21.15.57:0/1831993358 wait complete. 2024-03-27T10:01:25.111 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.117+0000 7f2615000640 1 Processor -- start 2024-03-27T10:01:25.112 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.118+0000 7f2615000640 1 -- start start 2024-03-27T10:01:25.112 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.119+0000 7f2615000640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f26100cfeb0 0x7f2610154350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:25.112 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.119+0000 7f2615000640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26100d0e90 0x7f261014a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:25.112 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.119+0000 7f2615000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2610161830 0x7f2610156a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:25.112 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.119+0000 7f2615000640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f26100ce4b0 con 0x7f26100d0e90 2024-03-27T10:01:25.112 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.119+0000 7f2615000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f26100ce330 con 0x7f2610161830 2024-03-27T10:01:25.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.119+0000 7f2615000640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f2610161c10 con 0x7f26100cfeb0 2024-03-27T10:01:25.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.119+0000 7f260ea00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26100d0e90 0x7f261014a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:25.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.119+0000 7f260ea00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26100d0e90 0x7f261014a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56134/0 (socket says 172.21.15.57:56134) 2024-03-27T10:01:25.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.119+0000 7f260ea00640 1 -- 172.21.15.57:0/2093147237 learned_addr learned my addr 172.21.15.57:0/2093147237 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:01:25.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.120+0000 7f260fe00640 1 --2- 172.21.15.57:0/2093147237 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2610161830 0x7f2610156a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:25.114 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.120+0000 7f260f400640 1 --2- 172.21.15.57:0/2093147237 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f26100cfeb0 0x7f2610154350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:25.114 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.120+0000 7f260ea00640 1 -- 172.21.15.57:0/2093147237 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f26100cfeb0 msgr2=0x7f2610154350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:25.114 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.120+0000 7f260ea00640 1 --2- 172.21.15.57:0/2093147237 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f26100cfeb0 0x7f2610154350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:25.114 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.120+0000 7f260ea00640 1 -- 172.21.15.57:0/2093147237 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2610161830 msgr2=0x7f2610156a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:25.114 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.120+0000 7f260ea00640 1 --2- 172.21.15.57:0/2093147237 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2610161830 0x7f2610156a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:25.114 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.120+0000 7f260ea00640 1 -- 172.21.15.57:0/2093147237 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2610159a60 con 0x7f26100d0e90 2024-03-27T10:01:25.115 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.120+0000 7f260fe00640 1 --2- 172.21.15.57:0/2093147237 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2610161830 0x7f2610156a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T10:01:25.115 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.120+0000 7f260ea00640 1 --2- 172.21.15.57:0/2093147237 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26100d0e90 0x7f261014a300 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f25f800c400 tx=0x7f25f800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:25.115 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.120+0000 7f2607400640 1 -- 172.21.15.57:0/2093147237 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25f80074e0 con 0x7f26100d0e90 2024-03-27T10:01:25.115 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.120+0000 7f2607400640 1 -- 172.21.15.57:0/2093147237 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25f8007680 con 0x7f26100d0e90 2024-03-27T10:01:25.115 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.120+0000 7f2607400640 1 -- 172.21.15.57:0/2093147237 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25f8004a00 con 0x7f26100d0e90 2024-03-27T10:01:25.115 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.120+0000 7f2615000640 1 -- 172.21.15.57:0/2093147237 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2610159d40 con 0x7f26100d0e90 2024-03-27T10:01:25.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.120+0000 7f2615000640 1 -- 172.21.15.57:0/2093147237 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f261015a300 con 0x7f26100d0e90 2024-03-27T10:01:25.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.122+0000 7f2615000640 1 -- 172.21.15.57:0/2093147237 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2610068540 con 0x7f26100d0e90 2024-03-27T10:01:25.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.123+0000 7f2607400640 1 -- 172.21.15.57:0/2093147237 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f25f801a020 con 0x7f26100d0e90 2024-03-27T10:01:25.118 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.123+0000 7f2607400640 1 --2- 172.21.15.57:0/2093147237 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f25ec06c530 0x7f25ec06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:25.118 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.124+0000 7f2607400640 1 -- 172.21.15.57:0/2093147237 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f25f808b010 con 0x7f26100d0e90 2024-03-27T10:01:25.118 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.124+0000 7f260f400640 1 --2- 172.21.15.57:0/2093147237 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f25ec06c530 0x7f25ec06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:25.118 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.125+0000 7f260f400640 1 --2- 172.21.15.57:0/2093147237 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f25ec06c530 0x7f25ec06e9f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f2600036000 tx=0x7f2600008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:25.118 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.128+0000 7f2607400640 1 -- 172.21.15.57:0/2093147237 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f25f8059530 con 0x7f26100d0e90 2024-03-27T10:01:25.323 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.334+0000 7f2615000640 1 -- 172.21.15.57:0/2093147237 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f261008d780 con 0x7f26100d0e90 2024-03-27T10:01:25.326 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.337+0000 7f2607400640 1 -- 172.21.15.57:0/2093147237 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) ==== 74+0+16943 (secure 0 0 0) 0x7f25f8058e30 con 0x7f26100d0e90 2024-03-27T10:01:25.327 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:01:25.327 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":39,"fsid":"7ac43f86-2c16-4a97-98fb-715d3cebc75c","created":"2024-03-27T09:59:04.033417+0000","modified":"2024-03-27T10:01:23.885762+0000","last_up_change":"2024-03-27T09:59:16.969624+0000","last_in_change":"2024-03-27T09:59:07.421690+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-27T09:59:17.253008+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-03-27T10:01:22.035595+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-03-27T10:01:22.866281+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"47b44362-7302-4f2a-b735-582c6c3850cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6801","nonce":2020036298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6803","nonce":2020036298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6807","nonce":2020036298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6805","nonce":2020036298}]},"public_addr":"172.21.15.57:6801/2020036298","cluster_addr":"172.21.15.57:6803/2020036298","heartbeat_back_addr":"172.21.15.57:6807/2020036298","heartbeat_front_addr":"172.21.15.57:6805/2020036298","state":["exists","up"]},{"osd":1,"uuid":"feaf96f0-9431-4188-9a09-da505b40e934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6809","nonce":3190929242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6811","nonce":3190929242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6815","nonce":3190929242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6813","nonce":3190929242}]},"public_addr":"172.21.15.57:6809/3190929242","cluster_addr":"172.21.15.57:6811/3190929242","heartbeat_back_addr":"172.21.15.57:6815/3190929242","heartbeat_front_addr":"172.21.15.57:6813/3190929242","state":["exists","up"]},{"osd":2,"uuid":"21e406e6-cfbc-4fe7-a816-e2420487c95d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6817","nonce":4065849973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6819","nonce":4065849973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6823","nonce":4065849973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6821","nonce":4065849973}]},"public_addr":"172.21.15.57:6817/4065849973","cluster_addr":"172.21.15.57:6819/4065849973","heartbeat_back_addr":"172.21.15.57:6823/4065849973","heartbeat_front_addr":"172.21.15.57:6821/4065849973","state":["exists","up"]},{"osd":3,"uuid":"a389af1d-76c4-4dfc-b215-f983f4931257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6825","nonce":158084809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6827","nonce":158084809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6831","nonce":158084809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6829","nonce":158084809}]},"public_addr":"172.21.15.57:6825/158084809","cluster_addr":"172.21.15.57:6827/158084809","heartbeat_back_addr":"172.21.15.57:6831/158084809","heartbeat_front_addr":"172.21.15.57:6829/158084809","state":["exists","up"]},{"osd":4,"uuid":"e9b05dca-557a-43ee-b43f-9ce5b7d28304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6823","nonce":108719401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6827","nonce":108719401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6831","nonce":108719401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6829","nonce":108719401}]},"public_addr":"172.21.15.118:6823/108719401","cluster_addr":"172.21.15.118:6827/108719401","heartbeat_back_addr":"172.21.15.118:6831/108719401","heartbeat_front_addr":"172.21.15.118:6829/108719401","state":["exists","up"]},{"osd":5,"uuid":"d968177d-44ff-499a-b00a-b147ed879253","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6817","nonce":2704605866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6819","nonce":2704605866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6826","nonce":2704605866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6822","nonce":2704605866}]},"public_addr":"172.21.15.118:6817/2704605866","cluster_addr":"172.21.15.118:6819/2704605866","heartbeat_back_addr":"172.21.15.118:6826/2704605866","heartbeat_front_addr":"172.21.15.118:6822/2704605866","state":["exists","up"]},{"osd":6,"uuid":"e8f98052-e6ad-4cfe-a4a9-0b17a434d54e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6801","nonce":1963659095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6803","nonce":1963659095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6807","nonce":1963659095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6805","nonce":1963659095}]},"public_addr":"172.21.15.118:6801/1963659095","cluster_addr":"172.21.15.118:6803/1963659095","heartbeat_back_addr":"172.21.15.118:6807/1963659095","heartbeat_front_addr":"172.21.15.118:6805/1963659095","state":["exists","up"]},{"osd":7,"uuid":"eccff987-8e51-4a63-845a-cf0a3196d7fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6809","nonce":1955879596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6811","nonce":1955879596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6815","nonce":1955879596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6813","nonce":1955879596}]},"public_addr":"172.21.15.118:6809/1955879596","cluster_addr":"172.21.15.118:6811/1955879596","heartbeat_back_addr":"172.21.15.118:6815/1955879596","heartbeat_front_addr":"172.21.15.118:6813/1955879596","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.721258+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.696610+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.777895+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.806769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.743259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.845687+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:13.020165+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.722294+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-27T10:01:25.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.340+0000 7f2615000640 1 -- 172.21.15.57:0/2093147237 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f25ec06c530 msgr2=0x7f25ec06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:25.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.340+0000 7f2615000640 1 --2- 172.21.15.57:0/2093147237 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f25ec06c530 0x7f25ec06e9f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f2600036000 tx=0x7f2600008030 comp rx=0 tx=0).stop 2024-03-27T10:01:25.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.340+0000 7f2615000640 1 -- 172.21.15.57:0/2093147237 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26100d0e90 msgr2=0x7f261014a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:25.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.340+0000 7f2615000640 1 --2- 172.21.15.57:0/2093147237 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26100d0e90 0x7f261014a300 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f25f800c400 tx=0x7f25f800c8c0 comp rx=0 tx=0).stop 2024-03-27T10:01:25.330 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.340+0000 7f2615000640 1 -- 172.21.15.57:0/2093147237 shutdown_connections 2024-03-27T10:01:25.330 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.340+0000 7f2615000640 1 --2- 172.21.15.57:0/2093147237 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f25ec06c530 0x7f25ec06e9f0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:25.330 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.340+0000 7f2615000640 1 --2- 172.21.15.57:0/2093147237 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2610161830 0x7f2610156a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:25.330 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.340+0000 7f2615000640 1 --2- 172.21.15.57:0/2093147237 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f26100d0e90 0x7f261014a300 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:25.330 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.340+0000 7f2615000640 1 --2- 172.21.15.57:0/2093147237 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f26100cfeb0 0x7f2610154350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:25.330 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.340+0000 7f2615000640 1 -- 172.21.15.57:0/2093147237 >> 172.21.15.57:0/2093147237 conn(0x7f26100d4030 msgr2=0x7f26100ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:25.330 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.341+0000 7f2615000640 1 -- 172.21.15.57:0/2093147237 shutdown_connections 2024-03-27T10:01:25.330 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.341+0000 7f2615000640 1 -- 172.21.15.57:0/2093147237 wait complete. 2024-03-27T10:01:25.350 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-03-27T10:01:25.578 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.588+0000 7fb4ad800640 1 Processor -- start 2024-03-27T10:01:25.578 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.589+0000 7fb4ad800640 1 -- start start 2024-03-27T10:01:25.580 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.591+0000 7fb4ad800640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb4a815e6f0 0x7fb4a80d2a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:25.580 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.591+0000 7fb4ad800640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fb4a80d2f70 0x7fb4a80d40b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:25.580 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.591+0000 7fb4ad800640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb4a80d45f0 0x7fb4a80d0730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:25.580 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.591+0000 7fb4ad800640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7fb4a80b43b0 con 0x7fb4a80d45f0 2024-03-27T10:01:25.580 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.591+0000 7fb4ad800640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7fb4a80b40b0 con 0x7fb4a80d2f70 2024-03-27T10:01:25.581 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.591+0000 7fb4ad800640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fb4a80cfb90 con 0x7fb4a815e6f0 2024-03-27T10:01:25.581 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.591+0000 7fb4a7400640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb4a80d45f0 0x7fb4a80d0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:25.581 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.591+0000 7fb4a7400640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb4a80d45f0 0x7fb4a80d0730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56140/0 (socket says 172.21.15.57:56140) 2024-03-27T10:01:25.581 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.591+0000 7fb4a7400640 1 -- 172.21.15.57:0/152064205 learned_addr learned my addr 172.21.15.57:0/152064205 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:01:25.583 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.591+0000 7fb4a6000640 1 --2- 172.21.15.57:0/152064205 >> v2:172.21.15.118:3300/0 conn(0x7fb4a80d2f70 0x7fb4a80d40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:25.583 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.592+0000 7fb4a6a00640 1 --2- 172.21.15.57:0/152064205 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb4a815e6f0 0x7fb4a80d2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:25.583 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.592+0000 7fb4a7400640 1 -- 172.21.15.57:0/152064205 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb4a815e6f0 msgr2=0x7fb4a80d2a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:01:25.583 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.592+0000 7fb4a7400640 1 --2- 172.21.15.57:0/152064205 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb4a815e6f0 0x7fb4a80d2a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:25.583 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.592+0000 7fb4a7400640 1 -- 172.21.15.57:0/152064205 >> v2:172.21.15.118:3300/0 conn(0x7fb4a80d2f70 msgr2=0x7fb4a80d40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:01:25.583 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.592+0000 7fb4a7400640 1 --2- 172.21.15.57:0/152064205 >> v2:172.21.15.118:3300/0 conn(0x7fb4a80d2f70 0x7fb4a80d40b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:25.583 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.592+0000 7fb4a7400640 1 -- 172.21.15.57:0/152064205 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4a80cfe70 con 0x7fb4a80d45f0 2024-03-27T10:01:25.583 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.593+0000 7fb4a7400640 1 --2- 172.21.15.57:0/152064205 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb4a80d45f0 0x7fb4a80d0730 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fb4a808e970 tx=0x7fb4a002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31af2e4c81553de0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:25.583 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.594+0000 7fb4a5600640 1 -- 172.21.15.57:0/152064205 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4a0035020 con 0x7fb4a80d45f0 2024-03-27T10:01:25.583 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.594+0000 7fb4a5600640 1 -- 172.21.15.57:0/152064205 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4a0031870 con 0x7fb4a80d45f0 2024-03-27T10:01:25.584 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.594+0000 7fb4a5600640 1 -- 172.21.15.57:0/152064205 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4a0031c40 con 0x7fb4a80d45f0 2024-03-27T10:01:25.584 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.594+0000 7fb4ad800640 1 -- 172.21.15.57:0/152064205 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb4a80d45f0 msgr2=0x7fb4a80d0730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:25.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.594+0000 7fb4ad800640 1 --2- 172.21.15.57:0/152064205 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb4a80d45f0 0x7fb4a80d0730 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fb4a808e970 tx=0x7fb4a002b910 comp rx=0 tx=0).stop 2024-03-27T10:01:25.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.594+0000 7fb4ad800640 1 -- 172.21.15.57:0/152064205 shutdown_connections 2024-03-27T10:01:25.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.594+0000 7fb4ad800640 1 --2- 172.21.15.57:0/152064205 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb4a80d45f0 0x7fb4a80d0730 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:25.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.594+0000 7fb4ad800640 1 --2- 172.21.15.57:0/152064205 >> v2:172.21.15.118:3300/0 conn(0x7fb4a80d2f70 0x7fb4a80d40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:25.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.594+0000 7fb4ad800640 1 --2- 172.21.15.57:0/152064205 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb4a815e6f0 0x7fb4a80d2a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:25.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.594+0000 7fb4ad800640 1 -- 172.21.15.57:0/152064205 >> 172.21.15.57:0/152064205 conn(0x7fb4a808db30 msgr2=0x7fb4a809d450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:25.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.595+0000 7fb4ad800640 1 -- 172.21.15.57:0/152064205 shutdown_connections 2024-03-27T10:01:25.585 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.595+0000 7fb4ad800640 1 -- 172.21.15.57:0/152064205 wait complete. 2024-03-27T10:01:25.586 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.597+0000 7fb4ad800640 1 Processor -- start 2024-03-27T10:01:25.586 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.598+0000 7fb4ad800640 1 -- start start 2024-03-27T10:01:25.589 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.599+0000 7fb4ad800640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb4a80d2f70 0x7fb4a80b7b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:25.589 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.599+0000 7fb4ad800640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb4a80d45f0 0x7fb4a80b8050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:25.589 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.599+0000 7fb4ad800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb4a815e6f0 0x7fb4a81f3f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:25.589 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.599+0000 7fb4ad800640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fb4a80d0c70 con 0x7fb4a80d45f0 2024-03-27T10:01:25.589 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.599+0000 7fb4ad800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fb4a80cf820 con 0x7fb4a815e6f0 2024-03-27T10:01:25.589 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.599+0000 7fb4ad800640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fb4a80d0df0 con 0x7fb4a80d2f70 2024-03-27T10:01:25.589 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.599+0000 7fb4a6000640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb4a80d45f0 0x7fb4a80b8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:25.589 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.600+0000 7fb4a6000640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb4a80d45f0 0x7fb4a80b8050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56144/0 (socket says 172.21.15.57:56144) 2024-03-27T10:01:25.590 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.600+0000 7fb4a6000640 1 -- 172.21.15.57:0/1697558755 learned_addr learned my addr 172.21.15.57:0/1697558755 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:01:25.590 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.600+0000 7fb4a7400640 1 --2- 172.21.15.57:0/1697558755 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb4a815e6f0 0x7fb4a81f3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:25.590 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.600+0000 7fb4a6a00640 1 --2- 172.21.15.57:0/1697558755 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb4a80d2f70 0x7fb4a80b7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:25.590 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.600+0000 7fb4a6000640 1 -- 172.21.15.57:0/1697558755 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb4a80d2f70 msgr2=0x7fb4a80b7b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:25.590 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.600+0000 7fb4a6000640 1 --2- 172.21.15.57:0/1697558755 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb4a80d2f70 0x7fb4a80b7b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:25.590 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.600+0000 7fb4a6000640 1 -- 172.21.15.57:0/1697558755 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb4a815e6f0 msgr2=0x7fb4a81f3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:25.590 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.600+0000 7fb4a6000640 1 --2- 172.21.15.57:0/1697558755 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb4a815e6f0 0x7fb4a81f3f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:25.590 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.600+0000 7fb4a6000640 1 -- 172.21.15.57:0/1697558755 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4a81f5fe0 con 0x7fb4a80d45f0 2024-03-27T10:01:25.590 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.600+0000 7fb4a6a00640 1 --2- 172.21.15.57:0/1697558755 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb4a80d2f70 0x7fb4a80b7b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T10:01:25.590 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.600+0000 7fb4a7400640 1 --2- 172.21.15.57:0/1697558755 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb4a815e6f0 0x7fb4a81f3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T10:01:25.590 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.600+0000 7fb4a6000640 1 --2- 172.21.15.57:0/1697558755 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb4a80d45f0 0x7fb4a80b8050 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fb490007e60 tx=0x7fb49000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:25.591 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.601+0000 7fb49ea00640 1 -- 172.21.15.57:0/1697558755 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb490014620 con 0x7fb4a80d45f0 2024-03-27T10:01:25.591 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.601+0000 7fb49ea00640 1 -- 172.21.15.57:0/1697558755 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb490019070 con 0x7fb4a80d45f0 2024-03-27T10:01:25.591 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.601+0000 7fb4ad800640 1 -- 172.21.15.57:0/1697558755 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4a81f62c0 con 0x7fb4a80d45f0 2024-03-27T10:01:25.592 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.601+0000 7fb49ea00640 1 -- 172.21.15.57:0/1697558755 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb490014a00 con 0x7fb4a80d45f0 2024-03-27T10:01:25.592 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.601+0000 7fb4ad800640 1 -- 172.21.15.57:0/1697558755 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4a81f6880 con 0x7fb4a80d45f0 2024-03-27T10:01:25.592 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.602+0000 7fb4ad800640 1 -- 172.21.15.57:0/1697558755 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4a8068c50 con 0x7fb4a80d45f0 2024-03-27T10:01:25.592 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.603+0000 7fb49ea00640 1 -- 172.21.15.57:0/1697558755 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fb490014ba0 con 0x7fb4a80d45f0 2024-03-27T10:01:25.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.604+0000 7fb49ea00640 1 --2- 172.21.15.57:0/1697558755 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fb48406c560 0x7fb48406ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:25.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.604+0000 7fb49ea00640 1 -- 172.21.15.57:0/1697558755 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7fb49008c0a0 con 0x7fb4a80d45f0 2024-03-27T10:01:25.593 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.604+0000 7fb4a6a00640 1 --2- 172.21.15.57:0/1697558755 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fb48406c560 0x7fb48406ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:25.594 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.605+0000 7fb4a6a00640 1 --2- 172.21.15.57:0/1697558755 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fb48406c560 0x7fb48406ea20 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb498006fd0 tx=0x7fb498008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:25.597 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.609+0000 7fb49ea00640 1 -- 172.21.15.57:0/1697558755 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7fb49005a520 con 0x7fb4a80d45f0 2024-03-27T10:01:25.952 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:25.962+0000 7fb4ad800640 1 -- 172.21.15.57:0/1697558755 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fb4a80b5820 con 0x7fb4a80d45f0 2024-03-27T10:01:26.429 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:26.438+0000 7fb49ea00640 1 -- 172.21.15.57:0/1697558755 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7fb490059e20 con 0x7fb4a80d45f0 2024-03-27T10:01:26.430 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:26.441+0000 7fb4ad800640 1 -- 172.21.15.57:0/1697558755 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fb48406c560 msgr2=0x7fb48406ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:26.430 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:26.441+0000 7fb4ad800640 1 --2- 172.21.15.57:0/1697558755 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fb48406c560 0x7fb48406ea20 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb498006fd0 tx=0x7fb498008040 comp rx=0 tx=0).stop 2024-03-27T10:01:26.430 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:26.441+0000 7fb4ad800640 1 -- 172.21.15.57:0/1697558755 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb4a80d45f0 msgr2=0x7fb4a80b8050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:26.431 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:26.441+0000 7fb4ad800640 1 --2- 172.21.15.57:0/1697558755 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb4a80d45f0 0x7fb4a80b8050 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fb490007e60 tx=0x7fb49000e4b0 comp rx=0 tx=0).stop 2024-03-27T10:01:26.431 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:26.442+0000 7fb4ad800640 1 -- 172.21.15.57:0/1697558755 shutdown_connections 2024-03-27T10:01:26.431 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:26.442+0000 7fb4ad800640 1 --2- 172.21.15.57:0/1697558755 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fb48406c560 0x7fb48406ea20 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:26.431 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:26.442+0000 7fb4ad800640 1 --2- 172.21.15.57:0/1697558755 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb4a815e6f0 0x7fb4a81f3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:26.431 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:26.442+0000 7fb4ad800640 1 --2- 172.21.15.57:0/1697558755 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb4a80d45f0 0x7fb4a80b8050 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:26.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:26.442+0000 7fb4ad800640 1 --2- 172.21.15.57:0/1697558755 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb4a80d2f70 0x7fb4a80b7b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:26.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:26.442+0000 7fb4ad800640 1 -- 172.21.15.57:0/1697558755 >> 172.21.15.57:0/1697558755 conn(0x7fb4a808db30 msgr2=0x7fb4a8074990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:26.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:26.442+0000 7fb4ad800640 1 -- 172.21.15.57:0/1697558755 shutdown_connections 2024-03-27T10:01:26.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:26.442+0000 7fb4ad800640 1 -- 172.21.15.57:0/1697558755 wait complete. 2024-03-27T10:01:26.454 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-03-27T10:01:26.454 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-03-27T10:01:26.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:26.749+0000 7fa0d7e00640 1 Processor -- start 2024-03-27T10:01:26.738 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:26.749+0000 7fa0d7e00640 1 -- start start 2024-03-27T10:01:26.740 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:26.751+0000 7fa0d7e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa0d80cc720 0x7fa0d80cdac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:26.740 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:26.751+0000 7fa0d7e00640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0d815b2c0 con 0x7fa0d806db20 2024-03-27T10:01:26.740 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:26.751+0000 7fa0d7e00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0d80b36d0 con 0x7fa0d806c650 2024-03-27T10:01:26.740 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:26.751+0000 7fa0d7e00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fa0d80b39b0 con 0x7fa0d80cc720 2024-03-27T10:01:26.740 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:26.751+0000 7fa0d6a00640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fa0d806db20 0x7fa0d806df00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:40356/0 (socket says 172.21.15.57:40356) 2024-03-27T10:01:26.740 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:26.751+0000 7fa0d6a00640 1 -- 172.21.15.57:0/171748034 learned_addr learned my addr 172.21.15.57:0/171748034 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T10:01:26.742 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:26.752+0000 7fa0d7400640 1 --2- 172.21.15.57:0/171748034 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa0d80cc720 0x7fa0d80cdac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:26.742 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:26.752+0000 7fa0d6000640 1 -- 172.21.15.57:0/171748034 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4072139705 0 0) 0x7fa0d815b2c0 con 0x7fa0d806db20 2024-03-27T10:01:26.743 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:26.752+0000 7fa0d6000640 1 -- 172.21.15.57:0/171748034 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa0bc003520 con 0x7fa0d806db20 2024-03-27T10:01:26.743 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:26.752+0000 7fa0d6000640 1 -- 172.21.15.57:0/171748034 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1691802075 0 0) 0x7fa0bc003520 con 0x7fa0d806db20 2024-03-27T10:01:26.743 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:26.752+0000 7fa0d6000640 1 -- 172.21.15.57:0/171748034 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa0d80cc720 msgr2=0x7fa0d80cdac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:01:26.743 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:26.752+0000 7fa0d6000640 1 --2- 172.21.15.57:0/171748034 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa0d80cc720 0x7fa0d80cdac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:26.743 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:26.752+0000 7fa0d6000640 1 -- 172.21.15.57:0/171748034 >> v1:172.21.15.118:6789/0 conn(0x7fa0d806c650 legacy=0x7fa0d80b4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:26.743 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:26.752+0000 7fa0d6000640 1 -- 172.21.15.57:0/171748034 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0d80b3c90 con 0x7fa0d806db20 2024-03-27T10:01:26.743 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:26.752+0000 7fa0d6000640 1 -- 172.21.15.57:0/171748034 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4227751516 0 0) 0x7fa0c8001670 con 0x7fa0d806db20 2024-03-27T10:01:26.743 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:26.752+0000 7fa0d6000640 1 -- 172.21.15.57:0/171748034 >> v1:172.21.15.57:6789/0 conn(0x7fa0d806db20 legacy=0x7fa0d806df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:26.743 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:26.752+0000 7fa0d6000640 1 --2- 172.21.15.57:0/171748034 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa0bc0039e0 0x7fa0bc003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:26.743 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:26.752+0000 7fa0d6000640 1 --2- 172.21.15.57:0/171748034 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa0d80cc720 0x7fa0bc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:26.743 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:26.752+0000 7fa0d6000640 1 --2- 172.21.15.57:0/171748034 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa0bc004d40 0x7fa0bc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:26.743 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:26.752+0000 7fa0d6000640 1 -- 172.21.15.57:0/171748034 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fa0d80b39b0 con 0x7fa0bc004d40 2024-03-27T10:01:26.743 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:26.752+0000 7fa0d6000640 1 -- 172.21.15.57:0/171748034 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fa0bc00ba70 con 0x7fa0bc0039e0 2024-03-27T10:01:26.743 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:26.753+0000 7fa0d6000640 1 -- 172.21.15.57:0/171748034 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fa0bc00de80 con 0x7fa0d80cc720 2024-03-27T10:01:26.743 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:26.753+0000 7fa0d7400640 1 --2- 172.21.15.57:0/171748034 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa0bc004d40 0x7fa0bc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:26.743 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:26.753+0000 7fa0cfe00640 1 --2- 172.21.15.57:0/171748034 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa0d80cc720 0x7fa0bc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:26.744 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:26.753+0000 7fa0d6a00640 1 --2- 172.21.15.57:0/171748034 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa0bc0039e0 0x7fa0bc003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:26.744 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:26.753+0000 7fa0d7400640 1 -- 172.21.15.57:0/171748034 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa0d80cc720 msgr2=0x7fa0bc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:01:26.744 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:26.753+0000 7fa0d7400640 1 --2- 172.21.15.57:0/171748034 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa0d80cc720 0x7fa0bc004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:26.744 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:26.753+0000 7fa0d7400640 1 -- 172.21.15.57:0/171748034 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa0bc0039e0 msgr2=0x7fa0bc003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:01:26.744 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:26.753+0000 7fa0d7400640 1 --2- 172.21.15.57:0/171748034 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa0bc0039e0 0x7fa0bc003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:26.744 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:26.753+0000 7fa0d7400640 1 -- 172.21.15.57:0/171748034 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0bc003520 con 0x7fa0bc004d40 2024-03-27T10:01:26.745 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:26.754+0000 7fa0d7400640 1 --2- 172.21.15.57:0/171748034 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa0bc004d40 0x7fa0bc0051c0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fa0d80ccbd0 tx=0x7fa0bc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69dd8c1178b92665 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:26.745 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:26.755+0000 7fa0d6000640 1 -- 172.21.15.57:0/171748034 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0d0039070 con 0x7fa0bc004d40 2024-03-27T10:01:26.745 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:26.755+0000 7fa0d6000640 1 -- 172.21.15.57:0/171748034 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0d002cb90 con 0x7fa0bc004d40 2024-03-27T10:01:26.745 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:26.755+0000 7fa0d6000640 1 -- 172.21.15.57:0/171748034 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0d0009c10 con 0x7fa0bc004d40 2024-03-27T10:01:26.745 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:26.755+0000 7fa0d7e00640 1 -- 172.21.15.57:0/171748034 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa0bc004d40 msgr2=0x7fa0bc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:26.745 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:26.755+0000 7fa0d7e00640 1 --2- 172.21.15.57:0/171748034 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa0bc004d40 0x7fa0bc0051c0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fa0d80ccbd0 tx=0x7fa0bc005830 comp rx=0 tx=0).stop 2024-03-27T10:01:26.745 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:26.755+0000 7fa0d7400640 1 -- 172.21.15.57:0/171748034 reap_dead start 2024-03-27T10:01:26.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:26.755+0000 7fa0d7e00640 1 -- 172.21.15.57:0/171748034 shutdown_connections 2024-03-27T10:01:26.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:26.755+0000 7fa0d7e00640 1 -- 172.21.15.57:0/171748034 >> 172.21.15.57:0/171748034 conn(0x7fa0d80d0380 msgr2=0x7fa0d80d0760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:26.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:26.756+0000 7fa0d7e00640 1 -- 172.21.15.57:0/171748034 shutdown_connections 2024-03-27T10:01:26.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:26.756+0000 7fa0d7e00640 1 -- 172.21.15.57:0/171748034 wait complete. 2024-03-27T10:01:26.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:26.757+0000 7fa0d7e00640 1 Processor -- start 2024-03-27T10:01:26.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:26.758+0000 7fa0d7e00640 1 -- start start 2024-03-27T10:01:26.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:26.758+0000 7fa0d7e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa0d81f6ff0 0x7fa0d81f4340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:26.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:26.758+0000 7fa0d7e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa0d81f73d0 0x7fa0d81e35b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:26.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:26.758+0000 7fa0d7e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa0d81e3af0 0x7fa0d815d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:26.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:26.758+0000 7fa0d7e00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fa0d806e610 con 0x7fa0d81f6ff0 2024-03-27T10:01:26.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:26.758+0000 7fa0d7e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fa0d80b4250 con 0x7fa0d81e3af0 2024-03-27T10:01:26.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:26.758+0000 7fa0d7e00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fa0d80b3310 con 0x7fa0d81f73d0 2024-03-27T10:01:26.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:26.759+0000 7fa0d6a00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa0d81f6ff0 0x7fa0d81f4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:26.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:26.759+0000 7fa0d6a00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa0d81f6ff0 0x7fa0d81f4340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56162/0 (socket says 172.21.15.57:56162) 2024-03-27T10:01:26.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:26.759+0000 7fa0d6a00640 1 -- 172.21.15.57:0/71514630 learned_addr learned my addr 172.21.15.57:0/71514630 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:01:26.750 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:26.759+0000 7fa0cfe00640 1 --2- 172.21.15.57:0/71514630 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa0d81f73d0 0x7fa0d81e35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:26.750 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:26.759+0000 7fa0d6a00640 1 -- 172.21.15.57:0/71514630 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa0d81f73d0 msgr2=0x7fa0d81e35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:26.750 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:26.759+0000 7fa0d6a00640 1 --2- 172.21.15.57:0/71514630 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa0d81f73d0 0x7fa0d81e35b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:26.750 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:26.759+0000 7fa0d6a00640 1 -- 172.21.15.57:0/71514630 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa0d81e3af0 msgr2=0x7fa0d815d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:26.750 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:26.759+0000 7fa0d6a00640 1 --2- 172.21.15.57:0/71514630 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa0d81e3af0 0x7fa0d815d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:26.750 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:26.759+0000 7fa0d6a00640 1 -- 172.21.15.57:0/71514630 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0d8158730 con 0x7fa0d81f6ff0 2024-03-27T10:01:26.750 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:26.760+0000 7fa0d6a00640 1 --2- 172.21.15.57:0/71514630 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa0d81f6ff0 0x7fa0d81f4340 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fa0c800e7f0 tx=0x7fa0c800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:26.750 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:26.760+0000 7fa0cea00640 1 -- 172.21.15.57:0/71514630 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0c800c850 con 0x7fa0d81f6ff0 2024-03-27T10:01:26.750 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:26.760+0000 7fa0cea00640 1 -- 172.21.15.57:0/71514630 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0c8018070 con 0x7fa0d81f6ff0 2024-03-27T10:01:26.750 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:26.760+0000 7fa0d7e00640 1 -- 172.21.15.57:0/71514630 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0d8158a10 con 0x7fa0d81f6ff0 2024-03-27T10:01:26.750 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:26.760+0000 7fa0cea00640 1 -- 172.21.15.57:0/71514630 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0c800cc30 con 0x7fa0d81f6ff0 2024-03-27T10:01:26.750 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:26.760+0000 7fa0d7e00640 1 -- 172.21.15.57:0/71514630 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0d8158fd0 con 0x7fa0d81f6ff0 2024-03-27T10:01:26.751 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:26.762+0000 7fa0d7e00640 1 -- 172.21.15.57:0/71514630 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0d81e3f10 con 0x7fa0d81f6ff0 2024-03-27T10:01:26.751 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:26.762+0000 7fa0cea00640 1 -- 172.21.15.57:0/71514630 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fa0c8013420 con 0x7fa0d81f6ff0 2024-03-27T10:01:26.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:26.763+0000 7fa0cea00640 1 --2- 172.21.15.57:0/71514630 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fa0b406c560 0x7fa0b406ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:26.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:26.763+0000 7fa0cea00640 1 -- 172.21.15.57:0/71514630 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7fa0c808b3e0 con 0x7fa0d81f6ff0 2024-03-27T10:01:26.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:26.763+0000 7fa0cfe00640 1 --2- 172.21.15.57:0/71514630 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fa0b406c560 0x7fa0b406ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:26.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:26.764+0000 7fa0cfe00640 1 --2- 172.21.15.57:0/71514630 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fa0b406c560 0x7fa0b406ea20 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa0c0007fd0 tx=0x7fa0c0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:26.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:26.768+0000 7fa0cea00640 1 -- 172.21.15.57:0/71514630 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7fa0c8059870 con 0x7fa0d81f6ff0 2024-03-27T10:01:26.999 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:27.011+0000 7fa0d7e00640 1 -- 172.21.15.57:0/71514630 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fa0d8068c50 con 0x7fa0d81f6ff0 2024-03-27T10:01:27.320 INFO:tasks.ceph.mds.a.smithi057.stderr:2024-03-27T10:01:27.331+0000 7f0ff7400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-27T10:01:27.442 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:27.452+0000 7fa0cea00640 1 -- 172.21.15.57:0/71514630 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v18) ==== 122+0+0 (secure 0 0 0) 0x7fa0c8059170 con 0x7fa0d81f6ff0 2024-03-27T10:01:27.447 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:27.457+0000 7fa0d7e00640 1 -- 172.21.15.57:0/71514630 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fa0b406c560 msgr2=0x7fa0b406ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:27.447 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:27.457+0000 7fa0d7e00640 1 --2- 172.21.15.57:0/71514630 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fa0b406c560 0x7fa0b406ea20 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa0c0007fd0 tx=0x7fa0c0009040 comp rx=0 tx=0).stop 2024-03-27T10:01:27.447 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:27.457+0000 7fa0d7e00640 1 -- 172.21.15.57:0/71514630 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa0d81f6ff0 msgr2=0x7fa0d81f4340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:27.447 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:27.457+0000 7fa0d7e00640 1 --2- 172.21.15.57:0/71514630 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa0d81f6ff0 0x7fa0d81f4340 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fa0c800e7f0 tx=0x7fa0c800ecb0 comp rx=0 tx=0).stop 2024-03-27T10:01:27.447 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:27.458+0000 7fa0d7e00640 1 -- 172.21.15.57:0/71514630 shutdown_connections 2024-03-27T10:01:27.447 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:27.458+0000 7fa0d7e00640 1 --2- 172.21.15.57:0/71514630 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fa0b406c560 0x7fa0b406ea20 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:27.447 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:27.458+0000 7fa0d7e00640 1 --2- 172.21.15.57:0/71514630 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa0d81e3af0 0x7fa0d815d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:27.447 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:27.458+0000 7fa0d7e00640 1 --2- 172.21.15.57:0/71514630 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa0d81f73d0 0x7fa0d81e35b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:27.447 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:27.458+0000 7fa0d7e00640 1 --2- 172.21.15.57:0/71514630 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa0d81f6ff0 0x7fa0d81f4340 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:27.447 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:27.458+0000 7fa0d7e00640 1 -- 172.21.15.57:0/71514630 >> 172.21.15.57:0/71514630 conn(0x7fa0d80d0380 msgr2=0x7fa0d80cfad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:27.447 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:27.458+0000 7fa0d7e00640 1 -- 172.21.15.57:0/71514630 shutdown_connections 2024-03-27T10:01:27.447 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:27.458+0000 7fa0d7e00640 1 -- 172.21.15.57:0/71514630 wait complete. 2024-03-27T10:01:27.467 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-03-27T10:01:27.468 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-27T10:01:27.687 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:27.698+0000 7f8ddae00640 1 Processor -- start 2024-03-27T10:01:27.687 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:27.698+0000 7f8ddae00640 1 -- start start 2024-03-27T10:01:27.689 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:27.700+0000 7f8ddae00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f8dd415a430 0x7f8dd415b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:27.689 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:27.700+0000 7f8ddae00640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8dd40b4da0 con 0x7f8dd4071c00 2024-03-27T10:01:27.689 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:27.700+0000 7f8ddae00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8dd40b4ac0 con 0x7f8dd40b3bb0 2024-03-27T10:01:27.689 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:27.700+0000 7f8ddae00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f8dd4071770 con 0x7f8dd415a430 2024-03-27T10:01:27.690 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:27.700+0000 7f8dd9000640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f8dd4071c00 0x7f8dd40b34a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:40372/0 (socket says 172.21.15.57:40372) 2024-03-27T10:01:27.690 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:27.701+0000 7f8dd9000640 1 -- 172.21.15.57:0/1813908847 learned_addr learned my addr 172.21.15.57:0/1813908847 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T10:01:27.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:27.701+0000 7f8dd3e00640 1 -- 172.21.15.57:0/1813908847 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2702723600 0 0) 0x7f8dd40b4da0 con 0x7f8dd4071c00 2024-03-27T10:01:27.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:27.701+0000 7f8dd9a00640 1 --2- 172.21.15.57:0/1813908847 >> v2:172.21.15.118:3300/0 conn(0x7f8dd415a430 0x7f8dd415b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:27.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:27.701+0000 7f8dd3e00640 1 -- 172.21.15.57:0/1813908847 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8dbc003520 con 0x7f8dd4071c00 2024-03-27T10:01:27.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:27.701+0000 7f8dd3e00640 1 -- 172.21.15.57:0/1813908847 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 597297629 0 0) 0x7f8dbc003520 con 0x7f8dd4071c00 2024-03-27T10:01:27.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:27.701+0000 7f8dd3e00640 1 -- 172.21.15.57:0/1813908847 >> v2:172.21.15.118:3300/0 conn(0x7f8dd415a430 msgr2=0x7f8dd415b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:01:27.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:27.701+0000 7f8dd3e00640 1 --2- 172.21.15.57:0/1813908847 >> v2:172.21.15.118:3300/0 conn(0x7f8dd415a430 0x7f8dd415b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:27.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:27.701+0000 7f8dd3e00640 1 -- 172.21.15.57:0/1813908847 >> v1:172.21.15.118:6789/0 conn(0x7f8dd40b3bb0 legacy=0x7f8dd406d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:27.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:27.702+0000 7f8dd3e00640 1 -- 172.21.15.57:0/1813908847 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dd4071120 con 0x7f8dd4071c00 2024-03-27T10:01:27.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:27.702+0000 7f8dd3e00640 1 -- 172.21.15.57:0/1813908847 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4227751516 0 0) 0x7f8dc0001670 con 0x7f8dd4071c00 2024-03-27T10:01:27.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:27.702+0000 7f8dd3e00640 1 -- 172.21.15.57:0/1813908847 >> v1:172.21.15.57:6789/0 conn(0x7f8dd4071c00 legacy=0x7f8dd40b34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:27.693 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:27.702+0000 7f8dd3e00640 1 --2- 172.21.15.57:0/1813908847 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8dbc0039b0 0x7f8dbc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:27.693 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:27.702+0000 7f8dd3e00640 1 --2- 172.21.15.57:0/1813908847 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8dbc004800 0x7f8dbc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:27.693 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:27.702+0000 7f8dd3e00640 1 --2- 172.21.15.57:0/1813908847 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8dbc0051c0 0x7f8dbc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:27.693 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:27.702+0000 7f8dd3e00640 1 -- 172.21.15.57:0/1813908847 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f8dd4071770 con 0x7f8dbc004800 2024-03-27T10:01:27.693 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:27.702+0000 7f8dd3e00640 1 -- 172.21.15.57:0/1813908847 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f8dbc00c110 con 0x7f8dbc0039b0 2024-03-27T10:01:27.693 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:27.702+0000 7f8dd3e00640 1 -- 172.21.15.57:0/1813908847 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f8dbc00c310 con 0x7f8dbc0051c0 2024-03-27T10:01:27.693 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:27.702+0000 7f8dd9000640 1 --2- 172.21.15.57:0/1813908847 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8dbc004800 0x7f8dbc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:27.693 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:27.702+0000 7f8dd9a00640 1 --2- 172.21.15.57:0/1813908847 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8dbc0039b0 0x7f8dbc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:27.693 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:27.703+0000 7f8dda400640 1 --2- 172.21.15.57:0/1813908847 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8dbc0051c0 0x7f8dbc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:27.693 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:27.703+0000 7f8dd9000640 1 -- 172.21.15.57:0/1813908847 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8dbc0051c0 msgr2=0x7f8dbc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:01:27.693 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:27.703+0000 7f8dd9000640 1 --2- 172.21.15.57:0/1813908847 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8dbc0051c0 0x7f8dbc00b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:27.693 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:27.703+0000 7f8dd9000640 1 -- 172.21.15.57:0/1813908847 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8dbc0039b0 msgr2=0x7f8dbc003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:01:27.693 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:27.703+0000 7f8dd9000640 1 --2- 172.21.15.57:0/1813908847 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8dbc0039b0 0x7f8dbc003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:27.693 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:27.703+0000 7f8dd9000640 1 -- 172.21.15.57:0/1813908847 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dbc003520 con 0x7f8dbc004800 2024-03-27T10:01:27.694 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:27.703+0000 7f8dda400640 1 -- 172.21.15.57:0/1813908847 reap_dead start 2024-03-27T10:01:27.695 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:27.704+0000 7f8dd9000640 1 --2- 172.21.15.57:0/1813908847 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8dbc004800 0x7f8dbc004c80 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f8dc000c210 tx=0x7f8dbc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2ae2b23866f0b5b server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:27.695 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:27.704+0000 7f8dd3e00640 1 -- 172.21.15.57:0/1813908847 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dc0007d30 con 0x7f8dbc004800 2024-03-27T10:01:27.695 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:27.704+0000 7f8dd3e00640 1 -- 172.21.15.57:0/1813908847 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8dc0030070 con 0x7f8dbc004800 2024-03-27T10:01:27.695 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:27.704+0000 7f8dd3e00640 1 -- 172.21.15.57:0/1813908847 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dc002cda0 con 0x7f8dbc004800 2024-03-27T10:01:27.695 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:27.705+0000 7f8ddae00640 1 -- 172.21.15.57:0/1813908847 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8dbc004800 msgr2=0x7f8dbc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:27.695 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:27.705+0000 7f8ddae00640 1 --2- 172.21.15.57:0/1813908847 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8dbc004800 0x7f8dbc004c80 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f8dc000c210 tx=0x7f8dbc005830 comp rx=0 tx=0).stop 2024-03-27T10:01:27.695 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:27.705+0000 7f8ddae00640 1 -- 172.21.15.57:0/1813908847 shutdown_connections 2024-03-27T10:01:27.695 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:27.705+0000 7f8ddae00640 1 --2- 172.21.15.57:0/1813908847 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8dbc004800 0x7f8dbc004c80 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:27.695 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:27.705+0000 7f8ddae00640 1 -- 172.21.15.57:0/1813908847 >> 172.21.15.57:0/1813908847 conn(0x7f8dd40b1770 msgr2=0x7f8dd40b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:27.695 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:27.705+0000 7f8ddae00640 1 -- 172.21.15.57:0/1813908847 shutdown_connections 2024-03-27T10:01:27.695 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:27.705+0000 7f8ddae00640 1 -- 172.21.15.57:0/1813908847 wait complete. 2024-03-27T10:01:27.696 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:27.708+0000 7f8ddae00640 1 Processor -- start 2024-03-27T10:01:27.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:27.708+0000 7f8ddae00640 1 -- start start 2024-03-27T10:01:27.699 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:27.710+0000 7f8ddae00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8dbc004800 0x7f8dd406df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:27.699 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:27.710+0000 7f8ddae00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8dd414b7b0 0x7f8dd4156690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:27.699 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:27.710+0000 7f8ddae00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8dd415c890 0x7f8dd415cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:27.699 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:27.710+0000 7f8ddae00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f8dd40b4880 con 0x7f8dbc004800 2024-03-27T10:01:27.699 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:27.710+0000 7f8ddae00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f8dd40b4700 con 0x7f8dd414b7b0 2024-03-27T10:01:27.699 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:27.710+0000 7f8ddae00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f8dd40b41a0 con 0x7f8dd415c890 2024-03-27T10:01:27.700 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:27.710+0000 7f8dd9a00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8dbc004800 0x7f8dd406df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:27.700 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:27.710+0000 7f8dd9a00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8dbc004800 0x7f8dd406df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56182/0 (socket says 172.21.15.57:56182) 2024-03-27T10:01:27.700 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:27.710+0000 7f8dd9a00640 1 -- 172.21.15.57:0/935822697 learned_addr learned my addr 172.21.15.57:0/935822697 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:01:27.700 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:27.710+0000 7f8dd9a00640 1 -- 172.21.15.57:0/935822697 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8dd415c890 msgr2=0x7f8dd415cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:27.700 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:27.710+0000 7f8dd9a00640 1 --2- 172.21.15.57:0/935822697 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8dd415c890 0x7f8dd415cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:27.700 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:27.710+0000 7f8dd9a00640 1 -- 172.21.15.57:0/935822697 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8dd414b7b0 msgr2=0x7f8dd4156690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:27.700 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:27.710+0000 7f8dd9a00640 1 --2- 172.21.15.57:0/935822697 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8dd414b7b0 0x7f8dd4156690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:27.700 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:27.710+0000 7f8dd9a00640 1 -- 172.21.15.57:0/935822697 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dd406cec0 con 0x7f8dbc004800 2024-03-27T10:01:27.701 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:27.711+0000 7f8dd9a00640 1 --2- 172.21.15.57:0/935822697 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8dbc004800 0x7f8dd406df60 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f8dc8008b20 tx=0x7f8dc80071f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:27.701 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:27.711+0000 7f8dd1600640 1 -- 172.21.15.57:0/935822697 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dc8007e30 con 0x7f8dbc004800 2024-03-27T10:01:27.701 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:27.711+0000 7f8dd1600640 1 -- 172.21.15.57:0/935822697 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8dc801a070 con 0x7f8dbc004800 2024-03-27T10:01:27.701 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:27.711+0000 7f8ddae00640 1 -- 172.21.15.57:0/935822697 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8dd406d1a0 con 0x7f8dbc004800 2024-03-27T10:01:27.701 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:27.711+0000 7f8dd1600640 1 -- 172.21.15.57:0/935822697 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dc8015660 con 0x7f8dbc004800 2024-03-27T10:01:27.701 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:27.711+0000 7f8ddae00640 1 -- 172.21.15.57:0/935822697 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8dd406d760 con 0x7f8dbc004800 2024-03-27T10:01:27.702 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:27.713+0000 7f8ddae00640 1 -- 172.21.15.57:0/935822697 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8dd415d250 con 0x7f8dbc004800 2024-03-27T10:01:27.702 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:27.713+0000 7f8dd1600640 1 -- 172.21.15.57:0/935822697 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f8dc8013030 con 0x7f8dbc004800 2024-03-27T10:01:27.703 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:27.715+0000 7f8dd1600640 1 --2- 172.21.15.57:0/935822697 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f8db406c530 0x7f8db406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:27.704 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:27.715+0000 7f8dd1600640 1 -- 172.21.15.57:0/935822697 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f8dc808bff0 con 0x7f8dbc004800 2024-03-27T10:01:27.704 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:27.715+0000 7f8dd9000640 1 --2- 172.21.15.57:0/935822697 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f8db406c530 0x7f8db406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:27.705 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:27.716+0000 7f8dd9000640 1 --2- 172.21.15.57:0/935822697 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f8db406c530 0x7f8db406e9f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f8dc0034000 tx=0x7f8dc0007000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:27.707 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:27.719+0000 7f8dd1600640 1 -- 172.21.15.57:0/935822697 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f8dc8011040 con 0x7f8dbc004800 2024-03-27T10:01:27.955 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:27.966+0000 7f8ddae00640 1 -- 172.21.15.57:0/935822697 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8dd4068540 con 0x7f8dbc004800 2024-03-27T10:01:27.956 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:27.967+0000 7f8dd1600640 1 -- 172.21.15.57:0/935822697 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5181 (secure 0 0 0) 0x7f8dd4068540 con 0x7f8dbc004800 2024-03-27T10:01:27.956 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:01:27.956 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4883,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/534729135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":534729135},{"type":"v1","addr":"172.21.15.57:6835","nonce":534729135}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4886,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/1117032671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1117032671},{"type":"v1","addr":"172.21.15.118:6834","nonce":1117032671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4889,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/2149281891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":2149281891},{"type":"v1","addr":"172.21.15.118:6835","nonce":2149281891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-27T10:01:23.885660+0000","modified":"2024-03-27T10:01:27.013100+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5508},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5508":{"gid":5508,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.57:6837/385124398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":385124398},{"type":"v1","addr":"172.21.15.57:6837","nonce":385124398}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5508,"qdb_cluster":[5508]},"id":2}]} 2024-03-27T10:01:27.956 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 18 2024-03-27T10:01:27.959 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:27.970+0000 7f8ddae00640 1 -- 172.21.15.57:0/935822697 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f8db406c530 msgr2=0x7f8db406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:27.959 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:27.970+0000 7f8ddae00640 1 --2- 172.21.15.57:0/935822697 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f8db406c530 0x7f8db406e9f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f8dc0034000 tx=0x7f8dc0007000 comp rx=0 tx=0).stop 2024-03-27T10:01:27.959 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:27.970+0000 7f8ddae00640 1 -- 172.21.15.57:0/935822697 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8dbc004800 msgr2=0x7f8dd406df60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:27.959 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:27.970+0000 7f8ddae00640 1 --2- 172.21.15.57:0/935822697 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8dbc004800 0x7f8dd406df60 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f8dc8008b20 tx=0x7f8dc80071f0 comp rx=0 tx=0).stop 2024-03-27T10:01:27.959 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:27.970+0000 7f8ddae00640 1 -- 172.21.15.57:0/935822697 shutdown_connections 2024-03-27T10:01:27.959 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:27.970+0000 7f8ddae00640 1 --2- 172.21.15.57:0/935822697 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f8dd415c890 0x7f8dd415cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:27.959 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:27.970+0000 7f8ddae00640 1 --2- 172.21.15.57:0/935822697 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f8db406c530 0x7f8db406e9f0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:27.959 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:27.970+0000 7f8ddae00640 1 --2- 172.21.15.57:0/935822697 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f8dd414b7b0 0x7f8dd4156690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:27.960 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:27.970+0000 7f8ddae00640 1 --2- 172.21.15.57:0/935822697 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f8dbc004800 0x7f8dd406df60 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:27.960 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:27.970+0000 7f8ddae00640 1 -- 172.21.15.57:0/935822697 >> 172.21.15.57:0/935822697 conn(0x7f8dd40b1770 msgr2=0x7f8dd40b0f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:27.960 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:27.970+0000 7f8ddae00640 1 -- 172.21.15.57:0/935822697 shutdown_connections 2024-03-27T10:01:27.960 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:27.970+0000 7f8ddae00640 1 -- 172.21.15.57:0/935822697 wait complete. 2024-03-27T10:01:27.978 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-27T10:01:28.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.189+0000 7f568b800640 1 Processor -- start 2024-03-27T10:01:28.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.189+0000 7f568b800640 1 -- start start 2024-03-27T10:01:28.180 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.191+0000 7f568b800640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f568415e4a0 0x7f56840d14f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:28.180 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.191+0000 7f568b800640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56840cfa40 con 0x7f56840d3fe0 2024-03-27T10:01:28.180 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.191+0000 7f568b800640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f568415f850 con 0x7f56840ceee0 2024-03-27T10:01:28.180 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.191+0000 7f568b800640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f56840d0a10 con 0x7f568415e4a0 2024-03-27T10:01:28.180 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.191+0000 7f5683e00640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f56840d3fe0 0x7f56840d4440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:40374/0 (socket says 172.21.15.57:40374) 2024-03-27T10:01:28.180 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.191+0000 7f5683e00640 1 -- 172.21.15.57:0/2575082774 learned_addr learned my addr 172.21.15.57:0/2575082774 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T10:01:28.182 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.192+0000 7f5688e00640 1 --2- 172.21.15.57:0/2575082774 >> v2:172.21.15.118:3300/0 conn(0x7f568415e4a0 0x7f56840d14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:28.182 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.192+0000 7f5683400640 1 -- 172.21.15.57:0/2575082774 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3135810302 0 0) 0x7f56840cfa40 con 0x7f56840d3fe0 2024-03-27T10:01:28.182 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.192+0000 7f5683400640 1 -- 172.21.15.57:0/2575082774 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f566c003520 con 0x7f56840d3fe0 2024-03-27T10:01:28.182 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.192+0000 7f5683400640 1 -- 172.21.15.57:0/2575082774 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1721590017 0 0) 0x7f566c003520 con 0x7f56840d3fe0 2024-03-27T10:01:28.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.192+0000 7f5683400640 1 -- 172.21.15.57:0/2575082774 >> v2:172.21.15.118:3300/0 conn(0x7f568415e4a0 msgr2=0x7f56840d14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:01:28.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.192+0000 7f5683400640 1 --2- 172.21.15.57:0/2575082774 >> v2:172.21.15.118:3300/0 conn(0x7f568415e4a0 0x7f56840d14f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:28.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.192+0000 7f5683400640 1 -- 172.21.15.57:0/2575082774 >> v1:172.21.15.118:6789/0 conn(0x7f56840ceee0 legacy=0x7f56840cf330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:28.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.192+0000 7f5683400640 1 -- 172.21.15.57:0/2575082774 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56840d0cf0 con 0x7f56840d3fe0 2024-03-27T10:01:28.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.192+0000 7f5683400640 1 -- 172.21.15.57:0/2575082774 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4227751516 0 0) 0x7f5670001670 con 0x7f56840d3fe0 2024-03-27T10:01:28.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.192+0000 7f5683400640 1 -- 172.21.15.57:0/2575082774 >> v1:172.21.15.57:6789/0 conn(0x7f56840d3fe0 legacy=0x7f56840d4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:28.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.192+0000 7f5683400640 1 --2- 172.21.15.57:0/2575082774 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f566c003a00 0x7f566c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:28.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.192+0000 7f5683400640 1 --2- 172.21.15.57:0/2575082774 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f566c004800 0x7f566c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:28.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.192+0000 7f5683400640 1 --2- 172.21.15.57:0/2575082774 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f566c0051c0 0x7f566c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:28.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.193+0000 7f5683400640 1 -- 172.21.15.57:0/2575082774 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f56840d0a10 con 0x7f566c0051c0 2024-03-27T10:01:28.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.193+0000 7f5683400640 1 -- 172.21.15.57:0/2575082774 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f566c00c0c0 con 0x7f566c004800 2024-03-27T10:01:28.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.193+0000 7f5683400640 1 -- 172.21.15.57:0/2575082774 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f566c00c2c0 con 0x7f566c003a00 2024-03-27T10:01:28.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.193+0000 7f5689800640 1 --2- 172.21.15.57:0/2575082774 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f566c0051c0 0x7f566c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:28.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.193+0000 7f5688e00640 1 --2- 172.21.15.57:0/2575082774 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f566c003a00 0x7f566c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:28.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.193+0000 7f5683e00640 1 --2- 172.21.15.57:0/2575082774 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f566c004800 0x7f566c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:28.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.193+0000 7f5689800640 1 -- 172.21.15.57:0/2575082774 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f566c003a00 msgr2=0x7f566c003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:01:28.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.193+0000 7f5689800640 1 --2- 172.21.15.57:0/2575082774 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f566c003a00 0x7f566c003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:28.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.193+0000 7f5689800640 1 -- 172.21.15.57:0/2575082774 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f566c004800 msgr2=0x7f566c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:01:28.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.193+0000 7f5689800640 1 --2- 172.21.15.57:0/2575082774 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f566c004800 0x7f566c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:28.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.193+0000 7f5689800640 1 -- 172.21.15.57:0/2575082774 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f566c003520 con 0x7f566c0051c0 2024-03-27T10:01:28.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.193+0000 7f5688e00640 1 --2- 172.21.15.57:0/2575082774 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f566c003a00 0x7f566c003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T10:01:28.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.195+0000 7f5689800640 1 -- 172.21.15.57:0/2575082774 reap_dead start 2024-03-27T10:01:28.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.195+0000 7f5689800640 1 --2- 172.21.15.57:0/2575082774 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f566c0051c0 0x7f566c00b9c0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f567c001e20 tx=0x7f566c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdb11dacf764eac6 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:28.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.196+0000 7f5683400640 1 -- 172.21.15.57:0/2575082774 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f567c001a70 con 0x7f566c0051c0 2024-03-27T10:01:28.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.196+0000 7f5683400640 1 -- 172.21.15.57:0/2575082774 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f567c003b70 con 0x7f566c0051c0 2024-03-27T10:01:28.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.196+0000 7f5683400640 1 -- 172.21.15.57:0/2575082774 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f567c0050d0 con 0x7f566c0051c0 2024-03-27T10:01:28.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.196+0000 7f568b800640 1 -- 172.21.15.57:0/2575082774 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f566c0051c0 msgr2=0x7f566c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:28.186 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.196+0000 7f568b800640 1 --2- 172.21.15.57:0/2575082774 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f566c0051c0 0x7f566c00b9c0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f567c001e20 tx=0x7f566c005830 comp rx=0 tx=0).stop 2024-03-27T10:01:28.186 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.196+0000 7f568b800640 1 -- 172.21.15.57:0/2575082774 shutdown_connections 2024-03-27T10:01:28.186 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.196+0000 7f568b800640 1 --2- 172.21.15.57:0/2575082774 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f566c0051c0 0x7f566c00b9c0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:28.186 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.196+0000 7f568b800640 1 -- 172.21.15.57:0/2575082774 >> 172.21.15.57:0/2575082774 conn(0x7f568408db50 msgr2=0x7f568409d470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:28.186 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.196+0000 7f568b800640 1 -- 172.21.15.57:0/2575082774 shutdown_connections 2024-03-27T10:01:28.186 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.196+0000 7f568b800640 1 -- 172.21.15.57:0/2575082774 wait complete. 2024-03-27T10:01:28.187 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.198+0000 7f568b800640 1 Processor -- start 2024-03-27T10:01:28.187 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.198+0000 7f568b800640 1 -- start start 2024-03-27T10:01:28.189 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.199+0000 7f568b800640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f566c0051c0 0x7f56840b9850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:28.189 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.199+0000 7f568b800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f56841e8ff0 0x7f56841e7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:28.189 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.199+0000 7f568b800640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f56841e6ac0 0x7f568414c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:28.189 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.199+0000 7f568b800640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f56840cf6c0 con 0x7f566c0051c0 2024-03-27T10:01:28.190 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.199+0000 7f568b800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f56840cf540 con 0x7f56841e8ff0 2024-03-27T10:01:28.190 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.199+0000 7f568b800640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f56840cf840 con 0x7f56841e6ac0 2024-03-27T10:01:28.190 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.200+0000 7f5688e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f566c0051c0 0x7f56840b9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:28.190 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.200+0000 7f5688e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f566c0051c0 0x7f56840b9850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56194/0 (socket says 172.21.15.57:56194) 2024-03-27T10:01:28.190 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.200+0000 7f5688e00640 1 -- 172.21.15.57:0/3479217158 learned_addr learned my addr 172.21.15.57:0/3479217158 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:01:28.190 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.200+0000 7f5688e00640 1 -- 172.21.15.57:0/3479217158 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f56841e6ac0 msgr2=0x7f568414c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:28.190 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.200+0000 7f5688e00640 1 --2- 172.21.15.57:0/3479217158 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f56841e6ac0 0x7f568414c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:28.190 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.200+0000 7f5688e00640 1 -- 172.21.15.57:0/3479217158 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f56841e8ff0 msgr2=0x7f56841e7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:28.190 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.200+0000 7f5683e00640 1 --2- 172.21.15.57:0/3479217158 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f56841e8ff0 0x7f56841e7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:28.190 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.200+0000 7f5688e00640 1 --2- 172.21.15.57:0/3479217158 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f56841e8ff0 0x7f56841e7850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:28.190 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.200+0000 7f5688e00640 1 -- 172.21.15.57:0/3479217158 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56841e7f50 con 0x7f566c0051c0 2024-03-27T10:01:28.191 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.200+0000 7f5683e00640 1 --2- 172.21.15.57:0/3479217158 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f56841e8ff0 0x7f56841e7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T10:01:28.191 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.201+0000 7f5688e00640 1 --2- 172.21.15.57:0/3479217158 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f566c0051c0 0x7f56840b9850 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f5678011570 tx=0x7f5678011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:28.191 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.201+0000 7f5680c00640 1 -- 172.21.15.57:0/3479217158 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5678015870 con 0x7f566c0051c0 2024-03-27T10:01:28.192 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.201+0000 7f5680c00640 1 -- 172.21.15.57:0/3479217158 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5678015a10 con 0x7f566c0051c0 2024-03-27T10:01:28.192 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.201+0000 7f5680c00640 1 -- 172.21.15.57:0/3479217158 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5678015dc0 con 0x7f566c0051c0 2024-03-27T10:01:28.192 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.201+0000 7f568b800640 1 -- 172.21.15.57:0/3479217158 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56841e8230 con 0x7f566c0051c0 2024-03-27T10:01:28.192 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.201+0000 7f568b800640 1 -- 172.21.15.57:0/3479217158 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56841e87f0 con 0x7f566c0051c0 2024-03-27T10:01:28.192 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.202+0000 7f568b800640 1 -- 172.21.15.57:0/3479217158 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5684068620 con 0x7f566c0051c0 2024-03-27T10:01:28.192 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.203+0000 7f5680c00640 1 -- 172.21.15.57:0/3479217158 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f567800f460 con 0x7f566c0051c0 2024-03-27T10:01:28.193 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.204+0000 7f5680c00640 1 --2- 172.21.15.57:0/3479217158 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f566406c560 0x7f566406ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:28.193 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.204+0000 7f5680c00640 1 -- 172.21.15.57:0/3479217158 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f567808c1e0 con 0x7f566c0051c0 2024-03-27T10:01:28.193 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.204+0000 7f5683e00640 1 --2- 172.21.15.57:0/3479217158 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f566406c560 0x7f566406ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:28.194 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.205+0000 7f5683e00640 1 --2- 172.21.15.57:0/3479217158 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f566406c560 0x7f566406ea20 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f5670000c00 tx=0x7f5670000f30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:28.197 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.208+0000 7f5680c00640 1 -- 172.21.15.57:0/3479217158 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f5678019030 con 0x7f566c0051c0 2024-03-27T10:01:28.401 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.412+0000 7f568b800640 1 -- 172.21.15.57:0/3479217158 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f568406c4a0 con 0x7f566c0051c0 2024-03-27T10:01:28.402 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.413+0000 7f5680c00640 1 -- 172.21.15.57:0/3479217158 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) ==== 74+0+16930 (secure 0 0 0) 0x7f567805a540 con 0x7f566c0051c0 2024-03-27T10:01:28.403 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:01:28.403 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":40,"fsid":"7ac43f86-2c16-4a97-98fb-715d3cebc75c","created":"2024-03-27T09:59:04.033417+0000","modified":"2024-03-27T10:01:25.396473+0000","last_up_change":"2024-03-27T09:59:16.969624+0000","last_in_change":"2024-03-27T09:59:07.421690+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-27T09:59:17.253008+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-03-27T10:01:22.035595+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-03-27T10:01:22.866281+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"47b44362-7302-4f2a-b735-582c6c3850cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6801","nonce":2020036298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6803","nonce":2020036298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6807","nonce":2020036298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6805","nonce":2020036298}]},"public_addr":"172.21.15.57:6801/2020036298","cluster_addr":"172.21.15.57:6803/2020036298","heartbeat_back_addr":"172.21.15.57:6807/2020036298","heartbeat_front_addr":"172.21.15.57:6805/2020036298","state":["exists","up"]},{"osd":1,"uuid":"feaf96f0-9431-4188-9a09-da505b40e934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6809","nonce":3190929242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6811","nonce":3190929242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6815","nonce":3190929242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6813","nonce":3190929242}]},"public_addr":"172.21.15.57:6809/3190929242","cluster_addr":"172.21.15.57:6811/3190929242","heartbeat_back_addr":"172.21.15.57:6815/3190929242","heartbeat_front_addr":"172.21.15.57:6813/3190929242","state":["exists","up"]},{"osd":2,"uuid":"21e406e6-cfbc-4fe7-a816-e2420487c95d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6817","nonce":4065849973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6819","nonce":4065849973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6823","nonce":4065849973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6821","nonce":4065849973}]},"public_addr":"172.21.15.57:6817/4065849973","cluster_addr":"172.21.15.57:6819/4065849973","heartbeat_back_addr":"172.21.15.57:6823/4065849973","heartbeat_front_addr":"172.21.15.57:6821/4065849973","state":["exists","up"]},{"osd":3,"uuid":"a389af1d-76c4-4dfc-b215-f983f4931257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6825","nonce":158084809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6827","nonce":158084809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6831","nonce":158084809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6829","nonce":158084809}]},"public_addr":"172.21.15.57:6825/158084809","cluster_addr":"172.21.15.57:6827/158084809","heartbeat_back_addr":"172.21.15.57:6831/158084809","heartbeat_front_addr":"172.21.15.57:6829/158084809","state":["exists","up"]},{"osd":4,"uuid":"e9b05dca-557a-43ee-b43f-9ce5b7d28304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6823","nonce":108719401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6827","nonce":108719401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6831","nonce":108719401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6829","nonce":108719401}]},"public_addr":"172.21.15.118:6823/108719401","cluster_addr":"172.21.15.118:6827/108719401","heartbeat_back_addr":"172.21.15.118:6831/108719401","heartbeat_front_addr":"172.21.15.118:6829/108719401","state":["exists","up"]},{"osd":5,"uuid":"d968177d-44ff-499a-b00a-b147ed879253","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6817","nonce":2704605866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6819","nonce":2704605866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6826","nonce":2704605866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6822","nonce":2704605866}]},"public_addr":"172.21.15.118:6817/2704605866","cluster_addr":"172.21.15.118:6819/2704605866","heartbeat_back_addr":"172.21.15.118:6826/2704605866","heartbeat_front_addr":"172.21.15.118:6822/2704605866","state":["exists","up"]},{"osd":6,"uuid":"e8f98052-e6ad-4cfe-a4a9-0b17a434d54e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6801","nonce":1963659095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6803","nonce":1963659095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6807","nonce":1963659095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6805","nonce":1963659095}]},"public_addr":"172.21.15.118:6801/1963659095","cluster_addr":"172.21.15.118:6803/1963659095","heartbeat_back_addr":"172.21.15.118:6807/1963659095","heartbeat_front_addr":"172.21.15.118:6805/1963659095","state":["exists","up"]},{"osd":7,"uuid":"eccff987-8e51-4a63-845a-cf0a3196d7fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6809","nonce":1955879596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6811","nonce":1955879596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6815","nonce":1955879596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6813","nonce":1955879596}]},"public_addr":"172.21.15.118:6809/1955879596","cluster_addr":"172.21.15.118:6811/1955879596","heartbeat_back_addr":"172.21.15.118:6815/1955879596","heartbeat_front_addr":"172.21.15.118:6813/1955879596","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.721258+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.696610+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.777895+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.806769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.743259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.845687+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:13.020165+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.722294+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-27T10:01:28.405 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.416+0000 7f568b800640 1 -- 172.21.15.57:0/3479217158 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f566406c560 msgr2=0x7f566406ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:28.405 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.416+0000 7f568b800640 1 --2- 172.21.15.57:0/3479217158 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f566406c560 0x7f566406ea20 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f5670000c00 tx=0x7f5670000f30 comp rx=0 tx=0).stop 2024-03-27T10:01:28.405 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.416+0000 7f568b800640 1 -- 172.21.15.57:0/3479217158 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f566c0051c0 msgr2=0x7f56840b9850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:28.405 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.416+0000 7f568b800640 1 --2- 172.21.15.57:0/3479217158 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f566c0051c0 0x7f56840b9850 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f5678011570 tx=0x7f5678011a30 comp rx=0 tx=0).stop 2024-03-27T10:01:28.405 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.416+0000 7f568b800640 1 -- 172.21.15.57:0/3479217158 shutdown_connections 2024-03-27T10:01:28.405 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.416+0000 7f568b800640 1 --2- 172.21.15.57:0/3479217158 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f56841e6ac0 0x7f568414c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:28.405 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.416+0000 7f568b800640 1 --2- 172.21.15.57:0/3479217158 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f566406c560 0x7f566406ea20 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:28.405 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.416+0000 7f568b800640 1 --2- 172.21.15.57:0/3479217158 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f56841e8ff0 0x7f56841e7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:28.406 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.416+0000 7f568b800640 1 --2- 172.21.15.57:0/3479217158 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f566c0051c0 0x7f56840b9850 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:28.406 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.416+0000 7f568b800640 1 -- 172.21.15.57:0/3479217158 >> 172.21.15.57:0/3479217158 conn(0x7f568408db50 msgr2=0x7f56840d0120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:28.406 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.416+0000 7f568b800640 1 -- 172.21.15.57:0/3479217158 shutdown_connections 2024-03-27T10:01:28.406 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.416+0000 7f568b800640 1 -- 172.21.15.57:0/3479217158 wait complete. 2024-03-27T10:01:28.423 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-03-27T10:01:28.423 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-27T10:01:28.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.654+0000 7effabe00640 1 Processor -- start 2024-03-27T10:01:28.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.654+0000 7effabe00640 1 -- start start 2024-03-27T10:01:28.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.656+0000 7effabe00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7effac0d2820 0x7effac0d0780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:28.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.656+0000 7effabe00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7effac0d4b50 0x7effac0d0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:28.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.656+0000 7effabe00640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effac0d2d90 con 0x7effac161830 2024-03-27T10:01:28.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.656+0000 7effabe00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7effac0cf4e0 con 0x7effac0d4b50 2024-03-27T10:01:28.645 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.656+0000 7effabe00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7effac0cee90 con 0x7effac0d2820 2024-03-27T10:01:28.646 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.656+0000 7effaaa00640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7effac161830 0x7effac0cf970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:40380/0 (socket says 172.21.15.57:40380) 2024-03-27T10:01:28.646 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.656+0000 7effaaa00640 1 -- 172.21.15.57:0/1816445512 learned_addr learned my addr 172.21.15.57:0/1816445512 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T10:01:28.646 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.657+0000 7effa2000640 1 --2- 172.21.15.57:0/1816445512 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7effac0d2820 0x7effac0d0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:28.647 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.657+0000 7effab400640 1 --2- 172.21.15.57:0/1816445512 >> v2:172.21.15.118:3300/0 conn(0x7effac0d4b50 0x7effac0d0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:28.647 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.657+0000 7effaa000640 1 -- 172.21.15.57:0/1816445512 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3040788383 0 0) 0x7effac0d2d90 con 0x7effac161830 2024-03-27T10:01:28.647 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.657+0000 7effaa000640 1 -- 172.21.15.57:0/1816445512 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff90003520 con 0x7effac161830 2024-03-27T10:01:28.647 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.657+0000 7effa2000640 1 -- 172.21.15.57:0/1816445512 >> v2:172.21.15.118:3300/0 conn(0x7effac0d4b50 msgr2=0x7effac0d0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:01:28.647 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.657+0000 7effa2000640 1 --2- 172.21.15.57:0/1816445512 >> v2:172.21.15.118:3300/0 conn(0x7effac0d4b50 0x7effac0d0cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:28.647 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.657+0000 7effaa000640 1 -- 172.21.15.57:0/1816445512 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2100832241 0 0) 0x7eff90003520 con 0x7effac161830 2024-03-27T10:01:28.647 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.657+0000 7effa2000640 1 -- 172.21.15.57:0/1816445512 >> v1:172.21.15.57:6789/0 conn(0x7effac161830 legacy=0x7effac0cf970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:28.647 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.658+0000 7effa2000640 1 -- 172.21.15.57:0/1816445512 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effac0cf170 con 0x7effac0d2820 2024-03-27T10:01:28.647 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.659+0000 7effa2000640 1 --2- 172.21.15.57:0/1816445512 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7effac0d2820 0x7effac0d0780 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7eff940097a0 tx=0x7eff9402b710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b7344d4db8b00ba9 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:28.648 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.659+0000 7effaa000640 1 -- 172.21.15.57:0/1816445512 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff94037070 con 0x7effac0d2820 2024-03-27T10:01:28.649 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.659+0000 7effaa000640 1 -- 172.21.15.57:0/1816445512 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff94030510 con 0x7effac0d2820 2024-03-27T10:01:28.649 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.659+0000 7effaa000640 1 -- 172.21.15.57:0/1816445512 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff9c001670 con 0x7effac0d2820 2024-03-27T10:01:28.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.660+0000 7effabe00640 1 -- 172.21.15.57:0/1816445512 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7effac0d2820 msgr2=0x7effac0d0780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:28.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.660+0000 7effabe00640 1 --2- 172.21.15.57:0/1816445512 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7effac0d2820 0x7effac0d0780 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7eff940097a0 tx=0x7eff9402b710 comp rx=0 tx=0).stop 2024-03-27T10:01:28.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.660+0000 7effabe00640 1 -- 172.21.15.57:0/1816445512 shutdown_connections 2024-03-27T10:01:28.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.660+0000 7effabe00640 1 --2- 172.21.15.57:0/1816445512 >> v2:172.21.15.118:3300/0 conn(0x7effac0d4b50 0x7effac0d0cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:28.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.660+0000 7effabe00640 1 --2- 172.21.15.57:0/1816445512 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7effac0d2820 0x7effac0d0780 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:28.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.660+0000 7effabe00640 1 -- 172.21.15.57:0/1816445512 >> 172.21.15.57:0/1816445512 conn(0x7effac0d4030 msgr2=0x7effac0d4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:28.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.661+0000 7effabe00640 1 -- 172.21.15.57:0/1816445512 shutdown_connections 2024-03-27T10:01:28.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.661+0000 7effabe00640 1 -- 172.21.15.57:0/1816445512 wait complete. 2024-03-27T10:01:28.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.663+0000 7effabe00640 1 Processor -- start 2024-03-27T10:01:28.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.664+0000 7effabe00640 1 -- start start 2024-03-27T10:01:28.656 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.665+0000 7effabe00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7effac0d2820 0x7effac0c8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:28.656 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.665+0000 7effabe00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7effac0d4b50 0x7effac15d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:28.656 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.665+0000 7effabe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7effac161830 0x7effac1560c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:28.656 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.665+0000 7effabe00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7effac0ce330 con 0x7effac0d4b50 2024-03-27T10:01:28.656 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.665+0000 7effabe00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7effac0d3070 con 0x7effac161830 2024-03-27T10:01:28.656 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.665+0000 7effabe00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7effac0ce4b0 con 0x7effac0d2820 2024-03-27T10:01:28.656 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.666+0000 7effa2000640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7effac0d4b50 0x7effac15d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:28.656 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.666+0000 7effa2000640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7effac0d4b50 0x7effac15d780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56202/0 (socket says 172.21.15.57:56202) 2024-03-27T10:01:28.657 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.666+0000 7effa2000640 1 -- 172.21.15.57:0/1644988769 learned_addr learned my addr 172.21.15.57:0/1644988769 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:01:28.657 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.666+0000 7effaaa00640 1 --2- 172.21.15.57:0/1644988769 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7effac0d2820 0x7effac0c8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:28.657 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.666+0000 7effab400640 1 --2- 172.21.15.57:0/1644988769 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7effac161830 0x7effac1560c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:28.657 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.666+0000 7effa2000640 1 -- 172.21.15.57:0/1644988769 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7effac0d2820 msgr2=0x7effac0c8fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:28.657 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.666+0000 7effa2000640 1 --2- 172.21.15.57:0/1644988769 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7effac0d2820 0x7effac0c8fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:28.657 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.666+0000 7effa2000640 1 -- 172.21.15.57:0/1644988769 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7effac161830 msgr2=0x7effac1560c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:28.657 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.666+0000 7effa2000640 1 --2- 172.21.15.57:0/1644988769 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7effac161830 0x7effac1560c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:28.657 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.666+0000 7effa2000640 1 -- 172.21.15.57:0/1644988769 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effac15dcc0 con 0x7effac0d4b50 2024-03-27T10:01:28.657 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.666+0000 7effa2000640 1 --2- 172.21.15.57:0/1644988769 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7effac0d4b50 0x7effac15d780 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7eff9402b750 tx=0x7eff940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:28.657 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.667+0000 7effa3400640 1 -- 172.21.15.57:0/1644988769 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff94040020 con 0x7effac0d4b50 2024-03-27T10:01:28.657 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.667+0000 7effa3400640 1 -- 172.21.15.57:0/1644988769 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff94038040 con 0x7effac0d4b50 2024-03-27T10:01:28.657 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.667+0000 7effa3400640 1 -- 172.21.15.57:0/1644988769 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff94037070 con 0x7effac0d4b50 2024-03-27T10:01:28.658 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.667+0000 7effabe00640 1 -- 172.21.15.57:0/1644988769 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effac160be0 con 0x7effac0d4b50 2024-03-27T10:01:28.658 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.667+0000 7effabe00640 1 -- 172.21.15.57:0/1644988769 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effac160900 con 0x7effac0d4b50 2024-03-27T10:01:28.658 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.668+0000 7effabe00640 1 -- 172.21.15.57:0/1644988769 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effac068540 con 0x7effac0d4b50 2024-03-27T10:01:28.658 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.669+0000 7effa3400640 1 -- 172.21.15.57:0/1644988769 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7eff94043020 con 0x7effac0d4b50 2024-03-27T10:01:28.660 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.671+0000 7effa3400640 1 --2- 172.21.15.57:0/1644988769 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7eff8806c530 0x7eff8806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:28.660 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.671+0000 7effa3400640 1 -- 172.21.15.57:0/1644988769 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7eff940acd00 con 0x7effac0d4b50 2024-03-27T10:01:28.660 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.671+0000 7effaaa00640 1 --2- 172.21.15.57:0/1644988769 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7eff8806c530 0x7eff8806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:28.660 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.672+0000 7effaaa00640 1 --2- 172.21.15.57:0/1644988769 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7eff8806c530 0x7eff8806e9f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7eff9c007940 tx=0x7eff9c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:28.664 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.675+0000 7effa3400640 1 -- 172.21.15.57:0/1644988769 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7eff9404a030 con 0x7effac0d4b50 2024-03-27T10:01:28.868 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.879+0000 7effabe00640 1 -- 172.21.15.57:0/1644988769 --> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7effac08d780 con 0x7eff8806c530 2024-03-27T10:01:28.887 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.898+0000 7effa3400640 1 -- 172.21.15.57:0/1644988769 <== mgr.4103 v2:172.21.15.57:6832/485397065 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+244814 (secure 0 0 0) 0x7effac08d780 con 0x7eff8806c530 2024-03-27T10:01:28.891 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:01:28.892 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-03-27T10:01:28.894 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.904+0000 7effabe00640 1 -- 172.21.15.57:0/1644988769 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7eff8806c530 msgr2=0x7eff8806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:28.894 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.904+0000 7effabe00640 1 --2- 172.21.15.57:0/1644988769 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7eff8806c530 0x7eff8806e9f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7eff9c007940 tx=0x7eff9c009040 comp rx=0 tx=0).stop 2024-03-27T10:01:28.894 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.904+0000 7effabe00640 1 -- 172.21.15.57:0/1644988769 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7effac0d4b50 msgr2=0x7effac15d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:28.894 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.905+0000 7effabe00640 1 --2- 172.21.15.57:0/1644988769 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7effac0d4b50 0x7effac15d780 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7eff9402b750 tx=0x7eff940046c0 comp rx=0 tx=0).stop 2024-03-27T10:01:28.894 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.905+0000 7effabe00640 1 -- 172.21.15.57:0/1644988769 shutdown_connections 2024-03-27T10:01:28.894 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.905+0000 7effabe00640 1 --2- 172.21.15.57:0/1644988769 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7eff8806c530 0x7eff8806e9f0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:28.894 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.905+0000 7effabe00640 1 --2- 172.21.15.57:0/1644988769 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7effac161830 0x7effac1560c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:28.895 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.905+0000 7effabe00640 1 --2- 172.21.15.57:0/1644988769 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7effac0d4b50 0x7effac15d780 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:28.895 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.905+0000 7effabe00640 1 --2- 172.21.15.57:0/1644988769 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7effac0d2820 0x7effac0c8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:28.895 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.905+0000 7effabe00640 1 -- 172.21.15.57:0/1644988769 >> 172.21.15.57:0/1644988769 conn(0x7effac0d4030 msgr2=0x7effac06c850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:28.895 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.905+0000 7effabe00640 1 -- 172.21.15.57:0/1644988769 shutdown_connections 2024-03-27T10:01:28.895 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:28.905+0000 7effabe00640 1 -- 172.21.15.57:0/1644988769 wait complete. 2024-03-27T10:01:28.916 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":99,"stamp":"2024-03-27T10:01:27.269011+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591062,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":189,"num_write_kb":2419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":141,"ondisk_log_size":141,"up":102,"acting":102,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":104,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":5,"kb":754974720,"kb_used":241600,"kb_used_data":4588,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754733120,"statfs":{"total":773094113280,"available":772846714880,"internally_reserved":0,"allocated":4698112,"data_stored":2682568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":242535985},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":694,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.891641"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-27T10:01:23.376891+0000","last_change":"2024-03-27T10:01:23.376891+0000","last_active":"2024-03-27T10:01:23.376891+0000","last_peered":"2024-03-27T10:01:23.376891+0000","last_clean":"2024-03-27T10:01:23.376891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-27T10:01:23.376891+0000","last_undegraded":"2024-03-27T10:01:23.376891+0000","last_fullsized":"2024-03-27T10:01:23.376891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-27T10:01:23.376891+0000","last_change":"2024-03-27T10:01:23.376891+0000","last_active":"2024-03-27T10:01:23.376891+0000","last_peered":"2024-03-27T10:01:23.376891+0000","last_clean":"2024-03-27T10:01:23.376891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-27T10:01:23.376891+0000","last_undegraded":"2024-03-27T10:01:23.376891+0000","last_fullsized":"2024-03-27T10:01:23.376891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-27T10:01:23.376891+0000","last_change":"2024-03-27T10:01:23.376891+0000","last_active":"2024-03-27T10:01:23.376891+0000","last_peered":"2024-03-27T10:01:23.376891+0000","last_clean":"2024-03-27T10:01:23.376891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-27T10:01:23.376891+0000","last_undegraded":"2024-03-27T10:01:23.376891+0000","last_fullsized":"2024-03-27T10:01:23.376891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-27T10:01:23.376891+0000","last_change":"2024-03-27T10:01:23.376891+0000","last_active":"2024-03-27T10:01:23.376891+0000","last_peered":"2024-03-27T10:01:23.376891+0000","last_clean":"2024-03-27T10:01:23.376891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-27T10:01:23.376891+0000","last_undegraded":"2024-03-27T10:01:23.376891+0000","last_fullsized":"2024-03-27T10:01:23.376891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-27T10:01:23.376891+0000","last_change":"2024-03-27T10:01:23.376891+0000","last_active":"2024-03-27T10:01:23.376891+0000","last_peered":"2024-03-27T10:01:23.376891+0000","last_clean":"2024-03-27T10:01:23.376891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-27T10:01:23.376891+0000","last_undegraded":"2024-03-27T10:01:23.376891+0000","last_fullsized":"2024-03-27T10:01:23.376891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-27T10:01:23.376891+0000","last_change":"2024-03-27T10:01:23.376891+0000","last_active":"2024-03-27T10:01:23.376891+0000","last_peered":"2024-03-27T10:01:23.376891+0000","last_clean":"2024-03-27T10:01:23.376891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-27T10:01:23.376891+0000","last_undegraded":"2024-03-27T10:01:23.376891+0000","last_fullsized":"2024-03-27T10:01:23.376891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.455835+0000","last_change":"2024-03-27T10:01:24.440200+0000","last_active":"2024-03-27T10:01:25.455835+0000","last_peered":"2024-03-27T10:01:25.455835+0000","last_clean":"2024-03-27T10:01:25.455835+0000","last_became_active":"2024-03-27T10:01:24.438666+0000","last_became_peered":"2024-03-27T10:01:24.438666+0000","last_unstale":"2024-03-27T10:01:25.455835+0000","last_undegraded":"2024-03-27T10:01:25.455835+0000","last_fullsized":"2024-03-27T10:01:25.455835+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T12:34:07.026628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-27T10:01:23.376891+0000","last_change":"2024-03-27T10:01:23.376891+0000","last_active":"2024-03-27T10:01:23.376891+0000","last_peered":"2024-03-27T10:01:23.376891+0000","last_clean":"2024-03-27T10:01:23.376891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-27T10:01:23.376891+0000","last_undegraded":"2024-03-27T10:01:23.376891+0000","last_fullsized":"2024-03-27T10:01:23.376891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-27T10:01:23.376891+0000","last_change":"2024-03-27T10:01:23.376891+0000","last_active":"2024-03-27T10:01:23.376891+0000","last_peered":"2024-03-27T10:01:23.376891+0000","last_clean":"2024-03-27T10:01:23.376891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-27T10:01:23.376891+0000","last_undegraded":"2024-03-27T10:01:23.376891+0000","last_fullsized":"2024-03-27T10:01:23.376891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.455730+0000","last_change":"2024-03-27T10:01:24.448110+0000","last_active":"2024-03-27T10:01:25.455730+0000","last_peered":"2024-03-27T10:01:25.455730+0000","last_clean":"2024-03-27T10:01:25.455730+0000","last_became_active":"2024-03-27T10:01:24.447718+0000","last_became_peered":"2024-03-27T10:01:24.447718+0000","last_unstale":"2024-03-27T10:01:25.455730+0000","last_undegraded":"2024-03-27T10:01:25.455730+0000","last_fullsized":"2024-03-27T10:01:25.455730+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:50:17.621272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.455455+0000","last_change":"2024-03-27T10:01:24.447059+0000","last_active":"2024-03-27T10:01:25.455455+0000","last_peered":"2024-03-27T10:01:25.455455+0000","last_clean":"2024-03-27T10:01:25.455455+0000","last_became_active":"2024-03-27T10:01:24.446543+0000","last_became_peered":"2024-03-27T10:01:24.446543+0000","last_unstale":"2024-03-27T10:01:25.455455+0000","last_undegraded":"2024-03-27T10:01:25.455455+0000","last_fullsized":"2024-03-27T10:01:25.455455+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:59:02.265298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-27T10:01:23.376891+0000","last_change":"2024-03-27T10:01:23.376891+0000","last_active":"2024-03-27T10:01:23.376891+0000","last_peered":"2024-03-27T10:01:23.376891+0000","last_clean":"2024-03-27T10:01:23.376891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-27T10:01:23.376891+0000","last_undegraded":"2024-03-27T10:01:23.376891+0000","last_fullsized":"2024-03-27T10:01:23.376891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.456031+0000","last_change":"2024-03-27T10:01:24.448589+0000","last_active":"2024-03-27T10:01:25.456031+0000","last_peered":"2024-03-27T10:01:25.456031+0000","last_clean":"2024-03-27T10:01:25.456031+0000","last_became_active":"2024-03-27T10:01:24.448296+0000","last_became_peered":"2024-03-27T10:01:24.448296+0000","last_unstale":"2024-03-27T10:01:25.456031+0000","last_undegraded":"2024-03-27T10:01:25.456031+0000","last_fullsized":"2024-03-27T10:01:25.456031+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:42:17.383244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.404907+0000","last_change":"2024-03-27T10:01:24.421324+0000","last_active":"2024-03-27T10:01:25.404907+0000","last_peered":"2024-03-27T10:01:25.404907+0000","last_clean":"2024-03-27T10:01:25.404907+0000","last_became_active":"2024-03-27T10:01:24.420636+0000","last_became_peered":"2024-03-27T10:01:24.420636+0000","last_unstale":"2024-03-27T10:01:25.404907+0000","last_undegraded":"2024-03-27T10:01:25.404907+0000","last_fullsized":"2024-03-27T10:01:25.404907+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:18:04.032991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.455866+0000","last_change":"2024-03-27T10:01:24.451596+0000","last_active":"2024-03-27T10:01:25.455866+0000","last_peered":"2024-03-27T10:01:25.455866+0000","last_clean":"2024-03-27T10:01:25.455866+0000","last_became_active":"2024-03-27T10:01:24.449718+0000","last_became_peered":"2024-03-27T10:01:24.449718+0000","last_unstale":"2024-03-27T10:01:25.455866+0000","last_undegraded":"2024-03-27T10:01:25.455866+0000","last_fullsized":"2024-03-27T10:01:25.455866+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T12:32:12.895181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.821549+0000","last_change":"2024-03-27T10:01:24.444727+0000","last_active":"2024-03-27T10:01:25.821549+0000","last_peered":"2024-03-27T10:01:25.821549+0000","last_clean":"2024-03-27T10:01:25.821549+0000","last_became_active":"2024-03-27T10:01:24.444390+0000","last_became_peered":"2024-03-27T10:01:24.444390+0000","last_unstale":"2024-03-27T10:01:25.821549+0000","last_undegraded":"2024-03-27T10:01:25.821549+0000","last_fullsized":"2024-03-27T10:01:25.821549+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:00:21.588815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.821683+0000","last_change":"2024-03-27T10:01:24.446632+0000","last_active":"2024-03-27T10:01:25.821683+0000","last_peered":"2024-03-27T10:01:25.821683+0000","last_clean":"2024-03-27T10:01:25.821683+0000","last_became_active":"2024-03-27T10:01:24.445901+0000","last_became_peered":"2024-03-27T10:01:24.445901+0000","last_unstale":"2024-03-27T10:01:25.821683+0000","last_undegraded":"2024-03-27T10:01:25.821683+0000","last_fullsized":"2024-03-27T10:01:25.821683+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:14:08.363370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.408443+0000","last_change":"2024-03-27T10:01:24.424661+0000","last_active":"2024-03-27T10:01:25.408443+0000","last_peered":"2024-03-27T10:01:25.408443+0000","last_clean":"2024-03-27T10:01:25.408443+0000","last_became_active":"2024-03-27T10:01:24.424231+0000","last_became_peered":"2024-03-27T10:01:24.424231+0000","last_unstale":"2024-03-27T10:01:25.408443+0000","last_undegraded":"2024-03-27T10:01:25.408443+0000","last_fullsized":"2024-03-27T10:01:25.408443+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:54:52.196447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-27T10:01:23.376891+0000","last_change":"2024-03-27T10:01:23.376891+0000","last_active":"2024-03-27T10:01:23.376891+0000","last_peered":"2024-03-27T10:01:23.376891+0000","last_clean":"2024-03-27T10:01:23.376891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-27T10:01:23.376891+0000","last_undegraded":"2024-03-27T10:01:23.376891+0000","last_fullsized":"2024-03-27T10:01:23.376891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.407902+0000","last_change":"2024-03-27T10:01:24.418982+0000","last_active":"2024-03-27T10:01:25.407902+0000","last_peered":"2024-03-27T10:01:25.407902+0000","last_clean":"2024-03-27T10:01:25.407902+0000","last_became_active":"2024-03-27T10:01:24.418212+0000","last_became_peered":"2024-03-27T10:01:24.418212+0000","last_unstale":"2024-03-27T10:01:25.407902+0000","last_undegraded":"2024-03-27T10:01:25.407902+0000","last_fullsized":"2024-03-27T10:01:25.407902+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:39:32.521473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.455046+0000","last_change":"2024-03-27T10:01:24.459894+0000","last_active":"2024-03-27T10:01:25.455046+0000","last_peered":"2024-03-27T10:01:25.455046+0000","last_clean":"2024-03-27T10:01:25.455046+0000","last_became_active":"2024-03-27T10:01:24.459608+0000","last_became_peered":"2024-03-27T10:01:24.459608+0000","last_unstale":"2024-03-27T10:01:25.455046+0000","last_undegraded":"2024-03-27T10:01:25.455046+0000","last_fullsized":"2024-03-27T10:01:25.455046+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T21:14:27.488462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.405570+0000","last_change":"2024-03-27T10:01:24.452526+0000","last_active":"2024-03-27T10:01:25.405570+0000","last_peered":"2024-03-27T10:01:25.405570+0000","last_clean":"2024-03-27T10:01:25.405570+0000","last_became_active":"2024-03-27T10:01:24.451751+0000","last_became_peered":"2024-03-27T10:01:24.451751+0000","last_unstale":"2024-03-27T10:01:25.405570+0000","last_undegraded":"2024-03-27T10:01:25.405570+0000","last_fullsized":"2024-03-27T10:01:25.405570+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:20:39.588546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.821314+0000","last_change":"2024-03-27T10:01:24.450386+0000","last_active":"2024-03-27T10:01:25.821314+0000","last_peered":"2024-03-27T10:01:25.821314+0000","last_clean":"2024-03-27T10:01:25.821314+0000","last_became_active":"2024-03-27T10:01:24.450105+0000","last_became_peered":"2024-03-27T10:01:24.450105+0000","last_unstale":"2024-03-27T10:01:25.821314+0000","last_undegraded":"2024-03-27T10:01:25.821314+0000","last_fullsized":"2024-03-27T10:01:25.821314+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:51:31.080332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-27T10:01:23.376891+0000","last_change":"2024-03-27T10:01:23.376891+0000","last_active":"2024-03-27T10:01:23.376891+0000","last_peered":"2024-03-27T10:01:23.376891+0000","last_clean":"2024-03-27T10:01:23.376891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-27T10:01:23.376891+0000","last_undegraded":"2024-03-27T10:01:23.376891+0000","last_fullsized":"2024-03-27T10:01:23.376891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.408522+0000","last_change":"2024-03-27T10:01:24.438871+0000","last_active":"2024-03-27T10:01:25.408522+0000","last_peered":"2024-03-27T10:01:25.408522+0000","last_clean":"2024-03-27T10:01:25.408522+0000","last_became_active":"2024-03-27T10:01:24.438526+0000","last_became_peered":"2024-03-27T10:01:24.438526+0000","last_unstale":"2024-03-27T10:01:25.408522+0000","last_undegraded":"2024-03-27T10:01:25.408522+0000","last_fullsized":"2024-03-27T10:01:25.408522+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:53:46.021640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-27T10:01:23.376891+0000","last_change":"2024-03-27T10:01:23.376891+0000","last_active":"2024-03-27T10:01:23.376891+0000","last_peered":"2024-03-27T10:01:23.376891+0000","last_clean":"2024-03-27T10:01:23.376891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-27T10:01:23.376891+0000","last_undegraded":"2024-03-27T10:01:23.376891+0000","last_fullsized":"2024-03-27T10:01:23.376891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.408219+0000","last_change":"2024-03-27T10:01:24.457328+0000","last_active":"2024-03-27T10:01:25.408219+0000","last_peered":"2024-03-27T10:01:25.408219+0000","last_clean":"2024-03-27T10:01:25.408219+0000","last_became_active":"2024-03-27T10:01:24.449361+0000","last_became_peered":"2024-03-27T10:01:24.449361+0000","last_unstale":"2024-03-27T10:01:25.408219+0000","last_undegraded":"2024-03-27T10:01:25.408219+0000","last_fullsized":"2024-03-27T10:01:25.408219+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T21:38:00.656376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.455724+0000","last_change":"2024-03-27T10:01:24.441355+0000","last_active":"2024-03-27T10:01:25.455724+0000","last_peered":"2024-03-27T10:01:25.455724+0000","last_clean":"2024-03-27T10:01:25.455724+0000","last_became_active":"2024-03-27T10:01:24.439538+0000","last_became_peered":"2024-03-27T10:01:24.439538+0000","last_unstale":"2024-03-27T10:01:25.455724+0000","last_undegraded":"2024-03-27T10:01:25.455724+0000","last_fullsized":"2024-03-27T10:01:25.455724+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:14:08.355513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.407790+0000","last_change":"2024-03-27T10:01:24.440009+0000","last_active":"2024-03-27T10:01:25.407790+0000","last_peered":"2024-03-27T10:01:25.407790+0000","last_clean":"2024-03-27T10:01:25.407790+0000","last_became_active":"2024-03-27T10:01:24.439640+0000","last_became_peered":"2024-03-27T10:01:24.439640+0000","last_unstale":"2024-03-27T10:01:25.407790+0000","last_undegraded":"2024-03-27T10:01:25.407790+0000","last_fullsized":"2024-03-27T10:01:25.407790+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:58:54.329192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.407618+0000","last_change":"2024-03-27T10:01:24.415241+0000","last_active":"2024-03-27T10:01:25.407618+0000","last_peered":"2024-03-27T10:01:25.407618+0000","last_clean":"2024-03-27T10:01:25.407618+0000","last_became_active":"2024-03-27T10:01:24.414465+0000","last_became_peered":"2024-03-27T10:01:24.414465+0000","last_unstale":"2024-03-27T10:01:25.407618+0000","last_undegraded":"2024-03-27T10:01:25.407618+0000","last_fullsized":"2024-03-27T10:01:25.407618+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:49:41.790909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.822219+0000","last_change":"2024-03-27T10:01:24.451386+0000","last_active":"2024-03-27T10:01:25.822219+0000","last_peered":"2024-03-27T10:01:25.822219+0000","last_clean":"2024-03-27T10:01:25.822219+0000","last_became_active":"2024-03-27T10:01:24.451077+0000","last_became_peered":"2024-03-27T10:01:24.451077+0000","last_unstale":"2024-03-27T10:01:25.822219+0000","last_undegraded":"2024-03-27T10:01:25.822219+0000","last_fullsized":"2024-03-27T10:01:25.822219+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T21:14:27.488462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-27T10:01:23.376891+0000","last_change":"2024-03-27T10:01:23.376891+0000","last_active":"2024-03-27T10:01:23.376891+0000","last_peered":"2024-03-27T10:01:23.376891+0000","last_clean":"2024-03-27T10:01:23.376891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-27T10:01:23.376891+0000","last_undegraded":"2024-03-27T10:01:23.376891+0000","last_fullsized":"2024-03-27T10:01:23.376891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.821819+0000","last_change":"2024-03-27T10:01:24.441443+0000","last_active":"2024-03-27T10:01:25.821819+0000","last_peered":"2024-03-27T10:01:25.821819+0000","last_clean":"2024-03-27T10:01:25.821819+0000","last_became_active":"2024-03-27T10:01:24.441085+0000","last_became_peered":"2024-03-27T10:01:24.441085+0000","last_unstale":"2024-03-27T10:01:25.821819+0000","last_undegraded":"2024-03-27T10:01:25.821819+0000","last_fullsized":"2024-03-27T10:01:25.821819+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T20:15:24.993936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"39'4","reported_seq":18,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.408571+0000","last_change":"2024-03-27T10:01:23.417653+0000","last_active":"2024-03-27T10:01:25.408571+0000","last_peered":"2024-03-27T10:01:25.408571+0000","last_clean":"2024-03-27T10:01:25.408571+0000","last_became_active":"2024-03-27T10:01:23.417337+0000","last_became_peered":"2024-03-27T10:01:23.417337+0000","last_unstale":"2024-03-27T10:01:25.408571+0000","last_undegraded":"2024-03-27T10:01:25.408571+0000","last_fullsized":"2024-03-27T10:01:25.408571+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_clean_scrub_stamp":"2024-03-27T10:01:22.351623+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:53:22.113616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-27T10:01:23.376891+0000","last_change":"2024-03-27T10:01:23.376891+0000","last_active":"2024-03-27T10:01:23.376891+0000","last_peered":"2024-03-27T10:01:23.376891+0000","last_clean":"2024-03-27T10:01:23.376891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-27T10:01:23.376891+0000","last_undegraded":"2024-03-27T10:01:23.376891+0000","last_fullsized":"2024-03-27T10:01:23.376891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-27T10:01:22.351623+0000","last_change":"2024-03-27T10:01:22.351623+0000","last_active":"2024-03-27T10:01:22.351623+0000","last_peered":"2024-03-27T10:01:22.351623+0000","last_clean":"2024-03-27T10:01:22.351623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-27T10:01:22.351623+0000","last_undegraded":"2024-03-27T10:01:22.351623+0000","last_fullsized":"2024-03-27T10:01:22.351623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_clean_scrub_stamp":"2024-03-27T10:01:22.351623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.406612+0000","last_change":"2024-03-27T10:01:24.428705+0000","last_active":"2024-03-27T10:01:25.406612+0000","last_peered":"2024-03-27T10:01:25.406612+0000","last_clean":"2024-03-27T10:01:25.406612+0000","last_became_active":"2024-03-27T10:01:24.428257+0000","last_became_peered":"2024-03-27T10:01:24.428257+0000","last_unstale":"2024-03-27T10:01:25.406612+0000","last_undegraded":"2024-03-27T10:01:25.406612+0000","last_fullsized":"2024-03-27T10:01:25.406612+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:46:41.476976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-27T10:01:22.351623+0000","last_change":"2024-03-27T10:01:22.351623+0000","last_active":"2024-03-27T10:01:22.351623+0000","last_peered":"2024-03-27T10:01:22.351623+0000","last_clean":"2024-03-27T10:01:22.351623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-27T10:01:22.351623+0000","last_undegraded":"2024-03-27T10:01:22.351623+0000","last_fullsized":"2024-03-27T10:01:22.351623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_clean_scrub_stamp":"2024-03-27T10:01:22.351623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-27T10:01:23.376891+0000","last_change":"2024-03-27T10:01:23.376891+0000","last_active":"2024-03-27T10:01:23.376891+0000","last_peered":"2024-03-27T10:01:23.376891+0000","last_clean":"2024-03-27T10:01:23.376891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-27T10:01:23.376891+0000","last_undegraded":"2024-03-27T10:01:23.376891+0000","last_fullsized":"2024-03-27T10:01:23.376891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"39'2","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.406614+0000","last_change":"2024-03-27T10:01:23.417257+0000","last_active":"2024-03-27T10:01:25.406614+0000","last_peered":"2024-03-27T10:01:25.406614+0000","last_clean":"2024-03-27T10:01:25.406614+0000","last_became_active":"2024-03-27T10:01:23.416698+0000","last_became_peered":"2024-03-27T10:01:23.416698+0000","last_unstale":"2024-03-27T10:01:25.406614+0000","last_undegraded":"2024-03-27T10:01:25.406614+0000","last_fullsized":"2024-03-27T10:01:25.406614+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_clean_scrub_stamp":"2024-03-27T10:01:22.351623+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:25:40.019001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-27T10:01:23.376891+0000","last_change":"2024-03-27T10:01:23.376891+0000","last_active":"2024-03-27T10:01:23.376891+0000","last_peered":"2024-03-27T10:01:23.376891+0000","last_clean":"2024-03-27T10:01:23.376891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-27T10:01:23.376891+0000","last_undegraded":"2024-03-27T10:01:23.376891+0000","last_fullsized":"2024-03-27T10:01:23.376891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"39'1","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.455380+0000","last_change":"2024-03-27T10:01:23.433449+0000","last_active":"2024-03-27T10:01:25.455380+0000","last_peered":"2024-03-27T10:01:25.455380+0000","last_clean":"2024-03-27T10:01:25.455380+0000","last_became_active":"2024-03-27T10:01:23.432054+0000","last_became_peered":"2024-03-27T10:01:23.432054+0000","last_unstale":"2024-03-27T10:01:25.455380+0000","last_undegraded":"2024-03-27T10:01:25.455380+0000","last_fullsized":"2024-03-27T10:01:25.455380+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_clean_scrub_stamp":"2024-03-27T10:01:22.351623+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:47:07.830155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.456203+0000","last_change":"2024-03-27T10:01:24.451202+0000","last_active":"2024-03-27T10:01:25.456203+0000","last_peered":"2024-03-27T10:01:25.456203+0000","last_clean":"2024-03-27T10:01:25.456203+0000","last_became_active":"2024-03-27T10:01:24.450849+0000","last_became_peered":"2024-03-27T10:01:24.450849+0000","last_unstale":"2024-03-27T10:01:25.456203+0000","last_undegraded":"2024-03-27T10:01:25.456203+0000","last_fullsized":"2024-03-27T10:01:25.456203+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T12:33:33.935860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"39'1","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.821644+0000","last_change":"2024-03-27T10:01:23.436261+0000","last_active":"2024-03-27T10:01:25.821644+0000","last_peered":"2024-03-27T10:01:25.821644+0000","last_clean":"2024-03-27T10:01:25.821644+0000","last_became_active":"2024-03-27T10:01:23.435336+0000","last_became_peered":"2024-03-27T10:01:23.435336+0000","last_unstale":"2024-03-27T10:01:25.821644+0000","last_undegraded":"2024-03-27T10:01:25.821644+0000","last_fullsized":"2024-03-27T10:01:25.821644+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_clean_scrub_stamp":"2024-03-27T10:01:22.351623+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T22:00:49.260875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.405775+0000","last_change":"2024-03-27T10:01:24.444057+0000","last_active":"2024-03-27T10:01:25.405775+0000","last_peered":"2024-03-27T10:01:25.405775+0000","last_clean":"2024-03-27T10:01:25.405775+0000","last_became_active":"2024-03-27T10:01:24.443657+0000","last_became_peered":"2024-03-27T10:01:24.443657+0000","last_unstale":"2024-03-27T10:01:25.405775+0000","last_undegraded":"2024-03-27T10:01:25.405775+0000","last_fullsized":"2024-03-27T10:01:25.405775+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:14:08.363370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-27T10:01:22.351623+0000","last_change":"2024-03-27T10:01:22.351623+0000","last_active":"2024-03-27T10:01:22.351623+0000","last_peered":"2024-03-27T10:01:22.351623+0000","last_clean":"2024-03-27T10:01:22.351623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-27T10:01:22.351623+0000","last_undegraded":"2024-03-27T10:01:22.351623+0000","last_fullsized":"2024-03-27T10:01:22.351623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_clean_scrub_stamp":"2024-03-27T10:01:22.351623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-27T10:01:23.376891+0000","last_change":"2024-03-27T10:01:23.376891+0000","last_active":"2024-03-27T10:01:23.376891+0000","last_peered":"2024-03-27T10:01:23.376891+0000","last_clean":"2024-03-27T10:01:23.376891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-27T10:01:23.376891+0000","last_undegraded":"2024-03-27T10:01:23.376891+0000","last_fullsized":"2024-03-27T10:01:23.376891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.404498+0000","last_change":"2024-03-27T10:01:23.421996+0000","last_active":"2024-03-27T10:01:25.404498+0000","last_peered":"2024-03-27T10:01:25.404498+0000","last_clean":"2024-03-27T10:01:25.404498+0000","last_became_active":"2024-03-27T10:01:23.419980+0000","last_became_peered":"2024-03-27T10:01:23.419980+0000","last_unstale":"2024-03-27T10:01:25.404498+0000","last_undegraded":"2024-03-27T10:01:25.404498+0000","last_fullsized":"2024-03-27T10:01:25.404498+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_clean_scrub_stamp":"2024-03-27T10:01:22.351623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:41:39.521966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-27T10:01:23.376891+0000","last_change":"2024-03-27T10:01:23.376891+0000","last_active":"2024-03-27T10:01:23.376891+0000","last_peered":"2024-03-27T10:01:23.376891+0000","last_clean":"2024-03-27T10:01:23.376891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-27T10:01:23.376891+0000","last_undegraded":"2024-03-27T10:01:23.376891+0000","last_fullsized":"2024-03-27T10:01:23.376891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-27T10:01:22.351623+0000","last_change":"2024-03-27T10:01:22.351623+0000","last_active":"2024-03-27T10:01:22.351623+0000","last_peered":"2024-03-27T10:01:22.351623+0000","last_clean":"2024-03-27T10:01:22.351623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-27T10:01:22.351623+0000","last_undegraded":"2024-03-27T10:01:22.351623+0000","last_fullsized":"2024-03-27T10:01:22.351623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_clean_scrub_stamp":"2024-03-27T10:01:22.351623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.822432+0000","last_change":"2024-03-27T10:01:24.442708+0000","last_active":"2024-03-27T10:01:25.822432+0000","last_peered":"2024-03-27T10:01:25.822432+0000","last_clean":"2024-03-27T10:01:25.822432+0000","last_became_active":"2024-03-27T10:01:24.442381+0000","last_became_peered":"2024-03-27T10:01:24.442381+0000","last_unstale":"2024-03-27T10:01:25.822432+0000","last_undegraded":"2024-03-27T10:01:25.822432+0000","last_fullsized":"2024-03-27T10:01:25.822432+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:41:23.568822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.456030+0000","last_change":"2024-03-27T10:01:23.428934+0000","last_active":"2024-03-27T10:01:25.456030+0000","last_peered":"2024-03-27T10:01:25.456030+0000","last_clean":"2024-03-27T10:01:25.456030+0000","last_became_active":"2024-03-27T10:01:23.427482+0000","last_became_peered":"2024-03-27T10:01:23.427482+0000","last_unstale":"2024-03-27T10:01:25.456030+0000","last_undegraded":"2024-03-27T10:01:25.456030+0000","last_fullsized":"2024-03-27T10:01:25.456030+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_clean_scrub_stamp":"2024-03-27T10:01:22.351623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:58:53.303924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-27T10:01:23.376891+0000","last_change":"2024-03-27T10:01:23.376891+0000","last_active":"2024-03-27T10:01:23.376891+0000","last_peered":"2024-03-27T10:01:23.376891+0000","last_clean":"2024-03-27T10:01:23.376891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-27T10:01:23.376891+0000","last_undegraded":"2024-03-27T10:01:23.376891+0000","last_fullsized":"2024-03-27T10:01:23.376891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"39'3","reported_seq":17,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.455731+0000","last_change":"2024-03-27T10:01:23.433084+0000","last_active":"2024-03-27T10:01:25.455731+0000","last_peered":"2024-03-27T10:01:25.455731+0000","last_clean":"2024-03-27T10:01:25.455731+0000","last_became_active":"2024-03-27T10:01:23.432230+0000","last_became_peered":"2024-03-27T10:01:23.432230+0000","last_unstale":"2024-03-27T10:01:25.455731+0000","last_undegraded":"2024-03-27T10:01:25.455731+0000","last_fullsized":"2024-03-27T10:01:25.455731+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_clean_scrub_stamp":"2024-03-27T10:01:22.351623+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T12:51:32.925978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.405695+0000","last_change":"2024-03-27T10:01:24.449675+0000","last_active":"2024-03-27T10:01:25.405695+0000","last_peered":"2024-03-27T10:01:25.405695+0000","last_clean":"2024-03-27T10:01:25.405695+0000","last_became_active":"2024-03-27T10:01:24.449365+0000","last_became_peered":"2024-03-27T10:01:24.449365+0000","last_unstale":"2024-03-27T10:01:25.405695+0000","last_undegraded":"2024-03-27T10:01:25.405695+0000","last_fullsized":"2024-03-27T10:01:25.405695+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:00:21.588815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-27T10:01:22.351623+0000","last_change":"2024-03-27T10:01:22.351623+0000","last_active":"2024-03-27T10:01:22.351623+0000","last_peered":"2024-03-27T10:01:22.351623+0000","last_clean":"2024-03-27T10:01:22.351623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-27T10:01:22.351623+0000","last_undegraded":"2024-03-27T10:01:22.351623+0000","last_fullsized":"2024-03-27T10:01:22.351623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_clean_scrub_stamp":"2024-03-27T10:01:22.351623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-27T10:01:23.376891+0000","last_change":"2024-03-27T10:01:23.376891+0000","last_active":"2024-03-27T10:01:23.376891+0000","last_peered":"2024-03-27T10:01:23.376891+0000","last_clean":"2024-03-27T10:01:23.376891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-27T10:01:23.376891+0000","last_undegraded":"2024-03-27T10:01:23.376891+0000","last_fullsized":"2024-03-27T10:01:23.376891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-27T10:01:22.351623+0000","last_change":"2024-03-27T10:01:22.351623+0000","last_active":"2024-03-27T10:01:22.351623+0000","last_peered":"2024-03-27T10:01:22.351623+0000","last_clean":"2024-03-27T10:01:22.351623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-27T10:01:22.351623+0000","last_undegraded":"2024-03-27T10:01:22.351623+0000","last_fullsized":"2024-03-27T10:01:22.351623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_clean_scrub_stamp":"2024-03-27T10:01:22.351623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-27T10:01:23.376891+0000","last_change":"2024-03-27T10:01:23.376891+0000","last_active":"2024-03-27T10:01:23.376891+0000","last_peered":"2024-03-27T10:01:23.376891+0000","last_clean":"2024-03-27T10:01:23.376891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-27T10:01:23.376891+0000","last_undegraded":"2024-03-27T10:01:23.376891+0000","last_fullsized":"2024-03-27T10:01:23.376891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-27T10:01:22.351623+0000","last_change":"2024-03-27T10:01:22.351623+0000","last_active":"2024-03-27T10:01:22.351623+0000","last_peered":"2024-03-27T10:01:22.351623+0000","last_clean":"2024-03-27T10:01:22.351623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-27T10:01:22.351623+0000","last_undegraded":"2024-03-27T10:01:22.351623+0000","last_fullsized":"2024-03-27T10:01:22.351623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_clean_scrub_stamp":"2024-03-27T10:01:22.351623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.821337+0000","last_change":"2024-03-27T10:01:24.457303+0000","last_active":"2024-03-27T10:01:25.821337+0000","last_peered":"2024-03-27T10:01:25.821337+0000","last_clean":"2024-03-27T10:01:25.821337+0000","last_became_active":"2024-03-27T10:01:24.456538+0000","last_became_peered":"2024-03-27T10:01:24.456538+0000","last_unstale":"2024-03-27T10:01:25.821337+0000","last_undegraded":"2024-03-27T10:01:25.821337+0000","last_fullsized":"2024-03-27T10:01:25.821337+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:20:39.588546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.407066+0000","last_change":"2024-03-27T10:01:23.415166+0000","last_active":"2024-03-27T10:01:25.407066+0000","last_peered":"2024-03-27T10:01:25.407066+0000","last_clean":"2024-03-27T10:01:25.407066+0000","last_became_active":"2024-03-27T10:01:23.413486+0000","last_became_peered":"2024-03-27T10:01:23.413486+0000","last_unstale":"2024-03-27T10:01:25.407066+0000","last_undegraded":"2024-03-27T10:01:25.407066+0000","last_fullsized":"2024-03-27T10:01:25.407066+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_clean_scrub_stamp":"2024-03-27T10:01:22.351623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:19:26.891312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-27T10:01:23.376891+0000","last_change":"2024-03-27T10:01:23.376891+0000","last_active":"2024-03-27T10:01:23.376891+0000","last_peered":"2024-03-27T10:01:23.376891+0000","last_clean":"2024-03-27T10:01:23.376891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-27T10:01:23.376891+0000","last_undegraded":"2024-03-27T10:01:23.376891+0000","last_fullsized":"2024-03-27T10:01:23.376891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"39'8","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.821438+0000","last_change":"2024-03-27T10:01:23.436147+0000","last_active":"2024-03-27T10:01:25.821438+0000","last_peered":"2024-03-27T10:01:25.821438+0000","last_clean":"2024-03-27T10:01:25.821438+0000","last_became_active":"2024-03-27T10:01:23.435785+0000","last_became_peered":"2024-03-27T10:01:23.435785+0000","last_unstale":"2024-03-27T10:01:25.821438+0000","last_undegraded":"2024-03-27T10:01:25.821438+0000","last_fullsized":"2024-03-27T10:01:25.821438+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_clean_scrub_stamp":"2024-03-27T10:01:22.351623+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:53:22.113616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-27T10:01:23.376891+0000","last_change":"2024-03-27T10:01:23.376891+0000","last_active":"2024-03-27T10:01:23.376891+0000","last_peered":"2024-03-27T10:01:23.376891+0000","last_clean":"2024-03-27T10:01:23.376891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-27T10:01:23.376891+0000","last_undegraded":"2024-03-27T10:01:23.376891+0000","last_fullsized":"2024-03-27T10:01:23.376891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"39'1","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.456240+0000","last_change":"2024-03-27T10:01:23.434290+0000","last_active":"2024-03-27T10:01:25.456240+0000","last_peered":"2024-03-27T10:01:25.456240+0000","last_clean":"2024-03-27T10:01:25.456240+0000","last_became_active":"2024-03-27T10:01:23.433907+0000","last_became_peered":"2024-03-27T10:01:23.433907+0000","last_unstale":"2024-03-27T10:01:25.456240+0000","last_undegraded":"2024-03-27T10:01:25.456240+0000","last_fullsized":"2024-03-27T10:01:25.456240+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_clean_scrub_stamp":"2024-03-27T10:01:22.351623+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T12:59:54.269125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.455644+0000","last_change":"2024-03-27T10:01:24.453606+0000","last_active":"2024-03-27T10:01:25.455644+0000","last_peered":"2024-03-27T10:01:25.455644+0000","last_clean":"2024-03-27T10:01:25.455644+0000","last_became_active":"2024-03-27T10:01:24.452959+0000","last_became_peered":"2024-03-27T10:01:24.452959+0000","last_unstale":"2024-03-27T10:01:25.455644+0000","last_undegraded":"2024-03-27T10:01:25.455644+0000","last_fullsized":"2024-03-27T10:01:25.455644+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:58:30.004453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"39'2","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.406348+0000","last_change":"2024-03-27T10:01:23.431781+0000","last_active":"2024-03-27T10:01:25.406348+0000","last_peered":"2024-03-27T10:01:25.406348+0000","last_clean":"2024-03-27T10:01:25.406348+0000","last_became_active":"2024-03-27T10:01:23.431483+0000","last_became_peered":"2024-03-27T10:01:23.431483+0000","last_unstale":"2024-03-27T10:01:25.406348+0000","last_undegraded":"2024-03-27T10:01:25.406348+0000","last_fullsized":"2024-03-27T10:01:25.406348+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_clean_scrub_stamp":"2024-03-27T10:01:22.351623+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:47:07.830155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.406008+0000","last_change":"2024-03-27T10:01:24.437506+0000","last_active":"2024-03-27T10:01:25.406008+0000","last_peered":"2024-03-27T10:01:25.406008+0000","last_clean":"2024-03-27T10:01:25.406008+0000","last_became_active":"2024-03-27T10:01:24.437208+0000","last_became_peered":"2024-03-27T10:01:24.437208+0000","last_unstale":"2024-03-27T10:01:25.406008+0000","last_undegraded":"2024-03-27T10:01:25.406008+0000","last_fullsized":"2024-03-27T10:01:25.406008+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T20:15:24.993936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-27T10:01:22.351623+0000","last_change":"2024-03-27T10:01:22.351623+0000","last_active":"2024-03-27T10:01:22.351623+0000","last_peered":"2024-03-27T10:01:22.351623+0000","last_clean":"2024-03-27T10:01:22.351623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-27T10:01:22.351623+0000","last_undegraded":"2024-03-27T10:01:22.351623+0000","last_fullsized":"2024-03-27T10:01:22.351623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_clean_scrub_stamp":"2024-03-27T10:01:22.351623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-27T10:01:23.376891+0000","last_change":"2024-03-27T10:01:23.376891+0000","last_active":"2024-03-27T10:01:23.376891+0000","last_peered":"2024-03-27T10:01:23.376891+0000","last_clean":"2024-03-27T10:01:23.376891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-27T10:01:23.376891+0000","last_undegraded":"2024-03-27T10:01:23.376891+0000","last_fullsized":"2024-03-27T10:01:23.376891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-27T10:01:22.351623+0000","last_change":"2024-03-27T10:01:22.351623+0000","last_active":"2024-03-27T10:01:22.351623+0000","last_peered":"2024-03-27T10:01:22.351623+0000","last_clean":"2024-03-27T10:01:22.351623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-27T10:01:22.351623+0000","last_undegraded":"2024-03-27T10:01:22.351623+0000","last_fullsized":"2024-03-27T10:01:22.351623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_clean_scrub_stamp":"2024-03-27T10:01:22.351623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.821992+0000","last_change":"2024-03-27T10:01:24.463797+0000","last_active":"2024-03-27T10:01:25.821992+0000","last_peered":"2024-03-27T10:01:25.821992+0000","last_clean":"2024-03-27T10:01:25.821992+0000","last_became_active":"2024-03-27T10:01:24.463563+0000","last_became_peered":"2024-03-27T10:01:24.463563+0000","last_unstale":"2024-03-27T10:01:25.821992+0000","last_undegraded":"2024-03-27T10:01:25.821992+0000","last_fullsized":"2024-03-27T10:01:25.821992+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:03:12.303809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-27T10:01:22.351623+0000","last_change":"2024-03-27T10:01:22.351623+0000","last_active":"2024-03-27T10:01:22.351623+0000","last_peered":"2024-03-27T10:01:22.351623+0000","last_clean":"2024-03-27T10:01:22.351623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-27T10:01:22.351623+0000","last_undegraded":"2024-03-27T10:01:22.351623+0000","last_fullsized":"2024-03-27T10:01:22.351623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_clean_scrub_stamp":"2024-03-27T10:01:22.351623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-27T10:01:23.376891+0000","last_change":"2024-03-27T10:01:23.376891+0000","last_active":"2024-03-27T10:01:23.376891+0000","last_peered":"2024-03-27T10:01:23.376891+0000","last_clean":"2024-03-27T10:01:23.376891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-27T10:01:23.376891+0000","last_undegraded":"2024-03-27T10:01:23.376891+0000","last_fullsized":"2024-03-27T10:01:23.376891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-27T10:01:22.351623+0000","last_change":"2024-03-27T10:01:22.351623+0000","last_active":"2024-03-27T10:01:22.351623+0000","last_peered":"2024-03-27T10:01:22.351623+0000","last_clean":"2024-03-27T10:01:22.351623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-27T10:01:22.351623+0000","last_undegraded":"2024-03-27T10:01:22.351623+0000","last_fullsized":"2024-03-27T10:01:22.351623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_clean_scrub_stamp":"2024-03-27T10:01:22.351623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.455171+0000","last_change":"2024-03-27T10:01:24.440879+0000","last_active":"2024-03-27T10:01:25.455171+0000","last_peered":"2024-03-27T10:01:25.455171+0000","last_clean":"2024-03-27T10:01:25.455171+0000","last_became_active":"2024-03-27T10:01:24.440597+0000","last_became_peered":"2024-03-27T10:01:24.440597+0000","last_unstale":"2024-03-27T10:01:25.455171+0000","last_undegraded":"2024-03-27T10:01:25.455171+0000","last_fullsized":"2024-03-27T10:01:25.455171+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:41:23.568822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.822095+0000","last_change":"2024-03-27T10:01:23.436698+0000","last_active":"2024-03-27T10:01:25.822095+0000","last_peered":"2024-03-27T10:01:25.822095+0000","last_clean":"2024-03-27T10:01:25.822095+0000","last_became_active":"2024-03-27T10:01:23.436340+0000","last_became_peered":"2024-03-27T10:01:23.436340+0000","last_unstale":"2024-03-27T10:01:25.822095+0000","last_undegraded":"2024-03-27T10:01:25.822095+0000","last_fullsized":"2024-03-27T10:01:25.822095+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_clean_scrub_stamp":"2024-03-27T10:01:22.351623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:42:33.589563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-27T10:01:23.376891+0000","last_change":"2024-03-27T10:01:23.376891+0000","last_active":"2024-03-27T10:01:23.376891+0000","last_peered":"2024-03-27T10:01:23.376891+0000","last_clean":"2024-03-27T10:01:23.376891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-27T10:01:23.376891+0000","last_undegraded":"2024-03-27T10:01:23.376891+0000","last_fullsized":"2024-03-27T10:01:23.376891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-27T10:01:22.351623+0000","last_change":"2024-03-27T10:01:22.351623+0000","last_active":"2024-03-27T10:01:22.351623+0000","last_peered":"2024-03-27T10:01:22.351623+0000","last_clean":"2024-03-27T10:01:22.351623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-27T10:01:22.351623+0000","last_undegraded":"2024-03-27T10:01:22.351623+0000","last_fullsized":"2024-03-27T10:01:22.351623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_clean_scrub_stamp":"2024-03-27T10:01:22.351623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-27T10:01:23.376891+0000","last_change":"2024-03-27T10:01:23.376891+0000","last_active":"2024-03-27T10:01:23.376891+0000","last_peered":"2024-03-27T10:01:23.376891+0000","last_clean":"2024-03-27T10:01:23.376891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-27T10:01:23.376891+0000","last_undegraded":"2024-03-27T10:01:23.376891+0000","last_fullsized":"2024-03-27T10:01:23.376891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"39'2","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.456440+0000","last_change":"2024-03-27T10:01:23.432905+0000","last_active":"2024-03-27T10:01:25.456440+0000","last_peered":"2024-03-27T10:01:25.456440+0000","last_clean":"2024-03-27T10:01:25.456440+0000","last_became_active":"2024-03-27T10:01:23.432623+0000","last_became_peered":"2024-03-27T10:01:23.432623+0000","last_unstale":"2024-03-27T10:01:25.456440+0000","last_undegraded":"2024-03-27T10:01:25.456440+0000","last_fullsized":"2024-03-27T10:01:25.456440+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_clean_scrub_stamp":"2024-03-27T10:01:22.351623+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:49:40.765641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.822462+0000","last_change":"2024-03-27T10:01:24.444504+0000","last_active":"2024-03-27T10:01:25.822462+0000","last_peered":"2024-03-27T10:01:25.822462+0000","last_clean":"2024-03-27T10:01:25.822462+0000","last_became_active":"2024-03-27T10:01:24.443902+0000","last_became_peered":"2024-03-27T10:01:24.443902+0000","last_unstale":"2024-03-27T10:01:25.822462+0000","last_undegraded":"2024-03-27T10:01:25.822462+0000","last_fullsized":"2024-03-27T10:01:25.822462+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T12:55:05.971460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-27T10:01:22.351623+0000","last_change":"2024-03-27T10:01:22.351623+0000","last_active":"2024-03-27T10:01:22.351623+0000","last_peered":"2024-03-27T10:01:22.351623+0000","last_clean":"2024-03-27T10:01:22.351623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-27T10:01:22.351623+0000","last_undegraded":"2024-03-27T10:01:22.351623+0000","last_fullsized":"2024-03-27T10:01:22.351623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_clean_scrub_stamp":"2024-03-27T10:01:22.351623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-27T10:01:23.376891+0000","last_change":"2024-03-27T10:01:23.376891+0000","last_active":"2024-03-27T10:01:23.376891+0000","last_peered":"2024-03-27T10:01:23.376891+0000","last_clean":"2024-03-27T10:01:23.376891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-27T10:01:23.376891+0000","last_undegraded":"2024-03-27T10:01:23.376891+0000","last_fullsized":"2024-03-27T10:01:23.376891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-27T10:01:22.351623+0000","last_change":"2024-03-27T10:01:22.351623+0000","last_active":"2024-03-27T10:01:22.351623+0000","last_peered":"2024-03-27T10:01:22.351623+0000","last_clean":"2024-03-27T10:01:22.351623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-27T10:01:22.351623+0000","last_undegraded":"2024-03-27T10:01:22.351623+0000","last_fullsized":"2024-03-27T10:01:22.351623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_clean_scrub_stamp":"2024-03-27T10:01:22.351623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-27T10:01:23.376891+0000","last_change":"2024-03-27T10:01:23.376891+0000","last_active":"2024-03-27T10:01:23.376891+0000","last_peered":"2024-03-27T10:01:23.376891+0000","last_clean":"2024-03-27T10:01:23.376891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-27T10:01:23.376891+0000","last_undegraded":"2024-03-27T10:01:23.376891+0000","last_fullsized":"2024-03-27T10:01:23.376891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-27T10:01:22.351623+0000","last_change":"2024-03-27T10:01:22.351623+0000","last_active":"2024-03-27T10:01:22.351623+0000","last_peered":"2024-03-27T10:01:22.351623+0000","last_clean":"2024-03-27T10:01:22.351623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-27T10:01:22.351623+0000","last_undegraded":"2024-03-27T10:01:22.351623+0000","last_fullsized":"2024-03-27T10:01:22.351623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_clean_scrub_stamp":"2024-03-27T10:01:22.351623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-27T10:01:23.376891+0000","last_change":"2024-03-27T10:01:23.376891+0000","last_active":"2024-03-27T10:01:23.376891+0000","last_peered":"2024-03-27T10:01:23.376891+0000","last_clean":"2024-03-27T10:01:23.376891+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-27T10:01:23.376891+0000","last_undegraded":"2024-03-27T10:01:23.376891+0000","last_fullsized":"2024-03-27T10:01:23.376891+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.407398+0000","last_change":"2024-03-27T10:01:23.425899+0000","last_active":"2024-03-27T10:01:25.407398+0000","last_peered":"2024-03-27T10:01:25.407398+0000","last_clean":"2024-03-27T10:01:25.407398+0000","last_became_active":"2024-03-27T10:01:23.422107+0000","last_became_peered":"2024-03-27T10:01:23.422107+0000","last_unstale":"2024-03-27T10:01:25.407398+0000","last_undegraded":"2024-03-27T10:01:25.407398+0000","last_fullsized":"2024-03-27T10:01:25.407398+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_clean_scrub_stamp":"2024-03-27T10:01:22.351623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T22:00:49.260875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.405383+0000","last_change":"2024-03-27T10:01:24.429105+0000","last_active":"2024-03-27T10:01:25.405383+0000","last_peered":"2024-03-27T10:01:25.405383+0000","last_clean":"2024-03-27T10:01:25.405383+0000","last_became_active":"2024-03-27T10:01:24.428588+0000","last_became_peered":"2024-03-27T10:01:24.428588+0000","last_unstale":"2024-03-27T10:01:25.405383+0000","last_undegraded":"2024-03-27T10:01:25.405383+0000","last_fullsized":"2024-03-27T10:01:25.405383+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:51:31.080332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.404630+0000","last_change":"2024-03-27T10:01:23.417333+0000","last_active":"2024-03-27T10:01:25.404630+0000","last_peered":"2024-03-27T10:01:25.404630+0000","last_clean":"2024-03-27T10:01:25.404630+0000","last_became_active":"2024-03-27T10:01:23.416756+0000","last_became_peered":"2024-03-27T10:01:23.416756+0000","last_unstale":"2024-03-27T10:01:25.404630+0000","last_undegraded":"2024-03-27T10:01:25.404630+0000","last_fullsized":"2024-03-27T10:01:25.404630+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_clean_scrub_stamp":"2024-03-27T10:01:22.351623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:42:33.589563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.821866+0000","last_change":"2024-03-27T10:01:24.445055+0000","last_active":"2024-03-27T10:01:25.821866+0000","last_peered":"2024-03-27T10:01:25.821866+0000","last_clean":"2024-03-27T10:01:25.821866+0000","last_became_active":"2024-03-27T10:01:24.442663+0000","last_became_peered":"2024-03-27T10:01:24.442663+0000","last_unstale":"2024-03-27T10:01:25.821866+0000","last_undegraded":"2024-03-27T10:01:25.821866+0000","last_fullsized":"2024-03-27T10:01:25.821866+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:46:41.476976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-27T10:01:22.351623+0000","last_change":"2024-03-27T10:01:22.351623+0000","last_active":"2024-03-27T10:01:22.351623+0000","last_peered":"2024-03-27T10:01:22.351623+0000","last_clean":"2024-03-27T10:01:22.351623+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-27T10:01:22.351623+0000","last_undegraded":"2024-03-27T10:01:22.351623+0000","last_fullsized":"2024-03-27T10:01:22.351623+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_clean_scrub_stamp":"2024-03-27T10:01:22.351623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.455452+0000","last_change":"2024-03-27T10:01:24.454480+0000","last_active":"2024-03-27T10:01:25.455452+0000","last_peered":"2024-03-27T10:01:25.455452+0000","last_clean":"2024-03-27T10:01:25.455452+0000","last_became_active":"2024-03-27T10:01:24.454202+0000","last_became_peered":"2024-03-27T10:01:24.454202+0000","last_unstale":"2024-03-27T10:01:25.455452+0000","last_undegraded":"2024-03-27T10:01:25.455452+0000","last_fullsized":"2024-03-27T10:01:25.455452+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T12:55:05.971460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.822016+0000","last_change":"2024-03-27T10:01:23.434505+0000","last_active":"2024-03-27T10:01:25.822016+0000","last_peered":"2024-03-27T10:01:25.822016+0000","last_clean":"2024-03-27T10:01:25.822016+0000","last_became_active":"2024-03-27T10:01:23.434219+0000","last_became_peered":"2024-03-27T10:01:23.434219+0000","last_unstale":"2024-03-27T10:01:25.822016+0000","last_undegraded":"2024-03-27T10:01:25.822016+0000","last_fullsized":"2024-03-27T10:01:25.822016+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_clean_scrub_stamp":"2024-03-27T10:01:22.351623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:25:40.019001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":207,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.821705+0000","last_change":"2024-03-27T09:59:19.234906+0000","last_active":"2024-03-27T10:01:25.821705+0000","last_peered":"2024-03-27T10:01:25.821705+0000","last_clean":"2024-03-27T10:01:25.821705+0000","last_became_active":"2024-03-27T09:59:19.234124+0000","last_became_peered":"2024-03-27T09:59:19.234124+0000","last_unstale":"2024-03-27T10:01:25.821705+0000","last_undegraded":"2024-03-27T10:01:25.821705+0000","last_fullsized":"2024-03-27T10:01:25.821705+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:17.974760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:17.974760+0000","last_clean_scrub_stamp":"2024-03-27T09:59:17.974760+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:24:35.357325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":68,"acting":68,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":694,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":32,"acting":32,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":14,"seq":60129542172,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31596,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340244,"statfs":{"total":96636764160,"available":96604409856,"internally_reserved":0,"allocated":409600,"data_stored":173989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542172,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31580,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340260,"statfs":{"total":96636764160,"available":96604426240,"internally_reserved":0,"allocated":409600,"data_stored":173989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542171,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27424,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":409600,"data_stored":173989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542171,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32160,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339680,"statfs":{"total":96636764160,"available":96603832320,"internally_reserved":0,"allocated":1003520,"data_stored":764357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574878,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32232,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339608,"statfs":{"total":96636764160,"available":96603758592,"internally_reserved":0,"allocated":1069056,"data_stored":792774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":462848,"data_stored":201306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574876,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":466944,"data_stored":200836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31644,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340196,"statfs":{"total":96636764160,"available":96604360704,"internally_reserved":0,"allocated":466944,"data_stored":201328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-27T10:01:28.921 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-27T10:01:29.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.183+0000 7fb628c00640 1 Processor -- start 2024-03-27T10:01:29.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.183+0000 7fb628c00640 1 -- start start 2024-03-27T10:01:29.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.185+0000 7fb628c00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb624145820 0x7fb6240cc950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:29.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.185+0000 7fb628c00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fb62406b750 0x7fb62406bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:29.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.185+0000 7fb628c00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb6240b2b70 0x7fb6240b2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:29.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.185+0000 7fb628c00640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7fb62406c100 con 0x7fb624145820 2024-03-27T10:01:29.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.185+0000 7fb628c00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7fb624160b60 con 0x7fb62406b750 2024-03-27T10:01:29.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.185+0000 7fb628c00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fb6240cce90 con 0x7fb6240b2b70 2024-03-27T10:01:29.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.185+0000 7fb621e00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb624145820 0x7fb6240cc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:29.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.185+0000 7fb621e00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fb624145820 0x7fb6240cc950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56216/0 (socket says 172.21.15.57:56216) 2024-03-27T10:01:29.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.185+0000 7fb621e00640 1 -- 172.21.15.57:0/2871814101 learned_addr learned my addr 172.21.15.57:0/2871814101 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:01:29.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.185+0000 7fb622800640 1 --2- 172.21.15.57:0/2871814101 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb6240b2b70 0x7fb6240b2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:29.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.186+0000 7fb621400640 1 --2- 172.21.15.57:0/2871814101 >> v2:172.21.15.118:3300/0 conn(0x7fb62406b750 0x7fb62406bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:29.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.186+0000 7fb621e00640 1 -- 172.21.15.57:0/2871814101 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb6240b2b70 msgr2=0x7fb6240b2fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:01:29.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.186+0000 7fb621e00640 1 --2- 172.21.15.57:0/2871814101 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb6240b2b70 0x7fb6240b2fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:29.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.186+0000 7fb621e00640 1 -- 172.21.15.57:0/2871814101 >> v2:172.21.15.118:3300/0 conn(0x7fb62406b750 msgr2=0x7fb62406bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:01:29.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.186+0000 7fb621e00640 1 --2- 172.21.15.57:0/2871814101 >> v2:172.21.15.118:3300/0 conn(0x7fb62406b750 0x7fb62406bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:29.177 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.186+0000 7fb621e00640 1 -- 172.21.15.57:0/2871814101 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb62415fc70 con 0x7fb624145820 2024-03-27T10:01:29.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.187+0000 7fb621e00640 1 --2- 172.21.15.57:0/2871814101 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb624145820 0x7fb6240cc950 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fb62406c520 tx=0x7fb61402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cc42df7b43d9e09 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:29.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.187+0000 7fb620a00640 1 -- 172.21.15.57:0/2871814101 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb61402ca70 con 0x7fb624145820 2024-03-27T10:01:29.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.188+0000 7fb620a00640 1 -- 172.21.15.57:0/2871814101 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb61402cc10 con 0x7fb624145820 2024-03-27T10:01:29.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.188+0000 7fb620a00640 1 -- 172.21.15.57:0/2871814101 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6140343f0 con 0x7fb624145820 2024-03-27T10:01:29.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.188+0000 7fb628c00640 1 -- 172.21.15.57:0/2871814101 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb624145820 msgr2=0x7fb6240cc950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:29.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.188+0000 7fb628c00640 1 --2- 172.21.15.57:0/2871814101 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb624145820 0x7fb6240cc950 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fb62406c520 tx=0x7fb61402bed0 comp rx=0 tx=0).stop 2024-03-27T10:01:29.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.189+0000 7fb628c00640 1 -- 172.21.15.57:0/2871814101 shutdown_connections 2024-03-27T10:01:29.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.189+0000 7fb628c00640 1 --2- 172.21.15.57:0/2871814101 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb6240b2b70 0x7fb6240b2fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:29.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.189+0000 7fb628c00640 1 --2- 172.21.15.57:0/2871814101 >> v2:172.21.15.118:3300/0 conn(0x7fb62406b750 0x7fb62406bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:29.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.189+0000 7fb628c00640 1 --2- 172.21.15.57:0/2871814101 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb624145820 0x7fb6240cc950 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:29.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.189+0000 7fb628c00640 1 -- 172.21.15.57:0/2871814101 >> 172.21.15.57:0/2871814101 conn(0x7fb6240b1c60 msgr2=0x7fb6240b2070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:29.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.189+0000 7fb628c00640 1 -- 172.21.15.57:0/2871814101 shutdown_connections 2024-03-27T10:01:29.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.189+0000 7fb628c00640 1 -- 172.21.15.57:0/2871814101 wait complete. 2024-03-27T10:01:29.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.190+0000 7fb628c00640 1 Processor -- start 2024-03-27T10:01:29.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.191+0000 7fb628c00640 1 -- start start 2024-03-27T10:01:29.181 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.191+0000 7fb628c00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb62406b750 0x7fb62415bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:29.181 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.191+0000 7fb628c00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb6240b2b70 0x7fb6240a9490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:29.181 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.192+0000 7fb628c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb624145820 0x7fb6241eff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:29.182 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.192+0000 7fb628c00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fb624160510 con 0x7fb6240b2b70 2024-03-27T10:01:29.182 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.192+0000 7fb628c00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fb624160230 con 0x7fb624145820 2024-03-27T10:01:29.182 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.192+0000 7fb628c00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fb6241607f0 con 0x7fb62406b750 2024-03-27T10:01:29.182 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.192+0000 7fb621400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb6240b2b70 0x7fb6240a9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:29.182 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.192+0000 7fb621400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb6240b2b70 0x7fb6240a9490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56222/0 (socket says 172.21.15.57:56222) 2024-03-27T10:01:29.182 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.192+0000 7fb621400640 1 -- 172.21.15.57:0/2105950329 learned_addr learned my addr 172.21.15.57:0/2105950329 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:01:29.182 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.192+0000 7fb621e00640 1 --2- 172.21.15.57:0/2105950329 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb62406b750 0x7fb62415bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:29.182 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.192+0000 7fb622800640 1 --2- 172.21.15.57:0/2105950329 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb624145820 0x7fb6241eff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:29.182 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.192+0000 7fb621400640 1 -- 172.21.15.57:0/2105950329 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb62406b750 msgr2=0x7fb62415bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:29.182 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.192+0000 7fb621400640 1 --2- 172.21.15.57:0/2105950329 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb62406b750 0x7fb62415bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:29.182 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.192+0000 7fb621400640 1 -- 172.21.15.57:0/2105950329 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb624145820 msgr2=0x7fb6241eff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:29.182 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.192+0000 7fb621400640 1 --2- 172.21.15.57:0/2105950329 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb624145820 0x7fb6241eff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:29.182 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.192+0000 7fb621400640 1 -- 172.21.15.57:0/2105950329 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6241579a0 con 0x7fb6240b2b70 2024-03-27T10:01:29.182 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.193+0000 7fb621400640 1 --2- 172.21.15.57:0/2105950329 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb6240b2b70 0x7fb6240a9490 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fb60c00d800 tx=0x7fb60c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:29.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.193+0000 7fb61a000640 1 -- 172.21.15.57:0/2105950329 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb60c018030 con 0x7fb6240b2b70 2024-03-27T10:01:29.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.193+0000 7fb61a000640 1 -- 172.21.15.57:0/2105950329 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb60c0096a0 con 0x7fb6240b2b70 2024-03-27T10:01:29.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.193+0000 7fb61a000640 1 -- 172.21.15.57:0/2105950329 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb60c009870 con 0x7fb6240b2b70 2024-03-27T10:01:29.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.193+0000 7fb628c00640 1 -- 172.21.15.57:0/2105950329 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb624157c80 con 0x7fb6240b2b70 2024-03-27T10:01:29.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.193+0000 7fb628c00640 1 -- 172.21.15.57:0/2105950329 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb624158240 con 0x7fb6240b2b70 2024-03-27T10:01:29.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.195+0000 7fb628c00640 1 -- 172.21.15.57:0/2105950329 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb624068620 con 0x7fb6240b2b70 2024-03-27T10:01:29.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.195+0000 7fb61a000640 1 -- 172.21.15.57:0/2105950329 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fb60c01b070 con 0x7fb6240b2b70 2024-03-27T10:01:29.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.196+0000 7fb61a000640 1 --2- 172.21.15.57:0/2105950329 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fb60006c530 0x7fb60006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:29.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.196+0000 7fb61a000640 1 -- 172.21.15.57:0/2105950329 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7fb60c08bb20 con 0x7fb6240b2b70 2024-03-27T10:01:29.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.197+0000 7fb621e00640 1 --2- 172.21.15.57:0/2105950329 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fb60006c530 0x7fb60006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:29.186 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.197+0000 7fb621e00640 1 --2- 172.21.15.57:0/2105950329 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fb60006c530 0x7fb60006e9f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fb614035000 tx=0x7fb614030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:29.190 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.201+0000 7fb61a000640 1 -- 172.21.15.57:0/2105950329 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7fb60c059fa0 con 0x7fb6240b2b70 2024-03-27T10:01:29.419 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.430+0000 7fb628c00640 1 -- 172.21.15.57:0/2105950329 --> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb6240b4a70 con 0x7fb60006c530 2024-03-27T10:01:29.427 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.438+0000 7fb61a000640 1 -- 172.21.15.57:0/2105950329 <== mgr.4103 v2:172.21.15.57:6832/485397065 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251959 (secure 0 0 0) 0x7fb6240b4a70 con 0x7fb60006c530 2024-03-27T10:01:29.430 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:01:29.431 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-03-27T10:01:29.433 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.443+0000 7fb628c00640 1 -- 172.21.15.57:0/2105950329 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fb60006c530 msgr2=0x7fb60006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:29.433 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.443+0000 7fb628c00640 1 --2- 172.21.15.57:0/2105950329 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fb60006c530 0x7fb60006e9f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fb614035000 tx=0x7fb614030000 comp rx=0 tx=0).stop 2024-03-27T10:01:29.433 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.443+0000 7fb628c00640 1 -- 172.21.15.57:0/2105950329 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb6240b2b70 msgr2=0x7fb6240a9490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:29.433 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.443+0000 7fb628c00640 1 --2- 172.21.15.57:0/2105950329 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb6240b2b70 0x7fb6240a9490 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fb60c00d800 tx=0x7fb60c00dcc0 comp rx=0 tx=0).stop 2024-03-27T10:01:29.433 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.443+0000 7fb628c00640 1 -- 172.21.15.57:0/2105950329 shutdown_connections 2024-03-27T10:01:29.434 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.443+0000 7fb628c00640 1 --2- 172.21.15.57:0/2105950329 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fb60006c530 0x7fb60006e9f0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:29.434 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.443+0000 7fb628c00640 1 --2- 172.21.15.57:0/2105950329 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb624145820 0x7fb6241eff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:29.434 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.443+0000 7fb628c00640 1 --2- 172.21.15.57:0/2105950329 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb6240b2b70 0x7fb6240a9490 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:29.434 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.443+0000 7fb628c00640 1 --2- 172.21.15.57:0/2105950329 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb62406b750 0x7fb62415bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:29.434 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.443+0000 7fb628c00640 1 -- 172.21.15.57:0/2105950329 >> 172.21.15.57:0/2105950329 conn(0x7fb6240b1c60 msgr2=0x7fb6240af720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:29.434 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.444+0000 7fb628c00640 1 -- 172.21.15.57:0/2105950329 shutdown_connections 2024-03-27T10:01:29.434 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.444+0000 7fb628c00640 1 -- 172.21.15.57:0/2105950329 wait complete. 2024-03-27T10:01:29.452 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":100,"stamp":"2024-03-27T10:01:29.269736+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":169,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":241824,"kb_used_data":4808,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754732896,"statfs":{"total":773094113280,"available":772846485504,"internally_reserved":0,"allocated":4923392,"data_stored":2791348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":242535985},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001854"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.404984+0000","last_change":"2024-03-27T10:01:24.441495+0000","last_active":"2024-03-27T10:01:25.404984+0000","last_peered":"2024-03-27T10:01:25.404984+0000","last_clean":"2024-03-27T10:01:25.404984+0000","last_became_active":"2024-03-27T10:01:24.441203+0000","last_became_peered":"2024-03-27T10:01:24.441203+0000","last_unstale":"2024-03-27T10:01:25.404984+0000","last_undegraded":"2024-03-27T10:01:25.404984+0000","last_fullsized":"2024-03-27T10:01:25.404984+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:12:23.023704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.404626+0000","last_change":"2024-03-27T10:01:24.455902+0000","last_active":"2024-03-27T10:01:25.404626+0000","last_peered":"2024-03-27T10:01:25.404626+0000","last_clean":"2024-03-27T10:01:25.404626+0000","last_became_active":"2024-03-27T10:01:24.455102+0000","last_became_peered":"2024-03-27T10:01:24.455102+0000","last_unstale":"2024-03-27T10:01:25.404626+0000","last_undegraded":"2024-03-27T10:01:25.404626+0000","last_fullsized":"2024-03-27T10:01:25.404626+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:13:51.106203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.823133+0000","last_change":"2024-03-27T10:01:24.446719+0000","last_active":"2024-03-27T10:01:25.823133+0000","last_peered":"2024-03-27T10:01:25.823133+0000","last_clean":"2024-03-27T10:01:25.823133+0000","last_became_active":"2024-03-27T10:01:24.446452+0000","last_became_peered":"2024-03-27T10:01:24.446452+0000","last_unstale":"2024-03-27T10:01:25.823133+0000","last_undegraded":"2024-03-27T10:01:25.823133+0000","last_fullsized":"2024-03-27T10:01:25.823133+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:03:12.303809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.449243+0000","last_change":"2024-03-27T10:01:24.454275+0000","last_active":"2024-03-27T10:01:25.449243+0000","last_peered":"2024-03-27T10:01:25.449243+0000","last_clean":"2024-03-27T10:01:25.449243+0000","last_became_active":"2024-03-27T10:01:24.453940+0000","last_became_peered":"2024-03-27T10:01:24.453940+0000","last_unstale":"2024-03-27T10:01:25.449243+0000","last_undegraded":"2024-03-27T10:01:25.449243+0000","last_fullsized":"2024-03-27T10:01:25.449243+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:53:23.138884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.449699+0000","last_change":"2024-03-27T10:01:24.451269+0000","last_active":"2024-03-27T10:01:25.449699+0000","last_peered":"2024-03-27T10:01:25.449699+0000","last_clean":"2024-03-27T10:01:25.449699+0000","last_became_active":"2024-03-27T10:01:24.449672+0000","last_became_peered":"2024-03-27T10:01:24.449672+0000","last_unstale":"2024-03-27T10:01:25.449699+0000","last_undegraded":"2024-03-27T10:01:25.449699+0000","last_fullsized":"2024-03-27T10:01:25.449699+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:25:41.044269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.820512+0000","last_change":"2024-03-27T10:01:24.436013+0000","last_active":"2024-03-27T10:01:25.820512+0000","last_peered":"2024-03-27T10:01:25.820512+0000","last_clean":"2024-03-27T10:01:25.820512+0000","last_became_active":"2024-03-27T10:01:24.435698+0000","last_became_peered":"2024-03-27T10:01:24.435698+0000","last_unstale":"2024-03-27T10:01:25.820512+0000","last_undegraded":"2024-03-27T10:01:25.820512+0000","last_fullsized":"2024-03-27T10:01:25.820512+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:51:31.080332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.455835+0000","last_change":"2024-03-27T10:01:24.440200+0000","last_active":"2024-03-27T10:01:25.455835+0000","last_peered":"2024-03-27T10:01:25.455835+0000","last_clean":"2024-03-27T10:01:25.455835+0000","last_became_active":"2024-03-27T10:01:24.438666+0000","last_became_peered":"2024-03-27T10:01:24.438666+0000","last_unstale":"2024-03-27T10:01:25.455835+0000","last_undegraded":"2024-03-27T10:01:25.455835+0000","last_fullsized":"2024-03-27T10:01:25.455835+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T12:34:07.026628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.403995+0000","last_change":"2024-03-27T10:01:24.439069+0000","last_active":"2024-03-27T10:01:25.403995+0000","last_peered":"2024-03-27T10:01:25.403995+0000","last_clean":"2024-03-27T10:01:25.403995+0000","last_became_active":"2024-03-27T10:01:24.438790+0000","last_became_peered":"2024-03-27T10:01:24.438790+0000","last_unstale":"2024-03-27T10:01:25.403995+0000","last_undegraded":"2024-03-27T10:01:25.403995+0000","last_fullsized":"2024-03-27T10:01:25.403995+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T12:34:07.026628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.823482+0000","last_change":"2024-03-27T10:01:24.447667+0000","last_active":"2024-03-27T10:01:25.823482+0000","last_peered":"2024-03-27T10:01:25.823482+0000","last_clean":"2024-03-27T10:01:25.823482+0000","last_became_active":"2024-03-27T10:01:24.447269+0000","last_became_peered":"2024-03-27T10:01:24.447269+0000","last_unstale":"2024-03-27T10:01:25.823482+0000","last_undegraded":"2024-03-27T10:01:25.823482+0000","last_fullsized":"2024-03-27T10:01:25.823482+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T12:55:05.971460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.455730+0000","last_change":"2024-03-27T10:01:24.448110+0000","last_active":"2024-03-27T10:01:25.455730+0000","last_peered":"2024-03-27T10:01:25.455730+0000","last_clean":"2024-03-27T10:01:25.455730+0000","last_became_active":"2024-03-27T10:01:24.447718+0000","last_became_peered":"2024-03-27T10:01:24.447718+0000","last_unstale":"2024-03-27T10:01:25.455730+0000","last_undegraded":"2024-03-27T10:01:25.455730+0000","last_fullsized":"2024-03-27T10:01:25.455730+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:50:17.621272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.455455+0000","last_change":"2024-03-27T10:01:24.447059+0000","last_active":"2024-03-27T10:01:25.455455+0000","last_peered":"2024-03-27T10:01:25.455455+0000","last_clean":"2024-03-27T10:01:25.455455+0000","last_became_active":"2024-03-27T10:01:24.446543+0000","last_became_peered":"2024-03-27T10:01:24.446543+0000","last_unstale":"2024-03-27T10:01:25.455455+0000","last_undegraded":"2024-03-27T10:01:25.455455+0000","last_fullsized":"2024-03-27T10:01:25.455455+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:59:02.265298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.823344+0000","last_change":"2024-03-27T10:01:24.455561+0000","last_active":"2024-03-27T10:01:25.823344+0000","last_peered":"2024-03-27T10:01:25.823344+0000","last_clean":"2024-03-27T10:01:25.823344+0000","last_became_active":"2024-03-27T10:01:24.455280+0000","last_became_peered":"2024-03-27T10:01:24.455280+0000","last_unstale":"2024-03-27T10:01:25.823344+0000","last_undegraded":"2024-03-27T10:01:25.823344+0000","last_fullsized":"2024-03-27T10:01:25.823344+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T21:14:27.488462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.456031+0000","last_change":"2024-03-27T10:01:24.448589+0000","last_active":"2024-03-27T10:01:25.456031+0000","last_peered":"2024-03-27T10:01:25.456031+0000","last_clean":"2024-03-27T10:01:25.456031+0000","last_became_active":"2024-03-27T10:01:24.448296+0000","last_became_peered":"2024-03-27T10:01:24.448296+0000","last_unstale":"2024-03-27T10:01:25.456031+0000","last_undegraded":"2024-03-27T10:01:25.456031+0000","last_fullsized":"2024-03-27T10:01:25.456031+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:42:17.383244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.404907+0000","last_change":"2024-03-27T10:01:24.421324+0000","last_active":"2024-03-27T10:01:25.404907+0000","last_peered":"2024-03-27T10:01:25.404907+0000","last_clean":"2024-03-27T10:01:25.404907+0000","last_became_active":"2024-03-27T10:01:24.420636+0000","last_became_peered":"2024-03-27T10:01:24.420636+0000","last_unstale":"2024-03-27T10:01:25.404907+0000","last_undegraded":"2024-03-27T10:01:25.404907+0000","last_fullsized":"2024-03-27T10:01:25.404907+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:18:04.032991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.455866+0000","last_change":"2024-03-27T10:01:24.451596+0000","last_active":"2024-03-27T10:01:25.455866+0000","last_peered":"2024-03-27T10:01:25.455866+0000","last_clean":"2024-03-27T10:01:25.455866+0000","last_became_active":"2024-03-27T10:01:24.449718+0000","last_became_peered":"2024-03-27T10:01:24.449718+0000","last_unstale":"2024-03-27T10:01:25.455866+0000","last_undegraded":"2024-03-27T10:01:25.455866+0000","last_fullsized":"2024-03-27T10:01:25.455866+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T12:32:12.895181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.821549+0000","last_change":"2024-03-27T10:01:24.444727+0000","last_active":"2024-03-27T10:01:25.821549+0000","last_peered":"2024-03-27T10:01:25.821549+0000","last_clean":"2024-03-27T10:01:25.821549+0000","last_became_active":"2024-03-27T10:01:24.444390+0000","last_became_peered":"2024-03-27T10:01:24.444390+0000","last_unstale":"2024-03-27T10:01:25.821549+0000","last_undegraded":"2024-03-27T10:01:25.821549+0000","last_fullsized":"2024-03-27T10:01:25.821549+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:00:21.588815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.821683+0000","last_change":"2024-03-27T10:01:24.446632+0000","last_active":"2024-03-27T10:01:25.821683+0000","last_peered":"2024-03-27T10:01:25.821683+0000","last_clean":"2024-03-27T10:01:25.821683+0000","last_became_active":"2024-03-27T10:01:24.445901+0000","last_became_peered":"2024-03-27T10:01:24.445901+0000","last_unstale":"2024-03-27T10:01:25.821683+0000","last_undegraded":"2024-03-27T10:01:25.821683+0000","last_fullsized":"2024-03-27T10:01:25.821683+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:14:08.363370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.408443+0000","last_change":"2024-03-27T10:01:24.424661+0000","last_active":"2024-03-27T10:01:25.408443+0000","last_peered":"2024-03-27T10:01:25.408443+0000","last_clean":"2024-03-27T10:01:25.408443+0000","last_became_active":"2024-03-27T10:01:24.424231+0000","last_became_peered":"2024-03-27T10:01:24.424231+0000","last_unstale":"2024-03-27T10:01:25.408443+0000","last_undegraded":"2024-03-27T10:01:25.408443+0000","last_fullsized":"2024-03-27T10:01:25.408443+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:54:52.196447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.449197+0000","last_change":"2024-03-27T10:01:24.450144+0000","last_active":"2024-03-27T10:01:25.449197+0000","last_peered":"2024-03-27T10:01:25.449197+0000","last_clean":"2024-03-27T10:01:25.449197+0000","last_became_active":"2024-03-27T10:01:24.449029+0000","last_became_peered":"2024-03-27T10:01:24.449029+0000","last_unstale":"2024-03-27T10:01:25.449197+0000","last_undegraded":"2024-03-27T10:01:25.449197+0000","last_fullsized":"2024-03-27T10:01:25.449197+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:19:27.916580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.407902+0000","last_change":"2024-03-27T10:01:24.418982+0000","last_active":"2024-03-27T10:01:25.407902+0000","last_peered":"2024-03-27T10:01:25.407902+0000","last_clean":"2024-03-27T10:01:25.407902+0000","last_became_active":"2024-03-27T10:01:24.418212+0000","last_became_peered":"2024-03-27T10:01:24.418212+0000","last_unstale":"2024-03-27T10:01:25.407902+0000","last_undegraded":"2024-03-27T10:01:25.407902+0000","last_fullsized":"2024-03-27T10:01:25.407902+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:39:32.521473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.455046+0000","last_change":"2024-03-27T10:01:24.459894+0000","last_active":"2024-03-27T10:01:25.455046+0000","last_peered":"2024-03-27T10:01:25.455046+0000","last_clean":"2024-03-27T10:01:25.455046+0000","last_became_active":"2024-03-27T10:01:24.459608+0000","last_became_peered":"2024-03-27T10:01:24.459608+0000","last_unstale":"2024-03-27T10:01:25.455046+0000","last_undegraded":"2024-03-27T10:01:25.455046+0000","last_fullsized":"2024-03-27T10:01:25.455046+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T21:14:27.488462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.405570+0000","last_change":"2024-03-27T10:01:24.452526+0000","last_active":"2024-03-27T10:01:25.405570+0000","last_peered":"2024-03-27T10:01:25.405570+0000","last_clean":"2024-03-27T10:01:25.405570+0000","last_became_active":"2024-03-27T10:01:24.451751+0000","last_became_peered":"2024-03-27T10:01:24.451751+0000","last_unstale":"2024-03-27T10:01:25.405570+0000","last_undegraded":"2024-03-27T10:01:25.405570+0000","last_fullsized":"2024-03-27T10:01:25.405570+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:20:39.588546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.821314+0000","last_change":"2024-03-27T10:01:24.450386+0000","last_active":"2024-03-27T10:01:25.821314+0000","last_peered":"2024-03-27T10:01:25.821314+0000","last_clean":"2024-03-27T10:01:25.821314+0000","last_became_active":"2024-03-27T10:01:24.450105+0000","last_became_peered":"2024-03-27T10:01:24.450105+0000","last_unstale":"2024-03-27T10:01:25.821314+0000","last_undegraded":"2024-03-27T10:01:25.821314+0000","last_fullsized":"2024-03-27T10:01:25.821314+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:51:31.080332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.449194+0000","last_change":"2024-03-27T10:01:24.454844+0000","last_active":"2024-03-27T10:01:25.449194+0000","last_peered":"2024-03-27T10:01:25.449194+0000","last_clean":"2024-03-27T10:01:25.449194+0000","last_became_active":"2024-03-27T10:01:24.453453+0000","last_became_peered":"2024-03-27T10:01:24.453453+0000","last_unstale":"2024-03-27T10:01:25.449194+0000","last_undegraded":"2024-03-27T10:01:25.449194+0000","last_fullsized":"2024-03-27T10:01:25.449194+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:37:00.399067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.408522+0000","last_change":"2024-03-27T10:01:24.438871+0000","last_active":"2024-03-27T10:01:25.408522+0000","last_peered":"2024-03-27T10:01:25.408522+0000","last_clean":"2024-03-27T10:01:25.408522+0000","last_became_active":"2024-03-27T10:01:24.438526+0000","last_became_peered":"2024-03-27T10:01:24.438526+0000","last_unstale":"2024-03-27T10:01:25.408522+0000","last_undegraded":"2024-03-27T10:01:25.408522+0000","last_fullsized":"2024-03-27T10:01:25.408522+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:53:46.021640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.821945+0000","last_change":"2024-03-27T10:01:24.445970+0000","last_active":"2024-03-27T10:01:25.821945+0000","last_peered":"2024-03-27T10:01:25.821945+0000","last_clean":"2024-03-27T10:01:25.821945+0000","last_became_active":"2024-03-27T10:01:24.444828+0000","last_became_peered":"2024-03-27T10:01:24.444828+0000","last_unstale":"2024-03-27T10:01:25.821945+0000","last_undegraded":"2024-03-27T10:01:25.821945+0000","last_fullsized":"2024-03-27T10:01:25.821945+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:14:08.363370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.408219+0000","last_change":"2024-03-27T10:01:24.457328+0000","last_active":"2024-03-27T10:01:25.408219+0000","last_peered":"2024-03-27T10:01:25.408219+0000","last_clean":"2024-03-27T10:01:25.408219+0000","last_became_active":"2024-03-27T10:01:24.449361+0000","last_became_peered":"2024-03-27T10:01:24.449361+0000","last_unstale":"2024-03-27T10:01:25.408219+0000","last_undegraded":"2024-03-27T10:01:25.408219+0000","last_fullsized":"2024-03-27T10:01:25.408219+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T21:38:00.656376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.455724+0000","last_change":"2024-03-27T10:01:24.441355+0000","last_active":"2024-03-27T10:01:25.455724+0000","last_peered":"2024-03-27T10:01:25.455724+0000","last_clean":"2024-03-27T10:01:25.455724+0000","last_became_active":"2024-03-27T10:01:24.439538+0000","last_became_peered":"2024-03-27T10:01:24.439538+0000","last_unstale":"2024-03-27T10:01:25.455724+0000","last_undegraded":"2024-03-27T10:01:25.455724+0000","last_fullsized":"2024-03-27T10:01:25.455724+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:14:08.355513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.407790+0000","last_change":"2024-03-27T10:01:24.440009+0000","last_active":"2024-03-27T10:01:25.407790+0000","last_peered":"2024-03-27T10:01:25.407790+0000","last_clean":"2024-03-27T10:01:25.407790+0000","last_became_active":"2024-03-27T10:01:24.439640+0000","last_became_peered":"2024-03-27T10:01:24.439640+0000","last_unstale":"2024-03-27T10:01:25.407790+0000","last_undegraded":"2024-03-27T10:01:25.407790+0000","last_fullsized":"2024-03-27T10:01:25.407790+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:58:54.329192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.407618+0000","last_change":"2024-03-27T10:01:24.415241+0000","last_active":"2024-03-27T10:01:25.407618+0000","last_peered":"2024-03-27T10:01:25.407618+0000","last_clean":"2024-03-27T10:01:25.407618+0000","last_became_active":"2024-03-27T10:01:24.414465+0000","last_became_peered":"2024-03-27T10:01:24.414465+0000","last_unstale":"2024-03-27T10:01:25.407618+0000","last_undegraded":"2024-03-27T10:01:25.407618+0000","last_fullsized":"2024-03-27T10:01:25.407618+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:49:41.790909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.822219+0000","last_change":"2024-03-27T10:01:24.451386+0000","last_active":"2024-03-27T10:01:25.822219+0000","last_peered":"2024-03-27T10:01:25.822219+0000","last_clean":"2024-03-27T10:01:25.822219+0000","last_became_active":"2024-03-27T10:01:24.451077+0000","last_became_peered":"2024-03-27T10:01:24.451077+0000","last_unstale":"2024-03-27T10:01:25.822219+0000","last_undegraded":"2024-03-27T10:01:25.822219+0000","last_fullsized":"2024-03-27T10:01:25.822219+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T21:14:27.488462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.820337+0000","last_change":"2024-03-27T10:01:24.456495+0000","last_active":"2024-03-27T10:01:25.820337+0000","last_peered":"2024-03-27T10:01:25.820337+0000","last_clean":"2024-03-27T10:01:25.820337+0000","last_became_active":"2024-03-27T10:01:24.456142+0000","last_became_peered":"2024-03-27T10:01:24.456142+0000","last_unstale":"2024-03-27T10:01:25.820337+0000","last_undegraded":"2024-03-27T10:01:25.820337+0000","last_fullsized":"2024-03-27T10:01:25.820337+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:18:04.032991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.821819+0000","last_change":"2024-03-27T10:01:24.441443+0000","last_active":"2024-03-27T10:01:25.821819+0000","last_peered":"2024-03-27T10:01:25.821819+0000","last_clean":"2024-03-27T10:01:25.821819+0000","last_became_active":"2024-03-27T10:01:24.441085+0000","last_became_peered":"2024-03-27T10:01:24.441085+0000","last_unstale":"2024-03-27T10:01:25.821819+0000","last_undegraded":"2024-03-27T10:01:25.821819+0000","last_fullsized":"2024-03-27T10:01:25.821819+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T20:15:24.993936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"39'4","reported_seq":18,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.408571+0000","last_change":"2024-03-27T10:01:23.417653+0000","last_active":"2024-03-27T10:01:25.408571+0000","last_peered":"2024-03-27T10:01:25.408571+0000","last_clean":"2024-03-27T10:01:25.408571+0000","last_became_active":"2024-03-27T10:01:23.417337+0000","last_became_peered":"2024-03-27T10:01:23.417337+0000","last_unstale":"2024-03-27T10:01:25.408571+0000","last_undegraded":"2024-03-27T10:01:25.408571+0000","last_fullsized":"2024-03-27T10:01:25.408571+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_clean_scrub_stamp":"2024-03-27T10:01:22.351623+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:53:22.113616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.822043+0000","last_change":"2024-03-27T10:01:24.445700+0000","last_active":"2024-03-27T10:01:25.822043+0000","last_peered":"2024-03-27T10:01:25.822043+0000","last_clean":"2024-03-27T10:01:25.822043+0000","last_became_active":"2024-03-27T10:01:24.445097+0000","last_became_peered":"2024-03-27T10:01:24.445097+0000","last_unstale":"2024-03-27T10:01:25.822043+0000","last_undegraded":"2024-03-27T10:01:25.822043+0000","last_fullsized":"2024-03-27T10:01:25.822043+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T20:15:24.993936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"39'1","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.823232+0000","last_change":"2024-03-27T10:01:23.430510+0000","last_active":"2024-03-27T10:01:25.823232+0000","last_peered":"2024-03-27T10:01:25.823232+0000","last_clean":"2024-03-27T10:01:25.823232+0000","last_became_active":"2024-03-27T10:01:23.430141+0000","last_became_peered":"2024-03-27T10:01:23.430141+0000","last_unstale":"2024-03-27T10:01:25.823232+0000","last_undegraded":"2024-03-27T10:01:25.823232+0000","last_fullsized":"2024-03-27T10:01:25.823232+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_clean_scrub_stamp":"2024-03-27T10:01:22.351623+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:47:07.830155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.406612+0000","last_change":"2024-03-27T10:01:24.428705+0000","last_active":"2024-03-27T10:01:25.406612+0000","last_peered":"2024-03-27T10:01:25.406612+0000","last_clean":"2024-03-27T10:01:25.406612+0000","last_became_active":"2024-03-27T10:01:24.428257+0000","last_became_peered":"2024-03-27T10:01:24.428257+0000","last_unstale":"2024-03-27T10:01:25.406612+0000","last_undegraded":"2024-03-27T10:01:25.406612+0000","last_fullsized":"2024-03-27T10:01:25.406612+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:46:41.476976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"39'2","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.822347+0000","last_change":"2024-03-27T10:01:23.429122+0000","last_active":"2024-03-27T10:01:25.822347+0000","last_peered":"2024-03-27T10:01:25.822347+0000","last_clean":"2024-03-27T10:01:25.822347+0000","last_became_active":"2024-03-27T10:01:23.428603+0000","last_became_peered":"2024-03-27T10:01:23.428603+0000","last_unstale":"2024-03-27T10:01:25.822347+0000","last_undegraded":"2024-03-27T10:01:25.822347+0000","last_fullsized":"2024-03-27T10:01:25.822347+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_clean_scrub_stamp":"2024-03-27T10:01:22.351623+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T12:59:54.269125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.404833+0000","last_change":"2024-03-27T10:01:24.416095+0000","last_active":"2024-03-27T10:01:25.404833+0000","last_peered":"2024-03-27T10:01:25.404833+0000","last_clean":"2024-03-27T10:01:25.404833+0000","last_became_active":"2024-03-27T10:01:24.415108+0000","last_became_peered":"2024-03-27T10:01:24.415108+0000","last_unstale":"2024-03-27T10:01:25.404833+0000","last_undegraded":"2024-03-27T10:01:25.404833+0000","last_fullsized":"2024-03-27T10:01:25.404833+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:56:45.624976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"39'2","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.406614+0000","last_change":"2024-03-27T10:01:23.417257+0000","last_active":"2024-03-27T10:01:25.406614+0000","last_peered":"2024-03-27T10:01:25.406614+0000","last_clean":"2024-03-27T10:01:25.406614+0000","last_became_active":"2024-03-27T10:01:23.416698+0000","last_became_peered":"2024-03-27T10:01:23.416698+0000","last_unstale":"2024-03-27T10:01:25.406614+0000","last_undegraded":"2024-03-27T10:01:25.406614+0000","last_fullsized":"2024-03-27T10:01:25.406614+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_clean_scrub_stamp":"2024-03-27T10:01:22.351623+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:25:40.019001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.821719+0000","last_change":"2024-03-27T10:01:24.441452+0000","last_active":"2024-03-27T10:01:25.821719+0000","last_peered":"2024-03-27T10:01:25.821719+0000","last_clean":"2024-03-27T10:01:25.821719+0000","last_became_active":"2024-03-27T10:01:24.440825+0000","last_became_peered":"2024-03-27T10:01:24.440825+0000","last_unstale":"2024-03-27T10:01:25.821719+0000","last_undegraded":"2024-03-27T10:01:25.821719+0000","last_fullsized":"2024-03-27T10:01:25.821719+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:00:21.588815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"39'1","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.455380+0000","last_change":"2024-03-27T10:01:23.433449+0000","last_active":"2024-03-27T10:01:25.455380+0000","last_peered":"2024-03-27T10:01:25.455380+0000","last_clean":"2024-03-27T10:01:25.455380+0000","last_became_active":"2024-03-27T10:01:23.432054+0000","last_became_peered":"2024-03-27T10:01:23.432054+0000","last_unstale":"2024-03-27T10:01:25.455380+0000","last_undegraded":"2024-03-27T10:01:25.455380+0000","last_fullsized":"2024-03-27T10:01:25.455380+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_clean_scrub_stamp":"2024-03-27T10:01:22.351623+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:47:07.830155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.456203+0000","last_change":"2024-03-27T10:01:24.451202+0000","last_active":"2024-03-27T10:01:25.456203+0000","last_peered":"2024-03-27T10:01:25.456203+0000","last_clean":"2024-03-27T10:01:25.456203+0000","last_became_active":"2024-03-27T10:01:24.450849+0000","last_became_peered":"2024-03-27T10:01:24.450849+0000","last_unstale":"2024-03-27T10:01:25.456203+0000","last_undegraded":"2024-03-27T10:01:25.456203+0000","last_fullsized":"2024-03-27T10:01:25.456203+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T12:33:33.935860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"39'1","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.821644+0000","last_change":"2024-03-27T10:01:23.436261+0000","last_active":"2024-03-27T10:01:25.821644+0000","last_peered":"2024-03-27T10:01:25.821644+0000","last_clean":"2024-03-27T10:01:25.821644+0000","last_became_active":"2024-03-27T10:01:23.435336+0000","last_became_peered":"2024-03-27T10:01:23.435336+0000","last_unstale":"2024-03-27T10:01:25.821644+0000","last_undegraded":"2024-03-27T10:01:25.821644+0000","last_fullsized":"2024-03-27T10:01:25.821644+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_clean_scrub_stamp":"2024-03-27T10:01:22.351623+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T22:00:49.260875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.405775+0000","last_change":"2024-03-27T10:01:24.444057+0000","last_active":"2024-03-27T10:01:25.405775+0000","last_peered":"2024-03-27T10:01:25.405775+0000","last_clean":"2024-03-27T10:01:25.405775+0000","last_became_active":"2024-03-27T10:01:24.443657+0000","last_became_peered":"2024-03-27T10:01:24.443657+0000","last_unstale":"2024-03-27T10:01:25.405775+0000","last_undegraded":"2024-03-27T10:01:25.405775+0000","last_fullsized":"2024-03-27T10:01:25.405775+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:14:08.363370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.820551+0000","last_change":"2024-03-27T10:01:23.431539+0000","last_active":"2024-03-27T10:01:25.820551+0000","last_peered":"2024-03-27T10:01:25.820551+0000","last_clean":"2024-03-27T10:01:25.820551+0000","last_became_active":"2024-03-27T10:01:23.431225+0000","last_became_peered":"2024-03-27T10:01:23.431225+0000","last_unstale":"2024-03-27T10:01:25.820551+0000","last_undegraded":"2024-03-27T10:01:25.820551+0000","last_fullsized":"2024-03-27T10:01:25.820551+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_clean_scrub_stamp":"2024-03-27T10:01:22.351623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:41:39.521966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.404225+0000","last_change":"2024-03-27T10:01:24.439549+0000","last_active":"2024-03-27T10:01:25.404225+0000","last_peered":"2024-03-27T10:01:25.404225+0000","last_clean":"2024-03-27T10:01:25.404225+0000","last_became_active":"2024-03-27T10:01:24.439152+0000","last_became_peered":"2024-03-27T10:01:24.439152+0000","last_unstale":"2024-03-27T10:01:25.404225+0000","last_undegraded":"2024-03-27T10:01:25.404225+0000","last_fullsized":"2024-03-27T10:01:25.404225+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:42:17.383244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.404498+0000","last_change":"2024-03-27T10:01:23.421996+0000","last_active":"2024-03-27T10:01:25.404498+0000","last_peered":"2024-03-27T10:01:25.404498+0000","last_clean":"2024-03-27T10:01:25.404498+0000","last_became_active":"2024-03-27T10:01:23.419980+0000","last_became_peered":"2024-03-27T10:01:23.419980+0000","last_unstale":"2024-03-27T10:01:25.404498+0000","last_undegraded":"2024-03-27T10:01:25.404498+0000","last_fullsized":"2024-03-27T10:01:25.404498+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_clean_scrub_stamp":"2024-03-27T10:01:22.351623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:41:39.521966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.449467+0000","last_change":"2024-03-27T10:01:24.456901+0000","last_active":"2024-03-27T10:01:25.449467+0000","last_peered":"2024-03-27T10:01:25.449467+0000","last_clean":"2024-03-27T10:01:25.449467+0000","last_became_active":"2024-03-27T10:01:24.454274+0000","last_became_peered":"2024-03-27T10:01:24.454274+0000","last_unstale":"2024-03-27T10:01:25.449467+0000","last_undegraded":"2024-03-27T10:01:25.449467+0000","last_fullsized":"2024-03-27T10:01:25.449467+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T22:00:50.286144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.404908+0000","last_change":"2024-03-27T10:01:23.420399+0000","last_active":"2024-03-27T10:01:25.404908+0000","last_peered":"2024-03-27T10:01:25.404908+0000","last_clean":"2024-03-27T10:01:25.404908+0000","last_became_active":"2024-03-27T10:01:23.420079+0000","last_became_peered":"2024-03-27T10:01:23.420079+0000","last_unstale":"2024-03-27T10:01:25.404908+0000","last_undegraded":"2024-03-27T10:01:25.404908+0000","last_fullsized":"2024-03-27T10:01:25.404908+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_clean_scrub_stamp":"2024-03-27T10:01:22.351623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:14:07.338102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.822432+0000","last_change":"2024-03-27T10:01:24.442708+0000","last_active":"2024-03-27T10:01:25.822432+0000","last_peered":"2024-03-27T10:01:25.822432+0000","last_clean":"2024-03-27T10:01:25.822432+0000","last_became_active":"2024-03-27T10:01:24.442381+0000","last_became_peered":"2024-03-27T10:01:24.442381+0000","last_unstale":"2024-03-27T10:01:25.822432+0000","last_undegraded":"2024-03-27T10:01:25.822432+0000","last_fullsized":"2024-03-27T10:01:25.822432+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:41:23.568822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.456030+0000","last_change":"2024-03-27T10:01:23.428934+0000","last_active":"2024-03-27T10:01:25.456030+0000","last_peered":"2024-03-27T10:01:25.456030+0000","last_clean":"2024-03-27T10:01:25.456030+0000","last_became_active":"2024-03-27T10:01:23.427482+0000","last_became_peered":"2024-03-27T10:01:23.427482+0000","last_unstale":"2024-03-27T10:01:25.456030+0000","last_undegraded":"2024-03-27T10:01:25.456030+0000","last_fullsized":"2024-03-27T10:01:25.456030+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_clean_scrub_stamp":"2024-03-27T10:01:22.351623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:58:53.303924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.823442+0000","last_change":"2024-03-27T10:01:24.439196+0000","last_active":"2024-03-27T10:01:25.823442+0000","last_peered":"2024-03-27T10:01:25.823442+0000","last_clean":"2024-03-27T10:01:25.823442+0000","last_became_active":"2024-03-27T10:01:24.438896+0000","last_became_peered":"2024-03-27T10:01:24.438896+0000","last_unstale":"2024-03-27T10:01:25.823442+0000","last_undegraded":"2024-03-27T10:01:25.823442+0000","last_fullsized":"2024-03-27T10:01:25.823442+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:41:23.568822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"39'3","reported_seq":17,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.455731+0000","last_change":"2024-03-27T10:01:23.433084+0000","last_active":"2024-03-27T10:01:25.455731+0000","last_peered":"2024-03-27T10:01:25.455731+0000","last_clean":"2024-03-27T10:01:25.455731+0000","last_became_active":"2024-03-27T10:01:23.432230+0000","last_became_peered":"2024-03-27T10:01:23.432230+0000","last_unstale":"2024-03-27T10:01:25.455731+0000","last_undegraded":"2024-03-27T10:01:25.455731+0000","last_fullsized":"2024-03-27T10:01:25.455731+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_clean_scrub_stamp":"2024-03-27T10:01:22.351623+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T12:51:32.925978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.405695+0000","last_change":"2024-03-27T10:01:24.449675+0000","last_active":"2024-03-27T10:01:25.405695+0000","last_peered":"2024-03-27T10:01:25.405695+0000","last_clean":"2024-03-27T10:01:25.405695+0000","last_became_active":"2024-03-27T10:01:24.449365+0000","last_became_peered":"2024-03-27T10:01:24.449365+0000","last_unstale":"2024-03-27T10:01:25.405695+0000","last_undegraded":"2024-03-27T10:01:25.405695+0000","last_fullsized":"2024-03-27T10:01:25.405695+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:00:21.588815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"39'6","reported_seq":20,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.404497+0000","last_change":"2024-03-27T10:01:23.430412+0000","last_active":"2024-03-27T10:01:25.404497+0000","last_peered":"2024-03-27T10:01:25.404497+0000","last_clean":"2024-03-27T10:01:25.404497+0000","last_became_active":"2024-03-27T10:01:23.429993+0000","last_became_peered":"2024-03-27T10:01:23.429993+0000","last_unstale":"2024-03-27T10:01:25.404497+0000","last_undegraded":"2024-03-27T10:01:25.404497+0000","last_fullsized":"2024-03-27T10:01:25.404497+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_clean_scrub_stamp":"2024-03-27T10:01:22.351623+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:20:38.563278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.822796+0000","last_change":"2024-03-27T10:01:24.441672+0000","last_active":"2024-03-27T10:01:25.822796+0000","last_peered":"2024-03-27T10:01:25.822796+0000","last_clean":"2024-03-27T10:01:25.822796+0000","last_became_active":"2024-03-27T10:01:24.441171+0000","last_became_peered":"2024-03-27T10:01:24.441171+0000","last_unstale":"2024-03-27T10:01:25.822796+0000","last_undegraded":"2024-03-27T10:01:25.822796+0000","last_fullsized":"2024-03-27T10:01:25.822796+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T20:15:24.993936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"39'2","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.404463+0000","last_change":"2024-03-27T10:01:23.424632+0000","last_active":"2024-03-27T10:01:25.404463+0000","last_peered":"2024-03-27T10:01:25.404463+0000","last_clean":"2024-03-27T10:01:25.404463+0000","last_became_active":"2024-03-27T10:01:23.422971+0000","last_became_peered":"2024-03-27T10:01:23.422971+0000","last_unstale":"2024-03-27T10:01:25.404463+0000","last_undegraded":"2024-03-27T10:01:25.404463+0000","last_fullsized":"2024-03-27T10:01:25.404463+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_clean_scrub_stamp":"2024-03-27T10:01:22.351623+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:00:20.563547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.404120+0000","last_change":"2024-03-27T10:01:24.435187+0000","last_active":"2024-03-27T10:01:25.404120+0000","last_peered":"2024-03-27T10:01:25.404120+0000","last_clean":"2024-03-27T10:01:25.404120+0000","last_became_active":"2024-03-27T10:01:24.434858+0000","last_became_peered":"2024-03-27T10:01:24.434858+0000","last_unstale":"2024-03-27T10:01:25.404120+0000","last_undegraded":"2024-03-27T10:01:25.404120+0000","last_fullsized":"2024-03-27T10:01:25.404120+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T12:32:12.895181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.820574+0000","last_change":"2024-03-27T10:01:23.434681+0000","last_active":"2024-03-27T10:01:25.820574+0000","last_peered":"2024-03-27T10:01:25.820574+0000","last_clean":"2024-03-27T10:01:25.820574+0000","last_became_active":"2024-03-27T10:01:23.434278+0000","last_became_peered":"2024-03-27T10:01:23.434278+0000","last_unstale":"2024-03-27T10:01:25.820574+0000","last_undegraded":"2024-03-27T10:01:25.820574+0000","last_fullsized":"2024-03-27T10:01:25.820574+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_clean_scrub_stamp":"2024-03-27T10:01:22.351623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:47:07.830155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.821337+0000","last_change":"2024-03-27T10:01:24.457303+0000","last_active":"2024-03-27T10:01:25.821337+0000","last_peered":"2024-03-27T10:01:25.821337+0000","last_clean":"2024-03-27T10:01:25.821337+0000","last_became_active":"2024-03-27T10:01:24.456538+0000","last_became_peered":"2024-03-27T10:01:24.456538+0000","last_unstale":"2024-03-27T10:01:25.821337+0000","last_undegraded":"2024-03-27T10:01:25.821337+0000","last_fullsized":"2024-03-27T10:01:25.821337+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:20:39.588546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.407066+0000","last_change":"2024-03-27T10:01:23.415166+0000","last_active":"2024-03-27T10:01:25.407066+0000","last_peered":"2024-03-27T10:01:25.407066+0000","last_clean":"2024-03-27T10:01:25.407066+0000","last_became_active":"2024-03-27T10:01:23.413486+0000","last_became_peered":"2024-03-27T10:01:23.413486+0000","last_unstale":"2024-03-27T10:01:25.407066+0000","last_undegraded":"2024-03-27T10:01:25.407066+0000","last_fullsized":"2024-03-27T10:01:25.407066+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_clean_scrub_stamp":"2024-03-27T10:01:22.351623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:19:26.891312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.404291+0000","last_change":"2024-03-27T10:01:24.437189+0000","last_active":"2024-03-27T10:01:25.404291+0000","last_peered":"2024-03-27T10:01:25.404291+0000","last_clean":"2024-03-27T10:01:25.404291+0000","last_became_active":"2024-03-27T10:01:24.436509+0000","last_became_peered":"2024-03-27T10:01:24.436509+0000","last_unstale":"2024-03-27T10:01:25.404291+0000","last_undegraded":"2024-03-27T10:01:25.404291+0000","last_fullsized":"2024-03-27T10:01:25.404291+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T12:33:33.935860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"39'8","reported_seq":22,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.821438+0000","last_change":"2024-03-27T10:01:23.436147+0000","last_active":"2024-03-27T10:01:25.821438+0000","last_peered":"2024-03-27T10:01:25.821438+0000","last_clean":"2024-03-27T10:01:25.821438+0000","last_became_active":"2024-03-27T10:01:23.435785+0000","last_became_peered":"2024-03-27T10:01:23.435785+0000","last_unstale":"2024-03-27T10:01:25.821438+0000","last_undegraded":"2024-03-27T10:01:25.821438+0000","last_fullsized":"2024-03-27T10:01:25.821438+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_clean_scrub_stamp":"2024-03-27T10:01:22.351623+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:53:22.113616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.404525+0000","last_change":"2024-03-27T10:01:24.421650+0000","last_active":"2024-03-27T10:01:25.404525+0000","last_peered":"2024-03-27T10:01:25.404525+0000","last_clean":"2024-03-27T10:01:25.404525+0000","last_became_active":"2024-03-27T10:01:24.417567+0000","last_became_peered":"2024-03-27T10:01:24.417567+0000","last_unstale":"2024-03-27T10:01:25.404525+0000","last_undegraded":"2024-03-27T10:01:25.404525+0000","last_fullsized":"2024-03-27T10:01:25.404525+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T20:06:35.050642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"39'1","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.456240+0000","last_change":"2024-03-27T10:01:23.434290+0000","last_active":"2024-03-27T10:01:25.456240+0000","last_peered":"2024-03-27T10:01:25.456240+0000","last_clean":"2024-03-27T10:01:25.456240+0000","last_became_active":"2024-03-27T10:01:23.433907+0000","last_became_peered":"2024-03-27T10:01:23.433907+0000","last_unstale":"2024-03-27T10:01:25.456240+0000","last_undegraded":"2024-03-27T10:01:25.456240+0000","last_fullsized":"2024-03-27T10:01:25.456240+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_clean_scrub_stamp":"2024-03-27T10:01:22.351623+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T12:59:54.269125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.455644+0000","last_change":"2024-03-27T10:01:24.453606+0000","last_active":"2024-03-27T10:01:25.455644+0000","last_peered":"2024-03-27T10:01:25.455644+0000","last_clean":"2024-03-27T10:01:25.455644+0000","last_became_active":"2024-03-27T10:01:24.452959+0000","last_became_peered":"2024-03-27T10:01:24.452959+0000","last_unstale":"2024-03-27T10:01:25.455644+0000","last_undegraded":"2024-03-27T10:01:25.455644+0000","last_fullsized":"2024-03-27T10:01:25.455644+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:58:30.004453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"39'2","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.406348+0000","last_change":"2024-03-27T10:01:23.431781+0000","last_active":"2024-03-27T10:01:25.406348+0000","last_peered":"2024-03-27T10:01:25.406348+0000","last_clean":"2024-03-27T10:01:25.406348+0000","last_became_active":"2024-03-27T10:01:23.431483+0000","last_became_peered":"2024-03-27T10:01:23.431483+0000","last_unstale":"2024-03-27T10:01:25.406348+0000","last_undegraded":"2024-03-27T10:01:25.406348+0000","last_fullsized":"2024-03-27T10:01:25.406348+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_clean_scrub_stamp":"2024-03-27T10:01:22.351623+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:47:07.830155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.406008+0000","last_change":"2024-03-27T10:01:24.437506+0000","last_active":"2024-03-27T10:01:25.406008+0000","last_peered":"2024-03-27T10:01:25.406008+0000","last_clean":"2024-03-27T10:01:25.406008+0000","last_became_active":"2024-03-27T10:01:24.437208+0000","last_became_peered":"2024-03-27T10:01:24.437208+0000","last_unstale":"2024-03-27T10:01:25.406008+0000","last_undegraded":"2024-03-27T10:01:25.406008+0000","last_fullsized":"2024-03-27T10:01:25.406008+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T20:15:24.993936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"39'1","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.449362+0000","last_change":"2024-03-27T10:01:23.431474+0000","last_active":"2024-03-27T10:01:25.449362+0000","last_peered":"2024-03-27T10:01:25.449362+0000","last_clean":"2024-03-27T10:01:25.449362+0000","last_became_active":"2024-03-27T10:01:23.430580+0000","last_became_peered":"2024-03-27T10:01:23.430580+0000","last_unstale":"2024-03-27T10:01:25.449362+0000","last_undegraded":"2024-03-27T10:01:25.449362+0000","last_fullsized":"2024-03-27T10:01:25.449362+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_clean_scrub_stamp":"2024-03-27T10:01:22.351623+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:45:57.128480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.449500+0000","last_change":"2024-03-27T10:01:24.450704+0000","last_active":"2024-03-27T10:01:25.449500+0000","last_peered":"2024-03-27T10:01:25.449500+0000","last_clean":"2024-03-27T10:01:25.449500+0000","last_became_active":"2024-03-27T10:01:24.449969+0000","last_became_peered":"2024-03-27T10:01:24.449969+0000","last_unstale":"2024-03-27T10:01:25.449500+0000","last_undegraded":"2024-03-27T10:01:25.449500+0000","last_fullsized":"2024-03-27T10:01:25.449500+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:42:34.614831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.821097+0000","last_change":"2024-03-27T10:01:23.425236+0000","last_active":"2024-03-27T10:01:25.821097+0000","last_peered":"2024-03-27T10:01:25.821097+0000","last_clean":"2024-03-27T10:01:25.821097+0000","last_became_active":"2024-03-27T10:01:23.424962+0000","last_became_peered":"2024-03-27T10:01:23.424962+0000","last_unstale":"2024-03-27T10:01:25.821097+0000","last_undegraded":"2024-03-27T10:01:25.821097+0000","last_fullsized":"2024-03-27T10:01:25.821097+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_clean_scrub_stamp":"2024-03-27T10:01:22.351623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T12:51:32.925978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.821992+0000","last_change":"2024-03-27T10:01:24.463797+0000","last_active":"2024-03-27T10:01:25.821992+0000","last_peered":"2024-03-27T10:01:25.821992+0000","last_clean":"2024-03-27T10:01:25.821992+0000","last_became_active":"2024-03-27T10:01:24.463563+0000","last_became_peered":"2024-03-27T10:01:24.463563+0000","last_unstale":"2024-03-27T10:01:25.821992+0000","last_undegraded":"2024-03-27T10:01:25.821992+0000","last_fullsized":"2024-03-27T10:01:25.821992+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:03:12.303809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"39'2","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.449667+0000","last_change":"2024-03-27T10:01:23.425325+0000","last_active":"2024-03-27T10:01:25.449667+0000","last_peered":"2024-03-27T10:01:25.449667+0000","last_clean":"2024-03-27T10:01:25.449667+0000","last_became_active":"2024-03-27T10:01:23.423000+0000","last_became_peered":"2024-03-27T10:01:23.423000+0000","last_unstale":"2024-03-27T10:01:25.449667+0000","last_undegraded":"2024-03-27T10:01:25.449667+0000","last_fullsized":"2024-03-27T10:01:25.449667+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_clean_scrub_stamp":"2024-03-27T10:01:22.351623+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:20:24.735656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.822812+0000","last_change":"2024-03-27T10:01:24.442367+0000","last_active":"2024-03-27T10:01:25.822812+0000","last_peered":"2024-03-27T10:01:25.822812+0000","last_clean":"2024-03-27T10:01:25.822812+0000","last_became_active":"2024-03-27T10:01:24.442089+0000","last_became_peered":"2024-03-27T10:01:24.442089+0000","last_unstale":"2024-03-27T10:01:25.822812+0000","last_undegraded":"2024-03-27T10:01:25.822812+0000","last_fullsized":"2024-03-27T10:01:25.822812+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:46:41.476976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.449431+0000","last_change":"2024-03-27T10:01:23.429496+0000","last_active":"2024-03-27T10:01:25.449431+0000","last_peered":"2024-03-27T10:01:25.449431+0000","last_clean":"2024-03-27T10:01:25.449431+0000","last_became_active":"2024-03-27T10:01:23.429216+0000","last_became_peered":"2024-03-27T10:01:23.429216+0000","last_unstale":"2024-03-27T10:01:25.449431+0000","last_undegraded":"2024-03-27T10:01:25.449431+0000","last_fullsized":"2024-03-27T10:01:25.449431+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_clean_scrub_stamp":"2024-03-27T10:01:22.351623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T21:56:04.443490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.455171+0000","last_change":"2024-03-27T10:01:24.440879+0000","last_active":"2024-03-27T10:01:25.455171+0000","last_peered":"2024-03-27T10:01:25.455171+0000","last_clean":"2024-03-27T10:01:25.455171+0000","last_became_active":"2024-03-27T10:01:24.440597+0000","last_became_peered":"2024-03-27T10:01:24.440597+0000","last_unstale":"2024-03-27T10:01:25.455171+0000","last_undegraded":"2024-03-27T10:01:25.455171+0000","last_fullsized":"2024-03-27T10:01:25.455171+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:41:23.568822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.822095+0000","last_change":"2024-03-27T10:01:23.436698+0000","last_active":"2024-03-27T10:01:25.822095+0000","last_peered":"2024-03-27T10:01:25.822095+0000","last_clean":"2024-03-27T10:01:25.822095+0000","last_became_active":"2024-03-27T10:01:23.436340+0000","last_became_peered":"2024-03-27T10:01:23.436340+0000","last_unstale":"2024-03-27T10:01:25.822095+0000","last_undegraded":"2024-03-27T10:01:25.822095+0000","last_fullsized":"2024-03-27T10:01:25.822095+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_clean_scrub_stamp":"2024-03-27T10:01:22.351623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:42:33.589563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.404484+0000","last_change":"2024-03-27T10:01:24.438478+0000","last_active":"2024-03-27T10:01:25.404484+0000","last_peered":"2024-03-27T10:01:25.404484+0000","last_clean":"2024-03-27T10:01:25.404484+0000","last_became_active":"2024-03-27T10:01:24.438185+0000","last_became_peered":"2024-03-27T10:01:24.438185+0000","last_unstale":"2024-03-27T10:01:25.404484+0000","last_undegraded":"2024-03-27T10:01:25.404484+0000","last_fullsized":"2024-03-27T10:01:25.404484+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:13:24.133121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.449170+0000","last_change":"2024-03-27T10:01:23.423788+0000","last_active":"2024-03-27T10:01:25.449170+0000","last_peered":"2024-03-27T10:01:25.449170+0000","last_clean":"2024-03-27T10:01:25.449170+0000","last_became_active":"2024-03-27T10:01:23.422256+0000","last_became_peered":"2024-03-27T10:01:23.422256+0000","last_unstale":"2024-03-27T10:01:25.449170+0000","last_undegraded":"2024-03-27T10:01:25.449170+0000","last_fullsized":"2024-03-27T10:01:25.449170+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_clean_scrub_stamp":"2024-03-27T10:01:22.351623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:47:42.239804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.821277+0000","last_change":"2024-03-27T10:01:24.442352+0000","last_active":"2024-03-27T10:01:25.821277+0000","last_peered":"2024-03-27T10:01:25.821277+0000","last_clean":"2024-03-27T10:01:25.821277+0000","last_became_active":"2024-03-27T10:01:24.442051+0000","last_became_peered":"2024-03-27T10:01:24.442051+0000","last_unstale":"2024-03-27T10:01:25.821277+0000","last_undegraded":"2024-03-27T10:01:25.821277+0000","last_fullsized":"2024-03-27T10:01:25.821277+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:00:21.588815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"39'2","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.456440+0000","last_change":"2024-03-27T10:01:23.432905+0000","last_active":"2024-03-27T10:01:25.456440+0000","last_peered":"2024-03-27T10:01:25.456440+0000","last_clean":"2024-03-27T10:01:25.456440+0000","last_became_active":"2024-03-27T10:01:23.432623+0000","last_became_peered":"2024-03-27T10:01:23.432623+0000","last_unstale":"2024-03-27T10:01:25.456440+0000","last_undegraded":"2024-03-27T10:01:25.456440+0000","last_fullsized":"2024-03-27T10:01:25.456440+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_clean_scrub_stamp":"2024-03-27T10:01:22.351623+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:49:40.765641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.822462+0000","last_change":"2024-03-27T10:01:24.444504+0000","last_active":"2024-03-27T10:01:25.822462+0000","last_peered":"2024-03-27T10:01:25.822462+0000","last_clean":"2024-03-27T10:01:25.822462+0000","last_became_active":"2024-03-27T10:01:24.443902+0000","last_became_peered":"2024-03-27T10:01:24.443902+0000","last_unstale":"2024-03-27T10:01:25.822462+0000","last_undegraded":"2024-03-27T10:01:25.822462+0000","last_fullsized":"2024-03-27T10:01:25.822462+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T12:55:05.971460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"40'1","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.453120+0000","last_change":"2024-03-27T10:01:23.431045+0000","last_active":"2024-03-27T10:01:25.453120+0000","last_peered":"2024-03-27T10:01:25.453120+0000","last_clean":"2024-03-27T10:01:25.453120+0000","last_became_active":"2024-03-27T10:01:23.430018+0000","last_became_peered":"2024-03-27T10:01:23.430018+0000","last_unstale":"2024-03-27T10:01:25.453120+0000","last_undegraded":"2024-03-27T10:01:25.453120+0000","last_fullsized":"2024-03-27T10:01:25.453120+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_clean_scrub_stamp":"2024-03-27T10:01:22.351623+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:18:28.787254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.404707+0000","last_change":"2024-03-27T10:01:24.425230+0000","last_active":"2024-03-27T10:01:25.404707+0000","last_peered":"2024-03-27T10:01:25.404707+0000","last_clean":"2024-03-27T10:01:25.404707+0000","last_became_active":"2024-03-27T10:01:24.424794+0000","last_became_peered":"2024-03-27T10:01:24.424794+0000","last_unstale":"2024-03-27T10:01:25.404707+0000","last_undegraded":"2024-03-27T10:01:25.404707+0000","last_fullsized":"2024-03-27T10:01:25.404707+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:59:09.611653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.823115+0000","last_change":"2024-03-27T10:01:23.423737+0000","last_active":"2024-03-27T10:01:25.823115+0000","last_peered":"2024-03-27T10:01:25.823115+0000","last_clean":"2024-03-27T10:01:25.823115+0000","last_became_active":"2024-03-27T10:01:23.423239+0000","last_became_peered":"2024-03-27T10:01:23.423239+0000","last_unstale":"2024-03-27T10:01:25.823115+0000","last_undegraded":"2024-03-27T10:01:25.823115+0000","last_fullsized":"2024-03-27T10:01:25.823115+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_clean_scrub_stamp":"2024-03-27T10:01:22.351623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T12:59:54.269125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.822685+0000","last_change":"2024-03-27T10:01:24.444676+0000","last_active":"2024-03-27T10:01:25.822685+0000","last_peered":"2024-03-27T10:01:25.822685+0000","last_clean":"2024-03-27T10:01:25.822685+0000","last_became_active":"2024-03-27T10:01:24.443616+0000","last_became_peered":"2024-03-27T10:01:24.443616+0000","last_unstale":"2024-03-27T10:01:25.822685+0000","last_undegraded":"2024-03-27T10:01:25.822685+0000","last_fullsized":"2024-03-27T10:01:25.822685+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:14:08.363370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.823277+0000","last_change":"2024-03-27T10:01:23.426523+0000","last_active":"2024-03-27T10:01:25.823277+0000","last_peered":"2024-03-27T10:01:25.823277+0000","last_clean":"2024-03-27T10:01:25.823277+0000","last_became_active":"2024-03-27T10:01:23.426232+0000","last_became_peered":"2024-03-27T10:01:23.426232+0000","last_unstale":"2024-03-27T10:01:25.823277+0000","last_undegraded":"2024-03-27T10:01:25.823277+0000","last_fullsized":"2024-03-27T10:01:25.823277+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_clean_scrub_stamp":"2024-03-27T10:01:22.351623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T12:51:32.925978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.820561+0000","last_change":"2024-03-27T10:01:24.437294+0000","last_active":"2024-03-27T10:01:25.820561+0000","last_peered":"2024-03-27T10:01:25.820561+0000","last_clean":"2024-03-27T10:01:25.820561+0000","last_became_active":"2024-03-27T10:01:24.435480+0000","last_became_peered":"2024-03-27T10:01:24.435480+0000","last_unstale":"2024-03-27T10:01:25.820561+0000","last_undegraded":"2024-03-27T10:01:25.820561+0000","last_fullsized":"2024-03-27T10:01:25.820561+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:20:39.588546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.407398+0000","last_change":"2024-03-27T10:01:23.425899+0000","last_active":"2024-03-27T10:01:25.407398+0000","last_peered":"2024-03-27T10:01:25.407398+0000","last_clean":"2024-03-27T10:01:25.407398+0000","last_became_active":"2024-03-27T10:01:23.422107+0000","last_became_peered":"2024-03-27T10:01:23.422107+0000","last_unstale":"2024-03-27T10:01:25.407398+0000","last_undegraded":"2024-03-27T10:01:25.407398+0000","last_fullsized":"2024-03-27T10:01:25.407398+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_clean_scrub_stamp":"2024-03-27T10:01:22.351623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T22:00:49.260875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.405383+0000","last_change":"2024-03-27T10:01:24.429105+0000","last_active":"2024-03-27T10:01:25.405383+0000","last_peered":"2024-03-27T10:01:25.405383+0000","last_clean":"2024-03-27T10:01:25.405383+0000","last_became_active":"2024-03-27T10:01:24.428588+0000","last_became_peered":"2024-03-27T10:01:24.428588+0000","last_unstale":"2024-03-27T10:01:25.405383+0000","last_undegraded":"2024-03-27T10:01:25.405383+0000","last_fullsized":"2024-03-27T10:01:25.405383+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:51:31.080332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.404630+0000","last_change":"2024-03-27T10:01:23.417333+0000","last_active":"2024-03-27T10:01:25.404630+0000","last_peered":"2024-03-27T10:01:25.404630+0000","last_clean":"2024-03-27T10:01:25.404630+0000","last_became_active":"2024-03-27T10:01:23.416756+0000","last_became_peered":"2024-03-27T10:01:23.416756+0000","last_unstale":"2024-03-27T10:01:25.404630+0000","last_undegraded":"2024-03-27T10:01:25.404630+0000","last_fullsized":"2024-03-27T10:01:25.404630+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_clean_scrub_stamp":"2024-03-27T10:01:22.351623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:42:33.589563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.821866+0000","last_change":"2024-03-27T10:01:24.445055+0000","last_active":"2024-03-27T10:01:25.821866+0000","last_peered":"2024-03-27T10:01:25.821866+0000","last_clean":"2024-03-27T10:01:25.821866+0000","last_became_active":"2024-03-27T10:01:24.442663+0000","last_became_peered":"2024-03-27T10:01:24.442663+0000","last_unstale":"2024-03-27T10:01:25.821866+0000","last_undegraded":"2024-03-27T10:01:25.821866+0000","last_fullsized":"2024-03-27T10:01:25.821866+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:46:41.476976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.403998+0000","last_change":"2024-03-27T10:01:23.419605+0000","last_active":"2024-03-27T10:01:25.403998+0000","last_peered":"2024-03-27T10:01:25.403998+0000","last_clean":"2024-03-27T10:01:25.403998+0000","last_became_active":"2024-03-27T10:01:23.419291+0000","last_became_peered":"2024-03-27T10:01:23.419291+0000","last_unstale":"2024-03-27T10:01:25.403998+0000","last_undegraded":"2024-03-27T10:01:25.403998+0000","last_fullsized":"2024-03-27T10:01:25.403998+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_clean_scrub_stamp":"2024-03-27T10:01:22.351623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:51:30.055064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.455452+0000","last_change":"2024-03-27T10:01:24.454480+0000","last_active":"2024-03-27T10:01:25.455452+0000","last_peered":"2024-03-27T10:01:25.455452+0000","last_clean":"2024-03-27T10:01:25.455452+0000","last_became_active":"2024-03-27T10:01:24.454202+0000","last_became_peered":"2024-03-27T10:01:24.454202+0000","last_unstale":"2024-03-27T10:01:25.455452+0000","last_undegraded":"2024-03-27T10:01:25.455452+0000","last_fullsized":"2024-03-27T10:01:25.455452+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:23.376891+0000","last_clean_scrub_stamp":"2024-03-27T10:01:23.376891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T12:55:05.971460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.822016+0000","last_change":"2024-03-27T10:01:23.434505+0000","last_active":"2024-03-27T10:01:25.822016+0000","last_peered":"2024-03-27T10:01:25.822016+0000","last_clean":"2024-03-27T10:01:25.822016+0000","last_became_active":"2024-03-27T10:01:23.434219+0000","last_became_peered":"2024-03-27T10:01:23.434219+0000","last_unstale":"2024-03-27T10:01:25.822016+0000","last_undegraded":"2024-03-27T10:01:25.822016+0000","last_fullsized":"2024-03-27T10:01:25.822016+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T10:01:22.351623+0000","last_clean_scrub_stamp":"2024-03-27T10:01:22.351623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:25:40.019001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":207,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-03-27T10:01:25.821705+0000","last_change":"2024-03-27T09:59:19.234906+0000","last_active":"2024-03-27T10:01:25.821705+0000","last_peered":"2024-03-27T10:01:25.821705+0000","last_clean":"2024-03-27T10:01:25.821705+0000","last_became_active":"2024-03-27T09:59:19.234124+0000","last_became_peered":"2024-03-27T09:59:19.234124+0000","last_unstale":"2024-03-27T10:01:25.821705+0000","last_undegraded":"2024-03-27T10:01:25.821705+0000","last_fullsized":"2024-03-27T10:01:25.821705+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:17.974760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:17.974760+0000","last_clean_scrub_stamp":"2024-03-27T09:59:17.974760+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:24:35.357325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":14,"seq":60129542173,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31648,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340192,"statfs":{"total":96636764160,"available":96604356608,"internally_reserved":0,"allocated":475136,"data_stored":202370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542173,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31640,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340200,"statfs":{"total":96636764160,"available":96604364800,"internally_reserved":0,"allocated":462848,"data_stored":200794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542172,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":462848,"data_stored":200814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542172,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32220,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339620,"statfs":{"total":96636764160,"available":96603770880,"internally_reserved":0,"allocated":1056768,"data_stored":791126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574878,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32232,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339608,"statfs":{"total":96636764160,"available":96603758592,"internally_reserved":0,"allocated":1069056,"data_stored":792774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":462848,"data_stored":201306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574876,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":466944,"data_stored":200836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31644,"kb_used_data":456,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340196,"statfs":{"total":96636764160,"available":96604360704,"internally_reserved":0,"allocated":466944,"data_stored":201328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-27T10:01:29.456 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-03-27T10:01:29.456 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-03-27T10:01:29.714 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.725+0000 7f3958a00640 1 Processor -- start 2024-03-27T10:01:29.715 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.726+0000 7f3958a00640 1 -- start start 2024-03-27T10:01:29.716 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.727+0000 7f3958a00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3954161950 0x7f39540ceb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:29.716 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.727+0000 7f3958a00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f39540cf040 0x7f39540cf480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:29.716 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.727+0000 7f3958a00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39540cfe40 con 0x7f39540d2760 2024-03-27T10:01:29.716 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.727+0000 7f3958a00640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f39540cf9c0 con 0x7f3954161950 2024-03-27T10:01:29.716 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.727+0000 7f3958a00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f3954161d30 con 0x7f39540cf040 2024-03-27T10:01:29.716 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.727+0000 7f3952800640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3954161950 0x7f39540ceb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:29.716 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.727+0000 7f3952800640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f3954161950 0x7f39540ceb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56226/0 (socket says 172.21.15.57:56226) 2024-03-27T10:01:29.716 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.727+0000 7f3952800640 1 -- 172.21.15.57:0/1262123519 learned_addr learned my addr 172.21.15.57:0/1262123519 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:01:29.717 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.728+0000 7f3952800640 1 -- 172.21.15.57:0/1262123519 >> v2:172.21.15.118:3300/0 conn(0x7f39540cf040 msgr2=0x7f39540cf480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:01:29.717 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.728+0000 7f3952800640 1 --2- 172.21.15.57:0/1262123519 >> v2:172.21.15.118:3300/0 conn(0x7f39540cf040 0x7f39540cf480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:29.717 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.728+0000 7f3952800640 1 -- 172.21.15.57:0/1262123519 >> v1:172.21.15.118:6789/0 conn(0x7f39540d2760 legacy=0x7f39540d2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:01:29.717 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.728+0000 7f3952800640 1 -- 172.21.15.57:0/1262123519 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39540d0f10 con 0x7f3954161950 2024-03-27T10:01:29.717 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.729+0000 7f3952800640 1 --2- 172.21.15.57:0/1262123519 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3954161950 0x7f39540ceb00 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f395408c610 tx=0x7f394402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ceb0c842359cb1e server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:29.718 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.729+0000 7f3951400640 1 -- 172.21.15.57:0/1262123519 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3944034070 con 0x7f3954161950 2024-03-27T10:01:29.718 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.729+0000 7f3951400640 1 -- 172.21.15.57:0/1262123519 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3944030860 con 0x7f3954161950 2024-03-27T10:01:29.718 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.729+0000 7f3951400640 1 -- 172.21.15.57:0/1262123519 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3944030c30 con 0x7f3954161950 2024-03-27T10:01:29.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.730+0000 7f3958a00640 1 -- 172.21.15.57:0/1262123519 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3954161950 msgr2=0x7f39540ceb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:29.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.730+0000 7f3958a00640 1 --2- 172.21.15.57:0/1262123519 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3954161950 0x7f39540ceb00 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f395408c610 tx=0x7f394402b9a0 comp rx=0 tx=0).stop 2024-03-27T10:01:29.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.730+0000 7f3958a00640 1 -- 172.21.15.57:0/1262123519 shutdown_connections 2024-03-27T10:01:29.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.730+0000 7f3958a00640 1 --2- 172.21.15.57:0/1262123519 >> v2:172.21.15.118:3300/0 conn(0x7f39540cf040 0x7f39540cf480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:29.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.730+0000 7f3958a00640 1 --2- 172.21.15.57:0/1262123519 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3954161950 0x7f39540ceb00 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:29.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.730+0000 7f3958a00640 1 -- 172.21.15.57:0/1262123519 >> 172.21.15.57:0/1262123519 conn(0x7f39540d3fc0 msgr2=0x7f39540d43d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:29.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.730+0000 7f3958a00640 1 -- 172.21.15.57:0/1262123519 shutdown_connections 2024-03-27T10:01:29.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.730+0000 7f3958a00640 1 -- 172.21.15.57:0/1262123519 wait complete. 2024-03-27T10:01:29.721 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.732+0000 7f3958a00640 1 Processor -- start 2024-03-27T10:01:29.721 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.732+0000 7f3958a00640 1 -- start start 2024-03-27T10:01:29.724 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.733+0000 7f3958a00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f39540cf040 0x7f39541534c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:29.724 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.733+0000 7f3958a00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f39540d2760 0x7f39540c9d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:29.724 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.733+0000 7f3958a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3954161950 0x7f39540cd410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:29.724 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.733+0000 7f3958a00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f39540d1f60 con 0x7f39540d2760 2024-03-27T10:01:29.724 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.733+0000 7f3958a00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f39540d14d0 con 0x7f3954161950 2024-03-27T10:01:29.724 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.733+0000 7f3958a00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f39540d2240 con 0x7f39540cf040 2024-03-27T10:01:29.725 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.733+0000 7f3951e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f39540d2760 0x7f39540c9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:29.725 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.733+0000 7f3951e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f39540d2760 0x7f39540c9d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56228/0 (socket says 172.21.15.57:56228) 2024-03-27T10:01:29.725 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.733+0000 7f3951e00640 1 -- 172.21.15.57:0/1434241887 learned_addr learned my addr 172.21.15.57:0/1434241887 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:01:29.725 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.734+0000 7f3952800640 1 --2- 172.21.15.57:0/1434241887 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f39540cf040 0x7f39541534c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:29.725 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.734+0000 7f3951e00640 1 -- 172.21.15.57:0/1434241887 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f39540cf040 msgr2=0x7f39541534c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:29.725 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.734+0000 7f3951e00640 1 --2- 172.21.15.57:0/1434241887 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f39540cf040 0x7f39541534c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:29.725 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.734+0000 7f3951e00640 1 -- 172.21.15.57:0/1434241887 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3954161950 msgr2=0x7f39540cd410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:29.725 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.734+0000 7f3953200640 1 --2- 172.21.15.57:0/1434241887 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3954161950 0x7f39540cd410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:29.725 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.734+0000 7f3951e00640 1 --2- 172.21.15.57:0/1434241887 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3954161950 0x7f39540cd410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:29.725 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.734+0000 7f3951e00640 1 -- 172.21.15.57:0/1434241887 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3954153a00 con 0x7f39540d2760 2024-03-27T10:01:29.725 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.734+0000 7f3952800640 1 --2- 172.21.15.57:0/1434241887 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f39540cf040 0x7f39541534c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T10:01:29.725 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.734+0000 7f3951e00640 1 --2- 172.21.15.57:0/1434241887 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f39540d2760 0x7f39540c9d40 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f394000b4a0 tx=0x7f394000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:29.725 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.734+0000 7f394aa00640 1 -- 172.21.15.57:0/1434241887 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3940014070 con 0x7f39540d2760 2024-03-27T10:01:29.726 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.735+0000 7f394aa00640 1 -- 172.21.15.57:0/1434241887 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3940010610 con 0x7f39540d2760 2024-03-27T10:01:29.726 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.735+0000 7f394aa00640 1 -- 172.21.15.57:0/1434241887 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3940010a00 con 0x7f39540d2760 2024-03-27T10:01:29.726 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.735+0000 7f3958a00640 1 -- 172.21.15.57:0/1434241887 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39540c8ac0 con 0x7f39540d2760 2024-03-27T10:01:29.726 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.735+0000 7f3958a00640 1 -- 172.21.15.57:0/1434241887 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39540cb1c0 con 0x7f39540d2760 2024-03-27T10:01:29.726 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.736+0000 7f3958a00640 1 -- 172.21.15.57:0/1434241887 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3954068540 con 0x7f39540d2760 2024-03-27T10:01:29.726 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.737+0000 7f394aa00640 1 -- 172.21.15.57:0/1434241887 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f3940017070 con 0x7f39540d2760 2024-03-27T10:01:29.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.738+0000 7f394aa00640 1 --2- 172.21.15.57:0/1434241887 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f393406c530 0x7f393406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:29.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.739+0000 7f394aa00640 1 -- 172.21.15.57:0/1434241887 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f394008b330 con 0x7f39540d2760 2024-03-27T10:01:29.727 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.739+0000 7f3952800640 1 --2- 172.21.15.57:0/1434241887 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f393406c530 0x7f393406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:29.728 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.739+0000 7f3952800640 1 --2- 172.21.15.57:0/1434241887 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f393406c530 0x7f393406e9f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f3944036000 tx=0x7f394403b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:29.731 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:29.742+0000 7f394aa00640 1 -- 172.21.15.57:0/1434241887 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f39400597b0 con 0x7f39540d2760 2024-03-27T10:01:30.001 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.012+0000 7f3958a00640 1 -- 172.21.15.57:0/1434241887 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f395406d0c0 con 0x7f39540d2760 2024-03-27T10:01:30.005 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.016+0000 7f394aa00640 1 -- 172.21.15.57:0/1434241887 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) ==== 190+0+147 (secure 0 0 0) 0x7f39400590b0 con 0x7f39540d2760 2024-03-27T10:01:30.005 INFO:teuthology.orchestra.run.smithi057.stdout:[client.0] 2024-03-27T10:01:30.005 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQC+7QNmRLHcIhAAr+U/Y0Vnin6pDQmxi8Dc+g== 2024-03-27T10:01:30.005 INFO:teuthology.orchestra.run.smithi057.stdout: caps mds = "allow" 2024-03-27T10:01:30.006 INFO:teuthology.orchestra.run.smithi057.stdout: caps mon = "allow r" 2024-03-27T10:01:30.006 INFO:teuthology.orchestra.run.smithi057.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-03-27T10:01:30.006 INFO:teuthology.orchestra.run.smithi057.stderr:updated caps for client.0 2024-03-27T10:01:30.008 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.019+0000 7f3958a00640 1 -- 172.21.15.57:0/1434241887 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f393406c530 msgr2=0x7f393406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:30.008 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.019+0000 7f3958a00640 1 --2- 172.21.15.57:0/1434241887 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f393406c530 0x7f393406e9f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f3944036000 tx=0x7f394403b040 comp rx=0 tx=0).stop 2024-03-27T10:01:30.008 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.019+0000 7f3958a00640 1 -- 172.21.15.57:0/1434241887 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f39540d2760 msgr2=0x7f39540c9d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:30.008 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.019+0000 7f3958a00640 1 --2- 172.21.15.57:0/1434241887 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f39540d2760 0x7f39540c9d40 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f394000b4a0 tx=0x7f394000b960 comp rx=0 tx=0).stop 2024-03-27T10:01:30.008 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.019+0000 7f3958a00640 1 -- 172.21.15.57:0/1434241887 shutdown_connections 2024-03-27T10:01:30.008 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.019+0000 7f3958a00640 1 --2- 172.21.15.57:0/1434241887 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f393406c530 0x7f393406e9f0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:30.008 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.019+0000 7f3958a00640 1 --2- 172.21.15.57:0/1434241887 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3954161950 0x7f39540cd410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:30.008 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.019+0000 7f3958a00640 1 --2- 172.21.15.57:0/1434241887 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f39540d2760 0x7f39540c9d40 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:30.008 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.019+0000 7f3958a00640 1 --2- 172.21.15.57:0/1434241887 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f39540cf040 0x7f39541534c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:30.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.019+0000 7f3958a00640 1 -- 172.21.15.57:0/1434241887 >> 172.21.15.57:0/1434241887 conn(0x7f39540d3fc0 msgr2=0x7f39540b52a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:30.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.020+0000 7f3958a00640 1 -- 172.21.15.57:0/1434241887 shutdown_connections 2024-03-27T10:01:30.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.020+0000 7f3958a00640 1 -- 172.21.15.57:0/1434241887 wait complete. 2024-03-27T10:01:30.027 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-27T10:01:30.227 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.238+0000 7fce0d000640 1 Processor -- start 2024-03-27T10:01:30.227 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.238+0000 7fce0d000640 1 -- start start 2024-03-27T10:01:30.230 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.241+0000 7fce0d000640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fce0806c940 0x7fce08161f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:30.230 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.241+0000 7fce0d000640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fce0815e590 0x7fce080d1e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:30.230 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.241+0000 7fce0d000640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce081628d0 con 0x7fce0815e1b0 2024-03-27T10:01:30.230 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.241+0000 7fce0d000640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7fce08162bb0 con 0x7fce0806c940 2024-03-27T10:01:30.231 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.241+0000 7fce0d000640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fce080b2150 con 0x7fce0815e590 2024-03-27T10:01:30.231 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.241+0000 7fce05e00640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fce0815e1b0 0x7fce080b2950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:40386/0 (socket says 172.21.15.57:40386) 2024-03-27T10:01:30.231 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.241+0000 7fce05e00640 1 -- 172.21.15.57:0/1297999240 learned_addr learned my addr 172.21.15.57:0/1297999240 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T10:01:30.233 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.242+0000 7fce05400640 1 --2- 172.21.15.57:0/1297999240 >> v2:172.21.15.118:3300/0 conn(0x7fce0806c940 0x7fce08161f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:30.233 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.242+0000 7fce06800640 1 --2- 172.21.15.57:0/1297999240 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fce0815e590 0x7fce080d1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:30.233 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.242+0000 7fce04a00640 1 -- 172.21.15.57:0/1297999240 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2220723118 0 0) 0x7fce081628d0 con 0x7fce0815e1b0 2024-03-27T10:01:30.233 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.242+0000 7fce04a00640 1 -- 172.21.15.57:0/1297999240 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcdec003520 con 0x7fce0815e1b0 2024-03-27T10:01:30.233 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.242+0000 7fce04a00640 1 -- 172.21.15.57:0/1297999240 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2503170764 0 0) 0x7fcdec003520 con 0x7fce0815e1b0 2024-03-27T10:01:30.233 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.242+0000 7fce04a00640 1 -- 172.21.15.57:0/1297999240 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fce0815e590 msgr2=0x7fce080d1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:01:30.233 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.242+0000 7fce04a00640 1 --2- 172.21.15.57:0/1297999240 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fce0815e590 0x7fce080d1e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:30.233 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.242+0000 7fce04a00640 1 -- 172.21.15.57:0/1297999240 >> v2:172.21.15.118:3300/0 conn(0x7fce0806c940 msgr2=0x7fce08161f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:01:30.234 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.242+0000 7fce04a00640 1 --2- 172.21.15.57:0/1297999240 >> v2:172.21.15.118:3300/0 conn(0x7fce0806c940 0x7fce08161f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:30.234 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.243+0000 7fce04a00640 1 -- 172.21.15.57:0/1297999240 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce080b2430 con 0x7fce0815e1b0 2024-03-27T10:01:30.234 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.243+0000 7fce04a00640 1 -- 172.21.15.57:0/1297999240 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4227751516 0 0) 0x7fcdf8001670 con 0x7fce0815e1b0 2024-03-27T10:01:30.234 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.243+0000 7fce04a00640 1 -- 172.21.15.57:0/1297999240 >> v1:172.21.15.57:6789/0 conn(0x7fce0815e1b0 legacy=0x7fce080b2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:30.234 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.243+0000 7fce04a00640 1 --2- 172.21.15.57:0/1297999240 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fce0815e590 0x7fcdec0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:30.234 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.243+0000 7fce04a00640 1 --2- 172.21.15.57:0/1297999240 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcdec003f30 0x7fcdec004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:30.234 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.243+0000 7fce04a00640 1 --2- 172.21.15.57:0/1297999240 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcdec004d40 0x7fcdec0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:30.234 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.243+0000 7fce04a00640 1 -- 172.21.15.57:0/1297999240 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fce08162bb0 con 0x7fcdec003f30 2024-03-27T10:01:30.234 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.243+0000 7fce04a00640 1 -- 172.21.15.57:0/1297999240 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fce080b2150 con 0x7fcdec004d40 2024-03-27T10:01:30.234 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.243+0000 7fce04a00640 1 -- 172.21.15.57:0/1297999240 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fcdec00ba10 con 0x7fce0815e590 2024-03-27T10:01:30.234 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.243+0000 7fce05400640 1 --2- 172.21.15.57:0/1297999240 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcdec003f30 0x7fcdec004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:30.234 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.243+0000 7fce05e00640 1 --2- 172.21.15.57:0/1297999240 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fce0815e590 0x7fcdec0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:30.235 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.243+0000 7fce06800640 1 --2- 172.21.15.57:0/1297999240 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcdec004d40 0x7fcdec0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:30.235 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.243+0000 7fce05400640 1 -- 172.21.15.57:0/1297999240 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fce0815e590 msgr2=0x7fcdec0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:01:30.235 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.243+0000 7fce05400640 1 --2- 172.21.15.57:0/1297999240 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fce0815e590 0x7fcdec0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:30.235 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.243+0000 7fce05400640 1 -- 172.21.15.57:0/1297999240 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcdec004d40 msgr2=0x7fcdec0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:01:30.235 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.243+0000 7fce05400640 1 --2- 172.21.15.57:0/1297999240 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcdec004d40 0x7fcdec0051c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:30.235 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.244+0000 7fce05400640 1 -- 172.21.15.57:0/1297999240 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdec003520 con 0x7fcdec003f30 2024-03-27T10:01:30.236 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.245+0000 7fce05400640 1 --2- 172.21.15.57:0/1297999240 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcdec003f30 0x7fcdec004800 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fcdf4009af0 tx=0x7fcdec005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da9aa1565145573a server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:30.237 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.245+0000 7fce04a00640 1 -- 172.21.15.57:0/1297999240 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdf4039070 con 0x7fcdec003f30 2024-03-27T10:01:30.237 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.245+0000 7fce04a00640 1 -- 172.21.15.57:0/1297999240 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdf402c710 con 0x7fcdec003f30 2024-03-27T10:01:30.237 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.245+0000 7fce04a00640 1 -- 172.21.15.57:0/1297999240 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdf4009690 con 0x7fcdec003f30 2024-03-27T10:01:30.237 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.245+0000 7fce0d000640 1 -- 172.21.15.57:0/1297999240 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcdec003f30 msgr2=0x7fcdec004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:30.237 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.245+0000 7fce0d000640 1 --2- 172.21.15.57:0/1297999240 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcdec003f30 0x7fcdec004800 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fcdf4009af0 tx=0x7fcdec005830 comp rx=0 tx=0).stop 2024-03-27T10:01:30.237 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.246+0000 7fce06800640 1 -- 172.21.15.57:0/1297999240 reap_dead start 2024-03-27T10:01:30.237 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.246+0000 7fce0d000640 1 -- 172.21.15.57:0/1297999240 shutdown_connections 2024-03-27T10:01:30.237 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.246+0000 7fce0d000640 1 -- 172.21.15.57:0/1297999240 >> 172.21.15.57:0/1297999240 conn(0x7fce0809aa30 msgr2=0x7fce0809ae40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:30.237 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.246+0000 7fce0d000640 1 -- 172.21.15.57:0/1297999240 shutdown_connections 2024-03-27T10:01:30.237 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.246+0000 7fce0d000640 1 -- 172.21.15.57:0/1297999240 wait complete. 2024-03-27T10:01:30.237 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.248+0000 7fce0d000640 1 Processor -- start 2024-03-27T10:01:30.237 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.248+0000 7fce0d000640 1 -- start start 2024-03-27T10:01:30.239 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.249+0000 7fce0d000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcdec003f30 0x7fce080b5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:30.240 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.249+0000 7fce0d000640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fce08161630 0x7fce0815fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:30.240 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.249+0000 7fce0d000640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fce080afb50 0x7fce080affd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:30.240 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.249+0000 7fce0d000640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fce080d1e40 con 0x7fce08161630 2024-03-27T10:01:30.240 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.249+0000 7fce0d000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fce081626b0 con 0x7fcdec003f30 2024-03-27T10:01:30.240 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.249+0000 7fce0d000640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fce080d1fc0 con 0x7fce080afb50 2024-03-27T10:01:30.240 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.249+0000 7fce05400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fce08161630 0x7fce0815fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:30.240 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.249+0000 7fce05400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fce08161630 0x7fce0815fe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56248/0 (socket says 172.21.15.57:56248) 2024-03-27T10:01:30.240 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.249+0000 7fce05400640 1 -- 172.21.15.57:0/4145121994 learned_addr learned my addr 172.21.15.57:0/4145121994 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:01:30.240 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.249+0000 7fce05e00640 1 --2- 172.21.15.57:0/4145121994 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcdec003f30 0x7fce080b5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:30.240 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.249+0000 7fce05400640 1 -- 172.21.15.57:0/4145121994 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fce080afb50 msgr2=0x7fce080affd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:30.240 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.249+0000 7fce05400640 1 --2- 172.21.15.57:0/4145121994 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fce080afb50 0x7fce080affd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:30.240 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.249+0000 7fce05400640 1 -- 172.21.15.57:0/4145121994 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcdec003f30 msgr2=0x7fce080b5c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:30.241 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.249+0000 7fce05400640 1 --2- 172.21.15.57:0/4145121994 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcdec003f30 0x7fce080b5c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:30.241 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.249+0000 7fce05400640 1 -- 172.21.15.57:0/4145121994 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce081608b0 con 0x7fce08161630 2024-03-27T10:01:30.241 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.249+0000 7fce05e00640 1 --2- 172.21.15.57:0/4145121994 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcdec003f30 0x7fce080b5c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T10:01:30.241 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.250+0000 7fce05400640 1 --2- 172.21.15.57:0/4145121994 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fce08161630 0x7fce0815fe60 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fcdf4009af0 tx=0x7fcdf4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:30.241 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.250+0000 7fcdfe000640 1 -- 172.21.15.57:0/4145121994 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdf4039050 con 0x7fce08161630 2024-03-27T10:01:30.241 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.250+0000 7fcdfe000640 1 -- 172.21.15.57:0/4145121994 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdf4045070 con 0x7fce08161630 2024-03-27T10:01:30.241 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.250+0000 7fce0d000640 1 -- 172.21.15.57:0/4145121994 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce080b63a0 con 0x7fce08161630 2024-03-27T10:01:30.241 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.250+0000 7fcdfe000640 1 -- 172.21.15.57:0/4145121994 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdf4003850 con 0x7fce08161630 2024-03-27T10:01:30.241 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.251+0000 7fce0d000640 1 -- 172.21.15.57:0/4145121994 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce08160e30 con 0x7fce08161630 2024-03-27T10:01:30.242 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.252+0000 7fce0d000640 1 -- 172.21.15.57:0/4145121994 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce08068620 con 0x7fce08161630 2024-03-27T10:01:30.242 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.253+0000 7fcdfe000640 1 -- 172.21.15.57:0/4145121994 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fcdf40039f0 con 0x7fce08161630 2024-03-27T10:01:30.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.254+0000 7fcdfe000640 1 --2- 172.21.15.57:0/4145121994 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fcde806c560 0x7fcde806ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:30.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.254+0000 7fcdfe000640 1 -- 172.21.15.57:0/4145121994 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7fcdf40ad8d0 con 0x7fce08161630 2024-03-27T10:01:30.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.254+0000 7fce05e00640 1 --2- 172.21.15.57:0/4145121994 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fcde806c560 0x7fcde806ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:30.244 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.255+0000 7fce05e00640 1 --2- 172.21.15.57:0/4145121994 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fcde806c560 0x7fcde806ea20 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fcdf8001eb0 tx=0x7fcdf8001de0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:30.250 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.261+0000 7fcdfe000640 1 -- 172.21.15.57:0/4145121994 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7fcdf404f020 con 0x7fce08161630 2024-03-27T10:01:30.497 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.508+0000 7fce0d000640 1 -- 172.21.15.57:0/4145121994 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fce080b1ab0 con 0x7fce08161630 2024-03-27T10:01:30.498 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.509+0000 7fcdfe000640 1 -- 172.21.15.57:0/4145121994 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5181 (secure 0 0 0) 0x7fcdf407bf30 con 0x7fce08161630 2024-03-27T10:01:30.498 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:01:30.498 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4883,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/534729135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":534729135},{"type":"v1","addr":"172.21.15.57:6835","nonce":534729135}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4886,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/1117032671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1117032671},{"type":"v1","addr":"172.21.15.118:6834","nonce":1117032671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4889,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/2149281891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":2149281891},{"type":"v1","addr":"172.21.15.118:6835","nonce":2149281891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-27T10:01:23.885660+0000","modified":"2024-03-27T10:01:27.013100+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5508},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5508":{"gid":5508,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.57:6837/385124398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":385124398},{"type":"v1","addr":"172.21.15.57:6837","nonce":385124398}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5508,"qdb_cluster":[5508]},"id":2}]} 2024-03-27T10:01:30.499 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 18 2024-03-27T10:01:30.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.512+0000 7fce0d000640 1 -- 172.21.15.57:0/4145121994 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fcde806c560 msgr2=0x7fcde806ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:30.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.512+0000 7fce0d000640 1 --2- 172.21.15.57:0/4145121994 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fcde806c560 0x7fcde806ea20 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fcdf8001eb0 tx=0x7fcdf8001de0 comp rx=0 tx=0).stop 2024-03-27T10:01:30.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.512+0000 7fce0d000640 1 -- 172.21.15.57:0/4145121994 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fce08161630 msgr2=0x7fce0815fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:30.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.512+0000 7fce0d000640 1 --2- 172.21.15.57:0/4145121994 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fce08161630 0x7fce0815fe60 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fcdf4009af0 tx=0x7fcdf4004730 comp rx=0 tx=0).stop 2024-03-27T10:01:30.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.512+0000 7fce0d000640 1 -- 172.21.15.57:0/4145121994 shutdown_connections 2024-03-27T10:01:30.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.512+0000 7fce0d000640 1 --2- 172.21.15.57:0/4145121994 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fce080afb50 0x7fce080affd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:30.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.512+0000 7fce0d000640 1 --2- 172.21.15.57:0/4145121994 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fce08161630 0x7fce0815fe60 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:30.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.512+0000 7fce0d000640 1 --2- 172.21.15.57:0/4145121994 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fcde806c560 0x7fcde806ea20 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:30.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.512+0000 7fce0d000640 1 --2- 172.21.15.57:0/4145121994 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcdec003f30 0x7fce080b5c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:30.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.512+0000 7fce0d000640 1 -- 172.21.15.57:0/4145121994 >> 172.21.15.57:0/4145121994 conn(0x7fce0809aa30 msgr2=0x7fce0809ae40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:30.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.513+0000 7fce0d000640 1 -- 172.21.15.57:0/4145121994 shutdown_connections 2024-03-27T10:01:30.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:30.513+0000 7fce0d000640 1 -- 172.21.15.57:0/4145121994 wait complete. 2024-03-27T10:01:30.921 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 18, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-27T10:01:23.885660+0000', 'modified': '2024-03-27T10:01:27.013100+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5508}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5508': {'gid': 5508, 'name': 'a', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.57:6837/385124398', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.57:6836', 'nonce': 385124398}, {'type': 'v1', 'addr': '172.21.15.57:6837', 'nonce': 385124398}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5508, 'qdb_cluster': [5508]} 2024-03-27T10:01:30.922 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-03-27T10:01:30.922 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-03-27T10:01:31.147 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.154+0000 7f70fa800640 1 Processor -- start 2024-03-27T10:01:31.147 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.154+0000 7f70fa800640 1 -- start start 2024-03-27T10:01:31.147 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.156+0000 7f70fa800640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f70f4158530 0x7f70f40ad8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:31.147 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.156+0000 7f70fa800640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f70f40adde0 0x7f70f4071b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:31.147 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.156+0000 7f70fa800640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70f406e210 con 0x7f70f40720d0 2024-03-27T10:01:31.147 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.156+0000 7f70fa800640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f70f406e4f0 con 0x7f70f4158530 2024-03-27T10:01:31.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.156+0000 7f70fa800640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f70f40710b0 con 0x7f70f40adde0 2024-03-27T10:01:31.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.157+0000 7f70f8a00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f70f40adde0 0x7f70f4071b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:31.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.157+0000 7f70f8a00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f70f40adde0 0x7f70f4071b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.57:51572/0 (socket says 172.21.15.57:51572) 2024-03-27T10:01:31.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.157+0000 7f70f8a00640 1 -- 172.21.15.57:0/1161620121 learned_addr learned my addr 172.21.15.57:0/1161620121 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:01:31.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.157+0000 7f70f9e00640 1 --1- 172.21.15.57:0/1161620121 >> v1:172.21.15.118:6789/0 conn(0x7f70f40720d0 0x7f70f406e970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.57:50398/0 (socket says 172.21.15.57:50398) 2024-03-27T10:01:31.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.157+0000 7f70f9400640 1 --2- 172.21.15.57:0/1161620121 >> v2:172.21.15.118:3300/0 conn(0x7f70f4158530 0x7f70f40ad8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:31.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.158+0000 7f70f3e00640 1 -- 172.21.15.57:0/1161620121 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3532635620 0 0) 0x7f70f406e210 con 0x7f70f40720d0 2024-03-27T10:01:31.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.158+0000 7f70f3e00640 1 -- 172.21.15.57:0/1161620121 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f70dc003520 con 0x7f70f40720d0 2024-03-27T10:01:31.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.158+0000 7f70f8a00640 1 -- 172.21.15.57:0/1161620121 >> v2:172.21.15.118:3300/0 conn(0x7f70f4158530 msgr2=0x7f70f40ad8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:01:31.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.158+0000 7f70f8a00640 1 --2- 172.21.15.57:0/1161620121 >> v2:172.21.15.118:3300/0 conn(0x7f70f4158530 0x7f70f40ad8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:31.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.158+0000 7f70f8a00640 1 -- 172.21.15.57:0/1161620121 >> v1:172.21.15.118:6789/0 conn(0x7f70f40720d0 legacy=0x7f70f406e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:31.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.158+0000 7f70f8a00640 1 -- 172.21.15.57:0/1161620121 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70f4071390 con 0x7f70f40adde0 2024-03-27T10:01:31.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.159+0000 7f70f8a00640 1 --2- 172.21.15.57:0/1161620121 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f70f40adde0 0x7f70f4071b90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f70e0009870 tx=0x7f70e002b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36b87abcb822ed10 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:31.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.160+0000 7f70f3e00640 1 -- 172.21.15.57:0/1161620121 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70e0034070 con 0x7f70f40adde0 2024-03-27T10:01:31.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.160+0000 7f70f3e00640 1 -- 172.21.15.57:0/1161620121 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70e0030840 con 0x7f70f40adde0 2024-03-27T10:01:31.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.160+0000 7f70f3e00640 1 -- 172.21.15.57:0/1161620121 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70e0030bf0 con 0x7f70f40adde0 2024-03-27T10:01:31.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.160+0000 7f70fa800640 1 -- 172.21.15.57:0/1161620121 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f70f40adde0 msgr2=0x7f70f4071b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:31.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.160+0000 7f70fa800640 1 --2- 172.21.15.57:0/1161620121 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f70f40adde0 0x7f70f4071b90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f70e0009870 tx=0x7f70e002b980 comp rx=0 tx=0).stop 2024-03-27T10:01:31.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.161+0000 7f70fa800640 1 -- 172.21.15.57:0/1161620121 shutdown_connections 2024-03-27T10:01:31.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.161+0000 7f70fa800640 1 --2- 172.21.15.57:0/1161620121 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f70f40adde0 0x7f70f4071b90 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:31.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.161+0000 7f70fa800640 1 --2- 172.21.15.57:0/1161620121 >> v2:172.21.15.118:3300/0 conn(0x7f70f4158530 0x7f70f40ad8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:31.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.161+0000 7f70fa800640 1 -- 172.21.15.57:0/1161620121 >> 172.21.15.57:0/1161620121 conn(0x7f70f40b1770 msgr2=0x7f70f40b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:31.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.161+0000 7f70fa800640 1 -- 172.21.15.57:0/1161620121 shutdown_connections 2024-03-27T10:01:31.150 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.161+0000 7f70fa800640 1 -- 172.21.15.57:0/1161620121 wait complete. 2024-03-27T10:01:31.152 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.164+0000 7f70fa800640 1 Processor -- start 2024-03-27T10:01:31.152 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.164+0000 7f70fa800640 1 -- start start 2024-03-27T10:01:31.155 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.165+0000 7f70fa800640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f70f40720d0 0x7f70f414f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:31.155 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.166+0000 7f70fa800640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f70f40adde0 0x7f70f40b3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:31.155 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.166+0000 7f70fa800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f70f4158530 0x7f70f40b4070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:31.155 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.166+0000 7f70fa800640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f70f4158a90 con 0x7f70f40adde0 2024-03-27T10:01:31.155 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.166+0000 7f70fa800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f70f4158910 con 0x7f70f4158530 2024-03-27T10:01:31.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.166+0000 7f70fa800640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f70f406f080 con 0x7f70f40720d0 2024-03-27T10:01:31.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.166+0000 7f70f8a00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f70f40adde0 0x7f70f40b3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:31.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.166+0000 7f70f8a00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f70f40adde0 0x7f70f40b3b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56252/0 (socket says 172.21.15.57:56252) 2024-03-27T10:01:31.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.166+0000 7f70f8a00640 1 -- 172.21.15.57:0/4279193183 learned_addr learned my addr 172.21.15.57:0/4279193183 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:01:31.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.166+0000 7f70f9400640 1 --2- 172.21.15.57:0/4279193183 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f70f40720d0 0x7f70f414f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:31.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.166+0000 7f70f8a00640 1 -- 172.21.15.57:0/4279193183 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f70f40720d0 msgr2=0x7f70f414f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:31.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.166+0000 7f70f9e00640 1 --2- 172.21.15.57:0/4279193183 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f70f4158530 0x7f70f40b4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:31.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.166+0000 7f70f8a00640 1 --2- 172.21.15.57:0/4279193183 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f70f40720d0 0x7f70f414f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:31.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.166+0000 7f70f8a00640 1 -- 172.21.15.57:0/4279193183 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f70f4158530 msgr2=0x7f70f40b4070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:31.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.166+0000 7f70f8a00640 1 --2- 172.21.15.57:0/4279193183 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f70f4158530 0x7f70f40b4070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:31.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.166+0000 7f70f8a00640 1 -- 172.21.15.57:0/4279193183 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70f414f560 con 0x7f70f40adde0 2024-03-27T10:01:31.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.166+0000 7f70f9400640 1 --2- 172.21.15.57:0/4279193183 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f70f40720d0 0x7f70f414f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T10:01:31.157 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.167+0000 7f70f8a00640 1 --2- 172.21.15.57:0/4279193183 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f70f40adde0 0x7f70f40b3b30 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f70e002b9c0 tx=0x7f70e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:31.157 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.167+0000 7f70f1600640 1 -- 172.21.15.57:0/4279193183 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70e0047070 con 0x7f70f40adde0 2024-03-27T10:01:31.157 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.167+0000 7f70f1600640 1 -- 172.21.15.57:0/4279193183 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70e0030e00 con 0x7f70f40adde0 2024-03-27T10:01:31.157 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.167+0000 7f70f1600640 1 -- 172.21.15.57:0/4279193183 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70e0034040 con 0x7f70f40adde0 2024-03-27T10:01:31.157 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.167+0000 7f70fa800640 1 -- 172.21.15.57:0/4279193183 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70f41500a0 con 0x7f70f40adde0 2024-03-27T10:01:31.158 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.168+0000 7f70fa800640 1 -- 172.21.15.57:0/4279193183 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70f414fdc0 con 0x7f70f40adde0 2024-03-27T10:01:31.159 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.170+0000 7f70f1600640 1 -- 172.21.15.57:0/4279193183 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f70e004a070 con 0x7f70f40adde0 2024-03-27T10:01:31.160 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.171+0000 7f70feb71740 1 Processor -- start 2024-03-27T10:01:31.160 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.172+0000 7f70feb71740 1 -- start start 2024-03-27T10:01:31.160 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.172+0000 7f70f1600640 1 --2- 172.21.15.57:0/4279193183 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f70d406c530 0x7f70d406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:31.160 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.172+0000 7f70f1600640 1 -- 172.21.15.57:0/4279193183 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f70e00ad330 con 0x7f70f40adde0 2024-03-27T10:01:31.162 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.172+0000 7f70f9e00640 1 --2- 172.21.15.57:0/4279193183 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f70d406c530 0x7f70d406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:31.162 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.172+0000 7f70feb71740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c57bc051d0 0x55c57bbd8170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:31.162 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.173+0000 7f70feb71740 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55c57bc055b0 0x55c57bc07f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:31.163 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.173+0000 7f70feb71740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c57bbd86b0 0x55c57bc084a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:31.163 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.173+0000 7f70feb71740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x55c57bb9f920 con 0x55c57bc051d0 2024-03-27T10:01:31.163 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.173+0000 7f70feb71740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x55c57baeffa0 con 0x55c57bbd86b0 2024-03-27T10:01:31.163 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.173+0000 7f70feb71740 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x55c57bb41f90 con 0x55c57bc055b0 2024-03-27T10:01:31.163 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.173+0000 7f70f9e00640 1 --2- 172.21.15.57:0/4279193183 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f70d406c530 0x7f70d406e9f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f70ec001460 tx=0x7f70ec009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:31.163 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.173+0000 7f70f9400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c57bc051d0 0x55c57bbd8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:31.163 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.173+0000 7f70f9400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c57bc051d0 0x55c57bbd8170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56270/0 (socket says 172.21.15.57:56270) 2024-03-27T10:01:31.163 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.173+0000 7f70f9400640 1 -- 172.21.15.57:0/1340924903 learned_addr learned my addr 172.21.15.57:0/1340924903 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:01:31.163 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.173+0000 7f70f8a00640 1 --2- 172.21.15.57:0/1340924903 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55c57bc055b0 0x55c57bc07f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:31.163 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.173+0000 7f70f9400640 1 -- 172.21.15.57:0/1340924903 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55c57bc055b0 msgr2=0x55c57bc07f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:01:31.163 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.173+0000 7f70f9400640 1 --2- 172.21.15.57:0/1340924903 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55c57bc055b0 0x55c57bc07f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:31.163 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.173+0000 7f70f9400640 1 -- 172.21.15.57:0/1340924903 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c57bbd86b0 msgr2=0x55c57bc084a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:01:31.163 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.173+0000 7f70f9e00640 1 --2- 172.21.15.57:0/1340924903 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c57bbd86b0 0x55c57bc084a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:31.163 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.174+0000 7f70f9400640 1 --2- 172.21.15.57:0/1340924903 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c57bbd86b0 0x55c57bc084a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:31.164 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.174+0000 7f70f9400640 1 -- 172.21.15.57:0/1340924903 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c57b8562d0 con 0x55c57bc051d0 2024-03-27T10:01:31.164 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.174+0000 7f70f9e00640 1 --2- 172.21.15.57:0/1340924903 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c57bbd86b0 0x55c57bc084a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T10:01:31.165 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.174+0000 7f70f9400640 1 --2- 172.21.15.57:0/1340924903 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c57bc051d0 0x55c57bbd8170 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f70e8009b30 tx=0x7f70e8009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=763ee766de9a5a4f server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:31.165 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.174+0000 7f70e5c00640 1 -- 172.21.15.57:0/1340924903 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70e8018070 con 0x55c57bc051d0 2024-03-27T10:01:31.165 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.174+0000 7f70e5c00640 1 -- 172.21.15.57:0/1340924903 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70e8010dc0 con 0x55c57bc051d0 2024-03-27T10:01:31.165 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.174+0000 7f70e5c00640 1 -- 172.21.15.57:0/1340924903 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70e800f040 con 0x55c57bc051d0 2024-03-27T10:01:31.165 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.175+0000 7f70feb71740 1 -- 172.21.15.57:0/1340924903 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c57bc051d0 msgr2=0x55c57bbd8170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:31.165 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.175+0000 7f70feb71740 1 --2- 172.21.15.57:0/1340924903 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c57bc051d0 0x55c57bbd8170 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f70e8009b30 tx=0x7f70e8009190 comp rx=0 tx=0).stop 2024-03-27T10:01:31.165 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.175+0000 7f70feb71740 1 -- 172.21.15.57:0/1340924903 shutdown_connections 2024-03-27T10:01:31.166 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.175+0000 7f70feb71740 1 --2- 172.21.15.57:0/1340924903 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c57bbd86b0 0x55c57bc084a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:31.166 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.175+0000 7f70feb71740 1 --2- 172.21.15.57:0/1340924903 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55c57bc055b0 0x55c57bc07f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:31.166 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.175+0000 7f70feb71740 1 --2- 172.21.15.57:0/1340924903 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c57bc051d0 0x55c57bbd8170 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:31.166 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.175+0000 7f70feb71740 1 -- 172.21.15.57:0/1340924903 >> 172.21.15.57:0/1340924903 conn(0x55c57bbda3e0 msgr2=0x55c57bc22f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:31.166 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.175+0000 7f70feb71740 1 -- 172.21.15.57:0/1340924903 shutdown_connections 2024-03-27T10:01:31.166 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.175+0000 7f70feb71740 1 -- 172.21.15.57:0/1340924903 wait complete. 2024-03-27T10:01:31.166 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.176+0000 7f70feb71740 1 -- start start 2024-03-27T10:01:31.166 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.176+0000 7f70feb71740 1 Processor -- start 2024-03-27T10:01:31.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.177+0000 7f70feb71740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c57bc051d0 0x55c57bc1a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:31.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.177+0000 7f70feb71740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c57bc055b0 0x55c57bc36290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:31.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.177+0000 7f70feb71740 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55c57bc367d0 0x55c57bc36c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:31.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.177+0000 7f70feb71740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x55c57bb3df40 con 0x55c57bc051d0 2024-03-27T10:01:31.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.177+0000 7f70feb71740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x55c57baea650 con 0x55c57bc055b0 2024-03-27T10:01:31.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.177+0000 7f70feb71740 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x55c57bafda10 con 0x55c57bc367d0 2024-03-27T10:01:31.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.177+0000 7f70feb71740 10 client.0 _ll_register_callbacks cb 0x55c57bb3cff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T10:01:31.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.178+0000 7f70f9400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c57bc051d0 0x55c57bc1a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:31.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.178+0000 7f70f9400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c57bc051d0 0x55c57bc1a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56276/0 (socket says 172.21.15.57:56276) 2024-03-27T10:01:31.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.178+0000 7f70f9400640 1 -- 172.21.15.57:0/1320817028 learned_addr learned my addr 172.21.15.57:0/1320817028 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:01:31.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.178+0000 7f70f9e00640 1 --2- 172.21.15.57:0/1320817028 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55c57bc367d0 0x55c57bc36c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:31.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.178+0000 7f70f8a00640 1 --2- 172.21.15.57:0/1320817028 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c57bc055b0 0x55c57bc36290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:31.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.178+0000 7f70f9400640 1 -- 172.21.15.57:0/1320817028 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55c57bc367d0 msgr2=0x55c57bc36c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:01:31.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.178+0000 7f70f9400640 1 --2- 172.21.15.57:0/1320817028 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55c57bc367d0 0x55c57bc36c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:31.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.178+0000 7f70f9400640 1 -- 172.21.15.57:0/1320817028 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c57bc055b0 msgr2=0x55c57bc36290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:01:31.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.178+0000 7f70f9400640 1 --2- 172.21.15.57:0/1320817028 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c57bc055b0 0x55c57bc36290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:31.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.178+0000 7f70f9400640 1 -- 172.21.15.57:0/1320817028 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c57b9206b0 con 0x55c57bc051d0 2024-03-27T10:01:31.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.179+0000 7f70f9400640 1 --2- 172.21.15.57:0/1320817028 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c57bc051d0 0x55c57bc1a3e0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f70e8010680 tx=0x7f70e8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4291b917cfd7d22c server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:31.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.179+0000 7f70da000640 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2024-03-27T10:01:31.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.179+0000 7f70da000640 1 -- 172.21.15.57:0/1320817028 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70e8018050 con 0x55c57bc051d0 2024-03-27T10:01:31.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.179+0000 7f70da000640 1 -- 172.21.15.57:0/1320817028 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f70e8010bc0 con 0x55c57bc051d0 2024-03-27T10:01:31.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.179+0000 7f70feb71740 1 -- 172.21.15.57:0/1320817028 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f70e8010dc0 con 0x55c57bc051d0 2024-03-27T10:01:31.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.179+0000 7f70da000640 1 -- 172.21.15.57:0/1320817028 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f70e80044f0 con 0x55c57bc051d0 2024-03-27T10:01:31.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.179+0000 7f70feb71740 10 client.5667 fetch_fsmap learned FSMap version 18 2024-03-27T10:01:31.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.179+0000 7f70feb71740 1 -- 172.21.15.57:0/1320817028 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55c57bc1a920 con 0x55c57bc051d0 2024-03-27T10:01:31.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.180+0000 7f70da000640 1 -- 172.21.15.57:0/1320817028 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70e8010dc0 con 0x55c57bc051d0 2024-03-27T10:01:31.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.180+0000 7f70da000640 1 -- 172.21.15.57:0/1320817028 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 18) ==== 3494+0+0 (secure 0 0 0) 0x7f70e8003ca0 con 0x55c57bc051d0 2024-03-27T10:01:31.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.180+0000 7f70feb71740 10 client.5667 fetch_fsmap finished waiting for FSMap version 18 2024-03-27T10:01:31.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.180+0000 7f70feb71740 10 client.5667 resolve_mds: resolved name 'a' to daemon mds.a 2024-03-27T10:01:31.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.180+0000 7f70feb71740 20 client.5667 populate_metadata read hostname 'smithi057' 2024-03-27T10:01:31.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.180+0000 7f70feb71740 1 --2- 172.21.15.57:0/1320817028 >> [v2:172.21.15.57:6836/385124398,v1:172.21.15.57:6837/385124398] conn(0x55c57bc06d10 0x55c57bc07110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:31.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.180+0000 7f70feb71740 4 client.5667 mds_command: new command op to 5508 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T10:01:31.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.180+0000 7f70feb71740 1 -- 172.21.15.57:0/1320817028 --> [v2:172.21.15.57:6836/385124398,v1:172.21.15.57:6837/385124398] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c57bb4f4d0 con 0x55c57bc06d10 2024-03-27T10:01:31.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.180+0000 7f70f8a00640 1 --2- 172.21.15.57:0/1320817028 >> [v2:172.21.15.57:6836/385124398,v1:172.21.15.57:6837/385124398] conn(0x55c57bc06d10 0x55c57bc07110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:31.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.181+0000 7f70f8a00640 1 --2- 172.21.15.57:0/1320817028 >> [v2:172.21.15.57:6836/385124398,v1:172.21.15.57:6837/385124398] conn(0x55c57bc06d10 0x55c57bc07110 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c765348a6d48814 server_cookie=6cffa017d0d246fd in_seq=0 out_seq=0 2024-03-27T10:01:31.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.181+0000 7f70da000640 10 client.5667 ms_handle_connect on v2:172.21.15.57:6836/385124398 2024-03-27T10:01:31.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.182+0000 7f70da000640 1 -- 172.21.15.57:0/1320817028 <== mds.0 v2:172.21.15.57:6836/385124398 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55c57bb4f4d0 con 0x55c57bc06d10 2024-03-27T10:01:31.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.182+0000 7f70da000640 10 client.5667 handle_command_reply: tid=0 2024-03-27T10:01:31.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.182+0000 7f70feb71740 1 client.5667 shutdown 2024-03-27T10:01:31.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.182+0000 7f70feb71740 1 -- 172.21.15.57:0/1320817028 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c57bc051d0 msgr2=0x55c57bc1a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:31.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.182+0000 7f70feb71740 1 --2- 172.21.15.57:0/1320817028 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c57bc051d0 0x55c57bc1a3e0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f70e8010680 tx=0x7f70e8004730 comp rx=0 tx=0).stop 2024-03-27T10:01:31.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.182+0000 7f70feb71740 1 -- 172.21.15.57:0/1320817028 shutdown_connections 2024-03-27T10:01:31.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.182+0000 7f70feb71740 1 --2- 172.21.15.57:0/1320817028 >> [v2:172.21.15.57:6836/385124398,v1:172.21.15.57:6837/385124398] conn(0x55c57bc06d10 0x55c57bc07110 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:31.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.182+0000 7f70feb71740 1 --2- 172.21.15.57:0/1320817028 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55c57bc367d0 0x55c57bc36c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:31.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.182+0000 7f70feb71740 1 --2- 172.21.15.57:0/1320817028 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c57bc055b0 0x55c57bc36290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:31.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.182+0000 7f70feb71740 1 --2- 172.21.15.57:0/1320817028 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c57bc051d0 0x55c57bc1a3e0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:31.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.182+0000 7f70feb71740 1 -- 172.21.15.57:0/1320817028 >> 172.21.15.57:0/1320817028 conn(0x55c57bbd86b0 msgr2=0x55c57bbd7890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:31.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.182+0000 7f70da000640 0 client.5667 ms_handle_reset on v2:172.21.15.57:6836/385124398 2024-03-27T10:01:31.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.182+0000 7f70feb71740 1 -- 172.21.15.57:0/1320817028 shutdown_connections 2024-03-27T10:01:31.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.182+0000 7f70feb71740 1 -- 172.21.15.57:0/1320817028 wait complete. 2024-03-27T10:01:31.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.182+0000 7f70feb71740 20 client.5667 trim_cache size 0 max 16384 2024-03-27T10:01:31.191 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.202+0000 7f70feb71740 1 Processor -- start 2024-03-27T10:01:31.191 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.202+0000 7f70feb71740 1 -- start start 2024-03-27T10:01:31.192 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.203+0000 7f70feb71740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c57bc051d0 0x55c57bc0aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:31.192 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.203+0000 7f70feb71740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c57bc055b0 0x55c57bc082b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:31.192 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.203+0000 7f70feb71740 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55c57bc367d0 0x55c57bc087f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:31.192 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.203+0000 7f70feb71740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f70f4200cb0 con 0x55c57bc051d0 2024-03-27T10:01:31.192 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.203+0000 7f70feb71740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f70f41ffcd0 con 0x55c57bc055b0 2024-03-27T10:01:31.193 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.203+0000 7f70feb71740 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f70f41f7ea0 con 0x55c57bc367d0 2024-03-27T10:01:31.193 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.203+0000 7f70f9400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c57bc051d0 0x55c57bc0aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:31.193 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.204+0000 7f70f9400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c57bc051d0 0x55c57bc0aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56286/0 (socket says 172.21.15.57:56286) 2024-03-27T10:01:31.193 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.204+0000 7f70f9400640 1 -- 172.21.15.57:0/2014142818 learned_addr learned my addr 172.21.15.57:0/2014142818 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:01:31.194 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.204+0000 7f70f9400640 1 -- 172.21.15.57:0/2014142818 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55c57bc367d0 msgr2=0x55c57bc087f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:01:31.194 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.204+0000 7f70f9400640 1 --2- 172.21.15.57:0/2014142818 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55c57bc367d0 0x55c57bc087f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:31.194 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.204+0000 7f70f8a00640 1 --2- 172.21.15.57:0/2014142818 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c57bc055b0 0x55c57bc082b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:31.194 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.204+0000 7f70f9400640 1 -- 172.21.15.57:0/2014142818 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c57bc055b0 msgr2=0x55c57bc082b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:01:31.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.204+0000 7f70f9400640 1 --2- 172.21.15.57:0/2014142818 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c57bc055b0 0x55c57bc082b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:31.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.204+0000 7f70f9400640 1 -- 172.21.15.57:0/2014142818 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c57bc26200 con 0x55c57bc051d0 2024-03-27T10:01:31.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.204+0000 7f70f9400640 1 --2- 172.21.15.57:0/2014142818 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c57bc051d0 0x55c57bc0aa60 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f70e8008010 tx=0x7f70e8022000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48a4c4044ff00644 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:31.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.205+0000 7f70e5200640 1 -- 172.21.15.57:0/2014142818 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70e8018040 con 0x55c57bc051d0 2024-03-27T10:01:31.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.205+0000 7f70e5200640 1 -- 172.21.15.57:0/2014142818 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70e80106b0 con 0x55c57bc051d0 2024-03-27T10:01:31.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.205+0000 7f70e5200640 1 -- 172.21.15.57:0/2014142818 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70e8009400 con 0x55c57bc051d0 2024-03-27T10:01:31.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.205+0000 7f70feb71740 1 -- 172.21.15.57:0/2014142818 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c57bc051d0 msgr2=0x55c57bc0aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:31.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.205+0000 7f70feb71740 1 --2- 172.21.15.57:0/2014142818 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c57bc051d0 0x55c57bc0aa60 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f70e8008010 tx=0x7f70e8022000 comp rx=0 tx=0).stop 2024-03-27T10:01:31.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.205+0000 7f70feb71740 1 -- 172.21.15.57:0/2014142818 shutdown_connections 2024-03-27T10:01:31.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.205+0000 7f70feb71740 1 --2- 172.21.15.57:0/2014142818 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55c57bc367d0 0x55c57bc087f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:31.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.205+0000 7f70feb71740 1 --2- 172.21.15.57:0/2014142818 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c57bc055b0 0x55c57bc082b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:31.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.205+0000 7f70feb71740 1 --2- 172.21.15.57:0/2014142818 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c57bc051d0 0x55c57bc0aa60 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:31.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.205+0000 7f70feb71740 1 -- 172.21.15.57:0/2014142818 >> 172.21.15.57:0/2014142818 conn(0x55c57bbd86b0 msgr2=0x55c57bc35700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:31.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.205+0000 7f70feb71740 1 -- 172.21.15.57:0/2014142818 shutdown_connections 2024-03-27T10:01:31.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.206+0000 7f70feb71740 1 -- 172.21.15.57:0/2014142818 wait complete. 2024-03-27T10:01:31.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.206+0000 7f70feb71740 1 -- start start 2024-03-27T10:01:31.198 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.206+0000 7f70feb71740 1 Processor -- start 2024-03-27T10:01:31.199 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.207+0000 7f70feb71740 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c57bc055b0 0x55c57bc344e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:31.199 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.207+0000 7f70feb71740 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55c57bc367d0 0x55c57bc38d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:31.199 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.207+0000 7f70feb71740 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c57bc0b540 0x55c57bc0b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:31.199 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.207+0000 7f70feb71740 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x55c57bc094d0 con 0x55c57bc055b0 2024-03-27T10:01:31.199 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.207+0000 7f70feb71740 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f70f41ff680 con 0x55c57bc0b540 2024-03-27T10:01:31.199 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.207+0000 7f70feb71740 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x55c57bc09fc0 con 0x55c57bc367d0 2024-03-27T10:01:31.199 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.207+0000 7f70feb71740 10 client.0 _ll_register_callbacks cb 0x7f70e8009980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T10:01:31.199 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.208+0000 7f70f9400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c57bc055b0 0x55c57bc344e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:31.199 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.208+0000 7f70f9400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c57bc055b0 0x55c57bc344e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56288/0 (socket says 172.21.15.57:56288) 2024-03-27T10:01:31.199 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.208+0000 7f70f9400640 1 -- 172.21.15.57:0/1449307088 learned_addr learned my addr 172.21.15.57:0/1449307088 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:01:31.199 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.208+0000 7f70f8a00640 1 --2- 172.21.15.57:0/1449307088 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55c57bc367d0 0x55c57bc38d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:31.199 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.208+0000 7f70f9400640 1 -- 172.21.15.57:0/1449307088 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55c57bc367d0 msgr2=0x55c57bc38d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:01:31.199 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.208+0000 7f70f9400640 1 --2- 172.21.15.57:0/1449307088 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55c57bc367d0 0x55c57bc38d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:31.199 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.208+0000 7f70f9400640 1 -- 172.21.15.57:0/1449307088 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c57bc0b540 msgr2=0x55c57bc0b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:01:31.200 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.208+0000 7f70f9400640 1 --2- 172.21.15.57:0/1449307088 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c57bc0b540 0x55c57bc0b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:31.200 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.208+0000 7f70f9400640 1 -- 172.21.15.57:0/1449307088 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c57bc9d1c0 con 0x55c57bc055b0 2024-03-27T10:01:31.200 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.208+0000 7f70f9400640 1 --2- 172.21.15.57:0/1449307088 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c57bc055b0 0x55c57bc344e0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f70e8010680 tx=0x7f70e8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5d519767ba6cae server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:31.200 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.208+0000 7f70da000640 10 client.0 ms_handle_connect on v2:172.21.15.57:3300/0 2024-03-27T10:01:31.200 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.209+0000 7f70da000640 1 -- 172.21.15.57:0/1449307088 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70e803e060 con 0x55c57bc055b0 2024-03-27T10:01:31.200 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.209+0000 7f70da000640 1 -- 172.21.15.57:0/1449307088 <== mon.0 v2:172.21.15.57:3300/0 2 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f70e8033070 con 0x55c57bc055b0 2024-03-27T10:01:31.200 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.209+0000 7f70feb71740 1 -- 172.21.15.57:0/1449307088 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f70e80106b0 con 0x55c57bc055b0 2024-03-27T10:01:31.200 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.209+0000 7f70da000640 1 -- 172.21.15.57:0/1449307088 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f70e8018040 con 0x55c57bc055b0 2024-03-27T10:01:31.200 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.209+0000 7f70feb71740 10 client.5673 fetch_fsmap learned FSMap version 18 2024-03-27T10:01:31.200 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.209+0000 7f70feb71740 1 -- 172.21.15.57:0/1449307088 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) -- 0x55c57bc39250 con 0x55c57bc055b0 2024-03-27T10:01:31.200 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.209+0000 7f70da000640 1 -- 172.21.15.57:0/1449307088 <== mon.0 v2:172.21.15.57:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70e80106b0 con 0x55c57bc055b0 2024-03-27T10:01:31.200 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.210+0000 7f70da000640 1 -- 172.21.15.57:0/1449307088 <== mon.0 v2:172.21.15.57:3300/0 5 ==== fsmap(e 18) ==== 3494+0+0 (secure 0 0 0) 0x7f70e8005ba0 con 0x55c57bc055b0 2024-03-27T10:01:31.200 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.210+0000 7f70feb71740 10 client.5673 fetch_fsmap finished waiting for FSMap version 18 2024-03-27T10:01:31.200 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.210+0000 7f70feb71740 10 client.5673 resolve_mds: resolved name 'a' to daemon mds.a 2024-03-27T10:01:31.201 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.210+0000 7f70feb71740 20 client.5673 populate_metadata read hostname 'smithi057' 2024-03-27T10:01:31.201 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.210+0000 7f70feb71740 1 --2- 172.21.15.57:0/1449307088 >> [v2:172.21.15.57:6836/385124398,v1:172.21.15.57:6837/385124398] conn(0x55c57bbd7900 0x55c57bca8780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:31.201 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.210+0000 7f70feb71740 4 client.5673 mds_command: new command op to 5508 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-27T10:01:31.201 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.210+0000 7f70feb71740 1 -- 172.21.15.57:0/1449307088 --> [v2:172.21.15.57:6836/385124398,v1:172.21.15.57:6837/385124398] -- command(tid 0: {"prefix": "status"}) -- 0x55c57bb49820 con 0x55c57bbd7900 2024-03-27T10:01:31.202 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.210+0000 7f70f8a00640 1 --2- 172.21.15.57:0/1449307088 >> [v2:172.21.15.57:6836/385124398,v1:172.21.15.57:6837/385124398] conn(0x55c57bbd7900 0x55c57bca8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:31.202 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.211+0000 7f70f8a00640 1 --2- 172.21.15.57:0/1449307088 >> [v2:172.21.15.57:6836/385124398,v1:172.21.15.57:6837/385124398] conn(0x55c57bbd7900 0x55c57bca8780 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=952215628ccdfa7d server_cookie=598e252f201f70b1 in_seq=0 out_seq=0 2024-03-27T10:01:31.202 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.211+0000 7f70da000640 10 client.5673 ms_handle_connect on v2:172.21.15.57:6836/385124398 2024-03-27T10:01:31.202 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.211+0000 7f70da000640 1 -- 172.21.15.57:0/1449307088 <== mds.0 v2:172.21.15.57:6836/385124398 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55c57bb49820 con 0x55c57bbd7900 2024-03-27T10:01:31.202 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.211+0000 7f70da000640 10 client.5673 handle_command_reply: tid=0 2024-03-27T10:01:31.203 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.211+0000 7f70feb71740 1 client.5673 shutdown 2024-03-27T10:01:31.203 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.211+0000 7f70feb71740 1 -- 172.21.15.57:0/1449307088 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c57bc055b0 msgr2=0x55c57bc344e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:31.203 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.211+0000 7f70feb71740 1 --2- 172.21.15.57:0/1449307088 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c57bc055b0 0x55c57bc344e0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f70e8010680 tx=0x7f70e8008040 comp rx=0 tx=0).stop 2024-03-27T10:01:31.203 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.211+0000 7f70feb71740 1 -- 172.21.15.57:0/1449307088 shutdown_connections 2024-03-27T10:01:31.203 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.211+0000 7f70feb71740 1 --2- 172.21.15.57:0/1449307088 >> [v2:172.21.15.57:6836/385124398,v1:172.21.15.57:6837/385124398] conn(0x55c57bbd7900 0x55c57bca8780 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:31.203 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.211+0000 7f70feb71740 1 --2- 172.21.15.57:0/1449307088 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x55c57bc0b540 0x55c57bc0b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:31.203 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.211+0000 7f70feb71740 1 --2- 172.21.15.57:0/1449307088 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x55c57bc367d0 0x55c57bc38d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:31.203 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.211+0000 7f70feb71740 1 --2- 172.21.15.57:0/1449307088 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x55c57bc055b0 0x55c57bc344e0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:31.203 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.211+0000 7f70da000640 0 client.5673 ms_handle_reset on v2:172.21.15.57:6836/385124398 2024-03-27T10:01:31.203 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.211+0000 7f70feb71740 1 -- 172.21.15.57:0/1449307088 >> 172.21.15.57:0/1449307088 conn(0x55c57bbd86b0 msgr2=0x55c57bc35e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:31.203 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.211+0000 7f70feb71740 1 -- 172.21.15.57:0/1449307088 shutdown_connections 2024-03-27T10:01:31.203 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.211+0000 7f70feb71740 1 -- 172.21.15.57:0/1449307088 wait complete. 2024-03-27T10:01:31.203 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.211+0000 7f70feb71740 20 client.5673 trim_cache size 0 max 16384 2024-03-27T10:01:31.204 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-03-27T10:01:31.204 INFO:teuthology.orchestra.run.smithi057.stdout: "cluster_fsid": "7ac43f86-2c16-4a97-98fb-715d3cebc75c", 2024-03-27T10:01:31.204 INFO:teuthology.orchestra.run.smithi057.stdout: "whoami": 0, 2024-03-27T10:01:31.204 INFO:teuthology.orchestra.run.smithi057.stdout: "id": 5508, 2024-03-27T10:01:31.204 INFO:teuthology.orchestra.run.smithi057.stdout: "want_state": "up:active", 2024-03-27T10:01:31.204 INFO:teuthology.orchestra.run.smithi057.stdout: "state": "up:active", 2024-03-27T10:01:31.204 INFO:teuthology.orchestra.run.smithi057.stdout: "fs_name": "cephfs", 2024-03-27T10:01:31.204 INFO:teuthology.orchestra.run.smithi057.stdout: "rank_uptime": 6.7812145020000001, 2024-03-27T10:01:31.204 INFO:teuthology.orchestra.run.smithi057.stdout: "mdsmap_epoch": 18, 2024-03-27T10:01:31.204 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_epoch": 40, 2024-03-27T10:01:31.204 INFO:teuthology.orchestra.run.smithi057.stdout: "osdmap_epoch_barrier": 40, 2024-03-27T10:01:31.204 INFO:teuthology.orchestra.run.smithi057.stdout: "uptime": 15.631160526 2024-03-27T10:01:31.205 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-03-27T10:01:31.205 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.212+0000 7f70fa800640 1 -- 172.21.15.57:0/4279193183 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f70d406c530 msgr2=0x7f70d406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:31.205 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.212+0000 7f70fa800640 1 --2- 172.21.15.57:0/4279193183 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f70d406c530 0x7f70d406e9f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f70ec001460 tx=0x7f70ec009040 comp rx=0 tx=0).stop 2024-03-27T10:01:31.205 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.212+0000 7f70fa800640 1 -- 172.21.15.57:0/4279193183 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f70f40adde0 msgr2=0x7f70f40b3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:31.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.212+0000 7f70fa800640 1 --2- 172.21.15.57:0/4279193183 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f70f40adde0 0x7f70f40b3b30 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f70e002b9c0 tx=0x7f70e00046c0 comp rx=0 tx=0).stop 2024-03-27T10:01:31.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.212+0000 7f70fa800640 1 -- 172.21.15.57:0/4279193183 shutdown_connections 2024-03-27T10:01:31.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.212+0000 7f70fa800640 1 --2- 172.21.15.57:0/4279193183 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f70d406c530 0x7f70d406e9f0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:31.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.212+0000 7f70fa800640 1 --2- 172.21.15.57:0/4279193183 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f70f4158530 0x7f70f40b4070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:31.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.212+0000 7f70fa800640 1 --2- 172.21.15.57:0/4279193183 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f70f40adde0 0x7f70f40b3b30 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:31.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.212+0000 7f70fa800640 1 --2- 172.21.15.57:0/4279193183 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f70f40720d0 0x7f70f414f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:31.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.212+0000 7f70fa800640 1 -- 172.21.15.57:0/4279193183 >> 172.21.15.57:0/4279193183 conn(0x7f70f40b1770 msgr2=0x7f70f414de80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:31.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.212+0000 7f70fa800640 1 -- 172.21.15.57:0/4279193183 shutdown_connections 2024-03-27T10:01:31.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.212+0000 7f70fa800640 1 -- 172.21.15.57:0/4279193183 wait complete. 2024-03-27T10:01:31.220 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-27T10:01:31.435 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.446+0000 7f7a5f000640 1 Processor -- start 2024-03-27T10:01:31.435 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.446+0000 7f7a5f000640 1 -- start start 2024-03-27T10:01:31.436 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.447+0000 7f7a5f000640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7a580d2d30 0x7f7a581610d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:31.437 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.447+0000 7f7a5f000640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a5815ec20 con 0x7f7a5815e300 2024-03-27T10:01:31.437 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.447+0000 7f7a5f000640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a5815ef00 con 0x7f7a5815e6e0 2024-03-27T10:01:31.437 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.447+0000 7f7a5f000640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f7a5815f1e0 con 0x7f7a580d2d30 2024-03-27T10:01:31.437 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.448+0000 7f7a5e600640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f7a580d2d30 0x7f7a581610d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:31.437 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.448+0000 7f7a5dc00640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f7a5815e300 0x7f7a580d1c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:40394/0 (socket says 172.21.15.57:40394) 2024-03-27T10:01:31.437 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.448+0000 7f7a5dc00640 1 -- 172.21.15.57:0/1874935971 learned_addr learned my addr 172.21.15.57:0/1874935971 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T10:01:31.437 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.448+0000 7f7a5e600640 1 -- 172.21.15.57:0/1874935971 >> v1:172.21.15.118:6789/0 conn(0x7f7a5815e6e0 legacy=0x7f7a580d2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:01:31.437 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.448+0000 7f7a5e600640 1 -- 172.21.15.57:0/1874935971 >> v1:172.21.15.57:6789/0 conn(0x7f7a5815e300 legacy=0x7f7a580d1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:31.438 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.448+0000 7f7a5e600640 1 -- 172.21.15.57:0/1874935971 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a5815f4c0 con 0x7f7a580d2d30 2024-03-27T10:01:31.439 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.450+0000 7f7a5e600640 1 --2- 172.21.15.57:0/1874935971 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7a580d2d30 0x7f7a581610d0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f7a50009d90 tx=0x7f7a5002beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef31df9e29dc4529 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:31.439 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.450+0000 7f7a57e00640 1 -- 172.21.15.57:0/1874935971 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a50039070 con 0x7f7a580d2d30 2024-03-27T10:01:31.439 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.450+0000 7f7a57e00640 1 -- 172.21.15.57:0/1874935971 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a5002cc60 con 0x7f7a580d2d30 2024-03-27T10:01:31.439 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.450+0000 7f7a57e00640 1 -- 172.21.15.57:0/1874935971 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a50034660 con 0x7f7a580d2d30 2024-03-27T10:01:31.440 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.451+0000 7f7a5f000640 1 -- 172.21.15.57:0/1874935971 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7a580d2d30 msgr2=0x7f7a581610d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:31.440 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.451+0000 7f7a5f000640 1 --2- 172.21.15.57:0/1874935971 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7a580d2d30 0x7f7a581610d0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f7a50009d90 tx=0x7f7a5002beb0 comp rx=0 tx=0).stop 2024-03-27T10:01:31.440 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.451+0000 7f7a5f000640 1 -- 172.21.15.57:0/1874935971 shutdown_connections 2024-03-27T10:01:31.440 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.451+0000 7f7a5f000640 1 --2- 172.21.15.57:0/1874935971 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7a580d2d30 0x7f7a581610d0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:31.440 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.451+0000 7f7a5f000640 1 -- 172.21.15.57:0/1874935971 >> 172.21.15.57:0/1874935971 conn(0x7f7a5809d330 msgr2=0x7f7a580d4060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:31.441 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.451+0000 7f7a5f000640 1 -- 172.21.15.57:0/1874935971 shutdown_connections 2024-03-27T10:01:31.441 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.451+0000 7f7a5f000640 1 -- 172.21.15.57:0/1874935971 wait complete. 2024-03-27T10:01:31.442 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.453+0000 7f7a5f000640 1 Processor -- start 2024-03-27T10:01:31.442 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.453+0000 7f7a5f000640 1 -- start start 2024-03-27T10:01:31.444 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.454+0000 7f7a5f000640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7a580d2d30 0x7f7a581554a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:31.444 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.454+0000 7f7a5f000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7a5815e300 0x7f7a581f43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:31.444 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.454+0000 7f7a5f000640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7a5815e6e0 0x7f7a5809f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:31.444 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.454+0000 7f7a5f000640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f7a5815f7a0 con 0x7f7a580d2d30 2024-03-27T10:01:31.444 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.454+0000 7f7a5f000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f7a580cffd0 con 0x7f7a5815e300 2024-03-27T10:01:31.444 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.454+0000 7f7a5f000640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f7a580d2340 con 0x7f7a5815e6e0 2024-03-27T10:01:31.444 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.454+0000 7f7a5dc00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7a580d2d30 0x7f7a581554a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:31.444 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.455+0000 7f7a5dc00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7a580d2d30 0x7f7a581554a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56306/0 (socket says 172.21.15.57:56306) 2024-03-27T10:01:31.444 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.455+0000 7f7a5dc00640 1 -- 172.21.15.57:0/2471440004 learned_addr learned my addr 172.21.15.57:0/2471440004 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:01:31.445 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.455+0000 7f7a5d200640 1 --2- 172.21.15.57:0/2471440004 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7a5815e300 0x7f7a581f43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:31.445 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.455+0000 7f7a5e600640 1 --2- 172.21.15.57:0/2471440004 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7a5815e6e0 0x7f7a5809f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:31.445 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.455+0000 7f7a5dc00640 1 -- 172.21.15.57:0/2471440004 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7a5815e6e0 msgr2=0x7f7a5809f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:31.445 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.455+0000 7f7a5dc00640 1 --2- 172.21.15.57:0/2471440004 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7a5815e6e0 0x7f7a5809f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:31.445 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.455+0000 7f7a5dc00640 1 -- 172.21.15.57:0/2471440004 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7a5815e300 msgr2=0x7f7a581f43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:31.445 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.455+0000 7f7a5dc00640 1 --2- 172.21.15.57:0/2471440004 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7a5815e300 0x7f7a581f43a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:31.445 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.455+0000 7f7a5dc00640 1 -- 172.21.15.57:0/2471440004 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a581f48e0 con 0x7f7a580d2d30 2024-03-27T10:01:31.445 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.455+0000 7f7a5dc00640 1 --2- 172.21.15.57:0/2471440004 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7a580d2d30 0x7f7a581554a0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c00c400 tx=0x7f7a4c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:31.446 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.456+0000 7f7a55600640 1 -- 172.21.15.57:0/2471440004 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a4c017070 con 0x7f7a580d2d30 2024-03-27T10:01:31.446 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.456+0000 7f7a55600640 1 -- 172.21.15.57:0/2471440004 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a4c005ce0 con 0x7f7a580d2d30 2024-03-27T10:01:31.446 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.456+0000 7f7a55600640 1 -- 172.21.15.57:0/2471440004 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a4c0072f0 con 0x7f7a580d2d30 2024-03-27T10:01:31.446 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.456+0000 7f7a5f000640 1 -- 172.21.15.57:0/2471440004 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a5809fd10 con 0x7f7a580d2d30 2024-03-27T10:01:31.446 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.456+0000 7f7a5f000640 1 -- 172.21.15.57:0/2471440004 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a580cb660 con 0x7f7a580d2d30 2024-03-27T10:01:31.446 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.457+0000 7f7a5f000640 1 -- 172.21.15.57:0/2471440004 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a58068540 con 0x7f7a580d2d30 2024-03-27T10:01:31.448 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.460+0000 7f7a55600640 1 -- 172.21.15.57:0/2471440004 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f7a4c01a070 con 0x7f7a580d2d30 2024-03-27T10:01:31.449 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.461+0000 7f7a55600640 1 --2- 172.21.15.57:0/2471440004 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f7a3806c560 0x7f7a3806ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:01:31.450 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.461+0000 7f7a55600640 1 -- 172.21.15.57:0/2471440004 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 6101+0+0 (secure 0 0 0) 0x7f7a4c08ac70 con 0x7f7a580d2d30 2024-03-27T10:01:31.450 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.461+0000 7f7a5d200640 1 --2- 172.21.15.57:0/2471440004 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f7a3806c560 0x7f7a3806ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:01:31.450 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.462+0000 7f7a5d200640 1 --2- 172.21.15.57:0/2471440004 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f7a3806c560 0x7f7a3806ea20 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f7a44006fd0 tx=0x7f7a44008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:01:31.454 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.466+0000 7f7a55600640 1 -- 172.21.15.57:0/2471440004 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f7a4c0590f0 con 0x7f7a580d2d30 2024-03-27T10:01:31.705 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.716+0000 7f7a5f000640 1 -- 172.21.15.57:0/2471440004 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f7a580d4770 con 0x7f7a580d2d30 2024-03-27T10:01:31.706 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.717+0000 7f7a55600640 1 -- 172.21.15.57:0/2471440004 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) ==== 53+0+73 (secure 0 0 0) 0x7f7a4c0589f0 con 0x7f7a580d2d30 2024-03-27T10:01:31.706 INFO:teuthology.orchestra.run.smithi057.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-27T10:01:31.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.719+0000 7f7a5f000640 1 -- 172.21.15.57:0/2471440004 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f7a3806c560 msgr2=0x7f7a3806ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:31.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.720+0000 7f7a5f000640 1 --2- 172.21.15.57:0/2471440004 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f7a3806c560 0x7f7a3806ea20 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f7a44006fd0 tx=0x7f7a44008040 comp rx=0 tx=0).stop 2024-03-27T10:01:31.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.720+0000 7f7a5f000640 1 -- 172.21.15.57:0/2471440004 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7a580d2d30 msgr2=0x7f7a581554a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:01:31.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.720+0000 7f7a5f000640 1 --2- 172.21.15.57:0/2471440004 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7a580d2d30 0x7f7a581554a0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c00c400 tx=0x7f7a4c00c8c0 comp rx=0 tx=0).stop 2024-03-27T10:01:31.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.720+0000 7f7a5f000640 1 -- 172.21.15.57:0/2471440004 shutdown_connections 2024-03-27T10:01:31.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.720+0000 7f7a5f000640 1 --2- 172.21.15.57:0/2471440004 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7a5815e6e0 0x7f7a5809f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:31.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.720+0000 7f7a5f000640 1 --2- 172.21.15.57:0/2471440004 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f7a3806c560 0x7f7a3806ea20 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:31.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.720+0000 7f7a5f000640 1 --2- 172.21.15.57:0/2471440004 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7a5815e300 0x7f7a581f43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:31.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.720+0000 7f7a5f000640 1 --2- 172.21.15.57:0/2471440004 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f7a580d2d30 0x7f7a581554a0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:01:31.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.720+0000 7f7a5f000640 1 -- 172.21.15.57:0/2471440004 >> 172.21.15.57:0/2471440004 conn(0x7f7a5809d330 msgr2=0x7f7a5806d5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:01:31.710 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.720+0000 7f7a5f000640 1 -- 172.21.15.57:0/2471440004 shutdown_connections 2024-03-27T10:01:31.710 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:31.720+0000 7f7a5f000640 1 -- 172.21.15.57:0/2471440004 wait complete. 2024-03-27T10:01:31.728 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-27T10:01:31.728 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-27T10:01:31.728 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi057.front.sepia.ceph.com 2024-03-27T10:01:31.728 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-03-27T10:01:31.728 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-27T10:01:31.728 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-27T10:01:31.728 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-27T10:01:31.728 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-27T10:01:31.728 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-27T10:01:31.728 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T10:01:31.729 DEBUG:teuthology.orchestra.run.smithi057:> ip addr 2024-03-27T10:01:31.783 INFO:teuthology.orchestra.run.smithi057.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-27T10:01:31.783 INFO:teuthology.orchestra.run.smithi057.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-27T10:01:31.783 INFO:teuthology.orchestra.run.smithi057.stdout: inet 127.0.0.1/8 scope host lo 2024-03-27T10:01:31.783 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2024-03-27T10:01:31.783 INFO:teuthology.orchestra.run.smithi057.stdout: inet6 ::1/128 scope host 2024-03-27T10:01:31.783 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2024-03-27T10:01:31.783 INFO:teuthology.orchestra.run.smithi057.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-27T10:01:31.784 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 0c:c4:7a:6b:ff:86 brd ff:ff:ff:ff:ff:ff 2024-03-27T10:01:31.784 INFO:teuthology.orchestra.run.smithi057.stdout: altname enp7s0f0 2024-03-27T10:01:31.784 INFO:teuthology.orchestra.run.smithi057.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-27T10:01:31.784 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 0c:c4:7a:6b:ff:87 brd ff:ff:ff:ff:ff:ff 2024-03-27T10:01:31.784 INFO:teuthology.orchestra.run.smithi057.stdout: altname enp7s0f1 2024-03-27T10:01:31.784 INFO:teuthology.orchestra.run.smithi057.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-27T10:01:31.784 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 0c:c4:7a:bd:15:62 brd ff:ff:ff:ff:ff:ff 2024-03-27T10:01:31.784 INFO:teuthology.orchestra.run.smithi057.stdout: altname enp1s0f0 2024-03-27T10:01:31.784 INFO:teuthology.orchestra.run.smithi057.stdout: inet 172.21.15.57/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-03-27T10:01:31.784 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft 42436sec preferred_lft 42436sec 2024-03-27T10:01:31.784 INFO:teuthology.orchestra.run.smithi057.stdout: inet6 fe80::ec4:7aff:febd:1562/64 scope link noprefixroute 2024-03-27T10:01:31.784 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2024-03-27T10:01:31.784 INFO:teuthology.orchestra.run.smithi057.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-27T10:01:31.785 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 0c:c4:7a:bd:15:63 brd ff:ff:ff:ff:ff:ff 2024-03-27T10:01:31.785 INFO:teuthology.orchestra.run.smithi057.stdout: altname enp1s0f1 2024-03-27T10:01:31.785 INFO:teuthology.orchestra.run.smithi057.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-27T10:01:31.785 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 1a:73:c2:9e:6e:42 brd ff:ff:ff:ff:ff:ff 2024-03-27T10:01:31.785 INFO:teuthology.orchestra.run.smithi057.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-03-27T10:01:31.785 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2024-03-27T10:01:31.785 INFO:teuthology.orchestra.run.smithi057.stdout: inet6 fe80::800d:e9ff:feb6:8b3b/64 scope link 2024-03-27T10:01:31.785 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2024-03-27T10:01:31.785 INFO:teuthology.orchestra.run.smithi057.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-27T10:01:31.785 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 36:b4:3c:bc:43:af brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-27T10:01:31.785 INFO:teuthology.orchestra.run.smithi057.stdout: inet6 fe80::34b4:3cff:febc:43af/64 scope link 2024-03-27T10:01:31.785 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2024-03-27T10:01:31.785 INFO:teuthology.orchestra.run.smithi057.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-27T10:01:31.785 INFO:teuthology.orchestra.run.smithi057.stdout: link/ether 1a:73:c2:9e:6e:42 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-27T10:01:31.785 INFO:teuthology.orchestra.run.smithi057.stdout: inet6 fe80::1873:c2ff:fe9e:6e42/64 scope link 2024-03-27T10:01:31.786 INFO:teuthology.orchestra.run.smithi057.stdout: valid_lft forever preferred_lft forever 2024-03-27T10:01:31.787 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T10:01:31.787 DEBUG:teuthology.orchestra.run.smithi057:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-27T10:01:31.876 INFO:teuthology.orchestra.run.smithi057.stdout:1 2024-03-27T10:01:31.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T10:01:31.881 DEBUG:teuthology.orchestra.run.smithi057:> route 2024-03-27T10:01:31.936 INFO:teuthology.orchestra.run.smithi057.stdout:Kernel IP routing table 2024-03-27T10:01:31.936 INFO:teuthology.orchestra.run.smithi057.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-27T10:01:31.936 INFO:teuthology.orchestra.run.smithi057.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-03-27T10:01:31.936 INFO:teuthology.orchestra.run.smithi057.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-03-27T10:01:31.936 INFO:teuthology.orchestra.run.smithi057.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-27T10:01:31.937 DEBUG:teuthology.orchestra.run.smithi057:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-27T10:01:31.937 DEBUG:teuthology.orchestra.run.smithi057:> set -e 2024-03-27T10:01:31.937 DEBUG:teuthology.orchestra.run.smithi057:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-03-27T10:01:31.937 DEBUG:teuthology.orchestra.run.smithi057:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-03-27T10:01:31.937 DEBUG:teuthology.orchestra.run.smithi057:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-03-27T10:01:31.937 DEBUG:teuthology.orchestra.run.smithi057:> ') 2024-03-27T10:01:32.044 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-27T10:01:32.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-27T10:01:32.190 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T10:01:32.190 DEBUG:teuthology.orchestra.run.smithi057:> ip netns list 2024-03-27T10:01:32.242 INFO:teuthology.orchestra.run.smithi057.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-03-27T10:01:32.242 INFO:teuthology.orchestra.run.smithi057.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-03-27T10:01:32.243 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-27T10:01:32.243 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T10:01:32.244 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip link set brx.0 up 2024-03-27T10:01:32.337 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-03-27T10:01:32.337 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-27T10:01:32.337 DEBUG:teuthology.orchestra.run.smithi057:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-03-27T10:01:32.392 INFO:teuthology.orchestra.run.smithi057.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-03-27T10:01:32.392 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-27T10:01:32.392 DEBUG:teuthology.orchestra.run.smithi057:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-03-27T10:01:32.446 DEBUG:teuthology.orchestra.run.smithi057:> sudo modprobe fuse 2024-03-27T10:01:32.528 DEBUG:teuthology.orchestra.run.smithi057:> cat /proc/self/mounts | awk '{print $2}' 2024-03-27T10:01:32.577 INFO:teuthology.orchestra.run.smithi057.stdout:/proc 2024-03-27T10:01:32.577 INFO:teuthology.orchestra.run.smithi057.stdout:/sys 2024-03-27T10:01:32.577 INFO:teuthology.orchestra.run.smithi057.stdout:/dev 2024-03-27T10:01:32.577 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/kernel/security 2024-03-27T10:01:32.577 INFO:teuthology.orchestra.run.smithi057.stdout:/dev/shm 2024-03-27T10:01:32.577 INFO:teuthology.orchestra.run.smithi057.stdout:/dev/pts 2024-03-27T10:01:32.577 INFO:teuthology.orchestra.run.smithi057.stdout:/run 2024-03-27T10:01:32.577 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/cgroup 2024-03-27T10:01:32.577 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/pstore 2024-03-27T10:01:32.578 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/bpf 2024-03-27T10:01:32.578 INFO:teuthology.orchestra.run.smithi057.stdout:/ 2024-03-27T10:01:32.578 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/selinux 2024-03-27T10:01:32.578 INFO:teuthology.orchestra.run.smithi057.stdout:/proc/sys/fs/binfmt_misc 2024-03-27T10:01:32.578 INFO:teuthology.orchestra.run.smithi057.stdout:/dev/hugepages 2024-03-27T10:01:32.578 INFO:teuthology.orchestra.run.smithi057.stdout:/dev/mqueue 2024-03-27T10:01:32.578 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/kernel/debug 2024-03-27T10:01:32.578 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/kernel/tracing 2024-03-27T10:01:32.578 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/fuse/connections 2024-03-27T10:01:32.578 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/kernel/config 2024-03-27T10:01:32.578 INFO:teuthology.orchestra.run.smithi057.stdout:/run/credentials/systemd-sysctl.service 2024-03-27T10:01:32.578 INFO:teuthology.orchestra.run.smithi057.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-27T10:01:32.578 INFO:teuthology.orchestra.run.smithi057.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-27T10:01:32.578 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/nfs/rpc_pipefs 2024-03-27T10:01:32.578 INFO:teuthology.orchestra.run.smithi057.stdout:/run/user/1000 2024-03-27T10:01:32.579 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/ceph 2024-03-27T10:01:32.579 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/ceph/osd/ceph-0 2024-03-27T10:01:32.579 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/ceph/osd/ceph-1 2024-03-27T10:01:32.579 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/ceph/osd/ceph-2 2024-03-27T10:01:32.579 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/ceph/osd/ceph-3 2024-03-27T10:01:32.579 INFO:teuthology.orchestra.run.smithi057.stdout:/run/netns 2024-03-27T10:01:32.579 INFO:teuthology.orchestra.run.smithi057.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-27T10:01:32.579 INFO:teuthology.orchestra.run.smithi057.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-27T10:01:32.579 INFO:teuthology.orchestra.run.smithi057.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-27T10:01:32.579 INFO:teuthology.orchestra.run.smithi057.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-27T10:01:32.580 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T10:01:32.580 DEBUG:teuthology.orchestra.run.smithi057:> ls /sys/fs/fuse/connections 2024-03-27T10:01:32.673 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-03-27T10:01:32.673 DEBUG:teuthology.orchestra.run.smithi057:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-03-27T10:01:32.677 DEBUG:teuthology.orchestra.run.smithi057:> sudo modprobe fuse 2024-03-27T10:01:32.749 DEBUG:teuthology.orchestra.run.smithi057:> cat /proc/self/mounts | awk '{print $2}' 2024-03-27T10:01:32.796 INFO:teuthology.orchestra.run.smithi057.stdout:/proc 2024-03-27T10:01:32.796 INFO:teuthology.orchestra.run.smithi057.stdout:/sys 2024-03-27T10:01:32.796 INFO:teuthology.orchestra.run.smithi057.stdout:/dev 2024-03-27T10:01:32.796 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/kernel/security 2024-03-27T10:01:32.796 INFO:teuthology.orchestra.run.smithi057.stdout:/dev/shm 2024-03-27T10:01:32.796 INFO:teuthology.orchestra.run.smithi057.stdout:/dev/pts 2024-03-27T10:01:32.796 INFO:teuthology.orchestra.run.smithi057.stdout:/run 2024-03-27T10:01:32.796 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/cgroup 2024-03-27T10:01:32.796 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/pstore 2024-03-27T10:01:32.796 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/bpf 2024-03-27T10:01:32.796 INFO:teuthology.orchestra.run.smithi057.stdout:/ 2024-03-27T10:01:32.796 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/selinux 2024-03-27T10:01:32.796 INFO:teuthology.orchestra.run.smithi057.stdout:/proc/sys/fs/binfmt_misc 2024-03-27T10:01:32.797 INFO:teuthology.orchestra.run.smithi057.stdout:/dev/hugepages 2024-03-27T10:01:32.797 INFO:teuthology.orchestra.run.smithi057.stdout:/dev/mqueue 2024-03-27T10:01:32.797 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/kernel/debug 2024-03-27T10:01:32.797 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/kernel/tracing 2024-03-27T10:01:32.797 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/fuse/connections 2024-03-27T10:01:32.797 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/kernel/config 2024-03-27T10:01:32.797 INFO:teuthology.orchestra.run.smithi057.stdout:/run/credentials/systemd-sysctl.service 2024-03-27T10:01:32.797 INFO:teuthology.orchestra.run.smithi057.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-27T10:01:32.797 INFO:teuthology.orchestra.run.smithi057.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-27T10:01:32.797 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/nfs/rpc_pipefs 2024-03-27T10:01:32.797 INFO:teuthology.orchestra.run.smithi057.stdout:/run/user/1000 2024-03-27T10:01:32.797 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/ceph 2024-03-27T10:01:32.797 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/ceph/osd/ceph-0 2024-03-27T10:01:32.797 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/ceph/osd/ceph-1 2024-03-27T10:01:32.797 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/ceph/osd/ceph-2 2024-03-27T10:01:32.798 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/ceph/osd/ceph-3 2024-03-27T10:01:32.798 INFO:teuthology.orchestra.run.smithi057.stdout:/run/netns 2024-03-27T10:01:32.798 INFO:teuthology.orchestra.run.smithi057.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-27T10:01:32.798 INFO:teuthology.orchestra.run.smithi057.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-27T10:01:32.798 INFO:teuthology.orchestra.run.smithi057.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-27T10:01:32.798 INFO:teuthology.orchestra.run.smithi057.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-27T10:01:32.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T10:01:32.799 DEBUG:teuthology.orchestra.run.smithi057:> ls /sys/fs/fuse/connections 2024-03-27T10:01:32.866 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi057.stderr:2024-03-27T10:01:32.877+0000 7fd919c41480 -1 init, newargv = 0x55e7b6665830 newargc=15 2024-03-27T10:01:32.866 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi057.stderr:ceph-fuse[53742]: starting ceph client 2024-03-27T10:01:32.875 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi057.stderr:ceph-fuse[53742]: starting fuse 2024-03-27T10:01:33.943 DEBUG:teuthology.orchestra.run.smithi057:> sudo modprobe fuse 2024-03-27T10:01:34.052 DEBUG:teuthology.orchestra.run.smithi057:> cat /proc/self/mounts | awk '{print $2}' 2024-03-27T10:01:34.106 INFO:teuthology.orchestra.run.smithi057.stdout:/proc 2024-03-27T10:01:34.107 INFO:teuthology.orchestra.run.smithi057.stdout:/sys 2024-03-27T10:01:34.107 INFO:teuthology.orchestra.run.smithi057.stdout:/dev 2024-03-27T10:01:34.107 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/kernel/security 2024-03-27T10:01:34.107 INFO:teuthology.orchestra.run.smithi057.stdout:/dev/shm 2024-03-27T10:01:34.107 INFO:teuthology.orchestra.run.smithi057.stdout:/dev/pts 2024-03-27T10:01:34.107 INFO:teuthology.orchestra.run.smithi057.stdout:/run 2024-03-27T10:01:34.107 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/cgroup 2024-03-27T10:01:34.107 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/pstore 2024-03-27T10:01:34.107 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/bpf 2024-03-27T10:01:34.107 INFO:teuthology.orchestra.run.smithi057.stdout:/ 2024-03-27T10:01:34.107 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/selinux 2024-03-27T10:01:34.107 INFO:teuthology.orchestra.run.smithi057.stdout:/proc/sys/fs/binfmt_misc 2024-03-27T10:01:34.107 INFO:teuthology.orchestra.run.smithi057.stdout:/dev/hugepages 2024-03-27T10:01:34.107 INFO:teuthology.orchestra.run.smithi057.stdout:/dev/mqueue 2024-03-27T10:01:34.108 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/kernel/debug 2024-03-27T10:01:34.108 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/kernel/tracing 2024-03-27T10:01:34.108 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/fs/fuse/connections 2024-03-27T10:01:34.108 INFO:teuthology.orchestra.run.smithi057.stdout:/sys/kernel/config 2024-03-27T10:01:34.108 INFO:teuthology.orchestra.run.smithi057.stdout:/run/credentials/systemd-sysctl.service 2024-03-27T10:01:34.108 INFO:teuthology.orchestra.run.smithi057.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-27T10:01:34.108 INFO:teuthology.orchestra.run.smithi057.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-27T10:01:34.108 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/nfs/rpc_pipefs 2024-03-27T10:01:34.108 INFO:teuthology.orchestra.run.smithi057.stdout:/run/user/1000 2024-03-27T10:01:34.108 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/ceph 2024-03-27T10:01:34.108 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/ceph/osd/ceph-0 2024-03-27T10:01:34.108 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/ceph/osd/ceph-1 2024-03-27T10:01:34.108 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/ceph/osd/ceph-2 2024-03-27T10:01:34.108 INFO:teuthology.orchestra.run.smithi057.stdout:/var/lib/ceph/osd/ceph-3 2024-03-27T10:01:34.109 INFO:teuthology.orchestra.run.smithi057.stdout:/run/netns 2024-03-27T10:01:34.109 INFO:teuthology.orchestra.run.smithi057.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-27T10:01:34.109 INFO:teuthology.orchestra.run.smithi057.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-27T10:01:34.109 INFO:teuthology.orchestra.run.smithi057.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-27T10:01:34.109 INFO:teuthology.orchestra.run.smithi057.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-27T10:01:34.109 INFO:teuthology.orchestra.run.smithi057.stdout:/home/ubuntu/cephtest/mnt.0 2024-03-27T10:01:34.110 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T10:01:34.110 DEBUG:teuthology.orchestra.run.smithi057:> ls /sys/fs/fuse/connections 2024-03-27T10:01:34.163 INFO:teuthology.orchestra.run.smithi057.stdout:42 2024-03-27T10:01:34.163 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2024-03-27T10:01:34.163 DEBUG:teuthology.orchestra.run.smithi057:> sudo stdin-killer -- python3 -c ' 2024-03-27T10:01:34.163 DEBUG:teuthology.orchestra.run.smithi057:> import glob 2024-03-27T10:01:34.163 DEBUG:teuthology.orchestra.run.smithi057:> import re 2024-03-27T10:01:34.163 DEBUG:teuthology.orchestra.run.smithi057:> import os 2024-03-27T10:01:34.163 DEBUG:teuthology.orchestra.run.smithi057:> import subprocess 2024-03-27T10:01:34.163 DEBUG:teuthology.orchestra.run.smithi057:> 2024-03-27T10:01:34.164 DEBUG:teuthology.orchestra.run.smithi057:> def _find_admin_socket(client_name): 2024-03-27T10:01:34.164 DEBUG:teuthology.orchestra.run.smithi057:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-03-27T10:01:34.164 DEBUG:teuthology.orchestra.run.smithi057:> files = glob.glob(asok_path) 2024-03-27T10:01:34.164 DEBUG:teuthology.orchestra.run.smithi057:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-03-27T10:01:34.164 DEBUG:teuthology.orchestra.run.smithi057:> 2024-03-27T10:01:34.164 DEBUG:teuthology.orchestra.run.smithi057:> # Given a non-glob path, it better be there 2024-03-27T10:01:34.164 DEBUG:teuthology.orchestra.run.smithi057:> if "*" not in asok_path: 2024-03-27T10:01:34.164 DEBUG:teuthology.orchestra.run.smithi057:> assert(len(files) == 1) 2024-03-27T10:01:34.164 DEBUG:teuthology.orchestra.run.smithi057:> return files[0] 2024-03-27T10:01:34.164 DEBUG:teuthology.orchestra.run.smithi057:> 2024-03-27T10:01:34.164 DEBUG:teuthology.orchestra.run.smithi057:> for f in files: 2024-03-27T10:01:34.164 DEBUG:teuthology.orchestra.run.smithi057:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-03-27T10:01:34.164 DEBUG:teuthology.orchestra.run.smithi057:> if os.path.exists("/proc/{0}".format(pid)): 2024-03-27T10:01:34.164 DEBUG:teuthology.orchestra.run.smithi057:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-03-27T10:01:34.164 DEBUG:teuthology.orchestra.run.smithi057:> contents = proc_f.read() 2024-03-27T10:01:34.165 DEBUG:teuthology.orchestra.run.smithi057:> if mountpoint in contents: 2024-03-27T10:01:34.165 DEBUG:teuthology.orchestra.run.smithi057:> return f 2024-03-27T10:01:34.165 DEBUG:teuthology.orchestra.run.smithi057:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-03-27T10:01:34.165 DEBUG:teuthology.orchestra.run.smithi057:> 2024-03-27T10:01:34.165 DEBUG:teuthology.orchestra.run.smithi057:> print(_find_admin_socket("client.0")) 2024-03-27T10:01:34.165 DEBUG:teuthology.orchestra.run.smithi057:> ' 2024-03-27T10:01:34.340 INFO:teuthology.orchestra.run.smithi057.stdout:/var/run/ceph/ceph-client.0.53742.asok 2024-03-27T10:01:34.345 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:01:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-27T10:01:34.358 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.53742.asok 2024-03-27T10:01:34.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T10:01:34.359 DEBUG:teuthology.orchestra.run.smithi057:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.53742.asok status 2024-03-27T10:01:34.602 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-03-27T10:01:34.602 INFO:teuthology.orchestra.run.smithi057.stdout: "metadata": { 2024-03-27T10:01:34.602 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph_sha1": "155268c4e432a12433aa833f174f9fe3b1016ae0", 2024-03-27T10:01:34.602 INFO:teuthology.orchestra.run.smithi057.stdout: "ceph_version": "ceph version 19.0.0-2478-g155268c4 (155268c4e432a12433aa833f174f9fe3b1016ae0) squid (dev)", 2024-03-27T10:01:34.602 INFO:teuthology.orchestra.run.smithi057.stdout: "entity_id": "0", 2024-03-27T10:01:34.602 INFO:teuthology.orchestra.run.smithi057.stdout: "hostname": "smithi057", 2024-03-27T10:01:34.602 INFO:teuthology.orchestra.run.smithi057.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-03-27T10:01:34.602 INFO:teuthology.orchestra.run.smithi057.stdout: "pid": "53742", 2024-03-27T10:01:34.602 INFO:teuthology.orchestra.run.smithi057.stdout: "root": "/" 2024-03-27T10:01:34.602 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-03-27T10:01:34.603 INFO:teuthology.orchestra.run.smithi057.stdout: "dentry_count": 0, 2024-03-27T10:01:34.603 INFO:teuthology.orchestra.run.smithi057.stdout: "dentry_pinned_count": 0, 2024-03-27T10:01:34.603 INFO:teuthology.orchestra.run.smithi057.stdout: "id": 5688, 2024-03-27T10:01:34.603 INFO:teuthology.orchestra.run.smithi057.stdout: "inst": { 2024-03-27T10:01:34.603 INFO:teuthology.orchestra.run.smithi057.stdout: "name": { 2024-03-27T10:01:34.603 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "client", 2024-03-27T10:01:34.603 INFO:teuthology.orchestra.run.smithi057.stdout: "num": 5688 2024-03-27T10:01:34.603 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-03-27T10:01:34.603 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": { 2024-03-27T10:01:34.603 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-03-27T10:01:34.603 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "192.168.0.1:0", 2024-03-27T10:01:34.603 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 169921907 2024-03-27T10:01:34.603 INFO:teuthology.orchestra.run.smithi057.stdout: } 2024-03-27T10:01:34.603 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-03-27T10:01:34.604 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": { 2024-03-27T10:01:34.604 INFO:teuthology.orchestra.run.smithi057.stdout: "type": "v1", 2024-03-27T10:01:34.604 INFO:teuthology.orchestra.run.smithi057.stdout: "addr": "192.168.0.1:0", 2024-03-27T10:01:34.604 INFO:teuthology.orchestra.run.smithi057.stdout: "nonce": 169921907 2024-03-27T10:01:34.604 INFO:teuthology.orchestra.run.smithi057.stdout: }, 2024-03-27T10:01:34.604 INFO:teuthology.orchestra.run.smithi057.stdout: "inst_str": "client.5688 192.168.0.1:0/169921907", 2024-03-27T10:01:34.604 INFO:teuthology.orchestra.run.smithi057.stdout: "addr_str": "192.168.0.1:0/169921907", 2024-03-27T10:01:34.604 INFO:teuthology.orchestra.run.smithi057.stdout: "inode_count": 1, 2024-03-27T10:01:34.604 INFO:teuthology.orchestra.run.smithi057.stdout: "mds_epoch": 18, 2024-03-27T10:01:34.604 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_epoch": 40, 2024-03-27T10:01:34.604 INFO:teuthology.orchestra.run.smithi057.stdout: "osd_epoch_barrier": 0, 2024-03-27T10:01:34.604 INFO:teuthology.orchestra.run.smithi057.stdout: "blocklisted": false, 2024-03-27T10:01:34.604 INFO:teuthology.orchestra.run.smithi057.stdout: "fs_name": "cephfs" 2024-03-27T10:01:34.604 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-03-27T10:01:34.618 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T10:01:34.618 DEBUG:teuthology.orchestra.run.smithi057:> stat --file-system '--printf=%T 2024-03-27T10:01:34.618 DEBUG:teuthology.orchestra.run.smithi057:> ' -- /home/ubuntu/cephtest/mnt.0 2024-03-27T10:01:34.678 INFO:teuthology.orchestra.run.smithi057.stdout:fuseblk 2024-03-27T10:01:34.678 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-03-27T10:01:34.679 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T10:01:34.679 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-03-27T10:01:34.773 DEBUG:teuthology.orchestra.run.smithi057:> mktemp -d --suffix=xfstests-dev 2024-03-27T10:01:34.820 INFO:teuthology.orchestra.run.smithi057.stdout:/tmp/tmp.446sL8UEHrxfstests-dev 2024-03-27T10:01:34.820 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T10:01:34.820 DEBUG:teuthology.orchestra.run.smithi057:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.446sL8UEHrxfstests-dev) 2024-03-27T10:01:34.912 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T10:01:34.913 DEBUG:teuthology.orchestra.run.smithi057:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.446sL8UEHrxfstests-dev) 2024-03-27T10:01:34.976 INFO:teuthology.orchestra.run.smithi057.stderr:Cloning into '/tmp/tmp.446sL8UEHrxfstests-dev'... 2024-03-27T10:01:36.222 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T10:01:36.222 DEBUG:teuthology.orchestra.run.smithi057:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2024-03-27T10:01:36.278 DEBUG:teuthology.orchestra.run.smithi057:> mktemp -d --suffix=test 2024-03-27T10:01:36.321 INFO:teuthology.orchestra.run.smithi057.stdout:/tmp/tmp.HFg5N66vC0test 2024-03-27T10:01:36.322 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T10:01:36.322 DEBUG:teuthology.orchestra.run.smithi057:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2024-03-27T10:01:36.424 DEBUG:teuthology.orchestra.run.smithi057:> mktemp -d --suffix=scratch 2024-03-27T10:01:36.476 INFO:teuthology.orchestra.run.smithi057.stdout:/tmp/tmp.XGhHhAACBDscratch 2024-03-27T10:01:36.476 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "centos" and "9". 2024-03-27T10:01:36.477 DEBUG:teuthology.orchestra.run.smithi057:> sudo yum install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc gdbm-devel git indent kernel-devel libacl-devel libaio-devel libcap-devel libtool libuuid-devel lvm2 make psmisc python3 quota sed sqlite udftools xfsprogs 2024-03-27T10:01:37.432 INFO:teuthology.orchestra.run.smithi057.stdout:Last metadata expiration check: 0:05:12 ago on Wed 27 Mar 2024 09:56:25 AM UTC. 2024-03-27T10:01:37.537 INFO:teuthology.orchestra.run.smithi057.stdout:Package acl-2.3.1-4.el9.x86_64 is already installed. 2024-03-27T10:01:37.538 INFO:teuthology.orchestra.run.smithi057.stdout:Package attr-2.5.1-3.el9.x86_64 is already installed. 2024-03-27T10:01:37.539 INFO:teuthology.orchestra.run.smithi057.stdout:Package automake-1.16.2-8.el9.noarch is already installed. 2024-03-27T10:01:37.540 INFO:teuthology.orchestra.run.smithi057.stdout:Package bc-1.07.1-14.el9.x86_64 is already installed. 2024-03-27T10:01:37.542 INFO:teuthology.orchestra.run.smithi057.stdout:Package dbench-4.0-25.el9.x86_64 is already installed. 2024-03-27T10:01:37.544 INFO:teuthology.orchestra.run.smithi057.stdout:Package e2fsprogs-1.46.5-3.el9.x86_64 is already installed. 2024-03-27T10:01:37.546 INFO:teuthology.orchestra.run.smithi057.stdout:Package gawk-5.1.0-6.el9.x86_64 is already installed. 2024-03-27T10:01:37.547 INFO:teuthology.orchestra.run.smithi057.stdout:Package gcc-11.4.1-2.1.el9.x86_64 is already installed. 2024-03-27T10:01:37.549 INFO:teuthology.orchestra.run.smithi057.stdout:Package git-2.39.3-1.el9.x86_64 is already installed. 2024-03-27T10:01:37.552 INFO:teuthology.orchestra.run.smithi057.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-03-27T10:01:37.553 INFO:teuthology.orchestra.run.smithi057.stdout:Package libaio-devel-0.3.111-13.el9.x86_64 is already installed. 2024-03-27T10:01:37.556 INFO:teuthology.orchestra.run.smithi057.stdout:Package libtool-2.4.6-45.el9.x86_64 is already installed. 2024-03-27T10:01:37.557 INFO:teuthology.orchestra.run.smithi057.stdout:Package libuuid-devel-2.37.4-18.el9.x86_64 is already installed. 2024-03-27T10:01:37.558 INFO:teuthology.orchestra.run.smithi057.stdout:Package lvm2-9:2.03.21-3.el9.x86_64 is already installed. 2024-03-27T10:01:37.559 INFO:teuthology.orchestra.run.smithi057.stdout:Package make-1:4.3-7.el9.x86_64 is already installed. 2024-03-27T10:01:37.560 INFO:teuthology.orchestra.run.smithi057.stdout:Package psmisc-23.4-3.el9.x86_64 is already installed. 2024-03-27T10:01:37.561 INFO:teuthology.orchestra.run.smithi057.stdout:Package python3-3.9.17-2.el9.x86_64 is already installed. 2024-03-27T10:01:37.562 INFO:teuthology.orchestra.run.smithi057.stdout:Package quota-1:4.06-6.el9.x86_64 is already installed. 2024-03-27T10:01:37.563 INFO:teuthology.orchestra.run.smithi057.stdout:Package sed-4.8-9.el9.x86_64 is already installed. 2024-03-27T10:01:37.566 INFO:teuthology.orchestra.run.smithi057.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-03-27T10:01:37.639 INFO:teuthology.orchestra.run.smithi057.stdout:Dependencies resolved. 2024-03-27T10:01:37.643 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-03-27T10:01:37.643 INFO:teuthology.orchestra.run.smithi057.stdout: Package Arch Version Repository Size 2024-03-27T10:01:37.643 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-03-27T10:01:37.643 INFO:teuthology.orchestra.run.smithi057.stdout:Installing: 2024-03-27T10:01:37.643 INFO:teuthology.orchestra.run.smithi057.stdout: dump x86_64 1:0.4-0.51.b47.el9 epel 88 k 2024-03-27T10:01:37.643 INFO:teuthology.orchestra.run.smithi057.stdout: fio x86_64 3.35-1.el9 CentOS-AppStream 6.2 M 2024-03-27T10:01:37.644 INFO:teuthology.orchestra.run.smithi057.stdout: gdbm-devel x86_64 1:1.19-4.el9 crb 59 k 2024-03-27T10:01:37.644 INFO:teuthology.orchestra.run.smithi057.stdout: indent x86_64 2.2.13-5.el9 epel 179 k 2024-03-27T10:01:37.644 INFO:teuthology.orchestra.run.smithi057.stdout: kernel-devel x86_64 5.14.0-432.el9 appstream 16 M 2024-03-27T10:01:37.644 INFO:teuthology.orchestra.run.smithi057.stdout: libcap-devel x86_64 2.48-9.el9 CentOS-AppStream 33 k 2024-03-27T10:01:37.644 INFO:teuthology.orchestra.run.smithi057.stdout: sqlite x86_64 3.34.1-7.el9 CentOS-AppStream 747 k 2024-03-27T10:01:37.644 INFO:teuthology.orchestra.run.smithi057.stdout: udftools x86_64 2.2-5.el9 CentOS-AppStream 144 k 2024-03-27T10:01:37.644 INFO:teuthology.orchestra.run.smithi057.stdout:Upgrading: 2024-03-27T10:01:37.644 INFO:teuthology.orchestra.run.smithi057.stdout: cpp x86_64 11.4.1-3.el9 appstream 11 M 2024-03-27T10:01:37.644 INFO:teuthology.orchestra.run.smithi057.stdout: device-mapper x86_64 9:1.02.197-2.el9 baseos 141 k 2024-03-27T10:01:37.644 INFO:teuthology.orchestra.run.smithi057.stdout: device-mapper-event x86_64 9:1.02.197-2.el9 baseos 34 k 2024-03-27T10:01:37.644 INFO:teuthology.orchestra.run.smithi057.stdout: device-mapper-event-libs x86_64 9:1.02.197-2.el9 baseos 32 k 2024-03-27T10:01:37.644 INFO:teuthology.orchestra.run.smithi057.stdout: device-mapper-libs x86_64 9:1.02.197-2.el9 baseos 179 k 2024-03-27T10:01:37.644 INFO:teuthology.orchestra.run.smithi057.stdout: e2fsprogs x86_64 1.46.5-5.el9 baseos 1.0 M 2024-03-27T10:01:37.644 INFO:teuthology.orchestra.run.smithi057.stdout: e2fsprogs-libs x86_64 1.46.5-5.el9 baseos 222 k 2024-03-27T10:01:37.644 INFO:teuthology.orchestra.run.smithi057.stdout: gcc x86_64 11.4.1-3.el9 appstream 32 M 2024-03-27T10:01:37.644 INFO:teuthology.orchestra.run.smithi057.stdout: gcc-c++ x86_64 11.4.1-3.el9 appstream 13 M 2024-03-27T10:01:37.645 INFO:teuthology.orchestra.run.smithi057.stdout: gcc-plugin-annobin x86_64 11.4.1-3.el9 appstream 47 k 2024-03-27T10:01:37.645 INFO:teuthology.orchestra.run.smithi057.stdout: git x86_64 2.43.0-1.el9 appstream 51 k 2024-03-27T10:01:37.645 INFO:teuthology.orchestra.run.smithi057.stdout: git-core x86_64 2.43.0-1.el9 appstream 4.4 M 2024-03-27T10:01:37.645 INFO:teuthology.orchestra.run.smithi057.stdout: git-core-doc noarch 2.43.0-1.el9 appstream 2.9 M 2024-03-27T10:01:37.645 INFO:teuthology.orchestra.run.smithi057.stdout: libcom_err x86_64 1.46.5-5.el9 baseos 26 k 2024-03-27T10:01:37.645 INFO:teuthology.orchestra.run.smithi057.stdout: libgcc x86_64 11.4.1-3.el9 baseos 92 k 2024-03-27T10:01:37.645 INFO:teuthology.orchestra.run.smithi057.stdout: libgomp x86_64 11.4.1-3.el9 baseos 268 k 2024-03-27T10:01:37.645 INFO:teuthology.orchestra.run.smithi057.stdout: libss x86_64 1.46.5-5.el9 baseos 32 k 2024-03-27T10:01:37.645 INFO:teuthology.orchestra.run.smithi057.stdout: libstdc++ x86_64 11.4.1-3.el9 baseos 743 k 2024-03-27T10:01:37.645 INFO:teuthology.orchestra.run.smithi057.stdout: libstdc++-devel x86_64 11.4.1-3.el9 appstream 2.4 M 2024-03-27T10:01:37.645 INFO:teuthology.orchestra.run.smithi057.stdout: lvm2 x86_64 9:2.03.23-2.el9 baseos 1.5 M 2024-03-27T10:01:37.645 INFO:teuthology.orchestra.run.smithi057.stdout: lvm2-libs x86_64 9:2.03.23-2.el9 baseos 1.0 M 2024-03-27T10:01:37.645 INFO:teuthology.orchestra.run.smithi057.stdout: make x86_64 1:4.3-8.el9 baseos 536 k 2024-03-27T10:01:37.645 INFO:teuthology.orchestra.run.smithi057.stdout: perl-Git noarch 2.43.0-1.el9 appstream 38 k 2024-03-27T10:01:37.645 INFO:teuthology.orchestra.run.smithi057.stdout: python-unversioned-command noarch 3.9.18-3.el9 CentOS-AppStream 8.3 k 2024-03-27T10:01:37.646 INFO:teuthology.orchestra.run.smithi057.stdout: python3 x86_64 3.9.18-3.el9 CentOS-BaseOS 25 k 2024-03-27T10:01:37.646 INFO:teuthology.orchestra.run.smithi057.stdout: python3-devel x86_64 3.9.18-3.el9 CentOS-AppStream 204 k 2024-03-27T10:01:37.646 INFO:teuthology.orchestra.run.smithi057.stdout: python3-libs x86_64 3.9.18-3.el9 CentOS-BaseOS 7.3 M 2024-03-27T10:01:37.646 INFO:teuthology.orchestra.run.smithi057.stdout: sqlite-libs x86_64 3.34.1-7.el9 CentOS-BaseOS 619 k 2024-03-27T10:01:37.646 INFO:teuthology.orchestra.run.smithi057.stdout:Installing dependencies: 2024-03-27T10:01:37.646 INFO:teuthology.orchestra.run.smithi057.stdout: gdbm x86_64 1:1.19-4.el9 crb 132 k 2024-03-27T10:01:37.646 INFO:teuthology.orchestra.run.smithi057.stdout: libnbd x86_64 1.18.1-3.el9 appstream 166 k 2024-03-27T10:01:37.646 INFO:teuthology.orchestra.run.smithi057.stdout: rmt x86_64 2:1.6-6.el9 CentOS-BaseOS 45 k 2024-03-27T10:01:37.646 INFO:teuthology.orchestra.run.smithi057.stdout:Installing weak dependencies: 2024-03-27T10:01:37.646 INFO:teuthology.orchestra.run.smithi057.stdout: fio-engine-http x86_64 3.35-1.el9 CentOS-AppStream 17 k 2024-03-27T10:01:37.646 INFO:teuthology.orchestra.run.smithi057.stdout: fio-engine-libaio x86_64 3.35-1.el9 CentOS-AppStream 14 k 2024-03-27T10:01:37.646 INFO:teuthology.orchestra.run.smithi057.stdout: fio-engine-nbd x86_64 3.35-1.el9 CentOS-AppStream 13 k 2024-03-27T10:01:37.646 INFO:teuthology.orchestra.run.smithi057.stdout: fio-engine-rados x86_64 3.35-1.el9 CentOS-AppStream 15 k 2024-03-27T10:01:37.646 INFO:teuthology.orchestra.run.smithi057.stdout: fio-engine-rbd x86_64 3.35-1.el9 CentOS-AppStream 15 k 2024-03-27T10:01:37.647 INFO:teuthology.orchestra.run.smithi057.stdout: fio-engine-rdma x86_64 3.35-1.el9 CentOS-AppStream 20 k 2024-03-27T10:01:37.647 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:01:37.647 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction Summary 2024-03-27T10:01:37.647 INFO:teuthology.orchestra.run.smithi057.stdout:================================================================================ 2024-03-27T10:01:37.647 INFO:teuthology.orchestra.run.smithi057.stdout:Install 17 Packages 2024-03-27T10:01:37.647 INFO:teuthology.orchestra.run.smithi057.stdout:Upgrade 28 Packages 2024-03-27T10:01:37.647 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:01:37.647 INFO:teuthology.orchestra.run.smithi057.stdout:Total download size: 103 M 2024-03-27T10:01:37.647 INFO:teuthology.orchestra.run.smithi057.stdout:Downloading Packages: 2024-03-27T10:01:39.984 INFO:teuthology.orchestra.run.smithi057.stdout:(1/45): fio-engine-http-3.35-1.el9.x86_64.rpm 57 kB/s | 17 kB 00:00 2024-03-27T10:01:40.008 INFO:teuthology.orchestra.run.smithi057.stdout:(2/45): fio-engine-libaio-3.35-1.el9.x86_64.rpm 45 kB/s | 14 kB 00:00 2024-03-27T10:01:40.091 INFO:teuthology.orchestra.run.smithi057.stdout:(3/45): fio-engine-nbd-3.35-1.el9.x86_64.rpm 129 kB/s | 13 kB 00:00 2024-03-27T10:01:40.133 INFO:teuthology.orchestra.run.smithi057.stdout:(4/45): fio-engine-rados-3.35-1.el9.x86_64.rpm 120 kB/s | 15 kB 00:00 2024-03-27T10:01:40.267 INFO:teuthology.orchestra.run.smithi057.stdout:(5/45): fio-3.35-1.el9.x86_64.rpm 11 MB/s | 6.2 MB 00:00 2024-03-27T10:01:40.292 INFO:teuthology.orchestra.run.smithi057.stdout:(6/45): fio-engine-rbd-3.35-1.el9.x86_64.rpm 78 kB/s | 15 kB 00:00 2024-03-27T10:01:40.317 INFO:teuthology.orchestra.run.smithi057.stdout:(7/45): fio-engine-rdma-3.35-1.el9.x86_64.rpm 115 kB/s | 20 kB 00:00 2024-03-27T10:01:40.351 INFO:teuthology.orchestra.run.smithi057.stdout:(8/45): libcap-devel-2.48-9.el9.x86_64.rpm 576 kB/s | 33 kB 00:00 2024-03-27T10:01:40.384 INFO:teuthology.orchestra.run.smithi057.stdout:(9/45): sqlite-3.34.1-7.el9.x86_64.rpm 8.1 MB/s | 747 kB 00:00 2024-03-27T10:01:40.410 INFO:teuthology.orchestra.run.smithi057.stdout:(10/45): udftools-2.2-5.el9.x86_64.rpm 1.6 MB/s | 144 kB 00:00 2024-03-27T10:01:40.435 INFO:teuthology.orchestra.run.smithi057.stdout:(11/45): rmt-1.6-6.el9.x86_64.rpm 935 kB/s | 45 kB 00:00 2024-03-27T10:01:40.602 INFO:teuthology.orchestra.run.smithi057.stdout:(12/45): libnbd-1.18.1-3.el9.x86_64.rpm 874 kB/s | 166 kB 00:00 2024-03-27T10:01:41.094 INFO:teuthology.orchestra.run.smithi057.stdout:(13/45): kernel-devel-5.14.0-432.el9.x86_64.rpm 22 MB/s | 16 MB 00:00 2024-03-27T10:01:41.511 INFO:teuthology.orchestra.run.smithi057.stdout:(14/45): gdbm-devel-1.19-4.el9.x86_64.rpm 65 kB/s | 59 kB 00:00 2024-03-27T10:01:41.545 INFO:teuthology.orchestra.run.smithi057.stdout:(15/45): gdbm-1.19-4.el9.x86_64.rpm 119 kB/s | 132 kB 00:01 2024-03-27T10:01:41.578 INFO:teuthology.orchestra.run.smithi057.stdout:(16/45): dump-0.4-0.51.b47.el9.x86_64.rpm 183 kB/s | 88 kB 00:00 2024-03-27T10:01:41.603 INFO:teuthology.orchestra.run.smithi057.stdout:(17/45): python-unversioned-command-3.9.18-3.el 146 kB/s | 8.3 kB 00:00 2024-03-27T10:01:41.654 INFO:teuthology.orchestra.run.smithi057.stdout:(18/45): python3-devel-3.9.18-3.el9.x86_64.rpm 2.7 MB/s | 204 kB 00:00 2024-03-27T10:01:41.688 INFO:teuthology.orchestra.run.smithi057.stdout:(19/45): python3-3.9.18-3.el9.x86_64.rpm 309 kB/s | 25 kB 00:00 2024-03-27T10:01:41.888 INFO:teuthology.orchestra.run.smithi057.stdout:(20/45): python3-libs-3.9.18-3.el9.x86_64.rpm 31 MB/s | 7.3 MB 00:00 2024-03-27T10:01:41.922 INFO:teuthology.orchestra.run.smithi057.stdout:(21/45): indent-2.2.13-5.el9.x86_64.rpm 439 kB/s | 179 kB 00:00 2024-03-27T10:01:41.963 INFO:teuthology.orchestra.run.smithi057.stdout:(22/45): sqlite-libs-3.34.1-7.el9.x86_64.rpm 2.3 MB/s | 619 kB 00:00 2024-03-27T10:01:42.106 INFO:teuthology.orchestra.run.smithi057.stdout:(23/45): device-mapper-event-libs-1.02.197-2.el 230 kB/s | 32 kB 00:00 2024-03-27T10:01:42.131 INFO:teuthology.orchestra.run.smithi057.stdout:(24/45): device-mapper-event-1.02.197-2.el9.x86 206 kB/s | 34 kB 00:00 2024-03-27T10:01:42.189 INFO:teuthology.orchestra.run.smithi057.stdout:(25/45): device-mapper-1.02.197-2.el9.x86_64.rp 477 kB/s | 141 kB 00:00 2024-03-27T10:01:42.256 INFO:teuthology.orchestra.run.smithi057.stdout:(26/45): device-mapper-libs-1.02.197-2.el9.x86_ 1.2 MB/s | 179 kB 00:00 2024-03-27T10:01:42.290 INFO:teuthology.orchestra.run.smithi057.stdout:(27/45): e2fsprogs-libs-1.46.5-5.el9.x86_64.rpm 2.2 MB/s | 222 kB 00:00 2024-03-27T10:01:42.315 INFO:teuthology.orchestra.run.smithi057.stdout:(28/45): libcom_err-1.46.5-5.el9.x86_64.rpm 457 kB/s | 26 kB 00:00 2024-03-27T10:01:42.349 INFO:teuthology.orchestra.run.smithi057.stdout:(29/45): libgcc-11.4.1-3.el9.x86_64.rpm 1.6 MB/s | 92 kB 00:00 2024-03-27T10:01:42.391 INFO:teuthology.orchestra.run.smithi057.stdout:(30/45): e2fsprogs-1.46.5-5.el9.x86_64.rpm 3.9 MB/s | 1.0 MB 00:00 2024-03-27T10:01:42.416 INFO:teuthology.orchestra.run.smithi057.stdout:(31/45): libss-1.46.5-5.el9.x86_64.rpm 480 kB/s | 32 kB 00:00 2024-03-27T10:01:42.450 INFO:teuthology.orchestra.run.smithi057.stdout:(32/45): libgomp-11.4.1-3.el9.x86_64.rpm 2.0 MB/s | 268 kB 00:00 2024-03-27T10:01:42.500 INFO:teuthology.orchestra.run.smithi057.stdout:(33/45): libstdc++-11.4.1-3.el9.x86_64.rpm 6.7 MB/s | 743 kB 00:00 2024-03-27T10:01:42.584 INFO:teuthology.orchestra.run.smithi057.stdout:(34/45): lvm2-libs-2.03.23-2.el9.x86_64.rpm 7.5 MB/s | 1.0 MB 00:00 2024-03-27T10:01:42.642 INFO:teuthology.orchestra.run.smithi057.stdout:(35/45): lvm2-2.03.23-2.el9.x86_64.rpm 6.8 MB/s | 1.5 MB 00:00 2024-03-27T10:01:42.701 INFO:teuthology.orchestra.run.smithi057.stdout:(36/45): make-4.3-8.el9.x86_64.rpm 2.6 MB/s | 536 kB 00:00 2024-03-27T10:01:43.052 INFO:teuthology.orchestra.run.smithi057.stdout:(37/45): cpp-11.4.1-3.el9.x86_64.rpm 23 MB/s | 11 MB 00:00 2024-03-27T10:01:43.101 INFO:teuthology.orchestra.run.smithi057.stdout:(38/45): gcc-plugin-annobin-11.4.1-3.el9.x86_64 968 kB/s | 47 kB 00:00 2024-03-27T10:01:43.152 INFO:teuthology.orchestra.run.smithi057.stdout:(39/45): git-2.43.0-1.el9.x86_64.rpm 1.0 MB/s | 51 kB 00:00 2024-03-27T10:01:43.344 INFO:teuthology.orchestra.run.smithi057.stdout:(40/45): git-core-2.43.0-1.el9.x86_64.rpm 23 MB/s | 4.4 MB 00:00 2024-03-27T10:01:43.486 INFO:teuthology.orchestra.run.smithi057.stdout:(41/45): git-core-doc-2.43.0-1.el9.noarch.rpm 21 MB/s | 2.9 MB 00:00 2024-03-27T10:01:43.611 INFO:teuthology.orchestra.run.smithi057.stdout:(42/45): libstdc++-devel-11.4.1-3.el9.x86_64.rp 19 MB/s | 2.4 MB 00:00 2024-03-27T10:01:43.670 INFO:teuthology.orchestra.run.smithi057.stdout:(43/45): perl-Git-2.43.0-1.el9.noarch.rpm 658 kB/s | 38 kB 00:00 2024-03-27T10:01:45.020 INFO:teuthology.orchestra.run.smithi057.stdout:(44/45): gcc-11.4.1-3.el9.x86_64.rpm 14 MB/s | 32 MB 00:02 2024-03-27T10:01:45.228 INFO:teuthology.orchestra.run.smithi057.stdout:(45/45): gcc-c++-11.4.1-3.el9.x86_64.rpm 5.1 MB/s | 13 MB 00:02 2024-03-27T10:01:45.234 INFO:teuthology.orchestra.run.smithi057.stdout:-------------------------------------------------------------------------------- 2024-03-27T10:01:45.234 INFO:teuthology.orchestra.run.smithi057.stdout:Total 14 MB/s | 103 MB 00:07 2024-03-27T10:01:47.011 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction check 2024-03-27T10:01:47.452 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction check succeeded. 2024-03-27T10:01:47.452 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction test 2024-03-27T10:01:48.312 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:01:48.319 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:01:49.186 INFO:teuthology.orchestra.run.smithi057.stdout:Transaction test succeeded. 2024-03-27T10:01:49.188 INFO:teuthology.orchestra.run.smithi057.stdout:Running transaction 2024-03-27T10:01:52.573 INFO:teuthology.orchestra.run.smithi057.stdout: Preparing : 1/1 2024-03-27T10:01:52.854 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : libgcc-11.4.1-3.el9.x86_64 1/73 2024-03-27T10:01:52.972 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: libgcc-11.4.1-3.el9.x86_64 1/73 2024-03-27T10:01:53.078 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : libcom_err-1.46.5-5.el9.x86_64 2/73 2024-03-27T10:01:53.271 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : libstdc++-11.4.1-3.el9.x86_64 3/73 2024-03-27T10:01:53.342 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : e2fsprogs-libs-1.46.5-5.el9.x86_64 4/73 2024-03-27T10:01:53.433 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : device-mapper-libs-9:1.02.197-2.el9.x86_64 5/73 2024-03-27T10:01:53.488 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : device-mapper-9:1.02.197-2.el9.x86_64 6/73 2024-03-27T10:01:53.884 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : device-mapper-event-libs-9:1.02.197-2.el9.x86_64 7/73 2024-03-27T10:01:54.073 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : git-core-2.43.0-1.el9.x86_64 8/73 2024-03-27T10:01:54.134 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : make-1:4.3-8.el9.x86_64 9/73 2024-03-27T10:01:55.765 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : sqlite-libs-3.34.1-7.el9.x86_64 10/73 2024-03-27T10:01:55.873 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : python3-libs-3.9.18-3.el9.x86_64 11/73 2024-03-27T10:01:55.908 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : python3-3.9.18-3.el9.x86_64 12/73 2024-03-27T10:01:56.929 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : python-unversioned-command-3.9.18-3.el9.noarch 13/73 2024-03-27T10:01:57.040 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : git-core-doc-2.43.0-1.el9.noarch 14/73 2024-03-27T10:01:57.111 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : perl-Git-2.43.0-1.el9.noarch 15/73 2024-03-27T10:01:57.153 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : git-2.43.0-1.el9.x86_64 16/73 2024-03-27T10:01:57.197 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : device-mapper-event-9:1.02.197-2.el9.x86_64 17/73 2024-03-27T10:01:57.622 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: device-mapper-event-9:1.02.197-2.el9.x86_64 17/73 2024-03-27T10:01:58.357 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : lvm2-libs-9:2.03.23-2.el9.x86_64 18/73 2024-03-27T10:01:58.447 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : libstdc++-devel-11.4.1-3.el9.x86_64 19/73 2024-03-27T10:01:58.789 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : libss-1.46.5-5.el9.x86_64 20/73 2024-03-27T10:01:58.984 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : cpp-11.4.1-3.el9.x86_64 21/73 2024-03-27T10:02:00.235 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : libgomp-11.4.1-3.el9.x86_64 22/73 2024-03-27T10:02:00.408 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : gcc-11.4.1-3.el9.x86_64 23/73 2024-03-27T10:02:00.501 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: gcc-11.4.1-3.el9.x86_64 23/73 2024-03-27T10:02:00.549 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : gdbm-1:1.19-4.el9.x86_64 24/73 2024-03-27T10:02:00.579 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libnbd-1.18.1-3.el9.x86_64 25/73 2024-03-27T10:02:00.612 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : fio-engine-http-3.35-1.el9.x86_64 26/73 2024-03-27T10:02:00.647 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : fio-engine-libaio-3.35-1.el9.x86_64 27/73 2024-03-27T10:02:00.673 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : fio-engine-nbd-3.35-1.el9.x86_64 28/73 2024-03-27T10:02:00.698 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : fio-engine-rados-3.35-1.el9.x86_64 29/73 2024-03-27T10:02:00.731 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : fio-engine-rbd-3.35-1.el9.x86_64 30/73 2024-03-27T10:02:00.998 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : fio-engine-rdma-3.35-1.el9.x86_64 31/73 2024-03-27T10:02:01.037 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : fio-3.35-1.el9.x86_64 32/73 2024-03-27T10:02:01.077 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : rmt-2:1.6-6.el9.x86_64 33/73 2024-03-27T10:02:01.114 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : dump-1:0.4-0.51.b47.el9.x86_64 34/73 2024-03-27T10:02:13.581 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : gdbm-devel-1:1.19-4.el9.x86_64 35/73 2024-03-27T10:02:13.786 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : kernel-devel-5.14.0-432.el9.x86_64 36/73 2024-03-27T10:02:18.477 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:02:18.488 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:02:48.636 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:02:48.645 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:03:05.143 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: kernel-devel-5.14.0-432.el9.x86_64 36/73 2024-03-27T10:03:05.226 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : gcc-c++-11.4.1-3.el9.x86_64 37/73 2024-03-27T10:03:05.263 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : gcc-plugin-annobin-11.4.1-3.el9.x86_64 38/73 2024-03-27T10:03:05.445 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: gcc-plugin-annobin-11.4.1-3.el9.x86_64 38/73 2024-03-27T10:03:05.671 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : e2fsprogs-1.46.5-5.el9.x86_64 39/73 2024-03-27T10:03:05.671 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : lvm2-9:2.03.23-2.el9.x86_64 40/73 2024-03-27T10:03:05.671 INFO:teuthology.orchestra.run.smithi057.stdout:warning: /etc/lvm/lvm.conf created as /etc/lvm/lvm.conf.rpmnew 2024-03-27T10:03:05.671 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:03:06.218 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: lvm2-9:2.03.23-2.el9.x86_64 40/73 2024-03-27T10:03:06.282 INFO:teuthology.orchestra.run.smithi057.stdout: Upgrading : python3-devel-3.9.18-3.el9.x86_64 41/73 2024-03-27T10:03:06.353 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : sqlite-3.34.1-7.el9.x86_64 42/73 2024-03-27T10:03:06.412 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : indent-2.2.13-5.el9.x86_64 43/73 2024-03-27T10:03:06.479 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : udftools-2.2-5.el9.x86_64 44/73 2024-03-27T10:03:06.510 INFO:teuthology.orchestra.run.smithi057.stdout: Installing : libcap-devel-2.48-9.el9.x86_64 45/73 2024-03-27T10:03:06.550 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : git-2.39.3-1.el9.x86_64 46/73 2024-03-27T10:03:06.594 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : python3-devel-3.9.17-2.el9.x86_64 47/73 2024-03-27T10:03:06.641 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : e2fsprogs-1.46.5-3.el9.x86_64 48/73 2024-03-27T10:03:06.688 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : gcc-c++-11.4.1-2.1.el9.x86_64 49/73 2024-03-27T10:03:06.746 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : python3-3.9.17-2.el9.x86_64 50/73 2024-03-27T10:03:06.771 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : python-unversioned-command-3.9.17-2.el9.noarch 51/73 2024-03-27T10:03:06.772 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : gcc-plugin-annobin-11.4.1-2.1.el9.x86_64 52/73 2024-03-27T10:03:06.882 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: gcc-plugin-annobin-11.4.1-2.1.el9.x86_64 52/73 2024-03-27T10:03:06.923 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : gcc-11.4.1-2.1.el9.x86_64 53/73 2024-03-27T10:03:06.954 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: lvm2-9:2.03.21-3.el9.x86_64 54/73 2024-03-27T10:03:06.955 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : lvm2-9:2.03.21-3.el9.x86_64 54/73 2024-03-27T10:03:07.101 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: lvm2-9:2.03.21-3.el9.x86_64 54/73 2024-03-27T10:03:07.208 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : libstdc++-devel-11.4.1-2.1.el9.x86_64 55/73 2024-03-27T10:03:07.249 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : git-core-doc-2.39.3-1.el9.noarch 56/73 2024-03-27T10:03:07.275 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : perl-Git-2.39.3-1.el9.noarch 57/73 2024-03-27T10:03:07.308 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : lvm2-libs-9:2.03.21-3.el9.x86_64 58/73 2024-03-27T10:03:07.335 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: device-mapper-event-9:1.02.195-3.el9.x86_64 59/73 2024-03-27T10:03:07.378 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : device-mapper-event-9:1.02.195-3.el9.x86_64 59/73 2024-03-27T10:03:07.409 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : libstdc++-11.4.1-2.1.el9.x86_64 60/73 2024-03-27T10:03:07.443 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : device-mapper-event-libs-9:1.02.195-3.el9.x86_64 61/73 2024-03-27T10:03:07.477 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : e2fsprogs-libs-1.46.5-3.el9.x86_64 62/73 2024-03-27T10:03:07.510 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : libss-1.46.5-3.el9.x86_64 63/73 2024-03-27T10:03:07.545 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : device-mapper-libs-9:1.02.195-3.el9.x86_64 64/73 2024-03-27T10:03:07.691 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : device-mapper-9:1.02.195-3.el9.x86_64 65/73 2024-03-27T10:03:07.773 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : python3-libs-3.9.17-2.el9.x86_64 66/73 2024-03-27T10:03:07.804 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : sqlite-libs-3.34.1-6.el9.x86_64 67/73 2024-03-27T10:03:07.831 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : libcom_err-1.46.5-3.el9.x86_64 68/73 2024-03-27T10:03:07.831 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : libgcc-11.4.1-2.1.el9.x86_64 69/73 2024-03-27T10:03:07.948 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: libgcc-11.4.1-2.1.el9.x86_64 69/73 2024-03-27T10:03:07.994 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : git-core-2.39.3-1.el9.x86_64 70/73 2024-03-27T10:03:08.034 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : cpp-11.4.1-2.1.el9.x86_64 71/73 2024-03-27T10:03:08.070 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : libgomp-11.4.1-2.1.el9.x86_64 72/73 2024-03-27T10:03:08.203 INFO:teuthology.orchestra.run.smithi057.stdout: Cleanup : make-1:4.3-7.el9.x86_64 73/73 2024-03-27T10:03:10.332 INFO:teuthology.orchestra.run.smithi057.stdout: Running scriptlet: make-1:4.3-7.el9.x86_64 73/73 2024-03-27T10:03:10.332 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : fio-3.35-1.el9.x86_64 1/73 2024-03-27T10:03:10.332 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : fio-engine-http-3.35-1.el9.x86_64 2/73 2024-03-27T10:03:10.332 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : fio-engine-libaio-3.35-1.el9.x86_64 3/73 2024-03-27T10:03:10.332 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : fio-engine-nbd-3.35-1.el9.x86_64 4/73 2024-03-27T10:03:10.332 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : fio-engine-rados-3.35-1.el9.x86_64 5/73 2024-03-27T10:03:10.332 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : fio-engine-rbd-3.35-1.el9.x86_64 6/73 2024-03-27T10:03:10.332 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : fio-engine-rdma-3.35-1.el9.x86_64 7/73 2024-03-27T10:03:10.332 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libcap-devel-2.48-9.el9.x86_64 8/73 2024-03-27T10:03:10.333 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : sqlite-3.34.1-7.el9.x86_64 9/73 2024-03-27T10:03:10.333 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : udftools-2.2-5.el9.x86_64 10/73 2024-03-27T10:03:10.333 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : rmt-2:1.6-6.el9.x86_64 11/73 2024-03-27T10:03:10.333 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : kernel-devel-5.14.0-432.el9.x86_64 12/73 2024-03-27T10:03:10.333 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libnbd-1.18.1-3.el9.x86_64 13/73 2024-03-27T10:03:10.333 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : gdbm-1:1.19-4.el9.x86_64 14/73 2024-03-27T10:03:10.333 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : gdbm-devel-1:1.19-4.el9.x86_64 15/73 2024-03-27T10:03:10.333 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : dump-1:0.4-0.51.b47.el9.x86_64 16/73 2024-03-27T10:03:10.333 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : indent-2.2.13-5.el9.x86_64 17/73 2024-03-27T10:03:10.333 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python-unversioned-command-3.9.18-3.el9.noarch 18/73 2024-03-27T10:03:10.333 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python-unversioned-command-3.9.17-2.el9.noarch 19/73 2024-03-27T10:03:10.333 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 20/73 2024-03-27T10:03:10.334 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 21/73 2024-03-27T10:03:10.334 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-3.9.18-3.el9.x86_64 22/73 2024-03-27T10:03:10.334 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-3.9.17-2.el9.x86_64 23/73 2024-03-27T10:03:10.334 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-libs-3.9.18-3.el9.x86_64 24/73 2024-03-27T10:03:10.334 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : python3-libs-3.9.17-2.el9.x86_64 25/73 2024-03-27T10:03:10.334 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : sqlite-libs-3.34.1-7.el9.x86_64 26/73 2024-03-27T10:03:10.334 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : sqlite-libs-3.34.1-6.el9.x86_64 27/73 2024-03-27T10:03:10.339 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : device-mapper-9:1.02.197-2.el9.x86_64 28/73 2024-03-27T10:03:10.339 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : device-mapper-9:1.02.195-3.el9.x86_64 29/73 2024-03-27T10:03:10.339 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : device-mapper-event-9:1.02.197-2.el9.x86_64 30/73 2024-03-27T10:03:10.339 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : device-mapper-event-9:1.02.195-3.el9.x86_64 31/73 2024-03-27T10:03:10.339 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : device-mapper-event-libs-9:1.02.197-2.el9.x86_64 32/73 2024-03-27T10:03:10.339 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : device-mapper-event-libs-9:1.02.195-3.el9.x86_64 33/73 2024-03-27T10:03:10.340 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : device-mapper-libs-9:1.02.197-2.el9.x86_64 34/73 2024-03-27T10:03:10.340 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : device-mapper-libs-9:1.02.195-3.el9.x86_64 35/73 2024-03-27T10:03:10.340 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : e2fsprogs-1.46.5-5.el9.x86_64 36/73 2024-03-27T10:03:10.340 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : e2fsprogs-1.46.5-3.el9.x86_64 37/73 2024-03-27T10:03:10.340 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : e2fsprogs-libs-1.46.5-5.el9.x86_64 38/73 2024-03-27T10:03:10.340 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : e2fsprogs-libs-1.46.5-3.el9.x86_64 39/73 2024-03-27T10:03:10.340 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libcom_err-1.46.5-5.el9.x86_64 40/73 2024-03-27T10:03:10.340 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libcom_err-1.46.5-3.el9.x86_64 41/73 2024-03-27T10:03:10.340 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libgcc-11.4.1-3.el9.x86_64 42/73 2024-03-27T10:03:10.340 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libgcc-11.4.1-2.1.el9.x86_64 43/73 2024-03-27T10:03:10.340 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libgomp-11.4.1-3.el9.x86_64 44/73 2024-03-27T10:03:10.340 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libgomp-11.4.1-2.1.el9.x86_64 45/73 2024-03-27T10:03:10.341 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libss-1.46.5-5.el9.x86_64 46/73 2024-03-27T10:03:10.341 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libss-1.46.5-3.el9.x86_64 47/73 2024-03-27T10:03:10.341 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libstdc++-11.4.1-3.el9.x86_64 48/73 2024-03-27T10:03:10.341 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libstdc++-11.4.1-2.1.el9.x86_64 49/73 2024-03-27T10:03:10.341 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : lvm2-9:2.03.23-2.el9.x86_64 50/73 2024-03-27T10:03:10.341 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : lvm2-9:2.03.21-3.el9.x86_64 51/73 2024-03-27T10:03:10.341 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : lvm2-libs-9:2.03.23-2.el9.x86_64 52/73 2024-03-27T10:03:10.341 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : lvm2-libs-9:2.03.21-3.el9.x86_64 53/73 2024-03-27T10:03:10.341 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : make-1:4.3-8.el9.x86_64 54/73 2024-03-27T10:03:10.341 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : make-1:4.3-7.el9.x86_64 55/73 2024-03-27T10:03:10.341 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : cpp-11.4.1-3.el9.x86_64 56/73 2024-03-27T10:03:10.341 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : cpp-11.4.1-2.1.el9.x86_64 57/73 2024-03-27T10:03:10.342 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : gcc-11.4.1-3.el9.x86_64 58/73 2024-03-27T10:03:10.342 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : gcc-11.4.1-2.1.el9.x86_64 59/73 2024-03-27T10:03:10.342 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : gcc-c++-11.4.1-3.el9.x86_64 60/73 2024-03-27T10:03:10.342 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : gcc-c++-11.4.1-2.1.el9.x86_64 61/73 2024-03-27T10:03:10.342 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : gcc-plugin-annobin-11.4.1-3.el9.x86_64 62/73 2024-03-27T10:03:10.342 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : gcc-plugin-annobin-11.4.1-2.1.el9.x86_64 63/73 2024-03-27T10:03:10.342 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : git-2.43.0-1.el9.x86_64 64/73 2024-03-27T10:03:10.342 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : git-2.39.3-1.el9.x86_64 65/73 2024-03-27T10:03:10.342 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : git-core-2.43.0-1.el9.x86_64 66/73 2024-03-27T10:03:10.342 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : git-core-2.39.3-1.el9.x86_64 67/73 2024-03-27T10:03:10.342 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : git-core-doc-2.43.0-1.el9.noarch 68/73 2024-03-27T10:03:10.342 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : git-core-doc-2.39.3-1.el9.noarch 69/73 2024-03-27T10:03:10.342 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libstdc++-devel-11.4.1-3.el9.x86_64 70/73 2024-03-27T10:03:10.343 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : libstdc++-devel-11.4.1-2.1.el9.x86_64 71/73 2024-03-27T10:03:10.343 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : perl-Git-2.43.0-1.el9.noarch 72/73 2024-03-27T10:03:11.427 INFO:teuthology.orchestra.run.smithi057.stdout: Verifying : perl-Git-2.39.3-1.el9.noarch 73/73 2024-03-27T10:03:11.427 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:03:11.427 INFO:teuthology.orchestra.run.smithi057.stdout:Upgraded: 2024-03-27T10:03:11.427 INFO:teuthology.orchestra.run.smithi057.stdout: cpp-11.4.1-3.el9.x86_64 2024-03-27T10:03:11.427 INFO:teuthology.orchestra.run.smithi057.stdout: device-mapper-9:1.02.197-2.el9.x86_64 2024-03-27T10:03:11.427 INFO:teuthology.orchestra.run.smithi057.stdout: device-mapper-event-9:1.02.197-2.el9.x86_64 2024-03-27T10:03:11.427 INFO:teuthology.orchestra.run.smithi057.stdout: device-mapper-event-libs-9:1.02.197-2.el9.x86_64 2024-03-27T10:03:11.428 INFO:teuthology.orchestra.run.smithi057.stdout: device-mapper-libs-9:1.02.197-2.el9.x86_64 2024-03-27T10:03:11.428 INFO:teuthology.orchestra.run.smithi057.stdout: e2fsprogs-1.46.5-5.el9.x86_64 2024-03-27T10:03:11.428 INFO:teuthology.orchestra.run.smithi057.stdout: e2fsprogs-libs-1.46.5-5.el9.x86_64 2024-03-27T10:03:11.428 INFO:teuthology.orchestra.run.smithi057.stdout: gcc-11.4.1-3.el9.x86_64 2024-03-27T10:03:11.428 INFO:teuthology.orchestra.run.smithi057.stdout: gcc-c++-11.4.1-3.el9.x86_64 2024-03-27T10:03:11.428 INFO:teuthology.orchestra.run.smithi057.stdout: gcc-plugin-annobin-11.4.1-3.el9.x86_64 2024-03-27T10:03:11.428 INFO:teuthology.orchestra.run.smithi057.stdout: git-2.43.0-1.el9.x86_64 2024-03-27T10:03:11.428 INFO:teuthology.orchestra.run.smithi057.stdout: git-core-2.43.0-1.el9.x86_64 2024-03-27T10:03:11.428 INFO:teuthology.orchestra.run.smithi057.stdout: git-core-doc-2.43.0-1.el9.noarch 2024-03-27T10:03:11.428 INFO:teuthology.orchestra.run.smithi057.stdout: libcom_err-1.46.5-5.el9.x86_64 2024-03-27T10:03:11.428 INFO:teuthology.orchestra.run.smithi057.stdout: libgcc-11.4.1-3.el9.x86_64 2024-03-27T10:03:11.428 INFO:teuthology.orchestra.run.smithi057.stdout: libgomp-11.4.1-3.el9.x86_64 2024-03-27T10:03:11.428 INFO:teuthology.orchestra.run.smithi057.stdout: libss-1.46.5-5.el9.x86_64 2024-03-27T10:03:11.428 INFO:teuthology.orchestra.run.smithi057.stdout: libstdc++-11.4.1-3.el9.x86_64 2024-03-27T10:03:11.429 INFO:teuthology.orchestra.run.smithi057.stdout: libstdc++-devel-11.4.1-3.el9.x86_64 2024-03-27T10:03:11.429 INFO:teuthology.orchestra.run.smithi057.stdout: lvm2-9:2.03.23-2.el9.x86_64 2024-03-27T10:03:11.429 INFO:teuthology.orchestra.run.smithi057.stdout: lvm2-libs-9:2.03.23-2.el9.x86_64 2024-03-27T10:03:11.429 INFO:teuthology.orchestra.run.smithi057.stdout: make-1:4.3-8.el9.x86_64 2024-03-27T10:03:11.429 INFO:teuthology.orchestra.run.smithi057.stdout: perl-Git-2.43.0-1.el9.noarch 2024-03-27T10:03:11.429 INFO:teuthology.orchestra.run.smithi057.stdout: python-unversioned-command-3.9.18-3.el9.noarch 2024-03-27T10:03:11.429 INFO:teuthology.orchestra.run.smithi057.stdout: python3-3.9.18-3.el9.x86_64 2024-03-27T10:03:11.429 INFO:teuthology.orchestra.run.smithi057.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-03-27T10:03:11.429 INFO:teuthology.orchestra.run.smithi057.stdout: python3-libs-3.9.18-3.el9.x86_64 2024-03-27T10:03:11.429 INFO:teuthology.orchestra.run.smithi057.stdout: sqlite-libs-3.34.1-7.el9.x86_64 2024-03-27T10:03:11.429 INFO:teuthology.orchestra.run.smithi057.stdout:Installed: 2024-03-27T10:03:11.429 INFO:teuthology.orchestra.run.smithi057.stdout: dump-1:0.4-0.51.b47.el9.x86_64 fio-3.35-1.el9.x86_64 2024-03-27T10:03:11.429 INFO:teuthology.orchestra.run.smithi057.stdout: fio-engine-http-3.35-1.el9.x86_64 fio-engine-libaio-3.35-1.el9.x86_64 2024-03-27T10:03:11.429 INFO:teuthology.orchestra.run.smithi057.stdout: fio-engine-nbd-3.35-1.el9.x86_64 fio-engine-rados-3.35-1.el9.x86_64 2024-03-27T10:03:11.429 INFO:teuthology.orchestra.run.smithi057.stdout: fio-engine-rbd-3.35-1.el9.x86_64 fio-engine-rdma-3.35-1.el9.x86_64 2024-03-27T10:03:11.430 INFO:teuthology.orchestra.run.smithi057.stdout: gdbm-1:1.19-4.el9.x86_64 gdbm-devel-1:1.19-4.el9.x86_64 2024-03-27T10:03:11.430 INFO:teuthology.orchestra.run.smithi057.stdout: indent-2.2.13-5.el9.x86_64 kernel-devel-5.14.0-432.el9.x86_64 2024-03-27T10:03:11.430 INFO:teuthology.orchestra.run.smithi057.stdout: libcap-devel-2.48-9.el9.x86_64 libnbd-1.18.1-3.el9.x86_64 2024-03-27T10:03:11.430 INFO:teuthology.orchestra.run.smithi057.stdout: rmt-2:1.6-6.el9.x86_64 sqlite-3.34.1-7.el9.x86_64 2024-03-27T10:03:11.430 INFO:teuthology.orchestra.run.smithi057.stdout: udftools-2.2-5.el9.x86_64 2024-03-27T10:03:11.430 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:03:11.430 INFO:teuthology.orchestra.run.smithi057.stdout:Complete! 2024-03-27T10:03:12.026 DEBUG:teuthology.orchestra.run.smithi057:> sudo useradd -m fsgqa 2024-03-27T10:03:12.106 INFO:teuthology.orchestra.run.smithi057.stderr:useradd: user 'fsgqa' already exists 2024-03-27T10:03:12.110 DEBUG:teuthology.orchestra.run:got remote process result: 9 2024-03-27T10:03:12.111 DEBUG:teuthology.orchestra.run.smithi057:> sudo groupadd fsgqa 2024-03-27T10:03:12.182 INFO:teuthology.orchestra.run.smithi057.stderr:groupadd: group 'fsgqa' already exists 2024-03-27T10:03:12.185 DEBUG:teuthology.orchestra.run:got remote process result: 9 2024-03-27T10:03:12.186 DEBUG:teuthology.orchestra.run.smithi057:> sudo useradd fsgqa2 2024-03-27T10:03:12.844 DEBUG:teuthology.orchestra.run.smithi057:> sudo useradd 123456-fsgqa 2024-03-27T10:03:13.524 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2024-03-27T10:03:13.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:13.721+0000 7f2484e00640 1 Processor -- start 2024-03-27T10:03:13.709 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:13.721+0000 7f2484e00640 1 -- start start 2024-03-27T10:03:13.711 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:13.723+0000 7f2484e00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f248006b750 0x7f248006bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:03:13.711 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:13.723+0000 7f2484e00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f24800ce740 0x7f24800ceb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:03:13.711 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:13.723+0000 7f2484e00640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f248015fc70 con 0x7f2480145820 2024-03-27T10:03:13.711 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:13.723+0000 7f2484e00640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f2480160b60 con 0x7f248006b750 2024-03-27T10:03:13.711 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:13.723+0000 7f2484e00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f248006c0d0 con 0x7f24800ce740 2024-03-27T10:03:13.711 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:13.723+0000 7f247d400640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f248006b750 0x7f248006bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:03:13.711 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:13.723+0000 7f247de00640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f2480145820 0x7f24800cc950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:55490/0 (socket says 172.21.15.57:55490) 2024-03-27T10:03:13.711 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:13.723+0000 7f247de00640 1 -- 172.21.15.57:0/3982038830 learned_addr learned my addr 172.21.15.57:0/3982038830 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T10:03:13.712 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:13.724+0000 7f247e800640 1 --2- 172.21.15.57:0/3982038830 >> v2:172.21.15.118:3300/0 conn(0x7f24800ce740 0x7f24800ceb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:03:13.712 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:13.724+0000 7f247d400640 1 -- 172.21.15.57:0/3982038830 >> v2:172.21.15.118:3300/0 conn(0x7f24800ce740 msgr2=0x7f24800ceb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:03:13.712 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:13.724+0000 7f247d400640 1 --2- 172.21.15.57:0/3982038830 >> v2:172.21.15.118:3300/0 conn(0x7f24800ce740 0x7f24800ceb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:03:13.712 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:13.724+0000 7f247d400640 1 -- 172.21.15.57:0/3982038830 >> v1:172.21.15.57:6789/0 conn(0x7f2480145820 legacy=0x7f24800cc950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:03:13.712 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:13.724+0000 7f247d400640 1 -- 172.21.15.57:0/3982038830 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f248015ff50 con 0x7f248006b750 2024-03-27T10:03:13.712 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:13.724+0000 7f247ca00640 1 -- 172.21.15.57:0/3982038830 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2593926318 0 0) 0x7f248015fc70 con 0x7f2480145820 2024-03-27T10:03:13.713 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:13.726+0000 7f247d400640 1 --2- 172.21.15.57:0/3982038830 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f248006b750 0x7f248006bb90 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f24800af610 tx=0x7f246c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d1b1f8dcafd288e server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:03:13.714 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:13.726+0000 7f247ca00640 1 -- 172.21.15.57:0/3982038830 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f246c035020 con 0x7f248006b750 2024-03-27T10:03:13.714 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:13.726+0000 7f247ca00640 1 -- 172.21.15.57:0/3982038830 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f246c031830 con 0x7f248006b750 2024-03-27T10:03:13.714 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:13.726+0000 7f247ca00640 1 -- 172.21.15.57:0/3982038830 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f246c031c00 con 0x7f248006b750 2024-03-27T10:03:13.715 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:13.727+0000 7f2484e00640 1 -- 172.21.15.57:0/3982038830 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f248006b750 msgr2=0x7f248006bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:03:13.715 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:13.727+0000 7f2484e00640 1 --2- 172.21.15.57:0/3982038830 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f248006b750 0x7f248006bb90 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f24800af610 tx=0x7f246c02b8d0 comp rx=0 tx=0).stop 2024-03-27T10:03:13.715 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:13.727+0000 7f2484e00640 1 -- 172.21.15.57:0/3982038830 shutdown_connections 2024-03-27T10:03:13.716 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:13.727+0000 7f2484e00640 1 --2- 172.21.15.57:0/3982038830 >> v2:172.21.15.118:3300/0 conn(0x7f24800ce740 0x7f24800ceb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:03:13.716 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:13.727+0000 7f2484e00640 1 --2- 172.21.15.57:0/3982038830 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f248006b750 0x7f248006bb90 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:03:13.716 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:13.727+0000 7f2484e00640 1 -- 172.21.15.57:0/3982038830 >> 172.21.15.57:0/3982038830 conn(0x7f24800b1c60 msgr2=0x7f24800b2070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:03:13.716 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:13.727+0000 7f2484e00640 1 -- 172.21.15.57:0/3982038830 shutdown_connections 2024-03-27T10:03:13.716 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:13.727+0000 7f2484e00640 1 -- 172.21.15.57:0/3982038830 wait complete. 2024-03-27T10:03:13.718 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:13.730+0000 7f2484e00640 1 Processor -- start 2024-03-27T10:03:13.718 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:13.730+0000 7f2484e00640 1 -- start start 2024-03-27T10:03:13.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:13.731+0000 7f2484e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f248006b750 0x7f24801f4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:03:13.719 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:13.731+0000 7f2484e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f24800ce740 0x7f2480142c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:03:13.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:13.731+0000 7f2484e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2480145820 0x7f24800b0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:03:13.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:13.731+0000 7f2484e00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f24801607f0 con 0x7f2480145820 2024-03-27T10:03:13.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:13.731+0000 7f2484e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f2480160510 con 0x7f248006b750 2024-03-27T10:03:13.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:13.731+0000 7f2484e00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f2480145c00 con 0x7f24800ce740 2024-03-27T10:03:13.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:13.732+0000 7f247e800640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2480145820 0x7f24800b0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:03:13.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:13.732+0000 7f247e800640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2480145820 0x7f24800b0690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:50340/0 (socket says 172.21.15.57:50340) 2024-03-27T10:03:13.720 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:13.732+0000 7f247e800640 1 -- 172.21.15.57:0/4008593789 learned_addr learned my addr 172.21.15.57:0/4008593789 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:03:13.721 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:13.732+0000 7f247d400640 1 --2- 172.21.15.57:0/4008593789 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f24800ce740 0x7f2480142c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:03:13.722 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:13.732+0000 7f247de00640 1 --2- 172.21.15.57:0/4008593789 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f248006b750 0x7f24801f4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:03:13.722 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:13.732+0000 7f247e800640 1 -- 172.21.15.57:0/4008593789 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f24800ce740 msgr2=0x7f2480142c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:03:13.722 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:13.732+0000 7f247e800640 1 --2- 172.21.15.57:0/4008593789 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f24800ce740 0x7f2480142c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:03:13.722 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:13.732+0000 7f247e800640 1 -- 172.21.15.57:0/4008593789 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f248006b750 msgr2=0x7f24801f4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:03:13.722 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:13.732+0000 7f247e800640 1 --2- 172.21.15.57:0/4008593789 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f248006b750 0x7f24801f4a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:03:13.722 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:13.732+0000 7f247e800640 1 -- 172.21.15.57:0/4008593789 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2480159160 con 0x7f2480145820 2024-03-27T10:03:13.722 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:13.732+0000 7f247d400640 1 --2- 172.21.15.57:0/4008593789 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f24800ce740 0x7f2480142c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T10:03:13.722 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:13.733+0000 7f247e800640 1 --2- 172.21.15.57:0/4008593789 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2480145820 0x7f24800b0690 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f2478007e40 tx=0x7f247800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:03:13.722 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:13.733+0000 7f2476000640 1 -- 172.21.15.57:0/4008593789 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2478014620 con 0x7f2480145820 2024-03-27T10:03:13.722 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:13.733+0000 7f2476000640 1 -- 172.21.15.57:0/4008593789 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2478019070 con 0x7f2480145820 2024-03-27T10:03:13.722 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:13.733+0000 7f2476000640 1 -- 172.21.15.57:0/4008593789 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2478014a20 con 0x7f2480145820 2024-03-27T10:03:13.722 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:13.733+0000 7f2484e00640 1 -- 172.21.15.57:0/4008593789 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2480159440 con 0x7f2480145820 2024-03-27T10:03:13.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:13.733+0000 7f2484e00640 1 -- 172.21.15.57:0/4008593789 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f248015c040 con 0x7f2480145820 2024-03-27T10:03:13.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:13.735+0000 7f2484e00640 1 -- 172.21.15.57:0/4008593789 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2480068620 con 0x7f2480145820 2024-03-27T10:03:13.723 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:13.736+0000 7f2476000640 1 -- 172.21.15.57:0/4008593789 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f2478014bc0 con 0x7f2480145820 2024-03-27T10:03:13.725 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:13.737+0000 7f2476000640 1 --2- 172.21.15.57:0/4008593789 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f246006c580 0x7f246006ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:03:13.725 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:13.737+0000 7f2476000640 1 -- 172.21.15.57:0/4008593789 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6130+0+0 (secure 0 0 0) 0x7f247808c150 con 0x7f2480145820 2024-03-27T10:03:13.725 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:13.738+0000 7f247de00640 1 --2- 172.21.15.57:0/4008593789 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f246006c580 0x7f246006ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:03:13.726 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:13.738+0000 7f247de00640 1 --2- 172.21.15.57:0/4008593789 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f246006c580 0x7f246006ea40 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f2470000f60 tx=0x7f2470009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:03:13.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:13.742+0000 7f2476000640 1 -- 172.21.15.57:0/4008593789 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f247805a630 con 0x7f2480145820 2024-03-27T10:03:14.072 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:14.084+0000 7f2484e00640 1 -- 172.21.15.57:0/4008593789 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f24800cce40 con 0x7f2480145820 2024-03-27T10:03:14.072 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:14.084+0000 7f2476000640 1 -- 172.21.15.57:0/4008593789 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+1285 (secure 0 0 0) 0x7f2478059f30 con 0x7f2480145820 2024-03-27T10:03:14.073 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:03:14.073 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":1,"fsid":"7ac43f86-2c16-4a97-98fb-715d3cebc75c","modified":"2024-03-27T09:58:19.759263Z","created":"2024-03-27T09:58:19.759263Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:3300","nonce":0},{"type":"v1","addr":"172.21.15.57:6789","nonce":0}]},"addr":"172.21.15.57:6789/0","public_addr":"172.21.15.57:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:3300","nonce":0},{"type":"v1","addr":"172.21.15.118:6789","nonce":0}]},"addr":"172.21.15.118:6789/0","public_addr":"172.21.15.118:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:3301","nonce":0},{"type":"v1","addr":"172.21.15.118:6790","nonce":0}]},"addr":"172.21.15.118:6790/0","public_addr":"172.21.15.118:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-03-27T10:03:14.073 INFO:teuthology.orchestra.run.smithi057.stderr:dumped monmap epoch 1 2024-03-27T10:03:14.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:14.088+0000 7f2484e00640 1 -- 172.21.15.57:0/4008593789 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f246006c580 msgr2=0x7f246006ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:03:14.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:14.088+0000 7f2484e00640 1 --2- 172.21.15.57:0/4008593789 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f246006c580 0x7f246006ea40 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f2470000f60 tx=0x7f2470009040 comp rx=0 tx=0).stop 2024-03-27T10:03:14.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:14.088+0000 7f2484e00640 1 -- 172.21.15.57:0/4008593789 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2480145820 msgr2=0x7f24800b0690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:03:14.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:14.088+0000 7f2484e00640 1 --2- 172.21.15.57:0/4008593789 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2480145820 0x7f24800b0690 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f2478007e40 tx=0x7f247800e4b0 comp rx=0 tx=0).stop 2024-03-27T10:03:14.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:14.088+0000 7f2484e00640 1 -- 172.21.15.57:0/4008593789 shutdown_connections 2024-03-27T10:03:14.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:14.088+0000 7f2484e00640 1 --2- 172.21.15.57:0/4008593789 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2480145820 0x7f24800b0690 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:03:14.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:14.088+0000 7f2484e00640 1 --2- 172.21.15.57:0/4008593789 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f24800ce740 0x7f2480142c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:03:14.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:14.088+0000 7f2484e00640 1 --2- 172.21.15.57:0/4008593789 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f246006c580 0x7f246006ea40 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:03:14.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:14.088+0000 7f2484e00640 1 --2- 172.21.15.57:0/4008593789 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f248006b750 0x7f24801f4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:03:14.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:14.088+0000 7f2484e00640 1 -- 172.21.15.57:0/4008593789 >> 172.21.15.57:0/4008593789 conn(0x7f24800b1c60 msgr2=0x7f248006e4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:03:14.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:14.088+0000 7f2484e00640 1 -- 172.21.15.57:0/4008593789 shutdown_connections 2024-03-27T10:03:14.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:14.089+0000 7f2484e00640 1 -- 172.21.15.57:0/4008593789 wait complete. 2024-03-27T10:03:14.095 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get client.admin 2024-03-27T10:03:14.295 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:14.307+0000 7f4285600640 1 Processor -- start 2024-03-27T10:03:14.296 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:14.307+0000 7f4285600640 1 -- start start 2024-03-27T10:03:14.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:14.310+0000 7f4285600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4280145820 0x7f42800cc950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:03:14.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:14.310+0000 7f4285600640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f428006b750 0x7f428006bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:03:14.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:14.310+0000 7f4285600640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f42800b2b70 0x7f42800b2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:03:14.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:14.310+0000 7f4285600640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f4280160b60 con 0x7f428006b750 2024-03-27T10:03:14.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:14.310+0000 7f4285600640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f428006c0d0 con 0x7f42800b2b70 2024-03-27T10:03:14.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:14.310+0000 7f4285600640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f42800cce90 con 0x7f4280145820 2024-03-27T10:03:14.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:14.310+0000 7f427e000640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f428006b750 0x7f428006bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:03:14.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:14.310+0000 7f427e000640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f428006b750 0x7f428006bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:50346/0 (socket says 172.21.15.57:50346) 2024-03-27T10:03:14.298 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:14.310+0000 7f427e000640 1 -- 172.21.15.57:0/3109832156 learned_addr learned my addr 172.21.15.57:0/3109832156 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:03:14.299 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:14.311+0000 7f427ea00640 1 --2- 172.21.15.57:0/3109832156 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4280145820 0x7f42800cc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:03:14.299 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:14.311+0000 7f427f400640 1 --2- 172.21.15.57:0/3109832156 >> v2:172.21.15.118:3300/0 conn(0x7f42800b2b70 0x7f42800b2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:03:14.299 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:14.311+0000 7f427e000640 1 -- 172.21.15.57:0/3109832156 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4280145820 msgr2=0x7f42800cc950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:03:14.299 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:14.311+0000 7f427e000640 1 --2- 172.21.15.57:0/3109832156 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4280145820 0x7f42800cc950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:03:14.299 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:14.311+0000 7f427e000640 1 -- 172.21.15.57:0/3109832156 >> v2:172.21.15.118:3300/0 conn(0x7f42800b2b70 msgr2=0x7f42800b2fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T10:03:14.299 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:14.311+0000 7f427e000640 1 --2- 172.21.15.57:0/3109832156 >> v2:172.21.15.118:3300/0 conn(0x7f42800b2b70 0x7f42800b2fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:03:14.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:14.311+0000 7f427e000640 1 -- 172.21.15.57:0/3109832156 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f428015fc70 con 0x7f428006b750 2024-03-27T10:03:14.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:14.311+0000 7f427f400640 1 --2- 172.21.15.57:0/3109832156 >> v2:172.21.15.118:3300/0 conn(0x7f42800b2b70 0x7f42800b2fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T10:03:14.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:14.312+0000 7f427e000640 1 --2- 172.21.15.57:0/3109832156 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f428006b750 0x7f428006bb90 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f42800b3c30 tx=0x7f426c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d1db5cb1e9f1570 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:03:14.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:14.313+0000 7f427d600640 1 -- 172.21.15.57:0/3109832156 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f426c035020 con 0x7f428006b750 2024-03-27T10:03:14.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:14.313+0000 7f427d600640 1 -- 172.21.15.57:0/3109832156 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f426c031870 con 0x7f428006b750 2024-03-27T10:03:14.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:14.313+0000 7f427d600640 1 -- 172.21.15.57:0/3109832156 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f426c031c40 con 0x7f428006b750 2024-03-27T10:03:14.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:14.313+0000 7f4285600640 1 -- 172.21.15.57:0/3109832156 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f428006b750 msgr2=0x7f428006bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:03:14.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:14.313+0000 7f4285600640 1 --2- 172.21.15.57:0/3109832156 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f428006b750 0x7f428006bb90 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f42800b3c30 tx=0x7f426c02b910 comp rx=0 tx=0).stop 2024-03-27T10:03:14.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:14.314+0000 7f4285600640 1 -- 172.21.15.57:0/3109832156 shutdown_connections 2024-03-27T10:03:14.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:14.314+0000 7f4285600640 1 --2- 172.21.15.57:0/3109832156 >> v2:172.21.15.118:3300/0 conn(0x7f42800b2b70 0x7f42800b2fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:03:14.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:14.314+0000 7f4285600640 1 --2- 172.21.15.57:0/3109832156 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f428006b750 0x7f428006bb90 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:03:14.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:14.314+0000 7f4285600640 1 --2- 172.21.15.57:0/3109832156 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4280145820 0x7f42800cc950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:03:14.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:14.314+0000 7f4285600640 1 -- 172.21.15.57:0/3109832156 >> 172.21.15.57:0/3109832156 conn(0x7f42800b1c60 msgr2=0x7f42800b2070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:03:14.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:14.314+0000 7f4285600640 1 -- 172.21.15.57:0/3109832156 shutdown_connections 2024-03-27T10:03:14.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:14.314+0000 7f4285600640 1 -- 172.21.15.57:0/3109832156 wait complete. 2024-03-27T10:03:14.303 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:14.315+0000 7f4285600640 1 Processor -- start 2024-03-27T10:03:14.303 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:14.316+0000 7f4285600640 1 -- start start 2024-03-27T10:03:14.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:14.316+0000 7f4285600640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f428006b750 0x7f42800b0110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:03:14.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:14.316+0000 7f4285600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f42800b2b70 0x7f42801e70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:03:14.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:14.317+0000 7f4285600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4280145820 0x7f42801e7600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:03:14.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:14.317+0000 7f4285600640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f4280160510 con 0x7f428006b750 2024-03-27T10:03:14.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:14.317+0000 7f4285600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f4280160230 con 0x7f4280145820 2024-03-27T10:03:14.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:14.317+0000 7f4285600640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f42801607f0 con 0x7f42800b2b70 2024-03-27T10:03:14.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:14.317+0000 7f427ea00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f428006b750 0x7f42800b0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:03:14.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:14.317+0000 7f427ea00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f428006b750 0x7f42800b0110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:50348/0 (socket says 172.21.15.57:50348) 2024-03-27T10:03:14.305 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:14.317+0000 7f427ea00640 1 -- 172.21.15.57:0/251619969 learned_addr learned my addr 172.21.15.57:0/251619969 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T10:03:14.307 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:14.317+0000 7f427ea00640 1 -- 172.21.15.57:0/251619969 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f42800b2b70 msgr2=0x7f42801e70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:03:14.307 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:14.317+0000 7f427e000640 1 --2- 172.21.15.57:0/251619969 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f42800b2b70 0x7f42801e70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:03:14.307 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:14.317+0000 7f427f400640 1 --2- 172.21.15.57:0/251619969 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4280145820 0x7f42801e7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:03:14.307 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:14.317+0000 7f427ea00640 1 --2- 172.21.15.57:0/251619969 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f42800b2b70 0x7f42801e70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:03:14.307 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:14.317+0000 7f427ea00640 1 -- 172.21.15.57:0/251619969 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4280145820 msgr2=0x7f42801e7600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:03:14.307 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:14.317+0000 7f427ea00640 1 --2- 172.21.15.57:0/251619969 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4280145820 0x7f42801e7600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:03:14.307 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:14.318+0000 7f427ea00640 1 -- 172.21.15.57:0/251619969 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42801e7e30 con 0x7f428006b750 2024-03-27T10:03:14.307 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:14.318+0000 7f427e000640 1 --2- 172.21.15.57:0/251619969 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f42800b2b70 0x7f42801e70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T10:03:14.307 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:14.318+0000 7f427f400640 1 --2- 172.21.15.57:0/251619969 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4280145820 0x7f42801e7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T10:03:14.307 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:14.318+0000 7f427ea00640 1 --2- 172.21.15.57:0/251619969 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f428006b750 0x7f42800b0110 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f427000d620 tx=0x7f427000dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:03:14.307 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:14.318+0000 7f4276a00640 1 -- 172.21.15.57:0/251619969 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f427000b620 con 0x7f428006b750 2024-03-27T10:03:14.307 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:14.318+0000 7f4276a00640 1 -- 172.21.15.57:0/251619969 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4270019070 con 0x7f428006b750 2024-03-27T10:03:14.307 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:14.318+0000 7f4285600640 1 -- 172.21.15.57:0/251619969 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42801e8110 con 0x7f428006b750 2024-03-27T10:03:14.307 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:14.318+0000 7f4276a00640 1 -- 172.21.15.57:0/251619969 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f427000ba00 con 0x7f428006b750 2024-03-27T10:03:14.308 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:14.318+0000 7f4285600640 1 -- 172.21.15.57:0/251619969 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42800a9ed0 con 0x7f428006b750 2024-03-27T10:03:14.308 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:14.320+0000 7f4285600640 1 -- 172.21.15.57:0/251619969 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42801e82e0 con 0x7f428006b750 2024-03-27T10:03:14.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:14.321+0000 7f4276a00640 1 -- 172.21.15.57:0/251619969 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f427000bba0 con 0x7f428006b750 2024-03-27T10:03:14.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:14.322+0000 7f4276a00640 1 --2- 172.21.15.57:0/251619969 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f426006c530 0x7f426006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T10:03:14.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:14.322+0000 7f4276a00640 1 -- 172.21.15.57:0/251619969 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6130+0+0 (secure 0 0 0) 0x7f427008bcb0 con 0x7f428006b750 2024-03-27T10:03:14.310 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:14.322+0000 7f427e000640 1 --2- 172.21.15.57:0/251619969 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f426006c530 0x7f426006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T10:03:14.311 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:14.323+0000 7f427e000640 1 --2- 172.21.15.57:0/251619969 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f426006c530 0x7f426006e9f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f426c036000 tx=0x7f426c008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T10:03:14.318 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:14.330+0000 7f4276a00640 1 -- 172.21.15.57:0/251619969 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f427005a110 con 0x7f428006b750 2024-03-27T10:03:14.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:14.742+0000 7f4285600640 1 -- 172.21.15.57:0/251619969 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "auth get", "entity": "client.admin"} v 0) -- 0x7f428006ee70 con 0x7f428006b750 2024-03-27T10:03:14.731 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:14.743+0000 7f4276a00640 1 -- 172.21.15.57:0/251619969 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "auth get", "entity": "client.admin"}]=0 v13) ==== 82+0+151 (secure 0 0 0) 0x7f428006ee70 con 0x7f428006b750 2024-03-27T10:03:14.731 INFO:teuthology.orchestra.run.smithi057.stdout:[client.admin] 2024-03-27T10:03:14.731 INFO:teuthology.orchestra.run.smithi057.stdout: key = AQC87QNmHuDwChAAenKYfjfGbbXKNjBWOPqz+A== 2024-03-27T10:03:14.731 INFO:teuthology.orchestra.run.smithi057.stdout: caps mds = "allow *" 2024-03-27T10:03:14.731 INFO:teuthology.orchestra.run.smithi057.stdout: caps mgr = "allow *" 2024-03-27T10:03:14.731 INFO:teuthology.orchestra.run.smithi057.stdout: caps mon = "allow *" 2024-03-27T10:03:14.731 INFO:teuthology.orchestra.run.smithi057.stdout: caps osd = "allow *" 2024-03-27T10:03:14.733 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:14.745+0000 7f4285600640 1 -- 172.21.15.57:0/251619969 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f426006c530 msgr2=0x7f426006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:03:14.733 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:14.745+0000 7f4285600640 1 --2- 172.21.15.57:0/251619969 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f426006c530 0x7f426006e9f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f426c036000 tx=0x7f426c008030 comp rx=0 tx=0).stop 2024-03-27T10:03:14.734 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:14.745+0000 7f4285600640 1 -- 172.21.15.57:0/251619969 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f428006b750 msgr2=0x7f42800b0110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T10:03:14.734 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:14.745+0000 7f4285600640 1 --2- 172.21.15.57:0/251619969 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f428006b750 0x7f42800b0110 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f427000d620 tx=0x7f427000dae0 comp rx=0 tx=0).stop 2024-03-27T10:03:14.734 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:14.745+0000 7f4285600640 1 -- 172.21.15.57:0/251619969 shutdown_connections 2024-03-27T10:03:14.734 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:14.745+0000 7f4285600640 1 --2- 172.21.15.57:0/251619969 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f426006c530 0x7f426006e9f0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:03:14.734 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:14.745+0000 7f4285600640 1 --2- 172.21.15.57:0/251619969 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f4280145820 0x7f42801e7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:03:14.734 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:14.745+0000 7f4285600640 1 --2- 172.21.15.57:0/251619969 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f42800b2b70 0x7f42801e70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:03:14.734 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:14.745+0000 7f4285600640 1 --2- 172.21.15.57:0/251619969 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f428006b750 0x7f42800b0110 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T10:03:14.734 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:14.745+0000 7f4285600640 1 -- 172.21.15.57:0/251619969 >> 172.21.15.57:0/251619969 conn(0x7f42800b1c60 msgr2=0x7f42800b2040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T10:03:14.734 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:14.745+0000 7f4285600640 1 -- 172.21.15.57:0/251619969 shutdown_connections 2024-03-27T10:03:14.734 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T10:03:14.745+0000 7f4285600640 1 -- 172.21.15.57:0/251619969 wait complete. 2024-03-27T10:03:14.755 DEBUG:teuthology.orchestra.run.smithi057:> mktemp 2024-03-27T10:03:14.794 INFO:teuthology.orchestra.run.smithi057.stdout:/tmp/tmp.3ZFV1ZLbzC 2024-03-27T10:03:14.795 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-03-27T10:03:14.795 DEBUG:teuthology.orchestra.run.smithi057:> dd of=/tmp/tmp.3ZFV1ZLbzC 2024-03-27T10:03:14.876 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-03-27T10:03:14.876 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/tmp/tmp.446sL8UEHrxfstests-dev/local.config 2024-03-27T10:03:14.990 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph-fuse export CEPH_FUSE_BIN_PATH=ceph-fuse export TEST_DEV=ceph-fuse # without this tests won't get started export TEST_DIR=/tmp/tmp.HFg5N66vC0test export SCRATCH_DEV= export SCRATCH_MNT=/tmp/tmp.XGhHhAACBDscratch export CEPHFS_MOUNT_OPTIONS="-m 172.21.15.57:6789 -k /tmp/tmp.3ZFV1ZLbzC --client_mountpoint /test" 2024-03-27T10:03:14.990 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-03-27T10:03:14.990 DEBUG:teuthology.orchestra.run.smithi057:> sudo dd of=/tmp/tmp.446sL8UEHrxfstests-dev/ceph.exclude 2024-03-27T10:03:15.107 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo make) 2024-03-27T10:03:15.228 INFO:teuthology.orchestra.run.smithi057.stdout:libtoolize -cfi 2024-03-27T10:03:15.937 INFO:teuthology.orchestra.run.smithi057.stdout:libtoolize: putting auxiliary files in '.'. 2024-03-27T10:03:15.937 INFO:teuthology.orchestra.run.smithi057.stdout:libtoolize: copying file './config.guess' 2024-03-27T10:03:15.950 INFO:teuthology.orchestra.run.smithi057.stdout:libtoolize: copying file './config.sub' 2024-03-27T10:03:15.963 INFO:teuthology.orchestra.run.smithi057.stdout:libtoolize: copying file './install-sh' 2024-03-27T10:03:15.977 INFO:teuthology.orchestra.run.smithi057.stdout:libtoolize: copying file './ltmain.sh' 2024-03-27T10:03:16.054 INFO:teuthology.orchestra.run.smithi057.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2024-03-27T10:03:16.054 INFO:teuthology.orchestra.run.smithi057.stdout:libtoolize: copying file 'm4/libtool.m4' 2024-03-27T10:03:16.071 INFO:teuthology.orchestra.run.smithi057.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2024-03-27T10:03:16.087 INFO:teuthology.orchestra.run.smithi057.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2024-03-27T10:03:16.107 INFO:teuthology.orchestra.run.smithi057.stdout:libtoolize: copying file 'm4/ltversion.m4' 2024-03-27T10:03:16.126 INFO:teuthology.orchestra.run.smithi057.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2024-03-27T10:03:16.153 INFO:teuthology.orchestra.run.smithi057.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2024-03-27T10:03:16.157 INFO:teuthology.orchestra.run.smithi057.stdout:cp include/install-sh . 2024-03-27T10:03:16.160 INFO:teuthology.orchestra.run.smithi057.stdout:aclocal -I m4 2024-03-27T10:03:17.840 INFO:teuthology.orchestra.run.smithi057.stdout:autoheader 2024-03-27T10:03:18.245 INFO:teuthology.orchestra.run.smithi057.stdout:autoconf 2024-03-27T10:03:18.514 INFO:teuthology.orchestra.run.smithi057.stdout:./configure \ 2024-03-27T10:03:18.514 INFO:teuthology.orchestra.run.smithi057.stdout: --libexecdir=/usr/lib \ 2024-03-27T10:03:18.515 INFO:teuthology.orchestra.run.smithi057.stdout: --exec_prefix=/var/lib 2024-03-27T10:03:18.778 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:03:18.785 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:03:18.989 INFO:teuthology.orchestra.run.smithi057.stdout:checking build system type... x86_64-pc-linux-gnu 2024-03-27T10:03:18.989 INFO:teuthology.orchestra.run.smithi057.stdout:checking host system type... x86_64-pc-linux-gnu 2024-03-27T10:03:18.993 INFO:teuthology.orchestra.run.smithi057.stdout:checking how to print strings... printf 2024-03-27T10:03:18.994 INFO:teuthology.orchestra.run.smithi057.stdout:checking for gcc... gcc 2024-03-27T10:03:19.122 INFO:teuthology.orchestra.run.smithi057.stdout:checking whether the C compiler works... yes 2024-03-27T10:03:19.122 INFO:teuthology.orchestra.run.smithi057.stdout:checking for C compiler default output file name... a.out 2024-03-27T10:03:19.194 INFO:teuthology.orchestra.run.smithi057.stdout:checking for suffix of executables... 2024-03-27T10:03:19.306 INFO:teuthology.orchestra.run.smithi057.stdout:checking whether we are cross compiling... no 2024-03-27T10:03:19.349 INFO:teuthology.orchestra.run.smithi057.stdout:checking for suffix of object files... o 2024-03-27T10:03:19.386 INFO:teuthology.orchestra.run.smithi057.stdout:checking whether we are using the GNU C compiler... yes 2024-03-27T10:03:19.427 INFO:teuthology.orchestra.run.smithi057.stdout:checking whether gcc accepts -g... yes 2024-03-27T10:03:19.483 INFO:teuthology.orchestra.run.smithi057.stdout:checking for gcc option to accept ISO C89... none needed 2024-03-27T10:03:19.493 INFO:teuthology.orchestra.run.smithi057.stdout:checking for a sed that does not truncate output... /bin/sed 2024-03-27T10:03:19.500 INFO:teuthology.orchestra.run.smithi057.stdout:checking for grep that handles long lines and -e... /bin/grep 2024-03-27T10:03:19.504 INFO:teuthology.orchestra.run.smithi057.stdout:checking for egrep... /bin/grep -E 2024-03-27T10:03:19.507 INFO:teuthology.orchestra.run.smithi057.stdout:checking for fgrep... /bin/grep -F 2024-03-27T10:03:19.518 INFO:teuthology.orchestra.run.smithi057.stdout:checking for ld used by gcc... /bin/ld 2024-03-27T10:03:19.523 INFO:teuthology.orchestra.run.smithi057.stdout:checking if the linker (/bin/ld) is GNU ld... yes 2024-03-27T10:03:19.531 INFO:teuthology.orchestra.run.smithi057.stdout:checking for BSD- or MS-compatible name lister (nm)... /bin/nm -B 2024-03-27T10:03:20.538 INFO:teuthology.orchestra.run.smithi057.stdout:checking the name lister (/bin/nm -B) interface... BSD nm 2024-03-27T10:03:20.539 INFO:teuthology.orchestra.run.smithi057.stdout:checking whether ln -s works... yes 2024-03-27T10:03:20.559 INFO:teuthology.orchestra.run.smithi057.stdout:checking the maximum length of command line arguments... 1572864 2024-03-27T10:03:20.569 INFO:teuthology.orchestra.run.smithi057.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2024-03-27T10:03:20.569 INFO:teuthology.orchestra.run.smithi057.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2024-03-27T10:03:20.569 INFO:teuthology.orchestra.run.smithi057.stdout:checking for /bin/ld option to reload object files... -r 2024-03-27T10:03:20.569 INFO:teuthology.orchestra.run.smithi057.stdout:checking for objdump... objdump 2024-03-27T10:03:20.569 INFO:teuthology.orchestra.run.smithi057.stdout:checking how to recognize dependent libraries... pass_all 2024-03-27T10:03:20.571 INFO:teuthology.orchestra.run.smithi057.stdout:checking for dlltool... no 2024-03-27T10:03:20.571 INFO:teuthology.orchestra.run.smithi057.stdout:checking how to associate runtime and link libraries... printf %s\n 2024-03-27T10:03:20.571 INFO:teuthology.orchestra.run.smithi057.stdout:checking for ar... ar 2024-03-27T10:03:20.664 INFO:teuthology.orchestra.run.smithi057.stdout:checking for archiver @FILE support... @ 2024-03-27T10:03:20.664 INFO:teuthology.orchestra.run.smithi057.stdout:checking for strip... strip 2024-03-27T10:03:20.665 INFO:teuthology.orchestra.run.smithi057.stdout:checking for ranlib... ranlib 2024-03-27T10:03:20.665 INFO:teuthology.orchestra.run.smithi057.stdout:checking for gawk... gawk 2024-03-27T10:03:20.816 INFO:teuthology.orchestra.run.smithi057.stdout:checking command to parse /bin/nm -B output from gcc object... ok 2024-03-27T10:03:20.820 INFO:teuthology.orchestra.run.smithi057.stdout:checking for sysroot... no 2024-03-27T10:03:20.829 INFO:teuthology.orchestra.run.smithi057.stdout:checking for a working dd... /bin/dd 2024-03-27T10:03:20.838 INFO:teuthology.orchestra.run.smithi057.stdout:checking how to truncate binary pipes... /bin/dd bs=4096 count=1 2024-03-27T10:03:20.874 INFO:teuthology.orchestra.run.smithi057.stdout:checking for mt... no 2024-03-27T10:03:20.881 INFO:teuthology.orchestra.run.smithi057.stdout:checking if : is a manifest tool... no 2024-03-27T10:03:20.973 INFO:teuthology.orchestra.run.smithi057.stdout:checking how to run the C preprocessor... gcc -E 2024-03-27T10:03:21.335 INFO:teuthology.orchestra.run.smithi057.stdout:checking for ANSI C header files... yes 2024-03-27T10:03:21.387 INFO:teuthology.orchestra.run.smithi057.stdout:checking for sys/types.h... yes 2024-03-27T10:03:21.465 INFO:teuthology.orchestra.run.smithi057.stdout:checking for sys/stat.h... yes 2024-03-27T10:03:21.534 INFO:teuthology.orchestra.run.smithi057.stdout:checking for stdlib.h... yes 2024-03-27T10:03:21.600 INFO:teuthology.orchestra.run.smithi057.stdout:checking for string.h... yes 2024-03-27T10:03:21.681 INFO:teuthology.orchestra.run.smithi057.stdout:checking for memory.h... yes 2024-03-27T10:03:21.747 INFO:teuthology.orchestra.run.smithi057.stdout:checking for strings.h... yes 2024-03-27T10:03:21.815 INFO:teuthology.orchestra.run.smithi057.stdout:checking for inttypes.h... yes 2024-03-27T10:03:21.888 INFO:teuthology.orchestra.run.smithi057.stdout:checking for stdint.h... yes 2024-03-27T10:03:21.962 INFO:teuthology.orchestra.run.smithi057.stdout:checking for unistd.h... yes 2024-03-27T10:03:22.043 INFO:teuthology.orchestra.run.smithi057.stdout:checking for dlfcn.h... yes 2024-03-27T10:03:22.057 INFO:teuthology.orchestra.run.smithi057.stdout:checking for objdir... .libs 2024-03-27T10:03:22.248 INFO:teuthology.orchestra.run.smithi057.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2024-03-27T10:03:22.248 INFO:teuthology.orchestra.run.smithi057.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2024-03-27T10:03:22.307 INFO:teuthology.orchestra.run.smithi057.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2024-03-27T10:03:22.357 INFO:teuthology.orchestra.run.smithi057.stdout:checking if gcc static flag -static works... no 2024-03-27T10:03:22.436 INFO:teuthology.orchestra.run.smithi057.stdout:checking if gcc supports -c -o file.o... yes 2024-03-27T10:03:22.436 INFO:teuthology.orchestra.run.smithi057.stdout:checking if gcc supports -c -o file.o... (cached) yes 2024-03-27T10:03:22.463 INFO:teuthology.orchestra.run.smithi057.stdout:checking whether the gcc linker (/bin/ld -m elf_x86_64) supports shared libraries... yes 2024-03-27T10:03:22.539 INFO:teuthology.orchestra.run.smithi057.stdout:checking whether -lc should be explicitly linked in... no 2024-03-27T10:03:22.688 INFO:teuthology.orchestra.run.smithi057.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2024-03-27T10:03:22.688 INFO:teuthology.orchestra.run.smithi057.stdout:checking how to hardcode library paths into programs... immediate 2024-03-27T10:03:22.694 INFO:teuthology.orchestra.run.smithi057.stdout:checking whether stripping libraries is possible... yes 2024-03-27T10:03:22.694 INFO:teuthology.orchestra.run.smithi057.stdout:checking if libtool supports shared libraries... yes 2024-03-27T10:03:22.694 INFO:teuthology.orchestra.run.smithi057.stdout:checking whether to build shared libraries... yes 2024-03-27T10:03:22.695 INFO:teuthology.orchestra.run.smithi057.stdout:checking whether to build static libraries... yes 2024-03-27T10:03:22.723 INFO:teuthology.orchestra.run.smithi057.stdout:checking for gcc... (cached) gcc 2024-03-27T10:03:22.784 INFO:teuthology.orchestra.run.smithi057.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-03-27T10:03:22.784 INFO:teuthology.orchestra.run.smithi057.stdout:checking whether gcc accepts -g... (cached) yes 2024-03-27T10:03:22.785 INFO:teuthology.orchestra.run.smithi057.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-03-27T10:03:22.785 INFO:teuthology.orchestra.run.smithi057.stdout:checking for gmake... /usr/bin/gmake 2024-03-27T10:03:22.786 INFO:teuthology.orchestra.run.smithi057.stderr:./configure: line 12082: test: $(SHELL): binary operator expected 2024-03-27T10:03:22.786 INFO:teuthology.orchestra.run.smithi057.stdout:checking for tar... /bin/tar 2024-03-27T10:03:22.786 INFO:teuthology.orchestra.run.smithi057.stdout:checking for gzip... /bin/gzip 2024-03-27T10:03:22.814 INFO:teuthology.orchestra.run.smithi057.stdout:checking whether gcc -MM is supported... yes 2024-03-27T10:03:22.815 INFO:teuthology.orchestra.run.smithi057.stdout:checking for sort... /bin/sort 2024-03-27T10:03:22.816 INFO:teuthology.orchestra.run.smithi057.stdout:checking whether ln -s works... yes 2024-03-27T10:03:22.816 INFO:teuthology.orchestra.run.smithi057.stdout:checking for rpm... /bin/rpm 2024-03-27T10:03:22.828 INFO:teuthology.orchestra.run.smithi057.stdout:checking for rpmbuild... no 2024-03-27T10:03:22.897 INFO:teuthology.orchestra.run.smithi057.stdout:checking assert.h usability... yes 2024-03-27T10:03:22.925 INFO:teuthology.orchestra.run.smithi057.stdout:checking assert.h presence... yes 2024-03-27T10:03:22.925 INFO:teuthology.orchestra.run.smithi057.stdout:checking for assert.h... yes 2024-03-27T10:03:22.998 INFO:teuthology.orchestra.run.smithi057.stdout:checking bstring.h usability... no 2024-03-27T10:03:23.039 INFO:teuthology.orchestra.run.smithi057.stdout:checking bstring.h presence... no 2024-03-27T10:03:23.039 INFO:teuthology.orchestra.run.smithi057.stdout:checking for bstring.h... no 2024-03-27T10:03:23.128 INFO:teuthology.orchestra.run.smithi057.stdout:checking libgen.h usability... yes 2024-03-27T10:03:23.155 INFO:teuthology.orchestra.run.smithi057.stdout:checking libgen.h presence... yes 2024-03-27T10:03:23.155 INFO:teuthology.orchestra.run.smithi057.stdout:checking for libgen.h... yes 2024-03-27T10:03:23.257 INFO:teuthology.orchestra.run.smithi057.stdout:checking dirent.h usability... yes 2024-03-27T10:03:23.287 INFO:teuthology.orchestra.run.smithi057.stdout:checking dirent.h presence... yes 2024-03-27T10:03:23.287 INFO:teuthology.orchestra.run.smithi057.stdout:checking for dirent.h... yes 2024-03-27T10:03:23.381 INFO:teuthology.orchestra.run.smithi057.stdout:checking errno.h usability... yes 2024-03-27T10:03:23.408 INFO:teuthology.orchestra.run.smithi057.stdout:checking errno.h presence... yes 2024-03-27T10:03:23.408 INFO:teuthology.orchestra.run.smithi057.stdout:checking for errno.h... yes 2024-03-27T10:03:23.494 INFO:teuthology.orchestra.run.smithi057.stdout:checking malloc.h usability... yes 2024-03-27T10:03:23.525 INFO:teuthology.orchestra.run.smithi057.stdout:checking malloc.h presence... yes 2024-03-27T10:03:23.525 INFO:teuthology.orchestra.run.smithi057.stdout:checking for malloc.h... yes 2024-03-27T10:03:23.608 INFO:teuthology.orchestra.run.smithi057.stdout:checking uuid.h usability... no 2024-03-27T10:03:23.647 INFO:teuthology.orchestra.run.smithi057.stdout:checking uuid.h presence... no 2024-03-27T10:03:23.647 INFO:teuthology.orchestra.run.smithi057.stdout:checking for uuid.h... no 2024-03-27T10:03:23.721 INFO:teuthology.orchestra.run.smithi057.stdout:checking uuid/uuid.h usability... yes 2024-03-27T10:03:23.752 INFO:teuthology.orchestra.run.smithi057.stdout:checking uuid/uuid.h presence... yes 2024-03-27T10:03:23.752 INFO:teuthology.orchestra.run.smithi057.stdout:checking for uuid/uuid.h... yes 2024-03-27T10:03:23.840 INFO:teuthology.orchestra.run.smithi057.stdout:checking sys/uuid.h usability... no 2024-03-27T10:03:23.894 INFO:teuthology.orchestra.run.smithi057.stdout:checking sys/uuid.h presence... no 2024-03-27T10:03:23.894 INFO:teuthology.orchestra.run.smithi057.stdout:checking for sys/uuid.h... no 2024-03-27T10:03:23.971 INFO:teuthology.orchestra.run.smithi057.stdout:checking sys/file.h usability... yes 2024-03-27T10:03:24.001 INFO:teuthology.orchestra.run.smithi057.stdout:checking sys/file.h presence... yes 2024-03-27T10:03:24.001 INFO:teuthology.orchestra.run.smithi057.stdout:checking for sys/file.h... yes 2024-03-27T10:03:24.080 INFO:teuthology.orchestra.run.smithi057.stdout:checking sys/fcntl.h usability... yes 2024-03-27T10:03:24.103 INFO:teuthology.orchestra.run.smithi057.stdout:checking sys/fcntl.h presence... yes 2024-03-27T10:03:24.103 INFO:teuthology.orchestra.run.smithi057.stdout:checking for sys/fcntl.h... yes 2024-03-27T10:03:24.177 INFO:teuthology.orchestra.run.smithi057.stdout:checking sys/syssgi.h usability... no 2024-03-27T10:03:24.211 INFO:teuthology.orchestra.run.smithi057.stdout:checking sys/syssgi.h presence... no 2024-03-27T10:03:24.211 INFO:teuthology.orchestra.run.smithi057.stdout:checking for sys/syssgi.h... no 2024-03-27T10:03:24.293 INFO:teuthology.orchestra.run.smithi057.stdout:checking sys/param.h usability... yes 2024-03-27T10:03:24.329 INFO:teuthology.orchestra.run.smithi057.stdout:checking sys/param.h presence... yes 2024-03-27T10:03:24.329 INFO:teuthology.orchestra.run.smithi057.stdout:checking for sys/param.h... yes 2024-03-27T10:03:24.345 INFO:teuthology.orchestra.run.smithi057.stdout:checking for sys/stat.h... (cached) yes 2024-03-27T10:03:24.418 INFO:teuthology.orchestra.run.smithi057.stdout:checking sys/statvfs.h usability... yes 2024-03-27T10:03:24.446 INFO:teuthology.orchestra.run.smithi057.stdout:checking sys/statvfs.h presence... yes 2024-03-27T10:03:24.446 INFO:teuthology.orchestra.run.smithi057.stdout:checking for sys/statvfs.h... yes 2024-03-27T10:03:24.517 INFO:teuthology.orchestra.run.smithi057.stdout:checking sys/time.h usability... yes 2024-03-27T10:03:24.547 INFO:teuthology.orchestra.run.smithi057.stdout:checking sys/time.h presence... yes 2024-03-27T10:03:24.548 INFO:teuthology.orchestra.run.smithi057.stdout:checking for sys/time.h... yes 2024-03-27T10:03:24.637 INFO:teuthology.orchestra.run.smithi057.stdout:checking sys/ioctl.h usability... yes 2024-03-27T10:03:24.663 INFO:teuthology.orchestra.run.smithi057.stdout:checking sys/ioctl.h presence... yes 2024-03-27T10:03:24.663 INFO:teuthology.orchestra.run.smithi057.stdout:checking for sys/ioctl.h... yes 2024-03-27T10:03:24.743 INFO:teuthology.orchestra.run.smithi057.stdout:checking sys/wait.h usability... yes 2024-03-27T10:03:24.774 INFO:teuthology.orchestra.run.smithi057.stdout:checking sys/wait.h presence... yes 2024-03-27T10:03:24.774 INFO:teuthology.orchestra.run.smithi057.stdout:checking for sys/wait.h... yes 2024-03-27T10:03:24.793 INFO:teuthology.orchestra.run.smithi057.stdout:checking for sys/types.h... (cached) yes 2024-03-27T10:03:24.809 INFO:teuthology.orchestra.run.smithi057.stdout:checking for strings.h... (cached) yes 2024-03-27T10:03:24.875 INFO:teuthology.orchestra.run.smithi057.stdout:checking err.h usability... yes 2024-03-27T10:03:24.901 INFO:teuthology.orchestra.run.smithi057.stdout:checking err.h presence... yes 2024-03-27T10:03:24.901 INFO:teuthology.orchestra.run.smithi057.stdout:checking for err.h... yes 2024-03-27T10:03:24.972 INFO:teuthology.orchestra.run.smithi057.stdout:checking linux/falloc.h usability... yes 2024-03-27T10:03:24.999 INFO:teuthology.orchestra.run.smithi057.stdout:checking linux/falloc.h presence... yes 2024-03-27T10:03:24.999 INFO:teuthology.orchestra.run.smithi057.stdout:checking for linux/falloc.h... yes 2024-03-27T10:03:25.077 INFO:teuthology.orchestra.run.smithi057.stdout:checking sys/fs/xfs_fsops.h usability... no 2024-03-27T10:03:25.118 INFO:teuthology.orchestra.run.smithi057.stdout:checking sys/fs/xfs_fsops.h presence... no 2024-03-27T10:03:25.118 INFO:teuthology.orchestra.run.smithi057.stdout:checking for sys/fs/xfs_fsops.h... no 2024-03-27T10:03:25.193 INFO:teuthology.orchestra.run.smithi057.stdout:checking sys/fs/xfs_itable.h usability... no 2024-03-27T10:03:25.237 INFO:teuthology.orchestra.run.smithi057.stdout:checking sys/fs/xfs_itable.h presence... no 2024-03-27T10:03:25.237 INFO:teuthology.orchestra.run.smithi057.stdout:checking for sys/fs/xfs_itable.h... no 2024-03-27T10:03:25.307 INFO:teuthology.orchestra.run.smithi057.stdout:checking xfs/platform_defs.h usability... no 2024-03-27T10:03:25.345 INFO:teuthology.orchestra.run.smithi057.stdout:checking xfs/platform_defs.h presence... no 2024-03-27T10:03:25.345 INFO:teuthology.orchestra.run.smithi057.stdout:checking for xfs/platform_defs.h... no 2024-03-27T10:03:25.413 INFO:teuthology.orchestra.run.smithi057.stdout:checking btrfs/ioctl.h usability... no 2024-03-27T10:03:25.448 INFO:teuthology.orchestra.run.smithi057.stdout:checking btrfs/ioctl.h presence... no 2024-03-27T10:03:25.448 INFO:teuthology.orchestra.run.smithi057.stdout:checking for btrfs/ioctl.h... no 2024-03-27T10:03:25.510 INFO:teuthology.orchestra.run.smithi057.stdout:checking cifs/ioctl.h usability... no 2024-03-27T10:03:25.551 INFO:teuthology.orchestra.run.smithi057.stdout:checking cifs/ioctl.h presence... no 2024-03-27T10:03:25.551 INFO:teuthology.orchestra.run.smithi057.stdout:checking for cifs/ioctl.h... no 2024-03-27T10:03:25.626 INFO:teuthology.orchestra.run.smithi057.stdout:checking sys/mman.h usability... yes 2024-03-27T10:03:25.655 INFO:teuthology.orchestra.run.smithi057.stdout:checking sys/mman.h presence... yes 2024-03-27T10:03:25.655 INFO:teuthology.orchestra.run.smithi057.stdout:checking for sys/mman.h... yes 2024-03-27T10:03:25.704 INFO:teuthology.orchestra.run.smithi057.stdout:checking for xfs/xfs_log_format.h... no 2024-03-27T10:03:25.794 INFO:teuthology.orchestra.run.smithi057.stdout:checking for uuid_compare... no 2024-03-27T10:03:25.868 INFO:teuthology.orchestra.run.smithi057.stdout:checking for uuid_compare in -luuid... yes 2024-03-27T10:03:26.005 INFO:teuthology.orchestra.run.smithi057.stdout:checking for xfs/xfs.h... yes 2024-03-27T10:03:26.055 INFO:teuthology.orchestra.run.smithi057.stdout:checking for xfs/libxfs.h... no 2024-03-27T10:03:26.113 INFO:teuthology.orchestra.run.smithi057.stdout:checking whether xlog_assign_lsn is declared... no 2024-03-27T10:03:26.182 INFO:teuthology.orchestra.run.smithi057.stdout:checking for xfs/xqm.h... yes 2024-03-27T10:03:26.299 INFO:teuthology.orchestra.run.smithi057.stdout:checking xfsctl from xfs/xfs.h... ok 2024-03-27T10:03:26.366 INFO:teuthology.orchestra.run.smithi057.stdout:checking xfs/handle.h usability... yes 2024-03-27T10:03:26.391 INFO:teuthology.orchestra.run.smithi057.stdout:checking xfs/handle.h presence... yes 2024-03-27T10:03:26.391 INFO:teuthology.orchestra.run.smithi057.stdout:checking for xfs/handle.h... yes 2024-03-27T10:03:26.472 INFO:teuthology.orchestra.run.smithi057.stdout:checking for attr_list_by_handle in -lhandle... yes 2024-03-27T10:03:26.538 INFO:teuthology.orchestra.run.smithi057.stdout:checking sys/acl.h usability... yes 2024-03-27T10:03:26.569 INFO:teuthology.orchestra.run.smithi057.stdout:checking sys/acl.h presence... yes 2024-03-27T10:03:26.570 INFO:teuthology.orchestra.run.smithi057.stdout:checking for sys/acl.h... yes 2024-03-27T10:03:26.630 INFO:teuthology.orchestra.run.smithi057.stdout:checking acl/libacl.h usability... yes 2024-03-27T10:03:26.659 INFO:teuthology.orchestra.run.smithi057.stdout:checking acl/libacl.h presence... yes 2024-03-27T10:03:26.660 INFO:teuthology.orchestra.run.smithi057.stdout:checking for acl/libacl.h... yes 2024-03-27T10:03:26.739 INFO:teuthology.orchestra.run.smithi057.stdout:checking for acl_init in -lacl... yes 2024-03-27T10:03:26.803 INFO:teuthology.orchestra.run.smithi057.stdout:checking gdbm-ndbm.h usability... no 2024-03-27T10:03:26.841 INFO:teuthology.orchestra.run.smithi057.stdout:checking gdbm-ndbm.h presence... no 2024-03-27T10:03:26.842 INFO:teuthology.orchestra.run.smithi057.stdout:checking for gdbm-ndbm.h... no 2024-03-27T10:03:26.899 INFO:teuthology.orchestra.run.smithi057.stdout:checking gdbm/ndbm.h usability... yes 2024-03-27T10:03:26.925 INFO:teuthology.orchestra.run.smithi057.stdout:checking gdbm/ndbm.h presence... yes 2024-03-27T10:03:26.925 INFO:teuthology.orchestra.run.smithi057.stdout:checking for gdbm/ndbm.h... yes 2024-03-27T10:03:27.016 INFO:teuthology.orchestra.run.smithi057.stdout:checking for dbm_open in -lgdbm... no 2024-03-27T10:03:27.110 INFO:teuthology.orchestra.run.smithi057.stdout:checking for dbm_fetch in -lgdbm... no 2024-03-27T10:03:27.207 INFO:teuthology.orchestra.run.smithi057.stdout:checking for dbm_store in -lgdbm... no 2024-03-27T10:03:27.308 INFO:teuthology.orchestra.run.smithi057.stdout:checking for dbm_close in -lgdbm... no 2024-03-27T10:03:27.412 INFO:teuthology.orchestra.run.smithi057.stdout:checking for dbm_open in -lgdbm_compat... yes 2024-03-27T10:03:27.494 INFO:teuthology.orchestra.run.smithi057.stdout:checking for dbm_fetch in -lgdbm_compat... yes 2024-03-27T10:03:27.569 INFO:teuthology.orchestra.run.smithi057.stdout:checking for dbm_store in -lgdbm_compat... yes 2024-03-27T10:03:27.652 INFO:teuthology.orchestra.run.smithi057.stdout:checking for dbm_close in -lgdbm_compat... yes 2024-03-27T10:03:27.710 INFO:teuthology.orchestra.run.smithi057.stdout:checking libaio.h usability... yes 2024-03-27T10:03:27.737 INFO:teuthology.orchestra.run.smithi057.stdout:checking libaio.h presence... yes 2024-03-27T10:03:27.737 INFO:teuthology.orchestra.run.smithi057.stdout:checking for libaio.h... yes 2024-03-27T10:03:27.795 INFO:teuthology.orchestra.run.smithi057.stdout:checking liburing.h usability... no 2024-03-27T10:03:27.832 INFO:teuthology.orchestra.run.smithi057.stdout:checking liburing.h presence... no 2024-03-27T10:03:27.833 INFO:teuthology.orchestra.run.smithi057.stdout:checking for liburing.h... no 2024-03-27T10:03:27.899 INFO:teuthology.orchestra.run.smithi057.stdout:checking sys/capability.h usability... yes 2024-03-27T10:03:27.933 INFO:teuthology.orchestra.run.smithi057.stdout:checking sys/capability.h presence... yes 2024-03-27T10:03:27.933 INFO:teuthology.orchestra.run.smithi057.stdout:checking for sys/capability.h... yes 2024-03-27T10:03:27.990 INFO:teuthology.orchestra.run.smithi057.stdout:checking linux/fiemap.h usability... yes 2024-03-27T10:03:28.011 INFO:teuthology.orchestra.run.smithi057.stdout:checking linux/fiemap.h presence... yes 2024-03-27T10:03:28.011 INFO:teuthology.orchestra.run.smithi057.stdout:checking for linux/fiemap.h... yes 2024-03-27T10:03:28.088 INFO:teuthology.orchestra.run.smithi057.stdout:checking for fallocate... yes 2024-03-27T10:03:28.180 INFO:teuthology.orchestra.run.smithi057.stdout:checking for open_by_handle_at... yes 2024-03-27T10:03:28.247 INFO:teuthology.orchestra.run.smithi057.stdout:checking linux/fs.h usability... yes 2024-03-27T10:03:28.278 INFO:teuthology.orchestra.run.smithi057.stdout:checking linux/fs.h presence... yes 2024-03-27T10:03:28.278 INFO:teuthology.orchestra.run.smithi057.stdout:checking for linux/fs.h... yes 2024-03-27T10:03:28.338 INFO:teuthology.orchestra.run.smithi057.stdout:checking btrfsutil.h usability... no 2024-03-27T10:03:28.376 INFO:teuthology.orchestra.run.smithi057.stdout:checking btrfsutil.h presence... no 2024-03-27T10:03:28.377 INFO:teuthology.orchestra.run.smithi057.stdout:checking for btrfsutil.h... no 2024-03-27T10:03:28.474 INFO:teuthology.orchestra.run.smithi057.stdout:checking for copy_file_range... yes 2024-03-27T10:03:28.566 INFO:teuthology.orchestra.run.smithi057.stdout:checking for SEEK_DATA... yes 2024-03-27T10:03:28.721 INFO:teuthology.orchestra.run.smithi057.stdout:checking for BMV_OF_SHARED... yes 2024-03-27T10:03:28.807 INFO:teuthology.orchestra.run.smithi057.stdout:checking for nftw... yes 2024-03-27T10:03:28.903 INFO:teuthology.orchestra.run.smithi057.stdout:checking for RLIMIT_NOFILE... yes 2024-03-27T10:03:28.982 INFO:teuthology.orchestra.run.smithi057.stdout:checking for XFS_IOC_EXCHANGE_RANGE... no 2024-03-27T10:03:29.068 INFO:teuthology.orchestra.run.smithi057.stdout:checking for FICLONE... yes 2024-03-27T10:03:29.158 INFO:teuthology.orchestra.run.smithi057.stdout:checking for renameat2... yes 2024-03-27T10:03:29.236 INFO:teuthology.orchestra.run.smithi057.stdout:checking for reallocarray... yes 2024-03-27T10:03:29.333 INFO:teuthology.orchestra.run.smithi057.stdout:checking for struct mount_attr... yes 2024-03-27T10:03:29.447 INFO:teuthology.orchestra.run.smithi057.stdout:checking for struct btrfs_qgroup_limit... yes 2024-03-27T10:03:29.563 INFO:teuthology.orchestra.run.smithi057.stdout:checking for struct btrfs_qgroup_inherit... yes 2024-03-27T10:03:29.685 INFO:teuthology.orchestra.run.smithi057.stdout:checking for struct btrfs_ioctl_vol_args... yes 2024-03-27T10:03:29.785 INFO:teuthology.orchestra.run.smithi057.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2024-03-27T10:03:29.880 INFO:teuthology.orchestra.run.smithi057.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2024-03-27T10:03:29.990 INFO:teuthology.orchestra.run.smithi057.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2024-03-27T10:03:30.104 INFO:teuthology.orchestra.run.smithi057.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2024-03-27T10:03:30.182 INFO:teuthology.orchestra.run.smithi057.stdout:checking linux/btrfs.h usability... yes 2024-03-27T10:03:30.210 INFO:teuthology.orchestra.run.smithi057.stdout:checking linux/btrfs.h presence... yes 2024-03-27T10:03:30.210 INFO:teuthology.orchestra.run.smithi057.stdout:checking for linux/btrfs.h... yes 2024-03-27T10:03:30.287 INFO:teuthology.orchestra.run.smithi057.stdout:checking linux/btrfs_tree.h usability... yes 2024-03-27T10:03:30.324 INFO:teuthology.orchestra.run.smithi057.stdout:checking linux/btrfs_tree.h presence... yes 2024-03-27T10:03:30.325 INFO:teuthology.orchestra.run.smithi057.stdout:checking for linux/btrfs_tree.h... yes 2024-03-27T10:03:30.381 INFO:teuthology.orchestra.run.smithi057.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... yes 2024-03-27T10:03:30.449 INFO:teuthology.orchestra.run.smithi057.stdout:checking whether BTRFS_IOC_SNAP_DESTROY_V2 is declared... yes 2024-03-27T10:03:30.489 INFO:teuthology.orchestra.run.smithi057.stdout:configure: creating ./config.status 2024-03-27T10:03:31.734 INFO:teuthology.orchestra.run.smithi057.stdout:config.status: creating include/builddefs 2024-03-27T10:03:31.771 INFO:teuthology.orchestra.run.smithi057.stdout:config.status: creating include/config.h 2024-03-27T10:03:31.799 INFO:teuthology.orchestra.run.smithi057.stdout:config.status: executing libtool commands 2024-03-27T10:03:31.907 INFO:teuthology.orchestra.run.smithi057.stdout:Building include 2024-03-27T10:03:31.918 INFO:teuthology.orchestra.run.smithi057.stdout:Building lib 2024-03-27T10:03:31.927 INFO:teuthology.orchestra.run.smithi057.stdout: [LTDEP] 2024-03-27T10:03:32.343 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] dataascii.lo 2024-03-27T10:03:32.650 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] databin.lo 2024-03-27T10:03:32.941 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] datapid.lo 2024-03-27T10:03:33.198 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] file_lock.lo 2024-03-27T10:03:33.498 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] forker.lo 2024-03-27T10:03:33.754 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] pattern.lo 2024-03-27T10:03:33.996 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] open_flags.lo 2024-03-27T10:03:34.262 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] random_range.lo 2024-03-27T10:03:34.663 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] string_to_tokens.lo 2024-03-27T10:03:34.898 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] str_to_bytes.lo 2024-03-27T10:03:35.165 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] tlibio.lo 2024-03-27T10:03:35.568 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] write_log.lo 2024-03-27T10:03:35.988 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] random.lo 2024-03-27T10:03:36.225 INFO:teuthology.orchestra.run.smithi057.stdout: [LD] 2024-03-27T10:03:36.438 INFO:teuthology.orchestra.run.smithi057.stdout:Building ltp 2024-03-27T10:03:36.447 INFO:teuthology.orchestra.run.smithi057.stdout: [DEP] 2024-03-27T10:03:36.764 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] doio 2024-03-27T10:03:37.678 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] fsstress 2024-03-27T10:03:39.484 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] fsx 2024-03-27T10:03:40.419 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] growfiles 2024-03-27T10:03:41.081 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] iogen 2024-03-27T10:03:41.689 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] aio-stress 2024-03-27T10:03:42.373 INFO:teuthology.orchestra.run.smithi057.stdout:Building src 2024-03-27T10:03:42.390 INFO:teuthology.orchestra.run.smithi057.stdout: [DEP] 2024-03-27T10:03:46.476 INFO:teuthology.orchestra.run.smithi057.stdout: [DEP] 2024-03-27T10:03:46.546 INFO:teuthology.orchestra.run.smithi057.stdout: [DEP] 2024-03-27T10:03:46.565 INFO:teuthology.orchestra.run.smithi057.stdout: [DEP] 2024-03-27T10:03:47.082 INFO:teuthology.orchestra.run.smithi057.stdout: [DEP] 2024-03-27T10:03:47.141 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] dirstress 2024-03-27T10:03:47.573 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] fill 2024-03-27T10:03:47.886 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] fill2 2024-03-27T10:03:48.317 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] getpagesize 2024-03-27T10:03:48.619 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] holes 2024-03-27T10:03:48.915 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:03:48.923 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:03:48.962 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] lstat64 2024-03-27T10:03:49.304 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] nametest 2024-03-27T10:03:49.691 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] permname 2024-03-27T10:03:50.033 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] randholes 2024-03-27T10:03:50.459 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] runas 2024-03-27T10:03:50.771 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] truncfile 2024-03-27T10:03:51.081 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] usemem 2024-03-27T10:03:51.340 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] mmapcat 2024-03-27T10:03:51.646 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] append_reader 2024-03-27T10:03:51.938 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] append_writer 2024-03-27T10:03:52.254 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] dirperf 2024-03-27T10:03:52.634 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] metaperf 2024-03-27T10:03:53.176 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] devzero 2024-03-27T10:03:53.556 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] feature 2024-03-27T10:03:53.926 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] alloc 2024-03-27T10:03:54.303 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] fault 2024-03-27T10:03:54.627 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] fstest 2024-03-27T10:03:55.074 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] t_access_root 2024-03-27T10:03:55.363 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] godown 2024-03-27T10:03:55.730 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] resvtest 2024-03-27T10:03:56.068 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] writemod 2024-03-27T10:03:56.420 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] writev_on_pagefault 2024-03-27T10:03:56.749 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] makeextents 2024-03-27T10:03:57.088 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] itrash 2024-03-27T10:03:57.417 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] rename 2024-03-27T10:03:57.709 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] multi_open_unlink 2024-03-27T10:03:58.036 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] unwritten_sync 2024-03-27T10:03:58.432 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] genhashnames 2024-03-27T10:03:58.771 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] t_holes 2024-03-27T10:03:59.074 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] t_mmap_writev 2024-03-27T10:03:59.402 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] t_truncate_cmtime 2024-03-27T10:03:59.725 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] dirhash_collide 2024-03-27T10:04:00.095 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] t_rename_overwrite 2024-03-27T10:04:00.381 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] holetest 2024-03-27T10:04:00.750 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] t_truncate_self 2024-03-27T10:04:01.058 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] af_unix 2024-03-27T10:04:01.371 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] t_mmap_stale_pmd 2024-03-27T10:04:01.660 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] t_mmap_cow_race 2024-03-27T10:04:01.974 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] t_mmap_fallocate 2024-03-27T10:04:02.269 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] fsync-err 2024-03-27T10:04:02.620 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] t_mmap_write_ro 2024-03-27T10:04:02.919 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] t_ext4_dax_journal_corruption 2024-03-27T10:04:03.235 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] t_ext4_dax_inline_corruption 2024-03-27T10:04:03.523 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] t_ofd_locks 2024-03-27T10:04:03.895 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] t_mmap_collision 2024-03-27T10:04:04.249 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] mmap-write-concurrent 2024-03-27T10:04:04.584 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] t_get_file_time 2024-03-27T10:04:04.863 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] t_create_short_dirs 2024-03-27T10:04:05.181 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] t_create_long_dirs 2024-03-27T10:04:05.541 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] t_enospc 2024-03-27T10:04:05.904 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] t_mmap_writev_overlap 2024-03-27T10:04:06.356 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] checkpoint_journal 2024-03-27T10:04:06.656 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] mmap-rw-fault 2024-03-27T10:04:07.027 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] allocstale 2024-03-27T10:04:07.351 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] t_mmap_cow_memory_failure 2024-03-27T10:04:07.669 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] fake-dump-rootino 2024-03-27T10:04:07.984 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] dio-buf-fault 2024-03-27T10:04:08.281 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] rewinddir-test 2024-03-27T10:04:08.614 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] readdir-while-renames 2024-03-27T10:04:08.940 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] xfsctl 2024-03-27T10:04:09.288 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] bstat 2024-03-27T10:04:09.680 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] t_mtab 2024-03-27T10:04:10.027 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] getdevicesize 2024-03-27T10:04:10.297 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] preallo_rw_pattern_reader 2024-03-27T10:04:10.599 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] preallo_rw_pattern_writer 2024-03-27T10:04:10.929 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] ftrunc 2024-03-27T10:04:11.270 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] trunc 2024-03-27T10:04:11.608 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] fs_perms 2024-03-27T10:04:11.927 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] testx 2024-03-27T10:04:12.247 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] looptest 2024-03-27T10:04:12.636 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] locktest 2024-03-27T10:04:13.161 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] unwritten_mmap 2024-03-27T10:04:13.532 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] bulkstat_unlink_test 2024-03-27T10:04:13.902 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] deduperace 2024-03-27T10:04:14.255 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] bulkstat_unlink_test_modified 2024-03-27T10:04:14.613 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] t_dir_offset 2024-03-27T10:04:14.930 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] t_futimens 2024-03-27T10:04:15.231 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] t_immutable 2024-03-27T10:04:16.051 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] stale_handle 2024-03-27T10:04:16.391 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] pwrite_mmap_blocked 2024-03-27T10:04:16.671 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] t_dir_offset2 2024-03-27T10:04:17.030 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] seek_sanity_test 2024-03-27T10:04:17.760 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] seek_copy_test 2024-03-27T10:04:18.138 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] t_readdir_1 2024-03-27T10:04:18.437 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] t_readdir_2 2024-03-27T10:04:18.746 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] fsync-tester 2024-03-27T10:04:19.044 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:04:19.052 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:04:19.197 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] nsexec 2024-03-27T10:04:19.541 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] cloner 2024-03-27T10:04:19.875 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] renameat2 2024-03-27T10:04:20.230 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] t_getcwd 2024-03-27T10:04:20.567 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] e4compact 2024-03-27T10:04:20.916 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] test-nextquota 2024-03-27T10:04:21.272 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] punch-alternating 2024-03-27T10:04:21.613 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] attr-list-by-handle-cursor-test 2024-03-27T10:04:22.040 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] listxattr 2024-03-27T10:04:22.395 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] dio-interleaved 2024-03-27T10:04:22.777 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] t_dir_type 2024-03-27T10:04:23.118 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] dio-invalidate-cache 2024-03-27T10:04:23.484 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] stat_test 2024-03-27T10:04:23.955 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] t_encrypted_d_revalidate 2024-03-27T10:04:24.285 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] attr_replace_test 2024-03-27T10:04:24.660 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] swapon 2024-03-27T10:04:24.974 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] mkswap 2024-03-27T10:04:25.282 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] t_attr_corruption 2024-03-27T10:04:25.584 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] t_open_tmpfiles 2024-03-27T10:04:25.987 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] fscrypt-crypt-util 2024-03-27T10:04:26.829 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] bulkstat_null_ocount 2024-03-27T10:04:27.142 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] splice-test 2024-03-27T10:04:27.463 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] chprojid_fail 2024-03-27T10:04:27.760 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] detached_mounts_propagation 2024-03-27T10:04:28.129 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] ext4_resize 2024-03-27T10:04:28.439 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] t_readdir_3 2024-03-27T10:04:28.814 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] splice2pipe 2024-03-27T10:04:29.108 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] uuid_ioctl 2024-03-27T10:04:29.452 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] t_snapshot_deleted_subvolume 2024-03-27T10:04:29.771 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] fiemap-tester 2024-03-27T10:04:30.258 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] t_stripealign 2024-03-27T10:04:30.578 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] open_by_handle 2024-03-27T10:04:30.980 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] dbtest 2024-03-27T10:04:31.400 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] t_mmap_dio 2024-03-27T10:04:31.702 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] xfsfind 2024-03-27T10:04:32.087 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] t_reflink_read_race 2024-03-27T10:04:32.488 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] fssum 2024-03-27T10:04:33.135 INFO:teuthology.orchestra.run.smithi057.stdout:Building log-writes 2024-03-27T10:04:33.150 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] replay-log 2024-03-27T10:04:33.649 INFO:teuthology.orchestra.run.smithi057.stdout:Building perf 2024-03-27T10:04:33.660 INFO:teuthology.orchestra.run.smithi057.stdout:Building aio-dio-regress 2024-03-27T10:04:33.675 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] aiocp 2024-03-27T10:04:34.053 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] aio-dio-append-write-fallocate-race 2024-03-27T10:04:34.369 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] aio-dio-append-write-read-race 2024-03-27T10:04:34.738 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] aio-dio-cow-race 2024-03-27T10:04:35.073 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] aio-dio-cycle-write 2024-03-27T10:04:35.469 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] aio-dio-eof-race 2024-03-27T10:04:35.811 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] aio-dio-extend-stat 2024-03-27T10:04:36.129 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] aio-dio-fcntl-race 2024-03-27T10:04:36.446 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] aio-dio-hole-filling-race 2024-03-27T10:04:36.724 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] aio-dio-invalidate-failure 2024-03-27T10:04:37.019 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] aio-dio-invalidate-readahead 2024-03-27T10:04:37.399 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] aiodio_sparse2 2024-03-27T10:04:37.785 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] aio-dio-subblock-eof-read 2024-03-27T10:04:38.052 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] aio-dio-write-verify 2024-03-27T10:04:38.406 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2024-03-27T10:04:38.667 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2024-03-27T10:04:38.962 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] aio-last-ref-held-by-io 2024-03-27T10:04:39.295 INFO:teuthology.orchestra.run.smithi057.stdout:Building vfs 2024-03-27T10:04:39.309 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] vfstest 2024-03-27T10:04:43.495 INFO:teuthology.orchestra.run.smithi057.stdout: [CC] mount-idmapped 2024-03-27T10:04:44.092 INFO:teuthology.orchestra.run.smithi057.stdout:Building m4 2024-03-27T10:04:44.104 INFO:teuthology.orchestra.run.smithi057.stdout:Building common 2024-03-27T10:04:44.116 INFO:teuthology.orchestra.run.smithi057.stdout:Building tests 2024-03-27T10:04:44.131 INFO:teuthology.orchestra.run.smithi057.stdout:Building btrfs 2024-03-27T10:04:44.148 INFO:teuthology.orchestra.run.smithi057.stdout: [GROUP] /tmp/tmp.446sL8UEHrxfstests-dev/tests/btrfs/group.list 2024-03-27T10:04:44.404 INFO:teuthology.orchestra.run.smithi057.stdout:Building ceph 2024-03-27T10:04:44.420 INFO:teuthology.orchestra.run.smithi057.stdout: [GROUP] /tmp/tmp.446sL8UEHrxfstests-dev/tests/ceph/group.list 2024-03-27T10:04:44.475 INFO:teuthology.orchestra.run.smithi057.stdout:Building cifs 2024-03-27T10:04:44.488 INFO:teuthology.orchestra.run.smithi057.stdout: [GROUP] /tmp/tmp.446sL8UEHrxfstests-dev/tests/cifs/group.list 2024-03-27T10:04:44.527 INFO:teuthology.orchestra.run.smithi057.stdout:Building ext4 2024-03-27T10:04:44.539 INFO:teuthology.orchestra.run.smithi057.stdout: [GROUP] /tmp/tmp.446sL8UEHrxfstests-dev/tests/ext4/group.list 2024-03-27T10:04:44.683 INFO:teuthology.orchestra.run.smithi057.stdout:Building f2fs 2024-03-27T10:04:44.698 INFO:teuthology.orchestra.run.smithi057.stdout: [GROUP] /tmp/tmp.446sL8UEHrxfstests-dev/tests/f2fs/group.list 2024-03-27T10:04:44.764 INFO:teuthology.orchestra.run.smithi057.stdout:Building generic 2024-03-27T10:04:44.784 INFO:teuthology.orchestra.run.smithi057.stdout: [GROUP] /tmp/tmp.446sL8UEHrxfstests-dev/tests/generic/group.list 2024-03-27T10:04:45.159 INFO:teuthology.orchestra.run.smithi057.stdout:Building nfs 2024-03-27T10:04:45.175 INFO:teuthology.orchestra.run.smithi057.stdout: [GROUP] /tmp/tmp.446sL8UEHrxfstests-dev/tests/nfs/group.list 2024-03-27T10:04:45.229 INFO:teuthology.orchestra.run.smithi057.stdout:Building ocfs2 2024-03-27T10:04:45.244 INFO:teuthology.orchestra.run.smithi057.stdout: [GROUP] /tmp/tmp.446sL8UEHrxfstests-dev/tests/ocfs2/group.list 2024-03-27T10:04:45.295 INFO:teuthology.orchestra.run.smithi057.stdout:Building overlay 2024-03-27T10:04:45.310 INFO:teuthology.orchestra.run.smithi057.stdout: [GROUP] /tmp/tmp.446sL8UEHrxfstests-dev/tests/overlay/group.list 2024-03-27T10:04:45.466 INFO:teuthology.orchestra.run.smithi057.stdout:Building perf 2024-03-27T10:04:45.482 INFO:teuthology.orchestra.run.smithi057.stdout: [GROUP] /tmp/tmp.446sL8UEHrxfstests-dev/tests/perf/group.list 2024-03-27T10:04:45.526 INFO:teuthology.orchestra.run.smithi057.stdout:Building selftest 2024-03-27T10:04:45.541 INFO:teuthology.orchestra.run.smithi057.stdout: [GROUP] /tmp/tmp.446sL8UEHrxfstests-dev/tests/selftest/group.list 2024-03-27T10:04:45.590 INFO:teuthology.orchestra.run.smithi057.stdout:Building shared 2024-03-27T10:04:45.606 INFO:teuthology.orchestra.run.smithi057.stdout: [GROUP] /tmp/tmp.446sL8UEHrxfstests-dev/tests/shared/group.list 2024-03-27T10:04:45.669 INFO:teuthology.orchestra.run.smithi057.stdout:Building tmpfs 2024-03-27T10:04:45.683 INFO:teuthology.orchestra.run.smithi057.stdout: [GROUP] /tmp/tmp.446sL8UEHrxfstests-dev/tests/tmpfs/group.list 2024-03-27T10:04:45.728 INFO:teuthology.orchestra.run.smithi057.stdout:Building udf 2024-03-27T10:04:45.740 INFO:teuthology.orchestra.run.smithi057.stdout: [GROUP] /tmp/tmp.446sL8UEHrxfstests-dev/tests/udf/group.list 2024-03-27T10:04:45.783 INFO:teuthology.orchestra.run.smithi057.stdout:Building xfs 2024-03-27T10:04:45.801 INFO:teuthology.orchestra.run.smithi057.stdout: [GROUP] /tmp/tmp.446sL8UEHrxfstests-dev/tests/xfs/group.list 2024-03-27T10:04:46.166 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo make install) 2024-03-27T10:04:46.340 INFO:teuthology.orchestra.run.smithi057.stdout:Building include 2024-03-27T10:04:46.350 INFO:teuthology.orchestra.run.smithi057.stdout:Building lib 2024-03-27T10:04:46.360 INFO:teuthology.orchestra.run.smithi057.stdout:Building ltp 2024-03-27T10:04:46.372 INFO:teuthology.orchestra.run.smithi057.stdout:Building src 2024-03-27T10:04:46.455 INFO:teuthology.orchestra.run.smithi057.stdout:Building log-writes 2024-03-27T10:04:46.467 INFO:teuthology.orchestra.run.smithi057.stdout:Building perf 2024-03-27T10:04:46.477 INFO:teuthology.orchestra.run.smithi057.stdout:Building aio-dio-regress 2024-03-27T10:04:46.487 INFO:teuthology.orchestra.run.smithi057.stdout:Building vfs 2024-03-27T10:04:46.497 INFO:teuthology.orchestra.run.smithi057.stdout:Building m4 2024-03-27T10:04:46.507 INFO:teuthology.orchestra.run.smithi057.stdout:Building common 2024-03-27T10:04:46.517 INFO:teuthology.orchestra.run.smithi057.stdout:Building tests 2024-03-27T10:04:46.531 INFO:teuthology.orchestra.run.smithi057.stdout:Building btrfs 2024-03-27T10:04:46.546 INFO:teuthology.orchestra.run.smithi057.stdout: [GROUP] /tmp/tmp.446sL8UEHrxfstests-dev/tests/btrfs/group.list 2024-03-27T10:04:46.798 INFO:teuthology.orchestra.run.smithi057.stdout:Building ceph 2024-03-27T10:04:46.813 INFO:teuthology.orchestra.run.smithi057.stdout: [GROUP] /tmp/tmp.446sL8UEHrxfstests-dev/tests/ceph/group.list 2024-03-27T10:04:46.867 INFO:teuthology.orchestra.run.smithi057.stdout:Building cifs 2024-03-27T10:04:46.880 INFO:teuthology.orchestra.run.smithi057.stdout: [GROUP] /tmp/tmp.446sL8UEHrxfstests-dev/tests/cifs/group.list 2024-03-27T10:04:46.933 INFO:teuthology.orchestra.run.smithi057.stdout:Building ext4 2024-03-27T10:04:46.948 INFO:teuthology.orchestra.run.smithi057.stdout: [GROUP] /tmp/tmp.446sL8UEHrxfstests-dev/tests/ext4/group.list 2024-03-27T10:04:47.084 INFO:teuthology.orchestra.run.smithi057.stdout:Building f2fs 2024-03-27T10:04:47.098 INFO:teuthology.orchestra.run.smithi057.stdout: [GROUP] /tmp/tmp.446sL8UEHrxfstests-dev/tests/f2fs/group.list 2024-03-27T10:04:47.165 INFO:teuthology.orchestra.run.smithi057.stdout:Building generic 2024-03-27T10:04:47.183 INFO:teuthology.orchestra.run.smithi057.stdout: [GROUP] /tmp/tmp.446sL8UEHrxfstests-dev/tests/generic/group.list 2024-03-27T10:04:47.531 INFO:teuthology.orchestra.run.smithi057.stdout:Building nfs 2024-03-27T10:04:47.546 INFO:teuthology.orchestra.run.smithi057.stdout: [GROUP] /tmp/tmp.446sL8UEHrxfstests-dev/tests/nfs/group.list 2024-03-27T10:04:47.604 INFO:teuthology.orchestra.run.smithi057.stdout:Building ocfs2 2024-03-27T10:04:47.619 INFO:teuthology.orchestra.run.smithi057.stdout: [GROUP] /tmp/tmp.446sL8UEHrxfstests-dev/tests/ocfs2/group.list 2024-03-27T10:04:47.669 INFO:teuthology.orchestra.run.smithi057.stdout:Building overlay 2024-03-27T10:04:47.684 INFO:teuthology.orchestra.run.smithi057.stdout: [GROUP] /tmp/tmp.446sL8UEHrxfstests-dev/tests/overlay/group.list 2024-03-27T10:04:47.825 INFO:teuthology.orchestra.run.smithi057.stdout:Building perf 2024-03-27T10:04:47.837 INFO:teuthology.orchestra.run.smithi057.stdout: [GROUP] /tmp/tmp.446sL8UEHrxfstests-dev/tests/perf/group.list 2024-03-27T10:04:47.880 INFO:teuthology.orchestra.run.smithi057.stdout:Building selftest 2024-03-27T10:04:47.895 INFO:teuthology.orchestra.run.smithi057.stdout: [GROUP] /tmp/tmp.446sL8UEHrxfstests-dev/tests/selftest/group.list 2024-03-27T10:04:47.936 INFO:teuthology.orchestra.run.smithi057.stdout:Building shared 2024-03-27T10:04:47.948 INFO:teuthology.orchestra.run.smithi057.stdout: [GROUP] /tmp/tmp.446sL8UEHrxfstests-dev/tests/shared/group.list 2024-03-27T10:04:48.014 INFO:teuthology.orchestra.run.smithi057.stdout:Building tmpfs 2024-03-27T10:04:48.028 INFO:teuthology.orchestra.run.smithi057.stdout: [GROUP] /tmp/tmp.446sL8UEHrxfstests-dev/tests/tmpfs/group.list 2024-03-27T10:04:48.081 INFO:teuthology.orchestra.run.smithi057.stdout:Building udf 2024-03-27T10:04:48.096 INFO:teuthology.orchestra.run.smithi057.stdout: [GROUP] /tmp/tmp.446sL8UEHrxfstests-dev/tests/udf/group.list 2024-03-27T10:04:48.140 INFO:teuthology.orchestra.run.smithi057.stdout:Building xfs 2024-03-27T10:04:48.157 INFO:teuthology.orchestra.run.smithi057.stdout: [GROUP] /tmp/tmp.446sL8UEHrxfstests-dev/tests/xfs/group.list 2024-03-27T10:04:48.542 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/gmake --no-print-directory Q=@ -C include install 2024-03-27T10:04:48.546 INFO:teuthology.orchestra.run.smithi057.stdout:gmake[1]: Nothing to be done for 'install'. 2024-03-27T10:04:48.547 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/gmake --no-print-directory Q=@ -C lib install 2024-03-27T10:04:48.552 INFO:teuthology.orchestra.run.smithi057.stdout:gmake[1]: Nothing to be done for 'install'. 2024-03-27T10:04:48.552 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/gmake --no-print-directory Q=@ -C ltp install 2024-03-27T10:04:48.557 INFO:teuthology.orchestra.run.smithi057.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2024-03-27T10:04:48.590 INFO:teuthology.orchestra.run.smithi057.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2024-03-27T10:04:48.794 INFO:teuthology.orchestra.run.smithi057.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2024-03-27T10:04:48.819 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/gmake --no-print-directory Q=@ -C src install 2024-03-27T10:04:48.858 INFO:teuthology.orchestra.run.smithi057.stdout:Building log-writes 2024-03-27T10:04:48.869 INFO:teuthology.orchestra.run.smithi057.stdout:Building perf 2024-03-27T10:04:48.880 INFO:teuthology.orchestra.run.smithi057.stdout:Building aio-dio-regress 2024-03-27T10:04:48.892 INFO:teuthology.orchestra.run.smithi057.stdout:Building vfs 2024-03-27T10:04:48.900 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/gmake -C log-writes install 2024-03-27T10:04:48.904 INFO:teuthology.orchestra.run.smithi057.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2024-03-27T10:04:48.938 INFO:teuthology.orchestra.run.smithi057.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2024-03-27T10:04:48.971 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/gmake -C perf install 2024-03-27T10:04:48.974 INFO:teuthology.orchestra.run.smithi057.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2024-03-27T10:04:49.006 INFO:teuthology.orchestra.run.smithi057.stdout:../../install-sh -o root -g root -m 755 FioCompare.py fio-insert-and-compare.py FioResultDecoder.py generate-schema.py ResultData.py fio-results.sql /var/lib/xfstests/src/perf 2024-03-27T10:04:49.080 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/gmake -C aio-dio-regress install 2024-03-27T10:04:49.084 INFO:teuthology.orchestra.run.smithi057.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2024-03-27T10:04:49.111 INFO:teuthology.orchestra.run.smithi057.stdout:../../install-sh -o root -g root -m 755 aiocp aio-dio-append-write-fallocate-race aio-dio-append-write-read-race aio-dio-cow-race aio-dio-cycle-write aio-dio-eof-race aio-dio-extend-stat aio-dio-fcntl-race aio-dio-hole-filling-race aio-dio-invalidate-failure aio-dio-invalidate-readahead aiodio_sparse2 aio-dio-subblock-eof-read aio-dio-write-verify aio-free-ring-with-bogus-nr-pages aio-io-setup-with-nonwritable-context-pointer aio-last-ref-held-by-io /var/lib/xfstests/src/aio-dio-regress 2024-03-27T10:04:49.169 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:04:49.174 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:04:49.279 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/gmake -C vfs install 2024-03-27T10:04:49.282 INFO:teuthology.orchestra.run.smithi057.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2024-03-27T10:04:49.310 INFO:teuthology.orchestra.run.smithi057.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2024-03-27T10:04:49.346 INFO:teuthology.orchestra.run.smithi057.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2024-03-27T10:04:49.377 INFO:teuthology.orchestra.run.smithi057.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault rewinddir-test readdir-while-renames xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl t_snapshot_deleted_subvolume fiemap-tester t_stripealign open_by_handle dbtest t_mmap_dio xfsfind t_reflink_read_race fssum /var/lib/xfstests/src 2024-03-27T10:04:53.682 INFO:teuthology.orchestra.run.smithi057.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py soak_duration.awk /var/lib/xfstests/src 2024-03-27T10:04:54.032 INFO:teuthology.orchestra.run.smithi057.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2024-03-27T10:04:54.096 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/gmake --no-print-directory Q=@ -C m4 install 2024-03-27T10:04:54.100 INFO:teuthology.orchestra.run.smithi057.stdout:gmake[1]: Nothing to be done for 'install'. 2024-03-27T10:04:54.101 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/gmake --no-print-directory Q=@ -C common install 2024-03-27T10:04:54.105 INFO:teuthology.orchestra.run.smithi057.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2024-03-27T10:04:54.138 INFO:teuthology.orchestra.run.smithi057.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2024-03-27T10:04:54.647 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/gmake --no-print-directory Q=@ -C tests install 2024-03-27T10:04:54.652 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.446sL8UEHrxfstests-dev/tests/btrfs/ install 2024-03-27T10:04:54.660 INFO:teuthology.orchestra.run.smithi057.stdout: [GROUP] /tmp/tmp.446sL8UEHrxfstests-dev/tests/btrfs/group.list 2024-03-27T10:04:54.889 INFO:teuthology.orchestra.run.smithi057.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2024-03-27T10:04:54.923 INFO:teuthology.orchestra.run.smithi057.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 /var/lib/xfstests/tests/btrfs 2024-03-27T10:04:58.552 INFO:teuthology.orchestra.run.smithi057.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2024-03-27T10:04:58.587 INFO:teuthology.orchestra.run.smithi057.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out /var/lib/xfstests/tests/btrfs 2024-03-27T10:05:02.145 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.446sL8UEHrxfstests-dev/tests/ceph/ install 2024-03-27T10:05:02.152 INFO:teuthology.orchestra.run.smithi057.stdout: [GROUP] /tmp/tmp.446sL8UEHrxfstests-dev/tests/ceph/group.list 2024-03-27T10:05:02.203 INFO:teuthology.orchestra.run.smithi057.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2024-03-27T10:05:02.235 INFO:teuthology.orchestra.run.smithi057.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2024-03-27T10:05:02.309 INFO:teuthology.orchestra.run.smithi057.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2024-03-27T10:05:02.341 INFO:teuthology.orchestra.run.smithi057.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out /var/lib/xfstests/tests/ceph 2024-03-27T10:05:02.417 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.446sL8UEHrxfstests-dev/tests/cifs/ install 2024-03-27T10:05:02.424 INFO:teuthology.orchestra.run.smithi057.stdout: [GROUP] /tmp/tmp.446sL8UEHrxfstests-dev/tests/cifs/group.list 2024-03-27T10:05:02.468 INFO:teuthology.orchestra.run.smithi057.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2024-03-27T10:05:02.502 INFO:teuthology.orchestra.run.smithi057.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2024-03-27T10:05:02.537 INFO:teuthology.orchestra.run.smithi057.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2024-03-27T10:05:02.573 INFO:teuthology.orchestra.run.smithi057.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2024-03-27T10:05:02.604 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.446sL8UEHrxfstests-dev/tests/ext4/ install 2024-03-27T10:05:02.612 INFO:teuthology.orchestra.run.smithi057.stdout: [GROUP] /tmp/tmp.446sL8UEHrxfstests-dev/tests/ext4/group.list 2024-03-27T10:05:02.756 INFO:teuthology.orchestra.run.smithi057.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2024-03-27T10:05:02.786 INFO:teuthology.orchestra.run.smithi057.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2024-03-27T10:05:03.509 INFO:teuthology.orchestra.run.smithi057.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2024-03-27T10:05:03.542 INFO:teuthology.orchestra.run.smithi057.stdout:../../install-sh -o root -g root -m 644 001.out.default 001.out.nodelalloc 001.out.nozero 001.cfg 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 271.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out /var/lib/xfstests/tests/ext4 2024-03-27T10:05:04.296 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.446sL8UEHrxfstests-dev/tests/f2fs/ install 2024-03-27T10:05:04.303 INFO:teuthology.orchestra.run.smithi057.stdout: [GROUP] /tmp/tmp.446sL8UEHrxfstests-dev/tests/f2fs/group.list 2024-03-27T10:05:04.361 INFO:teuthology.orchestra.run.smithi057.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2024-03-27T10:05:04.394 INFO:teuthology.orchestra.run.smithi057.stdout:../../install-sh -o root -g root -m 755 001 002 /var/lib/xfstests/tests/f2fs 2024-03-27T10:05:04.438 INFO:teuthology.orchestra.run.smithi057.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2024-03-27T10:05:04.472 INFO:teuthology.orchestra.run.smithi057.stdout:../../install-sh -o root -g root -m 644 001.out 002.out /var/lib/xfstests/tests/f2fs 2024-03-27T10:05:04.513 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.446sL8UEHrxfstests-dev/tests/generic/ install 2024-03-27T10:05:04.522 INFO:teuthology.orchestra.run.smithi057.stdout: [GROUP] /tmp/tmp.446sL8UEHrxfstests-dev/tests/generic/group.list 2024-03-27T10:05:04.877 INFO:teuthology.orchestra.run.smithi057.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2024-03-27T10:05:04.909 INFO:teuthology.orchestra.run.smithi057.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 /var/lib/xfstests/tests/generic 2024-03-27T10:05:13.352 INFO:teuthology.orchestra.run.smithi057.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2024-03-27T10:05:13.389 INFO:teuthology.orchestra.run.smithi057.stdout:../../install-sh -o root -g root -m 644 035.out.default 035.out.nfs 050.out.default 050.out.nojournal 050.out.xfsquota 035.cfg 050.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 601.out 602.out 603.out 604.out 605.out 606.out 607.out 608.out 609.out 610.out 611.out 612.out 613.out 614.out 615.out 616.out 617.out 618.out 619.out 620.out 621.out 622.out 623.out 624.out 625.out 626.out 627.out 628.out 629.out 630.out 631.out 632.out 633.out 634.out 635.out 636.out 637.out 638.out 639.out 640.out 641.out 642.out 643.out 644.out 645.out 646.out 647.out 648.out 649.out 650.out 651.out 652.out 653.out 654.out 655.out 656.out 657.out 658.out 659.out 660.out 661.out 662.out 663.out 664.out 665.out 666.out 667.out 668.out 669.out 670.out 671.out 672.out 673.out 674.out 675.out 676.out 677.out 678.out 679.out 680.out 681.out 682.out 683.out 684.out 685.out 686.out 687.out 688.out 689.out 690.out 691.out 692.out 693.out 694.out 695.out 696.out 697.out 698.out 699.out 700.out 701.out 702.out 703.out 704.out 705.out 706.out 707.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out 733.out 734.out 735.out 736.out 737.out 738.out 739.out /var/lib/xfstests/tests/generic 2024-03-27T10:05:19.297 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:05:19.304 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:05:21.605 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.446sL8UEHrxfstests-dev/tests/nfs/ install 2024-03-27T10:05:21.612 INFO:teuthology.orchestra.run.smithi057.stdout: [GROUP] /tmp/tmp.446sL8UEHrxfstests-dev/tests/nfs/group.list 2024-03-27T10:05:21.666 INFO:teuthology.orchestra.run.smithi057.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2024-03-27T10:05:21.700 INFO:teuthology.orchestra.run.smithi057.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2024-03-27T10:05:21.733 INFO:teuthology.orchestra.run.smithi057.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2024-03-27T10:05:21.764 INFO:teuthology.orchestra.run.smithi057.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2024-03-27T10:05:21.795 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.446sL8UEHrxfstests-dev/tests/ocfs2/ install 2024-03-27T10:05:21.802 INFO:teuthology.orchestra.run.smithi057.stdout: [GROUP] /tmp/tmp.446sL8UEHrxfstests-dev/tests/ocfs2/group.list 2024-03-27T10:05:21.843 INFO:teuthology.orchestra.run.smithi057.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2024-03-27T10:05:21.874 INFO:teuthology.orchestra.run.smithi057.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2024-03-27T10:05:21.901 INFO:teuthology.orchestra.run.smithi057.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2024-03-27T10:05:21.930 INFO:teuthology.orchestra.run.smithi057.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2024-03-27T10:05:21.959 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.446sL8UEHrxfstests-dev/tests/overlay/ install 2024-03-27T10:05:21.965 INFO:teuthology.orchestra.run.smithi057.stdout: [GROUP] /tmp/tmp.446sL8UEHrxfstests-dev/tests/overlay/group.list 2024-03-27T10:05:22.119 INFO:teuthology.orchestra.run.smithi057.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2024-03-27T10:05:22.152 INFO:teuthology.orchestra.run.smithi057.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2024-03-27T10:05:23.254 INFO:teuthology.orchestra.run.smithi057.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2024-03-27T10:05:23.288 INFO:teuthology.orchestra.run.smithi057.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out /var/lib/xfstests/tests/overlay 2024-03-27T10:05:24.461 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.446sL8UEHrxfstests-dev/tests/perf/ install 2024-03-27T10:05:24.468 INFO:teuthology.orchestra.run.smithi057.stdout: [GROUP] /tmp/tmp.446sL8UEHrxfstests-dev/tests/perf/group.list 2024-03-27T10:05:24.507 INFO:teuthology.orchestra.run.smithi057.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2024-03-27T10:05:24.539 INFO:teuthology.orchestra.run.smithi057.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2024-03-27T10:05:24.573 INFO:teuthology.orchestra.run.smithi057.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2024-03-27T10:05:24.611 INFO:teuthology.orchestra.run.smithi057.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2024-03-27T10:05:24.647 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.446sL8UEHrxfstests-dev/tests/selftest/ install 2024-03-27T10:05:24.654 INFO:teuthology.orchestra.run.smithi057.stdout: [GROUP] /tmp/tmp.446sL8UEHrxfstests-dev/tests/selftest/group.list 2024-03-27T10:05:24.704 INFO:teuthology.orchestra.run.smithi057.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2024-03-27T10:05:24.735 INFO:teuthology.orchestra.run.smithi057.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2024-03-27T10:05:24.809 INFO:teuthology.orchestra.run.smithi057.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2024-03-27T10:05:24.841 INFO:teuthology.orchestra.run.smithi057.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out /var/lib/xfstests/tests/selftest 2024-03-27T10:05:24.926 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.446sL8UEHrxfstests-dev/tests/shared/ install 2024-03-27T10:05:24.933 INFO:teuthology.orchestra.run.smithi057.stdout: [GROUP] /tmp/tmp.446sL8UEHrxfstests-dev/tests/shared/group.list 2024-03-27T10:05:24.997 INFO:teuthology.orchestra.run.smithi057.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/shared 2024-03-27T10:05:25.031 INFO:teuthology.orchestra.run.smithi057.stdout:../../install-sh -o root -g root -m 755 002 032 298 /var/lib/xfstests/tests/shared 2024-03-27T10:05:25.084 INFO:teuthology.orchestra.run.smithi057.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/shared 2024-03-27T10:05:25.117 INFO:teuthology.orchestra.run.smithi057.stdout:../../install-sh -o root -g root -m 644 002.out 032.out 298.out /var/lib/xfstests/tests/shared 2024-03-27T10:05:25.167 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.446sL8UEHrxfstests-dev/tests/tmpfs/ install 2024-03-27T10:05:25.174 INFO:teuthology.orchestra.run.smithi057.stdout: [GROUP] /tmp/tmp.446sL8UEHrxfstests-dev/tests/tmpfs/group.list 2024-03-27T10:05:25.222 INFO:teuthology.orchestra.run.smithi057.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/tmpfs 2024-03-27T10:05:25.256 INFO:teuthology.orchestra.run.smithi057.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/tmpfs 2024-03-27T10:05:25.291 INFO:teuthology.orchestra.run.smithi057.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/tmpfs 2024-03-27T10:05:25.327 INFO:teuthology.orchestra.run.smithi057.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/tmpfs 2024-03-27T10:05:25.361 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.446sL8UEHrxfstests-dev/tests/udf/ install 2024-03-27T10:05:25.369 INFO:teuthology.orchestra.run.smithi057.stdout: [GROUP] /tmp/tmp.446sL8UEHrxfstests-dev/tests/udf/group.list 2024-03-27T10:05:25.401 INFO:teuthology.orchestra.run.smithi057.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2024-03-27T10:05:25.433 INFO:teuthology.orchestra.run.smithi057.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2024-03-27T10:05:25.466 INFO:teuthology.orchestra.run.smithi057.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2024-03-27T10:05:25.499 INFO:teuthology.orchestra.run.smithi057.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2024-03-27T10:05:25.529 INFO:teuthology.orchestra.run.smithi057.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.446sL8UEHrxfstests-dev/tests/xfs/ install 2024-03-27T10:05:25.538 INFO:teuthology.orchestra.run.smithi057.stdout: [GROUP] /tmp/tmp.446sL8UEHrxfstests-dev/tests/xfs/group.list 2024-03-27T10:05:25.899 INFO:teuthology.orchestra.run.smithi057.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2024-03-27T10:05:25.930 INFO:teuthology.orchestra.run.smithi057.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 /var/lib/xfstests/tests/xfs 2024-03-27T10:05:33.403 INFO:teuthology.orchestra.run.smithi057.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2024-03-27T10:05:33.439 INFO:teuthology.orchestra.run.smithi057.stdout:../../install-sh -o root -g root -m 644 033.out.crc 033.out.default 071.out.32 071.out.64 096.out.external 096.out.internal 216.out.64mblog 216.out.classic 033.cfg 216.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 601.out 602.out 603.out 604.out 605.out 606.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out 733.out 734.out 735.out 736.out 737.out 738.out 739.out 740.out 741.out 742.out 743.out 744.out 745.out 746.out 747.out 748.out 749.out 750.out 751.out 752.out 753.out 754.out 755.out 756.out 757.out 758.out 759.out 760.out 761.out 762.out 763.out 764.out 765.out 766.out 767.out 768.out 769.out 770.out 771.out 772.out 773.out 774.out 775.out 776.out 777.out 778.out 779.out 780.out 781.out 782.out 783.out 784.out 785.out 786.out 787.out 788.out 789.out 790.out 791.out 792.out 793.out 794.out 795.out 796.out 797.out 798.out 799.out 800.out /var/lib/xfstests/tests/xfs 2024-03-27T10:05:41.240 INFO:teuthology.orchestra.run.smithi057.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2024-03-27T10:05:41.275 INFO:teuthology.orchestra.run.smithi057.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2024-03-27T10:05:41.309 INFO:teuthology.orchestra.run.smithi057.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2024-03-27T10:05:41.344 INFO:teuthology.orchestra.run.smithi057.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2024-03-27T10:05:41.384 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T10:05:41.385 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec ls tests/generic) 2024-03-27T10:05:41.440 INFO:teuthology.orchestra.run.smithi057.stdout:001 2024-03-27T10:05:41.440 INFO:teuthology.orchestra.run.smithi057.stdout:001.out 2024-03-27T10:05:41.440 INFO:teuthology.orchestra.run.smithi057.stdout:002 2024-03-27T10:05:41.440 INFO:teuthology.orchestra.run.smithi057.stdout:002.out 2024-03-27T10:05:41.440 INFO:teuthology.orchestra.run.smithi057.stdout:003 2024-03-27T10:05:41.440 INFO:teuthology.orchestra.run.smithi057.stdout:003.out 2024-03-27T10:05:41.440 INFO:teuthology.orchestra.run.smithi057.stdout:004 2024-03-27T10:05:41.440 INFO:teuthology.orchestra.run.smithi057.stdout:004.out 2024-03-27T10:05:41.440 INFO:teuthology.orchestra.run.smithi057.stdout:005 2024-03-27T10:05:41.440 INFO:teuthology.orchestra.run.smithi057.stdout:005.out 2024-03-27T10:05:41.440 INFO:teuthology.orchestra.run.smithi057.stdout:006 2024-03-27T10:05:41.441 INFO:teuthology.orchestra.run.smithi057.stdout:006.out 2024-03-27T10:05:41.441 INFO:teuthology.orchestra.run.smithi057.stdout:007 2024-03-27T10:05:41.441 INFO:teuthology.orchestra.run.smithi057.stdout:007.out 2024-03-27T10:05:41.441 INFO:teuthology.orchestra.run.smithi057.stdout:008 2024-03-27T10:05:41.441 INFO:teuthology.orchestra.run.smithi057.stdout:008.out 2024-03-27T10:05:41.441 INFO:teuthology.orchestra.run.smithi057.stdout:009 2024-03-27T10:05:41.441 INFO:teuthology.orchestra.run.smithi057.stdout:009.out 2024-03-27T10:05:41.441 INFO:teuthology.orchestra.run.smithi057.stdout:010 2024-03-27T10:05:41.441 INFO:teuthology.orchestra.run.smithi057.stdout:010.out 2024-03-27T10:05:41.441 INFO:teuthology.orchestra.run.smithi057.stdout:011 2024-03-27T10:05:41.441 INFO:teuthology.orchestra.run.smithi057.stdout:011.out 2024-03-27T10:05:41.441 INFO:teuthology.orchestra.run.smithi057.stdout:012 2024-03-27T10:05:41.441 INFO:teuthology.orchestra.run.smithi057.stdout:012.out 2024-03-27T10:05:41.441 INFO:teuthology.orchestra.run.smithi057.stdout:013 2024-03-27T10:05:41.442 INFO:teuthology.orchestra.run.smithi057.stdout:013.out 2024-03-27T10:05:41.442 INFO:teuthology.orchestra.run.smithi057.stdout:014 2024-03-27T10:05:41.442 INFO:teuthology.orchestra.run.smithi057.stdout:014.out 2024-03-27T10:05:41.442 INFO:teuthology.orchestra.run.smithi057.stdout:015 2024-03-27T10:05:41.442 INFO:teuthology.orchestra.run.smithi057.stdout:015.out 2024-03-27T10:05:41.442 INFO:teuthology.orchestra.run.smithi057.stdout:016 2024-03-27T10:05:41.442 INFO:teuthology.orchestra.run.smithi057.stdout:016.out 2024-03-27T10:05:41.442 INFO:teuthology.orchestra.run.smithi057.stdout:017 2024-03-27T10:05:41.442 INFO:teuthology.orchestra.run.smithi057.stdout:017.out 2024-03-27T10:05:41.442 INFO:teuthology.orchestra.run.smithi057.stdout:018 2024-03-27T10:05:41.442 INFO:teuthology.orchestra.run.smithi057.stdout:018.out 2024-03-27T10:05:41.442 INFO:teuthology.orchestra.run.smithi057.stdout:019 2024-03-27T10:05:41.443 INFO:teuthology.orchestra.run.smithi057.stdout:019.out 2024-03-27T10:05:41.443 INFO:teuthology.orchestra.run.smithi057.stdout:020 2024-03-27T10:05:41.443 INFO:teuthology.orchestra.run.smithi057.stdout:020.out 2024-03-27T10:05:41.443 INFO:teuthology.orchestra.run.smithi057.stdout:021 2024-03-27T10:05:41.443 INFO:teuthology.orchestra.run.smithi057.stdout:021.out 2024-03-27T10:05:41.443 INFO:teuthology.orchestra.run.smithi057.stdout:022 2024-03-27T10:05:41.443 INFO:teuthology.orchestra.run.smithi057.stdout:022.out 2024-03-27T10:05:41.443 INFO:teuthology.orchestra.run.smithi057.stdout:023 2024-03-27T10:05:41.443 INFO:teuthology.orchestra.run.smithi057.stdout:023.out 2024-03-27T10:05:41.443 INFO:teuthology.orchestra.run.smithi057.stdout:024 2024-03-27T10:05:41.443 INFO:teuthology.orchestra.run.smithi057.stdout:024.out 2024-03-27T10:05:41.443 INFO:teuthology.orchestra.run.smithi057.stdout:025 2024-03-27T10:05:41.443 INFO:teuthology.orchestra.run.smithi057.stdout:025.out 2024-03-27T10:05:41.443 INFO:teuthology.orchestra.run.smithi057.stdout:026 2024-03-27T10:05:41.443 INFO:teuthology.orchestra.run.smithi057.stdout:026.out 2024-03-27T10:05:41.444 INFO:teuthology.orchestra.run.smithi057.stdout:027 2024-03-27T10:05:41.444 INFO:teuthology.orchestra.run.smithi057.stdout:027.out 2024-03-27T10:05:41.444 INFO:teuthology.orchestra.run.smithi057.stdout:028 2024-03-27T10:05:41.444 INFO:teuthology.orchestra.run.smithi057.stdout:028.out 2024-03-27T10:05:41.444 INFO:teuthology.orchestra.run.smithi057.stdout:029 2024-03-27T10:05:41.444 INFO:teuthology.orchestra.run.smithi057.stdout:029.out 2024-03-27T10:05:41.444 INFO:teuthology.orchestra.run.smithi057.stdout:030 2024-03-27T10:05:41.444 INFO:teuthology.orchestra.run.smithi057.stdout:030.out 2024-03-27T10:05:41.444 INFO:teuthology.orchestra.run.smithi057.stdout:031 2024-03-27T10:05:41.444 INFO:teuthology.orchestra.run.smithi057.stdout:031.out 2024-03-27T10:05:41.444 INFO:teuthology.orchestra.run.smithi057.stdout:032 2024-03-27T10:05:41.444 INFO:teuthology.orchestra.run.smithi057.stdout:032.out 2024-03-27T10:05:41.444 INFO:teuthology.orchestra.run.smithi057.stdout:033 2024-03-27T10:05:41.444 INFO:teuthology.orchestra.run.smithi057.stdout:033.out 2024-03-27T10:05:41.444 INFO:teuthology.orchestra.run.smithi057.stdout:034 2024-03-27T10:05:41.445 INFO:teuthology.orchestra.run.smithi057.stdout:034.out 2024-03-27T10:05:41.445 INFO:teuthology.orchestra.run.smithi057.stdout:035 2024-03-27T10:05:41.445 INFO:teuthology.orchestra.run.smithi057.stdout:035.cfg 2024-03-27T10:05:41.445 INFO:teuthology.orchestra.run.smithi057.stdout:035.out.default 2024-03-27T10:05:41.445 INFO:teuthology.orchestra.run.smithi057.stdout:035.out.nfs 2024-03-27T10:05:41.445 INFO:teuthology.orchestra.run.smithi057.stdout:036 2024-03-27T10:05:41.445 INFO:teuthology.orchestra.run.smithi057.stdout:036.out 2024-03-27T10:05:41.445 INFO:teuthology.orchestra.run.smithi057.stdout:037 2024-03-27T10:05:41.445 INFO:teuthology.orchestra.run.smithi057.stdout:037.out 2024-03-27T10:05:41.445 INFO:teuthology.orchestra.run.smithi057.stdout:038 2024-03-27T10:05:41.445 INFO:teuthology.orchestra.run.smithi057.stdout:038.out 2024-03-27T10:05:41.445 INFO:teuthology.orchestra.run.smithi057.stdout:039 2024-03-27T10:05:41.445 INFO:teuthology.orchestra.run.smithi057.stdout:039.out 2024-03-27T10:05:41.445 INFO:teuthology.orchestra.run.smithi057.stdout:040 2024-03-27T10:05:41.446 INFO:teuthology.orchestra.run.smithi057.stdout:040.out 2024-03-27T10:05:41.446 INFO:teuthology.orchestra.run.smithi057.stdout:041 2024-03-27T10:05:41.446 INFO:teuthology.orchestra.run.smithi057.stdout:041.out 2024-03-27T10:05:41.446 INFO:teuthology.orchestra.run.smithi057.stdout:042 2024-03-27T10:05:41.446 INFO:teuthology.orchestra.run.smithi057.stdout:042.out 2024-03-27T10:05:41.446 INFO:teuthology.orchestra.run.smithi057.stdout:043 2024-03-27T10:05:41.446 INFO:teuthology.orchestra.run.smithi057.stdout:043.out 2024-03-27T10:05:41.446 INFO:teuthology.orchestra.run.smithi057.stdout:044 2024-03-27T10:05:41.446 INFO:teuthology.orchestra.run.smithi057.stdout:044.out 2024-03-27T10:05:41.446 INFO:teuthology.orchestra.run.smithi057.stdout:045 2024-03-27T10:05:41.446 INFO:teuthology.orchestra.run.smithi057.stdout:045.out 2024-03-27T10:05:41.446 INFO:teuthology.orchestra.run.smithi057.stdout:046 2024-03-27T10:05:41.446 INFO:teuthology.orchestra.run.smithi057.stdout:046.out 2024-03-27T10:05:41.447 INFO:teuthology.orchestra.run.smithi057.stdout:047 2024-03-27T10:05:41.447 INFO:teuthology.orchestra.run.smithi057.stdout:047.out 2024-03-27T10:05:41.447 INFO:teuthology.orchestra.run.smithi057.stdout:048 2024-03-27T10:05:41.447 INFO:teuthology.orchestra.run.smithi057.stdout:048.out 2024-03-27T10:05:41.447 INFO:teuthology.orchestra.run.smithi057.stdout:049 2024-03-27T10:05:41.447 INFO:teuthology.orchestra.run.smithi057.stdout:049.out 2024-03-27T10:05:41.447 INFO:teuthology.orchestra.run.smithi057.stdout:050 2024-03-27T10:05:41.447 INFO:teuthology.orchestra.run.smithi057.stdout:050.cfg 2024-03-27T10:05:41.447 INFO:teuthology.orchestra.run.smithi057.stdout:050.out.default 2024-03-27T10:05:41.447 INFO:teuthology.orchestra.run.smithi057.stdout:050.out.nojournal 2024-03-27T10:05:41.447 INFO:teuthology.orchestra.run.smithi057.stdout:050.out.xfsquota 2024-03-27T10:05:41.447 INFO:teuthology.orchestra.run.smithi057.stdout:051 2024-03-27T10:05:41.447 INFO:teuthology.orchestra.run.smithi057.stdout:051.out 2024-03-27T10:05:41.447 INFO:teuthology.orchestra.run.smithi057.stdout:052 2024-03-27T10:05:41.447 INFO:teuthology.orchestra.run.smithi057.stdout:052.out 2024-03-27T10:05:41.447 INFO:teuthology.orchestra.run.smithi057.stdout:053 2024-03-27T10:05:41.448 INFO:teuthology.orchestra.run.smithi057.stdout:053.out 2024-03-27T10:05:41.448 INFO:teuthology.orchestra.run.smithi057.stdout:054 2024-03-27T10:05:41.448 INFO:teuthology.orchestra.run.smithi057.stdout:054.out 2024-03-27T10:05:41.448 INFO:teuthology.orchestra.run.smithi057.stdout:055 2024-03-27T10:05:41.448 INFO:teuthology.orchestra.run.smithi057.stdout:055.out 2024-03-27T10:05:41.448 INFO:teuthology.orchestra.run.smithi057.stdout:056 2024-03-27T10:05:41.448 INFO:teuthology.orchestra.run.smithi057.stdout:056.out 2024-03-27T10:05:41.448 INFO:teuthology.orchestra.run.smithi057.stdout:057 2024-03-27T10:05:41.448 INFO:teuthology.orchestra.run.smithi057.stdout:057.out 2024-03-27T10:05:41.448 INFO:teuthology.orchestra.run.smithi057.stdout:058 2024-03-27T10:05:41.448 INFO:teuthology.orchestra.run.smithi057.stdout:058.out 2024-03-27T10:05:41.448 INFO:teuthology.orchestra.run.smithi057.stdout:059 2024-03-27T10:05:41.448 INFO:teuthology.orchestra.run.smithi057.stdout:059.out 2024-03-27T10:05:41.448 INFO:teuthology.orchestra.run.smithi057.stdout:060 2024-03-27T10:05:41.448 INFO:teuthology.orchestra.run.smithi057.stdout:060.out 2024-03-27T10:05:41.449 INFO:teuthology.orchestra.run.smithi057.stdout:061 2024-03-27T10:05:41.449 INFO:teuthology.orchestra.run.smithi057.stdout:061.out 2024-03-27T10:05:41.449 INFO:teuthology.orchestra.run.smithi057.stdout:062 2024-03-27T10:05:41.449 INFO:teuthology.orchestra.run.smithi057.stdout:062.out 2024-03-27T10:05:41.449 INFO:teuthology.orchestra.run.smithi057.stdout:063 2024-03-27T10:05:41.449 INFO:teuthology.orchestra.run.smithi057.stdout:063.out 2024-03-27T10:05:41.449 INFO:teuthology.orchestra.run.smithi057.stdout:064 2024-03-27T10:05:41.449 INFO:teuthology.orchestra.run.smithi057.stdout:064.out 2024-03-27T10:05:41.449 INFO:teuthology.orchestra.run.smithi057.stdout:065 2024-03-27T10:05:41.449 INFO:teuthology.orchestra.run.smithi057.stdout:065.out 2024-03-27T10:05:41.449 INFO:teuthology.orchestra.run.smithi057.stdout:066 2024-03-27T10:05:41.449 INFO:teuthology.orchestra.run.smithi057.stdout:066.out 2024-03-27T10:05:41.449 INFO:teuthology.orchestra.run.smithi057.stdout:067 2024-03-27T10:05:41.449 INFO:teuthology.orchestra.run.smithi057.stdout:067.out 2024-03-27T10:05:41.450 INFO:teuthology.orchestra.run.smithi057.stdout:068 2024-03-27T10:05:41.450 INFO:teuthology.orchestra.run.smithi057.stdout:068.out 2024-03-27T10:05:41.450 INFO:teuthology.orchestra.run.smithi057.stdout:069 2024-03-27T10:05:41.450 INFO:teuthology.orchestra.run.smithi057.stdout:069.out 2024-03-27T10:05:41.450 INFO:teuthology.orchestra.run.smithi057.stdout:070 2024-03-27T10:05:41.450 INFO:teuthology.orchestra.run.smithi057.stdout:070.out 2024-03-27T10:05:41.450 INFO:teuthology.orchestra.run.smithi057.stdout:071 2024-03-27T10:05:41.450 INFO:teuthology.orchestra.run.smithi057.stdout:071.out 2024-03-27T10:05:41.450 INFO:teuthology.orchestra.run.smithi057.stdout:072 2024-03-27T10:05:41.450 INFO:teuthology.orchestra.run.smithi057.stdout:072.out 2024-03-27T10:05:41.450 INFO:teuthology.orchestra.run.smithi057.stdout:073 2024-03-27T10:05:41.450 INFO:teuthology.orchestra.run.smithi057.stdout:073.out 2024-03-27T10:05:41.450 INFO:teuthology.orchestra.run.smithi057.stdout:074 2024-03-27T10:05:41.451 INFO:teuthology.orchestra.run.smithi057.stdout:074.out 2024-03-27T10:05:41.451 INFO:teuthology.orchestra.run.smithi057.stdout:075 2024-03-27T10:05:41.451 INFO:teuthology.orchestra.run.smithi057.stdout:075.out 2024-03-27T10:05:41.451 INFO:teuthology.orchestra.run.smithi057.stdout:076 2024-03-27T10:05:41.451 INFO:teuthology.orchestra.run.smithi057.stdout:076.out 2024-03-27T10:05:41.451 INFO:teuthology.orchestra.run.smithi057.stdout:077 2024-03-27T10:05:41.451 INFO:teuthology.orchestra.run.smithi057.stdout:077.out 2024-03-27T10:05:41.451 INFO:teuthology.orchestra.run.smithi057.stdout:078 2024-03-27T10:05:41.451 INFO:teuthology.orchestra.run.smithi057.stdout:078.out 2024-03-27T10:05:41.451 INFO:teuthology.orchestra.run.smithi057.stdout:079 2024-03-27T10:05:41.451 INFO:teuthology.orchestra.run.smithi057.stdout:079.out 2024-03-27T10:05:41.451 INFO:teuthology.orchestra.run.smithi057.stdout:080 2024-03-27T10:05:41.451 INFO:teuthology.orchestra.run.smithi057.stdout:080.out 2024-03-27T10:05:41.451 INFO:teuthology.orchestra.run.smithi057.stdout:081 2024-03-27T10:05:41.451 INFO:teuthology.orchestra.run.smithi057.stdout:081.out 2024-03-27T10:05:41.451 INFO:teuthology.orchestra.run.smithi057.stdout:082 2024-03-27T10:05:41.452 INFO:teuthology.orchestra.run.smithi057.stdout:082.out 2024-03-27T10:05:41.452 INFO:teuthology.orchestra.run.smithi057.stdout:083 2024-03-27T10:05:41.452 INFO:teuthology.orchestra.run.smithi057.stdout:083.out 2024-03-27T10:05:41.452 INFO:teuthology.orchestra.run.smithi057.stdout:084 2024-03-27T10:05:41.452 INFO:teuthology.orchestra.run.smithi057.stdout:084.out 2024-03-27T10:05:41.452 INFO:teuthology.orchestra.run.smithi057.stdout:085 2024-03-27T10:05:41.452 INFO:teuthology.orchestra.run.smithi057.stdout:085.out 2024-03-27T10:05:41.452 INFO:teuthology.orchestra.run.smithi057.stdout:086 2024-03-27T10:05:41.452 INFO:teuthology.orchestra.run.smithi057.stdout:086.out 2024-03-27T10:05:41.452 INFO:teuthology.orchestra.run.smithi057.stdout:087 2024-03-27T10:05:41.452 INFO:teuthology.orchestra.run.smithi057.stdout:087.out 2024-03-27T10:05:41.452 INFO:teuthology.orchestra.run.smithi057.stdout:088 2024-03-27T10:05:41.452 INFO:teuthology.orchestra.run.smithi057.stdout:088.out 2024-03-27T10:05:41.452 INFO:teuthology.orchestra.run.smithi057.stdout:089 2024-03-27T10:05:41.453 INFO:teuthology.orchestra.run.smithi057.stdout:089.out 2024-03-27T10:05:41.453 INFO:teuthology.orchestra.run.smithi057.stdout:090 2024-03-27T10:05:41.453 INFO:teuthology.orchestra.run.smithi057.stdout:090.out 2024-03-27T10:05:41.453 INFO:teuthology.orchestra.run.smithi057.stdout:091 2024-03-27T10:05:41.453 INFO:teuthology.orchestra.run.smithi057.stdout:091.out 2024-03-27T10:05:41.453 INFO:teuthology.orchestra.run.smithi057.stdout:092 2024-03-27T10:05:41.453 INFO:teuthology.orchestra.run.smithi057.stdout:092.out 2024-03-27T10:05:41.453 INFO:teuthology.orchestra.run.smithi057.stdout:093 2024-03-27T10:05:41.453 INFO:teuthology.orchestra.run.smithi057.stdout:093.out 2024-03-27T10:05:41.453 INFO:teuthology.orchestra.run.smithi057.stdout:094 2024-03-27T10:05:41.453 INFO:teuthology.orchestra.run.smithi057.stdout:094.out 2024-03-27T10:05:41.453 INFO:teuthology.orchestra.run.smithi057.stdout:095 2024-03-27T10:05:41.453 INFO:teuthology.orchestra.run.smithi057.stdout:095.out 2024-03-27T10:05:41.453 INFO:teuthology.orchestra.run.smithi057.stdout:096 2024-03-27T10:05:41.453 INFO:teuthology.orchestra.run.smithi057.stdout:096.out 2024-03-27T10:05:41.453 INFO:teuthology.orchestra.run.smithi057.stdout:097 2024-03-27T10:05:41.454 INFO:teuthology.orchestra.run.smithi057.stdout:097.out 2024-03-27T10:05:41.454 INFO:teuthology.orchestra.run.smithi057.stdout:098 2024-03-27T10:05:41.454 INFO:teuthology.orchestra.run.smithi057.stdout:098.out 2024-03-27T10:05:41.454 INFO:teuthology.orchestra.run.smithi057.stdout:099 2024-03-27T10:05:41.454 INFO:teuthology.orchestra.run.smithi057.stdout:099.out 2024-03-27T10:05:41.454 INFO:teuthology.orchestra.run.smithi057.stdout:100 2024-03-27T10:05:41.454 INFO:teuthology.orchestra.run.smithi057.stdout:100.out 2024-03-27T10:05:41.454 INFO:teuthology.orchestra.run.smithi057.stdout:101 2024-03-27T10:05:41.454 INFO:teuthology.orchestra.run.smithi057.stdout:101.out 2024-03-27T10:05:41.454 INFO:teuthology.orchestra.run.smithi057.stdout:102 2024-03-27T10:05:41.454 INFO:teuthology.orchestra.run.smithi057.stdout:102.out 2024-03-27T10:05:41.454 INFO:teuthology.orchestra.run.smithi057.stdout:103 2024-03-27T10:05:41.454 INFO:teuthology.orchestra.run.smithi057.stdout:103.out 2024-03-27T10:05:41.454 INFO:teuthology.orchestra.run.smithi057.stdout:104 2024-03-27T10:05:41.455 INFO:teuthology.orchestra.run.smithi057.stdout:104.out 2024-03-27T10:05:41.455 INFO:teuthology.orchestra.run.smithi057.stdout:105 2024-03-27T10:05:41.455 INFO:teuthology.orchestra.run.smithi057.stdout:105.out 2024-03-27T10:05:41.455 INFO:teuthology.orchestra.run.smithi057.stdout:106 2024-03-27T10:05:41.455 INFO:teuthology.orchestra.run.smithi057.stdout:106.out 2024-03-27T10:05:41.455 INFO:teuthology.orchestra.run.smithi057.stdout:107 2024-03-27T10:05:41.455 INFO:teuthology.orchestra.run.smithi057.stdout:107.out 2024-03-27T10:05:41.455 INFO:teuthology.orchestra.run.smithi057.stdout:108 2024-03-27T10:05:41.455 INFO:teuthology.orchestra.run.smithi057.stdout:108.out 2024-03-27T10:05:41.455 INFO:teuthology.orchestra.run.smithi057.stdout:109 2024-03-27T10:05:41.455 INFO:teuthology.orchestra.run.smithi057.stdout:109.out 2024-03-27T10:05:41.455 INFO:teuthology.orchestra.run.smithi057.stdout:110 2024-03-27T10:05:41.455 INFO:teuthology.orchestra.run.smithi057.stdout:110.out 2024-03-27T10:05:41.455 INFO:teuthology.orchestra.run.smithi057.stdout:111 2024-03-27T10:05:41.456 INFO:teuthology.orchestra.run.smithi057.stdout:111.out 2024-03-27T10:05:41.456 INFO:teuthology.orchestra.run.smithi057.stdout:112 2024-03-27T10:05:41.456 INFO:teuthology.orchestra.run.smithi057.stdout:112.out 2024-03-27T10:05:41.456 INFO:teuthology.orchestra.run.smithi057.stdout:113 2024-03-27T10:05:41.456 INFO:teuthology.orchestra.run.smithi057.stdout:113.out 2024-03-27T10:05:41.456 INFO:teuthology.orchestra.run.smithi057.stdout:114 2024-03-27T10:05:41.456 INFO:teuthology.orchestra.run.smithi057.stdout:114.out 2024-03-27T10:05:41.456 INFO:teuthology.orchestra.run.smithi057.stdout:115 2024-03-27T10:05:41.456 INFO:teuthology.orchestra.run.smithi057.stdout:115.out 2024-03-27T10:05:41.456 INFO:teuthology.orchestra.run.smithi057.stdout:116 2024-03-27T10:05:41.456 INFO:teuthology.orchestra.run.smithi057.stdout:116.out 2024-03-27T10:05:41.456 INFO:teuthology.orchestra.run.smithi057.stdout:117 2024-03-27T10:05:41.456 INFO:teuthology.orchestra.run.smithi057.stdout:117.out 2024-03-27T10:05:41.456 INFO:teuthology.orchestra.run.smithi057.stdout:118 2024-03-27T10:05:41.457 INFO:teuthology.orchestra.run.smithi057.stdout:118.out 2024-03-27T10:05:41.457 INFO:teuthology.orchestra.run.smithi057.stdout:119 2024-03-27T10:05:41.457 INFO:teuthology.orchestra.run.smithi057.stdout:119.out 2024-03-27T10:05:41.457 INFO:teuthology.orchestra.run.smithi057.stdout:120 2024-03-27T10:05:41.457 INFO:teuthology.orchestra.run.smithi057.stdout:120.out 2024-03-27T10:05:41.457 INFO:teuthology.orchestra.run.smithi057.stdout:121 2024-03-27T10:05:41.457 INFO:teuthology.orchestra.run.smithi057.stdout:121.out 2024-03-27T10:05:41.457 INFO:teuthology.orchestra.run.smithi057.stdout:122 2024-03-27T10:05:41.457 INFO:teuthology.orchestra.run.smithi057.stdout:122.out 2024-03-27T10:05:41.457 INFO:teuthology.orchestra.run.smithi057.stdout:123 2024-03-27T10:05:41.457 INFO:teuthology.orchestra.run.smithi057.stdout:123.out 2024-03-27T10:05:41.457 INFO:teuthology.orchestra.run.smithi057.stdout:124 2024-03-27T10:05:41.457 INFO:teuthology.orchestra.run.smithi057.stdout:124.out 2024-03-27T10:05:41.457 INFO:teuthology.orchestra.run.smithi057.stdout:125 2024-03-27T10:05:41.458 INFO:teuthology.orchestra.run.smithi057.stdout:125.out 2024-03-27T10:05:41.458 INFO:teuthology.orchestra.run.smithi057.stdout:126 2024-03-27T10:05:41.458 INFO:teuthology.orchestra.run.smithi057.stdout:126.out 2024-03-27T10:05:41.458 INFO:teuthology.orchestra.run.smithi057.stdout:127 2024-03-27T10:05:41.458 INFO:teuthology.orchestra.run.smithi057.stdout:127.out 2024-03-27T10:05:41.458 INFO:teuthology.orchestra.run.smithi057.stdout:128 2024-03-27T10:05:41.458 INFO:teuthology.orchestra.run.smithi057.stdout:128.out 2024-03-27T10:05:41.458 INFO:teuthology.orchestra.run.smithi057.stdout:129 2024-03-27T10:05:41.458 INFO:teuthology.orchestra.run.smithi057.stdout:129.out 2024-03-27T10:05:41.458 INFO:teuthology.orchestra.run.smithi057.stdout:130 2024-03-27T10:05:41.458 INFO:teuthology.orchestra.run.smithi057.stdout:130.out 2024-03-27T10:05:41.458 INFO:teuthology.orchestra.run.smithi057.stdout:131 2024-03-27T10:05:41.458 INFO:teuthology.orchestra.run.smithi057.stdout:131.out 2024-03-27T10:05:41.458 INFO:teuthology.orchestra.run.smithi057.stdout:132 2024-03-27T10:05:41.459 INFO:teuthology.orchestra.run.smithi057.stdout:132.out 2024-03-27T10:05:41.459 INFO:teuthology.orchestra.run.smithi057.stdout:133 2024-03-27T10:05:41.459 INFO:teuthology.orchestra.run.smithi057.stdout:133.out 2024-03-27T10:05:41.459 INFO:teuthology.orchestra.run.smithi057.stdout:134 2024-03-27T10:05:41.459 INFO:teuthology.orchestra.run.smithi057.stdout:134.out 2024-03-27T10:05:41.459 INFO:teuthology.orchestra.run.smithi057.stdout:135 2024-03-27T10:05:41.459 INFO:teuthology.orchestra.run.smithi057.stdout:135.out 2024-03-27T10:05:41.459 INFO:teuthology.orchestra.run.smithi057.stdout:136 2024-03-27T10:05:41.459 INFO:teuthology.orchestra.run.smithi057.stdout:136.out 2024-03-27T10:05:41.459 INFO:teuthology.orchestra.run.smithi057.stdout:137 2024-03-27T10:05:41.459 INFO:teuthology.orchestra.run.smithi057.stdout:137.out 2024-03-27T10:05:41.459 INFO:teuthology.orchestra.run.smithi057.stdout:138 2024-03-27T10:05:41.459 INFO:teuthology.orchestra.run.smithi057.stdout:138.out 2024-03-27T10:05:41.459 INFO:teuthology.orchestra.run.smithi057.stdout:139 2024-03-27T10:05:41.459 INFO:teuthology.orchestra.run.smithi057.stdout:139.out 2024-03-27T10:05:41.460 INFO:teuthology.orchestra.run.smithi057.stdout:140 2024-03-27T10:05:41.460 INFO:teuthology.orchestra.run.smithi057.stdout:140.out 2024-03-27T10:05:41.460 INFO:teuthology.orchestra.run.smithi057.stdout:141 2024-03-27T10:05:41.460 INFO:teuthology.orchestra.run.smithi057.stdout:141.out 2024-03-27T10:05:41.460 INFO:teuthology.orchestra.run.smithi057.stdout:142 2024-03-27T10:05:41.460 INFO:teuthology.orchestra.run.smithi057.stdout:142.out 2024-03-27T10:05:41.460 INFO:teuthology.orchestra.run.smithi057.stdout:143 2024-03-27T10:05:41.460 INFO:teuthology.orchestra.run.smithi057.stdout:143.out 2024-03-27T10:05:41.460 INFO:teuthology.orchestra.run.smithi057.stdout:144 2024-03-27T10:05:41.460 INFO:teuthology.orchestra.run.smithi057.stdout:144.out 2024-03-27T10:05:41.460 INFO:teuthology.orchestra.run.smithi057.stdout:145 2024-03-27T10:05:41.460 INFO:teuthology.orchestra.run.smithi057.stdout:145.out 2024-03-27T10:05:41.460 INFO:teuthology.orchestra.run.smithi057.stdout:146 2024-03-27T10:05:41.460 INFO:teuthology.orchestra.run.smithi057.stdout:146.out 2024-03-27T10:05:41.461 INFO:teuthology.orchestra.run.smithi057.stdout:147 2024-03-27T10:05:41.461 INFO:teuthology.orchestra.run.smithi057.stdout:147.out 2024-03-27T10:05:41.461 INFO:teuthology.orchestra.run.smithi057.stdout:148 2024-03-27T10:05:41.461 INFO:teuthology.orchestra.run.smithi057.stdout:148.out 2024-03-27T10:05:41.461 INFO:teuthology.orchestra.run.smithi057.stdout:149 2024-03-27T10:05:41.461 INFO:teuthology.orchestra.run.smithi057.stdout:149.out 2024-03-27T10:05:41.461 INFO:teuthology.orchestra.run.smithi057.stdout:150 2024-03-27T10:05:41.461 INFO:teuthology.orchestra.run.smithi057.stdout:150.out 2024-03-27T10:05:41.461 INFO:teuthology.orchestra.run.smithi057.stdout:151 2024-03-27T10:05:41.461 INFO:teuthology.orchestra.run.smithi057.stdout:151.out 2024-03-27T10:05:41.461 INFO:teuthology.orchestra.run.smithi057.stdout:152 2024-03-27T10:05:41.461 INFO:teuthology.orchestra.run.smithi057.stdout:152.out 2024-03-27T10:05:41.461 INFO:teuthology.orchestra.run.smithi057.stdout:153 2024-03-27T10:05:41.461 INFO:teuthology.orchestra.run.smithi057.stdout:153.out 2024-03-27T10:05:41.461 INFO:teuthology.orchestra.run.smithi057.stdout:154 2024-03-27T10:05:41.461 INFO:teuthology.orchestra.run.smithi057.stdout:154.out 2024-03-27T10:05:41.462 INFO:teuthology.orchestra.run.smithi057.stdout:155 2024-03-27T10:05:41.462 INFO:teuthology.orchestra.run.smithi057.stdout:155.out 2024-03-27T10:05:41.462 INFO:teuthology.orchestra.run.smithi057.stdout:156 2024-03-27T10:05:41.462 INFO:teuthology.orchestra.run.smithi057.stdout:156.out 2024-03-27T10:05:41.462 INFO:teuthology.orchestra.run.smithi057.stdout:157 2024-03-27T10:05:41.462 INFO:teuthology.orchestra.run.smithi057.stdout:157.out 2024-03-27T10:05:41.462 INFO:teuthology.orchestra.run.smithi057.stdout:158 2024-03-27T10:05:41.462 INFO:teuthology.orchestra.run.smithi057.stdout:158.out 2024-03-27T10:05:41.462 INFO:teuthology.orchestra.run.smithi057.stdout:159 2024-03-27T10:05:41.462 INFO:teuthology.orchestra.run.smithi057.stdout:159.out 2024-03-27T10:05:41.462 INFO:teuthology.orchestra.run.smithi057.stdout:160 2024-03-27T10:05:41.462 INFO:teuthology.orchestra.run.smithi057.stdout:160.out 2024-03-27T10:05:41.462 INFO:teuthology.orchestra.run.smithi057.stdout:161 2024-03-27T10:05:41.462 INFO:teuthology.orchestra.run.smithi057.stdout:161.out 2024-03-27T10:05:41.462 INFO:teuthology.orchestra.run.smithi057.stdout:162 2024-03-27T10:05:41.463 INFO:teuthology.orchestra.run.smithi057.stdout:162.out 2024-03-27T10:05:41.463 INFO:teuthology.orchestra.run.smithi057.stdout:163 2024-03-27T10:05:41.463 INFO:teuthology.orchestra.run.smithi057.stdout:163.out 2024-03-27T10:05:41.463 INFO:teuthology.orchestra.run.smithi057.stdout:164 2024-03-27T10:05:41.463 INFO:teuthology.orchestra.run.smithi057.stdout:164.out 2024-03-27T10:05:41.463 INFO:teuthology.orchestra.run.smithi057.stdout:165 2024-03-27T10:05:41.463 INFO:teuthology.orchestra.run.smithi057.stdout:165.out 2024-03-27T10:05:41.463 INFO:teuthology.orchestra.run.smithi057.stdout:166 2024-03-27T10:05:41.463 INFO:teuthology.orchestra.run.smithi057.stdout:166.out 2024-03-27T10:05:41.463 INFO:teuthology.orchestra.run.smithi057.stdout:167 2024-03-27T10:05:41.463 INFO:teuthology.orchestra.run.smithi057.stdout:167.out 2024-03-27T10:05:41.463 INFO:teuthology.orchestra.run.smithi057.stdout:168 2024-03-27T10:05:41.463 INFO:teuthology.orchestra.run.smithi057.stdout:168.out 2024-03-27T10:05:41.463 INFO:teuthology.orchestra.run.smithi057.stdout:169 2024-03-27T10:05:41.464 INFO:teuthology.orchestra.run.smithi057.stdout:169.out 2024-03-27T10:05:41.464 INFO:teuthology.orchestra.run.smithi057.stdout:170 2024-03-27T10:05:41.464 INFO:teuthology.orchestra.run.smithi057.stdout:170.out 2024-03-27T10:05:41.464 INFO:teuthology.orchestra.run.smithi057.stdout:171 2024-03-27T10:05:41.464 INFO:teuthology.orchestra.run.smithi057.stdout:171.out 2024-03-27T10:05:41.464 INFO:teuthology.orchestra.run.smithi057.stdout:172 2024-03-27T10:05:41.464 INFO:teuthology.orchestra.run.smithi057.stdout:172.out 2024-03-27T10:05:41.464 INFO:teuthology.orchestra.run.smithi057.stdout:173 2024-03-27T10:05:41.464 INFO:teuthology.orchestra.run.smithi057.stdout:173.out 2024-03-27T10:05:41.464 INFO:teuthology.orchestra.run.smithi057.stdout:174 2024-03-27T10:05:41.464 INFO:teuthology.orchestra.run.smithi057.stdout:174.out 2024-03-27T10:05:41.464 INFO:teuthology.orchestra.run.smithi057.stdout:175 2024-03-27T10:05:41.464 INFO:teuthology.orchestra.run.smithi057.stdout:175.out 2024-03-27T10:05:41.464 INFO:teuthology.orchestra.run.smithi057.stdout:176 2024-03-27T10:05:41.464 INFO:teuthology.orchestra.run.smithi057.stdout:176.out 2024-03-27T10:05:41.465 INFO:teuthology.orchestra.run.smithi057.stdout:177 2024-03-27T10:05:41.465 INFO:teuthology.orchestra.run.smithi057.stdout:177.out 2024-03-27T10:05:41.465 INFO:teuthology.orchestra.run.smithi057.stdout:178 2024-03-27T10:05:41.465 INFO:teuthology.orchestra.run.smithi057.stdout:178.out 2024-03-27T10:05:41.465 INFO:teuthology.orchestra.run.smithi057.stdout:179 2024-03-27T10:05:41.465 INFO:teuthology.orchestra.run.smithi057.stdout:179.out 2024-03-27T10:05:41.465 INFO:teuthology.orchestra.run.smithi057.stdout:180 2024-03-27T10:05:41.465 INFO:teuthology.orchestra.run.smithi057.stdout:180.out 2024-03-27T10:05:41.465 INFO:teuthology.orchestra.run.smithi057.stdout:181 2024-03-27T10:05:41.465 INFO:teuthology.orchestra.run.smithi057.stdout:181.out 2024-03-27T10:05:41.465 INFO:teuthology.orchestra.run.smithi057.stdout:182 2024-03-27T10:05:41.465 INFO:teuthology.orchestra.run.smithi057.stdout:182.out 2024-03-27T10:05:41.465 INFO:teuthology.orchestra.run.smithi057.stdout:183 2024-03-27T10:05:41.465 INFO:teuthology.orchestra.run.smithi057.stdout:183.out 2024-03-27T10:05:41.466 INFO:teuthology.orchestra.run.smithi057.stdout:184 2024-03-27T10:05:41.466 INFO:teuthology.orchestra.run.smithi057.stdout:184.out 2024-03-27T10:05:41.466 INFO:teuthology.orchestra.run.smithi057.stdout:185 2024-03-27T10:05:41.466 INFO:teuthology.orchestra.run.smithi057.stdout:185.out 2024-03-27T10:05:41.466 INFO:teuthology.orchestra.run.smithi057.stdout:186 2024-03-27T10:05:41.466 INFO:teuthology.orchestra.run.smithi057.stdout:186.out 2024-03-27T10:05:41.466 INFO:teuthology.orchestra.run.smithi057.stdout:187 2024-03-27T10:05:41.466 INFO:teuthology.orchestra.run.smithi057.stdout:187.out 2024-03-27T10:05:41.466 INFO:teuthology.orchestra.run.smithi057.stdout:188 2024-03-27T10:05:41.466 INFO:teuthology.orchestra.run.smithi057.stdout:188.out 2024-03-27T10:05:41.466 INFO:teuthology.orchestra.run.smithi057.stdout:189 2024-03-27T10:05:41.466 INFO:teuthology.orchestra.run.smithi057.stdout:189.out 2024-03-27T10:05:41.466 INFO:teuthology.orchestra.run.smithi057.stdout:190 2024-03-27T10:05:41.466 INFO:teuthology.orchestra.run.smithi057.stdout:190.out 2024-03-27T10:05:41.467 INFO:teuthology.orchestra.run.smithi057.stdout:191 2024-03-27T10:05:41.467 INFO:teuthology.orchestra.run.smithi057.stdout:191.out 2024-03-27T10:05:41.467 INFO:teuthology.orchestra.run.smithi057.stdout:192 2024-03-27T10:05:41.467 INFO:teuthology.orchestra.run.smithi057.stdout:192.out 2024-03-27T10:05:41.467 INFO:teuthology.orchestra.run.smithi057.stdout:193 2024-03-27T10:05:41.467 INFO:teuthology.orchestra.run.smithi057.stdout:193.out 2024-03-27T10:05:41.467 INFO:teuthology.orchestra.run.smithi057.stdout:194 2024-03-27T10:05:41.467 INFO:teuthology.orchestra.run.smithi057.stdout:194.out 2024-03-27T10:05:41.467 INFO:teuthology.orchestra.run.smithi057.stdout:195 2024-03-27T10:05:41.467 INFO:teuthology.orchestra.run.smithi057.stdout:195.out 2024-03-27T10:05:41.467 INFO:teuthology.orchestra.run.smithi057.stdout:196 2024-03-27T10:05:41.467 INFO:teuthology.orchestra.run.smithi057.stdout:196.out 2024-03-27T10:05:41.467 INFO:teuthology.orchestra.run.smithi057.stdout:197 2024-03-27T10:05:41.467 INFO:teuthology.orchestra.run.smithi057.stdout:197.out 2024-03-27T10:05:41.467 INFO:teuthology.orchestra.run.smithi057.stdout:198 2024-03-27T10:05:41.468 INFO:teuthology.orchestra.run.smithi057.stdout:198.out 2024-03-27T10:05:41.468 INFO:teuthology.orchestra.run.smithi057.stdout:199 2024-03-27T10:05:41.468 INFO:teuthology.orchestra.run.smithi057.stdout:199.out 2024-03-27T10:05:41.468 INFO:teuthology.orchestra.run.smithi057.stdout:200 2024-03-27T10:05:41.468 INFO:teuthology.orchestra.run.smithi057.stdout:200.out 2024-03-27T10:05:41.468 INFO:teuthology.orchestra.run.smithi057.stdout:201 2024-03-27T10:05:41.468 INFO:teuthology.orchestra.run.smithi057.stdout:201.out 2024-03-27T10:05:41.468 INFO:teuthology.orchestra.run.smithi057.stdout:202 2024-03-27T10:05:41.468 INFO:teuthology.orchestra.run.smithi057.stdout:202.out 2024-03-27T10:05:41.468 INFO:teuthology.orchestra.run.smithi057.stdout:203 2024-03-27T10:05:41.468 INFO:teuthology.orchestra.run.smithi057.stdout:203.out 2024-03-27T10:05:41.468 INFO:teuthology.orchestra.run.smithi057.stdout:204 2024-03-27T10:05:41.468 INFO:teuthology.orchestra.run.smithi057.stdout:204.out 2024-03-27T10:05:41.468 INFO:teuthology.orchestra.run.smithi057.stdout:205 2024-03-27T10:05:41.469 INFO:teuthology.orchestra.run.smithi057.stdout:205.out 2024-03-27T10:05:41.469 INFO:teuthology.orchestra.run.smithi057.stdout:206 2024-03-27T10:05:41.469 INFO:teuthology.orchestra.run.smithi057.stdout:206.out 2024-03-27T10:05:41.469 INFO:teuthology.orchestra.run.smithi057.stdout:207 2024-03-27T10:05:41.469 INFO:teuthology.orchestra.run.smithi057.stdout:207.out 2024-03-27T10:05:41.469 INFO:teuthology.orchestra.run.smithi057.stdout:208 2024-03-27T10:05:41.469 INFO:teuthology.orchestra.run.smithi057.stdout:208.out 2024-03-27T10:05:41.469 INFO:teuthology.orchestra.run.smithi057.stdout:209 2024-03-27T10:05:41.469 INFO:teuthology.orchestra.run.smithi057.stdout:209.out 2024-03-27T10:05:41.469 INFO:teuthology.orchestra.run.smithi057.stdout:210 2024-03-27T10:05:41.469 INFO:teuthology.orchestra.run.smithi057.stdout:210.out 2024-03-27T10:05:41.469 INFO:teuthology.orchestra.run.smithi057.stdout:211 2024-03-27T10:05:41.469 INFO:teuthology.orchestra.run.smithi057.stdout:211.out 2024-03-27T10:05:41.469 INFO:teuthology.orchestra.run.smithi057.stdout:212 2024-03-27T10:05:41.469 INFO:teuthology.orchestra.run.smithi057.stdout:212.out 2024-03-27T10:05:41.470 INFO:teuthology.orchestra.run.smithi057.stdout:213 2024-03-27T10:05:41.470 INFO:teuthology.orchestra.run.smithi057.stdout:213.out 2024-03-27T10:05:41.470 INFO:teuthology.orchestra.run.smithi057.stdout:214 2024-03-27T10:05:41.470 INFO:teuthology.orchestra.run.smithi057.stdout:214.out 2024-03-27T10:05:41.470 INFO:teuthology.orchestra.run.smithi057.stdout:215 2024-03-27T10:05:41.470 INFO:teuthology.orchestra.run.smithi057.stdout:215.out 2024-03-27T10:05:41.470 INFO:teuthology.orchestra.run.smithi057.stdout:216 2024-03-27T10:05:41.470 INFO:teuthology.orchestra.run.smithi057.stdout:216.out 2024-03-27T10:05:41.470 INFO:teuthology.orchestra.run.smithi057.stdout:217 2024-03-27T10:05:41.470 INFO:teuthology.orchestra.run.smithi057.stdout:217.out 2024-03-27T10:05:41.470 INFO:teuthology.orchestra.run.smithi057.stdout:218 2024-03-27T10:05:41.470 INFO:teuthology.orchestra.run.smithi057.stdout:218.out 2024-03-27T10:05:41.470 INFO:teuthology.orchestra.run.smithi057.stdout:219 2024-03-27T10:05:41.471 INFO:teuthology.orchestra.run.smithi057.stdout:219.out 2024-03-27T10:05:41.471 INFO:teuthology.orchestra.run.smithi057.stdout:220 2024-03-27T10:05:41.471 INFO:teuthology.orchestra.run.smithi057.stdout:220.out 2024-03-27T10:05:41.471 INFO:teuthology.orchestra.run.smithi057.stdout:221 2024-03-27T10:05:41.471 INFO:teuthology.orchestra.run.smithi057.stdout:221.out 2024-03-27T10:05:41.471 INFO:teuthology.orchestra.run.smithi057.stdout:222 2024-03-27T10:05:41.471 INFO:teuthology.orchestra.run.smithi057.stdout:222.out 2024-03-27T10:05:41.471 INFO:teuthology.orchestra.run.smithi057.stdout:223 2024-03-27T10:05:41.471 INFO:teuthology.orchestra.run.smithi057.stdout:223.out 2024-03-27T10:05:41.471 INFO:teuthology.orchestra.run.smithi057.stdout:224 2024-03-27T10:05:41.471 INFO:teuthology.orchestra.run.smithi057.stdout:224.out 2024-03-27T10:05:41.471 INFO:teuthology.orchestra.run.smithi057.stdout:225 2024-03-27T10:05:41.471 INFO:teuthology.orchestra.run.smithi057.stdout:225.out 2024-03-27T10:05:41.471 INFO:teuthology.orchestra.run.smithi057.stdout:226 2024-03-27T10:05:41.472 INFO:teuthology.orchestra.run.smithi057.stdout:226.out 2024-03-27T10:05:41.472 INFO:teuthology.orchestra.run.smithi057.stdout:227 2024-03-27T10:05:41.472 INFO:teuthology.orchestra.run.smithi057.stdout:227.out 2024-03-27T10:05:41.472 INFO:teuthology.orchestra.run.smithi057.stdout:228 2024-03-27T10:05:41.472 INFO:teuthology.orchestra.run.smithi057.stdout:228.out 2024-03-27T10:05:41.472 INFO:teuthology.orchestra.run.smithi057.stdout:229 2024-03-27T10:05:41.472 INFO:teuthology.orchestra.run.smithi057.stdout:229.out 2024-03-27T10:05:41.472 INFO:teuthology.orchestra.run.smithi057.stdout:230 2024-03-27T10:05:41.472 INFO:teuthology.orchestra.run.smithi057.stdout:230.out 2024-03-27T10:05:41.472 INFO:teuthology.orchestra.run.smithi057.stdout:231 2024-03-27T10:05:41.472 INFO:teuthology.orchestra.run.smithi057.stdout:231.out 2024-03-27T10:05:41.472 INFO:teuthology.orchestra.run.smithi057.stdout:232 2024-03-27T10:05:41.472 INFO:teuthology.orchestra.run.smithi057.stdout:232.out 2024-03-27T10:05:41.472 INFO:teuthology.orchestra.run.smithi057.stdout:233 2024-03-27T10:05:41.473 INFO:teuthology.orchestra.run.smithi057.stdout:233.out 2024-03-27T10:05:41.473 INFO:teuthology.orchestra.run.smithi057.stdout:234 2024-03-27T10:05:41.473 INFO:teuthology.orchestra.run.smithi057.stdout:234.out 2024-03-27T10:05:41.473 INFO:teuthology.orchestra.run.smithi057.stdout:235 2024-03-27T10:05:41.473 INFO:teuthology.orchestra.run.smithi057.stdout:235.out 2024-03-27T10:05:41.473 INFO:teuthology.orchestra.run.smithi057.stdout:236 2024-03-27T10:05:41.473 INFO:teuthology.orchestra.run.smithi057.stdout:236.out 2024-03-27T10:05:41.473 INFO:teuthology.orchestra.run.smithi057.stdout:237 2024-03-27T10:05:41.473 INFO:teuthology.orchestra.run.smithi057.stdout:237.out 2024-03-27T10:05:41.473 INFO:teuthology.orchestra.run.smithi057.stdout:238 2024-03-27T10:05:41.473 INFO:teuthology.orchestra.run.smithi057.stdout:238.out 2024-03-27T10:05:41.473 INFO:teuthology.orchestra.run.smithi057.stdout:239 2024-03-27T10:05:41.473 INFO:teuthology.orchestra.run.smithi057.stdout:239.out 2024-03-27T10:05:41.473 INFO:teuthology.orchestra.run.smithi057.stdout:240 2024-03-27T10:05:41.473 INFO:teuthology.orchestra.run.smithi057.stdout:240.out 2024-03-27T10:05:41.473 INFO:teuthology.orchestra.run.smithi057.stdout:241 2024-03-27T10:05:41.474 INFO:teuthology.orchestra.run.smithi057.stdout:241.out 2024-03-27T10:05:41.474 INFO:teuthology.orchestra.run.smithi057.stdout:242 2024-03-27T10:05:41.474 INFO:teuthology.orchestra.run.smithi057.stdout:242.out 2024-03-27T10:05:41.474 INFO:teuthology.orchestra.run.smithi057.stdout:243 2024-03-27T10:05:41.474 INFO:teuthology.orchestra.run.smithi057.stdout:243.out 2024-03-27T10:05:41.474 INFO:teuthology.orchestra.run.smithi057.stdout:244 2024-03-27T10:05:41.474 INFO:teuthology.orchestra.run.smithi057.stdout:244.out 2024-03-27T10:05:41.474 INFO:teuthology.orchestra.run.smithi057.stdout:245 2024-03-27T10:05:41.474 INFO:teuthology.orchestra.run.smithi057.stdout:245.out 2024-03-27T10:05:41.474 INFO:teuthology.orchestra.run.smithi057.stdout:246 2024-03-27T10:05:41.474 INFO:teuthology.orchestra.run.smithi057.stdout:246.out 2024-03-27T10:05:41.474 INFO:teuthology.orchestra.run.smithi057.stdout:247 2024-03-27T10:05:41.474 INFO:teuthology.orchestra.run.smithi057.stdout:247.out 2024-03-27T10:05:41.474 INFO:teuthology.orchestra.run.smithi057.stdout:248 2024-03-27T10:05:41.475 INFO:teuthology.orchestra.run.smithi057.stdout:248.out 2024-03-27T10:05:41.475 INFO:teuthology.orchestra.run.smithi057.stdout:249 2024-03-27T10:05:41.475 INFO:teuthology.orchestra.run.smithi057.stdout:249.out 2024-03-27T10:05:41.475 INFO:teuthology.orchestra.run.smithi057.stdout:250 2024-03-27T10:05:41.475 INFO:teuthology.orchestra.run.smithi057.stdout:250.out 2024-03-27T10:05:41.475 INFO:teuthology.orchestra.run.smithi057.stdout:251 2024-03-27T10:05:41.475 INFO:teuthology.orchestra.run.smithi057.stdout:251.out 2024-03-27T10:05:41.475 INFO:teuthology.orchestra.run.smithi057.stdout:252 2024-03-27T10:05:41.475 INFO:teuthology.orchestra.run.smithi057.stdout:252.out 2024-03-27T10:05:41.475 INFO:teuthology.orchestra.run.smithi057.stdout:253 2024-03-27T10:05:41.475 INFO:teuthology.orchestra.run.smithi057.stdout:253.out 2024-03-27T10:05:41.475 INFO:teuthology.orchestra.run.smithi057.stdout:254 2024-03-27T10:05:41.475 INFO:teuthology.orchestra.run.smithi057.stdout:254.out 2024-03-27T10:05:41.475 INFO:teuthology.orchestra.run.smithi057.stdout:255 2024-03-27T10:05:41.475 INFO:teuthology.orchestra.run.smithi057.stdout:255.out 2024-03-27T10:05:41.476 INFO:teuthology.orchestra.run.smithi057.stdout:256 2024-03-27T10:05:41.476 INFO:teuthology.orchestra.run.smithi057.stdout:256.out 2024-03-27T10:05:41.476 INFO:teuthology.orchestra.run.smithi057.stdout:257 2024-03-27T10:05:41.476 INFO:teuthology.orchestra.run.smithi057.stdout:257.out 2024-03-27T10:05:41.476 INFO:teuthology.orchestra.run.smithi057.stdout:258 2024-03-27T10:05:41.476 INFO:teuthology.orchestra.run.smithi057.stdout:258.out 2024-03-27T10:05:41.476 INFO:teuthology.orchestra.run.smithi057.stdout:259 2024-03-27T10:05:41.476 INFO:teuthology.orchestra.run.smithi057.stdout:259.out 2024-03-27T10:05:41.476 INFO:teuthology.orchestra.run.smithi057.stdout:260 2024-03-27T10:05:41.476 INFO:teuthology.orchestra.run.smithi057.stdout:260.out 2024-03-27T10:05:41.476 INFO:teuthology.orchestra.run.smithi057.stdout:261 2024-03-27T10:05:41.476 INFO:teuthology.orchestra.run.smithi057.stdout:261.out 2024-03-27T10:05:41.476 INFO:teuthology.orchestra.run.smithi057.stdout:262 2024-03-27T10:05:41.476 INFO:teuthology.orchestra.run.smithi057.stdout:262.out 2024-03-27T10:05:41.476 INFO:teuthology.orchestra.run.smithi057.stdout:263 2024-03-27T10:05:41.477 INFO:teuthology.orchestra.run.smithi057.stdout:263.out 2024-03-27T10:05:41.477 INFO:teuthology.orchestra.run.smithi057.stdout:264 2024-03-27T10:05:41.477 INFO:teuthology.orchestra.run.smithi057.stdout:264.out 2024-03-27T10:05:41.477 INFO:teuthology.orchestra.run.smithi057.stdout:265 2024-03-27T10:05:41.477 INFO:teuthology.orchestra.run.smithi057.stdout:265.out 2024-03-27T10:05:41.477 INFO:teuthology.orchestra.run.smithi057.stdout:266 2024-03-27T10:05:41.477 INFO:teuthology.orchestra.run.smithi057.stdout:266.out 2024-03-27T10:05:41.477 INFO:teuthology.orchestra.run.smithi057.stdout:267 2024-03-27T10:05:41.477 INFO:teuthology.orchestra.run.smithi057.stdout:267.out 2024-03-27T10:05:41.477 INFO:teuthology.orchestra.run.smithi057.stdout:268 2024-03-27T10:05:41.477 INFO:teuthology.orchestra.run.smithi057.stdout:268.out 2024-03-27T10:05:41.477 INFO:teuthology.orchestra.run.smithi057.stdout:269 2024-03-27T10:05:41.477 INFO:teuthology.orchestra.run.smithi057.stdout:269.out 2024-03-27T10:05:41.477 INFO:teuthology.orchestra.run.smithi057.stdout:270 2024-03-27T10:05:41.477 INFO:teuthology.orchestra.run.smithi057.stdout:270.out 2024-03-27T10:05:41.478 INFO:teuthology.orchestra.run.smithi057.stdout:271 2024-03-27T10:05:41.478 INFO:teuthology.orchestra.run.smithi057.stdout:271.out 2024-03-27T10:05:41.478 INFO:teuthology.orchestra.run.smithi057.stdout:272 2024-03-27T10:05:41.478 INFO:teuthology.orchestra.run.smithi057.stdout:272.out 2024-03-27T10:05:41.478 INFO:teuthology.orchestra.run.smithi057.stdout:273 2024-03-27T10:05:41.478 INFO:teuthology.orchestra.run.smithi057.stdout:273.out 2024-03-27T10:05:41.478 INFO:teuthology.orchestra.run.smithi057.stdout:274 2024-03-27T10:05:41.478 INFO:teuthology.orchestra.run.smithi057.stdout:274.out 2024-03-27T10:05:41.478 INFO:teuthology.orchestra.run.smithi057.stdout:275 2024-03-27T10:05:41.478 INFO:teuthology.orchestra.run.smithi057.stdout:275.out 2024-03-27T10:05:41.478 INFO:teuthology.orchestra.run.smithi057.stdout:276 2024-03-27T10:05:41.478 INFO:teuthology.orchestra.run.smithi057.stdout:276.out 2024-03-27T10:05:41.478 INFO:teuthology.orchestra.run.smithi057.stdout:277 2024-03-27T10:05:41.478 INFO:teuthology.orchestra.run.smithi057.stdout:277.out 2024-03-27T10:05:41.479 INFO:teuthology.orchestra.run.smithi057.stdout:278 2024-03-27T10:05:41.479 INFO:teuthology.orchestra.run.smithi057.stdout:278.out 2024-03-27T10:05:41.479 INFO:teuthology.orchestra.run.smithi057.stdout:279 2024-03-27T10:05:41.479 INFO:teuthology.orchestra.run.smithi057.stdout:279.out 2024-03-27T10:05:41.479 INFO:teuthology.orchestra.run.smithi057.stdout:280 2024-03-27T10:05:41.479 INFO:teuthology.orchestra.run.smithi057.stdout:280.out 2024-03-27T10:05:41.479 INFO:teuthology.orchestra.run.smithi057.stdout:281 2024-03-27T10:05:41.479 INFO:teuthology.orchestra.run.smithi057.stdout:281.out 2024-03-27T10:05:41.479 INFO:teuthology.orchestra.run.smithi057.stdout:282 2024-03-27T10:05:41.479 INFO:teuthology.orchestra.run.smithi057.stdout:282.out 2024-03-27T10:05:41.479 INFO:teuthology.orchestra.run.smithi057.stdout:283 2024-03-27T10:05:41.479 INFO:teuthology.orchestra.run.smithi057.stdout:283.out 2024-03-27T10:05:41.479 INFO:teuthology.orchestra.run.smithi057.stdout:284 2024-03-27T10:05:41.479 INFO:teuthology.orchestra.run.smithi057.stdout:284.out 2024-03-27T10:05:41.480 INFO:teuthology.orchestra.run.smithi057.stdout:285 2024-03-27T10:05:41.480 INFO:teuthology.orchestra.run.smithi057.stdout:285.out 2024-03-27T10:05:41.480 INFO:teuthology.orchestra.run.smithi057.stdout:286 2024-03-27T10:05:41.480 INFO:teuthology.orchestra.run.smithi057.stdout:286.out 2024-03-27T10:05:41.480 INFO:teuthology.orchestra.run.smithi057.stdout:287 2024-03-27T10:05:41.480 INFO:teuthology.orchestra.run.smithi057.stdout:287.out 2024-03-27T10:05:41.480 INFO:teuthology.orchestra.run.smithi057.stdout:288 2024-03-27T10:05:41.480 INFO:teuthology.orchestra.run.smithi057.stdout:288.out 2024-03-27T10:05:41.480 INFO:teuthology.orchestra.run.smithi057.stdout:289 2024-03-27T10:05:41.480 INFO:teuthology.orchestra.run.smithi057.stdout:289.out 2024-03-27T10:05:41.480 INFO:teuthology.orchestra.run.smithi057.stdout:290 2024-03-27T10:05:41.480 INFO:teuthology.orchestra.run.smithi057.stdout:290.out 2024-03-27T10:05:41.480 INFO:teuthology.orchestra.run.smithi057.stdout:291 2024-03-27T10:05:41.480 INFO:teuthology.orchestra.run.smithi057.stdout:291.out 2024-03-27T10:05:41.480 INFO:teuthology.orchestra.run.smithi057.stdout:292 2024-03-27T10:05:41.480 INFO:teuthology.orchestra.run.smithi057.stdout:292.out 2024-03-27T10:05:41.481 INFO:teuthology.orchestra.run.smithi057.stdout:293 2024-03-27T10:05:41.481 INFO:teuthology.orchestra.run.smithi057.stdout:293.out 2024-03-27T10:05:41.481 INFO:teuthology.orchestra.run.smithi057.stdout:294 2024-03-27T10:05:41.481 INFO:teuthology.orchestra.run.smithi057.stdout:294.out 2024-03-27T10:05:41.481 INFO:teuthology.orchestra.run.smithi057.stdout:295 2024-03-27T10:05:41.481 INFO:teuthology.orchestra.run.smithi057.stdout:295.out 2024-03-27T10:05:41.481 INFO:teuthology.orchestra.run.smithi057.stdout:296 2024-03-27T10:05:41.481 INFO:teuthology.orchestra.run.smithi057.stdout:296.out 2024-03-27T10:05:41.481 INFO:teuthology.orchestra.run.smithi057.stdout:297 2024-03-27T10:05:41.481 INFO:teuthology.orchestra.run.smithi057.stdout:297.out 2024-03-27T10:05:41.481 INFO:teuthology.orchestra.run.smithi057.stdout:298 2024-03-27T10:05:41.481 INFO:teuthology.orchestra.run.smithi057.stdout:298.out 2024-03-27T10:05:41.481 INFO:teuthology.orchestra.run.smithi057.stdout:299 2024-03-27T10:05:41.481 INFO:teuthology.orchestra.run.smithi057.stdout:299.out 2024-03-27T10:05:41.481 INFO:teuthology.orchestra.run.smithi057.stdout:300 2024-03-27T10:05:41.482 INFO:teuthology.orchestra.run.smithi057.stdout:300.out 2024-03-27T10:05:41.482 INFO:teuthology.orchestra.run.smithi057.stdout:301 2024-03-27T10:05:41.482 INFO:teuthology.orchestra.run.smithi057.stdout:301.out 2024-03-27T10:05:41.482 INFO:teuthology.orchestra.run.smithi057.stdout:302 2024-03-27T10:05:41.482 INFO:teuthology.orchestra.run.smithi057.stdout:302.out 2024-03-27T10:05:41.482 INFO:teuthology.orchestra.run.smithi057.stdout:303 2024-03-27T10:05:41.482 INFO:teuthology.orchestra.run.smithi057.stdout:303.out 2024-03-27T10:05:41.482 INFO:teuthology.orchestra.run.smithi057.stdout:304 2024-03-27T10:05:41.482 INFO:teuthology.orchestra.run.smithi057.stdout:304.out 2024-03-27T10:05:41.482 INFO:teuthology.orchestra.run.smithi057.stdout:305 2024-03-27T10:05:41.482 INFO:teuthology.orchestra.run.smithi057.stdout:305.out 2024-03-27T10:05:41.482 INFO:teuthology.orchestra.run.smithi057.stdout:306 2024-03-27T10:05:41.482 INFO:teuthology.orchestra.run.smithi057.stdout:306.out 2024-03-27T10:05:41.482 INFO:teuthology.orchestra.run.smithi057.stdout:307 2024-03-27T10:05:41.483 INFO:teuthology.orchestra.run.smithi057.stdout:307.out 2024-03-27T10:05:41.483 INFO:teuthology.orchestra.run.smithi057.stdout:308 2024-03-27T10:05:41.483 INFO:teuthology.orchestra.run.smithi057.stdout:308.out 2024-03-27T10:05:41.483 INFO:teuthology.orchestra.run.smithi057.stdout:309 2024-03-27T10:05:41.483 INFO:teuthology.orchestra.run.smithi057.stdout:309.out 2024-03-27T10:05:41.483 INFO:teuthology.orchestra.run.smithi057.stdout:310 2024-03-27T10:05:41.483 INFO:teuthology.orchestra.run.smithi057.stdout:310.out 2024-03-27T10:05:41.483 INFO:teuthology.orchestra.run.smithi057.stdout:311 2024-03-27T10:05:41.483 INFO:teuthology.orchestra.run.smithi057.stdout:311.out 2024-03-27T10:05:41.483 INFO:teuthology.orchestra.run.smithi057.stdout:312 2024-03-27T10:05:41.483 INFO:teuthology.orchestra.run.smithi057.stdout:312.out 2024-03-27T10:05:41.483 INFO:teuthology.orchestra.run.smithi057.stdout:313 2024-03-27T10:05:41.483 INFO:teuthology.orchestra.run.smithi057.stdout:313.out 2024-03-27T10:05:41.483 INFO:teuthology.orchestra.run.smithi057.stdout:314 2024-03-27T10:05:41.484 INFO:teuthology.orchestra.run.smithi057.stdout:314.out 2024-03-27T10:05:41.484 INFO:teuthology.orchestra.run.smithi057.stdout:315 2024-03-27T10:05:41.484 INFO:teuthology.orchestra.run.smithi057.stdout:315.out 2024-03-27T10:05:41.484 INFO:teuthology.orchestra.run.smithi057.stdout:316 2024-03-27T10:05:41.484 INFO:teuthology.orchestra.run.smithi057.stdout:316.out 2024-03-27T10:05:41.484 INFO:teuthology.orchestra.run.smithi057.stdout:317 2024-03-27T10:05:41.484 INFO:teuthology.orchestra.run.smithi057.stdout:317.out 2024-03-27T10:05:41.484 INFO:teuthology.orchestra.run.smithi057.stdout:318 2024-03-27T10:05:41.484 INFO:teuthology.orchestra.run.smithi057.stdout:318.out 2024-03-27T10:05:41.484 INFO:teuthology.orchestra.run.smithi057.stdout:319 2024-03-27T10:05:41.484 INFO:teuthology.orchestra.run.smithi057.stdout:319.out 2024-03-27T10:05:41.484 INFO:teuthology.orchestra.run.smithi057.stdout:320 2024-03-27T10:05:41.484 INFO:teuthology.orchestra.run.smithi057.stdout:320.out 2024-03-27T10:05:41.484 INFO:teuthology.orchestra.run.smithi057.stdout:321 2024-03-27T10:05:41.484 INFO:teuthology.orchestra.run.smithi057.stdout:321.out 2024-03-27T10:05:41.485 INFO:teuthology.orchestra.run.smithi057.stdout:322 2024-03-27T10:05:41.485 INFO:teuthology.orchestra.run.smithi057.stdout:322.out 2024-03-27T10:05:41.485 INFO:teuthology.orchestra.run.smithi057.stdout:323 2024-03-27T10:05:41.485 INFO:teuthology.orchestra.run.smithi057.stdout:323.out 2024-03-27T10:05:41.485 INFO:teuthology.orchestra.run.smithi057.stdout:324 2024-03-27T10:05:41.485 INFO:teuthology.orchestra.run.smithi057.stdout:324.out 2024-03-27T10:05:41.485 INFO:teuthology.orchestra.run.smithi057.stdout:325 2024-03-27T10:05:41.485 INFO:teuthology.orchestra.run.smithi057.stdout:325.out 2024-03-27T10:05:41.485 INFO:teuthology.orchestra.run.smithi057.stdout:326 2024-03-27T10:05:41.485 INFO:teuthology.orchestra.run.smithi057.stdout:326.out 2024-03-27T10:05:41.485 INFO:teuthology.orchestra.run.smithi057.stdout:327 2024-03-27T10:05:41.485 INFO:teuthology.orchestra.run.smithi057.stdout:327.out 2024-03-27T10:05:41.485 INFO:teuthology.orchestra.run.smithi057.stdout:328 2024-03-27T10:05:41.485 INFO:teuthology.orchestra.run.smithi057.stdout:328.out 2024-03-27T10:05:41.485 INFO:teuthology.orchestra.run.smithi057.stdout:329 2024-03-27T10:05:41.486 INFO:teuthology.orchestra.run.smithi057.stdout:329.out 2024-03-27T10:05:41.486 INFO:teuthology.orchestra.run.smithi057.stdout:330 2024-03-27T10:05:41.486 INFO:teuthology.orchestra.run.smithi057.stdout:330.out 2024-03-27T10:05:41.486 INFO:teuthology.orchestra.run.smithi057.stdout:331 2024-03-27T10:05:41.486 INFO:teuthology.orchestra.run.smithi057.stdout:331.out 2024-03-27T10:05:41.486 INFO:teuthology.orchestra.run.smithi057.stdout:332 2024-03-27T10:05:41.486 INFO:teuthology.orchestra.run.smithi057.stdout:332.out 2024-03-27T10:05:41.486 INFO:teuthology.orchestra.run.smithi057.stdout:333 2024-03-27T10:05:41.486 INFO:teuthology.orchestra.run.smithi057.stdout:333.out 2024-03-27T10:05:41.486 INFO:teuthology.orchestra.run.smithi057.stdout:334 2024-03-27T10:05:41.486 INFO:teuthology.orchestra.run.smithi057.stdout:334.out 2024-03-27T10:05:41.486 INFO:teuthology.orchestra.run.smithi057.stdout:335 2024-03-27T10:05:41.486 INFO:teuthology.orchestra.run.smithi057.stdout:335.out 2024-03-27T10:05:41.486 INFO:teuthology.orchestra.run.smithi057.stdout:336 2024-03-27T10:05:41.487 INFO:teuthology.orchestra.run.smithi057.stdout:336.out 2024-03-27T10:05:41.487 INFO:teuthology.orchestra.run.smithi057.stdout:337 2024-03-27T10:05:41.487 INFO:teuthology.orchestra.run.smithi057.stdout:337.out 2024-03-27T10:05:41.487 INFO:teuthology.orchestra.run.smithi057.stdout:338 2024-03-27T10:05:41.487 INFO:teuthology.orchestra.run.smithi057.stdout:338.out 2024-03-27T10:05:41.487 INFO:teuthology.orchestra.run.smithi057.stdout:339 2024-03-27T10:05:41.487 INFO:teuthology.orchestra.run.smithi057.stdout:339.out 2024-03-27T10:05:41.487 INFO:teuthology.orchestra.run.smithi057.stdout:340 2024-03-27T10:05:41.487 INFO:teuthology.orchestra.run.smithi057.stdout:340.out 2024-03-27T10:05:41.487 INFO:teuthology.orchestra.run.smithi057.stdout:341 2024-03-27T10:05:41.487 INFO:teuthology.orchestra.run.smithi057.stdout:341.out 2024-03-27T10:05:41.487 INFO:teuthology.orchestra.run.smithi057.stdout:342 2024-03-27T10:05:41.487 INFO:teuthology.orchestra.run.smithi057.stdout:342.out 2024-03-27T10:05:41.487 INFO:teuthology.orchestra.run.smithi057.stdout:343 2024-03-27T10:05:41.487 INFO:teuthology.orchestra.run.smithi057.stdout:343.out 2024-03-27T10:05:41.488 INFO:teuthology.orchestra.run.smithi057.stdout:344 2024-03-27T10:05:41.488 INFO:teuthology.orchestra.run.smithi057.stdout:344.out 2024-03-27T10:05:41.488 INFO:teuthology.orchestra.run.smithi057.stdout:345 2024-03-27T10:05:41.488 INFO:teuthology.orchestra.run.smithi057.stdout:345.out 2024-03-27T10:05:41.488 INFO:teuthology.orchestra.run.smithi057.stdout:346 2024-03-27T10:05:41.488 INFO:teuthology.orchestra.run.smithi057.stdout:346.out 2024-03-27T10:05:41.488 INFO:teuthology.orchestra.run.smithi057.stdout:347 2024-03-27T10:05:41.488 INFO:teuthology.orchestra.run.smithi057.stdout:347.out 2024-03-27T10:05:41.488 INFO:teuthology.orchestra.run.smithi057.stdout:348 2024-03-27T10:05:41.488 INFO:teuthology.orchestra.run.smithi057.stdout:348.out 2024-03-27T10:05:41.488 INFO:teuthology.orchestra.run.smithi057.stdout:349 2024-03-27T10:05:41.488 INFO:teuthology.orchestra.run.smithi057.stdout:349.out 2024-03-27T10:05:41.488 INFO:teuthology.orchestra.run.smithi057.stdout:350 2024-03-27T10:05:41.488 INFO:teuthology.orchestra.run.smithi057.stdout:350.out 2024-03-27T10:05:41.488 INFO:teuthology.orchestra.run.smithi057.stdout:351 2024-03-27T10:05:41.489 INFO:teuthology.orchestra.run.smithi057.stdout:351.out 2024-03-27T10:05:41.489 INFO:teuthology.orchestra.run.smithi057.stdout:352 2024-03-27T10:05:41.489 INFO:teuthology.orchestra.run.smithi057.stdout:352.out 2024-03-27T10:05:41.489 INFO:teuthology.orchestra.run.smithi057.stdout:353 2024-03-27T10:05:41.489 INFO:teuthology.orchestra.run.smithi057.stdout:353.out 2024-03-27T10:05:41.489 INFO:teuthology.orchestra.run.smithi057.stdout:354 2024-03-27T10:05:41.489 INFO:teuthology.orchestra.run.smithi057.stdout:354.out 2024-03-27T10:05:41.489 INFO:teuthology.orchestra.run.smithi057.stdout:355 2024-03-27T10:05:41.489 INFO:teuthology.orchestra.run.smithi057.stdout:355.out 2024-03-27T10:05:41.489 INFO:teuthology.orchestra.run.smithi057.stdout:356 2024-03-27T10:05:41.489 INFO:teuthology.orchestra.run.smithi057.stdout:356.out 2024-03-27T10:05:41.489 INFO:teuthology.orchestra.run.smithi057.stdout:357 2024-03-27T10:05:41.489 INFO:teuthology.orchestra.run.smithi057.stdout:357.out 2024-03-27T10:05:41.489 INFO:teuthology.orchestra.run.smithi057.stdout:358 2024-03-27T10:05:41.490 INFO:teuthology.orchestra.run.smithi057.stdout:358.out 2024-03-27T10:05:41.490 INFO:teuthology.orchestra.run.smithi057.stdout:359 2024-03-27T10:05:41.490 INFO:teuthology.orchestra.run.smithi057.stdout:359.out 2024-03-27T10:05:41.490 INFO:teuthology.orchestra.run.smithi057.stdout:360 2024-03-27T10:05:41.490 INFO:teuthology.orchestra.run.smithi057.stdout:360.out 2024-03-27T10:05:41.490 INFO:teuthology.orchestra.run.smithi057.stdout:361 2024-03-27T10:05:41.490 INFO:teuthology.orchestra.run.smithi057.stdout:361.out 2024-03-27T10:05:41.490 INFO:teuthology.orchestra.run.smithi057.stdout:362 2024-03-27T10:05:41.490 INFO:teuthology.orchestra.run.smithi057.stdout:362.out 2024-03-27T10:05:41.490 INFO:teuthology.orchestra.run.smithi057.stdout:363 2024-03-27T10:05:41.490 INFO:teuthology.orchestra.run.smithi057.stdout:363.out 2024-03-27T10:05:41.490 INFO:teuthology.orchestra.run.smithi057.stdout:364 2024-03-27T10:05:41.490 INFO:teuthology.orchestra.run.smithi057.stdout:364.out 2024-03-27T10:05:41.490 INFO:teuthology.orchestra.run.smithi057.stdout:365 2024-03-27T10:05:41.491 INFO:teuthology.orchestra.run.smithi057.stdout:365.out 2024-03-27T10:05:41.491 INFO:teuthology.orchestra.run.smithi057.stdout:366 2024-03-27T10:05:41.491 INFO:teuthology.orchestra.run.smithi057.stdout:366.out 2024-03-27T10:05:41.491 INFO:teuthology.orchestra.run.smithi057.stdout:367 2024-03-27T10:05:41.491 INFO:teuthology.orchestra.run.smithi057.stdout:367.out 2024-03-27T10:05:41.491 INFO:teuthology.orchestra.run.smithi057.stdout:368 2024-03-27T10:05:41.491 INFO:teuthology.orchestra.run.smithi057.stdout:368.out 2024-03-27T10:05:41.491 INFO:teuthology.orchestra.run.smithi057.stdout:369 2024-03-27T10:05:41.491 INFO:teuthology.orchestra.run.smithi057.stdout:369.out 2024-03-27T10:05:41.491 INFO:teuthology.orchestra.run.smithi057.stdout:370 2024-03-27T10:05:41.491 INFO:teuthology.orchestra.run.smithi057.stdout:370.out 2024-03-27T10:05:41.491 INFO:teuthology.orchestra.run.smithi057.stdout:371 2024-03-27T10:05:41.491 INFO:teuthology.orchestra.run.smithi057.stdout:371.out 2024-03-27T10:05:41.491 INFO:teuthology.orchestra.run.smithi057.stdout:372 2024-03-27T10:05:41.492 INFO:teuthology.orchestra.run.smithi057.stdout:372.out 2024-03-27T10:05:41.492 INFO:teuthology.orchestra.run.smithi057.stdout:373 2024-03-27T10:05:41.492 INFO:teuthology.orchestra.run.smithi057.stdout:373.out 2024-03-27T10:05:41.492 INFO:teuthology.orchestra.run.smithi057.stdout:374 2024-03-27T10:05:41.492 INFO:teuthology.orchestra.run.smithi057.stdout:374.out 2024-03-27T10:05:41.492 INFO:teuthology.orchestra.run.smithi057.stdout:375 2024-03-27T10:05:41.492 INFO:teuthology.orchestra.run.smithi057.stdout:375.out 2024-03-27T10:05:41.492 INFO:teuthology.orchestra.run.smithi057.stdout:376 2024-03-27T10:05:41.492 INFO:teuthology.orchestra.run.smithi057.stdout:376.out 2024-03-27T10:05:41.492 INFO:teuthology.orchestra.run.smithi057.stdout:377 2024-03-27T10:05:41.492 INFO:teuthology.orchestra.run.smithi057.stdout:377.out 2024-03-27T10:05:41.492 INFO:teuthology.orchestra.run.smithi057.stdout:378 2024-03-27T10:05:41.492 INFO:teuthology.orchestra.run.smithi057.stdout:378.out 2024-03-27T10:05:41.492 INFO:teuthology.orchestra.run.smithi057.stdout:379 2024-03-27T10:05:41.492 INFO:teuthology.orchestra.run.smithi057.stdout:379.out 2024-03-27T10:05:41.492 INFO:teuthology.orchestra.run.smithi057.stdout:380 2024-03-27T10:05:41.493 INFO:teuthology.orchestra.run.smithi057.stdout:380.out 2024-03-27T10:05:41.493 INFO:teuthology.orchestra.run.smithi057.stdout:381 2024-03-27T10:05:41.493 INFO:teuthology.orchestra.run.smithi057.stdout:381.out 2024-03-27T10:05:41.493 INFO:teuthology.orchestra.run.smithi057.stdout:382 2024-03-27T10:05:41.493 INFO:teuthology.orchestra.run.smithi057.stdout:382.out 2024-03-27T10:05:41.493 INFO:teuthology.orchestra.run.smithi057.stdout:383 2024-03-27T10:05:41.493 INFO:teuthology.orchestra.run.smithi057.stdout:383.out 2024-03-27T10:05:41.493 INFO:teuthology.orchestra.run.smithi057.stdout:384 2024-03-27T10:05:41.493 INFO:teuthology.orchestra.run.smithi057.stdout:384.out 2024-03-27T10:05:41.493 INFO:teuthology.orchestra.run.smithi057.stdout:385 2024-03-27T10:05:41.493 INFO:teuthology.orchestra.run.smithi057.stdout:385.out 2024-03-27T10:05:41.493 INFO:teuthology.orchestra.run.smithi057.stdout:386 2024-03-27T10:05:41.493 INFO:teuthology.orchestra.run.smithi057.stdout:386.out 2024-03-27T10:05:41.493 INFO:teuthology.orchestra.run.smithi057.stdout:387 2024-03-27T10:05:41.494 INFO:teuthology.orchestra.run.smithi057.stdout:387.out 2024-03-27T10:05:41.494 INFO:teuthology.orchestra.run.smithi057.stdout:388 2024-03-27T10:05:41.494 INFO:teuthology.orchestra.run.smithi057.stdout:388.out 2024-03-27T10:05:41.494 INFO:teuthology.orchestra.run.smithi057.stdout:389 2024-03-27T10:05:41.494 INFO:teuthology.orchestra.run.smithi057.stdout:389.out 2024-03-27T10:05:41.494 INFO:teuthology.orchestra.run.smithi057.stdout:390 2024-03-27T10:05:41.494 INFO:teuthology.orchestra.run.smithi057.stdout:390.out 2024-03-27T10:05:41.494 INFO:teuthology.orchestra.run.smithi057.stdout:391 2024-03-27T10:05:41.494 INFO:teuthology.orchestra.run.smithi057.stdout:391.out 2024-03-27T10:05:41.494 INFO:teuthology.orchestra.run.smithi057.stdout:392 2024-03-27T10:05:41.494 INFO:teuthology.orchestra.run.smithi057.stdout:392.out 2024-03-27T10:05:41.494 INFO:teuthology.orchestra.run.smithi057.stdout:393 2024-03-27T10:05:41.494 INFO:teuthology.orchestra.run.smithi057.stdout:393.out 2024-03-27T10:05:41.494 INFO:teuthology.orchestra.run.smithi057.stdout:394 2024-03-27T10:05:41.495 INFO:teuthology.orchestra.run.smithi057.stdout:394.out 2024-03-27T10:05:41.495 INFO:teuthology.orchestra.run.smithi057.stdout:395 2024-03-27T10:05:41.495 INFO:teuthology.orchestra.run.smithi057.stdout:395.out 2024-03-27T10:05:41.495 INFO:teuthology.orchestra.run.smithi057.stdout:396 2024-03-27T10:05:41.495 INFO:teuthology.orchestra.run.smithi057.stdout:396.out 2024-03-27T10:05:41.495 INFO:teuthology.orchestra.run.smithi057.stdout:397 2024-03-27T10:05:41.495 INFO:teuthology.orchestra.run.smithi057.stdout:397.out 2024-03-27T10:05:41.495 INFO:teuthology.orchestra.run.smithi057.stdout:398 2024-03-27T10:05:41.495 INFO:teuthology.orchestra.run.smithi057.stdout:398.out 2024-03-27T10:05:41.495 INFO:teuthology.orchestra.run.smithi057.stdout:399 2024-03-27T10:05:41.495 INFO:teuthology.orchestra.run.smithi057.stdout:399.out 2024-03-27T10:05:41.495 INFO:teuthology.orchestra.run.smithi057.stdout:400 2024-03-27T10:05:41.495 INFO:teuthology.orchestra.run.smithi057.stdout:400.out 2024-03-27T10:05:41.495 INFO:teuthology.orchestra.run.smithi057.stdout:401 2024-03-27T10:05:41.495 INFO:teuthology.orchestra.run.smithi057.stdout:401.out 2024-03-27T10:05:41.496 INFO:teuthology.orchestra.run.smithi057.stdout:402 2024-03-27T10:05:41.496 INFO:teuthology.orchestra.run.smithi057.stdout:402.out 2024-03-27T10:05:41.496 INFO:teuthology.orchestra.run.smithi057.stdout:403 2024-03-27T10:05:41.496 INFO:teuthology.orchestra.run.smithi057.stdout:403.out 2024-03-27T10:05:41.496 INFO:teuthology.orchestra.run.smithi057.stdout:404 2024-03-27T10:05:41.496 INFO:teuthology.orchestra.run.smithi057.stdout:404.out 2024-03-27T10:05:41.496 INFO:teuthology.orchestra.run.smithi057.stdout:405 2024-03-27T10:05:41.496 INFO:teuthology.orchestra.run.smithi057.stdout:405.out 2024-03-27T10:05:41.496 INFO:teuthology.orchestra.run.smithi057.stdout:406 2024-03-27T10:05:41.496 INFO:teuthology.orchestra.run.smithi057.stdout:406.out 2024-03-27T10:05:41.496 INFO:teuthology.orchestra.run.smithi057.stdout:407 2024-03-27T10:05:41.496 INFO:teuthology.orchestra.run.smithi057.stdout:407.out 2024-03-27T10:05:41.496 INFO:teuthology.orchestra.run.smithi057.stdout:408 2024-03-27T10:05:41.496 INFO:teuthology.orchestra.run.smithi057.stdout:408.out 2024-03-27T10:05:41.496 INFO:teuthology.orchestra.run.smithi057.stdout:409 2024-03-27T10:05:41.497 INFO:teuthology.orchestra.run.smithi057.stdout:409.out 2024-03-27T10:05:41.497 INFO:teuthology.orchestra.run.smithi057.stdout:410 2024-03-27T10:05:41.497 INFO:teuthology.orchestra.run.smithi057.stdout:410.out 2024-03-27T10:05:41.497 INFO:teuthology.orchestra.run.smithi057.stdout:411 2024-03-27T10:05:41.497 INFO:teuthology.orchestra.run.smithi057.stdout:411.out 2024-03-27T10:05:41.497 INFO:teuthology.orchestra.run.smithi057.stdout:412 2024-03-27T10:05:41.497 INFO:teuthology.orchestra.run.smithi057.stdout:412.out 2024-03-27T10:05:41.497 INFO:teuthology.orchestra.run.smithi057.stdout:413 2024-03-27T10:05:41.497 INFO:teuthology.orchestra.run.smithi057.stdout:413.out 2024-03-27T10:05:41.497 INFO:teuthology.orchestra.run.smithi057.stdout:414 2024-03-27T10:05:41.497 INFO:teuthology.orchestra.run.smithi057.stdout:414.out 2024-03-27T10:05:41.497 INFO:teuthology.orchestra.run.smithi057.stdout:415 2024-03-27T10:05:41.497 INFO:teuthology.orchestra.run.smithi057.stdout:415.out 2024-03-27T10:05:41.498 INFO:teuthology.orchestra.run.smithi057.stdout:416 2024-03-27T10:05:41.498 INFO:teuthology.orchestra.run.smithi057.stdout:416.out 2024-03-27T10:05:41.498 INFO:teuthology.orchestra.run.smithi057.stdout:417 2024-03-27T10:05:41.498 INFO:teuthology.orchestra.run.smithi057.stdout:417.out 2024-03-27T10:05:41.498 INFO:teuthology.orchestra.run.smithi057.stdout:418 2024-03-27T10:05:41.498 INFO:teuthology.orchestra.run.smithi057.stdout:418.out 2024-03-27T10:05:41.498 INFO:teuthology.orchestra.run.smithi057.stdout:419 2024-03-27T10:05:41.498 INFO:teuthology.orchestra.run.smithi057.stdout:419.out 2024-03-27T10:05:41.498 INFO:teuthology.orchestra.run.smithi057.stdout:420 2024-03-27T10:05:41.498 INFO:teuthology.orchestra.run.smithi057.stdout:420.out 2024-03-27T10:05:41.498 INFO:teuthology.orchestra.run.smithi057.stdout:421 2024-03-27T10:05:41.498 INFO:teuthology.orchestra.run.smithi057.stdout:421.out 2024-03-27T10:05:41.498 INFO:teuthology.orchestra.run.smithi057.stdout:422 2024-03-27T10:05:41.498 INFO:teuthology.orchestra.run.smithi057.stdout:422.out 2024-03-27T10:05:41.499 INFO:teuthology.orchestra.run.smithi057.stdout:423 2024-03-27T10:05:41.499 INFO:teuthology.orchestra.run.smithi057.stdout:423.out 2024-03-27T10:05:41.499 INFO:teuthology.orchestra.run.smithi057.stdout:424 2024-03-27T10:05:41.499 INFO:teuthology.orchestra.run.smithi057.stdout:424.out 2024-03-27T10:05:41.499 INFO:teuthology.orchestra.run.smithi057.stdout:425 2024-03-27T10:05:41.499 INFO:teuthology.orchestra.run.smithi057.stdout:425.out 2024-03-27T10:05:41.499 INFO:teuthology.orchestra.run.smithi057.stdout:426 2024-03-27T10:05:41.499 INFO:teuthology.orchestra.run.smithi057.stdout:426.out 2024-03-27T10:05:41.499 INFO:teuthology.orchestra.run.smithi057.stdout:427 2024-03-27T10:05:41.499 INFO:teuthology.orchestra.run.smithi057.stdout:427.out 2024-03-27T10:05:41.499 INFO:teuthology.orchestra.run.smithi057.stdout:428 2024-03-27T10:05:41.499 INFO:teuthology.orchestra.run.smithi057.stdout:428.out 2024-03-27T10:05:41.499 INFO:teuthology.orchestra.run.smithi057.stdout:429 2024-03-27T10:05:41.499 INFO:teuthology.orchestra.run.smithi057.stdout:429.out 2024-03-27T10:05:41.499 INFO:teuthology.orchestra.run.smithi057.stdout:430 2024-03-27T10:05:41.500 INFO:teuthology.orchestra.run.smithi057.stdout:430.out 2024-03-27T10:05:41.500 INFO:teuthology.orchestra.run.smithi057.stdout:431 2024-03-27T10:05:41.500 INFO:teuthology.orchestra.run.smithi057.stdout:431.out 2024-03-27T10:05:41.500 INFO:teuthology.orchestra.run.smithi057.stdout:432 2024-03-27T10:05:41.500 INFO:teuthology.orchestra.run.smithi057.stdout:432.out 2024-03-27T10:05:41.500 INFO:teuthology.orchestra.run.smithi057.stdout:433 2024-03-27T10:05:41.500 INFO:teuthology.orchestra.run.smithi057.stdout:433.out 2024-03-27T10:05:41.500 INFO:teuthology.orchestra.run.smithi057.stdout:434 2024-03-27T10:05:41.500 INFO:teuthology.orchestra.run.smithi057.stdout:434.out 2024-03-27T10:05:41.500 INFO:teuthology.orchestra.run.smithi057.stdout:435 2024-03-27T10:05:41.500 INFO:teuthology.orchestra.run.smithi057.stdout:435.out 2024-03-27T10:05:41.500 INFO:teuthology.orchestra.run.smithi057.stdout:436 2024-03-27T10:05:41.500 INFO:teuthology.orchestra.run.smithi057.stdout:436.out 2024-03-27T10:05:41.500 INFO:teuthology.orchestra.run.smithi057.stdout:437 2024-03-27T10:05:41.500 INFO:teuthology.orchestra.run.smithi057.stdout:437.out 2024-03-27T10:05:41.501 INFO:teuthology.orchestra.run.smithi057.stdout:438 2024-03-27T10:05:41.501 INFO:teuthology.orchestra.run.smithi057.stdout:438.out 2024-03-27T10:05:41.501 INFO:teuthology.orchestra.run.smithi057.stdout:439 2024-03-27T10:05:41.501 INFO:teuthology.orchestra.run.smithi057.stdout:439.out 2024-03-27T10:05:41.501 INFO:teuthology.orchestra.run.smithi057.stdout:440 2024-03-27T10:05:41.501 INFO:teuthology.orchestra.run.smithi057.stdout:440.out 2024-03-27T10:05:41.501 INFO:teuthology.orchestra.run.smithi057.stdout:441 2024-03-27T10:05:41.501 INFO:teuthology.orchestra.run.smithi057.stdout:441.out 2024-03-27T10:05:41.501 INFO:teuthology.orchestra.run.smithi057.stdout:442 2024-03-27T10:05:41.501 INFO:teuthology.orchestra.run.smithi057.stdout:442.out 2024-03-27T10:05:41.501 INFO:teuthology.orchestra.run.smithi057.stdout:443 2024-03-27T10:05:41.501 INFO:teuthology.orchestra.run.smithi057.stdout:443.out 2024-03-27T10:05:41.501 INFO:teuthology.orchestra.run.smithi057.stdout:444 2024-03-27T10:05:41.501 INFO:teuthology.orchestra.run.smithi057.stdout:444.out 2024-03-27T10:05:41.501 INFO:teuthology.orchestra.run.smithi057.stdout:445 2024-03-27T10:05:41.501 INFO:teuthology.orchestra.run.smithi057.stdout:445.out 2024-03-27T10:05:41.502 INFO:teuthology.orchestra.run.smithi057.stdout:446 2024-03-27T10:05:41.502 INFO:teuthology.orchestra.run.smithi057.stdout:446.out 2024-03-27T10:05:41.502 INFO:teuthology.orchestra.run.smithi057.stdout:447 2024-03-27T10:05:41.502 INFO:teuthology.orchestra.run.smithi057.stdout:447.out 2024-03-27T10:05:41.502 INFO:teuthology.orchestra.run.smithi057.stdout:448 2024-03-27T10:05:41.502 INFO:teuthology.orchestra.run.smithi057.stdout:448.out 2024-03-27T10:05:41.502 INFO:teuthology.orchestra.run.smithi057.stdout:449 2024-03-27T10:05:41.502 INFO:teuthology.orchestra.run.smithi057.stdout:449.out 2024-03-27T10:05:41.502 INFO:teuthology.orchestra.run.smithi057.stdout:450 2024-03-27T10:05:41.502 INFO:teuthology.orchestra.run.smithi057.stdout:450.out 2024-03-27T10:05:41.502 INFO:teuthology.orchestra.run.smithi057.stdout:451 2024-03-27T10:05:41.502 INFO:teuthology.orchestra.run.smithi057.stdout:451.out 2024-03-27T10:05:41.502 INFO:teuthology.orchestra.run.smithi057.stdout:452 2024-03-27T10:05:41.502 INFO:teuthology.orchestra.run.smithi057.stdout:452.out 2024-03-27T10:05:41.502 INFO:teuthology.orchestra.run.smithi057.stdout:453 2024-03-27T10:05:41.503 INFO:teuthology.orchestra.run.smithi057.stdout:453.out 2024-03-27T10:05:41.503 INFO:teuthology.orchestra.run.smithi057.stdout:454 2024-03-27T10:05:41.503 INFO:teuthology.orchestra.run.smithi057.stdout:454.out 2024-03-27T10:05:41.503 INFO:teuthology.orchestra.run.smithi057.stdout:455 2024-03-27T10:05:41.503 INFO:teuthology.orchestra.run.smithi057.stdout:455.out 2024-03-27T10:05:41.503 INFO:teuthology.orchestra.run.smithi057.stdout:456 2024-03-27T10:05:41.503 INFO:teuthology.orchestra.run.smithi057.stdout:456.out 2024-03-27T10:05:41.503 INFO:teuthology.orchestra.run.smithi057.stdout:457 2024-03-27T10:05:41.503 INFO:teuthology.orchestra.run.smithi057.stdout:457.out 2024-03-27T10:05:41.503 INFO:teuthology.orchestra.run.smithi057.stdout:458 2024-03-27T10:05:41.503 INFO:teuthology.orchestra.run.smithi057.stdout:458.out 2024-03-27T10:05:41.503 INFO:teuthology.orchestra.run.smithi057.stdout:459 2024-03-27T10:05:41.503 INFO:teuthology.orchestra.run.smithi057.stdout:459.out 2024-03-27T10:05:41.503 INFO:teuthology.orchestra.run.smithi057.stdout:460 2024-03-27T10:05:41.503 INFO:teuthology.orchestra.run.smithi057.stdout:460.out 2024-03-27T10:05:41.504 INFO:teuthology.orchestra.run.smithi057.stdout:461 2024-03-27T10:05:41.504 INFO:teuthology.orchestra.run.smithi057.stdout:461.out 2024-03-27T10:05:41.504 INFO:teuthology.orchestra.run.smithi057.stdout:462 2024-03-27T10:05:41.504 INFO:teuthology.orchestra.run.smithi057.stdout:462.out 2024-03-27T10:05:41.504 INFO:teuthology.orchestra.run.smithi057.stdout:463 2024-03-27T10:05:41.504 INFO:teuthology.orchestra.run.smithi057.stdout:463.out 2024-03-27T10:05:41.504 INFO:teuthology.orchestra.run.smithi057.stdout:464 2024-03-27T10:05:41.504 INFO:teuthology.orchestra.run.smithi057.stdout:464.out 2024-03-27T10:05:41.504 INFO:teuthology.orchestra.run.smithi057.stdout:465 2024-03-27T10:05:41.504 INFO:teuthology.orchestra.run.smithi057.stdout:465.out 2024-03-27T10:05:41.504 INFO:teuthology.orchestra.run.smithi057.stdout:466 2024-03-27T10:05:41.504 INFO:teuthology.orchestra.run.smithi057.stdout:466.out 2024-03-27T10:05:41.504 INFO:teuthology.orchestra.run.smithi057.stdout:467 2024-03-27T10:05:41.504 INFO:teuthology.orchestra.run.smithi057.stdout:467.out 2024-03-27T10:05:41.505 INFO:teuthology.orchestra.run.smithi057.stdout:468 2024-03-27T10:05:41.505 INFO:teuthology.orchestra.run.smithi057.stdout:468.out 2024-03-27T10:05:41.505 INFO:teuthology.orchestra.run.smithi057.stdout:469 2024-03-27T10:05:41.505 INFO:teuthology.orchestra.run.smithi057.stdout:469.out 2024-03-27T10:05:41.505 INFO:teuthology.orchestra.run.smithi057.stdout:470 2024-03-27T10:05:41.505 INFO:teuthology.orchestra.run.smithi057.stdout:470.out 2024-03-27T10:05:41.505 INFO:teuthology.orchestra.run.smithi057.stdout:471 2024-03-27T10:05:41.505 INFO:teuthology.orchestra.run.smithi057.stdout:471.out 2024-03-27T10:05:41.505 INFO:teuthology.orchestra.run.smithi057.stdout:472 2024-03-27T10:05:41.505 INFO:teuthology.orchestra.run.smithi057.stdout:472.out 2024-03-27T10:05:41.505 INFO:teuthology.orchestra.run.smithi057.stdout:473 2024-03-27T10:05:41.505 INFO:teuthology.orchestra.run.smithi057.stdout:473.out 2024-03-27T10:05:41.505 INFO:teuthology.orchestra.run.smithi057.stdout:474 2024-03-27T10:05:41.505 INFO:teuthology.orchestra.run.smithi057.stdout:474.out 2024-03-27T10:05:41.506 INFO:teuthology.orchestra.run.smithi057.stdout:475 2024-03-27T10:05:41.506 INFO:teuthology.orchestra.run.smithi057.stdout:475.out 2024-03-27T10:05:41.506 INFO:teuthology.orchestra.run.smithi057.stdout:476 2024-03-27T10:05:41.506 INFO:teuthology.orchestra.run.smithi057.stdout:476.out 2024-03-27T10:05:41.506 INFO:teuthology.orchestra.run.smithi057.stdout:477 2024-03-27T10:05:41.506 INFO:teuthology.orchestra.run.smithi057.stdout:477.out 2024-03-27T10:05:41.506 INFO:teuthology.orchestra.run.smithi057.stdout:478 2024-03-27T10:05:41.506 INFO:teuthology.orchestra.run.smithi057.stdout:478.out 2024-03-27T10:05:41.506 INFO:teuthology.orchestra.run.smithi057.stdout:479 2024-03-27T10:05:41.506 INFO:teuthology.orchestra.run.smithi057.stdout:479.out 2024-03-27T10:05:41.506 INFO:teuthology.orchestra.run.smithi057.stdout:480 2024-03-27T10:05:41.506 INFO:teuthology.orchestra.run.smithi057.stdout:480.out 2024-03-27T10:05:41.506 INFO:teuthology.orchestra.run.smithi057.stdout:481 2024-03-27T10:05:41.506 INFO:teuthology.orchestra.run.smithi057.stdout:481.out 2024-03-27T10:05:41.507 INFO:teuthology.orchestra.run.smithi057.stdout:482 2024-03-27T10:05:41.507 INFO:teuthology.orchestra.run.smithi057.stdout:482.out 2024-03-27T10:05:41.507 INFO:teuthology.orchestra.run.smithi057.stdout:483 2024-03-27T10:05:41.507 INFO:teuthology.orchestra.run.smithi057.stdout:483.out 2024-03-27T10:05:41.507 INFO:teuthology.orchestra.run.smithi057.stdout:484 2024-03-27T10:05:41.507 INFO:teuthology.orchestra.run.smithi057.stdout:484.out 2024-03-27T10:05:41.507 INFO:teuthology.orchestra.run.smithi057.stdout:485 2024-03-27T10:05:41.507 INFO:teuthology.orchestra.run.smithi057.stdout:485.out 2024-03-27T10:05:41.507 INFO:teuthology.orchestra.run.smithi057.stdout:486 2024-03-27T10:05:41.507 INFO:teuthology.orchestra.run.smithi057.stdout:486.out 2024-03-27T10:05:41.507 INFO:teuthology.orchestra.run.smithi057.stdout:487 2024-03-27T10:05:41.507 INFO:teuthology.orchestra.run.smithi057.stdout:487.out 2024-03-27T10:05:41.507 INFO:teuthology.orchestra.run.smithi057.stdout:488 2024-03-27T10:05:41.508 INFO:teuthology.orchestra.run.smithi057.stdout:488.out 2024-03-27T10:05:41.508 INFO:teuthology.orchestra.run.smithi057.stdout:489 2024-03-27T10:05:41.508 INFO:teuthology.orchestra.run.smithi057.stdout:489.out 2024-03-27T10:05:41.508 INFO:teuthology.orchestra.run.smithi057.stdout:490 2024-03-27T10:05:41.508 INFO:teuthology.orchestra.run.smithi057.stdout:490.out 2024-03-27T10:05:41.508 INFO:teuthology.orchestra.run.smithi057.stdout:491 2024-03-27T10:05:41.508 INFO:teuthology.orchestra.run.smithi057.stdout:491.out 2024-03-27T10:05:41.508 INFO:teuthology.orchestra.run.smithi057.stdout:492 2024-03-27T10:05:41.508 INFO:teuthology.orchestra.run.smithi057.stdout:492.out 2024-03-27T10:05:41.508 INFO:teuthology.orchestra.run.smithi057.stdout:493 2024-03-27T10:05:41.508 INFO:teuthology.orchestra.run.smithi057.stdout:493.out 2024-03-27T10:05:41.508 INFO:teuthology.orchestra.run.smithi057.stdout:494 2024-03-27T10:05:41.508 INFO:teuthology.orchestra.run.smithi057.stdout:494.out 2024-03-27T10:05:41.508 INFO:teuthology.orchestra.run.smithi057.stdout:495 2024-03-27T10:05:41.508 INFO:teuthology.orchestra.run.smithi057.stdout:495.out 2024-03-27T10:05:41.509 INFO:teuthology.orchestra.run.smithi057.stdout:496 2024-03-27T10:05:41.509 INFO:teuthology.orchestra.run.smithi057.stdout:496.out 2024-03-27T10:05:41.509 INFO:teuthology.orchestra.run.smithi057.stdout:497 2024-03-27T10:05:41.509 INFO:teuthology.orchestra.run.smithi057.stdout:497.out 2024-03-27T10:05:41.509 INFO:teuthology.orchestra.run.smithi057.stdout:498 2024-03-27T10:05:41.509 INFO:teuthology.orchestra.run.smithi057.stdout:498.out 2024-03-27T10:05:41.509 INFO:teuthology.orchestra.run.smithi057.stdout:499 2024-03-27T10:05:41.509 INFO:teuthology.orchestra.run.smithi057.stdout:499.out 2024-03-27T10:05:41.509 INFO:teuthology.orchestra.run.smithi057.stdout:500 2024-03-27T10:05:41.509 INFO:teuthology.orchestra.run.smithi057.stdout:500.out 2024-03-27T10:05:41.509 INFO:teuthology.orchestra.run.smithi057.stdout:501 2024-03-27T10:05:41.509 INFO:teuthology.orchestra.run.smithi057.stdout:501.out 2024-03-27T10:05:41.509 INFO:teuthology.orchestra.run.smithi057.stdout:502 2024-03-27T10:05:41.509 INFO:teuthology.orchestra.run.smithi057.stdout:502.out 2024-03-27T10:05:41.509 INFO:teuthology.orchestra.run.smithi057.stdout:503 2024-03-27T10:05:41.509 INFO:teuthology.orchestra.run.smithi057.stdout:503.out 2024-03-27T10:05:41.510 INFO:teuthology.orchestra.run.smithi057.stdout:504 2024-03-27T10:05:41.510 INFO:teuthology.orchestra.run.smithi057.stdout:504.out 2024-03-27T10:05:41.510 INFO:teuthology.orchestra.run.smithi057.stdout:505 2024-03-27T10:05:41.510 INFO:teuthology.orchestra.run.smithi057.stdout:505.out 2024-03-27T10:05:41.510 INFO:teuthology.orchestra.run.smithi057.stdout:506 2024-03-27T10:05:41.510 INFO:teuthology.orchestra.run.smithi057.stdout:506.out 2024-03-27T10:05:41.510 INFO:teuthology.orchestra.run.smithi057.stdout:507 2024-03-27T10:05:41.510 INFO:teuthology.orchestra.run.smithi057.stdout:507.out 2024-03-27T10:05:41.510 INFO:teuthology.orchestra.run.smithi057.stdout:508 2024-03-27T10:05:41.510 INFO:teuthology.orchestra.run.smithi057.stdout:508.out 2024-03-27T10:05:41.510 INFO:teuthology.orchestra.run.smithi057.stdout:509 2024-03-27T10:05:41.510 INFO:teuthology.orchestra.run.smithi057.stdout:509.out 2024-03-27T10:05:41.510 INFO:teuthology.orchestra.run.smithi057.stdout:510 2024-03-27T10:05:41.510 INFO:teuthology.orchestra.run.smithi057.stdout:510.out 2024-03-27T10:05:41.511 INFO:teuthology.orchestra.run.smithi057.stdout:511 2024-03-27T10:05:41.511 INFO:teuthology.orchestra.run.smithi057.stdout:511.out 2024-03-27T10:05:41.511 INFO:teuthology.orchestra.run.smithi057.stdout:512 2024-03-27T10:05:41.511 INFO:teuthology.orchestra.run.smithi057.stdout:512.out 2024-03-27T10:05:41.511 INFO:teuthology.orchestra.run.smithi057.stdout:513 2024-03-27T10:05:41.511 INFO:teuthology.orchestra.run.smithi057.stdout:513.out 2024-03-27T10:05:41.511 INFO:teuthology.orchestra.run.smithi057.stdout:514 2024-03-27T10:05:41.511 INFO:teuthology.orchestra.run.smithi057.stdout:514.out 2024-03-27T10:05:41.511 INFO:teuthology.orchestra.run.smithi057.stdout:515 2024-03-27T10:05:41.511 INFO:teuthology.orchestra.run.smithi057.stdout:515.out 2024-03-27T10:05:41.511 INFO:teuthology.orchestra.run.smithi057.stdout:516 2024-03-27T10:05:41.511 INFO:teuthology.orchestra.run.smithi057.stdout:516.out 2024-03-27T10:05:41.511 INFO:teuthology.orchestra.run.smithi057.stdout:517 2024-03-27T10:05:41.511 INFO:teuthology.orchestra.run.smithi057.stdout:517.out 2024-03-27T10:05:41.511 INFO:teuthology.orchestra.run.smithi057.stdout:518 2024-03-27T10:05:41.512 INFO:teuthology.orchestra.run.smithi057.stdout:518.out 2024-03-27T10:05:41.512 INFO:teuthology.orchestra.run.smithi057.stdout:519 2024-03-27T10:05:41.512 INFO:teuthology.orchestra.run.smithi057.stdout:519.out 2024-03-27T10:05:41.512 INFO:teuthology.orchestra.run.smithi057.stdout:520 2024-03-27T10:05:41.512 INFO:teuthology.orchestra.run.smithi057.stdout:520.out 2024-03-27T10:05:41.512 INFO:teuthology.orchestra.run.smithi057.stdout:521 2024-03-27T10:05:41.512 INFO:teuthology.orchestra.run.smithi057.stdout:521.out 2024-03-27T10:05:41.512 INFO:teuthology.orchestra.run.smithi057.stdout:522 2024-03-27T10:05:41.512 INFO:teuthology.orchestra.run.smithi057.stdout:522.out 2024-03-27T10:05:41.512 INFO:teuthology.orchestra.run.smithi057.stdout:523 2024-03-27T10:05:41.512 INFO:teuthology.orchestra.run.smithi057.stdout:523.out 2024-03-27T10:05:41.512 INFO:teuthology.orchestra.run.smithi057.stdout:524 2024-03-27T10:05:41.512 INFO:teuthology.orchestra.run.smithi057.stdout:524.out 2024-03-27T10:05:41.512 INFO:teuthology.orchestra.run.smithi057.stdout:525 2024-03-27T10:05:41.512 INFO:teuthology.orchestra.run.smithi057.stdout:525.out 2024-03-27T10:05:41.513 INFO:teuthology.orchestra.run.smithi057.stdout:526 2024-03-27T10:05:41.513 INFO:teuthology.orchestra.run.smithi057.stdout:526.out 2024-03-27T10:05:41.513 INFO:teuthology.orchestra.run.smithi057.stdout:527 2024-03-27T10:05:41.513 INFO:teuthology.orchestra.run.smithi057.stdout:527.out 2024-03-27T10:05:41.513 INFO:teuthology.orchestra.run.smithi057.stdout:528 2024-03-27T10:05:41.513 INFO:teuthology.orchestra.run.smithi057.stdout:528.out 2024-03-27T10:05:41.513 INFO:teuthology.orchestra.run.smithi057.stdout:529 2024-03-27T10:05:41.513 INFO:teuthology.orchestra.run.smithi057.stdout:529.out 2024-03-27T10:05:41.513 INFO:teuthology.orchestra.run.smithi057.stdout:530 2024-03-27T10:05:41.513 INFO:teuthology.orchestra.run.smithi057.stdout:530.out 2024-03-27T10:05:41.513 INFO:teuthology.orchestra.run.smithi057.stdout:531 2024-03-27T10:05:41.513 INFO:teuthology.orchestra.run.smithi057.stdout:531.out 2024-03-27T10:05:41.513 INFO:teuthology.orchestra.run.smithi057.stdout:532 2024-03-27T10:05:41.513 INFO:teuthology.orchestra.run.smithi057.stdout:532.out 2024-03-27T10:05:41.513 INFO:teuthology.orchestra.run.smithi057.stdout:533 2024-03-27T10:05:41.513 INFO:teuthology.orchestra.run.smithi057.stdout:533.out 2024-03-27T10:05:41.514 INFO:teuthology.orchestra.run.smithi057.stdout:534 2024-03-27T10:05:41.514 INFO:teuthology.orchestra.run.smithi057.stdout:534.out 2024-03-27T10:05:41.514 INFO:teuthology.orchestra.run.smithi057.stdout:535 2024-03-27T10:05:41.514 INFO:teuthology.orchestra.run.smithi057.stdout:535.out 2024-03-27T10:05:41.514 INFO:teuthology.orchestra.run.smithi057.stdout:536 2024-03-27T10:05:41.514 INFO:teuthology.orchestra.run.smithi057.stdout:536.out 2024-03-27T10:05:41.514 INFO:teuthology.orchestra.run.smithi057.stdout:537 2024-03-27T10:05:41.514 INFO:teuthology.orchestra.run.smithi057.stdout:537.out 2024-03-27T10:05:41.514 INFO:teuthology.orchestra.run.smithi057.stdout:538 2024-03-27T10:05:41.514 INFO:teuthology.orchestra.run.smithi057.stdout:538.out 2024-03-27T10:05:41.514 INFO:teuthology.orchestra.run.smithi057.stdout:539 2024-03-27T10:05:41.514 INFO:teuthology.orchestra.run.smithi057.stdout:539.out 2024-03-27T10:05:41.514 INFO:teuthology.orchestra.run.smithi057.stdout:540 2024-03-27T10:05:41.515 INFO:teuthology.orchestra.run.smithi057.stdout:540.out 2024-03-27T10:05:41.515 INFO:teuthology.orchestra.run.smithi057.stdout:541 2024-03-27T10:05:41.515 INFO:teuthology.orchestra.run.smithi057.stdout:541.out 2024-03-27T10:05:41.515 INFO:teuthology.orchestra.run.smithi057.stdout:542 2024-03-27T10:05:41.515 INFO:teuthology.orchestra.run.smithi057.stdout:542.out 2024-03-27T10:05:41.515 INFO:teuthology.orchestra.run.smithi057.stdout:543 2024-03-27T10:05:41.515 INFO:teuthology.orchestra.run.smithi057.stdout:543.out 2024-03-27T10:05:41.515 INFO:teuthology.orchestra.run.smithi057.stdout:544 2024-03-27T10:05:41.515 INFO:teuthology.orchestra.run.smithi057.stdout:544.out 2024-03-27T10:05:41.515 INFO:teuthology.orchestra.run.smithi057.stdout:545 2024-03-27T10:05:41.515 INFO:teuthology.orchestra.run.smithi057.stdout:545.out 2024-03-27T10:05:41.515 INFO:teuthology.orchestra.run.smithi057.stdout:546 2024-03-27T10:05:41.515 INFO:teuthology.orchestra.run.smithi057.stdout:546.out 2024-03-27T10:05:41.515 INFO:teuthology.orchestra.run.smithi057.stdout:547 2024-03-27T10:05:41.515 INFO:teuthology.orchestra.run.smithi057.stdout:547.out 2024-03-27T10:05:41.516 INFO:teuthology.orchestra.run.smithi057.stdout:548 2024-03-27T10:05:41.516 INFO:teuthology.orchestra.run.smithi057.stdout:548.out 2024-03-27T10:05:41.516 INFO:teuthology.orchestra.run.smithi057.stdout:549 2024-03-27T10:05:41.516 INFO:teuthology.orchestra.run.smithi057.stdout:549.out 2024-03-27T10:05:41.516 INFO:teuthology.orchestra.run.smithi057.stdout:550 2024-03-27T10:05:41.516 INFO:teuthology.orchestra.run.smithi057.stdout:550.out 2024-03-27T10:05:41.516 INFO:teuthology.orchestra.run.smithi057.stdout:551 2024-03-27T10:05:41.516 INFO:teuthology.orchestra.run.smithi057.stdout:551.out 2024-03-27T10:05:41.516 INFO:teuthology.orchestra.run.smithi057.stdout:552 2024-03-27T10:05:41.516 INFO:teuthology.orchestra.run.smithi057.stdout:552.out 2024-03-27T10:05:41.516 INFO:teuthology.orchestra.run.smithi057.stdout:553 2024-03-27T10:05:41.516 INFO:teuthology.orchestra.run.smithi057.stdout:553.out 2024-03-27T10:05:41.516 INFO:teuthology.orchestra.run.smithi057.stdout:554 2024-03-27T10:05:41.516 INFO:teuthology.orchestra.run.smithi057.stdout:554.out 2024-03-27T10:05:41.517 INFO:teuthology.orchestra.run.smithi057.stdout:555 2024-03-27T10:05:41.517 INFO:teuthology.orchestra.run.smithi057.stdout:555.out 2024-03-27T10:05:41.517 INFO:teuthology.orchestra.run.smithi057.stdout:556 2024-03-27T10:05:41.517 INFO:teuthology.orchestra.run.smithi057.stdout:556.out 2024-03-27T10:05:41.517 INFO:teuthology.orchestra.run.smithi057.stdout:557 2024-03-27T10:05:41.517 INFO:teuthology.orchestra.run.smithi057.stdout:557.out 2024-03-27T10:05:41.517 INFO:teuthology.orchestra.run.smithi057.stdout:558 2024-03-27T10:05:41.517 INFO:teuthology.orchestra.run.smithi057.stdout:558.out 2024-03-27T10:05:41.517 INFO:teuthology.orchestra.run.smithi057.stdout:559 2024-03-27T10:05:41.517 INFO:teuthology.orchestra.run.smithi057.stdout:559.out 2024-03-27T10:05:41.517 INFO:teuthology.orchestra.run.smithi057.stdout:560 2024-03-27T10:05:41.517 INFO:teuthology.orchestra.run.smithi057.stdout:560.out 2024-03-27T10:05:41.517 INFO:teuthology.orchestra.run.smithi057.stdout:561 2024-03-27T10:05:41.517 INFO:teuthology.orchestra.run.smithi057.stdout:561.out 2024-03-27T10:05:41.518 INFO:teuthology.orchestra.run.smithi057.stdout:562 2024-03-27T10:05:41.518 INFO:teuthology.orchestra.run.smithi057.stdout:562.out 2024-03-27T10:05:41.518 INFO:teuthology.orchestra.run.smithi057.stdout:563 2024-03-27T10:05:41.518 INFO:teuthology.orchestra.run.smithi057.stdout:563.out 2024-03-27T10:05:41.518 INFO:teuthology.orchestra.run.smithi057.stdout:564 2024-03-27T10:05:41.518 INFO:teuthology.orchestra.run.smithi057.stdout:564.out 2024-03-27T10:05:41.518 INFO:teuthology.orchestra.run.smithi057.stdout:565 2024-03-27T10:05:41.518 INFO:teuthology.orchestra.run.smithi057.stdout:565.out 2024-03-27T10:05:41.518 INFO:teuthology.orchestra.run.smithi057.stdout:566 2024-03-27T10:05:41.518 INFO:teuthology.orchestra.run.smithi057.stdout:566.out 2024-03-27T10:05:41.518 INFO:teuthology.orchestra.run.smithi057.stdout:567 2024-03-27T10:05:41.518 INFO:teuthology.orchestra.run.smithi057.stdout:567.out 2024-03-27T10:05:41.518 INFO:teuthology.orchestra.run.smithi057.stdout:568 2024-03-27T10:05:41.518 INFO:teuthology.orchestra.run.smithi057.stdout:568.out 2024-03-27T10:05:41.519 INFO:teuthology.orchestra.run.smithi057.stdout:569 2024-03-27T10:05:41.519 INFO:teuthology.orchestra.run.smithi057.stdout:569.out 2024-03-27T10:05:41.519 INFO:teuthology.orchestra.run.smithi057.stdout:570 2024-03-27T10:05:41.519 INFO:teuthology.orchestra.run.smithi057.stdout:570.out 2024-03-27T10:05:41.519 INFO:teuthology.orchestra.run.smithi057.stdout:571 2024-03-27T10:05:41.519 INFO:teuthology.orchestra.run.smithi057.stdout:571.out 2024-03-27T10:05:41.519 INFO:teuthology.orchestra.run.smithi057.stdout:572 2024-03-27T10:05:41.519 INFO:teuthology.orchestra.run.smithi057.stdout:572.out 2024-03-27T10:05:41.519 INFO:teuthology.orchestra.run.smithi057.stdout:573 2024-03-27T10:05:41.519 INFO:teuthology.orchestra.run.smithi057.stdout:573.out 2024-03-27T10:05:41.519 INFO:teuthology.orchestra.run.smithi057.stdout:574 2024-03-27T10:05:41.519 INFO:teuthology.orchestra.run.smithi057.stdout:574.out 2024-03-27T10:05:41.519 INFO:teuthology.orchestra.run.smithi057.stdout:575 2024-03-27T10:05:41.519 INFO:teuthology.orchestra.run.smithi057.stdout:575.out 2024-03-27T10:05:41.519 INFO:teuthology.orchestra.run.smithi057.stdout:576 2024-03-27T10:05:41.519 INFO:teuthology.orchestra.run.smithi057.stdout:576.out 2024-03-27T10:05:41.520 INFO:teuthology.orchestra.run.smithi057.stdout:577 2024-03-27T10:05:41.520 INFO:teuthology.orchestra.run.smithi057.stdout:577.out 2024-03-27T10:05:41.520 INFO:teuthology.orchestra.run.smithi057.stdout:578 2024-03-27T10:05:41.520 INFO:teuthology.orchestra.run.smithi057.stdout:578.out 2024-03-27T10:05:41.520 INFO:teuthology.orchestra.run.smithi057.stdout:579 2024-03-27T10:05:41.520 INFO:teuthology.orchestra.run.smithi057.stdout:579.out 2024-03-27T10:05:41.520 INFO:teuthology.orchestra.run.smithi057.stdout:580 2024-03-27T10:05:41.520 INFO:teuthology.orchestra.run.smithi057.stdout:580.out 2024-03-27T10:05:41.520 INFO:teuthology.orchestra.run.smithi057.stdout:581 2024-03-27T10:05:41.520 INFO:teuthology.orchestra.run.smithi057.stdout:581.out 2024-03-27T10:05:41.520 INFO:teuthology.orchestra.run.smithi057.stdout:582 2024-03-27T10:05:41.520 INFO:teuthology.orchestra.run.smithi057.stdout:582.out 2024-03-27T10:05:41.520 INFO:teuthology.orchestra.run.smithi057.stdout:583 2024-03-27T10:05:41.520 INFO:teuthology.orchestra.run.smithi057.stdout:583.out 2024-03-27T10:05:41.520 INFO:teuthology.orchestra.run.smithi057.stdout:584 2024-03-27T10:05:41.521 INFO:teuthology.orchestra.run.smithi057.stdout:584.out 2024-03-27T10:05:41.521 INFO:teuthology.orchestra.run.smithi057.stdout:585 2024-03-27T10:05:41.521 INFO:teuthology.orchestra.run.smithi057.stdout:585.out 2024-03-27T10:05:41.521 INFO:teuthology.orchestra.run.smithi057.stdout:586 2024-03-27T10:05:41.521 INFO:teuthology.orchestra.run.smithi057.stdout:586.out 2024-03-27T10:05:41.521 INFO:teuthology.orchestra.run.smithi057.stdout:587 2024-03-27T10:05:41.521 INFO:teuthology.orchestra.run.smithi057.stdout:587.out 2024-03-27T10:05:41.521 INFO:teuthology.orchestra.run.smithi057.stdout:588 2024-03-27T10:05:41.521 INFO:teuthology.orchestra.run.smithi057.stdout:588.out 2024-03-27T10:05:41.521 INFO:teuthology.orchestra.run.smithi057.stdout:589 2024-03-27T10:05:41.521 INFO:teuthology.orchestra.run.smithi057.stdout:589.out 2024-03-27T10:05:41.521 INFO:teuthology.orchestra.run.smithi057.stdout:590 2024-03-27T10:05:41.521 INFO:teuthology.orchestra.run.smithi057.stdout:590.out 2024-03-27T10:05:41.521 INFO:teuthology.orchestra.run.smithi057.stdout:591 2024-03-27T10:05:41.522 INFO:teuthology.orchestra.run.smithi057.stdout:591.out 2024-03-27T10:05:41.522 INFO:teuthology.orchestra.run.smithi057.stdout:592 2024-03-27T10:05:41.522 INFO:teuthology.orchestra.run.smithi057.stdout:592.out 2024-03-27T10:05:41.522 INFO:teuthology.orchestra.run.smithi057.stdout:593 2024-03-27T10:05:41.522 INFO:teuthology.orchestra.run.smithi057.stdout:593.out 2024-03-27T10:05:41.522 INFO:teuthology.orchestra.run.smithi057.stdout:594 2024-03-27T10:05:41.522 INFO:teuthology.orchestra.run.smithi057.stdout:594.out 2024-03-27T10:05:41.522 INFO:teuthology.orchestra.run.smithi057.stdout:595 2024-03-27T10:05:41.522 INFO:teuthology.orchestra.run.smithi057.stdout:595.out 2024-03-27T10:05:41.522 INFO:teuthology.orchestra.run.smithi057.stdout:596 2024-03-27T10:05:41.522 INFO:teuthology.orchestra.run.smithi057.stdout:596.out 2024-03-27T10:05:41.522 INFO:teuthology.orchestra.run.smithi057.stdout:597 2024-03-27T10:05:41.522 INFO:teuthology.orchestra.run.smithi057.stdout:597.out 2024-03-27T10:05:41.522 INFO:teuthology.orchestra.run.smithi057.stdout:598 2024-03-27T10:05:41.522 INFO:teuthology.orchestra.run.smithi057.stdout:598.out 2024-03-27T10:05:41.523 INFO:teuthology.orchestra.run.smithi057.stdout:599 2024-03-27T10:05:41.523 INFO:teuthology.orchestra.run.smithi057.stdout:599.out 2024-03-27T10:05:41.523 INFO:teuthology.orchestra.run.smithi057.stdout:600 2024-03-27T10:05:41.523 INFO:teuthology.orchestra.run.smithi057.stdout:600.out 2024-03-27T10:05:41.523 INFO:teuthology.orchestra.run.smithi057.stdout:601 2024-03-27T10:05:41.523 INFO:teuthology.orchestra.run.smithi057.stdout:601.out 2024-03-27T10:05:41.523 INFO:teuthology.orchestra.run.smithi057.stdout:602 2024-03-27T10:05:41.523 INFO:teuthology.orchestra.run.smithi057.stdout:602.out 2024-03-27T10:05:41.523 INFO:teuthology.orchestra.run.smithi057.stdout:603 2024-03-27T10:05:41.523 INFO:teuthology.orchestra.run.smithi057.stdout:603.out 2024-03-27T10:05:41.523 INFO:teuthology.orchestra.run.smithi057.stdout:604 2024-03-27T10:05:41.523 INFO:teuthology.orchestra.run.smithi057.stdout:604.out 2024-03-27T10:05:41.523 INFO:teuthology.orchestra.run.smithi057.stdout:605 2024-03-27T10:05:41.523 INFO:teuthology.orchestra.run.smithi057.stdout:605.out 2024-03-27T10:05:41.524 INFO:teuthology.orchestra.run.smithi057.stdout:606 2024-03-27T10:05:41.524 INFO:teuthology.orchestra.run.smithi057.stdout:606.out 2024-03-27T10:05:41.524 INFO:teuthology.orchestra.run.smithi057.stdout:607 2024-03-27T10:05:41.524 INFO:teuthology.orchestra.run.smithi057.stdout:607.out 2024-03-27T10:05:41.524 INFO:teuthology.orchestra.run.smithi057.stdout:608 2024-03-27T10:05:41.524 INFO:teuthology.orchestra.run.smithi057.stdout:608.out 2024-03-27T10:05:41.524 INFO:teuthology.orchestra.run.smithi057.stdout:609 2024-03-27T10:05:41.524 INFO:teuthology.orchestra.run.smithi057.stdout:609.out 2024-03-27T10:05:41.524 INFO:teuthology.orchestra.run.smithi057.stdout:610 2024-03-27T10:05:41.524 INFO:teuthology.orchestra.run.smithi057.stdout:610.out 2024-03-27T10:05:41.524 INFO:teuthology.orchestra.run.smithi057.stdout:611 2024-03-27T10:05:41.524 INFO:teuthology.orchestra.run.smithi057.stdout:611.out 2024-03-27T10:05:41.524 INFO:teuthology.orchestra.run.smithi057.stdout:612 2024-03-27T10:05:41.524 INFO:teuthology.orchestra.run.smithi057.stdout:612.out 2024-03-27T10:05:41.525 INFO:teuthology.orchestra.run.smithi057.stdout:613 2024-03-27T10:05:41.525 INFO:teuthology.orchestra.run.smithi057.stdout:613.out 2024-03-27T10:05:41.525 INFO:teuthology.orchestra.run.smithi057.stdout:614 2024-03-27T10:05:41.525 INFO:teuthology.orchestra.run.smithi057.stdout:614.out 2024-03-27T10:05:41.525 INFO:teuthology.orchestra.run.smithi057.stdout:615 2024-03-27T10:05:41.525 INFO:teuthology.orchestra.run.smithi057.stdout:615.out 2024-03-27T10:05:41.525 INFO:teuthology.orchestra.run.smithi057.stdout:616 2024-03-27T10:05:41.525 INFO:teuthology.orchestra.run.smithi057.stdout:616.out 2024-03-27T10:05:41.525 INFO:teuthology.orchestra.run.smithi057.stdout:617 2024-03-27T10:05:41.525 INFO:teuthology.orchestra.run.smithi057.stdout:617.out 2024-03-27T10:05:41.525 INFO:teuthology.orchestra.run.smithi057.stdout:618 2024-03-27T10:05:41.525 INFO:teuthology.orchestra.run.smithi057.stdout:618.out 2024-03-27T10:05:41.525 INFO:teuthology.orchestra.run.smithi057.stdout:619 2024-03-27T10:05:41.526 INFO:teuthology.orchestra.run.smithi057.stdout:619.out 2024-03-27T10:05:41.526 INFO:teuthology.orchestra.run.smithi057.stdout:620 2024-03-27T10:05:41.526 INFO:teuthology.orchestra.run.smithi057.stdout:620.out 2024-03-27T10:05:41.526 INFO:teuthology.orchestra.run.smithi057.stdout:621 2024-03-27T10:05:41.526 INFO:teuthology.orchestra.run.smithi057.stdout:621.out 2024-03-27T10:05:41.526 INFO:teuthology.orchestra.run.smithi057.stdout:622 2024-03-27T10:05:41.526 INFO:teuthology.orchestra.run.smithi057.stdout:622.out 2024-03-27T10:05:41.526 INFO:teuthology.orchestra.run.smithi057.stdout:623 2024-03-27T10:05:41.526 INFO:teuthology.orchestra.run.smithi057.stdout:623.out 2024-03-27T10:05:41.526 INFO:teuthology.orchestra.run.smithi057.stdout:624 2024-03-27T10:05:41.526 INFO:teuthology.orchestra.run.smithi057.stdout:624.out 2024-03-27T10:05:41.526 INFO:teuthology.orchestra.run.smithi057.stdout:625 2024-03-27T10:05:41.526 INFO:teuthology.orchestra.run.smithi057.stdout:625.out 2024-03-27T10:05:41.526 INFO:teuthology.orchestra.run.smithi057.stdout:626 2024-03-27T10:05:41.527 INFO:teuthology.orchestra.run.smithi057.stdout:626.out 2024-03-27T10:05:41.527 INFO:teuthology.orchestra.run.smithi057.stdout:627 2024-03-27T10:05:41.527 INFO:teuthology.orchestra.run.smithi057.stdout:627.out 2024-03-27T10:05:41.527 INFO:teuthology.orchestra.run.smithi057.stdout:628 2024-03-27T10:05:41.527 INFO:teuthology.orchestra.run.smithi057.stdout:628.out 2024-03-27T10:05:41.527 INFO:teuthology.orchestra.run.smithi057.stdout:629 2024-03-27T10:05:41.527 INFO:teuthology.orchestra.run.smithi057.stdout:629.out 2024-03-27T10:05:41.527 INFO:teuthology.orchestra.run.smithi057.stdout:630 2024-03-27T10:05:41.527 INFO:teuthology.orchestra.run.smithi057.stdout:630.out 2024-03-27T10:05:41.527 INFO:teuthology.orchestra.run.smithi057.stdout:631 2024-03-27T10:05:41.527 INFO:teuthology.orchestra.run.smithi057.stdout:631.out 2024-03-27T10:05:41.527 INFO:teuthology.orchestra.run.smithi057.stdout:632 2024-03-27T10:05:41.527 INFO:teuthology.orchestra.run.smithi057.stdout:632.out 2024-03-27T10:05:41.527 INFO:teuthology.orchestra.run.smithi057.stdout:633 2024-03-27T10:05:41.527 INFO:teuthology.orchestra.run.smithi057.stdout:633.out 2024-03-27T10:05:41.528 INFO:teuthology.orchestra.run.smithi057.stdout:634 2024-03-27T10:05:41.528 INFO:teuthology.orchestra.run.smithi057.stdout:634.out 2024-03-27T10:05:41.528 INFO:teuthology.orchestra.run.smithi057.stdout:635 2024-03-27T10:05:41.528 INFO:teuthology.orchestra.run.smithi057.stdout:635.out 2024-03-27T10:05:41.528 INFO:teuthology.orchestra.run.smithi057.stdout:636 2024-03-27T10:05:41.528 INFO:teuthology.orchestra.run.smithi057.stdout:636.out 2024-03-27T10:05:41.528 INFO:teuthology.orchestra.run.smithi057.stdout:637 2024-03-27T10:05:41.528 INFO:teuthology.orchestra.run.smithi057.stdout:637.out 2024-03-27T10:05:41.528 INFO:teuthology.orchestra.run.smithi057.stdout:638 2024-03-27T10:05:41.528 INFO:teuthology.orchestra.run.smithi057.stdout:638.out 2024-03-27T10:05:41.528 INFO:teuthology.orchestra.run.smithi057.stdout:639 2024-03-27T10:05:41.528 INFO:teuthology.orchestra.run.smithi057.stdout:639.out 2024-03-27T10:05:41.528 INFO:teuthology.orchestra.run.smithi057.stdout:640 2024-03-27T10:05:41.528 INFO:teuthology.orchestra.run.smithi057.stdout:640.out 2024-03-27T10:05:41.528 INFO:teuthology.orchestra.run.smithi057.stdout:641 2024-03-27T10:05:41.529 INFO:teuthology.orchestra.run.smithi057.stdout:641.out 2024-03-27T10:05:41.529 INFO:teuthology.orchestra.run.smithi057.stdout:642 2024-03-27T10:05:41.529 INFO:teuthology.orchestra.run.smithi057.stdout:642.out 2024-03-27T10:05:41.529 INFO:teuthology.orchestra.run.smithi057.stdout:643 2024-03-27T10:05:41.529 INFO:teuthology.orchestra.run.smithi057.stdout:643.out 2024-03-27T10:05:41.529 INFO:teuthology.orchestra.run.smithi057.stdout:644 2024-03-27T10:05:41.529 INFO:teuthology.orchestra.run.smithi057.stdout:644.out 2024-03-27T10:05:41.529 INFO:teuthology.orchestra.run.smithi057.stdout:645 2024-03-27T10:05:41.529 INFO:teuthology.orchestra.run.smithi057.stdout:645.out 2024-03-27T10:05:41.529 INFO:teuthology.orchestra.run.smithi057.stdout:646 2024-03-27T10:05:41.529 INFO:teuthology.orchestra.run.smithi057.stdout:646.out 2024-03-27T10:05:41.529 INFO:teuthology.orchestra.run.smithi057.stdout:647 2024-03-27T10:05:41.529 INFO:teuthology.orchestra.run.smithi057.stdout:647.out 2024-03-27T10:05:41.529 INFO:teuthology.orchestra.run.smithi057.stdout:648 2024-03-27T10:05:41.530 INFO:teuthology.orchestra.run.smithi057.stdout:648.out 2024-03-27T10:05:41.530 INFO:teuthology.orchestra.run.smithi057.stdout:649 2024-03-27T10:05:41.530 INFO:teuthology.orchestra.run.smithi057.stdout:649.out 2024-03-27T10:05:41.530 INFO:teuthology.orchestra.run.smithi057.stdout:650 2024-03-27T10:05:41.530 INFO:teuthology.orchestra.run.smithi057.stdout:650.out 2024-03-27T10:05:41.530 INFO:teuthology.orchestra.run.smithi057.stdout:651 2024-03-27T10:05:41.530 INFO:teuthology.orchestra.run.smithi057.stdout:651.out 2024-03-27T10:05:41.530 INFO:teuthology.orchestra.run.smithi057.stdout:652 2024-03-27T10:05:41.530 INFO:teuthology.orchestra.run.smithi057.stdout:652.out 2024-03-27T10:05:41.530 INFO:teuthology.orchestra.run.smithi057.stdout:653 2024-03-27T10:05:41.530 INFO:teuthology.orchestra.run.smithi057.stdout:653.out 2024-03-27T10:05:41.530 INFO:teuthology.orchestra.run.smithi057.stdout:654 2024-03-27T10:05:41.530 INFO:teuthology.orchestra.run.smithi057.stdout:654.out 2024-03-27T10:05:41.530 INFO:teuthology.orchestra.run.smithi057.stdout:655 2024-03-27T10:05:41.531 INFO:teuthology.orchestra.run.smithi057.stdout:655.out 2024-03-27T10:05:41.531 INFO:teuthology.orchestra.run.smithi057.stdout:656 2024-03-27T10:05:41.531 INFO:teuthology.orchestra.run.smithi057.stdout:656.out 2024-03-27T10:05:41.531 INFO:teuthology.orchestra.run.smithi057.stdout:657 2024-03-27T10:05:41.531 INFO:teuthology.orchestra.run.smithi057.stdout:657.out 2024-03-27T10:05:41.531 INFO:teuthology.orchestra.run.smithi057.stdout:658 2024-03-27T10:05:41.531 INFO:teuthology.orchestra.run.smithi057.stdout:658.out 2024-03-27T10:05:41.531 INFO:teuthology.orchestra.run.smithi057.stdout:659 2024-03-27T10:05:41.531 INFO:teuthology.orchestra.run.smithi057.stdout:659.out 2024-03-27T10:05:41.531 INFO:teuthology.orchestra.run.smithi057.stdout:660 2024-03-27T10:05:41.531 INFO:teuthology.orchestra.run.smithi057.stdout:660.out 2024-03-27T10:05:41.531 INFO:teuthology.orchestra.run.smithi057.stdout:661 2024-03-27T10:05:41.531 INFO:teuthology.orchestra.run.smithi057.stdout:661.out 2024-03-27T10:05:41.531 INFO:teuthology.orchestra.run.smithi057.stdout:662 2024-03-27T10:05:41.531 INFO:teuthology.orchestra.run.smithi057.stdout:662.out 2024-03-27T10:05:41.531 INFO:teuthology.orchestra.run.smithi057.stdout:663 2024-03-27T10:05:41.532 INFO:teuthology.orchestra.run.smithi057.stdout:663.out 2024-03-27T10:05:41.532 INFO:teuthology.orchestra.run.smithi057.stdout:664 2024-03-27T10:05:41.532 INFO:teuthology.orchestra.run.smithi057.stdout:664.out 2024-03-27T10:05:41.532 INFO:teuthology.orchestra.run.smithi057.stdout:665 2024-03-27T10:05:41.532 INFO:teuthology.orchestra.run.smithi057.stdout:665.out 2024-03-27T10:05:41.532 INFO:teuthology.orchestra.run.smithi057.stdout:666 2024-03-27T10:05:41.532 INFO:teuthology.orchestra.run.smithi057.stdout:666.out 2024-03-27T10:05:41.532 INFO:teuthology.orchestra.run.smithi057.stdout:667 2024-03-27T10:05:41.532 INFO:teuthology.orchestra.run.smithi057.stdout:667.out 2024-03-27T10:05:41.532 INFO:teuthology.orchestra.run.smithi057.stdout:668 2024-03-27T10:05:41.532 INFO:teuthology.orchestra.run.smithi057.stdout:668.out 2024-03-27T10:05:41.532 INFO:teuthology.orchestra.run.smithi057.stdout:669 2024-03-27T10:05:41.532 INFO:teuthology.orchestra.run.smithi057.stdout:669.out 2024-03-27T10:05:41.532 INFO:teuthology.orchestra.run.smithi057.stdout:670 2024-03-27T10:05:41.532 INFO:teuthology.orchestra.run.smithi057.stdout:670.out 2024-03-27T10:05:41.532 INFO:teuthology.orchestra.run.smithi057.stdout:671 2024-03-27T10:05:41.533 INFO:teuthology.orchestra.run.smithi057.stdout:671.out 2024-03-27T10:05:41.533 INFO:teuthology.orchestra.run.smithi057.stdout:672 2024-03-27T10:05:41.533 INFO:teuthology.orchestra.run.smithi057.stdout:672.out 2024-03-27T10:05:41.533 INFO:teuthology.orchestra.run.smithi057.stdout:673 2024-03-27T10:05:41.533 INFO:teuthology.orchestra.run.smithi057.stdout:673.out 2024-03-27T10:05:41.533 INFO:teuthology.orchestra.run.smithi057.stdout:674 2024-03-27T10:05:41.533 INFO:teuthology.orchestra.run.smithi057.stdout:674.out 2024-03-27T10:05:41.533 INFO:teuthology.orchestra.run.smithi057.stdout:675 2024-03-27T10:05:41.533 INFO:teuthology.orchestra.run.smithi057.stdout:675.out 2024-03-27T10:05:41.533 INFO:teuthology.orchestra.run.smithi057.stdout:676 2024-03-27T10:05:41.533 INFO:teuthology.orchestra.run.smithi057.stdout:676.out 2024-03-27T10:05:41.533 INFO:teuthology.orchestra.run.smithi057.stdout:677 2024-03-27T10:05:41.533 INFO:teuthology.orchestra.run.smithi057.stdout:677.out 2024-03-27T10:05:41.533 INFO:teuthology.orchestra.run.smithi057.stdout:678 2024-03-27T10:05:41.534 INFO:teuthology.orchestra.run.smithi057.stdout:678.out 2024-03-27T10:05:41.534 INFO:teuthology.orchestra.run.smithi057.stdout:679 2024-03-27T10:05:41.534 INFO:teuthology.orchestra.run.smithi057.stdout:679.out 2024-03-27T10:05:41.534 INFO:teuthology.orchestra.run.smithi057.stdout:680 2024-03-27T10:05:41.534 INFO:teuthology.orchestra.run.smithi057.stdout:680.out 2024-03-27T10:05:41.534 INFO:teuthology.orchestra.run.smithi057.stdout:681 2024-03-27T10:05:41.534 INFO:teuthology.orchestra.run.smithi057.stdout:681.out 2024-03-27T10:05:41.534 INFO:teuthology.orchestra.run.smithi057.stdout:682 2024-03-27T10:05:41.534 INFO:teuthology.orchestra.run.smithi057.stdout:682.out 2024-03-27T10:05:41.534 INFO:teuthology.orchestra.run.smithi057.stdout:683 2024-03-27T10:05:41.534 INFO:teuthology.orchestra.run.smithi057.stdout:683.out 2024-03-27T10:05:41.534 INFO:teuthology.orchestra.run.smithi057.stdout:684 2024-03-27T10:05:41.534 INFO:teuthology.orchestra.run.smithi057.stdout:684.out 2024-03-27T10:05:41.534 INFO:teuthology.orchestra.run.smithi057.stdout:685 2024-03-27T10:05:41.534 INFO:teuthology.orchestra.run.smithi057.stdout:685.out 2024-03-27T10:05:41.535 INFO:teuthology.orchestra.run.smithi057.stdout:686 2024-03-27T10:05:41.535 INFO:teuthology.orchestra.run.smithi057.stdout:686.out 2024-03-27T10:05:41.535 INFO:teuthology.orchestra.run.smithi057.stdout:687 2024-03-27T10:05:41.535 INFO:teuthology.orchestra.run.smithi057.stdout:687.out 2024-03-27T10:05:41.535 INFO:teuthology.orchestra.run.smithi057.stdout:688 2024-03-27T10:05:41.535 INFO:teuthology.orchestra.run.smithi057.stdout:688.out 2024-03-27T10:05:41.535 INFO:teuthology.orchestra.run.smithi057.stdout:689 2024-03-27T10:05:41.535 INFO:teuthology.orchestra.run.smithi057.stdout:689.out 2024-03-27T10:05:41.535 INFO:teuthology.orchestra.run.smithi057.stdout:690 2024-03-27T10:05:41.535 INFO:teuthology.orchestra.run.smithi057.stdout:690.out 2024-03-27T10:05:41.535 INFO:teuthology.orchestra.run.smithi057.stdout:691 2024-03-27T10:05:41.535 INFO:teuthology.orchestra.run.smithi057.stdout:691.out 2024-03-27T10:05:41.535 INFO:teuthology.orchestra.run.smithi057.stdout:692 2024-03-27T10:05:41.535 INFO:teuthology.orchestra.run.smithi057.stdout:692.out 2024-03-27T10:05:41.535 INFO:teuthology.orchestra.run.smithi057.stdout:693 2024-03-27T10:05:41.536 INFO:teuthology.orchestra.run.smithi057.stdout:693.out 2024-03-27T10:05:41.536 INFO:teuthology.orchestra.run.smithi057.stdout:694 2024-03-27T10:05:41.536 INFO:teuthology.orchestra.run.smithi057.stdout:694.out 2024-03-27T10:05:41.536 INFO:teuthology.orchestra.run.smithi057.stdout:695 2024-03-27T10:05:41.536 INFO:teuthology.orchestra.run.smithi057.stdout:695.out 2024-03-27T10:05:41.536 INFO:teuthology.orchestra.run.smithi057.stdout:696 2024-03-27T10:05:41.536 INFO:teuthology.orchestra.run.smithi057.stdout:696.out 2024-03-27T10:05:41.536 INFO:teuthology.orchestra.run.smithi057.stdout:697 2024-03-27T10:05:41.536 INFO:teuthology.orchestra.run.smithi057.stdout:697.out 2024-03-27T10:05:41.536 INFO:teuthology.orchestra.run.smithi057.stdout:698 2024-03-27T10:05:41.536 INFO:teuthology.orchestra.run.smithi057.stdout:698.out 2024-03-27T10:05:41.536 INFO:teuthology.orchestra.run.smithi057.stdout:699 2024-03-27T10:05:41.536 INFO:teuthology.orchestra.run.smithi057.stdout:699.out 2024-03-27T10:05:41.537 INFO:teuthology.orchestra.run.smithi057.stdout:700 2024-03-27T10:05:41.537 INFO:teuthology.orchestra.run.smithi057.stdout:700.out 2024-03-27T10:05:41.537 INFO:teuthology.orchestra.run.smithi057.stdout:701 2024-03-27T10:05:41.537 INFO:teuthology.orchestra.run.smithi057.stdout:701.out 2024-03-27T10:05:41.537 INFO:teuthology.orchestra.run.smithi057.stdout:702 2024-03-27T10:05:41.537 INFO:teuthology.orchestra.run.smithi057.stdout:702.out 2024-03-27T10:05:41.537 INFO:teuthology.orchestra.run.smithi057.stdout:703 2024-03-27T10:05:41.537 INFO:teuthology.orchestra.run.smithi057.stdout:703.out 2024-03-27T10:05:41.537 INFO:teuthology.orchestra.run.smithi057.stdout:704 2024-03-27T10:05:41.537 INFO:teuthology.orchestra.run.smithi057.stdout:704.out 2024-03-27T10:05:41.537 INFO:teuthology.orchestra.run.smithi057.stdout:705 2024-03-27T10:05:41.537 INFO:teuthology.orchestra.run.smithi057.stdout:705.out 2024-03-27T10:05:41.537 INFO:teuthology.orchestra.run.smithi057.stdout:706 2024-03-27T10:05:41.537 INFO:teuthology.orchestra.run.smithi057.stdout:706.out 2024-03-27T10:05:41.538 INFO:teuthology.orchestra.run.smithi057.stdout:707 2024-03-27T10:05:41.538 INFO:teuthology.orchestra.run.smithi057.stdout:707.out 2024-03-27T10:05:41.538 INFO:teuthology.orchestra.run.smithi057.stdout:708 2024-03-27T10:05:41.538 INFO:teuthology.orchestra.run.smithi057.stdout:708.out 2024-03-27T10:05:41.538 INFO:teuthology.orchestra.run.smithi057.stdout:709 2024-03-27T10:05:41.538 INFO:teuthology.orchestra.run.smithi057.stdout:709.out 2024-03-27T10:05:41.538 INFO:teuthology.orchestra.run.smithi057.stdout:710 2024-03-27T10:05:41.538 INFO:teuthology.orchestra.run.smithi057.stdout:710.out 2024-03-27T10:05:41.538 INFO:teuthology.orchestra.run.smithi057.stdout:711 2024-03-27T10:05:41.538 INFO:teuthology.orchestra.run.smithi057.stdout:711.out 2024-03-27T10:05:41.538 INFO:teuthology.orchestra.run.smithi057.stdout:712 2024-03-27T10:05:41.538 INFO:teuthology.orchestra.run.smithi057.stdout:712.out 2024-03-27T10:05:41.538 INFO:teuthology.orchestra.run.smithi057.stdout:713 2024-03-27T10:05:41.539 INFO:teuthology.orchestra.run.smithi057.stdout:713.out 2024-03-27T10:05:41.539 INFO:teuthology.orchestra.run.smithi057.stdout:714 2024-03-27T10:05:41.539 INFO:teuthology.orchestra.run.smithi057.stdout:714.out 2024-03-27T10:05:41.539 INFO:teuthology.orchestra.run.smithi057.stdout:715 2024-03-27T10:05:41.539 INFO:teuthology.orchestra.run.smithi057.stdout:715.out 2024-03-27T10:05:41.539 INFO:teuthology.orchestra.run.smithi057.stdout:716 2024-03-27T10:05:41.539 INFO:teuthology.orchestra.run.smithi057.stdout:716.out 2024-03-27T10:05:41.539 INFO:teuthology.orchestra.run.smithi057.stdout:717 2024-03-27T10:05:41.539 INFO:teuthology.orchestra.run.smithi057.stdout:717.out 2024-03-27T10:05:41.539 INFO:teuthology.orchestra.run.smithi057.stdout:718 2024-03-27T10:05:41.539 INFO:teuthology.orchestra.run.smithi057.stdout:718.out 2024-03-27T10:05:41.539 INFO:teuthology.orchestra.run.smithi057.stdout:719 2024-03-27T10:05:41.539 INFO:teuthology.orchestra.run.smithi057.stdout:719.out 2024-03-27T10:05:41.540 INFO:teuthology.orchestra.run.smithi057.stdout:720 2024-03-27T10:05:41.540 INFO:teuthology.orchestra.run.smithi057.stdout:720.out 2024-03-27T10:05:41.540 INFO:teuthology.orchestra.run.smithi057.stdout:721 2024-03-27T10:05:41.540 INFO:teuthology.orchestra.run.smithi057.stdout:721.out 2024-03-27T10:05:41.540 INFO:teuthology.orchestra.run.smithi057.stdout:722 2024-03-27T10:05:41.540 INFO:teuthology.orchestra.run.smithi057.stdout:722.out 2024-03-27T10:05:41.540 INFO:teuthology.orchestra.run.smithi057.stdout:723 2024-03-27T10:05:41.540 INFO:teuthology.orchestra.run.smithi057.stdout:723.out 2024-03-27T10:05:41.540 INFO:teuthology.orchestra.run.smithi057.stdout:724 2024-03-27T10:05:41.540 INFO:teuthology.orchestra.run.smithi057.stdout:724.out 2024-03-27T10:05:41.540 INFO:teuthology.orchestra.run.smithi057.stdout:725 2024-03-27T10:05:41.540 INFO:teuthology.orchestra.run.smithi057.stdout:725.out 2024-03-27T10:05:41.540 INFO:teuthology.orchestra.run.smithi057.stdout:726 2024-03-27T10:05:41.540 INFO:teuthology.orchestra.run.smithi057.stdout:726.out 2024-03-27T10:05:41.540 INFO:teuthology.orchestra.run.smithi057.stdout:727 2024-03-27T10:05:41.540 INFO:teuthology.orchestra.run.smithi057.stdout:727.out 2024-03-27T10:05:41.541 INFO:teuthology.orchestra.run.smithi057.stdout:728 2024-03-27T10:05:41.541 INFO:teuthology.orchestra.run.smithi057.stdout:728.out 2024-03-27T10:05:41.541 INFO:teuthology.orchestra.run.smithi057.stdout:729 2024-03-27T10:05:41.541 INFO:teuthology.orchestra.run.smithi057.stdout:729.out 2024-03-27T10:05:41.541 INFO:teuthology.orchestra.run.smithi057.stdout:730 2024-03-27T10:05:41.541 INFO:teuthology.orchestra.run.smithi057.stdout:730.out 2024-03-27T10:05:41.541 INFO:teuthology.orchestra.run.smithi057.stdout:731 2024-03-27T10:05:41.541 INFO:teuthology.orchestra.run.smithi057.stdout:731.out 2024-03-27T10:05:41.541 INFO:teuthology.orchestra.run.smithi057.stdout:732 2024-03-27T10:05:41.541 INFO:teuthology.orchestra.run.smithi057.stdout:732.out 2024-03-27T10:05:41.541 INFO:teuthology.orchestra.run.smithi057.stdout:733 2024-03-27T10:05:41.541 INFO:teuthology.orchestra.run.smithi057.stdout:733.out 2024-03-27T10:05:41.541 INFO:teuthology.orchestra.run.smithi057.stdout:734 2024-03-27T10:05:41.541 INFO:teuthology.orchestra.run.smithi057.stdout:734.out 2024-03-27T10:05:41.541 INFO:teuthology.orchestra.run.smithi057.stdout:735 2024-03-27T10:05:41.542 INFO:teuthology.orchestra.run.smithi057.stdout:735.out 2024-03-27T10:05:41.542 INFO:teuthology.orchestra.run.smithi057.stdout:736 2024-03-27T10:05:41.542 INFO:teuthology.orchestra.run.smithi057.stdout:736.out 2024-03-27T10:05:41.542 INFO:teuthology.orchestra.run.smithi057.stdout:737 2024-03-27T10:05:41.542 INFO:teuthology.orchestra.run.smithi057.stdout:737.out 2024-03-27T10:05:41.542 INFO:teuthology.orchestra.run.smithi057.stdout:738 2024-03-27T10:05:41.542 INFO:teuthology.orchestra.run.smithi057.stdout:738.out 2024-03-27T10:05:41.542 INFO:teuthology.orchestra.run.smithi057.stdout:739 2024-03-27T10:05:41.542 INFO:teuthology.orchestra.run.smithi057.stdout:739.out 2024-03-27T10:05:41.542 INFO:teuthology.orchestra.run.smithi057.stdout:group.list 2024-03-27T10:05:41.542 INFO:teuthology.orchestra.run.smithi057.stdout:Makefile 2024-03-27T10:05:41.544 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/001) 2024-03-27T10:05:42.057 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T10:05:42.069 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T10:05:42.069 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:05:49.432 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:05:49.439 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:05:50.438 INFO:teuthology.orchestra.run.smithi057.stdout:generic/001 8s 2024-03-27T10:05:50.454 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/001 2024-03-27T10:05:50.454 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T10:05:50.462 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:05:50.466 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi057.stderr:ceph-fuse[53742]: fuse finished with error 0 and tester_r 0 2024-03-27T10:05:50.495 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T10:05:50.496 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/002) 2024-03-27T10:05:50.990 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T10:05:51.002 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T10:05:51.002 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:05:52.082 INFO:teuthology.orchestra.run.smithi057.stdout:generic/002 1s 2024-03-27T10:05:52.101 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/002 2024-03-27T10:05:52.101 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T10:05:52.108 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:05:52.141 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T10:05:52.141 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/003) 2024-03-27T10:05:52.619 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T10:05:52.630 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T10:05:52.630 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:05:53.043 INFO:teuthology.orchestra.run.smithi057.stdout:generic/003 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T10:05:53.055 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/003 2024-03-27T10:05:53.055 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/003 2024-03-27T10:05:53.055 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T10:05:53.066 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:05:53.096 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T10:05:53.096 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/004) 2024-03-27T10:05:53.638 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T10:05:53.650 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T10:05:53.650 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:05:54.071 INFO:teuthology.orchestra.run.smithi057.stdout:generic/004 [not run] O_TMPFILE is not supported 2024-03-27T10:05:54.081 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/004 2024-03-27T10:05:54.082 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/004 2024-03-27T10:05:54.082 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T10:05:54.091 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:05:54.122 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T10:05:54.122 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/005) 2024-03-27T10:05:54.675 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T10:05:54.688 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T10:05:54.688 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:05:56.712 INFO:teuthology.orchestra.run.smithi057.stdout:generic/005 2s 2024-03-27T10:05:56.730 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/005 2024-03-27T10:05:56.731 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T10:05:56.740 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:05:56.775 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T10:05:56.775 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/006) 2024-03-27T10:05:57.269 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T10:05:57.281 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T10:05:57.281 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:06:19.572 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:06:19.579 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:06:49.715 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:06:49.724 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:07:12.453 INFO:teuthology.orchestra.run.smithi057.stdout:generic/006 75s 2024-03-27T10:07:12.469 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/006 2024-03-27T10:07:12.469 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T10:07:12.476 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:07:12.571 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T10:07:12.572 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/007) 2024-03-27T10:07:13.225 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T10:07:13.237 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T10:07:13.237 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:07:19.851 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:07:19.857 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:07:50.991 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:07:50.997 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:08:21.136 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:08:21.142 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:08:51.332 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:08:51.337 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:09:21.463 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:09:21.468 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:09:51.626 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:09:51.631 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:10:05.999 INFO:teuthology.orchestra.run.smithi057.stdout:generic/007 173s 2024-03-27T10:10:06.013 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/007 2024-03-27T10:10:06.013 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T10:10:06.021 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:10:06.047 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T10:10:06.047 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/008) 2024-03-27T10:10:06.547 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T10:10:06.559 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T10:10:06.559 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:10:09.742 INFO:teuthology.orchestra.run.smithi057.stdout:generic/008 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-03-27T10:10:09.754 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/008 2024-03-27T10:10:09.754 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/008 2024-03-27T10:10:09.755 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T10:10:09.767 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:10:09.797 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T10:10:09.797 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/009) 2024-03-27T10:10:10.324 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T10:10:10.337 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T10:10:10.337 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:10:13.953 INFO:teuthology.orchestra.run.smithi057.stdout:generic/009 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-03-27T10:10:13.964 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/009 2024-03-27T10:10:13.965 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/009 2024-03-27T10:10:13.965 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T10:10:13.974 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:10:14.006 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T10:10:14.006 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/010) 2024-03-27T10:10:14.548 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T10:10:14.560 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T10:10:14.560 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:10:16.343 INFO:teuthology.orchestra.run.smithi057.stdout:generic/010 2s 2024-03-27T10:10:17.055 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/010 2024-03-27T10:10:17.055 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T10:10:17.067 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:10:17.144 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T10:10:17.145 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/011) 2024-03-27T10:10:17.621 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T10:10:17.634 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T10:10:17.634 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:10:22.783 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:10:22.790 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:10:52.961 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:10:52.969 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:11:20.258 INFO:teuthology.orchestra.run.smithi057.stdout:generic/011 63s 2024-03-27T10:11:20.271 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/011 2024-03-27T10:11:20.271 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T10:11:20.279 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:11:20.318 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T10:11:20.319 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/012) 2024-03-27T10:11:20.867 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T10:11:20.879 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T10:11:20.879 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:11:24.173 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:11:24.183 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:11:24.837 INFO:teuthology.orchestra.run.smithi057.stdout:generic/012 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-03-27T10:11:24.851 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/012 2024-03-27T10:11:24.851 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/012 2024-03-27T10:11:24.851 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T10:11:24.863 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:11:24.907 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T10:11:24.907 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/013) 2024-03-27T10:11:25.681 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T10:11:25.693 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T10:11:25.693 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:11:54.313 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:11:54.319 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:12:25.029 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:12:25.040 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:12:55.275 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:12:55.286 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:12:55.704 INFO:tasks.ceph.mds.c.smithi057.stderr:2024-03-27T10:12:55.720+0000 7f1f8ba00640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 121639) UID: 0 2024-03-27T10:12:55.705 INFO:tasks.ceph.mds.a.smithi057.stderr:2024-03-27T10:12:55.721+0000 7f0ffc400640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 121639) UID: 0 2024-03-27T10:13:42.014 INFO:teuthology.orchestra.run.smithi057.stdout:generic/013 137s 2024-03-27T10:13:42.037 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/013 2024-03-27T10:13:42.038 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T10:13:42.047 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:13:42.083 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T10:13:42.083 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/014) 2024-03-27T10:13:42.857 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T10:13:42.873 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T10:13:42.873 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:13:43.467 INFO:teuthology.orchestra.run.smithi057.stdout:generic/014 [not run] Sparse files are not supported or do not work as expected 2024-03-27T10:13:43.480 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/014 2024-03-27T10:13:43.481 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/014 2024-03-27T10:13:43.481 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T10:13:43.492 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:13:43.532 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T10:13:43.533 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/015) 2024-03-27T10:13:44.263 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T10:13:44.283 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T10:13:44.283 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:13:44.769 INFO:teuthology.orchestra.run.smithi057.stdout:generic/015 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T10:13:44.782 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/015 2024-03-27T10:13:44.783 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/015 2024-03-27T10:13:44.783 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T10:13:44.795 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:13:44.833 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T10:13:44.833 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/016) 2024-03-27T10:13:45.603 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T10:13:45.622 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T10:13:45.622 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:13:48.995 INFO:teuthology.orchestra.run.smithi057.stdout:generic/016 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-03-27T10:13:49.010 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/016 2024-03-27T10:13:49.010 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/016 2024-03-27T10:13:49.011 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T10:13:49.023 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:13:49.062 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T10:13:49.062 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/017) 2024-03-27T10:13:49.925 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T10:13:49.948 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T10:13:49.948 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:13:50.447 INFO:teuthology.orchestra.run.smithi057.stdout:generic/017 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T10:13:50.461 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/017 2024-03-27T10:13:50.462 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/017 2024-03-27T10:13:50.462 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T10:13:50.474 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:13:50.509 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T10:13:50.510 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/018) 2024-03-27T10:13:51.244 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T10:13:51.260 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T10:13:51.261 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:13:51.768 INFO:teuthology.orchestra.run.smithi057.stdout:generic/018 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T10:13:51.779 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/018 2024-03-27T10:13:51.780 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/018 2024-03-27T10:13:51.780 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T10:13:51.794 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:13:51.835 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T10:13:51.835 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/019) 2024-03-27T10:13:52.596 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T10:13:52.617 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T10:13:52.617 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:13:53.143 INFO:teuthology.orchestra.run.smithi057.stdout:generic/019 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T10:13:53.155 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/019 2024-03-27T10:13:53.155 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/019 2024-03-27T10:13:53.155 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T10:13:53.166 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:13:53.201 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T10:13:53.201 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/020) 2024-03-27T10:13:53.971 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T10:13:53.989 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T10:13:53.989 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:14:16.107 INFO:teuthology.orchestra.run.smithi057.stdout:generic/020 - output mismatch (see /tmp/tmp.446sL8UEHrxfstests-dev/results//generic/020.out.bad) 2024-03-27T10:14:16.122 INFO:teuthology.orchestra.run.smithi057.stdout: --- tests/generic/020.out 2024-03-27 10:01:35.868469898 +0000 2024-03-27T10:14:16.122 INFO:teuthology.orchestra.run.smithi057.stdout: +++ /tmp/tmp.446sL8UEHrxfstests-dev/results//generic/020.out.bad 2024-03-27 10:14:16.118796703 +0000 2024-03-27T10:14:16.122 INFO:teuthology.orchestra.run.smithi057.stdout: @@ -47,9 +47,13 @@ 2024-03-27T10:14:16.122 INFO:teuthology.orchestra.run.smithi057.stdout: user.snrub="fish2\012" 2024-03-27T10:14:16.122 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:14:16.123 INFO:teuthology.orchestra.run.smithi057.stdout: *** really long value 2024-03-27T10:14:16.123 INFO:teuthology.orchestra.run.smithi057.stdout: -0000000 00 2024-03-27T10:14:16.123 INFO:teuthology.orchestra.run.smithi057.stdout: -* 2024-03-27T10:14:16.123 INFO:teuthology.orchestra.run.smithi057.stdout: -ATTRSIZE 2024-03-27T10:14:16.123 INFO:teuthology.orchestra.run.smithi057.stdout: +attr_set: No space left on device 2024-03-27T10:14:16.123 INFO:teuthology.orchestra.run.smithi057.stdout: +Could not set "long_attr" for 2024-03-27T10:14:16.123 INFO:teuthology.orchestra.run.smithi057.stdout: +attr_get: No data available 2024-03-27T10:14:16.123 INFO:teuthology.orchestra.run.smithi057.stdout: +Could not get "long_attr" for 2024-03-27T10:14:16.123 INFO:teuthology.orchestra.run.smithi057.stdout: +0000000 2024-03-27T10:14:16.123 INFO:teuthology.orchestra.run.smithi057.stdout: +attr_remove: No data available 2024-03-27T10:14:16.123 INFO:teuthology.orchestra.run.smithi057.stdout: +Could not remove "long_attr" for 2024-03-27T10:14:16.123 INFO:teuthology.orchestra.run.smithi057.stdout: *** set/get/remove really long names (expect failure) 2024-03-27T10:14:16.123 INFO:teuthology.orchestra.run.smithi057.stdout: attr_set: Invalid argument 2024-03-27T10:14:16.124 INFO:teuthology.orchestra.run.smithi057.stdout: Could not set "XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX" for 2024-03-27T10:14:16.131 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/020 2024-03-27T10:14:16.133 INFO:teuthology.orchestra.run.smithi057.stdout:Failures: generic/020 2024-03-27T10:14:16.133 INFO:teuthology.orchestra.run.smithi057.stdout:Failed 1 of 1 tests 2024-03-27T10:14:16.146 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:14:16.193 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-27T10:14:16.194 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-03-27T10:14:16.194 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-03-27T10:14:16.194 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/021) 2024-03-27T10:14:17.032 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T10:14:17.051 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T10:14:17.051 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:14:20.508 INFO:teuthology.orchestra.run.smithi057.stdout:generic/021 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-03-27T10:14:20.521 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/021 2024-03-27T10:14:20.521 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/021 2024-03-27T10:14:20.521 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T10:14:20.533 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:14:20.604 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T10:14:20.605 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/022) 2024-03-27T10:14:21.410 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T10:14:21.426 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T10:14:21.428 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:14:24.816 INFO:teuthology.orchestra.run.smithi057.stdout:generic/022 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-03-27T10:14:24.833 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/022 2024-03-27T10:14:24.833 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/022 2024-03-27T10:14:24.833 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T10:14:24.844 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:14:24.892 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T10:14:24.893 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/023) 2024-03-27T10:14:25.698 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T10:14:25.720 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T10:14:25.720 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:14:29.839 INFO:teuthology.orchestra.run.smithi057.stdout:generic/023 4s 2024-03-27T10:14:30.220 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/023 2024-03-27T10:14:30.221 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T10:14:30.228 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:14:30.270 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T10:14:30.271 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/024) 2024-03-27T10:14:31.120 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T10:14:31.140 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T10:14:31.140 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:14:31.745 INFO:teuthology.orchestra.run.smithi057.stdout:generic/024 [not run] kernel doesn't support renameat2 syscall 2024-03-27T10:14:31.760 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/024 2024-03-27T10:14:31.760 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/024 2024-03-27T10:14:31.761 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T10:14:31.771 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:14:31.817 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T10:14:31.817 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/025) 2024-03-27T10:14:32.651 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T10:14:32.670 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T10:14:32.670 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:14:33.256 INFO:teuthology.orchestra.run.smithi057.stdout:generic/025 [not run] kernel doesn't support renameat2 syscall 2024-03-27T10:14:33.268 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/025 2024-03-27T10:14:33.268 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/025 2024-03-27T10:14:33.268 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T10:14:33.280 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:14:33.328 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T10:14:33.328 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/026) 2024-03-27T10:14:34.149 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T10:14:34.169 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T10:14:34.169 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:14:34.795 INFO:teuthology.orchestra.run.smithi057.stdout:generic/026 [not run] ACLs not supported by this filesystem type: ceph-fuse 2024-03-27T10:14:34.806 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/026 2024-03-27T10:14:34.807 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/026 2024-03-27T10:14:34.807 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T10:14:34.816 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:14:34.853 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T10:14:34.853 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/027) 2024-03-27T10:14:35.595 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T10:14:35.616 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T10:14:35.616 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:14:36.138 INFO:teuthology.orchestra.run.smithi057.stdout:generic/027 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T10:14:36.153 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/027 2024-03-27T10:14:36.153 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/027 2024-03-27T10:14:36.153 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T10:14:36.164 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:14:36.210 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T10:14:36.210 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/028) 2024-03-27T10:14:36.968 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T10:14:36.985 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T10:14:36.985 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:14:42.593 INFO:teuthology.orchestra.run.smithi057.stdout:generic/028 5s 2024-03-27T10:14:42.614 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/028 2024-03-27T10:14:42.614 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T10:14:42.625 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:14:42.662 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T10:14:42.662 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/029) 2024-03-27T10:14:43.404 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T10:14:43.426 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T10:14:43.426 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:14:43.891 INFO:teuthology.orchestra.run.smithi057.stdout:generic/029 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T10:14:43.902 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/029 2024-03-27T10:14:43.902 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/029 2024-03-27T10:14:43.903 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T10:14:43.914 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:14:43.949 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T10:14:43.949 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/030) 2024-03-27T10:14:44.666 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T10:14:44.683 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T10:14:44.683 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:14:45.165 INFO:teuthology.orchestra.run.smithi057.stdout:generic/030 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T10:14:45.180 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/030 2024-03-27T10:14:45.180 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/030 2024-03-27T10:14:45.180 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T10:14:45.189 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:14:45.226 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T10:14:45.227 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/031) 2024-03-27T10:14:45.991 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T10:14:46.009 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T10:14:46.010 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:14:46.501 INFO:teuthology.orchestra.run.smithi057.stdout:generic/031 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T10:14:46.515 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/031 2024-03-27T10:14:46.515 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/031 2024-03-27T10:14:46.515 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T10:14:46.526 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:14:46.563 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T10:14:46.563 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/032) 2024-03-27T10:14:47.269 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T10:14:47.286 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T10:14:47.286 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:14:47.749 INFO:teuthology.orchestra.run.smithi057.stdout:generic/032 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T10:14:47.765 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/032 2024-03-27T10:14:47.765 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/032 2024-03-27T10:14:47.765 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T10:14:47.777 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:14:47.815 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T10:14:47.815 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/033) 2024-03-27T10:14:48.553 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T10:14:48.571 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T10:14:48.571 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:14:49.062 INFO:teuthology.orchestra.run.smithi057.stdout:generic/033 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T10:14:49.080 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/033 2024-03-27T10:14:49.081 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/033 2024-03-27T10:14:49.081 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T10:14:49.090 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:14:49.128 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T10:14:49.128 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/034) 2024-03-27T10:14:49.904 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T10:14:49.923 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T10:14:49.923 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:14:50.476 INFO:teuthology.orchestra.run.smithi057.stdout:generic/034 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T10:14:50.490 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/034 2024-03-27T10:14:50.492 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/034 2024-03-27T10:14:50.492 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T10:14:50.503 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:14:50.542 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T10:14:50.543 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/035) 2024-03-27T10:14:51.284 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T10:14:51.303 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T10:14:51.303 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:14:52.024 INFO:teuthology.orchestra.run.smithi057.stdout:generic/035 1s 2024-03-27T10:14:52.049 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/035 2024-03-27T10:14:52.049 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T10:14:52.060 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:14:52.103 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T10:14:52.103 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/036) 2024-03-27T10:14:52.957 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T10:14:52.973 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T10:14:52.974 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:15:03.688 INFO:teuthology.orchestra.run.smithi057.stdout:generic/036 10s 2024-03-27T10:15:03.708 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/036 2024-03-27T10:15:03.708 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T10:15:03.722 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:15:03.775 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T10:15:03.775 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/037) 2024-03-27T10:15:04.648 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T10:15:04.667 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T10:15:04.667 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:15:05.149 INFO:teuthology.orchestra.run.smithi057.stdout:generic/037 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T10:15:05.164 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/037 2024-03-27T10:15:05.164 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/037 2024-03-27T10:15:05.164 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T10:15:05.182 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:15:05.218 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T10:15:05.218 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/038) 2024-03-27T10:15:05.928 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T10:15:05.948 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T10:15:05.948 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:15:06.369 INFO:teuthology.orchestra.run.smithi057.stdout:generic/038 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T10:15:06.382 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/038 2024-03-27T10:15:06.382 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/038 2024-03-27T10:15:06.382 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T10:15:06.393 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:15:06.426 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T10:15:06.427 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/039) 2024-03-27T10:15:07.160 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T10:15:07.179 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T10:15:07.179 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:15:07.715 INFO:teuthology.orchestra.run.smithi057.stdout:generic/039 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T10:15:07.728 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/039 2024-03-27T10:15:07.728 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/039 2024-03-27T10:15:07.728 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T10:15:07.741 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:15:07.775 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T10:15:07.775 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/040) 2024-03-27T10:15:08.485 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T10:15:08.502 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T10:15:08.503 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:15:09.037 INFO:teuthology.orchestra.run.smithi057.stdout:generic/040 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T10:15:09.053 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/040 2024-03-27T10:15:09.054 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/040 2024-03-27T10:15:09.054 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T10:15:09.065 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:15:09.098 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T10:15:09.098 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/041) 2024-03-27T10:15:09.847 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T10:15:09.865 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T10:15:09.866 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:15:10.386 INFO:teuthology.orchestra.run.smithi057.stdout:generic/041 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T10:15:10.399 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/041 2024-03-27T10:15:10.399 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/041 2024-03-27T10:15:10.399 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T10:15:10.410 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:15:10.449 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T10:15:10.450 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/042) 2024-03-27T10:15:11.223 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T10:15:11.241 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T10:15:11.242 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:15:11.760 INFO:teuthology.orchestra.run.smithi057.stdout:generic/042 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T10:15:11.775 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/042 2024-03-27T10:15:11.775 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/042 2024-03-27T10:15:11.776 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T10:15:11.787 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:15:11.830 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T10:15:11.831 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/043) 2024-03-27T10:15:12.573 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T10:15:12.589 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T10:15:12.589 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:15:13.111 INFO:teuthology.orchestra.run.smithi057.stdout:generic/043 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T10:15:13.125 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/043 2024-03-27T10:15:13.127 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/043 2024-03-27T10:15:13.127 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T10:15:13.137 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:15:13.172 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T10:15:13.172 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/044) 2024-03-27T10:15:13.969 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T10:15:13.987 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T10:15:13.988 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:15:14.516 INFO:teuthology.orchestra.run.smithi057.stdout:generic/044 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T10:15:14.529 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/044 2024-03-27T10:15:14.529 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/044 2024-03-27T10:15:14.529 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T10:15:14.539 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:15:14.576 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T10:15:14.576 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/045) 2024-03-27T10:15:15.342 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T10:15:15.361 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T10:15:15.362 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:15:15.883 INFO:teuthology.orchestra.run.smithi057.stdout:generic/045 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T10:15:15.898 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/045 2024-03-27T10:15:15.898 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/045 2024-03-27T10:15:15.899 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T10:15:15.910 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:15:15.954 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T10:15:15.954 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/046) 2024-03-27T10:15:16.728 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T10:15:16.747 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T10:15:16.747 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:15:17.249 INFO:teuthology.orchestra.run.smithi057.stdout:generic/046 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T10:15:17.263 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/046 2024-03-27T10:15:17.265 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/046 2024-03-27T10:15:17.265 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T10:15:17.275 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:15:17.314 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T10:15:17.314 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/047) 2024-03-27T10:15:18.095 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T10:15:18.113 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T10:15:18.113 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:15:18.609 INFO:teuthology.orchestra.run.smithi057.stdout:generic/047 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T10:15:18.625 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/047 2024-03-27T10:15:18.625 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/047 2024-03-27T10:15:18.626 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T10:15:18.638 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:15:18.680 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T10:15:18.680 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/048) 2024-03-27T10:15:19.432 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T10:15:19.452 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T10:15:19.452 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:15:19.955 INFO:teuthology.orchestra.run.smithi057.stdout:generic/048 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T10:15:19.972 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/048 2024-03-27T10:15:19.972 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/048 2024-03-27T10:15:19.972 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T10:15:19.983 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:15:20.021 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T10:15:20.021 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/049) 2024-03-27T10:15:20.739 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T10:15:20.755 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T10:15:20.755 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:15:21.257 INFO:teuthology.orchestra.run.smithi057.stdout:generic/049 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T10:15:21.271 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/049 2024-03-27T10:15:21.271 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/049 2024-03-27T10:15:21.271 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T10:15:21.281 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:15:21.325 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T10:15:21.325 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/050) 2024-03-27T10:15:22.048 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T10:15:22.062 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T10:15:22.063 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:15:22.557 INFO:teuthology.orchestra.run.smithi057.stdout:generic/050 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T10:15:22.571 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/050 2024-03-27T10:15:22.571 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/050 2024-03-27T10:15:22.571 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T10:15:22.583 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:15:22.623 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T10:15:22.623 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/051) 2024-03-27T10:15:23.364 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T10:15:23.381 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T10:15:23.381 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:15:23.898 INFO:teuthology.orchestra.run.smithi057.stdout:generic/051 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T10:15:23.910 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/051 2024-03-27T10:15:23.910 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/051 2024-03-27T10:15:23.910 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T10:15:23.921 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:15:23.958 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T10:15:23.958 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/052) 2024-03-27T10:15:24.709 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T10:15:24.730 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T10:15:24.730 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:15:25.227 INFO:teuthology.orchestra.run.smithi057.stdout:generic/052 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T10:15:25.242 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/052 2024-03-27T10:15:25.242 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/052 2024-03-27T10:15:25.242 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T10:15:25.256 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:15:25.291 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T10:15:25.291 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/053) 2024-03-27T10:15:26.011 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T10:15:26.031 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T10:15:26.031 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:15:26.532 INFO:teuthology.orchestra.run.smithi057.stdout:generic/053 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T10:15:26.546 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/053 2024-03-27T10:15:26.546 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/053 2024-03-27T10:15:26.546 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T10:15:26.557 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:15:26.588 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T10:15:26.589 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/054) 2024-03-27T10:15:27.359 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T10:15:27.379 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T10:15:27.379 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:15:27.865 INFO:teuthology.orchestra.run.smithi057.stdout:generic/054 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T10:15:27.879 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/054 2024-03-27T10:15:27.879 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/054 2024-03-27T10:15:27.879 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T10:15:27.888 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:15:27.921 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T10:15:27.921 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/055) 2024-03-27T10:15:28.684 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T10:15:28.704 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T10:15:28.704 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:15:29.190 INFO:teuthology.orchestra.run.smithi057.stdout:generic/055 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T10:15:29.203 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/055 2024-03-27T10:15:29.203 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/055 2024-03-27T10:15:29.203 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T10:15:29.213 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:15:29.248 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T10:15:29.249 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/056) 2024-03-27T10:15:30.016 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T10:15:30.039 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T10:15:30.039 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:15:30.594 INFO:teuthology.orchestra.run.smithi057.stdout:generic/056 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T10:15:30.611 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/056 2024-03-27T10:15:30.612 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/056 2024-03-27T10:15:30.612 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T10:15:30.626 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:15:30.662 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T10:15:30.662 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/057) 2024-03-27T10:15:31.422 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T10:15:31.439 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T10:15:31.439 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:15:31.988 INFO:teuthology.orchestra.run.smithi057.stdout:generic/057 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T10:15:32.004 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/057 2024-03-27T10:15:32.004 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/057 2024-03-27T10:15:32.004 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T10:15:32.015 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:15:32.050 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T10:15:32.051 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/058) 2024-03-27T10:15:32.801 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T10:15:32.817 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T10:15:32.818 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:15:36.063 INFO:teuthology.orchestra.run.smithi057.stdout:generic/058 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-03-27T10:15:36.071 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/058 2024-03-27T10:15:36.072 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/058 2024-03-27T10:15:36.072 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T10:15:36.077 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:15:36.123 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T10:15:36.124 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/059) 2024-03-27T10:15:36.951 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T10:15:36.972 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T10:15:36.972 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:15:37.491 INFO:teuthology.orchestra.run.smithi057.stdout:generic/059 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T10:15:37.503 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/059 2024-03-27T10:15:37.503 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/059 2024-03-27T10:15:37.503 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T10:15:37.514 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:15:37.549 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T10:15:37.549 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/060) 2024-03-27T10:15:38.290 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T10:15:38.309 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T10:15:38.309 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:15:41.686 INFO:teuthology.orchestra.run.smithi057.stdout:generic/060 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-03-27T10:15:41.698 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/060 2024-03-27T10:15:41.699 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/060 2024-03-27T10:15:41.699 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T10:15:41.709 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:15:41.762 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T10:15:41.762 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/061) 2024-03-27T10:15:42.628 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T10:15:42.649 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T10:15:42.649 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:15:46.016 INFO:teuthology.orchestra.run.smithi057.stdout:generic/061 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-03-27T10:15:46.029 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/061 2024-03-27T10:15:46.029 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/061 2024-03-27T10:15:46.029 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T10:15:46.039 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:15:46.086 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T10:15:46.086 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/062) 2024-03-27T10:15:46.870 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T10:15:46.890 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T10:15:46.890 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:15:47.349 INFO:teuthology.orchestra.run.smithi057.stdout:generic/062 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T10:15:47.362 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/062 2024-03-27T10:15:47.362 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/062 2024-03-27T10:15:47.362 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T10:15:47.372 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:15:47.409 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T10:15:47.409 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/063) 2024-03-27T10:15:48.078 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T10:15:48.097 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T10:15:48.097 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:15:51.391 INFO:teuthology.orchestra.run.smithi057.stdout:generic/063 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-03-27T10:15:51.402 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/063 2024-03-27T10:15:51.403 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/063 2024-03-27T10:15:51.403 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T10:15:51.412 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:15:51.450 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T10:15:51.451 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/064) 2024-03-27T10:15:52.279 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T10:15:52.300 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T10:15:52.300 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:15:52.749 INFO:teuthology.orchestra.run.smithi057.stdout:generic/064 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T10:15:52.765 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/064 2024-03-27T10:15:52.766 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/064 2024-03-27T10:15:52.766 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T10:15:52.775 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:15:52.808 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T10:15:52.808 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/065) 2024-03-27T10:15:53.480 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T10:15:53.497 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T10:15:53.497 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:15:53.987 INFO:teuthology.orchestra.run.smithi057.stdout:generic/065 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T10:15:54.001 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/065 2024-03-27T10:15:54.001 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/065 2024-03-27T10:15:54.001 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T10:15:54.010 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:15:54.047 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T10:15:54.047 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/066) 2024-03-27T10:15:54.840 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T10:15:54.857 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T10:15:54.857 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:15:55.445 INFO:teuthology.orchestra.run.smithi057.stdout:generic/066 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T10:15:55.457 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/066 2024-03-27T10:15:55.458 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/066 2024-03-27T10:15:55.458 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T10:15:55.471 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:15:55.502 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T10:15:55.503 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/067) 2024-03-27T10:15:56.178 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T10:15:56.197 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T10:15:56.197 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:15:56.709 INFO:teuthology.orchestra.run.smithi057.stdout:generic/067 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T10:15:56.722 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/067 2024-03-27T10:15:56.722 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/067 2024-03-27T10:15:56.722 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T10:15:56.734 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:15:56.777 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T10:15:56.777 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/068) 2024-03-27T10:15:57.460 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T10:15:57.476 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T10:15:57.476 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:15:57.948 INFO:teuthology.orchestra.run.smithi057.stdout:generic/068 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T10:15:57.961 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/068 2024-03-27T10:15:57.963 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/068 2024-03-27T10:15:57.963 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T10:15:57.973 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:15:58.005 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T10:15:58.006 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/069) 2024-03-27T10:15:58.678 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T10:15:58.695 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T10:15:58.695 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:15:59.155 INFO:teuthology.orchestra.run.smithi057.stdout:generic/069 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T10:15:59.165 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/069 2024-03-27T10:15:59.165 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/069 2024-03-27T10:15:59.166 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T10:15:59.174 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:15:59.206 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T10:15:59.206 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/070) 2024-03-27T10:15:59.894 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T10:15:59.910 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T10:15:59.910 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:16:14.659 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:16:14.665 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:16:45.692 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:16:45.699 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:17:16.998 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:17:17.004 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:17:48.194 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:17:48.201 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:18:13.686 INFO:teuthology.orchestra.run.smithi057.stdout:generic/070 134s 2024-03-27T10:18:13.705 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/070 2024-03-27T10:18:13.706 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T10:18:13.716 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:18:13.758 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T10:18:13.759 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/071) 2024-03-27T10:18:14.599 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T10:18:14.616 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T10:18:14.616 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:18:15.051 INFO:teuthology.orchestra.run.smithi057.stdout:generic/071 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T10:18:15.066 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/071 2024-03-27T10:18:15.067 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/071 2024-03-27T10:18:15.067 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T10:18:15.077 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:18:15.109 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T10:18:15.109 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/072) 2024-03-27T10:18:15.763 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T10:18:15.778 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T10:18:15.778 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:18:18.700 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:18:18.707 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:18:18.776 INFO:teuthology.orchestra.run.smithi057.stdout:generic/072 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2024-03-27T10:18:18.788 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/072 2024-03-27T10:18:18.788 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/072 2024-03-27T10:18:18.788 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T10:18:18.804 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:18:18.834 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T10:18:18.834 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/073) 2024-03-27T10:18:19.474 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T10:18:19.494 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T10:18:19.494 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:18:19.958 INFO:teuthology.orchestra.run.smithi057.stdout:generic/073 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T10:18:19.971 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/073 2024-03-27T10:18:19.971 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/073 2024-03-27T10:18:19.971 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T10:18:19.981 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:18:20.021 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T10:18:20.021 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/074) 2024-03-27T10:18:20.641 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T10:18:20.657 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T10:18:20.658 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:18:48.851 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:18:48.861 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:19:19.875 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:19:19.887 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:19:50.926 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:19:50.938 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:20:23.389 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:20:23.396 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:20:53.687 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:20:53.698 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:21:24.008 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:21:24.015 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:21:54.190 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:21:54.197 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:22:24.739 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:22:24.748 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:22:54.900 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:22:54.910 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:23:25.066 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:23:25.075 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:23:55.258 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:23:55.265 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:24:25.436 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:24:25.443 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:24:55.584 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:24:55.597 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:25:25.756 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:25:25.764 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:25:55.963 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:25:55.970 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:26:27.097 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:26:27.107 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:26:27.256 INFO:tasks.ceph.osd.7.smithi118.stderr:2024-03-27T10:26:27.276+0000 7fdba0200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43712) UID: 0 2024-03-27T10:26:27.257 INFO:tasks.ceph.osd.5.smithi118.stderr:2024-03-27T10:26:27.276+0000 7fa84c200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43712) UID: 0 2024-03-27T10:26:27.257 INFO:tasks.ceph.osd.6.smithi118.stderr:2024-03-27T10:26:27.277+0000 7efe94a00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43712) UID: 0 2024-03-27T10:26:27.258 INFO:tasks.ceph.osd.4.smithi118.stderr:2024-03-27T10:26:27.279+0000 7f3737600640 -1 received signal: Hangup from (PID: 43712) UID: 0 2024-03-27T10:30:51.062 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:30:51.075 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:30:51.399 INFO:tasks.ceph.osd.6.smithi118.stderr:2024-03-27T10:30:51.421+0000 7efe94a00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43787) UID: 0 2024-03-27T10:30:51.400 INFO:tasks.ceph.osd.7.smithi118.stderr:2024-03-27T10:30:51.421+0000 7fdba0200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43787) UID: 0 2024-03-27T10:30:51.400 INFO:tasks.ceph.osd.4.smithi118.stderr:2024-03-27T10:30:51.422+0000 7f3737600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43787) UID: 0 2024-03-27T10:30:51.400 INFO:tasks.ceph.osd.5.smithi118.stderr:2024-03-27T10:30:51.422+0000 7fa84c200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43787) UID: 0 2024-03-27T10:30:53.476 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-03-27T10:30:53.497+0000 7f622b800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 152518) UID: 0 2024-03-27T10:30:53.476 INFO:tasks.ceph.osd.1.smithi057.stderr:2024-03-27T10:30:53.497+0000 7f8202600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 152518) UID: 0 2024-03-27T10:30:53.477 INFO:tasks.ceph.osd.2.smithi057.stderr:2024-03-27T10:30:53.498+0000 7f1380800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 152518) UID: 0 2024-03-27T10:30:53.481 INFO:tasks.ceph.osd.3.smithi057.stderr:2024-03-27T10:30:53.498+0000 7f009f600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 152518) UID: 0 2024-03-27T10:36:07.425 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:36:07.436 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:36:07.662 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-03-27T10:36:07.684+0000 7f622b800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 152714) UID: 0 2024-03-27T10:36:07.662 INFO:tasks.ceph.osd.2.smithi057.stderr:2024-03-27T10:36:07.684+0000 7f1380800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 152714) UID: 0 2024-03-27T10:36:07.663 INFO:tasks.ceph.osd.3.smithi057.stderr:2024-03-27T10:36:07.684+0000 7f009f600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 152714) UID: 0 2024-03-27T10:36:07.663 INFO:tasks.ceph.osd.1.smithi057.stderr:2024-03-27T10:36:07.684+0000 7f8202600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 152714) UID: 0 2024-03-27T10:36:12.545 INFO:tasks.ceph.osd.6.smithi118.stderr:2024-03-27T10:36:12.568+0000 7efe94a00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43823) UID: 0 2024-03-27T10:36:12.549 INFO:tasks.ceph.osd.4.smithi118.stderr:2024-03-27T10:36:12.568+0000 7f3737600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 43823) UID: 0 2024-03-27T10:36:12.550 INFO:tasks.ceph.osd.5.smithi118.stderr:2024-03-27T10:36:12.570+0000 7fa84c200640 -1 Fail to open '/proc/43823/cmdline' error = (2) No such file or directory 2024-03-27T10:36:12.550 INFO:tasks.ceph.osd.5.smithi118.stderr:2024-03-27T10:36:12.570+0000 7fa84c200640 -1 received signal: Hangup from (PID: 43823) UID: 0 2024-03-27T10:36:12.550 INFO:tasks.ceph.osd.7.smithi118.stderr:2024-03-27T10:36:12.574+0000 7fdba0200640 -1 Fail to open '/proc/43823/cmdline' error = (2) No such file or directory 2024-03-27T10:36:12.551 INFO:tasks.ceph.osd.7.smithi118.stderr:2024-03-27T10:36:12.574+0000 7fdba0200640 -1 received signal: Hangup from (PID: 43823) UID: 0 2024-03-27T10:46:07.900 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:46:07.936 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:46:08.182 INFO:tasks.ceph.osd.4.smithi118.stderr:2024-03-27T10:46:08.206+0000 7f3737600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44030) UID: 0 2024-03-27T10:46:08.182 INFO:tasks.ceph.osd.7.smithi118.stderr:2024-03-27T10:46:08.206+0000 7fdba0200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44030) UID: 0 2024-03-27T10:46:08.183 INFO:tasks.ceph.osd.5.smithi118.stderr:2024-03-27T10:46:08.206+0000 7fa84c200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44030) UID: 0 2024-03-27T10:46:08.183 INFO:tasks.ceph.osd.6.smithi118.stderr:2024-03-27T10:46:08.207+0000 7efe94a00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44030) UID: 0 2024-03-27T10:46:13.004 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-03-27T10:46:13.027+0000 7f622b800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 153101) UID: 0 2024-03-27T10:46:13.004 INFO:tasks.ceph.osd.2.smithi057.stderr:2024-03-27T10:46:13.027+0000 7f1380800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 153101) UID: 0 2024-03-27T10:46:13.005 INFO:tasks.ceph.osd.1.smithi057.stderr:2024-03-27T10:46:13.027+0000 7f8202600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 153101) UID: 0 2024-03-27T10:46:13.005 INFO:tasks.ceph.osd.3.smithi057.stderr:2024-03-27T10:46:13.027+0000 7f009f600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 153101) UID: 0 2024-03-27T10:48:38.630 INFO:teuthology.orchestra.run.smithi057.stdout:generic/074 1818s 2024-03-27T10:48:38.721 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/074 2024-03-27T10:48:38.721 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T10:48:38.733 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:48:38.768 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T10:48:38.769 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/075) 2024-03-27T10:48:40.029 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T10:48:40.040 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T10:48:40.040 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:50:03.129 INFO:teuthology.orchestra.run.smithi057.stdout:generic/075 83s 2024-03-27T10:50:03.148 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/075 2024-03-27T10:50:03.148 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T10:50:03.157 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:50:03.194 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T10:50:03.195 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/076) 2024-03-27T10:50:03.963 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T10:50:03.975 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T10:50:03.975 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:50:04.377 INFO:teuthology.orchestra.run.smithi057.stdout:generic/076 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T10:50:04.389 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/076 2024-03-27T10:50:04.390 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/076 2024-03-27T10:50:04.390 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T10:50:04.400 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:50:04.426 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T10:50:04.426 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/077) 2024-03-27T10:50:04.973 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T10:50:04.985 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T10:50:04.985 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:50:06.129 INFO:teuthology.orchestra.run.smithi057.stdout:generic/077 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T10:50:06.142 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/077 2024-03-27T10:50:06.142 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/077 2024-03-27T10:50:06.143 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T10:50:06.151 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:50:06.179 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T10:50:06.179 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/078) 2024-03-27T10:50:06.645 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T10:50:06.655 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T10:50:06.656 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:50:07.110 INFO:teuthology.orchestra.run.smithi057.stdout:generic/078 [not run] kernel doesn't support renameat2 syscall 2024-03-27T10:50:07.122 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/078 2024-03-27T10:50:07.123 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/078 2024-03-27T10:50:07.123 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T10:50:07.133 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:50:07.174 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T10:50:07.174 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/079) 2024-03-27T10:50:07.962 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T10:50:07.975 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T10:50:07.975 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:50:08.446 INFO:teuthology.orchestra.run.smithi057.stdout:generic/079 [not run] file system doesn't support chattr +ia 2024-03-27T10:50:08.458 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/079 2024-03-27T10:50:08.458 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/079 2024-03-27T10:50:08.458 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T10:50:08.467 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:50:08.494 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T10:50:08.494 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/080) 2024-03-27T10:50:08.996 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T10:50:09.008 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T10:50:09.008 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:50:11.557 INFO:teuthology.orchestra.run.smithi057.stdout:generic/080 2s 2024-03-27T10:50:11.573 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/080 2024-03-27T10:50:11.573 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T10:50:11.583 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:50:11.609 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T10:50:11.609 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/081) 2024-03-27T10:50:12.161 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T10:50:12.176 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T10:50:12.176 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:50:12.658 INFO:teuthology.orchestra.run.smithi057.stdout:generic/081 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T10:50:12.669 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/081 2024-03-27T10:50:12.669 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/081 2024-03-27T10:50:12.669 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T10:50:12.679 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:50:12.708 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T10:50:12.709 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/082) 2024-03-27T10:50:13.241 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T10:50:13.254 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T10:50:13.254 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:50:13.712 INFO:teuthology.orchestra.run.smithi057.stdout:generic/082 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T10:50:13.724 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/082 2024-03-27T10:50:13.724 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/082 2024-03-27T10:50:13.724 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T10:50:13.734 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:50:13.761 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T10:50:13.761 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/083) 2024-03-27T10:50:14.321 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T10:50:14.336 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T10:50:14.336 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:50:14.716 INFO:teuthology.orchestra.run.smithi057.stdout:generic/083 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T10:50:14.727 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/083 2024-03-27T10:50:14.727 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/083 2024-03-27T10:50:14.727 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T10:50:14.738 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:50:14.768 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T10:50:14.768 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/084) 2024-03-27T10:50:15.345 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T10:50:15.359 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T10:50:15.360 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:50:15.768 INFO:teuthology.orchestra.run.smithi057.stdout:generic/084 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T10:50:15.783 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/084 2024-03-27T10:50:15.783 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/084 2024-03-27T10:50:15.783 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T10:50:15.795 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:50:15.826 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T10:50:15.826 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/085) 2024-03-27T10:50:16.363 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T10:50:16.375 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T10:50:16.376 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:50:16.867 INFO:teuthology.orchestra.run.smithi057.stdout:generic/085 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T10:50:16.882 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/085 2024-03-27T10:50:16.882 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/085 2024-03-27T10:50:16.882 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T10:50:16.894 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:50:16.926 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T10:50:16.927 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/086) 2024-03-27T10:50:17.476 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T10:50:17.491 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T10:50:17.491 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:50:34.304 INFO:teuthology.orchestra.run.smithi057.stdout:generic/086 17s 2024-03-27T10:50:34.382 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/086 2024-03-27T10:50:34.382 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T10:50:34.394 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:50:34.538 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T10:50:34.538 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/087) 2024-03-27T10:50:36.349 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T10:50:36.359 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T10:50:36.359 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:50:37.236 INFO:teuthology.orchestra.run.smithi057.stdout:generic/087 1s 2024-03-27T10:50:37.253 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/087 2024-03-27T10:50:37.253 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T10:50:37.261 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:50:37.306 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T10:50:37.307 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/088) 2024-03-27T10:50:38.039 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T10:50:38.050 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T10:50:38.051 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:50:38.655 INFO:teuthology.orchestra.run.smithi057.stdout:generic/088 0s 2024-03-27T10:50:38.672 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/088 2024-03-27T10:50:38.672 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T10:50:38.681 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:50:38.717 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T10:50:38.717 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/089) 2024-03-27T10:50:39.482 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T10:50:39.493 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T10:50:39.493 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T10:54:11.103 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:54:11.110 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:54:41.285 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:54:41.296 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:55:11.421 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:55:11.430 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:55:41.773 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:55:41.779 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:55:41.888 INFO:tasks.ceph.osd.6.smithi118.stderr:2024-03-27T10:55:41.916+0000 7efe94a00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44179) UID: 0 2024-03-27T10:55:41.888 INFO:tasks.ceph.osd.5.smithi118.stderr:2024-03-27T10:55:41.916+0000 7fa84c200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44179) UID: 0 2024-03-27T10:55:41.888 INFO:tasks.ceph.osd.7.smithi118.stderr:2024-03-27T10:55:41.916+0000 7fdba0200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44179) UID: 0 2024-03-27T10:55:41.889 INFO:tasks.ceph.osd.4.smithi118.stderr:2024-03-27T10:55:41.916+0000 7f3737600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44179) UID: 0 2024-03-27T10:55:41.893 INFO:tasks.ceph.mds.c.smithi057.stderr:2024-03-27T10:55:41.920+0000 7f1f8ba00640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 161200) UID: 0 2024-03-27T10:55:41.893 INFO:tasks.ceph.mds.a.smithi057.stderr:2024-03-27T10:55:41.920+0000 7f0ffc400640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 161200) UID: 0 2024-03-27T10:59:04.124 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:59:04.130 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:59:35.031 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T10:59:35.038 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:00:05.188 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:00:05.193 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:00:36.212 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:00:36.223 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:01:06.372 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:01:06.382 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:01:37.597 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:01:37.603 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:02:07.727 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:02:07.734 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:02:07.841 INFO:tasks.ceph.mds.c.smithi057.stderr:2024-03-27T11:02:07.870+0000 7f1f8ba00640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 161573) UID: 0 2024-03-27T11:02:07.841 INFO:tasks.ceph.mds.a.smithi057.stderr:2024-03-27T11:02:07.870+0000 7f0ffc400640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 161573) UID: 0 2024-03-27T11:04:40.873 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-03-27T11:04:40.901+0000 7f622b800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 161579) UID: 0 2024-03-27T11:04:40.874 INFO:tasks.ceph.osd.1.smithi057.stderr:2024-03-27T11:04:40.901+0000 7f8202600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 161579) UID: 0 2024-03-27T11:04:40.874 INFO:tasks.ceph.osd.2.smithi057.stderr:2024-03-27T11:04:40.901+0000 7f1380800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 161579) UID: 0 2024-03-27T11:04:40.874 INFO:tasks.ceph.osd.3.smithi057.stderr:2024-03-27T11:04:40.901+0000 7f009f600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 161579) UID: 0 2024-03-27T11:08:58.021 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:08:58.034 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:08:58.768 INFO:tasks.ceph.mds.c.smithi057.stderr:2024-03-27T11:08:58.799+0000 7f1f8ba00640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 163616) UID: 0 2024-03-27T11:08:58.770 INFO:tasks.ceph.mds.a.smithi057.stderr:2024-03-27T11:08:58.799+0000 7f0ffc400640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 163616) UID: 0 2024-03-27T11:11:57.484 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:11:57.493 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:12:27.668 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:12:27.675 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:12:57.815 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:12:57.821 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:13:28.774 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:13:28.783 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:13:58.909 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:13:58.916 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:14:29.048 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:14:29.056 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:14:59.187 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:14:59.195 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:15:29.420 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:15:29.430 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:15:59.581 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:15:59.590 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:16:30.724 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:16:30.732 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:17:00.879 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:17:00.905 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:17:01.001 INFO:tasks.ceph.mds.a.smithi057.stderr:2024-03-27T11:17:01.034+0000 7f0ffc400640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 163827) UID: 0 2024-03-27T11:17:01.001 INFO:tasks.ceph.mds.c.smithi057.stderr:2024-03-27T11:17:01.034+0000 7f1f8ba00640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 163827) UID: 0 2024-03-27T11:17:47.603 INFO:teuthology.orchestra.run.smithi057.stdout:generic/089 1628s 2024-03-27T11:17:47.650 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/089 2024-03-27T11:17:47.650 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T11:17:47.657 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T11:17:47.694 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T11:17:47.695 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/090) 2024-03-27T11:17:48.699 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T11:17:48.711 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T11:17:48.711 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T11:17:49.223 INFO:teuthology.orchestra.run.smithi057.stdout:generic/090 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T11:17:49.236 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/090 2024-03-27T11:17:49.236 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/090 2024-03-27T11:17:49.236 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T11:17:49.246 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T11:17:49.272 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T11:17:49.272 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/091) 2024-03-27T11:17:49.773 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T11:17:49.783 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T11:17:49.783 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T11:19:52.843 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:19:52.852 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:20:22.987 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:20:22.996 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:20:53.177 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:20:53.187 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:21:23.674 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:21:23.683 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:21:53.808 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:21:53.816 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:22:23.949 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:22:23.962 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:22:54.090 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:22:54.099 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:23:24.246 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:23:24.253 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:23:28.391 INFO:teuthology.orchestra.run.smithi057.stdout:generic/091 339s 2024-03-27T11:23:28.408 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/091 2024-03-27T11:23:28.408 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T11:23:28.416 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T11:23:28.447 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T11:23:28.448 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/092) 2024-03-27T11:23:29.237 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T11:23:29.251 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T11:23:29.251 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T11:23:29.851 INFO:teuthology.orchestra.run.smithi057.stdout:generic/092 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-03-27T11:23:29.862 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/092 2024-03-27T11:23:29.862 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/092 2024-03-27T11:23:29.863 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T11:23:29.872 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T11:23:29.916 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T11:23:29.916 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/093) 2024-03-27T11:23:30.635 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T11:23:30.647 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T11:23:30.647 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T11:23:32.258 INFO:teuthology.orchestra.run.smithi057.stdout:generic/093 2s 2024-03-27T11:23:32.273 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/093 2024-03-27T11:23:32.273 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T11:23:32.282 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T11:23:32.321 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T11:23:32.321 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/094) 2024-03-27T11:23:33.080 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T11:23:33.091 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T11:23:33.091 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T11:23:33.481 INFO:teuthology.orchestra.run.smithi057.stdout:generic/094 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T11:23:33.491 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/094 2024-03-27T11:23:33.491 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/094 2024-03-27T11:23:33.492 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T11:23:33.500 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T11:23:33.525 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T11:23:33.525 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/095) 2024-03-27T11:23:34.085 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T11:23:34.098 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T11:23:34.098 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T11:23:34.501 INFO:teuthology.orchestra.run.smithi057.stdout:generic/095 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T11:23:34.510 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/095 2024-03-27T11:23:34.510 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/095 2024-03-27T11:23:34.510 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T11:23:34.517 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T11:23:34.544 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T11:23:34.544 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/096) 2024-03-27T11:23:35.063 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T11:23:35.075 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T11:23:35.075 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T11:23:35.599 INFO:teuthology.orchestra.run.smithi057.stdout:generic/096 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T11:23:35.611 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/096 2024-03-27T11:23:35.611 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/096 2024-03-27T11:23:35.611 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T11:23:35.619 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T11:23:35.647 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T11:23:35.647 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/097) 2024-03-27T11:23:36.149 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T11:23:36.161 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T11:23:36.161 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T11:23:37.320 INFO:teuthology.orchestra.run.smithi057.stdout:generic/097 1s 2024-03-27T11:23:37.335 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/097 2024-03-27T11:23:37.335 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T11:23:37.343 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T11:23:37.368 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T11:23:37.368 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/098) 2024-03-27T11:23:37.901 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T11:23:37.913 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T11:23:37.913 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T11:23:38.303 INFO:teuthology.orchestra.run.smithi057.stdout:generic/098 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T11:23:38.312 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/098 2024-03-27T11:23:38.312 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/098 2024-03-27T11:23:38.312 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T11:23:38.321 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T11:23:38.348 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T11:23:38.348 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/099) 2024-03-27T11:23:38.888 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T11:23:38.900 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T11:23:38.901 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T11:23:39.393 INFO:teuthology.orchestra.run.smithi057.stdout:generic/099 [not run] ACLs not supported by this filesystem type: ceph-fuse 2024-03-27T11:23:39.405 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/099 2024-03-27T11:23:39.405 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/099 2024-03-27T11:23:39.406 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T11:23:39.417 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T11:23:39.451 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T11:23:39.452 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/100) 2024-03-27T11:23:40.026 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T11:23:40.041 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T11:23:40.041 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T11:23:54.425 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:23:54.430 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:24:24.614 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:24:24.621 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:24:54.755 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:24:54.764 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:25:22.134 INFO:teuthology.orchestra.run.smithi057.stdout:generic/100 102s 2024-03-27T11:25:22.151 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/100 2024-03-27T11:25:22.151 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T11:25:22.160 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T11:25:22.227 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T11:25:22.228 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/101) 2024-03-27T11:25:23.121 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T11:25:23.134 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T11:25:23.134 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T11:25:23.574 INFO:teuthology.orchestra.run.smithi057.stdout:generic/101 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T11:25:23.586 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/101 2024-03-27T11:25:23.586 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/101 2024-03-27T11:25:23.586 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T11:25:23.596 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T11:25:23.626 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T11:25:23.626 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/102) 2024-03-27T11:25:24.178 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T11:25:24.191 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T11:25:24.191 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T11:25:24.606 INFO:teuthology.orchestra.run.smithi057.stdout:generic/102 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T11:25:24.619 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/102 2024-03-27T11:25:24.619 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/102 2024-03-27T11:25:24.619 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T11:25:24.629 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T11:25:24.661 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T11:25:24.662 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/103) 2024-03-27T11:25:24.890 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:25:24.898 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:25:25.213 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T11:25:25.225 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T11:25:25.225 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T11:25:25.646 INFO:teuthology.orchestra.run.smithi057.stdout:generic/103 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T11:25:25.657 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/103 2024-03-27T11:25:25.657 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/103 2024-03-27T11:25:25.657 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T11:25:25.665 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T11:25:25.697 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T11:25:25.698 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/104) 2024-03-27T11:25:26.252 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T11:25:26.264 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T11:25:26.264 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T11:25:26.651 INFO:teuthology.orchestra.run.smithi057.stdout:generic/104 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T11:25:26.661 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/104 2024-03-27T11:25:26.661 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/104 2024-03-27T11:25:26.662 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T11:25:26.671 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T11:25:26.702 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T11:25:26.702 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/105) 2024-03-27T11:25:27.196 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T11:25:27.207 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T11:25:27.207 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T11:25:27.596 INFO:teuthology.orchestra.run.smithi057.stdout:generic/105 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T11:25:27.606 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/105 2024-03-27T11:25:27.607 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/105 2024-03-27T11:25:27.607 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T11:25:27.618 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T11:25:27.645 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T11:25:27.646 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/106) 2024-03-27T11:25:28.177 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T11:25:28.188 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T11:25:28.188 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T11:25:28.583 INFO:teuthology.orchestra.run.smithi057.stdout:generic/106 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T11:25:28.596 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/106 2024-03-27T11:25:28.596 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/106 2024-03-27T11:25:28.596 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T11:25:28.607 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T11:25:28.637 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T11:25:28.638 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/107) 2024-03-27T11:25:29.183 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T11:25:29.197 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T11:25:29.197 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T11:25:29.664 INFO:teuthology.orchestra.run.smithi057.stdout:generic/107 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T11:25:29.676 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/107 2024-03-27T11:25:29.676 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/107 2024-03-27T11:25:29.676 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T11:25:29.685 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T11:25:29.713 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T11:25:29.713 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/108) 2024-03-27T11:25:30.235 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T11:25:30.250 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T11:25:30.250 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T11:25:30.946 INFO:teuthology.orchestra.run.smithi057.stdout:generic/108 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T11:25:30.960 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/108 2024-03-27T11:25:30.960 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/108 2024-03-27T11:25:30.961 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T11:25:30.972 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T11:25:31.012 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T11:25:31.013 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/109) 2024-03-27T11:25:31.574 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T11:25:31.586 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T11:25:31.586 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T11:25:31.985 INFO:teuthology.orchestra.run.smithi057.stdout:generic/109 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T11:25:32.000 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/109 2024-03-27T11:25:32.000 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/109 2024-03-27T11:25:32.000 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T11:25:32.012 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T11:25:32.046 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T11:25:32.047 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/110) 2024-03-27T11:25:32.651 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T11:25:32.666 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T11:25:32.667 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T11:25:33.185 INFO:teuthology.orchestra.run.smithi057.stdout:generic/110 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-03-27T11:25:33.197 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/110 2024-03-27T11:25:33.198 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/110 2024-03-27T11:25:33.198 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T11:25:33.208 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T11:25:33.268 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T11:25:33.268 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/111) 2024-03-27T11:25:34.010 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T11:25:34.022 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T11:25:34.023 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T11:25:34.563 INFO:teuthology.orchestra.run.smithi057.stdout:generic/111 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-03-27T11:25:34.573 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/111 2024-03-27T11:25:34.574 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/111 2024-03-27T11:25:34.574 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T11:25:34.583 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T11:25:34.621 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T11:25:34.621 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/112) 2024-03-27T11:25:35.370 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T11:25:35.380 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T11:25:35.380 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T11:25:55.029 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:25:55.038 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:26:25.203 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:26:25.212 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:26:55.377 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:26:55.386 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:27:25.523 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:27:25.532 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:27:31.981 INFO:teuthology.orchestra.run.smithi057.stdout:generic/112 116s 2024-03-27T11:27:32.003 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/112 2024-03-27T11:27:32.003 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T11:27:32.011 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T11:27:32.070 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T11:27:32.071 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/113) 2024-03-27T11:27:32.838 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T11:27:32.851 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T11:27:32.851 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T11:27:55.677 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:27:55.684 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:28:22.529 INFO:teuthology.orchestra.run.smithi057.stdout:generic/113 50s 2024-03-27T11:28:22.545 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/113 2024-03-27T11:28:22.545 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T11:28:22.554 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T11:28:22.606 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T11:28:22.607 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/114) 2024-03-27T11:28:23.375 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T11:28:23.385 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T11:28:23.385 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T11:28:23.838 INFO:teuthology.orchestra.run.smithi057.stdout:generic/114 [not run] Sparse files are not supported or do not work as expected 2024-03-27T11:28:23.847 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/114 2024-03-27T11:28:23.847 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/114 2024-03-27T11:28:23.847 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T11:28:23.855 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T11:28:23.879 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T11:28:23.879 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/115) 2024-03-27T11:28:24.358 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T11:28:24.368 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T11:28:24.369 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T11:28:24.965 INFO:teuthology.orchestra.run.smithi057.stdout:generic/115 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-03-27T11:28:24.977 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/115 2024-03-27T11:28:24.977 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/115 2024-03-27T11:28:24.978 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T11:28:24.986 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T11:28:25.020 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T11:28:25.020 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/116) 2024-03-27T11:28:25.788 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T11:28:25.799 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T11:28:25.799 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T11:28:25.822 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:28:25.833 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:28:26.722 INFO:teuthology.orchestra.run.smithi057.stdout:generic/116 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-03-27T11:28:26.734 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/116 2024-03-27T11:28:26.734 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/116 2024-03-27T11:28:26.734 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T11:28:26.899 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T11:28:26.943 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T11:28:26.943 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/117) 2024-03-27T11:28:27.713 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T11:28:27.724 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T11:28:27.724 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T11:28:28.456 INFO:teuthology.orchestra.run.smithi057.stdout:generic/117 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T11:28:28.470 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/117 2024-03-27T11:28:28.470 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/117 2024-03-27T11:28:28.470 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T11:28:28.481 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T11:28:28.509 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T11:28:28.509 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/118) 2024-03-27T11:28:29.004 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T11:28:29.017 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T11:28:29.017 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T11:28:29.639 INFO:teuthology.orchestra.run.smithi057.stdout:generic/118 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-03-27T11:28:29.653 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/118 2024-03-27T11:28:29.654 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/118 2024-03-27T11:28:29.654 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T11:28:29.666 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T11:28:29.701 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T11:28:29.702 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/119) 2024-03-27T11:28:30.476 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T11:28:30.487 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T11:28:30.487 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T11:28:31.017 INFO:teuthology.orchestra.run.smithi057.stdout:generic/119 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-03-27T11:28:31.032 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/119 2024-03-27T11:28:31.032 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/119 2024-03-27T11:28:31.032 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T11:28:31.044 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T11:28:31.098 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T11:28:31.098 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/120) 2024-03-27T11:28:31.863 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T11:28:31.877 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T11:28:31.877 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T11:28:32.288 INFO:teuthology.orchestra.run.smithi057.stdout:generic/120 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T11:28:32.299 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/120 2024-03-27T11:28:32.299 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/120 2024-03-27T11:28:32.299 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T11:28:32.308 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T11:28:32.335 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T11:28:32.336 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/121) 2024-03-27T11:28:32.904 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T11:28:32.916 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T11:28:32.916 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T11:28:33.486 INFO:teuthology.orchestra.run.smithi057.stdout:generic/121 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2024-03-27T11:28:33.501 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/121 2024-03-27T11:28:33.501 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/121 2024-03-27T11:28:33.502 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T11:28:33.513 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T11:28:33.558 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T11:28:33.559 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/122) 2024-03-27T11:28:34.290 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T11:28:34.301 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T11:28:34.301 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T11:28:34.850 INFO:teuthology.orchestra.run.smithi057.stdout:generic/122 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2024-03-27T11:28:34.861 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/122 2024-03-27T11:28:34.861 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/122 2024-03-27T11:28:34.861 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T11:28:34.868 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T11:28:34.897 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T11:28:34.897 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/123) 2024-03-27T11:28:35.636 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T11:28:35.647 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T11:28:35.647 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T11:28:36.920 INFO:teuthology.orchestra.run.smithi057.stdout:generic/123 1s 2024-03-27T11:28:36.939 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/123 2024-03-27T11:28:36.939 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T11:28:36.948 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T11:28:36.979 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T11:28:36.979 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/124) 2024-03-27T11:28:37.758 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T11:28:37.771 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T11:28:37.771 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T11:28:38.159 INFO:teuthology.orchestra.run.smithi057.stdout:generic/124 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T11:28:38.171 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/124 2024-03-27T11:28:38.171 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/124 2024-03-27T11:28:38.172 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T11:28:38.182 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T11:28:38.216 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T11:28:38.216 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/125) 2024-03-27T11:28:38.787 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T11:28:38.800 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T11:28:38.800 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T11:28:56.903 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:28:56.913 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:29:27.052 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:29:27.061 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:29:40.085 INFO:teuthology.orchestra.run.smithi057.stdout:generic/125 62s 2024-03-27T11:29:40.104 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/125 2024-03-27T11:29:40.104 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T11:29:40.113 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T11:29:40.179 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T11:29:40.179 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/126) 2024-03-27T11:29:40.887 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T11:29:40.898 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T11:29:40.899 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T11:29:42.410 INFO:teuthology.orchestra.run.smithi057.stdout:generic/126 - output mismatch (see /tmp/tmp.446sL8UEHrxfstests-dev/results//generic/126.out.bad) 2024-03-27T11:29:42.416 INFO:teuthology.orchestra.run.smithi057.stdout: --- tests/generic/126.out 2024-03-27 10:01:35.893469482 +0000 2024-03-27T11:29:42.416 INFO:teuthology.orchestra.run.smithi057.stdout: +++ /tmp/tmp.446sL8UEHrxfstests-dev/results//generic/126.out.bad 2024-03-27 11:29:42.443059613 +0000 2024-03-27T11:29:42.417 INFO:teuthology.orchestra.run.smithi057.stdout: @@ -1,7 +1,7 @@ 2024-03-27T11:29:42.417 INFO:teuthology.orchestra.run.smithi057.stdout: QA output created by 126 2024-03-27T11:29:42.417 INFO:teuthology.orchestra.run.smithi057.stdout: -x a 001 file owned by (99/99) as user/group(12/100) PASS 2024-03-27T11:29:42.417 INFO:teuthology.orchestra.run.smithi057.stdout: -x a 010 file owned by (99/99) as user/group(200/99) PASS 2024-03-27T11:29:42.417 INFO:teuthology.orchestra.run.smithi057.stdout: -x a 100 file owned by (99/99) as user/group(99/500) PASS 2024-03-27T11:29:42.417 INFO:teuthology.orchestra.run.smithi057.stdout: +x a 001 file owned by (99/99) as user/group(12/100) FAIL 2024-03-27T11:29:42.417 INFO:teuthology.orchestra.run.smithi057.stdout: +x a 010 file owned by (99/99) as user/group(200/99) FAIL 2024-03-27T11:29:42.417 INFO:teuthology.orchestra.run.smithi057.stdout: +x a 100 file owned by (99/99) as user/group(99/500) FAIL 2024-03-27T11:29:42.417 INFO:teuthology.orchestra.run.smithi057.stdout: w a 002 file owned by (99/99) as user/group(12/100) PASS 2024-03-27T11:29:42.417 INFO:teuthology.orchestra.run.smithi057.stdout: w a 020 file owned by (99/99) as user/group(200/99) PASS 2024-03-27T11:29:42.417 INFO:teuthology.orchestra.run.smithi057.stdout: w a 200 file owned by (99/99) as user/group(99/500) PASS 2024-03-27T11:29:42.422 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/126 2024-03-27T11:29:42.423 INFO:teuthology.orchestra.run.smithi057.stdout:Failures: generic/126 2024-03-27T11:29:42.423 INFO:teuthology.orchestra.run.smithi057.stdout:Failed 1 of 1 tests 2024-03-27T11:29:42.430 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T11:29:42.456 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-27T11:29:42.456 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-03-27T11:29:42.457 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-03-27T11:29:42.457 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/127) 2024-03-27T11:29:43.249 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T11:29:43.262 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T11:29:43.262 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T11:29:57.250 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:29:57.259 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:30:27.388 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:30:27.396 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:30:57.532 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:30:57.542 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:31:27.716 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:31:27.726 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:31:57.906 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:31:57.918 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:32:28.095 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:32:28.104 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:32:58.232 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:32:58.241 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:33:28.376 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:33:28.385 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:33:58.509 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:33:58.518 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:34:28.642 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:34:28.652 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:34:58.800 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:34:58.809 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:35:28.942 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:35:28.951 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:35:59.076 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:35:59.085 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:36:29.237 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:36:29.245 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:36:59.382 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:36:59.390 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:37:29.524 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:37:29.533 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:37:59.682 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:37:59.691 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:38:29.822 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:38:29.831 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:39:00.615 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:39:00.624 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:39:30.764 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:39:30.776 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:40:00.926 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:40:00.935 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:40:31.086 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:40:31.096 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:41:01.244 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:41:01.252 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:41:31.375 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:41:31.383 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:42:01.513 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:42:01.521 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:42:31.654 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:42:31.663 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:43:01.790 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:43:01.799 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:43:31.932 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:43:31.941 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:44:02.071 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:44:02.079 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:44:32.210 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:44:32.222 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:45:02.368 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:45:02.376 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:45:32.499 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:45:32.509 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:46:02.651 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:46:02.661 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:46:32.798 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:46:32.808 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:47:02.957 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:47:02.966 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:47:33.096 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:47:33.105 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:48:03.986 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:48:03.994 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:48:34.135 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:48:34.146 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:49:04.279 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:49:04.288 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:49:34.421 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:49:34.430 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:50:04.568 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:50:04.577 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:50:34.712 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:50:34.721 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:51:04.851 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:51:04.860 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:51:34.984 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:51:34.992 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:52:05.149 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:52:05.156 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:52:35.297 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:52:35.306 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:53:05.444 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:53:05.454 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:53:35.603 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:53:35.612 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:54:05.760 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:54:05.771 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:54:35.912 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:54:35.922 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:55:06.058 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:55:06.068 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:55:36.215 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:55:36.224 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:56:06.361 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:56:06.369 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:56:36.561 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:56:36.569 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:57:06.706 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:57:06.716 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:57:36.844 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:57:36.853 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:58:06.993 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:58:07.002 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:58:37.212 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:58:37.220 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:59:07.378 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:59:07.387 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:59:38.019 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T11:59:38.028 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:00:08.292 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:00:08.304 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:00:38.444 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:00:38.453 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:01:08.595 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:01:08.606 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:01:38.738 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:01:38.748 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:02:08.884 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:02:08.893 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:02:39.018 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:02:39.026 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:03:09.182 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:03:09.190 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:03:39.330 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:03:39.341 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:04:09.459 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:04:09.469 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:04:39.589 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:04:39.599 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:05:09.775 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:05:09.785 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:05:39.978 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:05:39.989 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:06:10.126 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:06:10.135 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:06:40.264 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:06:40.275 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:07:10.393 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:07:10.403 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:07:40.531 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:07:40.539 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:08:10.669 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:08:10.678 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:08:40.798 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:08:40.808 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:09:11.406 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:09:11.415 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:09:41.544 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:09:41.553 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:09:41.692 INFO:teuthology.orchestra.run.smithi057.stdout:generic/127 2398s 2024-03-27T12:09:41.707 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/127 2024-03-27T12:09:41.707 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:09:41.714 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:09:41.744 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:09:41.745 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/128) 2024-03-27T12:09:42.598 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:09:42.612 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:09:42.612 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:09:43.041 INFO:teuthology.orchestra.run.smithi057.stdout:generic/128 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:09:43.051 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/128 2024-03-27T12:09:43.051 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/128 2024-03-27T12:09:43.051 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:09:43.059 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:09:43.084 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:09:43.085 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/129) 2024-03-27T12:09:43.627 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:09:43.639 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:09:43.639 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:09:44.069 INFO:teuthology.orchestra.run.smithi057.stdout:generic/129 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:09:44.081 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/129 2024-03-27T12:09:44.081 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/129 2024-03-27T12:09:44.082 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:09:44.091 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:09:44.119 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:09:44.119 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/130) 2024-03-27T12:09:44.676 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:09:44.688 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:09:44.688 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:09:45.077 INFO:teuthology.orchestra.run.smithi057.stdout:generic/130 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:09:45.088 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/130 2024-03-27T12:09:45.089 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/130 2024-03-27T12:09:45.089 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:09:45.099 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:09:45.129 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:09:45.129 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/131) 2024-03-27T12:09:45.717 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:09:45.730 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:09:45.730 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:09:47.657 INFO:teuthology.orchestra.run.smithi057.stdout:generic/131 2s 2024-03-27T12:09:47.675 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/131 2024-03-27T12:09:47.675 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:09:47.683 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:09:47.710 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:09:47.711 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/132) 2024-03-27T12:09:48.472 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:09:48.486 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:09:48.486 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:09:48.920 INFO:teuthology.orchestra.run.smithi057.stdout:generic/132 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:09:48.932 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/132 2024-03-27T12:09:48.932 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/132 2024-03-27T12:09:48.932 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:09:48.941 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:09:48.968 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:09:48.968 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/133) 2024-03-27T12:09:49.532 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:09:49.543 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:09:49.543 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:10:11.679 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:10:11.688 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:10:41.824 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:10:41.834 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:11:11.971 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:11:11.980 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:11:42.127 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:11:42.138 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:12:12.266 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:12:12.277 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:12:42.399 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:12:42.410 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:13:12.543 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:13:12.552 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:13:42.691 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:13:42.701 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:14:12.831 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:14:12.840 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:14:42.963 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:14:42.972 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:15:13.121 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:15:13.130 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:15:43.252 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:15:43.262 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:16:13.390 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:16:13.398 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:16:43.521 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:16:43.530 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:17:13.668 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:17:13.677 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:17:44.078 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:17:44.090 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:18:14.211 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:18:14.221 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:18:44.354 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:18:44.364 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:19:14.577 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:19:14.591 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:19:44.728 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:19:44.737 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:20:14.866 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:20:14.875 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:20:22.699 INFO:teuthology.orchestra.run.smithi057.stdout:generic/133 633s 2024-03-27T12:20:22.718 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/133 2024-03-27T12:20:22.718 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:20:22.739 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:20:22.781 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:20:22.781 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/134) 2024-03-27T12:20:23.609 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:20:23.619 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:20:23.619 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:20:24.197 INFO:teuthology.orchestra.run.smithi057.stdout:generic/134 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-03-27T12:20:24.210 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/134 2024-03-27T12:20:24.211 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/134 2024-03-27T12:20:24.211 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:20:24.220 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:20:24.248 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:20:24.248 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/135) 2024-03-27T12:20:24.995 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:20:25.008 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:20:25.009 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:20:25.569 INFO:teuthology.orchestra.run.smithi057.stdout:generic/135 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:20:25.584 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/135 2024-03-27T12:20:25.584 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/135 2024-03-27T12:20:25.584 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:20:25.595 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:20:25.628 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:20:25.628 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/136) 2024-03-27T12:20:26.230 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:20:26.242 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:20:26.243 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:20:26.830 INFO:teuthology.orchestra.run.smithi057.stdout:generic/136 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2024-03-27T12:20:26.841 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/136 2024-03-27T12:20:26.841 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/136 2024-03-27T12:20:26.841 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:20:26.850 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:20:26.887 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:20:26.888 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/137) 2024-03-27T12:20:27.664 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:20:27.676 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:20:27.676 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:20:28.166 INFO:teuthology.orchestra.run.smithi057.stdout:generic/137 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-03-27T12:20:28.177 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/137 2024-03-27T12:20:28.177 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/137 2024-03-27T12:20:28.177 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:20:28.186 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:20:28.215 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:20:28.215 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/138) 2024-03-27T12:20:28.936 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:20:28.948 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:20:28.948 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:20:29.422 INFO:teuthology.orchestra.run.smithi057.stdout:generic/138 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-03-27T12:20:29.435 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/138 2024-03-27T12:20:29.435 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/138 2024-03-27T12:20:29.436 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:20:29.446 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:20:29.473 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:20:29.473 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/139) 2024-03-27T12:20:30.221 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:20:30.233 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:20:30.233 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:20:30.743 INFO:teuthology.orchestra.run.smithi057.stdout:generic/139 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-03-27T12:20:30.752 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/139 2024-03-27T12:20:30.753 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/139 2024-03-27T12:20:30.753 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:20:30.760 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:20:30.800 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:20:30.800 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/140) 2024-03-27T12:20:31.553 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:20:31.564 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:20:31.564 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:20:32.031 INFO:teuthology.orchestra.run.smithi057.stdout:generic/140 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-03-27T12:20:32.043 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/140 2024-03-27T12:20:32.043 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/140 2024-03-27T12:20:32.043 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:20:32.050 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:20:32.085 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:20:32.085 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/141) 2024-03-27T12:20:32.806 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:20:32.816 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:20:32.817 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:20:33.202 INFO:teuthology.orchestra.run.smithi057.stdout:generic/141 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:20:33.212 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/141 2024-03-27T12:20:33.213 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/141 2024-03-27T12:20:33.213 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:20:33.220 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:20:33.244 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:20:33.244 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/142) 2024-03-27T12:20:33.761 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:20:33.774 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:20:33.775 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:20:34.359 INFO:teuthology.orchestra.run.smithi057.stdout:generic/142 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-03-27T12:20:34.371 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/142 2024-03-27T12:20:34.371 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/142 2024-03-27T12:20:34.371 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:20:34.380 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:20:34.406 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:20:34.406 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/143) 2024-03-27T12:20:35.180 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:20:35.192 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:20:35.192 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:20:35.748 INFO:teuthology.orchestra.run.smithi057.stdout:generic/143 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-03-27T12:20:35.762 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/143 2024-03-27T12:20:35.762 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/143 2024-03-27T12:20:35.762 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:20:35.772 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:20:35.802 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:20:35.802 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/144) 2024-03-27T12:20:36.543 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:20:36.553 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:20:36.553 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:20:37.044 INFO:teuthology.orchestra.run.smithi057.stdout:generic/144 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-03-27T12:20:37.056 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/144 2024-03-27T12:20:37.056 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/144 2024-03-27T12:20:37.056 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:20:37.065 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:20:37.097 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:20:37.098 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/145) 2024-03-27T12:20:37.815 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:20:37.827 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:20:37.827 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:20:38.350 INFO:teuthology.orchestra.run.smithi057.stdout:generic/145 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-03-27T12:20:38.364 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/145 2024-03-27T12:20:38.364 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/145 2024-03-27T12:20:38.364 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:20:38.375 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:20:38.414 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:20:38.414 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/146) 2024-03-27T12:20:39.126 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:20:39.137 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:20:39.137 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:20:39.722 INFO:teuthology.orchestra.run.smithi057.stdout:generic/146 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-03-27T12:20:39.733 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/146 2024-03-27T12:20:39.733 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/146 2024-03-27T12:20:39.734 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:20:39.743 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:20:39.791 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:20:39.792 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/147) 2024-03-27T12:20:40.543 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:20:40.553 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:20:40.553 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:20:41.131 INFO:teuthology.orchestra.run.smithi057.stdout:generic/147 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-03-27T12:20:41.143 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/147 2024-03-27T12:20:41.143 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/147 2024-03-27T12:20:41.143 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:20:41.154 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:20:41.182 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:20:41.183 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/148) 2024-03-27T12:20:41.901 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:20:41.915 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:20:41.915 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:20:42.442 INFO:teuthology.orchestra.run.smithi057.stdout:generic/148 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-03-27T12:20:42.453 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/148 2024-03-27T12:20:42.453 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/148 2024-03-27T12:20:42.453 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:20:42.462 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:20:42.497 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:20:42.498 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/149) 2024-03-27T12:20:43.258 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:20:43.272 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:20:43.272 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:20:43.813 INFO:teuthology.orchestra.run.smithi057.stdout:generic/149 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-03-27T12:20:43.825 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/149 2024-03-27T12:20:43.825 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/149 2024-03-27T12:20:43.825 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:20:43.834 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:20:43.874 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:20:43.875 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/150) 2024-03-27T12:20:44.748 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:20:44.759 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:20:44.760 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:20:45.022 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:20:45.030 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:20:45.309 INFO:teuthology.orchestra.run.smithi057.stdout:generic/150 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-03-27T12:20:45.321 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/150 2024-03-27T12:20:45.321 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/150 2024-03-27T12:20:45.321 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:20:45.331 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:20:45.367 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:20:45.367 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/151) 2024-03-27T12:20:46.133 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:20:46.145 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:20:46.145 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:20:46.688 INFO:teuthology.orchestra.run.smithi057.stdout:generic/151 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-03-27T12:20:46.698 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/151 2024-03-27T12:20:46.698 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/151 2024-03-27T12:20:46.698 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:20:46.705 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:20:46.733 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:20:46.733 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/152) 2024-03-27T12:20:47.479 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:20:47.491 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:20:47.491 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:20:47.984 INFO:teuthology.orchestra.run.smithi057.stdout:generic/152 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-03-27T12:20:47.995 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/152 2024-03-27T12:20:47.995 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/152 2024-03-27T12:20:47.996 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:20:48.004 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:20:48.039 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:20:48.039 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/153) 2024-03-27T12:20:48.744 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:20:48.754 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:20:48.754 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:20:49.256 INFO:teuthology.orchestra.run.smithi057.stdout:generic/153 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-03-27T12:20:49.270 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/153 2024-03-27T12:20:49.270 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/153 2024-03-27T12:20:49.270 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:20:49.282 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:20:49.322 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:20:49.322 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/154) 2024-03-27T12:20:50.093 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:20:50.104 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:20:50.104 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:20:50.586 INFO:teuthology.orchestra.run.smithi057.stdout:generic/154 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-03-27T12:20:50.597 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/154 2024-03-27T12:20:50.597 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/154 2024-03-27T12:20:50.597 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:20:50.606 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:20:50.646 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:20:50.646 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/155) 2024-03-27T12:20:51.394 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:20:51.405 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:20:51.405 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:20:51.947 INFO:teuthology.orchestra.run.smithi057.stdout:generic/155 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-03-27T12:20:51.959 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/155 2024-03-27T12:20:51.959 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/155 2024-03-27T12:20:51.960 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:20:51.969 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:20:52.005 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:20:52.005 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/156) 2024-03-27T12:20:52.776 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:20:52.789 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:20:52.789 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:20:53.311 INFO:teuthology.orchestra.run.smithi057.stdout:generic/156 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-03-27T12:20:53.325 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/156 2024-03-27T12:20:53.325 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/156 2024-03-27T12:20:53.325 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:20:53.337 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:20:53.368 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:20:53.368 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/157) 2024-03-27T12:20:54.122 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:20:54.133 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:20:54.133 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:20:54.639 INFO:teuthology.orchestra.run.smithi057.stdout:generic/157 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-03-27T12:20:54.651 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/157 2024-03-27T12:20:54.651 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/157 2024-03-27T12:20:54.651 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:20:54.661 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:20:54.690 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:20:54.690 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/158) 2024-03-27T12:20:55.422 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:20:55.433 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:20:55.433 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:20:55.951 INFO:teuthology.orchestra.run.smithi057.stdout:generic/158 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2024-03-27T12:20:55.961 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/158 2024-03-27T12:20:55.961 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/158 2024-03-27T12:20:55.961 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:20:55.969 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:20:56.008 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:20:56.009 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/159) 2024-03-27T12:20:56.728 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:20:56.739 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:20:56.739 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:20:57.243 INFO:teuthology.orchestra.run.smithi057.stdout:generic/159 [not run] file system doesn't support chattr +i 2024-03-27T12:20:57.257 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/159 2024-03-27T12:20:57.257 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/159 2024-03-27T12:20:57.257 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:20:57.267 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:20:57.298 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:20:57.299 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/160) 2024-03-27T12:20:57.840 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:20:57.852 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:20:57.852 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:20:58.384 INFO:teuthology.orchestra.run.smithi057.stdout:generic/160 [not run] file system doesn't support chattr +i 2024-03-27T12:20:58.397 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/160 2024-03-27T12:20:58.397 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/160 2024-03-27T12:20:58.397 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:20:58.407 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:20:58.437 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:20:58.437 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/161) 2024-03-27T12:20:58.998 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:20:59.010 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:20:59.010 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:20:59.460 INFO:teuthology.orchestra.run.smithi057.stdout:generic/161 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:20:59.469 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/161 2024-03-27T12:20:59.469 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/161 2024-03-27T12:20:59.469 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:20:59.477 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:20:59.505 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:20:59.505 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/162) 2024-03-27T12:21:00.041 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:21:00.054 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:21:00.055 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:21:00.482 INFO:teuthology.orchestra.run.smithi057.stdout:generic/162 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:21:00.494 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/162 2024-03-27T12:21:00.494 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/162 2024-03-27T12:21:00.494 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:21:00.502 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:21:00.529 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:21:00.530 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/163) 2024-03-27T12:21:01.080 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:21:01.092 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:21:01.092 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:21:01.523 INFO:teuthology.orchestra.run.smithi057.stdout:generic/163 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:21:01.535 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/163 2024-03-27T12:21:01.536 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/163 2024-03-27T12:21:01.536 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:21:01.545 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:21:01.576 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:21:01.577 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/164) 2024-03-27T12:21:02.133 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:21:02.147 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:21:02.147 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:21:02.606 INFO:teuthology.orchestra.run.smithi057.stdout:generic/164 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:21:02.619 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/164 2024-03-27T12:21:02.619 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/164 2024-03-27T12:21:02.619 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:21:02.628 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:21:02.659 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:21:02.660 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/165) 2024-03-27T12:21:03.242 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:21:03.254 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:21:03.254 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:21:03.651 INFO:teuthology.orchestra.run.smithi057.stdout:generic/165 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:21:03.666 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/165 2024-03-27T12:21:03.667 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/165 2024-03-27T12:21:03.667 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:21:03.679 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:21:03.711 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:21:03.712 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/166) 2024-03-27T12:21:04.310 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:21:04.325 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:21:04.325 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:21:04.730 INFO:teuthology.orchestra.run.smithi057.stdout:generic/166 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:21:04.741 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/166 2024-03-27T12:21:04.741 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/166 2024-03-27T12:21:04.741 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:21:04.751 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:21:04.780 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:21:04.780 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/167) 2024-03-27T12:21:05.349 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:21:05.360 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:21:05.360 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:21:05.768 INFO:teuthology.orchestra.run.smithi057.stdout:generic/167 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:21:05.781 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/167 2024-03-27T12:21:05.781 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/167 2024-03-27T12:21:05.781 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:21:05.791 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:21:05.820 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:21:05.821 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/168) 2024-03-27T12:21:06.449 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:21:06.461 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:21:06.461 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:21:06.895 INFO:teuthology.orchestra.run.smithi057.stdout:generic/168 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:21:06.909 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/168 2024-03-27T12:21:06.909 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/168 2024-03-27T12:21:06.910 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:21:06.921 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:21:06.953 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:21:06.953 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/169) 2024-03-27T12:21:07.587 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:21:07.601 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:21:07.601 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:21:08.030 INFO:teuthology.orchestra.run.smithi057.stdout:generic/169 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:21:08.042 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/169 2024-03-27T12:21:08.042 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/169 2024-03-27T12:21:08.042 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:21:08.052 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:21:08.081 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:21:08.082 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/170) 2024-03-27T12:21:08.630 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:21:08.641 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:21:08.642 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:21:09.053 INFO:teuthology.orchestra.run.smithi057.stdout:generic/170 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:21:09.062 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/170 2024-03-27T12:21:09.063 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/170 2024-03-27T12:21:09.063 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:21:09.070 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:21:09.098 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:21:09.098 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/171) 2024-03-27T12:21:09.640 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:21:09.652 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:21:09.652 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:21:10.106 INFO:teuthology.orchestra.run.smithi057.stdout:generic/171 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:21:10.119 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/171 2024-03-27T12:21:10.119 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/171 2024-03-27T12:21:10.119 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:21:10.130 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:21:10.163 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:21:10.163 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/172) 2024-03-27T12:21:10.741 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:21:10.753 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:21:10.753 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:21:11.148 INFO:teuthology.orchestra.run.smithi057.stdout:generic/172 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:21:11.161 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/172 2024-03-27T12:21:11.161 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/172 2024-03-27T12:21:11.161 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:21:11.172 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:21:11.199 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:21:11.200 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/173) 2024-03-27T12:21:11.757 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:21:11.771 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:21:11.771 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:21:12.169 INFO:teuthology.orchestra.run.smithi057.stdout:generic/173 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:21:12.180 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/173 2024-03-27T12:21:12.181 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/173 2024-03-27T12:21:12.181 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:21:12.190 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:21:12.216 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:21:12.216 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/174) 2024-03-27T12:21:12.797 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:21:12.809 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:21:12.809 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:21:13.242 INFO:teuthology.orchestra.run.smithi057.stdout:generic/174 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:21:13.255 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/174 2024-03-27T12:21:13.255 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/174 2024-03-27T12:21:13.255 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:21:13.266 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:21:13.294 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:21:13.295 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/175) 2024-03-27T12:21:13.832 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:21:13.844 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:21:13.844 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:21:14.290 INFO:teuthology.orchestra.run.smithi057.stdout:generic/175 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:21:14.301 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/175 2024-03-27T12:21:14.302 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/175 2024-03-27T12:21:14.302 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:21:14.311 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:21:14.337 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:21:14.337 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/176) 2024-03-27T12:21:14.882 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:21:14.894 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:21:14.894 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:21:15.163 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:21:15.171 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:21:15.298 INFO:teuthology.orchestra.run.smithi057.stdout:generic/176 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:21:15.309 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/176 2024-03-27T12:21:15.309 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/176 2024-03-27T12:21:15.309 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:21:15.317 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:21:15.343 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:21:15.344 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/177) 2024-03-27T12:21:15.953 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:21:15.967 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:21:15.967 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:21:16.564 INFO:teuthology.orchestra.run.smithi057.stdout:generic/177 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:21:16.577 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/177 2024-03-27T12:21:16.577 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/177 2024-03-27T12:21:16.577 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:21:16.586 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:21:16.613 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:21:16.614 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/178) 2024-03-27T12:21:17.142 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:21:17.155 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:21:17.155 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:21:17.703 INFO:teuthology.orchestra.run.smithi057.stdout:generic/178 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-03-27T12:21:17.716 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/178 2024-03-27T12:21:17.717 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/178 2024-03-27T12:21:17.717 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:21:17.726 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:21:17.758 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:21:17.758 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/179) 2024-03-27T12:21:18.529 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:21:18.541 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:21:18.541 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:21:19.097 INFO:teuthology.orchestra.run.smithi057.stdout:generic/179 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-03-27T12:21:19.109 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/179 2024-03-27T12:21:19.109 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/179 2024-03-27T12:21:19.109 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:21:19.118 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:21:19.159 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:21:19.159 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/180) 2024-03-27T12:21:19.909 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:21:19.919 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:21:19.919 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:21:20.448 INFO:teuthology.orchestra.run.smithi057.stdout:generic/180 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-03-27T12:21:20.459 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/180 2024-03-27T12:21:20.460 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/180 2024-03-27T12:21:20.460 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:21:20.469 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:21:20.510 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:21:20.511 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/181) 2024-03-27T12:21:21.263 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:21:21.276 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:21:21.277 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:21:21.793 INFO:teuthology.orchestra.run.smithi057.stdout:generic/181 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-03-27T12:21:21.808 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/181 2024-03-27T12:21:21.808 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/181 2024-03-27T12:21:21.808 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:21:21.820 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:21:21.863 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:21:21.864 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/182) 2024-03-27T12:21:22.624 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:21:22.634 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:21:22.635 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:21:23.147 INFO:teuthology.orchestra.run.smithi057.stdout:generic/182 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2024-03-27T12:21:23.156 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/182 2024-03-27T12:21:23.156 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/182 2024-03-27T12:21:23.156 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:21:23.164 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:21:23.188 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:21:23.188 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/183) 2024-03-27T12:21:23.933 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:21:23.944 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:21:23.944 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:21:24.340 INFO:teuthology.orchestra.run.smithi057.stdout:generic/183 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:21:24.349 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/183 2024-03-27T12:21:24.349 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/183 2024-03-27T12:21:24.349 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:21:24.356 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:21:24.381 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:21:24.381 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/184) 2024-03-27T12:21:24.988 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:21:25.001 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:21:25.001 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:21:25.593 INFO:teuthology.orchestra.run.smithi057.stdout:generic/184 [failed, exit status 1]- output mismatch (see /tmp/tmp.446sL8UEHrxfstests-dev/results//generic/184.out.bad) 2024-03-27T12:21:25.600 INFO:teuthology.orchestra.run.smithi057.stdout: --- tests/generic/184.out 2024-03-27 10:01:35.910469200 +0000 2024-03-27T12:21:25.601 INFO:teuthology.orchestra.run.smithi057.stdout: +++ /tmp/tmp.446sL8UEHrxfstests-dev/results//generic/184.out.bad 2024-03-27 12:21:25.583714916 +0000 2024-03-27T12:21:25.601 INFO:teuthology.orchestra.run.smithi057.stdout: @@ -1 +1,2 @@ 2024-03-27T12:21:25.601 INFO:teuthology.orchestra.run.smithi057.stdout: QA output created by 184 2024-03-27T12:21:25.601 INFO:teuthology.orchestra.run.smithi057.stdout: +/tmp/tmp.446sL8UEHrxfstests-dev/tests/generic/184: line 23: /tmp/tmp.HFg5N66vC0test/null: Permission denied 2024-03-27T12:21:25.608 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/184 2024-03-27T12:21:25.609 INFO:teuthology.orchestra.run.smithi057.stdout:Failures: generic/184 2024-03-27T12:21:25.609 INFO:teuthology.orchestra.run.smithi057.stdout:Failed 1 of 1 tests 2024-03-27T12:21:25.618 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:21:25.645 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-27T12:21:25.646 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-03-27T12:21:25.646 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-03-27T12:21:25.647 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/185) 2024-03-27T12:21:26.216 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:21:26.227 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:21:26.228 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:21:26.663 INFO:teuthology.orchestra.run.smithi057.stdout:generic/185 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:21:26.675 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/185 2024-03-27T12:21:26.675 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/185 2024-03-27T12:21:26.675 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:21:26.685 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:21:26.716 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:21:26.716 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/186) 2024-03-27T12:21:27.279 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:21:27.292 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:21:27.292 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:21:27.742 INFO:teuthology.orchestra.run.smithi057.stdout:generic/186 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:21:27.753 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/186 2024-03-27T12:21:27.753 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/186 2024-03-27T12:21:27.754 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:21:27.762 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:21:27.789 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:21:27.790 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/187) 2024-03-27T12:21:28.365 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:21:28.378 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:21:28.379 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:21:28.798 INFO:teuthology.orchestra.run.smithi057.stdout:generic/187 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:21:28.808 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/187 2024-03-27T12:21:28.808 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/187 2024-03-27T12:21:28.808 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:21:28.817 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:21:28.848 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:21:28.848 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/188) 2024-03-27T12:21:29.430 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:21:29.442 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:21:29.442 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:21:29.869 INFO:teuthology.orchestra.run.smithi057.stdout:generic/188 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:21:29.884 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/188 2024-03-27T12:21:29.885 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/188 2024-03-27T12:21:29.885 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:21:29.896 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:21:29.923 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:21:29.923 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/189) 2024-03-27T12:21:30.506 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:21:30.518 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:21:30.518 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:21:30.945 INFO:teuthology.orchestra.run.smithi057.stdout:generic/189 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:21:30.954 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/189 2024-03-27T12:21:30.954 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/189 2024-03-27T12:21:30.954 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:21:30.962 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:21:30.984 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:21:30.985 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/190) 2024-03-27T12:21:31.551 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:21:31.564 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:21:31.565 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:21:31.970 INFO:teuthology.orchestra.run.smithi057.stdout:generic/190 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:21:31.981 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/190 2024-03-27T12:21:31.981 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/190 2024-03-27T12:21:31.981 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:21:31.990 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:21:32.020 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:21:32.021 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/191) 2024-03-27T12:21:32.585 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:21:32.596 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:21:32.596 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:21:33.001 INFO:teuthology.orchestra.run.smithi057.stdout:generic/191 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:21:33.011 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/191 2024-03-27T12:21:33.011 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/191 2024-03-27T12:21:33.011 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:21:33.020 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:21:33.053 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:21:33.053 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/192) 2024-03-27T12:21:33.642 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:21:33.654 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:21:33.655 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:21:34.091 INFO:teuthology.orchestra.run.smithi057.stdout:generic/192 [not run] atime not maintained by ceph-fuse 2024-03-27T12:21:34.103 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/192 2024-03-27T12:21:34.103 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/192 2024-03-27T12:21:34.104 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:21:34.113 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:21:34.139 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:21:34.139 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/193) 2024-03-27T12:21:34.697 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:21:34.709 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:21:34.709 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:21:37.366 INFO:teuthology.orchestra.run.smithi057.stdout:generic/193 - output mismatch (see /tmp/tmp.446sL8UEHrxfstests-dev/results//generic/193.out.bad) 2024-03-27T12:21:37.374 INFO:teuthology.orchestra.run.smithi057.stdout: --- tests/generic/193.out 2024-03-27 10:01:35.913469150 +0000 2024-03-27T12:21:37.374 INFO:teuthology.orchestra.run.smithi057.stdout: +++ /tmp/tmp.446sL8UEHrxfstests-dev/results//generic/193.out.bad 2024-03-27 12:21:37.355529247 +0000 2024-03-27T12:21:37.374 INFO:teuthology.orchestra.run.smithi057.stdout: @@ -24,7 +24,6 @@ 2024-03-27T12:21:37.374 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:21:37.374 INFO:teuthology.orchestra.run.smithi057.stdout: user: chmod a+r on qa_user owned file (should succeed) 2024-03-27T12:21:37.374 INFO:teuthology.orchestra.run.smithi057.stdout: user: chmod a+r on root owned file (should fail) 2024-03-27T12:21:37.374 INFO:teuthology.orchestra.run.smithi057.stdout: -chmod: changing permissions of 'test.root': Operation not permitted 2024-03-27T12:21:37.374 INFO:teuthology.orchestra.run.smithi057.stdout: check that the sgid bit is cleared 2024-03-27T12:21:37.375 INFO:teuthology.orchestra.run.smithi057.stdout: -rw-rw-rw- 2024-03-27T12:21:37.375 INFO:teuthology.orchestra.run.smithi057.stdout: check that suid bit is not cleared 2024-03-27T12:21:37.381 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/193 2024-03-27T12:21:37.381 INFO:teuthology.orchestra.run.smithi057.stdout:Failures: generic/193 2024-03-27T12:21:37.381 INFO:teuthology.orchestra.run.smithi057.stdout:Failed 1 of 1 tests 2024-03-27T12:21:37.389 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:21:37.429 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-27T12:21:37.429 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-03-27T12:21:37.429 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-03-27T12:21:37.429 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/194) 2024-03-27T12:21:38.216 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:21:38.228 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:21:38.228 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:21:38.625 INFO:teuthology.orchestra.run.smithi057.stdout:generic/194 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:21:38.639 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/194 2024-03-27T12:21:38.639 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/194 2024-03-27T12:21:38.639 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:21:38.650 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:21:38.685 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:21:38.685 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/195) 2024-03-27T12:21:39.242 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:21:39.254 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:21:39.254 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:21:39.719 INFO:teuthology.orchestra.run.smithi057.stdout:generic/195 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:21:39.729 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/195 2024-03-27T12:21:39.729 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/195 2024-03-27T12:21:39.730 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:21:39.738 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:21:39.765 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:21:39.765 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/196) 2024-03-27T12:21:40.338 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:21:40.353 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:21:40.353 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:21:40.753 INFO:teuthology.orchestra.run.smithi057.stdout:generic/196 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:21:40.767 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/196 2024-03-27T12:21:40.767 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/196 2024-03-27T12:21:40.767 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:21:40.779 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:21:40.809 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:21:40.809 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/197) 2024-03-27T12:21:41.387 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:21:41.400 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:21:41.400 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:21:41.835 INFO:teuthology.orchestra.run.smithi057.stdout:generic/197 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:21:41.848 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/197 2024-03-27T12:21:41.848 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/197 2024-03-27T12:21:41.848 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:21:41.857 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:21:41.884 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:21:41.884 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/198) 2024-03-27T12:21:42.436 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:21:42.449 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:21:42.449 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:21:44.304 INFO:teuthology.orchestra.run.smithi057.stdout:generic/198 2s 2024-03-27T12:21:44.322 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/198 2024-03-27T12:21:44.322 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:21:44.331 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:21:44.376 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:21:44.376 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/199) 2024-03-27T12:21:45.124 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:21:45.141 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:21:45.141 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:21:45.366 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:21:45.370 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:21:45.460 INFO:teuthology.orchestra.run.smithi057.stdout:generic/199 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:21:45.468 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/199 2024-03-27T12:21:45.468 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/199 2024-03-27T12:21:45.469 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:21:45.479 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:21:45.503 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:21:45.503 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/200) 2024-03-27T12:21:46.033 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:21:46.044 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:21:46.099 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:21:46.402 INFO:teuthology.orchestra.run.smithi057.stdout:generic/200 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:21:46.420 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/200 2024-03-27T12:21:46.420 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/200 2024-03-27T12:21:46.420 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:21:46.425 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:21:46.441 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:21:46.442 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/201) 2024-03-27T12:21:46.915 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:21:46.927 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:21:46.927 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:21:47.290 INFO:teuthology.orchestra.run.smithi057.stdout:generic/201 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:21:47.301 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/201 2024-03-27T12:21:47.301 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/201 2024-03-27T12:21:47.301 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:21:47.309 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:21:47.337 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:21:47.337 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/202) 2024-03-27T12:21:47.880 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:21:47.893 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:21:47.893 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:21:48.261 INFO:teuthology.orchestra.run.smithi057.stdout:generic/202 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:21:48.271 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/202 2024-03-27T12:21:48.271 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/202 2024-03-27T12:21:48.271 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:21:48.278 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:21:48.301 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:21:48.301 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/203) 2024-03-27T12:21:48.852 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:21:48.867 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:21:48.867 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:21:49.290 INFO:teuthology.orchestra.run.smithi057.stdout:generic/203 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:21:49.302 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/203 2024-03-27T12:21:49.302 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/203 2024-03-27T12:21:49.302 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:21:49.312 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:21:49.337 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:21:49.337 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/204) 2024-03-27T12:21:49.851 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:21:49.862 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:21:49.863 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:21:50.571 INFO:teuthology.orchestra.run.smithi057.stdout:generic/204 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:21:50.587 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/204 2024-03-27T12:21:50.587 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/204 2024-03-27T12:21:50.587 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:21:50.599 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:21:50.631 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:21:50.631 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/205) 2024-03-27T12:21:51.160 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:21:51.171 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:21:51.171 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:21:51.581 INFO:teuthology.orchestra.run.smithi057.stdout:generic/205 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:21:51.594 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/205 2024-03-27T12:21:51.594 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/205 2024-03-27T12:21:51.594 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:21:51.606 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:21:51.635 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:21:51.635 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/206) 2024-03-27T12:21:52.173 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:21:52.183 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:21:52.184 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:21:52.592 INFO:teuthology.orchestra.run.smithi057.stdout:generic/206 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:21:52.601 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/206 2024-03-27T12:21:52.601 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/206 2024-03-27T12:21:52.601 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:21:52.609 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:21:52.636 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:21:52.637 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/207) 2024-03-27T12:21:53.165 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:21:53.177 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:21:53.178 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:22:15.563 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:22:15.572 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:22:38.008 INFO:teuthology.orchestra.run.smithi057.stdout:generic/207 44s 2024-03-27T12:22:38.025 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/207 2024-03-27T12:22:38.025 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:22:38.033 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:22:38.064 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:22:38.065 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/208) 2024-03-27T12:22:38.835 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:22:38.847 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:22:38.847 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:22:45.708 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:22:45.718 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:23:15.839 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:23:15.850 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:23:45.986 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:23:45.996 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:24:16.177 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:24:16.189 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:24:46.322 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:24:46.328 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:25:16.493 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:25:16.501 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:25:46.724 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:25:46.732 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:25:59.501 INFO:teuthology.orchestra.run.smithi057.stdout:generic/208 201s 2024-03-27T12:25:59.519 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/208 2024-03-27T12:25:59.519 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:25:59.528 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:25:59.563 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:25:59.563 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/209) 2024-03-27T12:26:00.322 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:26:00.335 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:26:00.335 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:26:16.867 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:26:16.876 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:26:26.150 INFO:teuthology.orchestra.run.smithi057.stdout:generic/209 [failed, exit status 1]- output mismatch (see /tmp/tmp.446sL8UEHrxfstests-dev/results//generic/209.out.bad) 2024-03-27T12:26:26.182 INFO:teuthology.orchestra.run.smithi057.stdout: --- tests/generic/209.out 2024-03-27 10:01:35.917469083 +0000 2024-03-27T12:26:26.182 INFO:teuthology.orchestra.run.smithi057.stdout: +++ /tmp/tmp.446sL8UEHrxfstests-dev/results//generic/209.out.bad 2024-03-27 12:26:26.127005787 +0000 2024-03-27T12:26:26.182 INFO:teuthology.orchestra.run.smithi057.stdout: @@ -1,2 +1,2 @@ 2024-03-27T12:26:26.182 INFO:teuthology.orchestra.run.smithi057.stdout: QA output created by 209 2024-03-27T12:26:26.182 INFO:teuthology.orchestra.run.smithi057.stdout: -test ran for 30 seconds without error 2024-03-27T12:26:26.182 INFO:teuthology.orchestra.run.smithi057.stdout: +reader found old byte at pos 4096 2024-03-27T12:26:26.182 INFO:teuthology.orchestra.run.smithi057.stdout: \ No newline at end of file 2024-03-27T12:26:26.200 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/209 2024-03-27T12:26:26.200 INFO:teuthology.orchestra.run.smithi057.stdout:Failures: generic/209 2024-03-27T12:26:26.200 INFO:teuthology.orchestra.run.smithi057.stdout:Failed 1 of 1 tests 2024-03-27T12:26:26.226 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:26:26.279 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-27T12:26:26.279 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-03-27T12:26:26.279 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-03-27T12:26:26.280 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/210) 2024-03-27T12:26:26.891 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:26:26.902 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:26:26.902 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:26:27.520 INFO:teuthology.orchestra.run.smithi057.stdout:generic/210 1s 2024-03-27T12:26:27.538 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/210 2024-03-27T12:26:27.538 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:26:27.548 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:26:27.584 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:26:27.584 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/211) 2024-03-27T12:26:28.332 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:26:28.345 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:26:28.345 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:26:29.400 INFO:teuthology.orchestra.run.smithi057.stdout:generic/211 1s 2024-03-27T12:26:29.417 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/211 2024-03-27T12:26:29.418 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:26:29.428 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:26:29.460 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:26:29.460 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/212) 2024-03-27T12:26:30.045 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:26:30.056 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:26:30.057 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:26:30.664 INFO:teuthology.orchestra.run.smithi057.stdout:generic/212 0s 2024-03-27T12:26:30.683 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/212 2024-03-27T12:26:30.683 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:26:30.693 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:26:30.720 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:26:30.720 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/213) 2024-03-27T12:26:31.256 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:26:31.269 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:26:31.269 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:26:32.129 INFO:teuthology.orchestra.run.smithi057.stdout:generic/213 - output mismatch (see /tmp/tmp.446sL8UEHrxfstests-dev/results//generic/213.out.bad) 2024-03-27T12:26:32.135 INFO:teuthology.orchestra.run.smithi057.stdout: --- tests/generic/213.out 2024-03-27 10:01:35.918469066 +0000 2024-03-27T12:26:32.135 INFO:teuthology.orchestra.run.smithi057.stdout: +++ /tmp/tmp.446sL8UEHrxfstests-dev/results//generic/213.out.bad 2024-03-27 12:26:32.120912773 +0000 2024-03-27T12:26:32.135 INFO:teuthology.orchestra.run.smithi057.stdout: @@ -1,4 +1,3 @@ 2024-03-27T12:26:32.136 INFO:teuthology.orchestra.run.smithi057.stdout: QA output created by 213 2024-03-27T12:26:32.136 INFO:teuthology.orchestra.run.smithi057.stdout: We should get: fallocate: No space left on device 2024-03-27T12:26:32.136 INFO:teuthology.orchestra.run.smithi057.stdout: Strangely, xfs_io sometimes says "Success" when something went wrong, FYI 2024-03-27T12:26:32.136 INFO:teuthology.orchestra.run.smithi057.stdout: -fallocate: No space left on device 2024-03-27T12:26:32.141 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/213 2024-03-27T12:26:32.141 INFO:teuthology.orchestra.run.smithi057.stdout:Failures: generic/213 2024-03-27T12:26:32.141 INFO:teuthology.orchestra.run.smithi057.stdout:Failed 1 of 1 tests 2024-03-27T12:26:32.148 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:26:32.178 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-27T12:26:32.178 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-03-27T12:26:32.178 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-03-27T12:26:32.179 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/214) 2024-03-27T12:26:33.051 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:26:33.068 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:26:33.070 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:26:34.176 INFO:teuthology.orchestra.run.smithi057.stdout:generic/214 1s 2024-03-27T12:26:34.197 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/214 2024-03-27T12:26:34.198 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:26:34.209 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:26:34.249 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:26:34.250 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/215) 2024-03-27T12:26:35.118 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:26:35.131 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:26:35.131 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:26:39.407 INFO:teuthology.orchestra.run.smithi057.stdout:generic/215 4s 2024-03-27T12:26:39.425 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/215 2024-03-27T12:26:39.425 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:26:39.434 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:26:39.463 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:26:39.464 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/216) 2024-03-27T12:26:40.133 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:26:40.148 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:26:40.148 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:26:40.578 INFO:teuthology.orchestra.run.smithi057.stdout:generic/216 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:26:40.589 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/216 2024-03-27T12:26:40.589 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/216 2024-03-27T12:26:40.589 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:26:40.598 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:26:40.637 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:26:40.637 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/217) 2024-03-27T12:26:41.311 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:26:41.328 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:26:41.328 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:26:41.749 INFO:teuthology.orchestra.run.smithi057.stdout:generic/217 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:26:41.763 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/217 2024-03-27T12:26:41.763 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/217 2024-03-27T12:26:41.763 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:26:41.776 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:26:41.807 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:26:41.807 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/218) 2024-03-27T12:26:42.454 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:26:42.471 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:26:42.471 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:26:42.908 INFO:teuthology.orchestra.run.smithi057.stdout:generic/218 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:26:42.920 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/218 2024-03-27T12:26:42.920 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/218 2024-03-27T12:26:42.920 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:26:42.930 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:26:42.967 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:26:42.967 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/219) 2024-03-27T12:26:43.620 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:26:43.636 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:26:43.636 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:26:44.099 INFO:teuthology.orchestra.run.smithi057.stdout:generic/219 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:26:44.111 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/219 2024-03-27T12:26:44.111 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/219 2024-03-27T12:26:44.111 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:26:44.120 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:26:44.156 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:26:44.157 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/220) 2024-03-27T12:26:44.786 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:26:44.803 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:26:44.803 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:26:45.204 INFO:teuthology.orchestra.run.smithi057.stdout:generic/220 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:26:45.216 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/220 2024-03-27T12:26:45.216 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/220 2024-03-27T12:26:45.216 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:26:45.225 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:26:45.260 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:26:45.260 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/221) 2024-03-27T12:26:45.887 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:26:45.902 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:26:45.902 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:26:47.009 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:26:47.016 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:26:47.414 INFO:teuthology.orchestra.run.smithi057.stdout:generic/221 2s 2024-03-27T12:26:47.434 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/221 2024-03-27T12:26:47.434 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:26:47.443 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:26:47.474 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:26:47.474 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/222) 2024-03-27T12:26:48.111 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:26:48.130 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:26:48.130 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:26:48.561 INFO:teuthology.orchestra.run.smithi057.stdout:generic/222 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:26:48.574 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/222 2024-03-27T12:26:48.574 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/222 2024-03-27T12:26:48.574 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:26:48.585 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:26:48.612 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:26:48.612 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/223) 2024-03-27T12:26:49.253 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:26:49.267 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:26:49.267 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:26:49.713 INFO:teuthology.orchestra.run.smithi057.stdout:generic/223 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:26:49.728 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/223 2024-03-27T12:26:49.728 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/223 2024-03-27T12:26:49.728 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:26:49.739 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:26:49.772 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:26:49.772 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/224) 2024-03-27T12:26:50.368 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:26:50.388 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:26:50.388 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:26:50.819 INFO:teuthology.orchestra.run.smithi057.stdout:generic/224 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:26:50.830 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/224 2024-03-27T12:26:50.831 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/224 2024-03-27T12:26:50.831 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:26:50.843 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:26:50.876 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:26:50.877 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/225) 2024-03-27T12:26:51.539 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:26:51.557 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:26:51.557 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:26:51.978 INFO:teuthology.orchestra.run.smithi057.stdout:generic/225 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:26:51.990 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/225 2024-03-27T12:26:51.990 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/225 2024-03-27T12:26:51.990 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:26:51.998 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:26:52.029 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:26:52.029 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/226) 2024-03-27T12:26:52.645 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:26:52.659 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:26:52.659 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:26:53.126 INFO:teuthology.orchestra.run.smithi057.stdout:generic/226 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:26:53.137 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/226 2024-03-27T12:26:53.137 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/226 2024-03-27T12:26:53.137 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:26:53.148 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:26:53.179 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:26:53.179 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/227) 2024-03-27T12:26:53.994 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:26:54.012 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:26:54.012 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:26:54.485 INFO:teuthology.orchestra.run.smithi057.stdout:generic/227 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:26:54.497 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/227 2024-03-27T12:26:54.497 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/227 2024-03-27T12:26:54.497 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:26:54.507 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:26:54.543 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:26:54.544 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/228) 2024-03-27T12:26:55.185 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:26:55.202 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:26:55.202 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:26:55.920 INFO:teuthology.orchestra.run.smithi057.stdout:generic/228 0s 2024-03-27T12:26:55.940 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/228 2024-03-27T12:26:55.941 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:26:55.953 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:26:56.012 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:26:56.013 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/229) 2024-03-27T12:26:56.861 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:26:56.877 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:26:56.877 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:26:57.325 INFO:teuthology.orchestra.run.smithi057.stdout:generic/229 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:26:57.339 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/229 2024-03-27T12:26:57.339 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/229 2024-03-27T12:26:57.339 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:26:57.348 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:26:57.386 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:26:57.386 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/230) 2024-03-27T12:26:58.055 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:26:58.070 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:26:58.070 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:26:58.467 INFO:teuthology.orchestra.run.smithi057.stdout:generic/230 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:26:58.480 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/230 2024-03-27T12:26:58.480 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/230 2024-03-27T12:26:58.481 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:26:58.492 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:26:58.528 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:26:58.529 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/231) 2024-03-27T12:26:59.164 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:26:59.179 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:26:59.179 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:26:59.606 INFO:teuthology.orchestra.run.smithi057.stdout:generic/231 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:26:59.620 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/231 2024-03-27T12:26:59.620 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/231 2024-03-27T12:26:59.621 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:26:59.630 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:26:59.666 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:26:59.666 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/232) 2024-03-27T12:27:00.299 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:27:00.318 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:27:00.318 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:27:00.747 INFO:teuthology.orchestra.run.smithi057.stdout:generic/232 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:27:00.759 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/232 2024-03-27T12:27:00.759 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/232 2024-03-27T12:27:00.759 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:27:00.766 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:27:00.799 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:27:00.799 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/233) 2024-03-27T12:27:01.436 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:27:01.452 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:27:01.452 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:27:01.905 INFO:teuthology.orchestra.run.smithi057.stdout:generic/233 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:27:01.916 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/233 2024-03-27T12:27:01.916 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/233 2024-03-27T12:27:01.916 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:27:01.926 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:27:01.963 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:27:01.963 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/234) 2024-03-27T12:27:02.615 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:27:02.631 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:27:02.631 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:27:03.065 INFO:teuthology.orchestra.run.smithi057.stdout:generic/234 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:27:03.076 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/234 2024-03-27T12:27:03.076 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/234 2024-03-27T12:27:03.076 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:27:03.086 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:27:03.123 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:27:03.124 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/235) 2024-03-27T12:27:03.803 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:27:03.820 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:27:03.820 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:27:04.242 INFO:teuthology.orchestra.run.smithi057.stdout:generic/235 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:27:04.254 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/235 2024-03-27T12:27:04.254 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/235 2024-03-27T12:27:04.254 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:27:04.264 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:27:04.305 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:27:04.305 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/236) 2024-03-27T12:27:04.955 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:27:04.973 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:27:04.974 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:27:06.593 INFO:teuthology.orchestra.run.smithi057.stdout:generic/236 2s 2024-03-27T12:27:06.611 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/236 2024-03-27T12:27:06.611 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:27:06.621 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:27:06.670 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:27:06.670 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/237) 2024-03-27T12:27:07.534 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:27:07.551 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:27:07.553 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:27:08.102 INFO:teuthology.orchestra.run.smithi057.stdout:generic/237 [not run] ACLs not supported by this filesystem type: ceph-fuse 2024-03-27T12:27:08.116 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/237 2024-03-27T12:27:08.116 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/237 2024-03-27T12:27:08.117 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:27:08.126 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:27:08.162 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:27:08.162 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/238) 2024-03-27T12:27:08.799 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:27:08.815 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:27:08.815 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:27:09.250 INFO:teuthology.orchestra.run.smithi057.stdout:generic/238 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:27:09.262 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/238 2024-03-27T12:27:09.262 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/238 2024-03-27T12:27:09.262 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:27:09.274 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:27:09.322 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:27:09.323 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/239) 2024-03-27T12:27:09.973 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:27:09.990 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:27:09.990 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:27:10.505 INFO:teuthology.orchestra.run.smithi057.stdout:generic/239 [not run] Sparse files are not supported or do not work as expected 2024-03-27T12:27:10.516 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/239 2024-03-27T12:27:10.516 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/239 2024-03-27T12:27:10.516 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:27:10.526 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:27:10.559 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:27:10.559 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/240) 2024-03-27T12:27:11.198 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:27:11.214 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:27:11.214 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:27:11.743 INFO:teuthology.orchestra.run.smithi057.stdout:generic/240 [not run] Sparse files are not supported or do not work as expected 2024-03-27T12:27:11.753 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/240 2024-03-27T12:27:11.753 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/240 2024-03-27T12:27:11.753 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:27:11.762 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:27:11.794 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:27:11.795 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/241) 2024-03-27T12:27:12.457 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:27:12.473 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:27:12.473 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:27:17.155 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:27:17.163 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:27:17.297 INFO:tasks.ceph.osd.7.smithi118.stderr:2024-03-27T12:27:17.291+0000 7fdba0200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47133) UID: 0 2024-03-27T12:27:17.298 INFO:tasks.ceph.osd.4.smithi118.stderr:2024-03-27T12:27:17.291+0000 7f3737600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47133) UID: 0 2024-03-27T12:27:17.298 INFO:tasks.ceph.osd.6.smithi118.stderr:2024-03-27T12:27:17.291+0000 7efe94a00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47133) UID: 0 2024-03-27T12:27:17.298 INFO:tasks.ceph.osd.5.smithi118.stderr:2024-03-27T12:27:17.291+0000 7fa84c200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47133) UID: 0 2024-03-27T12:28:26.490 INFO:teuthology.orchestra.run.smithi057.stdout:generic/241 74s 2024-03-27T12:28:26.506 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/241 2024-03-27T12:28:26.506 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:28:26.518 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:28:26.562 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:28:26.563 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/242) 2024-03-27T12:28:27.470 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:28:27.488 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:28:27.488 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:28:27.911 INFO:teuthology.orchestra.run.smithi057.stdout:generic/242 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:28:27.924 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/242 2024-03-27T12:28:27.924 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/242 2024-03-27T12:28:27.924 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:28:27.936 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:28:27.965 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:28:27.965 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/243) 2024-03-27T12:28:28.620 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:28:28.637 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:28:28.637 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:28:29.058 INFO:teuthology.orchestra.run.smithi057.stdout:generic/243 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:28:29.074 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/243 2024-03-27T12:28:29.074 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/243 2024-03-27T12:28:29.074 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:28:29.085 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:28:29.116 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:28:29.116 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/244) 2024-03-27T12:28:29.738 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:28:29.753 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:28:29.754 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:28:30.176 INFO:teuthology.orchestra.run.smithi057.stdout:generic/244 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2024-03-27T12:28:30.190 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/244 2024-03-27T12:28:30.191 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/244 2024-03-27T12:28:30.191 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:28:30.198 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:28:30.226 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:28:30.226 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/245) 2024-03-27T12:28:30.875 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:28:30.891 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:28:30.891 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:28:31.561 INFO:teuthology.orchestra.run.smithi057.stdout:generic/245 1s 2024-03-27T12:28:31.580 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/245 2024-03-27T12:28:31.581 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:28:31.591 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:28:31.630 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:28:31.631 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/246) 2024-03-27T12:28:32.497 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:28:32.512 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:28:32.512 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:28:33.086 INFO:teuthology.orchestra.run.smithi057.stdout:generic/246 1s 2024-03-27T12:28:33.105 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/246 2024-03-27T12:28:33.105 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:28:33.114 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:28:33.150 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:28:33.151 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/247) 2024-03-27T12:28:34.045 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:28:34.061 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:28:34.061 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:29:29.546 INFO:teuthology.orchestra.run.smithi057.stdout:generic/247 55s 2024-03-27T12:29:29.647 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/247 2024-03-27T12:29:29.647 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:29:29.658 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:29:29.690 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:29:29.690 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/248) 2024-03-27T12:29:30.498 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:29:30.514 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:29:30.515 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:29:31.109 INFO:teuthology.orchestra.run.smithi057.stdout:generic/248 1s 2024-03-27T12:29:31.129 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/248 2024-03-27T12:29:31.129 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:29:31.135 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:29:31.169 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:29:31.170 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/249) 2024-03-27T12:29:31.828 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:29:31.844 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:29:31.844 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:29:36.353 INFO:teuthology.orchestra.run.smithi057.stdout:generic/249 5s 2024-03-27T12:29:36.377 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/249 2024-03-27T12:29:36.377 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:29:36.388 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:29:36.422 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:29:36.422 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/250) 2024-03-27T12:29:37.271 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:29:37.287 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:29:37.287 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:29:37.811 INFO:teuthology.orchestra.run.smithi057.stdout:generic/250 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:29:37.821 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/250 2024-03-27T12:29:37.821 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/250 2024-03-27T12:29:37.821 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:29:37.830 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:29:37.863 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:29:37.863 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/251) 2024-03-27T12:29:38.513 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:29:38.531 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:29:38.531 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:29:38.946 INFO:teuthology.orchestra.run.smithi057.stdout:generic/251 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:29:38.961 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/251 2024-03-27T12:29:38.961 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/251 2024-03-27T12:29:38.961 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:29:38.969 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:29:38.995 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:29:38.996 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/252) 2024-03-27T12:29:39.633 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:29:39.650 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:29:39.650 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:29:40.120 INFO:teuthology.orchestra.run.smithi057.stdout:generic/252 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:29:40.132 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/252 2024-03-27T12:29:40.132 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/252 2024-03-27T12:29:40.132 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:29:40.143 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:29:40.180 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:29:40.180 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/253) 2024-03-27T12:29:40.811 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:29:40.829 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:29:40.829 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:29:41.258 INFO:teuthology.orchestra.run.smithi057.stdout:generic/253 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:29:41.272 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/253 2024-03-27T12:29:41.272 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/253 2024-03-27T12:29:41.272 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:29:41.284 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:29:41.320 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:29:41.320 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/254) 2024-03-27T12:29:41.985 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:29:42.001 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:29:42.001 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:29:42.416 INFO:teuthology.orchestra.run.smithi057.stdout:generic/254 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:29:42.427 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/254 2024-03-27T12:29:42.427 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/254 2024-03-27T12:29:42.427 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:29:42.435 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:29:42.462 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:29:42.463 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/255) 2024-03-27T12:29:43.119 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:29:43.134 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:29:43.134 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:29:46.044 INFO:teuthology.orchestra.run.smithi057.stdout:generic/255 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-03-27T12:29:46.055 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/255 2024-03-27T12:29:46.055 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/255 2024-03-27T12:29:46.055 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:29:46.065 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:29:46.108 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:29:46.108 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/256) 2024-03-27T12:29:47.012 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:29:47.030 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:29:47.031 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:29:50.724 INFO:teuthology.orchestra.run.smithi057.stdout:generic/256 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:29:50.738 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/256 2024-03-27T12:29:50.738 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/256 2024-03-27T12:29:50.738 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:29:50.748 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:29:50.783 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:29:50.784 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/257) 2024-03-27T12:29:51.425 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:29:51.442 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:29:51.442 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:29:54.326 INFO:teuthology.orchestra.run.smithi057.stdout:generic/257 3s 2024-03-27T12:29:54.343 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/257 2024-03-27T12:29:54.343 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:29:54.353 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:29:54.391 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:29:54.392 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/258) 2024-03-27T12:29:55.237 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:29:55.257 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:29:55.258 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:29:55.759 INFO:teuthology.orchestra.run.smithi057.stdout:generic/258 [failed, exit status 1]- output mismatch (see /tmp/tmp.446sL8UEHrxfstests-dev/results//generic/258.out.bad) 2024-03-27T12:29:55.769 INFO:teuthology.orchestra.run.smithi057.stdout: --- tests/generic/258.out 2024-03-27 10:01:35.931468850 +0000 2024-03-27T12:29:55.769 INFO:teuthology.orchestra.run.smithi057.stdout: +++ /tmp/tmp.446sL8UEHrxfstests-dev/results//generic/258.out.bad 2024-03-27 12:29:55.749752555 +0000 2024-03-27T12:29:55.769 INFO:teuthology.orchestra.run.smithi057.stdout: @@ -1,5 +1,6 @@ 2024-03-27T12:29:55.769 INFO:teuthology.orchestra.run.smithi057.stdout: QA output created by 258 2024-03-27T12:29:55.769 INFO:teuthology.orchestra.run.smithi057.stdout: Creating file with timestamp of Jan 1, 1960 2024-03-27T12:29:55.769 INFO:teuthology.orchestra.run.smithi057.stdout: Testing for negative seconds since epoch 2024-03-27T12:29:55.769 INFO:teuthology.orchestra.run.smithi057.stdout: -Remounting to flush cache 2024-03-27T12:29:55.769 INFO:teuthology.orchestra.run.smithi057.stdout: -Testing for negative seconds since epoch 2024-03-27T12:29:55.769 INFO:teuthology.orchestra.run.smithi057.stdout: +Timestamp wrapped: 3979351756 2024-03-27T12:29:55.769 INFO:teuthology.orchestra.run.smithi057.stdout: +Timestamp wrapped 2024-03-27T12:29:55.770 INFO:teuthology.orchestra.run.smithi057.stdout: +(see /tmp/tmp.446sL8UEHrxfstests-dev/results//generic/258.full for details) 2024-03-27T12:29:55.778 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/258 2024-03-27T12:29:55.778 INFO:teuthology.orchestra.run.smithi057.stdout:Failures: generic/258 2024-03-27T12:29:55.778 INFO:teuthology.orchestra.run.smithi057.stdout:Failed 1 of 1 tests 2024-03-27T12:29:55.788 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:29:55.823 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-27T12:29:55.823 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-03-27T12:29:55.823 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-03-27T12:29:55.823 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/259) 2024-03-27T12:29:56.476 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:29:56.490 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:29:56.490 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:29:56.896 INFO:teuthology.orchestra.run.smithi057.stdout:generic/259 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:29:56.908 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/259 2024-03-27T12:29:56.908 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/259 2024-03-27T12:29:56.908 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:29:56.916 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:29:56.949 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:29:56.949 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/260) 2024-03-27T12:29:57.580 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:29:57.596 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:29:57.596 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:29:58.265 INFO:teuthology.orchestra.run.smithi057.stdout:generic/260 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:29:58.283 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/260 2024-03-27T12:29:58.283 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/260 2024-03-27T12:29:58.284 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:29:58.295 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:29:58.334 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:29:58.334 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/261) 2024-03-27T12:29:58.984 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:29:58.998 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:29:58.998 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:29:59.436 INFO:teuthology.orchestra.run.smithi057.stdout:generic/261 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:29:59.448 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/261 2024-03-27T12:29:59.448 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/261 2024-03-27T12:29:59.449 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:29:59.458 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:29:59.493 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:29:59.493 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/262) 2024-03-27T12:30:01.258 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:30:01.270 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:30:01.270 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:30:02.001 INFO:teuthology.orchestra.run.smithi057.stdout:generic/262 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:30:02.014 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/262 2024-03-27T12:30:02.014 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/262 2024-03-27T12:30:02.014 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:30:02.034 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:30:02.071 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:30:02.071 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/263) 2024-03-27T12:30:02.763 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:30:02.780 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:30:02.780 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:31:02.275 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:31:02.286 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:31:32.427 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:31:32.435 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:32:02.600 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:32:02.610 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:32:04.022 INFO:teuthology.orchestra.run.smithi057.stdout:generic/263 121s 2024-03-27T12:32:04.041 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/263 2024-03-27T12:32:04.041 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:32:04.052 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:32:04.084 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:32:04.085 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/264) 2024-03-27T12:32:04.882 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:32:04.894 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:32:04.894 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:32:05.327 INFO:teuthology.orchestra.run.smithi057.stdout:generic/264 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:32:05.339 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/264 2024-03-27T12:32:05.339 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/264 2024-03-27T12:32:05.340 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:32:05.350 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:32:05.382 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:32:05.382 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/265) 2024-03-27T12:32:05.954 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:32:05.969 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:32:05.969 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:32:06.485 INFO:teuthology.orchestra.run.smithi057.stdout:generic/265 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:32:06.497 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/265 2024-03-27T12:32:06.497 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/265 2024-03-27T12:32:06.498 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:32:06.507 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:32:06.540 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:32:06.540 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/266) 2024-03-27T12:32:07.060 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:32:07.073 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:32:07.073 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:32:07.522 INFO:teuthology.orchestra.run.smithi057.stdout:generic/266 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:32:07.535 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/266 2024-03-27T12:32:07.535 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/266 2024-03-27T12:32:07.536 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:32:07.546 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:32:07.573 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:32:07.573 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/267) 2024-03-27T12:32:08.137 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:32:08.149 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:32:08.149 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:32:08.611 INFO:teuthology.orchestra.run.smithi057.stdout:generic/267 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:32:08.624 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/267 2024-03-27T12:32:08.624 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/267 2024-03-27T12:32:08.624 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:32:08.632 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:32:08.664 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:32:08.665 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/268) 2024-03-27T12:32:09.241 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:32:09.254 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:32:09.254 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:32:09.714 INFO:teuthology.orchestra.run.smithi057.stdout:generic/268 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:32:09.724 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/268 2024-03-27T12:32:09.725 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/268 2024-03-27T12:32:09.725 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:32:09.732 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:32:09.763 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:32:09.763 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/269) 2024-03-27T12:32:10.344 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:32:10.358 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:32:10.358 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:32:10.847 INFO:teuthology.orchestra.run.smithi057.stdout:generic/269 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:32:10.859 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/269 2024-03-27T12:32:10.859 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/269 2024-03-27T12:32:10.859 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:32:10.871 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:32:10.903 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:32:10.903 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/270) 2024-03-27T12:32:11.466 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:32:11.478 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:32:11.478 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:32:11.885 INFO:teuthology.orchestra.run.smithi057.stdout:generic/270 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2024-03-27T12:32:11.896 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/270 2024-03-27T12:32:11.896 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/270 2024-03-27T12:32:11.896 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:32:11.905 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:32:11.934 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:32:11.934 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/271) 2024-03-27T12:32:12.499 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:32:12.512 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:32:12.512 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:32:12.965 INFO:teuthology.orchestra.run.smithi057.stdout:generic/271 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:32:12.976 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/271 2024-03-27T12:32:12.976 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/271 2024-03-27T12:32:12.976 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:32:12.987 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:32:13.016 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:32:13.017 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/272) 2024-03-27T12:32:13.557 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:32:13.570 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:32:13.570 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:32:14.027 INFO:teuthology.orchestra.run.smithi057.stdout:generic/272 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:32:14.041 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/272 2024-03-27T12:32:14.042 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/272 2024-03-27T12:32:14.042 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:32:14.054 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:32:14.081 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:32:14.082 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/273) 2024-03-27T12:32:14.594 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:32:14.606 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:32:14.607 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:32:14.974 INFO:teuthology.orchestra.run.smithi057.stdout:generic/273 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:32:14.986 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/273 2024-03-27T12:32:14.987 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/273 2024-03-27T12:32:14.987 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:32:14.997 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:32:15.024 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:32:15.025 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/274) 2024-03-27T12:32:15.558 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:32:15.570 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:32:15.570 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:32:15.957 INFO:teuthology.orchestra.run.smithi057.stdout:generic/274 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:32:15.969 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/274 2024-03-27T12:32:15.969 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/274 2024-03-27T12:32:15.969 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:32:15.979 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:32:16.010 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:32:16.010 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/275) 2024-03-27T12:32:16.557 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:32:16.569 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:32:16.569 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:32:17.393 INFO:teuthology.orchestra.run.smithi057.stdout:generic/275 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:32:17.407 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/275 2024-03-27T12:32:17.407 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/275 2024-03-27T12:32:17.407 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:32:17.419 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:32:17.453 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:32:17.454 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/276) 2024-03-27T12:32:18.032 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:32:18.047 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:32:18.047 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:32:18.486 INFO:teuthology.orchestra.run.smithi057.stdout:generic/276 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:32:18.497 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/276 2024-03-27T12:32:18.497 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/276 2024-03-27T12:32:18.497 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:32:18.505 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:32:18.532 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:32:18.532 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/277) 2024-03-27T12:32:19.103 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:32:19.114 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:32:19.114 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:32:19.518 INFO:teuthology.orchestra.run.smithi057.stdout:generic/277 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:32:19.530 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/277 2024-03-27T12:32:19.531 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/277 2024-03-27T12:32:19.531 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:32:19.542 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:32:19.576 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:32:19.576 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/278) 2024-03-27T12:32:20.147 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:32:20.160 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:32:20.160 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:32:20.616 INFO:teuthology.orchestra.run.smithi057.stdout:generic/278 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:32:20.627 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/278 2024-03-27T12:32:20.627 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/278 2024-03-27T12:32:20.627 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:32:20.636 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:32:20.667 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:32:20.667 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/279) 2024-03-27T12:32:21.186 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:32:21.198 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:32:21.199 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:32:21.637 INFO:teuthology.orchestra.run.smithi057.stdout:generic/279 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:32:21.648 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/279 2024-03-27T12:32:21.648 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/279 2024-03-27T12:32:21.648 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:32:21.657 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:32:21.687 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:32:21.687 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/280) 2024-03-27T12:32:22.254 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:32:22.266 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:32:22.266 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:32:22.760 INFO:teuthology.orchestra.run.smithi057.stdout:generic/280 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:32:22.772 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/280 2024-03-27T12:32:22.772 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/280 2024-03-27T12:32:22.772 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:32:22.781 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:32:22.810 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:32:22.810 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/281) 2024-03-27T12:32:23.343 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:32:23.356 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:32:23.357 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:32:23.818 INFO:teuthology.orchestra.run.smithi057.stdout:generic/281 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:32:23.833 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/281 2024-03-27T12:32:23.833 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/281 2024-03-27T12:32:23.834 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:32:23.845 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:32:23.872 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:32:23.873 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/282) 2024-03-27T12:32:24.449 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:32:24.462 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:32:24.462 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:32:24.903 INFO:teuthology.orchestra.run.smithi057.stdout:generic/282 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:32:24.914 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/282 2024-03-27T12:32:24.914 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/282 2024-03-27T12:32:24.914 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:32:24.923 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:32:24.948 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:32:24.949 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/283) 2024-03-27T12:32:25.472 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:32:25.484 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:32:25.484 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:32:25.912 INFO:teuthology.orchestra.run.smithi057.stdout:generic/283 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:32:25.926 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/283 2024-03-27T12:32:25.927 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/283 2024-03-27T12:32:25.927 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:32:25.939 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:32:25.971 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:32:25.971 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/284) 2024-03-27T12:32:26.519 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:32:26.531 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:32:26.532 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:32:26.941 INFO:teuthology.orchestra.run.smithi057.stdout:generic/284 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:32:26.955 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/284 2024-03-27T12:32:26.955 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/284 2024-03-27T12:32:26.955 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:32:26.967 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:32:26.996 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:32:26.996 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/285) 2024-03-27T12:32:27.540 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:32:27.553 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:32:27.553 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:32:32.524 INFO:teuthology.orchestra.run.smithi057.stdout:generic/285 5s 2024-03-27T12:32:32.540 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/285 2024-03-27T12:32:32.540 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:32:32.549 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:32:32.582 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:32:32.582 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/286) 2024-03-27T12:32:32.763 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:32:32.774 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:32:33.495 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:32:33.517 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:32:33.517 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:33:03.019 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:33:03.029 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:33:33.182 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:33:33.191 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:34:03.379 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:34:03.388 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:34:33.734 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:34:33.745 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:35:03.883 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:35:03.893 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:35:21.117 INFO:teuthology.orchestra.run.smithi057.stdout:generic/286 168s 2024-03-27T12:35:21.135 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/286 2024-03-27T12:35:21.135 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:35:21.144 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:35:21.174 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:35:21.174 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/287) 2024-03-27T12:35:22.073 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:35:22.083 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:35:22.083 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:35:22.535 INFO:teuthology.orchestra.run.smithi057.stdout:generic/287 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:35:22.546 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/287 2024-03-27T12:35:22.546 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/287 2024-03-27T12:35:22.546 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:35:22.556 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:35:22.585 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:35:22.585 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/288) 2024-03-27T12:35:23.137 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:35:23.150 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:35:23.150 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:35:23.589 INFO:teuthology.orchestra.run.smithi057.stdout:generic/288 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:35:23.601 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/288 2024-03-27T12:35:23.601 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/288 2024-03-27T12:35:23.601 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:35:23.612 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:35:23.644 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:35:23.645 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/289) 2024-03-27T12:35:24.245 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:35:24.258 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:35:24.258 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:35:24.728 INFO:teuthology.orchestra.run.smithi057.stdout:generic/289 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:35:24.740 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/289 2024-03-27T12:35:24.740 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/289 2024-03-27T12:35:24.740 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:35:24.748 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:35:24.777 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:35:24.777 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/290) 2024-03-27T12:35:25.322 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:35:25.334 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:35:25.334 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:35:25.757 INFO:teuthology.orchestra.run.smithi057.stdout:generic/290 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:35:25.771 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/290 2024-03-27T12:35:25.771 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/290 2024-03-27T12:35:25.771 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:35:25.783 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:35:25.811 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:35:25.811 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/291) 2024-03-27T12:35:26.348 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:35:26.360 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:35:26.360 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:35:26.796 INFO:teuthology.orchestra.run.smithi057.stdout:generic/291 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:35:26.809 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/291 2024-03-27T12:35:26.809 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/291 2024-03-27T12:35:26.809 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:35:26.819 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:35:26.850 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:35:26.850 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/292) 2024-03-27T12:35:27.422 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:35:27.434 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:35:27.434 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:35:27.849 INFO:teuthology.orchestra.run.smithi057.stdout:generic/292 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:35:27.861 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/292 2024-03-27T12:35:27.861 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/292 2024-03-27T12:35:27.861 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:35:27.870 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:35:27.898 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:35:27.898 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/293) 2024-03-27T12:35:28.441 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:35:28.456 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:35:28.456 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:35:28.870 INFO:teuthology.orchestra.run.smithi057.stdout:generic/293 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:35:28.881 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/293 2024-03-27T12:35:28.882 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/293 2024-03-27T12:35:28.882 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:35:28.892 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:35:28.925 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:35:28.926 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/294) 2024-03-27T12:35:29.527 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:35:29.539 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:35:29.539 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:35:29.920 INFO:teuthology.orchestra.run.smithi057.stdout:generic/294 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:35:29.932 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/294 2024-03-27T12:35:29.933 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/294 2024-03-27T12:35:29.933 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:35:29.945 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:35:29.978 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:35:29.978 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/295) 2024-03-27T12:35:30.514 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:35:30.526 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:35:30.526 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:35:30.992 INFO:teuthology.orchestra.run.smithi057.stdout:generic/295 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:35:31.004 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/295 2024-03-27T12:35:31.004 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/295 2024-03-27T12:35:31.004 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:35:31.014 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:35:31.045 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:35:31.045 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/296) 2024-03-27T12:35:31.590 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:35:31.603 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:35:31.604 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:35:32.023 INFO:teuthology.orchestra.run.smithi057.stdout:generic/296 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:35:32.035 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/296 2024-03-27T12:35:32.035 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/296 2024-03-27T12:35:32.035 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:35:32.045 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:35:32.076 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:35:32.076 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/297) 2024-03-27T12:35:32.662 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:35:32.676 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:35:32.676 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:35:33.098 INFO:teuthology.orchestra.run.smithi057.stdout:generic/297 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:35:33.112 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/297 2024-03-27T12:35:33.112 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/297 2024-03-27T12:35:33.112 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:35:33.124 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:35:33.160 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:35:33.161 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/298) 2024-03-27T12:35:33.723 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:35:33.736 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:35:33.736 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:35:34.037 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:35:34.042 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:35:34.149 INFO:teuthology.orchestra.run.smithi057.stdout:generic/298 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:35:34.159 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/298 2024-03-27T12:35:34.159 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/298 2024-03-27T12:35:34.159 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:35:34.166 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:35:34.191 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:35:34.191 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/299) 2024-03-27T12:35:34.767 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:35:34.780 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:35:34.781 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:35:35.227 INFO:teuthology.orchestra.run.smithi057.stdout:generic/299 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:35:35.240 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/299 2024-03-27T12:35:35.241 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/299 2024-03-27T12:35:35.241 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:35:35.254 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:35:35.284 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:35:35.285 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/300) 2024-03-27T12:35:35.798 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:35:35.809 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:35:35.809 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:35:36.207 INFO:teuthology.orchestra.run.smithi057.stdout:generic/300 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:35:36.217 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/300 2024-03-27T12:35:36.217 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/300 2024-03-27T12:35:36.217 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:35:36.226 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:35:36.258 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:35:36.258 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/301) 2024-03-27T12:35:36.809 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:35:36.820 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:35:36.820 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:35:37.214 INFO:teuthology.orchestra.run.smithi057.stdout:generic/301 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:35:37.223 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/301 2024-03-27T12:35:37.223 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/301 2024-03-27T12:35:37.223 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:35:37.232 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:35:37.262 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:35:37.263 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/302) 2024-03-27T12:35:37.832 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:35:37.847 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:35:37.847 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:35:38.297 INFO:teuthology.orchestra.run.smithi057.stdout:generic/302 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:35:38.311 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/302 2024-03-27T12:35:38.311 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/302 2024-03-27T12:35:38.311 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:35:38.323 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:35:38.357 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:35:38.357 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/303) 2024-03-27T12:35:38.948 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:35:38.960 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:35:38.961 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:35:39.542 INFO:teuthology.orchestra.run.smithi057.stdout:generic/303 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-03-27T12:35:39.556 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/303 2024-03-27T12:35:39.556 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/303 2024-03-27T12:35:39.556 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:35:39.567 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:35:39.614 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:35:39.614 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/304) 2024-03-27T12:35:40.398 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:35:40.409 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:35:40.409 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:35:40.908 INFO:teuthology.orchestra.run.smithi057.stdout:generic/304 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2024-03-27T12:35:40.921 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/304 2024-03-27T12:35:40.921 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/304 2024-03-27T12:35:40.921 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:35:40.931 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:35:40.981 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:35:40.981 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/305) 2024-03-27T12:35:41.707 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:35:41.717 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:35:41.717 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:35:42.092 INFO:teuthology.orchestra.run.smithi057.stdout:generic/305 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:35:42.105 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/305 2024-03-27T12:35:42.105 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/305 2024-03-27T12:35:42.105 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:35:42.115 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:35:42.139 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:35:42.139 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/306) 2024-03-27T12:35:42.690 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:35:42.702 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:35:42.702 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:35:43.127 INFO:teuthology.orchestra.run.smithi057.stdout:generic/306 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:35:43.140 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/306 2024-03-27T12:35:43.140 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/306 2024-03-27T12:35:43.140 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:35:43.151 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:35:43.184 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:35:43.185 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/307) 2024-03-27T12:35:43.746 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:35:43.759 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:35:43.759 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:35:44.390 INFO:teuthology.orchestra.run.smithi057.stdout:generic/307 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:35:44.402 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/307 2024-03-27T12:35:44.402 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/307 2024-03-27T12:35:44.402 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:35:44.411 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:35:44.439 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:35:44.440 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/308) 2024-03-27T12:35:44.987 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:35:44.998 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:35:44.998 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:35:45.528 INFO:teuthology.orchestra.run.smithi057.stdout:generic/308 0s 2024-03-27T12:35:45.547 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/308 2024-03-27T12:35:45.547 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:35:45.558 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:35:45.592 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:35:45.592 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/309) 2024-03-27T12:35:46.115 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:35:46.127 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:35:46.127 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:35:47.780 INFO:teuthology.orchestra.run.smithi057.stdout:generic/309 1s 2024-03-27T12:35:47.795 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/309 2024-03-27T12:35:47.795 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:35:47.803 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:35:47.836 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:35:47.836 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/310) 2024-03-27T12:35:48.591 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:35:48.602 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:35:48.602 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:36:04.241 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:36:04.254 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:36:34.372 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:36:34.381 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:37:04.536 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:37:04.544 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:37:34.716 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:37:34.726 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:37:38.589 INFO:teuthology.orchestra.run.smithi057.stdout:generic/310 110s 2024-03-27T12:37:38.606 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/310 2024-03-27T12:37:38.606 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:37:38.615 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:37:38.677 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:37:38.678 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/311) 2024-03-27T12:37:39.470 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:37:39.502 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:37:39.502 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:37:39.998 INFO:teuthology.orchestra.run.smithi057.stdout:generic/311 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:37:40.010 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/311 2024-03-27T12:37:40.011 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/311 2024-03-27T12:37:40.011 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:37:40.020 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:37:40.048 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:37:40.048 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/312) 2024-03-27T12:37:40.568 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:37:40.579 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:37:40.579 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:37:41.058 INFO:teuthology.orchestra.run.smithi057.stdout:generic/312 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:37:41.073 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/312 2024-03-27T12:37:41.073 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/312 2024-03-27T12:37:41.073 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:37:41.084 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:37:41.122 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:37:41.123 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/313) 2024-03-27T12:37:41.700 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:37:41.712 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:37:41.712 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:37:46.332 INFO:teuthology.orchestra.run.smithi057.stdout:generic/313 5s 2024-03-27T12:37:46.347 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/313 2024-03-27T12:37:46.347 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:37:46.354 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:37:46.378 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:37:46.378 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/314) 2024-03-27T12:37:46.958 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:37:46.971 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:37:46.971 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:37:48.327 INFO:teuthology.orchestra.run.smithi057.stdout:generic/314 2s 2024-03-27T12:37:48.346 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/314 2024-03-27T12:37:48.346 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:37:48.353 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:37:48.383 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:37:48.384 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/315) 2024-03-27T12:37:48.936 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:37:48.947 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:37:48.947 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:37:50.949 INFO:teuthology.orchestra.run.smithi057.stdout:generic/315 2s 2024-03-27T12:37:50.967 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/315 2024-03-27T12:37:50.967 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:37:50.978 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:37:51.027 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:37:51.027 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/316) 2024-03-27T12:37:51.715 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:37:51.726 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:37:51.726 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:37:55.655 INFO:teuthology.orchestra.run.smithi057.stdout:generic/316 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-03-27T12:37:55.666 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/316 2024-03-27T12:37:55.667 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/316 2024-03-27T12:37:55.667 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:37:55.676 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:37:55.722 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:37:55.722 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/317) 2024-03-27T12:37:56.450 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:37:56.464 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:37:56.464 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:37:56.891 INFO:teuthology.orchestra.run.smithi057.stdout:generic/317 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:37:56.904 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/317 2024-03-27T12:37:56.904 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/317 2024-03-27T12:37:56.904 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:37:56.915 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:37:56.942 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:37:56.943 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/318) 2024-03-27T12:37:57.536 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:37:57.548 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:37:57.548 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:37:57.941 INFO:teuthology.orchestra.run.smithi057.stdout:generic/318 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:37:57.950 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/318 2024-03-27T12:37:57.950 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/318 2024-03-27T12:37:57.950 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:37:57.957 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:37:57.985 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:37:57.985 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/319) 2024-03-27T12:37:58.517 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:37:58.528 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:37:58.528 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:37:58.968 INFO:teuthology.orchestra.run.smithi057.stdout:generic/319 [not run] ACLs not supported by this filesystem type: ceph-fuse 2024-03-27T12:37:58.977 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/319 2024-03-27T12:37:58.977 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/319 2024-03-27T12:37:58.977 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:37:58.985 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:37:59.010 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:37:59.010 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/320) 2024-03-27T12:37:59.546 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:37:59.558 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:37:59.558 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:38:00.001 INFO:teuthology.orchestra.run.smithi057.stdout:generic/320 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:38:00.016 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/320 2024-03-27T12:38:00.016 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/320 2024-03-27T12:38:00.016 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:38:00.027 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:38:00.060 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:38:00.060 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/321) 2024-03-27T12:38:00.612 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:38:00.623 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:38:00.623 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:38:01.095 INFO:teuthology.orchestra.run.smithi057.stdout:generic/321 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:38:01.109 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/321 2024-03-27T12:38:01.109 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/321 2024-03-27T12:38:01.109 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:38:01.120 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:38:01.151 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:38:01.151 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/322) 2024-03-27T12:38:01.708 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:38:01.724 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:38:01.724 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:38:02.164 INFO:teuthology.orchestra.run.smithi057.stdout:generic/322 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:38:02.176 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/322 2024-03-27T12:38:02.176 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/322 2024-03-27T12:38:02.176 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:38:02.185 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:38:02.214 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:38:02.215 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/323) 2024-03-27T12:38:02.757 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:38:02.768 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:38:02.768 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:38:04.855 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:38:04.862 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:38:35.169 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:38:35.177 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:38:35.371 INFO:tasks.ceph.osd.1.smithi057.stderr:2024-03-27T12:38:35.362+0000 7f8202600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 297485) UID: 0 2024-03-27T12:38:35.371 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-03-27T12:38:35.363+0000 7f622b800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 297485) UID: 0 2024-03-27T12:38:35.371 INFO:tasks.ceph.osd.2.smithi057.stderr:2024-03-27T12:38:35.363+0000 7f1380800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 297485) UID: 0 2024-03-27T12:38:35.373 INFO:tasks.ceph.osd.3.smithi057.stderr:2024-03-27T12:38:35.365+0000 7f009f600640 -1 received signal: Hangup from (PID: 297485) UID: 0 2024-03-27T12:40:05.555 INFO:teuthology.orchestra.run.smithi057.stdout:generic/323 123s 2024-03-27T12:40:05.574 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/323 2024-03-27T12:40:05.574 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:40:05.583 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:40:05.622 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:40:05.623 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/324) 2024-03-27T12:40:07.374 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:40:07.385 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:40:07.385 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:40:08.307 INFO:teuthology.orchestra.run.smithi057.stdout:generic/324 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:40:08.320 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/324 2024-03-27T12:40:08.320 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/324 2024-03-27T12:40:08.320 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:40:08.331 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:40:08.361 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:40:08.361 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/325) 2024-03-27T12:40:08.866 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:40:08.875 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:40:08.876 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:40:09.378 INFO:teuthology.orchestra.run.smithi057.stdout:generic/325 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:40:09.391 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/325 2024-03-27T12:40:09.392 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/325 2024-03-27T12:40:09.392 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:40:09.402 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:40:09.429 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:40:09.429 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/326) 2024-03-27T12:40:09.947 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:40:09.960 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:40:09.961 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:40:12.567 INFO:teuthology.orchestra.run.smithi057.stdout:generic/326 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:40:12.581 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/326 2024-03-27T12:40:12.581 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/326 2024-03-27T12:40:12.581 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:40:12.592 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:40:12.621 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:40:12.621 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/327) 2024-03-27T12:40:13.129 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:40:13.142 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:40:13.142 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:40:13.649 INFO:teuthology.orchestra.run.smithi057.stdout:generic/327 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:40:13.660 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/327 2024-03-27T12:40:13.660 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/327 2024-03-27T12:40:13.660 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:40:13.669 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:40:13.697 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:40:13.698 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/328) 2024-03-27T12:40:14.225 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:40:14.236 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:40:14.236 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:40:14.954 INFO:teuthology.orchestra.run.smithi057.stdout:generic/328 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:40:14.966 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/328 2024-03-27T12:40:14.966 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/328 2024-03-27T12:40:14.967 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:40:14.975 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:40:15.003 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:40:15.004 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/329) 2024-03-27T12:40:15.546 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:40:15.556 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:40:15.557 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:40:16.192 INFO:teuthology.orchestra.run.smithi057.stdout:generic/329 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:40:16.205 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/329 2024-03-27T12:40:16.205 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/329 2024-03-27T12:40:16.205 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:40:16.216 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:40:16.245 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:40:16.245 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/330) 2024-03-27T12:40:16.764 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:40:16.775 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:40:16.775 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:40:17.134 INFO:teuthology.orchestra.run.smithi057.stdout:generic/330 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:40:17.143 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/330 2024-03-27T12:40:17.143 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/330 2024-03-27T12:40:17.143 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:40:17.150 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:40:17.176 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:40:17.176 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/331) 2024-03-27T12:40:17.707 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:40:17.718 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:40:17.718 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:40:18.138 INFO:teuthology.orchestra.run.smithi057.stdout:generic/331 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:40:18.149 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/331 2024-03-27T12:40:18.149 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/331 2024-03-27T12:40:18.149 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:40:18.157 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:40:18.187 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:40:18.187 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/332) 2024-03-27T12:40:18.668 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:40:18.678 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:40:18.678 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:40:19.056 INFO:teuthology.orchestra.run.smithi057.stdout:generic/332 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:40:19.068 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/332 2024-03-27T12:40:19.068 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/332 2024-03-27T12:40:19.068 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:40:19.077 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:40:19.107 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:40:19.108 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/333) 2024-03-27T12:40:19.633 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:40:19.644 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:40:19.644 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:40:20.059 INFO:teuthology.orchestra.run.smithi057.stdout:generic/333 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:40:20.072 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/333 2024-03-27T12:40:20.073 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/333 2024-03-27T12:40:20.073 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:40:20.085 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:40:20.116 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:40:20.117 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/334) 2024-03-27T12:40:20.653 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:40:20.664 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:40:20.664 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:40:21.010 INFO:teuthology.orchestra.run.smithi057.stdout:generic/334 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:40:21.020 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/334 2024-03-27T12:40:21.020 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/334 2024-03-27T12:40:21.020 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:40:21.029 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:40:21.059 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:40:21.059 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/335) 2024-03-27T12:40:21.527 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:40:21.540 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:40:21.540 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:40:21.999 INFO:teuthology.orchestra.run.smithi057.stdout:generic/335 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:40:22.011 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/335 2024-03-27T12:40:22.011 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/335 2024-03-27T12:40:22.011 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:40:22.020 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:40:22.051 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:40:22.051 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/336) 2024-03-27T12:40:22.554 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:40:22.566 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:40:22.566 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:40:22.974 INFO:teuthology.orchestra.run.smithi057.stdout:generic/336 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:40:22.988 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/336 2024-03-27T12:40:22.988 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/336 2024-03-27T12:40:22.988 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:40:22.999 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:40:23.028 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:40:23.028 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/337) 2024-03-27T12:40:23.516 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:40:23.529 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:40:23.529 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:40:23.940 INFO:teuthology.orchestra.run.smithi057.stdout:generic/337 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:40:23.950 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/337 2024-03-27T12:40:23.950 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/337 2024-03-27T12:40:23.950 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:40:23.959 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:40:23.987 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:40:23.987 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/338) 2024-03-27T12:40:24.485 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:40:24.496 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:40:24.496 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:40:24.911 INFO:teuthology.orchestra.run.smithi057.stdout:generic/338 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:40:24.920 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/338 2024-03-27T12:40:24.920 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/338 2024-03-27T12:40:24.920 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:40:24.926 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:40:24.950 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:40:24.950 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/339) 2024-03-27T12:40:25.471 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:40:25.482 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:40:25.482 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:40:25.871 INFO:teuthology.orchestra.run.smithi057.stdout:generic/339 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:40:25.882 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/339 2024-03-27T12:40:25.882 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/339 2024-03-27T12:40:25.882 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:40:25.891 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:40:25.920 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:40:25.920 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/340) 2024-03-27T12:40:26.436 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:40:26.447 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:40:26.447 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:40:26.792 INFO:teuthology.orchestra.run.smithi057.stdout:generic/340 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:40:26.801 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/340 2024-03-27T12:40:26.801 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/340 2024-03-27T12:40:26.801 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:40:26.810 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:40:26.839 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:40:26.839 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/341) 2024-03-27T12:40:27.352 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:40:27.364 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:40:27.364 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:40:27.738 INFO:teuthology.orchestra.run.smithi057.stdout:generic/341 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:40:27.750 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/341 2024-03-27T12:40:27.750 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/341 2024-03-27T12:40:27.750 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:40:27.758 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:40:27.784 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:40:27.785 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/342) 2024-03-27T12:40:28.309 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:40:28.321 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:40:28.321 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:40:28.751 INFO:teuthology.orchestra.run.smithi057.stdout:generic/342 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:40:28.762 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/342 2024-03-27T12:40:28.763 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/342 2024-03-27T12:40:28.763 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:40:28.772 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:40:28.797 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:40:28.798 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/343) 2024-03-27T12:40:29.290 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:40:29.303 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:40:29.304 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:40:29.713 INFO:teuthology.orchestra.run.smithi057.stdout:generic/343 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:40:29.722 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/343 2024-03-27T12:40:29.723 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/343 2024-03-27T12:40:29.723 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:40:29.732 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:40:29.760 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:40:29.761 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/344) 2024-03-27T12:40:30.288 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:40:30.298 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:40:30.299 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:40:30.650 INFO:teuthology.orchestra.run.smithi057.stdout:generic/344 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:40:30.659 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/344 2024-03-27T12:40:30.659 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/344 2024-03-27T12:40:30.660 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:40:30.667 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:40:30.694 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:40:30.694 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/345) 2024-03-27T12:40:31.171 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:40:31.182 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:40:31.182 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:40:31.593 INFO:teuthology.orchestra.run.smithi057.stdout:generic/345 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:40:31.603 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/345 2024-03-27T12:40:31.604 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/345 2024-03-27T12:40:31.604 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:40:31.612 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:40:31.639 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:40:31.639 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/346) 2024-03-27T12:40:32.138 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:40:32.149 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:40:32.149 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:40:32.538 INFO:teuthology.orchestra.run.smithi057.stdout:generic/346 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:40:32.548 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/346 2024-03-27T12:40:32.548 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/346 2024-03-27T12:40:32.548 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:40:32.556 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:40:32.582 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:40:32.582 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/347) 2024-03-27T12:40:33.050 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:40:33.062 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:40:33.063 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:40:33.526 INFO:teuthology.orchestra.run.smithi057.stdout:generic/347 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:40:33.536 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/347 2024-03-27T12:40:33.536 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/347 2024-03-27T12:40:33.536 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:40:33.545 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:40:33.570 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:40:33.570 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/348) 2024-03-27T12:40:34.084 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:40:34.094 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:40:34.094 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:40:34.516 INFO:teuthology.orchestra.run.smithi057.stdout:generic/348 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:40:34.527 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/348 2024-03-27T12:40:34.527 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/348 2024-03-27T12:40:34.527 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:40:34.535 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:40:34.565 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:40:34.565 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/349) 2024-03-27T12:40:35.079 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:40:35.090 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:40:35.090 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:40:37.763 INFO:teuthology.orchestra.run.smithi057.stdout:generic/349 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-03-27T12:40:37.773 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/349 2024-03-27T12:40:37.773 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/349 2024-03-27T12:40:37.773 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:40:37.781 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:40:37.806 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:40:37.807 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/350) 2024-03-27T12:40:38.296 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:40:38.308 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:40:38.308 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:40:42.483 INFO:teuthology.orchestra.run.smithi057.stdout:generic/350 4s 2024-03-27T12:40:42.497 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/350 2024-03-27T12:40:42.497 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:40:42.505 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:40:42.533 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:40:42.533 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/351) 2024-03-27T12:40:43.053 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:40:43.065 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:40:43.065 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:40:45.860 INFO:teuthology.orchestra.run.smithi057.stdout:generic/351 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2024-03-27T12:40:45.870 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/351 2024-03-27T12:40:45.870 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/351 2024-03-27T12:40:45.870 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:40:45.877 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:40:45.929 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:40:45.930 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/352) 2024-03-27T12:40:46.698 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:40:46.709 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:40:46.709 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:40:47.134 INFO:teuthology.orchestra.run.smithi057.stdout:generic/352 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:40:47.145 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/352 2024-03-27T12:40:47.145 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/352 2024-03-27T12:40:47.145 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:40:47.154 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:40:47.180 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:40:47.180 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/353) 2024-03-27T12:40:47.672 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:40:47.684 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:40:47.684 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:40:48.060 INFO:teuthology.orchestra.run.smithi057.stdout:generic/353 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:40:48.072 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/353 2024-03-27T12:40:48.072 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/353 2024-03-27T12:40:48.072 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:40:48.087 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:40:48.115 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:40:48.115 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/354) 2024-03-27T12:40:48.624 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:40:48.637 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:40:48.637 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:40:49.010 INFO:teuthology.orchestra.run.smithi057.stdout:generic/354 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:40:49.021 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/354 2024-03-27T12:40:49.021 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/354 2024-03-27T12:40:49.021 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:40:49.029 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:40:49.055 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:40:49.055 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/355) 2024-03-27T12:40:49.550 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:40:49.562 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:40:49.562 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:40:52.086 INFO:teuthology.orchestra.run.smithi057.stdout:generic/355 3s 2024-03-27T12:40:52.102 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/355 2024-03-27T12:40:52.102 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:40:52.109 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:40:52.148 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:40:52.148 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/356) 2024-03-27T12:40:52.976 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:40:52.987 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:40:52.987 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:40:53.444 INFO:teuthology.orchestra.run.smithi057.stdout:generic/356 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:40:53.455 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/356 2024-03-27T12:40:53.455 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/356 2024-03-27T12:40:53.455 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:40:53.465 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:40:53.493 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:40:53.493 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/357) 2024-03-27T12:40:53.980 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:40:53.991 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:40:53.991 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:40:54.380 INFO:teuthology.orchestra.run.smithi057.stdout:generic/357 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:40:54.392 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/357 2024-03-27T12:40:54.393 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/357 2024-03-27T12:40:54.393 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:40:54.403 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:40:54.431 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:40:54.431 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/358) 2024-03-27T12:40:54.938 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:40:54.950 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:40:54.950 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:40:55.320 INFO:teuthology.orchestra.run.smithi057.stdout:generic/358 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:40:55.331 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/358 2024-03-27T12:40:55.331 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/358 2024-03-27T12:40:55.332 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:40:55.340 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:40:55.366 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:40:55.367 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/359) 2024-03-27T12:40:55.851 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:40:55.867 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:40:55.867 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:40:56.255 INFO:teuthology.orchestra.run.smithi057.stdout:generic/359 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:40:56.265 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/359 2024-03-27T12:40:56.265 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/359 2024-03-27T12:40:56.265 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:40:56.274 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:40:56.302 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:40:56.302 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/360) 2024-03-27T12:40:56.810 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:40:56.820 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:40:56.821 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:40:57.665 INFO:teuthology.orchestra.run.smithi057.stdout:generic/360 1s 2024-03-27T12:40:57.683 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/360 2024-03-27T12:40:57.683 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:40:57.691 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:40:57.725 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:40:57.725 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/361) 2024-03-27T12:40:58.245 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:40:58.259 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:40:58.260 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:40:58.762 INFO:teuthology.orchestra.run.smithi057.stdout:generic/361 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:40:58.777 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/361 2024-03-27T12:40:58.777 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/361 2024-03-27T12:40:58.777 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:40:58.788 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:40:58.820 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:40:58.820 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/362) 2024-03-27T12:40:59.307 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:40:59.319 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:40:59.319 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:40:59.662 INFO:teuthology.orchestra.run.smithi057.stdout:generic/362 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:40:59.672 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/362 2024-03-27T12:40:59.672 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/362 2024-03-27T12:40:59.672 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:40:59.680 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:40:59.708 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:40:59.709 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/363) 2024-03-27T12:41:00.230 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:41:00.242 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:41:00.242 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:41:00.614 INFO:teuthology.orchestra.run.smithi057.stdout:generic/363 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:41:00.624 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/363 2024-03-27T12:41:00.624 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/363 2024-03-27T12:41:00.624 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:41:00.632 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:41:00.659 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:41:00.659 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/364) 2024-03-27T12:41:01.174 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:41:01.187 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:41:01.187 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:41:01.602 INFO:teuthology.orchestra.run.smithi057.stdout:generic/364 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:41:01.615 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/364 2024-03-27T12:41:01.616 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/364 2024-03-27T12:41:01.616 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:41:01.627 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:41:01.654 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:41:01.655 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/365) 2024-03-27T12:41:02.148 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:41:02.161 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:41:02.161 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:41:02.549 INFO:teuthology.orchestra.run.smithi057.stdout:generic/365 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:41:02.556 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/365 2024-03-27T12:41:02.556 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/365 2024-03-27T12:41:02.556 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:41:02.564 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:41:02.591 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:41:02.591 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/366) 2024-03-27T12:41:03.128 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:41:03.142 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:41:03.142 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:41:03.532 INFO:teuthology.orchestra.run.smithi057.stdout:generic/366 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:41:03.542 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/366 2024-03-27T12:41:03.542 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/366 2024-03-27T12:41:03.542 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:41:03.550 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:41:03.580 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:41:03.580 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/367) 2024-03-27T12:41:04.087 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:41:04.097 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:41:04.098 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:41:04.493 INFO:teuthology.orchestra.run.smithi057.stdout:generic/367 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:41:04.502 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/367 2024-03-27T12:41:04.502 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/367 2024-03-27T12:41:04.502 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:41:04.511 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:41:04.537 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:41:04.538 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/368) 2024-03-27T12:41:05.033 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:41:05.044 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:41:05.044 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:41:05.426 INFO:teuthology.orchestra.run.smithi057.stdout:generic/368 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:41:05.439 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/368 2024-03-27T12:41:05.439 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/368 2024-03-27T12:41:05.439 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:41:05.448 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:41:05.476 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:41:05.476 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/369) 2024-03-27T12:41:05.958 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:41:05.969 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:41:05.969 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:41:06.335 INFO:teuthology.orchestra.run.smithi057.stdout:generic/369 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:41:06.346 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/369 2024-03-27T12:41:06.346 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/369 2024-03-27T12:41:06.346 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:41:06.356 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:41:06.384 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:41:06.384 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/370) 2024-03-27T12:41:06.933 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:41:06.945 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:41:06.945 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:41:07.327 INFO:teuthology.orchestra.run.smithi057.stdout:generic/370 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:41:07.336 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/370 2024-03-27T12:41:07.336 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/370 2024-03-27T12:41:07.336 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:41:07.343 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:41:07.369 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:41:07.369 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/371) 2024-03-27T12:41:07.859 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:41:07.872 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:41:07.873 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:41:08.284 INFO:teuthology.orchestra.run.smithi057.stdout:generic/371 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:41:08.295 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/371 2024-03-27T12:41:08.295 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/371 2024-03-27T12:41:08.295 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:41:08.302 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:41:08.328 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:41:08.328 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/372) 2024-03-27T12:41:08.817 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:41:08.828 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:41:08.828 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:41:09.216 INFO:teuthology.orchestra.run.smithi057.stdout:generic/372 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:41:09.228 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/372 2024-03-27T12:41:09.228 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/372 2024-03-27T12:41:09.228 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:41:09.237 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:41:09.266 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:41:09.266 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/373) 2024-03-27T12:41:09.741 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:41:09.752 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:41:09.752 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:41:10.108 INFO:teuthology.orchestra.run.smithi057.stdout:generic/373 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:41:10.117 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/373 2024-03-27T12:41:10.117 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/373 2024-03-27T12:41:10.117 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:41:10.123 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:41:10.147 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:41:10.147 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/374) 2024-03-27T12:41:10.643 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:41:10.654 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:41:10.655 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:41:11.062 INFO:teuthology.orchestra.run.smithi057.stdout:generic/374 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:41:11.072 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/374 2024-03-27T12:41:11.072 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/374 2024-03-27T12:41:11.072 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:41:11.079 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:41:11.103 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:41:11.104 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/375) 2024-03-27T12:41:11.619 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:41:11.630 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:41:11.630 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:41:12.120 INFO:teuthology.orchestra.run.smithi057.stdout:generic/375 [not run] ACLs not supported by this filesystem type: ceph-fuse 2024-03-27T12:41:12.132 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/375 2024-03-27T12:41:12.132 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/375 2024-03-27T12:41:12.133 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:41:12.143 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:41:12.171 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:41:12.171 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/376) 2024-03-27T12:41:12.690 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:41:12.702 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:41:12.702 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:41:13.216 INFO:teuthology.orchestra.run.smithi057.stdout:generic/376 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:41:13.227 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/376 2024-03-27T12:41:13.227 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/376 2024-03-27T12:41:13.227 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:41:13.236 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:41:13.263 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:41:13.263 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/377) 2024-03-27T12:41:13.758 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:41:13.768 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:41:13.768 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:41:14.140 INFO:teuthology.orchestra.run.smithi057.stdout:generic/377 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:41:14.149 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/377 2024-03-27T12:41:14.149 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/377 2024-03-27T12:41:14.149 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:41:14.156 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:41:14.180 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:41:14.180 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/378) 2024-03-27T12:41:14.693 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:41:14.703 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:41:14.703 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:41:16.899 INFO:teuthology.orchestra.run.smithi057.stdout:generic/378 2s 2024-03-27T12:41:16.920 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/378 2024-03-27T12:41:16.920 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:41:16.930 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:41:16.993 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:41:16.994 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/379) 2024-03-27T12:41:17.745 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:41:17.756 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:41:17.756 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:41:18.126 INFO:teuthology.orchestra.run.smithi057.stdout:generic/379 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:41:18.134 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/379 2024-03-27T12:41:18.134 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/379 2024-03-27T12:41:18.135 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:41:18.141 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:41:18.168 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:41:18.169 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/380) 2024-03-27T12:41:18.688 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:41:18.702 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:41:18.702 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:41:19.135 INFO:teuthology.orchestra.run.smithi057.stdout:generic/380 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:41:19.147 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/380 2024-03-27T12:41:19.147 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/380 2024-03-27T12:41:19.147 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:41:19.156 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:41:19.184 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:41:19.184 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/381) 2024-03-27T12:41:19.641 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:41:19.651 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:41:19.651 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:41:20.062 INFO:teuthology.orchestra.run.smithi057.stdout:generic/381 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:41:20.074 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/381 2024-03-27T12:41:20.075 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/381 2024-03-27T12:41:20.075 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:41:20.085 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:41:20.114 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:41:20.114 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/382) 2024-03-27T12:41:20.607 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:41:20.618 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:41:20.618 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:41:21.148 INFO:teuthology.orchestra.run.smithi057.stdout:generic/382 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:41:21.160 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/382 2024-03-27T12:41:21.160 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/382 2024-03-27T12:41:21.160 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:41:21.171 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:41:21.199 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:41:21.200 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/383) 2024-03-27T12:41:21.705 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:41:21.716 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:41:21.717 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:41:22.122 INFO:teuthology.orchestra.run.smithi057.stdout:generic/383 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:41:22.134 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/383 2024-03-27T12:41:22.134 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/383 2024-03-27T12:41:22.134 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:41:22.141 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:41:22.173 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:41:22.173 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/384) 2024-03-27T12:41:22.714 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:41:22.725 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:41:22.725 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:41:23.135 INFO:teuthology.orchestra.run.smithi057.stdout:generic/384 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2024-03-27T12:41:23.144 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/384 2024-03-27T12:41:23.144 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/384 2024-03-27T12:41:23.144 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:41:23.151 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:41:23.179 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:41:23.179 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/385) 2024-03-27T12:41:23.675 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:41:23.689 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:41:23.689 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:41:24.107 INFO:teuthology.orchestra.run.smithi057.stdout:generic/385 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:41:24.119 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/385 2024-03-27T12:41:24.119 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/385 2024-03-27T12:41:24.119 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:41:24.128 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:41:24.155 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:41:24.155 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/386) 2024-03-27T12:41:24.649 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:41:24.660 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:41:24.660 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:41:25.035 INFO:teuthology.orchestra.run.smithi057.stdout:generic/386 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2024-03-27T12:41:25.047 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/386 2024-03-27T12:41:25.047 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/386 2024-03-27T12:41:25.047 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:41:25.058 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:41:25.086 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:41:25.086 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/387) 2024-03-27T12:41:25.594 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:41:25.604 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:41:25.604 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:41:25.919 INFO:teuthology.orchestra.run.smithi057.stdout:generic/387 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:41:25.930 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/387 2024-03-27T12:41:25.931 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/387 2024-03-27T12:41:25.931 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:41:25.939 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:41:25.964 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:41:25.964 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/388) 2024-03-27T12:41:26.445 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:41:26.457 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:41:26.457 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:41:26.826 INFO:teuthology.orchestra.run.smithi057.stdout:generic/388 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:41:26.835 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/388 2024-03-27T12:41:26.835 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/388 2024-03-27T12:41:26.835 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:41:26.841 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:41:26.865 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:41:26.866 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/389) 2024-03-27T12:41:27.326 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:41:27.337 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:41:27.337 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:41:27.776 INFO:teuthology.orchestra.run.smithi057.stdout:generic/389 [not run] O_TMPFILE is not supported 2024-03-27T12:41:27.785 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/389 2024-03-27T12:41:27.786 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/389 2024-03-27T12:41:27.786 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:41:27.793 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:41:27.820 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:41:27.821 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/390) 2024-03-27T12:41:28.301 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:41:28.314 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:41:28.314 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:41:28.780 INFO:teuthology.orchestra.run.smithi057.stdout:generic/390 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:41:28.791 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/390 2024-03-27T12:41:28.792 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/390 2024-03-27T12:41:28.792 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:41:28.801 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:41:28.828 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:41:28.829 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/391) 2024-03-27T12:41:29.321 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:41:29.333 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:41:29.333 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:42:35.113 INFO:teuthology.orchestra.run.smithi057.stdout:generic/391 66s 2024-03-27T12:42:35.220 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/391 2024-03-27T12:42:35.220 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:42:35.232 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:42:35.447 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:42:35.448 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/392) 2024-03-27T12:42:37.795 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:42:37.810 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:42:37.810 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:42:38.413 INFO:teuthology.orchestra.run.smithi057.stdout:generic/392 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:42:38.427 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/392 2024-03-27T12:42:38.427 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/392 2024-03-27T12:42:38.427 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:42:38.437 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:42:38.465 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:42:38.465 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/393) 2024-03-27T12:42:38.965 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:42:38.976 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:42:38.977 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:42:39.380 INFO:teuthology.orchestra.run.smithi057.stdout:generic/393 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:42:39.393 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/393 2024-03-27T12:42:39.393 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/393 2024-03-27T12:42:39.394 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:42:39.405 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:42:39.434 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:42:39.434 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/394) 2024-03-27T12:42:40.013 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:42:40.026 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:42:40.026 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:42:40.589 INFO:teuthology.orchestra.run.smithi057.stdout:generic/394 0s 2024-03-27T12:42:40.605 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/394 2024-03-27T12:42:40.606 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:42:40.614 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:42:40.643 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:42:40.643 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/395) 2024-03-27T12:42:41.595 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:42:41.612 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:42:41.612 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:42:42.323 INFO:teuthology.orchestra.run.smithi057.stdout:generic/395 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:42:42.334 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/395 2024-03-27T12:42:42.334 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/395 2024-03-27T12:42:42.335 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:42:42.344 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:42:42.376 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:42:42.376 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/396) 2024-03-27T12:42:43.101 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:42:43.114 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:42:43.114 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:42:44.038 INFO:teuthology.orchestra.run.smithi057.stdout:generic/396 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:42:44.051 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/396 2024-03-27T12:42:44.051 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/396 2024-03-27T12:42:44.051 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:42:44.062 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:42:44.098 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:42:44.098 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/397) 2024-03-27T12:42:44.690 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:42:44.703 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:42:44.703 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:42:45.274 INFO:teuthology.orchestra.run.smithi057.stdout:generic/397 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:42:45.288 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/397 2024-03-27T12:42:45.288 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/397 2024-03-27T12:42:45.288 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:42:45.299 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:42:45.340 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:42:45.341 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/398) 2024-03-27T12:42:45.901 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:42:45.916 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:42:45.916 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:42:46.472 INFO:teuthology.orchestra.run.smithi057.stdout:generic/398 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:42:46.484 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/398 2024-03-27T12:42:46.484 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/398 2024-03-27T12:42:46.484 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:42:46.493 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:42:46.525 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:42:46.526 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/399) 2024-03-27T12:42:47.114 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:42:47.128 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:42:47.128 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:42:47.618 INFO:teuthology.orchestra.run.smithi057.stdout:generic/399 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:42:47.631 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/399 2024-03-27T12:42:47.631 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/399 2024-03-27T12:42:47.631 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:42:47.643 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:42:47.673 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:42:47.673 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/400) 2024-03-27T12:42:48.273 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:42:48.285 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:42:48.285 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:42:48.712 INFO:teuthology.orchestra.run.smithi057.stdout:generic/400 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2024-03-27T12:42:48.727 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/400 2024-03-27T12:42:48.728 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/400 2024-03-27T12:42:48.728 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:42:48.739 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:42:48.774 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:42:48.774 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/401) 2024-03-27T12:42:49.397 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:42:49.409 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:42:49.409 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:42:49.808 INFO:teuthology.orchestra.run.smithi057.stdout:generic/401 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:42:49.820 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/401 2024-03-27T12:42:49.820 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/401 2024-03-27T12:42:49.820 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:42:49.829 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:42:49.858 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:42:49.858 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/402) 2024-03-27T12:42:50.417 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:42:50.431 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:42:50.431 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:42:50.889 INFO:teuthology.orchestra.run.smithi057.stdout:generic/402 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:42:50.903 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/402 2024-03-27T12:42:50.903 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/402 2024-03-27T12:42:50.903 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:42:50.913 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:42:50.942 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:42:50.942 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/403) 2024-03-27T12:42:51.448 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:42:51.460 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:42:51.460 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:42:51.877 INFO:teuthology.orchestra.run.smithi057.stdout:generic/403 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:42:51.891 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/403 2024-03-27T12:42:51.891 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/403 2024-03-27T12:42:51.891 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:42:51.903 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:42:51.936 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:42:51.936 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/404) 2024-03-27T12:42:52.553 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:42:52.566 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:42:52.566 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:42:56.493 INFO:teuthology.orchestra.run.smithi057.stdout:generic/404 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2024-03-27T12:42:56.509 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/404 2024-03-27T12:42:56.509 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/404 2024-03-27T12:42:56.509 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:42:56.521 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:42:56.551 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:42:56.551 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/405) 2024-03-27T12:42:57.318 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:42:57.330 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:42:57.330 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:42:57.951 INFO:teuthology.orchestra.run.smithi057.stdout:generic/405 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:42:57.964 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/405 2024-03-27T12:42:57.964 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/405 2024-03-27T12:42:57.964 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:42:57.974 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:42:58.003 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:42:58.004 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/406) 2024-03-27T12:42:58.556 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:42:58.568 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:42:58.568 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:42:58.985 INFO:teuthology.orchestra.run.smithi057.stdout:generic/406 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:42:58.997 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/406 2024-03-27T12:42:58.997 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/406 2024-03-27T12:42:58.997 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:42:59.007 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:42:59.033 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:42:59.034 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/407) 2024-03-27T12:42:59.603 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:42:59.615 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:42:59.615 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:43:00.156 INFO:teuthology.orchestra.run.smithi057.stdout:generic/407 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-03-27T12:43:00.168 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/407 2024-03-27T12:43:00.169 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/407 2024-03-27T12:43:00.169 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:43:00.180 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:43:00.212 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:43:00.212 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/408) 2024-03-27T12:43:00.984 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:43:00.996 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:43:00.996 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:43:01.551 INFO:teuthology.orchestra.run.smithi057.stdout:generic/408 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2024-03-27T12:43:01.563 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/408 2024-03-27T12:43:01.563 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/408 2024-03-27T12:43:01.563 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:43:01.571 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:43:01.599 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:43:01.599 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/409) 2024-03-27T12:43:02.379 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:43:02.389 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:43:02.389 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:43:02.792 INFO:teuthology.orchestra.run.smithi057.stdout:generic/409 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:43:02.803 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/409 2024-03-27T12:43:02.803 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/409 2024-03-27T12:43:02.803 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:43:02.812 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:43:02.842 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:43:02.842 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/410) 2024-03-27T12:43:03.393 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:43:03.406 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:43:03.406 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:43:03.809 INFO:teuthology.orchestra.run.smithi057.stdout:generic/410 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:43:03.821 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/410 2024-03-27T12:43:03.821 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/410 2024-03-27T12:43:03.821 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:43:03.830 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:43:03.857 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:43:03.857 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/411) 2024-03-27T12:43:04.430 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:43:04.444 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:43:04.444 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:43:04.887 INFO:teuthology.orchestra.run.smithi057.stdout:generic/411 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:43:04.901 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/411 2024-03-27T12:43:04.901 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/411 2024-03-27T12:43:04.901 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:43:04.913 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:43:04.940 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:43:04.941 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/412) 2024-03-27T12:43:05.500 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:43:05.511 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:43:05.511 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:43:05.924 INFO:teuthology.orchestra.run.smithi057.stdout:generic/412 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:43:05.934 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/412 2024-03-27T12:43:05.935 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/412 2024-03-27T12:43:05.935 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:43:05.941 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:43:05.964 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:43:05.964 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/413) 2024-03-27T12:43:06.520 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:43:06.533 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:43:06.533 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:43:06.988 INFO:teuthology.orchestra.run.smithi057.stdout:generic/413 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:43:06.999 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/413 2024-03-27T12:43:06.999 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/413 2024-03-27T12:43:06.999 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:43:07.008 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:43:07.040 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:43:07.040 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/414) 2024-03-27T12:43:07.151 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:43:07.157 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:43:07.524 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:43:07.537 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:43:07.538 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:43:07.939 INFO:teuthology.orchestra.run.smithi057.stdout:generic/414 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:43:07.949 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/414 2024-03-27T12:43:07.949 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/414 2024-03-27T12:43:07.950 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:43:07.957 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:43:07.983 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:43:07.983 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/415) 2024-03-27T12:43:08.497 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:43:08.509 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:43:08.509 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:43:08.881 INFO:teuthology.orchestra.run.smithi057.stdout:generic/415 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:43:08.893 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/415 2024-03-27T12:43:08.893 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/415 2024-03-27T12:43:08.893 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:43:08.903 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:43:08.927 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:43:08.928 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/416) 2024-03-27T12:43:09.436 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:43:09.448 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:43:09.448 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:43:09.839 INFO:teuthology.orchestra.run.smithi057.stdout:generic/416 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:43:09.851 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/416 2024-03-27T12:43:09.851 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/416 2024-03-27T12:43:09.851 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:43:09.860 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:43:09.890 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:43:09.891 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/417) 2024-03-27T12:43:10.427 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:43:10.440 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:43:10.440 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:43:10.835 INFO:teuthology.orchestra.run.smithi057.stdout:generic/417 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:43:10.846 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/417 2024-03-27T12:43:10.846 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/417 2024-03-27T12:43:10.846 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:43:10.854 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:43:10.880 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:43:10.881 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/418) 2024-03-27T12:43:11.432 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:43:11.445 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:43:11.445 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:43:11.994 INFO:teuthology.orchestra.run.smithi057.stdout:generic/418 [not run] require ceph-fuse to be valid block disk 2024-03-27T12:43:12.007 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/418 2024-03-27T12:43:12.007 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/418 2024-03-27T12:43:12.007 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:43:12.018 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:43:12.050 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:43:12.051 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/419) 2024-03-27T12:43:12.617 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:43:12.628 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:43:12.628 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:43:13.180 INFO:teuthology.orchestra.run.smithi057.stdout:generic/419 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:43:13.195 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/419 2024-03-27T12:43:13.195 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/419 2024-03-27T12:43:13.196 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:43:13.207 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:43:13.236 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:43:13.237 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/420) 2024-03-27T12:43:13.797 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:43:13.811 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:43:13.811 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:43:17.682 INFO:teuthology.orchestra.run.smithi057.stdout:generic/420 4s 2024-03-27T12:43:17.698 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/420 2024-03-27T12:43:17.698 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:43:17.706 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:43:17.734 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:43:17.735 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/421) 2024-03-27T12:43:18.520 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:43:18.533 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:43:18.533 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:43:19.052 INFO:teuthology.orchestra.run.smithi057.stdout:generic/421 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:43:19.065 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/421 2024-03-27T12:43:19.065 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/421 2024-03-27T12:43:19.065 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:43:19.076 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:43:19.108 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:43:19.108 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/422) 2024-03-27T12:43:19.712 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:43:19.725 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:43:19.725 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:43:20.138 INFO:teuthology.orchestra.run.smithi057.stdout:generic/422 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:43:20.147 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/422 2024-03-27T12:43:20.147 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/422 2024-03-27T12:43:20.147 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:43:20.154 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:43:20.178 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:43:20.178 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/423) 2024-03-27T12:43:20.725 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:43:20.738 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:43:20.739 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:43:21.507 INFO:teuthology.orchestra.run.smithi057.stdout:generic/423 1s 2024-03-27T12:43:21.522 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/423 2024-03-27T12:43:21.522 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:43:21.530 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:43:21.557 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:43:21.558 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/424) 2024-03-27T12:43:22.350 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:43:22.361 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:43:22.361 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:43:22.856 INFO:teuthology.orchestra.run.smithi057.stdout:generic/424 [not run] file system doesn't support any of /bin/chattr +a/+c/+d/+i 2024-03-27T12:43:22.867 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/424 2024-03-27T12:43:22.868 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/424 2024-03-27T12:43:22.868 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:43:22.877 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:43:22.906 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:43:22.906 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/425) 2024-03-27T12:43:23.450 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:43:23.464 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:43:23.464 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:43:23.927 INFO:teuthology.orchestra.run.smithi057.stdout:generic/425 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:43:23.940 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/425 2024-03-27T12:43:23.941 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/425 2024-03-27T12:43:23.941 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:43:23.951 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:43:23.985 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:43:23.985 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/426) 2024-03-27T12:43:24.522 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:43:24.533 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:43:24.533 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:43:37.319 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:43:37.326 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:44:07.449 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:44:07.457 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:44:38.300 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:44:38.309 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:44:47.682 INFO:teuthology.orchestra.run.smithi057.stdout:generic/426 83s 2024-03-27T12:44:47.758 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/426 2024-03-27T12:44:47.758 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:44:47.791 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:44:47.970 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:44:47.970 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/427) 2024-03-27T12:44:49.504 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:44:49.519 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:44:49.519 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:44:50.052 INFO:teuthology.orchestra.run.smithi057.stdout:generic/427 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:44:50.064 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/427 2024-03-27T12:44:50.064 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/427 2024-03-27T12:44:50.065 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:44:50.074 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:44:50.106 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:44:50.107 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/428) 2024-03-27T12:44:50.672 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:44:50.684 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:44:50.684 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:44:51.192 INFO:teuthology.orchestra.run.smithi057.stdout:generic/428 1s 2024-03-27T12:44:51.207 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/428 2024-03-27T12:44:51.208 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:44:51.215 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:44:51.245 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:44:51.245 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/429) 2024-03-27T12:44:51.797 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:44:51.810 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:44:51.810 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:44:52.339 INFO:teuthology.orchestra.run.smithi057.stdout:generic/429 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:44:52.351 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/429 2024-03-27T12:44:52.351 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/429 2024-03-27T12:44:52.351 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:44:52.361 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:44:52.391 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:44:52.391 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/430) 2024-03-27T12:44:52.957 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:44:52.970 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:44:52.970 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:44:53.820 INFO:teuthology.orchestra.run.smithi057.stdout:generic/430 1s 2024-03-27T12:44:53.848 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/430 2024-03-27T12:44:53.849 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:44:53.858 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:44:53.891 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:44:53.891 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/431) 2024-03-27T12:44:54.662 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:44:54.672 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:44:54.672 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:44:55.400 INFO:teuthology.orchestra.run.smithi057.stdout:generic/431 1s 2024-03-27T12:44:55.418 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/431 2024-03-27T12:44:55.418 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:44:55.425 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:44:55.453 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:44:55.454 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/432) 2024-03-27T12:44:56.191 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:44:56.204 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:44:56.204 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:44:56.994 INFO:teuthology.orchestra.run.smithi057.stdout:generic/432 0s 2024-03-27T12:44:57.010 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/432 2024-03-27T12:44:57.010 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:44:57.018 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:44:57.046 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:44:57.046 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/433) 2024-03-27T12:44:57.791 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:44:57.802 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:44:57.802 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:44:58.455 INFO:teuthology.orchestra.run.smithi057.stdout:generic/433 1s 2024-03-27T12:44:58.472 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/433 2024-03-27T12:44:58.472 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:44:58.481 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:44:58.511 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:44:58.512 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/434) 2024-03-27T12:44:59.248 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:44:59.259 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:44:59.259 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:44:59.910 INFO:teuthology.orchestra.run.smithi057.stdout:generic/434 - output mismatch (see /tmp/tmp.446sL8UEHrxfstests-dev/results//generic/434.out.bad) 2024-03-27T12:44:59.916 INFO:teuthology.orchestra.run.smithi057.stdout: --- tests/generic/434.out 2024-03-27 10:01:35.983467985 +0000 2024-03-27T12:44:59.916 INFO:teuthology.orchestra.run.smithi057.stdout: +++ /tmp/tmp.446sL8UEHrxfstests-dev/results//generic/434.out.bad 2024-03-27 12:44:59.906149364 +0000 2024-03-27T12:44:59.916 INFO:teuthology.orchestra.run.smithi057.stdout: @@ -9,6 +9,6 @@ 2024-03-27T12:44:59.916 INFO:teuthology.orchestra.run.smithi057.stdout: copy_range: Bad file descriptor 2024-03-27T12:44:59.916 INFO:teuthology.orchestra.run.smithi057.stdout: d41d8cd98f00b204e9800998ecf8427e TEST_DIR/test-434/copy 2024-03-27T12:44:59.916 INFO:teuthology.orchestra.run.smithi057.stdout: Try to copy to a device 2024-03-27T12:44:59.916 INFO:teuthology.orchestra.run.smithi057.stdout: -copy_range: Invalid argument 2024-03-27T12:44:59.916 INFO:teuthology.orchestra.run.smithi057.stdout: +/tmp/tmp.HFg5N66vC0test/test-434/dev1: Permission denied 2024-03-27T12:44:59.916 INFO:teuthology.orchestra.run.smithi057.stdout: Try to copy to a fifo 2024-03-27T12:44:59.916 INFO:teuthology.orchestra.run.smithi057.stdout: copy_range: Invalid argument 2024-03-27T12:44:59.922 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/434 2024-03-27T12:44:59.922 INFO:teuthology.orchestra.run.smithi057.stdout:Failures: generic/434 2024-03-27T12:44:59.923 INFO:teuthology.orchestra.run.smithi057.stdout:Failed 1 of 1 tests 2024-03-27T12:44:59.931 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:44:59.960 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-27T12:44:59.961 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-03-27T12:44:59.961 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-03-27T12:44:59.961 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/435) 2024-03-27T12:45:00.717 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:45:00.729 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:45:00.729 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:45:01.288 INFO:teuthology.orchestra.run.smithi057.stdout:generic/435 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:45:01.303 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/435 2024-03-27T12:45:01.303 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/435 2024-03-27T12:45:01.304 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:45:01.315 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:45:01.345 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:45:01.345 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/436) 2024-03-27T12:45:01.919 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:45:01.932 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:45:01.932 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:45:04.620 INFO:teuthology.orchestra.run.smithi057.stdout:generic/436 3s 2024-03-27T12:45:04.640 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/436 2024-03-27T12:45:04.640 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:45:04.651 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:45:04.684 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:45:04.684 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/437) 2024-03-27T12:45:05.476 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:45:05.489 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:45:05.489 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:45:06.837 INFO:teuthology.orchestra.run.smithi057.stdout:generic/437 1s 2024-03-27T12:45:06.853 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/437 2024-03-27T12:45:06.853 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:45:06.862 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:45:06.893 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:45:06.893 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/438) 2024-03-27T12:45:07.460 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:45:07.471 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:45:07.471 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:45:09.061 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:45:09.067 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:45:39.775 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:45:39.783 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:46:09.943 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:46:09.951 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:46:40.073 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:46:40.079 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:47:10.219 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:47:10.228 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:47:40.350 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:47:40.357 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:48:10.503 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:48:10.509 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:48:35.225 INFO:teuthology.orchestra.run.smithi057.stdout:generic/438 208s 2024-03-27T12:48:35.243 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/438 2024-03-27T12:48:35.243 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:48:35.252 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:48:35.282 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:48:35.283 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/439) 2024-03-27T12:48:35.847 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:48:35.859 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:48:35.859 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:48:36.268 INFO:teuthology.orchestra.run.smithi057.stdout:generic/439 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:48:36.279 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/439 2024-03-27T12:48:36.279 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/439 2024-03-27T12:48:36.279 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:48:36.287 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:48:36.315 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:48:36.315 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/440) 2024-03-27T12:48:36.845 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:48:36.858 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:48:36.858 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:48:37.381 INFO:teuthology.orchestra.run.smithi057.stdout:generic/440 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:48:37.392 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/440 2024-03-27T12:48:37.392 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/440 2024-03-27T12:48:37.392 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:48:37.402 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:48:37.432 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:48:37.432 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/441) 2024-03-27T12:48:37.982 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:48:37.994 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:48:37.994 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:48:38.517 INFO:teuthology.orchestra.run.smithi057.stdout:generic/441 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:48:38.529 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/441 2024-03-27T12:48:38.529 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/441 2024-03-27T12:48:38.529 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:48:38.539 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:48:38.570 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:48:38.571 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/442) 2024-03-27T12:48:39.108 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:48:39.122 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:48:39.122 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:48:39.623 INFO:teuthology.orchestra.run.smithi057.stdout:generic/442 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:48:39.632 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/442 2024-03-27T12:48:39.633 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/442 2024-03-27T12:48:39.633 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:48:39.640 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:48:39.665 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:48:39.666 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/443) 2024-03-27T12:48:40.238 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:48:40.250 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:48:40.250 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:48:40.653 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:48:40.658 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:48:40.758 INFO:teuthology.orchestra.run.smithi057.stdout:generic/443 0s 2024-03-27T12:48:40.773 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/443 2024-03-27T12:48:40.773 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:48:40.781 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:48:40.807 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:48:40.807 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/444) 2024-03-27T12:48:41.397 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:48:41.409 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:48:41.409 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:48:41.924 INFO:teuthology.orchestra.run.smithi057.stdout:generic/444 [not run] ACLs not supported by this filesystem type: ceph-fuse 2024-03-27T12:48:41.937 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/444 2024-03-27T12:48:41.938 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/444 2024-03-27T12:48:41.938 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:48:41.949 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:48:41.983 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:48:41.983 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/445) 2024-03-27T12:48:42.538 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:48:42.550 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:48:42.551 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:48:45.051 INFO:teuthology.orchestra.run.smithi057.stdout:generic/445 3s 2024-03-27T12:48:45.068 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/445 2024-03-27T12:48:45.068 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:48:45.076 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:48:45.107 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:48:45.108 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/446) 2024-03-27T12:48:45.906 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:48:45.917 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:48:45.917 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:48:46.330 INFO:teuthology.orchestra.run.smithi057.stdout:generic/446 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:48:46.342 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/446 2024-03-27T12:48:46.342 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/446 2024-03-27T12:48:46.342 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:48:46.354 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:48:46.384 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:48:46.384 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/447) 2024-03-27T12:48:46.942 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:48:46.957 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:48:46.957 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:48:47.371 INFO:teuthology.orchestra.run.smithi057.stdout:generic/447 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:48:47.382 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/447 2024-03-27T12:48:47.382 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/447 2024-03-27T12:48:47.382 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:48:47.390 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:48:47.416 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:48:47.417 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/448) 2024-03-27T12:48:47.956 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:48:47.970 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:48:47.970 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:48:50.466 INFO:teuthology.orchestra.run.smithi057.stdout:generic/448 3s 2024-03-27T12:48:50.482 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/448 2024-03-27T12:48:50.483 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:48:50.490 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:48:50.545 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:48:50.545 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/449) 2024-03-27T12:48:51.295 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:48:51.307 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:48:51.307 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:48:51.691 INFO:teuthology.orchestra.run.smithi057.stdout:generic/449 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:48:51.704 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/449 2024-03-27T12:48:51.705 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/449 2024-03-27T12:48:51.705 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:48:51.716 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:48:51.745 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:48:51.745 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/450) 2024-03-27T12:48:52.280 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:48:52.293 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:48:52.293 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:48:55.547 INFO:teuthology.orchestra.run.smithi057.stdout:generic/450 3s 2024-03-27T12:48:55.564 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/450 2024-03-27T12:48:55.564 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:48:55.573 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:48:55.617 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:48:55.618 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/451) 2024-03-27T12:48:56.437 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:48:56.449 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:48:56.449 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:48:57.478 INFO:teuthology.orchestra.run.smithi057.stdout:generic/451 - output mismatch (see /tmp/tmp.446sL8UEHrxfstests-dev/results//generic/451.out.bad) 2024-03-27T12:48:57.484 INFO:teuthology.orchestra.run.smithi057.stdout: --- tests/generic/451.out 2024-03-27 10:01:35.988467902 +0000 2024-03-27T12:48:57.485 INFO:teuthology.orchestra.run.smithi057.stdout: +++ /tmp/tmp.446sL8UEHrxfstests-dev/results//generic/451.out.bad 2024-03-27 12:48:57.477608713 +0000 2024-03-27T12:48:57.485 INFO:teuthology.orchestra.run.smithi057.stdout: @@ -1,2 +1,5 @@ 2024-03-27T12:48:57.485 INFO:teuthology.orchestra.run.smithi057.stdout: QA output created by 451 2024-03-27T12:48:57.485 INFO:teuthology.orchestra.run.smithi057.stdout: +get stale data from buffer read 2024-03-27T12:48:57.485 INFO:teuthology.orchestra.run.smithi057.stdout: +00000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ 2024-03-27T12:48:57.485 INFO:teuthology.orchestra.run.smithi057.stdout: +000a0000 2024-03-27T12:48:57.485 INFO:teuthology.orchestra.run.smithi057.stdout: Silence is golden 2024-03-27T12:48:57.491 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/451 2024-03-27T12:48:57.491 INFO:teuthology.orchestra.run.smithi057.stdout:Failures: generic/451 2024-03-27T12:48:57.491 INFO:teuthology.orchestra.run.smithi057.stdout:Failed 1 of 1 tests 2024-03-27T12:48:57.500 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:48:57.523 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-27T12:48:57.523 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-03-27T12:48:57.524 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-03-27T12:48:57.524 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/452) 2024-03-27T12:48:58.414 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:48:58.431 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:48:58.432 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:48:58.742 INFO:teuthology.orchestra.run.smithi057.stdout:generic/452 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:48:58.752 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/452 2024-03-27T12:48:58.752 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/452 2024-03-27T12:48:58.752 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:48:58.760 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:48:58.787 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:48:58.787 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/453) 2024-03-27T12:48:59.340 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:48:59.353 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:48:59.353 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:48:59.789 INFO:teuthology.orchestra.run.smithi057.stdout:generic/453 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:48:59.800 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/453 2024-03-27T12:48:59.800 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/453 2024-03-27T12:48:59.800 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:48:59.809 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:48:59.840 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:48:59.840 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/454) 2024-03-27T12:49:00.398 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:49:00.411 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:49:00.411 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:49:00.823 INFO:teuthology.orchestra.run.smithi057.stdout:generic/454 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:49:00.835 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/454 2024-03-27T12:49:00.835 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/454 2024-03-27T12:49:00.835 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:49:00.847 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:49:00.879 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:49:00.879 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/455) 2024-03-27T12:49:01.435 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:49:01.448 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:49:01.448 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:49:02.057 INFO:teuthology.orchestra.run.smithi057.stdout:generic/455 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:49:02.069 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/455 2024-03-27T12:49:02.069 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/455 2024-03-27T12:49:02.070 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:49:02.079 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:49:02.111 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:49:02.112 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/456) 2024-03-27T12:49:02.693 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:49:02.705 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:49:02.705 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:49:03.146 INFO:teuthology.orchestra.run.smithi057.stdout:generic/456 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:49:03.157 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/456 2024-03-27T12:49:03.157 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/456 2024-03-27T12:49:03.157 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:49:03.167 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:49:03.198 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:49:03.198 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/457) 2024-03-27T12:49:03.743 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:49:03.755 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:49:03.755 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:49:04.304 INFO:teuthology.orchestra.run.smithi057.stdout:generic/457 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:49:04.317 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/457 2024-03-27T12:49:04.318 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/457 2024-03-27T12:49:04.318 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:49:04.329 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:49:04.369 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:49:04.369 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/458) 2024-03-27T12:49:04.948 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:49:04.959 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:49:04.959 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:49:05.356 INFO:teuthology.orchestra.run.smithi057.stdout:generic/458 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:49:05.367 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/458 2024-03-27T12:49:05.367 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/458 2024-03-27T12:49:05.367 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:49:05.376 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:49:05.406 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:49:05.406 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/459) 2024-03-27T12:49:05.961 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:49:05.975 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:49:05.975 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:49:06.625 INFO:teuthology.orchestra.run.smithi057.stdout:generic/459 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:49:06.636 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/459 2024-03-27T12:49:06.637 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/459 2024-03-27T12:49:06.637 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:49:06.646 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:49:06.676 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:49:06.676 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/460) 2024-03-27T12:49:07.231 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:49:07.243 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:49:07.243 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:49:07.650 INFO:teuthology.orchestra.run.smithi057.stdout:generic/460 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:49:07.661 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/460 2024-03-27T12:49:07.661 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/460 2024-03-27T12:49:07.661 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:49:07.670 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:49:07.699 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:49:07.699 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/461) 2024-03-27T12:49:08.278 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:49:08.292 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:49:08.292 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:49:08.727 INFO:teuthology.orchestra.run.smithi057.stdout:generic/461 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:49:08.738 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/461 2024-03-27T12:49:08.738 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/461 2024-03-27T12:49:08.739 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:49:08.749 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:49:08.781 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:49:08.782 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/462) 2024-03-27T12:49:09.345 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:49:09.357 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:49:09.357 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:49:09.763 INFO:teuthology.orchestra.run.smithi057.stdout:generic/462 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:49:09.777 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/462 2024-03-27T12:49:09.777 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/462 2024-03-27T12:49:09.777 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:49:09.787 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:49:09.813 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:49:09.814 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/463) 2024-03-27T12:49:10.379 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:49:10.393 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:49:10.393 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:49:10.771 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:49:10.776 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:49:10.945 INFO:teuthology.orchestra.run.smithi057.stdout:generic/463 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-03-27T12:49:10.956 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/463 2024-03-27T12:49:10.956 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/463 2024-03-27T12:49:10.956 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:49:10.964 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:49:10.993 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:49:10.993 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/464) 2024-03-27T12:49:11.759 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:49:11.770 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:49:11.771 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:49:12.176 INFO:teuthology.orchestra.run.smithi057.stdout:generic/464 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:49:12.187 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/464 2024-03-27T12:49:12.188 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/464 2024-03-27T12:49:12.188 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:49:12.196 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:49:12.225 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:49:12.226 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/465) 2024-03-27T12:49:12.740 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:49:12.753 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:49:12.753 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:49:41.195 INFO:teuthology.orchestra.run.smithi057.stdout:generic/465 29s 2024-03-27T12:49:41.236 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/465 2024-03-27T12:49:41.236 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:49:41.270 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:49:41.285 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:49:41.298 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:49:41.331 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:49:41.331 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/466) 2024-03-27T12:49:42.054 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:49:42.064 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:49:42.064 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:49:42.453 INFO:teuthology.orchestra.run.smithi057.stdout:generic/466 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:49:42.468 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/466 2024-03-27T12:49:42.469 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/466 2024-03-27T12:49:42.469 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:49:42.478 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:49:42.511 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:49:42.511 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/467) 2024-03-27T12:49:43.067 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:49:43.079 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:49:43.079 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:49:52.296 INFO:teuthology.orchestra.run.smithi057.stdout:generic/467 - output mismatch (see /tmp/tmp.446sL8UEHrxfstests-dev/results//generic/467.out.bad) 2024-03-27T12:49:52.319 INFO:teuthology.orchestra.run.smithi057.stdout: --- tests/generic/467.out 2024-03-27 10:01:35.993467819 +0000 2024-03-27T12:49:52.319 INFO:teuthology.orchestra.run.smithi057.stdout: +++ /tmp/tmp.446sL8UEHrxfstests-dev/results//generic/467.out.bad 2024-03-27 12:49:52.289785750 +0000 2024-03-27T12:49:52.319 INFO:teuthology.orchestra.run.smithi057.stdout: @@ -1,5 +1,15 @@ 2024-03-27T12:49:52.320 INFO:teuthology.orchestra.run.smithi057.stdout: QA output created by 467 2024-03-27T12:49:52.320 INFO:teuthology.orchestra.run.smithi057.stdout: test_file_handles TEST_DIR/467-dir -dp 2024-03-27T12:49:52.320 INFO:teuthology.orchestra.run.smithi057.stdout: +open_by_handle(/tmp/tmp.HFg5N66vC0test/467-dir/file000000) opened an unlinked file! 2024-03-27T12:49:52.320 INFO:teuthology.orchestra.run.smithi057.stdout: +open_by_handle(/tmp/tmp.HFg5N66vC0test/467-dir/file000001) opened an unlinked file! 2024-03-27T12:49:52.320 INFO:teuthology.orchestra.run.smithi057.stdout: +open_by_handle(/tmp/tmp.HFg5N66vC0test/467-dir/file000002) opened an unlinked file! 2024-03-27T12:49:52.320 INFO:teuthology.orchestra.run.smithi057.stdout: +open_by_handle(/tmp/tmp.HFg5N66vC0test/467-dir/file000003) opened an unlinked file! 2024-03-27T12:49:52.320 INFO:teuthology.orchestra.run.smithi057.stdout: +open_by_handle(/tmp/tmp.HFg5N66vC0test/467-dir/file000004) opened an unlinked file! 2024-03-27T12:49:52.320 INFO:teuthology.orchestra.run.smithi057.stdout: +open_by_handle(/tmp/tmp.HFg5N66vC0test/467-dir/file000005) opened an unlinked file! 2024-03-27T12:49:52.320 INFO:teuthology.orchestra.run.smithi057.stdout: +open_by_handle(/tmp/tmp.HFg5N66vC0test/467-dir/file000006) opened an unlinked file! 2024-03-27T12:49:52.320 INFO:teuthology.orchestra.run.smithi057.stdout: +open_by_handle(/tmp/tmp.HFg5N66vC0test/467-dir/file000007) opened an unlinked file! 2024-03-27T12:49:52.320 INFO:teuthology.orchestra.run.smithi057.stdout: +open_by_handle(/tmp/tmp.HFg5N66vC0test/467-dir/file000008) opened an unlinked file! 2024-03-27T12:49:52.320 INFO:teuthology.orchestra.run.smithi057.stdout: +open_by_handle(/tmp/tmp.HFg5N66vC0test/467-dir/file000009) opened an unlinked file! 2024-03-27T12:49:52.320 INFO:teuthology.orchestra.run.smithi057.stdout: test_file_handles TEST_DIR/467-dir -rp 2024-03-27T12:49:52.320 INFO:teuthology.orchestra.run.smithi057.stdout: test_file_handles TEST_DIR/467-dir -dkr 2024-03-27T12:49:52.321 INFO:teuthology.orchestra.run.smithi057.stdout: test_file_handles TEST_DIR/467-dir -lr 2024-03-27T12:49:52.360 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/467 2024-03-27T12:49:52.360 INFO:teuthology.orchestra.run.smithi057.stdout:Failures: generic/467 2024-03-27T12:49:52.360 INFO:teuthology.orchestra.run.smithi057.stdout:Failed 1 of 1 tests 2024-03-27T12:49:52.413 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:49:52.600 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-27T12:49:52.600 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-03-27T12:49:52.600 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-03-27T12:49:52.601 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/468) 2024-03-27T12:49:54.268 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:49:54.282 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:49:54.282 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:49:54.882 INFO:teuthology.orchestra.run.smithi057.stdout:generic/468 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:49:54.894 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/468 2024-03-27T12:49:54.894 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/468 2024-03-27T12:49:54.894 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:49:54.903 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:49:54.934 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:49:54.934 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/469) 2024-03-27T12:49:55.542 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:49:55.554 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:49:55.554 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:50:01.601 INFO:teuthology.orchestra.run.smithi057.stdout:generic/469 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-03-27T12:50:01.612 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/469 2024-03-27T12:50:01.612 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/469 2024-03-27T12:50:01.612 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:50:01.620 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:50:01.646 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:50:01.646 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/470) 2024-03-27T12:50:02.442 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:50:02.454 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:50:02.454 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:50:02.964 INFO:teuthology.orchestra.run.smithi057.stdout:generic/470 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:50:02.976 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/470 2024-03-27T12:50:02.976 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/470 2024-03-27T12:50:02.976 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:50:02.986 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:50:03.018 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:50:03.019 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/471) 2024-03-27T12:50:03.590 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:50:03.604 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:50:03.604 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:50:11.588 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:50:11.596 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:50:41.763 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:50:41.772 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:50:41.899 INFO:tasks.ceph.mds.a.smithi057.stderr:2024-03-27T12:50:41.903+0000 7f0ffc400640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 409071) UID: 0 2024-03-27T12:50:41.899 INFO:tasks.ceph.mds.c.smithi057.stderr:2024-03-27T12:50:41.903+0000 7f1f8ba00640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 409071) UID: 0 2024-03-27T12:52:03.244 INFO:teuthology.orchestra.run.smithi057.stdout:generic/471 120s 2024-03-27T12:52:03.264 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/471 2024-03-27T12:52:03.264 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:52:03.273 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:52:03.302 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:52:03.303 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/472) 2024-03-27T12:52:04.460 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:52:04.470 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:52:04.470 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:52:05.401 INFO:teuthology.orchestra.run.smithi057.stdout:generic/472 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:52:05.430 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/472 2024-03-27T12:52:05.430 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/472 2024-03-27T12:52:05.430 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:52:05.448 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:52:05.502 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:52:05.502 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/473) 2024-03-27T12:52:06.072 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:52:06.083 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:52:06.084 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:52:06.563 INFO:teuthology.orchestra.run.smithi057.stdout:generic/473 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-03-27T12:52:06.575 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/473 2024-03-27T12:52:06.575 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/473 2024-03-27T12:52:06.575 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:52:06.583 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:52:06.611 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:52:06.611 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/474) 2024-03-27T12:52:07.110 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:52:07.121 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:52:07.121 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:52:07.514 INFO:teuthology.orchestra.run.smithi057.stdout:generic/474 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:52:07.523 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/474 2024-03-27T12:52:07.523 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/474 2024-03-27T12:52:07.523 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:52:07.530 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:52:07.555 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:52:07.555 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/475) 2024-03-27T12:52:08.076 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:52:08.086 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:52:08.086 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:52:08.507 INFO:teuthology.orchestra.run.smithi057.stdout:generic/475 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:52:08.518 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/475 2024-03-27T12:52:08.518 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/475 2024-03-27T12:52:08.518 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:52:08.526 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:52:08.556 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:52:08.556 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/476) 2024-03-27T12:52:09.080 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:52:09.089 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:52:09.089 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:52:09.457 INFO:teuthology.orchestra.run.smithi057.stdout:generic/476 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:52:09.469 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/476 2024-03-27T12:52:09.469 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/476 2024-03-27T12:52:09.469 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:52:09.477 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:52:09.501 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:52:09.501 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/477) 2024-03-27T12:52:10.028 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:52:10.039 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:52:10.039 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:52:27.665 INFO:teuthology.orchestra.run.smithi057.stdout:generic/477 17s 2024-03-27T12:52:27.826 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/477 2024-03-27T12:52:27.826 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:52:27.854 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:52:28.005 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:52:28.005 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/478) 2024-03-27T12:52:30.869 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:52:30.881 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:52:30.881 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:52:42.979 INFO:teuthology.orchestra.run.smithi057.stdout:generic/478 - output mismatch (see /tmp/tmp.446sL8UEHrxfstests-dev/results//generic/478.out.bad) 2024-03-27T12:52:42.985 INFO:teuthology.orchestra.run.smithi057.stdout: --- tests/generic/478.out 2024-03-27 10:01:35.996467769 +0000 2024-03-27T12:52:42.985 INFO:teuthology.orchestra.run.smithi057.stdout: +++ /tmp/tmp.446sL8UEHrxfstests-dev/results//generic/478.out.bad 2024-03-27 12:52:42.977213312 +0000 2024-03-27T12:52:42.986 INFO:teuthology.orchestra.run.smithi057.stdout: @@ -10,7 +10,7 @@ 2024-03-27T12:52:42.986 INFO:teuthology.orchestra.run.smithi057.stdout: lock could be placed 2024-03-27T12:52:42.986 INFO:teuthology.orchestra.run.smithi057.stdout: get wrlck 2024-03-27T12:52:42.986 INFO:teuthology.orchestra.run.smithi057.stdout: lock could be placed 2024-03-27T12:52:42.986 INFO:teuthology.orchestra.run.smithi057.stdout: -lock could be placed 2024-03-27T12:52:42.986 INFO:teuthology.orchestra.run.smithi057.stdout: +get wrlck 2024-03-27T12:52:42.986 INFO:teuthology.orchestra.run.smithi057.stdout: lock could be placed 2024-03-27T12:52:42.986 INFO:teuthology.orchestra.run.smithi057.stdout: lock could be placed 2024-03-27T12:52:42.986 INFO:teuthology.orchestra.run.smithi057.stdout: lock could be placed 2024-03-27T12:52:42.986 INFO:teuthology.orchestra.run.smithi057.stdout: @@ -25,7 +25,7 @@ 2024-03-27T12:52:42.986 INFO:teuthology.orchestra.run.smithi057.stdout: lock could be placed 2024-03-27T12:52:42.986 INFO:teuthology.orchestra.run.smithi057.stdout: get wrlck 2024-03-27T12:52:42.986 INFO:teuthology.orchestra.run.smithi057.stdout: lock could be placed 2024-03-27T12:52:42.987 INFO:teuthology.orchestra.run.smithi057.stdout: -lock could be placed 2024-03-27T12:52:42.987 INFO:teuthology.orchestra.run.smithi057.stdout: +get wrlck 2024-03-27T12:52:42.987 INFO:teuthology.orchestra.run.smithi057.stdout: lock could be placed 2024-03-27T12:52:42.987 INFO:teuthology.orchestra.run.smithi057.stdout: lock could be placed 2024-03-27T12:52:42.987 INFO:teuthology.orchestra.run.smithi057.stdout: lock could be placed 2024-03-27T12:52:42.987 INFO:teuthology.orchestra.run.smithi057.stdout: @@ -37,7 +37,7 @@ 2024-03-27T12:52:42.987 INFO:teuthology.orchestra.run.smithi057.stdout: get rdlck 2024-03-27T12:52:42.987 INFO:teuthology.orchestra.run.smithi057.stdout: get rdlck 2024-03-27T12:52:42.987 INFO:teuthology.orchestra.run.smithi057.stdout: lock could be placed 2024-03-27T12:52:42.987 INFO:teuthology.orchestra.run.smithi057.stdout: -lock could be placed 2024-03-27T12:52:42.987 INFO:teuthology.orchestra.run.smithi057.stdout: +get rdlck 2024-03-27T12:52:42.987 INFO:teuthology.orchestra.run.smithi057.stdout: get rdlck 2024-03-27T12:52:42.987 INFO:teuthology.orchestra.run.smithi057.stdout: lock could be placed 2024-03-27T12:52:42.987 INFO:teuthology.orchestra.run.smithi057.stdout: get rdlck 2024-03-27T12:52:42.988 INFO:teuthology.orchestra.run.smithi057.stdout: @@ -46,7 +46,7 @@ 2024-03-27T12:52:42.988 INFO:teuthology.orchestra.run.smithi057.stdout: get rdlck 2024-03-27T12:52:42.988 INFO:teuthology.orchestra.run.smithi057.stdout: get rdlck 2024-03-27T12:52:42.988 INFO:teuthology.orchestra.run.smithi057.stdout: lock could be placed 2024-03-27T12:52:42.988 INFO:teuthology.orchestra.run.smithi057.stdout: -lock could be placed 2024-03-27T12:52:42.988 INFO:teuthology.orchestra.run.smithi057.stdout: +get rdlck 2024-03-27T12:52:42.988 INFO:teuthology.orchestra.run.smithi057.stdout: lock could be placed 2024-03-27T12:52:42.988 INFO:teuthology.orchestra.run.smithi057.stdout: lock could be placed 2024-03-27T12:52:42.988 INFO:teuthology.orchestra.run.smithi057.stdout: lock could be placed 2024-03-27T12:52:42.992 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/478 2024-03-27T12:52:42.992 INFO:teuthology.orchestra.run.smithi057.stdout:Failures: generic/478 2024-03-27T12:52:42.992 INFO:teuthology.orchestra.run.smithi057.stdout:Failed 1 of 1 tests 2024-03-27T12:52:42.999 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:52:43.024 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-27T12:52:43.024 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-03-27T12:52:43.024 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-03-27T12:52:43.025 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/479) 2024-03-27T12:52:43.538 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:52:43.550 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:52:43.550 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:52:44.082 INFO:teuthology.orchestra.run.smithi057.stdout:generic/479 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:52:44.093 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/479 2024-03-27T12:52:44.093 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/479 2024-03-27T12:52:44.093 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:52:44.102 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:52:44.131 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:52:44.131 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/480) 2024-03-27T12:52:44.682 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:52:44.693 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:52:44.694 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:52:45.124 INFO:teuthology.orchestra.run.smithi057.stdout:generic/480 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:52:45.135 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/480 2024-03-27T12:52:45.135 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/480 2024-03-27T12:52:45.135 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:52:45.144 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:52:45.171 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:52:45.171 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/481) 2024-03-27T12:52:45.668 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:52:45.679 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:52:45.679 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:52:46.089 INFO:teuthology.orchestra.run.smithi057.stdout:generic/481 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:52:46.101 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/481 2024-03-27T12:52:46.101 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/481 2024-03-27T12:52:46.101 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:52:46.111 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:52:46.137 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:52:46.137 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/482) 2024-03-27T12:52:46.673 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:52:46.685 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:52:46.685 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:52:47.220 INFO:teuthology.orchestra.run.smithi057.stdout:generic/482 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:52:47.234 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/482 2024-03-27T12:52:47.234 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/482 2024-03-27T12:52:47.234 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:52:47.243 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:52:47.271 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:52:47.271 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/483) 2024-03-27T12:52:47.780 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:52:47.790 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:52:47.791 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:52:48.173 INFO:teuthology.orchestra.run.smithi057.stdout:generic/483 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:52:48.185 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/483 2024-03-27T12:52:48.185 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/483 2024-03-27T12:52:48.185 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:52:48.195 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:52:48.223 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:52:48.223 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/484) 2024-03-27T12:52:48.703 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:52:48.714 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:52:48.714 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:52:49.216 INFO:teuthology.orchestra.run.smithi057.stdout:generic/484 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:52:49.230 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/484 2024-03-27T12:52:49.230 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/484 2024-03-27T12:52:49.231 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:52:49.242 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:52:49.273 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:52:49.273 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/485) 2024-03-27T12:52:49.786 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:52:49.797 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:52:49.797 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:52:52.905 INFO:teuthology.orchestra.run.smithi057.stdout:generic/485 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2024-03-27T12:52:52.916 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/485 2024-03-27T12:52:52.916 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/485 2024-03-27T12:52:52.916 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:52:52.924 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:52:52.952 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:52:52.952 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/486) 2024-03-27T12:52:53.717 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:52:53.729 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:52:53.729 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:52:54.149 INFO:teuthology.orchestra.run.smithi057.stdout:generic/486 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:52:54.158 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/486 2024-03-27T12:52:54.158 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/486 2024-03-27T12:52:54.158 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:52:54.165 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:52:54.189 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:52:54.189 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/487) 2024-03-27T12:52:54.704 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:52:54.714 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:52:54.714 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:52:55.166 INFO:teuthology.orchestra.run.smithi057.stdout:generic/487 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:52:55.177 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/487 2024-03-27T12:52:55.177 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/487 2024-03-27T12:52:55.177 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:52:55.188 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:52:55.218 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:52:55.219 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/488) 2024-03-27T12:52:55.726 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:52:55.736 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:52:55.736 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:52:56.156 INFO:teuthology.orchestra.run.smithi057.stdout:generic/488 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:52:56.167 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/488 2024-03-27T12:52:56.167 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/488 2024-03-27T12:52:56.167 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:52:56.176 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:52:56.205 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:52:56.206 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/489) 2024-03-27T12:52:56.706 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:52:56.717 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:52:56.717 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:52:57.106 INFO:teuthology.orchestra.run.smithi057.stdout:generic/489 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:52:57.117 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/489 2024-03-27T12:52:57.117 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/489 2024-03-27T12:52:57.117 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:52:57.126 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:52:57.155 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:52:57.156 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/490) 2024-03-27T12:52:57.815 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:52:57.827 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:52:57.827 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:53:00.254 INFO:teuthology.orchestra.run.smithi057.stdout:generic/490 3s 2024-03-27T12:53:00.273 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/490 2024-03-27T12:53:00.273 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:53:00.281 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:53:00.307 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:53:00.308 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/491) 2024-03-27T12:53:01.128 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:53:01.139 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:53:01.139 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:53:01.560 INFO:teuthology.orchestra.run.smithi057.stdout:generic/491 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:53:01.571 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/491 2024-03-27T12:53:01.571 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/491 2024-03-27T12:53:01.571 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:53:01.580 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:53:01.609 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:53:01.609 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/492) 2024-03-27T12:53:02.094 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:53:02.106 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:53:02.106 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:53:02.482 INFO:teuthology.orchestra.run.smithi057.stdout:generic/492 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:53:02.495 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/492 2024-03-27T12:53:02.495 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/492 2024-03-27T12:53:02.495 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:53:02.504 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:53:02.533 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:53:02.534 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/493) 2024-03-27T12:53:03.040 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:53:03.053 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:53:03.053 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:53:03.433 INFO:teuthology.orchestra.run.smithi057.stdout:generic/493 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:53:03.445 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/493 2024-03-27T12:53:03.445 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/493 2024-03-27T12:53:03.445 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:53:03.454 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:53:03.481 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:53:03.481 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/494) 2024-03-27T12:53:04.040 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:53:04.049 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:53:04.049 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:53:04.421 INFO:teuthology.orchestra.run.smithi057.stdout:generic/494 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:53:04.430 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/494 2024-03-27T12:53:04.430 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/494 2024-03-27T12:53:04.430 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:53:04.438 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:53:04.464 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:53:04.465 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/495) 2024-03-27T12:53:05.028 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:53:05.038 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:53:05.038 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:53:05.420 INFO:teuthology.orchestra.run.smithi057.stdout:generic/495 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:53:05.432 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/495 2024-03-27T12:53:05.432 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/495 2024-03-27T12:53:05.432 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:53:05.444 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:53:05.471 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:53:05.472 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/496) 2024-03-27T12:53:06.017 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:53:06.028 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:53:06.028 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:53:06.425 INFO:teuthology.orchestra.run.smithi057.stdout:generic/496 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:53:06.437 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/496 2024-03-27T12:53:06.437 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/496 2024-03-27T12:53:06.437 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:53:06.445 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:53:06.475 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:53:06.476 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/497) 2024-03-27T12:53:07.023 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:53:07.035 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:53:07.035 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:53:07.419 INFO:teuthology.orchestra.run.smithi057.stdout:generic/497 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:53:07.432 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/497 2024-03-27T12:53:07.432 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/497 2024-03-27T12:53:07.433 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:53:07.444 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:53:07.473 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:53:07.473 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/498) 2024-03-27T12:53:07.969 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:53:07.980 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:53:07.980 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:53:08.389 INFO:teuthology.orchestra.run.smithi057.stdout:generic/498 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:53:08.399 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/498 2024-03-27T12:53:08.399 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/498 2024-03-27T12:53:08.399 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:53:08.407 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:53:08.434 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:53:08.435 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/499) 2024-03-27T12:53:08.914 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:53:08.925 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:53:08.925 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:53:09.290 INFO:teuthology.orchestra.run.smithi057.stdout:generic/499 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:53:09.301 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/499 2024-03-27T12:53:09.301 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/499 2024-03-27T12:53:09.301 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:53:09.310 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:53:09.337 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:53:09.337 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/500) 2024-03-27T12:53:09.836 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:53:09.847 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:53:09.847 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:53:10.275 INFO:teuthology.orchestra.run.smithi057.stdout:generic/500 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:53:10.287 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/500 2024-03-27T12:53:10.287 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/500 2024-03-27T12:53:10.287 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:53:10.296 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:53:10.325 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:53:10.325 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/501) 2024-03-27T12:53:10.806 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:53:10.817 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:53:10.817 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:53:11.221 INFO:teuthology.orchestra.run.smithi057.stdout:generic/501 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:53:11.397 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/501 2024-03-27T12:53:11.398 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/501 2024-03-27T12:53:11.398 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:53:11.398 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:53:11.398 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:53:11.398 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/502) 2024-03-27T12:53:11.940 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:53:11.952 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:53:11.952 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:53:12.360 INFO:teuthology.orchestra.run.smithi057.stdout:generic/502 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:53:12.371 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/502 2024-03-27T12:53:12.371 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/502 2024-03-27T12:53:12.371 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:53:12.380 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:53:12.409 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:53:12.409 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/503) 2024-03-27T12:53:12.966 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:53:12.977 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:53:12.977 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:53:13.392 INFO:teuthology.orchestra.run.smithi057.stdout:generic/503 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:53:13.403 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/503 2024-03-27T12:53:13.403 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/503 2024-03-27T12:53:13.403 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:53:13.410 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:53:13.438 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:53:13.438 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/504) 2024-03-27T12:53:13.896 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:53:13.907 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:53:13.907 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:53:14.439 INFO:teuthology.orchestra.run.smithi057.stdout:generic/504 - output mismatch (see /tmp/tmp.446sL8UEHrxfstests-dev/results//generic/504.out.bad) 2024-03-27T12:53:14.446 INFO:teuthology.orchestra.run.smithi057.stdout: --- tests/generic/504.out 2024-03-27 10:01:36.003467652 +0000 2024-03-27T12:53:14.446 INFO:teuthology.orchestra.run.smithi057.stdout: +++ /tmp/tmp.446sL8UEHrxfstests-dev/results//generic/504.out.bad 2024-03-27 12:53:14.440740925 +0000 2024-03-27T12:53:14.446 INFO:teuthology.orchestra.run.smithi057.stdout: @@ -1,2 +1,3 @@ 2024-03-27T12:53:14.446 INFO:teuthology.orchestra.run.smithi057.stdout: QA output created by 504 2024-03-27T12:53:14.446 INFO:teuthology.orchestra.run.smithi057.stdout: +lock info not found 2024-03-27T12:53:14.446 INFO:teuthology.orchestra.run.smithi057.stdout: Silence is golden 2024-03-27T12:53:14.453 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/504 2024-03-27T12:53:14.453 INFO:teuthology.orchestra.run.smithi057.stdout:Failures: generic/504 2024-03-27T12:53:14.453 INFO:teuthology.orchestra.run.smithi057.stdout:Failed 1 of 1 tests 2024-03-27T12:53:14.460 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:53:14.485 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-27T12:53:14.486 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-03-27T12:53:14.486 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-03-27T12:53:14.486 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/505) 2024-03-27T12:53:14.992 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:53:15.003 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:53:15.003 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:53:15.387 INFO:teuthology.orchestra.run.smithi057.stdout:generic/505 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:53:15.397 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/505 2024-03-27T12:53:15.397 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/505 2024-03-27T12:53:15.397 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:53:15.405 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:53:15.431 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:53:15.432 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/506) 2024-03-27T12:53:15.929 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:53:15.941 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:53:15.941 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:53:16.340 INFO:teuthology.orchestra.run.smithi057.stdout:generic/506 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:53:16.346 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/506 2024-03-27T12:53:16.350 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/506 2024-03-27T12:53:16.350 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:53:16.354 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:53:16.387 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:53:16.387 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/507) 2024-03-27T12:53:16.885 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:53:16.896 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:53:16.897 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:53:17.349 INFO:teuthology.orchestra.run.smithi057.stdout:generic/507 [not run] file system doesn't support chattr +ASai 2024-03-27T12:53:17.358 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/507 2024-03-27T12:53:17.358 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/507 2024-03-27T12:53:17.358 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:53:17.365 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:53:17.389 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:53:17.390 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/508) 2024-03-27T12:53:17.944 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:53:17.954 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:53:17.954 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:53:18.327 INFO:teuthology.orchestra.run.smithi057.stdout:generic/508 [not run] lsattr not supported by test filesystem type: ceph-fuse 2024-03-27T12:53:18.337 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/508 2024-03-27T12:53:18.338 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/508 2024-03-27T12:53:18.338 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:53:18.346 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:53:18.373 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:53:18.373 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/509) 2024-03-27T12:53:18.834 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:53:18.845 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:53:18.845 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:53:19.251 INFO:teuthology.orchestra.run.smithi057.stdout:generic/509 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:53:19.260 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/509 2024-03-27T12:53:19.261 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/509 2024-03-27T12:53:19.261 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:53:19.268 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:53:19.293 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:53:19.293 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/510) 2024-03-27T12:53:19.829 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:53:19.841 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:53:19.841 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:53:20.316 INFO:teuthology.orchestra.run.smithi057.stdout:generic/510 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:53:20.327 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/510 2024-03-27T12:53:20.327 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/510 2024-03-27T12:53:20.327 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:53:20.335 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:53:20.362 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:53:20.362 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/511) 2024-03-27T12:53:20.830 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:53:20.841 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:53:20.841 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:53:21.226 INFO:teuthology.orchestra.run.smithi057.stdout:generic/511 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:53:21.236 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/511 2024-03-27T12:53:21.237 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/511 2024-03-27T12:53:21.237 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:53:21.244 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:53:21.270 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:53:21.271 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/512) 2024-03-27T12:53:21.762 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:53:21.773 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:53:21.773 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:53:22.165 INFO:teuthology.orchestra.run.smithi057.stdout:generic/512 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:53:22.175 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/512 2024-03-27T12:53:22.175 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/512 2024-03-27T12:53:22.175 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:53:22.182 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:53:22.207 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:53:22.208 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/513) 2024-03-27T12:53:22.753 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:53:22.765 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:53:22.765 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:53:23.130 INFO:teuthology.orchestra.run.smithi057.stdout:generic/513 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:53:23.140 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/513 2024-03-27T12:53:23.140 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/513 2024-03-27T12:53:23.140 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:53:23.147 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:53:23.174 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:53:23.174 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/514) 2024-03-27T12:53:23.677 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:53:23.688 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:53:23.688 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:53:24.053 INFO:teuthology.orchestra.run.smithi057.stdout:generic/514 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:53:24.063 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/514 2024-03-27T12:53:24.063 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/514 2024-03-27T12:53:24.064 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:53:24.074 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:53:24.102 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:53:24.103 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/515) 2024-03-27T12:53:24.664 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:53:24.676 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:53:24.676 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:53:25.063 INFO:teuthology.orchestra.run.smithi057.stdout:generic/515 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:53:25.072 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/515 2024-03-27T12:53:25.072 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/515 2024-03-27T12:53:25.073 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:53:25.079 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:53:25.103 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:53:25.104 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/516) 2024-03-27T12:53:25.597 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:53:25.609 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:53:25.609 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:53:26.124 INFO:teuthology.orchestra.run.smithi057.stdout:generic/516 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2024-03-27T12:53:26.134 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/516 2024-03-27T12:53:26.135 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/516 2024-03-27T12:53:26.135 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:53:26.143 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:53:26.179 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:53:26.179 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/517) 2024-03-27T12:53:26.985 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:53:26.996 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:53:26.996 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:53:27.383 INFO:teuthology.orchestra.run.smithi057.stdout:generic/517 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:53:27.393 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/517 2024-03-27T12:53:27.393 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/517 2024-03-27T12:53:27.393 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:53:27.401 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:53:27.428 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:53:27.428 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/518) 2024-03-27T12:53:27.935 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:53:27.948 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:53:27.948 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:53:28.366 INFO:teuthology.orchestra.run.smithi057.stdout:generic/518 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:53:28.374 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/518 2024-03-27T12:53:28.374 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/518 2024-03-27T12:53:28.374 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:53:28.381 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:53:28.407 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:53:28.408 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/519) 2024-03-27T12:53:28.938 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:53:28.950 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:53:28.950 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:53:29.358 INFO:teuthology.orchestra.run.smithi057.stdout:generic/519 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:53:29.372 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/519 2024-03-27T12:53:29.372 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/519 2024-03-27T12:53:29.372 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:53:29.384 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:53:29.416 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:53:29.416 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/520) 2024-03-27T12:53:29.926 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:53:29.938 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:53:29.938 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:53:30.533 INFO:teuthology.orchestra.run.smithi057.stdout:generic/520 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T12:53:30.544 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/520 2024-03-27T12:53:30.544 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/520 2024-03-27T12:53:30.544 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T12:53:30.552 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:53:30.579 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T12:53:30.579 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/521) 2024-03-27T12:53:31.137 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T12:53:31.149 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T12:53:31.149 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T12:54:29.935 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:54:29.944 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:55:00.147 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:55:00.156 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:55:30.294 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:55:30.302 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:56:00.431 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:56:00.441 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:56:30.569 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:56:30.578 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:57:00.708 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:57:00.716 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T12:57:00.814 INFO:tasks.ceph.osd.1.smithi057.stderr:2024-03-27T12:57:00.819+0000 7f8202600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 431994) UID: 0 2024-03-27T12:57:00.815 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-03-27T12:57:00.819+0000 7f622b800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 431994) UID: 0 2024-03-27T12:57:00.815 INFO:tasks.ceph.osd.2.smithi057.stderr:2024-03-27T12:57:00.819+0000 7f1380800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 431994) UID: 0 2024-03-27T12:57:00.815 INFO:tasks.ceph.osd.3.smithi057.stderr:2024-03-27T12:57:00.819+0000 7f009f600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 431994) UID: 0 2024-03-27T13:00:23.756 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:00:23.766 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:00:23.874 INFO:tasks.ceph.osd.5.smithi118.stderr:2024-03-27T13:00:23.881+0000 7fa84c200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47900) UID: 0 2024-03-27T13:00:23.875 INFO:tasks.ceph.osd.7.smithi118.stderr:2024-03-27T13:00:23.881+0000 7fdba0200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47900) UID: 0 2024-03-27T13:00:23.875 INFO:tasks.ceph.osd.4.smithi118.stderr:2024-03-27T13:00:23.881+0000 7f3737600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47900) UID: 0 2024-03-27T13:00:23.875 INFO:tasks.ceph.osd.6.smithi118.stderr:2024-03-27T13:00:23.881+0000 7efe94a00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47900) UID: 0 2024-03-27T13:03:22.749 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:03:22.760 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:03:52.892 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:03:52.902 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:04:23.030 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:04:23.039 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:04:53.160 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:04:53.169 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:05:23.306 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:05:23.315 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:05:53.439 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:05:53.448 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:06:23.602 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:06:23.611 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:06:53.740 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:06:53.750 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:07:23.878 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:07:23.887 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:07:54.012 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:07:54.020 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:08:24.147 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:08:24.156 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:08:54.285 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:08:54.295 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:09:24.450 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:09:24.461 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:09:54.589 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:09:54.599 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:10:24.728 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:10:24.735 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:10:54.867 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:10:54.877 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:11:25.214 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:11:25.224 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:11:55.359 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:11:55.367 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:12:25.523 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:12:25.532 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:12:55.666 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:12:55.675 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:13:25.800 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:13:25.808 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:13:55.922 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:13:55.931 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:14:26.061 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:14:26.070 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:14:56.227 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:14:56.236 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:15:26.565 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:15:26.574 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:15:56.695 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:15:56.705 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:16:26.826 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:16:26.838 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:16:56.967 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:16:56.975 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:17:27.101 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:17:27.110 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:17:57.270 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:17:57.279 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:18:27.446 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:18:27.455 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:18:57.576 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:18:57.587 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:19:27.840 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:19:27.853 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:19:57.978 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:19:57.986 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:20:28.107 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:20:28.118 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:20:58.268 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:20:58.280 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:21:28.429 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:21:28.438 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:21:58.574 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:21:58.583 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:22:28.721 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:22:28.733 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:22:58.853 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:22:58.864 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:23:29.011 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:23:29.021 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:23:59.159 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:23:59.167 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:24:29.290 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:24:29.300 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:24:59.424 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:24:59.434 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:25:29.553 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:25:29.565 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:25:59.954 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:25:59.963 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:26:30.088 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:26:30.097 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:27:00.219 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:27:00.228 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:27:30.350 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:27:30.359 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:28:00.488 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:28:00.497 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:28:30.621 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:28:30.629 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:29:00.757 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:29:00.766 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:29:30.908 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:29:30.918 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:30:01.045 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:30:01.055 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:30:31.186 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:30:31.193 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:31:01.345 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:31:01.355 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:31:31.594 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:31:31.604 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:32:01.742 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:32:01.752 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:32:31.869 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:32:31.878 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:33:01.999 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:33:02.009 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:33:32.137 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:33:32.145 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:34:02.285 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:34:02.295 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:34:32.558 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:34:32.565 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:35:02.808 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:35:02.817 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:35:32.942 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:35:32.951 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:36:03.357 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:36:03.366 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:36:33.505 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:36:33.514 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:37:03.650 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:37:03.660 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:37:33.780 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:37:33.789 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:38:03.910 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:38:03.919 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:38:34.037 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:38:34.046 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:39:04.180 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:39:04.187 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:39:34.312 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:39:34.320 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:40:04.458 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:40:04.466 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:40:34.603 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:40:34.613 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:41:04.741 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:41:04.750 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:41:34.893 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:41:34.900 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:42:05.028 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:42:05.035 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:42:35.177 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:42:35.186 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:43:05.317 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:43:05.325 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:43:35.466 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:43:35.475 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:44:05.591 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:44:05.601 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:44:35.730 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:44:35.740 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:45:05.870 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:45:05.878 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:45:35.998 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:45:36.005 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:46:06.134 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:46:06.143 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:46:36.268 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:46:36.276 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:47:06.399 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:47:06.408 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:47:37.459 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:47:37.468 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:48:07.600 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:48:07.610 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:48:37.742 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:48:37.752 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:49:07.877 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:49:07.886 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:49:38.024 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:49:38.033 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:50:08.146 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:50:08.153 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:50:38.284 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:50:38.293 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:51:08.415 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:51:08.424 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:51:38.587 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:51:38.597 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:52:08.735 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:52:08.744 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:52:38.882 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:52:38.892 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:53:09.014 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:53:09.022 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:53:39.144 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:53:39.153 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:54:09.280 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:54:09.289 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:54:40.234 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:54:40.244 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:55:10.381 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:55:10.391 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:55:40.529 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:55:40.540 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:56:10.662 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:56:10.671 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:56:10.770 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-03-27T13:56:10.776+0000 7f622b800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 434002) UID: 0 2024-03-27T13:56:10.770 INFO:tasks.ceph.osd.1.smithi057.stderr:2024-03-27T13:56:10.776+0000 7f8202600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 434002) UID: 0 2024-03-27T13:56:10.770 INFO:tasks.ceph.osd.2.smithi057.stderr:2024-03-27T13:56:10.776+0000 7f1380800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 434002) UID: 0 2024-03-27T13:56:10.771 INFO:tasks.ceph.osd.3.smithi057.stderr:2024-03-27T13:56:10.776+0000 7f009f600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 434002) UID: 0 2024-03-27T13:59:26.582 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:59:26.590 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:59:56.740 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T13:59:56.750 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:00:26.878 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:00:26.888 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:00:57.027 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:00:57.037 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:01:27.163 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:01:27.173 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:01:57.303 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:01:57.313 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:02:27.436 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:02:27.445 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:02:57.580 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:02:57.589 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:03:27.735 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:03:27.743 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:03:57.884 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:03:57.896 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:04:28.016 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:04:28.024 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:04:58.282 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:04:58.290 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:05:28.428 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:05:28.438 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:05:58.559 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:05:58.567 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:06:28.700 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:06:28.708 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:06:58.830 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:06:58.839 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:07:28.964 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:07:28.972 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:07:59.126 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:07:59.137 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:08:29.263 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:08:29.273 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:08:59.796 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:08:59.806 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:09:29.926 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:09:29.936 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:10:00.061 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:10:00.069 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:10:30.221 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:10:30.230 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:11:00.362 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:11:00.370 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:11:30.540 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:11:30.549 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:12:00.695 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:12:00.706 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:12:30.827 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:12:30.836 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:13:00.953 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:13:00.962 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:13:31.085 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:13:31.094 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:14:01.242 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:14:01.250 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:14:31.375 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:14:31.384 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:15:01.522 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:15:01.534 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:15:31.662 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:15:31.671 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:16:01.807 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:16:01.817 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:16:31.950 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:16:31.961 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:17:02.092 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:17:02.101 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:17:32.238 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:17:32.247 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:18:02.369 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:18:02.376 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:18:32.525 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:18:32.533 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:19:02.657 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:19:02.666 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:19:32.814 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:19:32.822 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:20:03.167 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:20:03.177 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:20:33.316 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:20:33.323 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:21:03.461 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:21:03.469 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:21:33.588 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:21:33.598 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:22:03.731 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:22:03.740 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:22:33.877 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:22:33.887 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:23:04.010 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:23:04.018 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:23:34.156 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:23:34.165 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:24:04.294 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:24:04.303 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:24:34.529 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:24:34.538 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:25:04.671 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:25:04.681 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:25:34.924 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:25:34.934 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:26:05.072 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:26:05.081 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:26:35.212 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:26:35.223 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:27:05.628 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:27:05.637 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:27:35.764 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:27:35.774 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:28:05.904 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:28:05.913 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:28:36.087 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:28:36.096 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:29:06.239 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:29:06.250 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:29:36.386 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:29:36.396 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:30:06.565 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:30:06.574 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:30:36.722 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:30:36.733 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:31:06.853 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:31:06.863 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:31:36.993 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:31:37.003 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:32:07.131 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:32:07.138 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:32:37.278 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:32:37.287 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:33:07.417 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:33:07.427 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:33:37.567 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:33:37.577 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:34:07.718 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:34:07.726 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:34:37.855 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:34:37.864 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:35:08.003 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:35:08.012 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:35:38.144 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:35:38.152 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:36:08.618 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:36:08.629 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:36:38.796 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:36:38.805 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:37:08.990 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:37:09.000 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:37:39.151 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:37:39.160 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:38:09.325 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:38:09.337 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:38:39.545 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:38:39.553 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:39:09.700 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:39:09.709 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:39:39.837 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:39:39.845 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:40:09.978 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:40:09.986 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:40:40.133 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:40:40.142 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:41:10.268 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:41:10.279 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:41:40.411 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:41:40.418 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:42:10.568 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:42:10.577 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:42:40.714 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:42:40.722 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:43:10.860 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:43:10.870 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:43:40.999 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:43:41.008 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:44:11.137 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:44:11.146 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:44:41.268 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:44:41.277 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:45:11.701 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:45:11.711 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:45:41.836 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:45:41.847 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:46:11.986 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:46:11.994 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:46:42.282 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:46:42.291 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:47:12.427 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:47:12.437 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:47:42.559 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:47:42.568 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:48:12.723 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:48:12.733 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:48:42.863 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:48:42.871 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:49:13.005 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:49:13.015 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:49:43.138 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:49:43.146 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:50:13.280 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:50:13.288 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:50:43.458 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:50:43.468 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:51:13.614 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:51:13.623 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:51:43.759 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:51:43.768 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:52:13.893 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:52:13.902 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:52:44.022 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:52:44.031 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:53:14.161 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:53:14.171 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:53:44.555 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:53:44.564 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:54:14.708 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:54:14.717 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:54:24.347 INFO:teuthology.orchestra.run.smithi057.stdout:generic/521 7253s 2024-03-27T14:54:24.402 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/521 2024-03-27T14:54:24.402 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T14:54:24.424 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T14:54:24.453 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T14:54:24.453 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/522) 2024-03-27T14:54:25.370 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T14:54:25.382 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T14:54:25.382 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T14:54:44.866 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:54:44.873 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:55:15.007 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:55:15.016 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:55:45.192 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:55:45.199 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:56:15.331 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:56:15.340 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:56:45.470 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:56:45.479 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:57:15.626 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:57:15.637 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T14:57:15.749 INFO:tasks.ceph.osd.1.smithi057.stderr:2024-03-27T14:57:15.756+0000 7f8202600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 436638) UID: 0 2024-03-27T14:57:15.750 INFO:tasks.ceph.osd.3.smithi057.stderr:2024-03-27T14:57:15.756+0000 7f009f600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 436638) UID: 0 2024-03-27T14:57:15.750 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-03-27T14:57:15.756+0000 7f622b800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 436638) UID: 0 2024-03-27T14:57:15.750 INFO:tasks.ceph.osd.2.smithi057.stderr:2024-03-27T14:57:15.756+0000 7f1380800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 436638) UID: 0 2024-03-27T15:00:29.904 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:00:29.914 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:01:00.120 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:01:00.128 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:01:30.267 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:01:30.278 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:02:00.406 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:02:00.412 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:02:30.531 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:02:30.540 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:03:00.662 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:03:00.670 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:03:30.826 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:03:30.835 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:04:01.048 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:04:01.054 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:04:31.197 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:04:31.207 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:05:01.333 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:05:01.341 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:05:31.464 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:05:31.473 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:06:01.604 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:06:01.611 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:06:01.713 INFO:tasks.ceph.mds.c.smithi057.stderr:2024-03-27T15:06:01.715+0000 7f1f8ba00640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 436882) UID: 0 2024-03-27T15:06:01.714 INFO:tasks.ceph.mds.a.smithi057.stderr:2024-03-27T15:06:01.715+0000 7f0ffc400640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 436882) UID: 0 2024-03-27T15:06:01.722 INFO:tasks.ceph.osd.6.smithi118.stderr:2024-03-27T15:06:01.722+0000 7efe94a00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52261) UID: 0 2024-03-27T15:06:01.722 INFO:tasks.ceph.osd.5.smithi118.stderr:2024-03-27T15:06:01.722+0000 7fa84c200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52261) UID: 0 2024-03-27T15:06:01.722 INFO:tasks.ceph.osd.7.smithi118.stderr:2024-03-27T15:06:01.722+0000 7fdba0200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52261) UID: 0 2024-03-27T15:06:01.722 INFO:tasks.ceph.osd.4.smithi118.stderr:2024-03-27T15:06:01.722+0000 7f3737600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52261) UID: 0 2024-03-27T15:09:21.053 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:09:21.063 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:09:51.267 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:09:51.276 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:10:21.440 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:10:21.447 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:10:21.549 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-03-27T15:10:21.549+0000 7f622b800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 436944) UID: 0 2024-03-27T15:10:21.549 INFO:tasks.ceph.osd.2.smithi057.stderr:2024-03-27T15:10:21.549+0000 7f1380800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 436944) UID: 0 2024-03-27T15:10:21.550 INFO:tasks.ceph.osd.1.smithi057.stderr:2024-03-27T15:10:21.549+0000 7f8202600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 436944) UID: 0 2024-03-27T15:10:21.550 INFO:tasks.ceph.osd.3.smithi057.stderr:2024-03-27T15:10:21.549+0000 7f009f600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 436944) UID: 0 2024-03-27T15:13:59.633 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:13:59.642 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:13:59.842 INFO:tasks.ceph.osd.6.smithi118.stderr:2024-03-27T15:13:59.840+0000 7efe94a00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52344) UID: 0 2024-03-27T15:13:59.842 INFO:tasks.ceph.osd.7.smithi118.stderr:2024-03-27T15:13:59.840+0000 7fdba0200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52344) UID: 0 2024-03-27T15:13:59.843 INFO:tasks.ceph.osd.4.smithi118.stderr:2024-03-27T15:13:59.840+0000 7f3737600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52344) UID: 0 2024-03-27T15:13:59.843 INFO:tasks.ceph.osd.5.smithi118.stderr:2024-03-27T15:13:59.840+0000 7fa84c200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52344) UID: 0 2024-03-27T15:16:51.718 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:16:51.727 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:16:51.837 INFO:tasks.ceph.osd.6.smithi118.stderr:2024-03-27T15:16:51.834+0000 7efe94a00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52367) UID: 0 2024-03-27T15:16:51.837 INFO:tasks.ceph.osd.7.smithi118.stderr:2024-03-27T15:16:51.834+0000 7fdba0200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52367) UID: 0 2024-03-27T15:16:51.837 INFO:tasks.ceph.osd.5.smithi118.stderr:2024-03-27T15:16:51.835+0000 7fa84c200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52367) UID: 0 2024-03-27T15:16:51.837 INFO:tasks.ceph.osd.4.smithi118.stderr:2024-03-27T15:16:51.835+0000 7f3737600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52367) UID: 0 2024-03-27T15:19:50.531 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:19:50.541 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:20:20.668 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:20:20.678 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:20:50.808 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:20:50.816 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:21:20.949 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:21:20.958 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:21:51.087 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:21:51.096 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:22:21.224 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:22:21.232 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:22:51.355 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:22:51.364 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:23:21.505 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:23:21.515 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:23:51.650 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:23:51.658 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:24:21.791 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:24:21.799 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:24:51.927 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:24:51.935 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:25:22.092 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:25:22.100 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:25:52.257 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:25:52.265 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:26:22.807 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:26:22.814 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:26:52.950 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:26:52.957 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:27:23.097 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:27:23.103 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:27:53.761 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:27:53.771 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:28:23.900 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:28:23.912 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:28:54.048 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:28:54.054 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:29:24.203 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:29:24.212 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:29:54.350 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:29:54.359 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:30:24.497 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:30:24.508 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:30:54.636 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:30:54.647 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:31:24.793 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:31:24.799 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:31:54.948 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:31:54.957 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:32:25.162 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:32:25.171 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:32:55.350 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:32:55.359 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:33:25.505 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:33:25.513 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:33:55.676 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:33:55.685 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:34:25.816 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:34:25.826 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:34:55.962 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:34:55.970 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:35:26.135 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:35:26.144 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:35:56.881 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:35:56.888 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:36:27.011 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:36:27.020 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:36:57.360 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:36:57.373 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:37:27.505 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:37:27.514 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:37:57.729 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:37:57.738 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:38:27.874 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:38:27.883 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:38:58.010 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:38:58.019 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:39:28.151 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:39:28.162 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:39:58.324 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:39:58.331 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:40:28.497 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:40:28.505 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:40:58.726 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:40:58.735 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:41:28.915 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:41:28.924 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:41:59.061 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:41:59.070 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:42:29.191 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:42:29.201 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:42:59.389 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:42:59.399 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:43:29.587 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:43:29.595 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:43:59.734 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:43:59.744 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:44:29.906 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:44:29.914 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:45:00.103 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:45:00.112 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:45:30.308 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:45:30.317 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:46:00.498 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:46:00.509 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:46:30.653 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:46:30.664 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:47:00.799 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:47:00.807 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:47:30.980 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:47:30.990 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:48:01.136 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:48:01.145 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:48:31.325 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:48:31.334 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:49:01.472 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:49:01.481 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:49:31.686 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:49:31.695 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:50:01.876 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:50:01.885 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:50:32.014 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:50:32.023 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:51:02.179 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:51:02.188 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:51:32.310 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:51:32.319 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:52:02.438 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:52:02.448 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:52:32.577 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:52:32.586 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:53:02.716 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:53:02.727 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:53:32.888 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:53:32.897 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:54:03.229 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:54:03.237 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:54:33.366 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:54:33.376 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:55:03.564 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:55:03.572 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:55:33.718 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:55:33.725 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:56:03.995 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:56:04.005 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:56:34.154 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:56:34.164 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:57:04.302 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:57:04.310 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:57:34.492 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:57:34.502 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:58:04.638 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:58:04.646 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:58:34.803 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:58:34.811 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:59:04.941 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:59:04.949 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:59:35.080 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T15:59:35.089 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:00:05.286 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:00:05.294 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:00:35.925 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:00:35.932 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:01:06.072 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:01:06.081 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:01:36.269 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:01:36.277 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:02:06.415 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:02:06.422 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:02:36.630 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:02:36.638 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:03:06.803 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:03:06.812 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:03:36.958 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:03:36.967 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:04:07.096 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:04:07.106 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:04:37.253 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:04:37.262 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:05:07.458 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:05:07.467 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:05:37.672 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:05:37.681 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:06:07.811 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:06:07.820 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:06:37.975 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:06:37.983 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:07:08.190 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:07:08.199 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:07:38.353 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:07:38.362 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:08:08.483 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:08:08.493 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:08:38.691 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:08:38.699 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:09:08.880 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:09:08.891 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:09:39.026 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:09:39.034 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:10:09.158 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:10:09.166 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:10:39.305 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:10:39.315 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:11:09.461 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:11:09.468 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:11:39.617 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:11:39.627 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:12:09.825 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:12:09.835 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:12:40.030 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:12:40.039 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:13:10.178 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:13:10.188 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:13:40.312 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:13:40.318 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:14:10.453 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:14:10.461 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:14:40.595 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:14:40.604 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:15:10.833 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:15:10.844 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:15:40.972 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:15:40.979 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:16:11.113 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:16:11.122 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:16:41.252 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:16:41.263 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:16:41.374 INFO:tasks.ceph.osd.1.smithi057.stderr:2024-03-27T16:16:41.376+0000 7f8202600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 439148) UID: 0 2024-03-27T16:16:41.374 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-03-27T16:16:41.376+0000 7f622b800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 439148) UID: 0 2024-03-27T16:16:41.375 INFO:tasks.ceph.osd.3.smithi057.stderr:2024-03-27T16:16:41.376+0000 7f009f600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 439148) UID: 0 2024-03-27T16:16:41.375 INFO:tasks.ceph.osd.2.smithi057.stderr:2024-03-27T16:16:41.376+0000 7f1380800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 439148) UID: 0 2024-03-27T16:18:33.288 INFO:teuthology.orchestra.run.smithi057.stdout:generic/522 5048s 2024-03-27T16:18:33.335 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/522 2024-03-27T16:18:33.335 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T16:18:33.342 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T16:18:33.369 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T16:18:33.370 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/523) 2024-03-27T16:18:34.122 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T16:18:34.132 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T16:18:34.132 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T16:18:34.489 INFO:teuthology.orchestra.run.smithi057.stdout:generic/523 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T16:18:34.500 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/523 2024-03-27T16:18:34.500 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/523 2024-03-27T16:18:34.500 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T16:18:34.509 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T16:18:34.540 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T16:18:34.541 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/524) 2024-03-27T16:18:35.034 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T16:18:35.046 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T16:18:35.046 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T16:18:35.413 INFO:teuthology.orchestra.run.smithi057.stdout:generic/524 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T16:18:35.423 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/524 2024-03-27T16:18:35.423 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/524 2024-03-27T16:18:35.423 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T16:18:35.432 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T16:18:35.457 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T16:18:35.457 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/525) 2024-03-27T16:18:35.997 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T16:18:36.009 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T16:18:36.009 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T16:18:36.353 INFO:teuthology.orchestra.run.smithi057.stdout:generic/525 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T16:18:36.363 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/525 2024-03-27T16:18:36.363 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/525 2024-03-27T16:18:36.363 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T16:18:36.371 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T16:18:36.400 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T16:18:36.400 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/526) 2024-03-27T16:18:36.917 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T16:18:36.932 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T16:18:36.932 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T16:18:37.390 INFO:teuthology.orchestra.run.smithi057.stdout:generic/526 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T16:18:37.402 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/526 2024-03-27T16:18:37.403 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/526 2024-03-27T16:18:37.403 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T16:18:37.412 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T16:18:37.442 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T16:18:37.443 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/527) 2024-03-27T16:18:37.937 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T16:18:37.949 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T16:18:37.949 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T16:18:38.371 INFO:teuthology.orchestra.run.smithi057.stdout:generic/527 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T16:18:38.382 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/527 2024-03-27T16:18:38.382 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/527 2024-03-27T16:18:38.382 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T16:18:38.391 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T16:18:38.415 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T16:18:38.415 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/528) 2024-03-27T16:18:38.906 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T16:18:38.919 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T16:18:38.920 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T16:18:39.405 INFO:teuthology.orchestra.run.smithi057.stdout:generic/528 [not run] inode creation time not supported by this filesystem 2024-03-27T16:18:39.418 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/528 2024-03-27T16:18:39.418 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/528 2024-03-27T16:18:39.418 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T16:18:39.430 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T16:18:39.458 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T16:18:39.458 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/529) 2024-03-27T16:18:39.962 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T16:18:39.972 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T16:18:39.973 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T16:18:40.379 INFO:teuthology.orchestra.run.smithi057.stdout:generic/529 [not run] ACLs not supported by this filesystem type: ceph-fuse 2024-03-27T16:18:40.390 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/529 2024-03-27T16:18:40.390 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/529 2024-03-27T16:18:40.390 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T16:18:40.401 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T16:18:40.428 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T16:18:40.428 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/530) 2024-03-27T16:18:40.942 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T16:18:40.953 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T16:18:40.953 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T16:18:41.337 INFO:teuthology.orchestra.run.smithi057.stdout:generic/530 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T16:18:41.348 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/530 2024-03-27T16:18:41.348 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/530 2024-03-27T16:18:41.348 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T16:18:41.356 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T16:18:41.381 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T16:18:41.382 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/531) 2024-03-27T16:18:41.896 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T16:18:41.907 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T16:18:41.907 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T16:18:42.276 INFO:teuthology.orchestra.run.smithi057.stdout:generic/531 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T16:18:42.286 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/531 2024-03-27T16:18:42.286 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/531 2024-03-27T16:18:42.287 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T16:18:42.294 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T16:18:42.321 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T16:18:42.321 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/532) 2024-03-27T16:18:42.830 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T16:18:42.842 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T16:18:42.842 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T16:18:43.385 INFO:teuthology.orchestra.run.smithi057.stdout:generic/532 1s 2024-03-27T16:18:43.403 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/532 2024-03-27T16:18:43.404 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T16:18:43.414 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T16:18:43.448 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T16:18:43.449 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/533) 2024-03-27T16:18:44.015 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T16:18:44.027 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T16:18:44.027 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T16:18:44.922 INFO:teuthology.orchestra.run.smithi057.stdout:generic/533 0s 2024-03-27T16:18:44.935 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/533 2024-03-27T16:18:44.935 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T16:18:44.944 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T16:18:44.969 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T16:18:44.969 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/534) 2024-03-27T16:18:45.467 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T16:18:45.479 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T16:18:45.479 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T16:18:45.875 INFO:teuthology.orchestra.run.smithi057.stdout:generic/534 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T16:18:45.887 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/534 2024-03-27T16:18:45.887 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/534 2024-03-27T16:18:45.887 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T16:18:45.896 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T16:18:45.926 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T16:18:45.926 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/535) 2024-03-27T16:18:46.405 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T16:18:46.419 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T16:18:46.419 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T16:18:46.829 INFO:teuthology.orchestra.run.smithi057.stdout:generic/535 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T16:18:46.840 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/535 2024-03-27T16:18:46.840 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/535 2024-03-27T16:18:46.840 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T16:18:46.849 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T16:18:46.875 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T16:18:46.876 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/536) 2024-03-27T16:18:47.376 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T16:18:47.387 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T16:18:47.387 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T16:18:47.771 INFO:teuthology.orchestra.run.smithi057.stdout:generic/536 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T16:18:47.780 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/536 2024-03-27T16:18:47.780 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/536 2024-03-27T16:18:47.780 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T16:18:47.791 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T16:18:47.817 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T16:18:47.817 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/537) 2024-03-27T16:18:48.295 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T16:18:48.306 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T16:18:48.306 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T16:18:48.701 INFO:teuthology.orchestra.run.smithi057.stdout:generic/537 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T16:18:48.710 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/537 2024-03-27T16:18:48.710 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/537 2024-03-27T16:18:48.710 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T16:18:48.957 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T16:18:48.987 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T16:18:48.987 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/538) 2024-03-27T16:18:49.568 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T16:18:49.578 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T16:18:49.578 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T16:19:57.519 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:19:57.528 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:20:27.665 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:20:27.674 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:20:57.804 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:20:57.812 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:21:27.947 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:21:27.958 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:21:58.086 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:21:58.094 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:22:28.484 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:22:28.490 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:22:58.633 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:22:58.642 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:23:28.778 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:23:28.787 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:23:28.899 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-03-27T16:23:28.898+0000 7f622b800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 446686) UID: 0 2024-03-27T16:23:28.899 INFO:tasks.ceph.osd.1.smithi057.stderr:2024-03-27T16:23:28.898+0000 7f8202600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 446686) UID: 0 2024-03-27T16:23:28.900 INFO:tasks.ceph.osd.2.smithi057.stderr:2024-03-27T16:23:28.898+0000 7f1380800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 446686) UID: 0 2024-03-27T16:23:28.900 INFO:tasks.ceph.osd.3.smithi057.stderr:2024-03-27T16:23:28.898+0000 7f009f600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 446686) UID: 0 2024-03-27T16:26:55.130 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:26:55.139 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:27:25.273 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:27:25.283 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:27:55.419 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:27:55.428 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:28:25.560 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:28:25.567 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:28:55.704 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:28:55.713 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:29:25.850 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:29:25.859 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:29:56.031 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:29:56.040 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:30:26.196 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:30:26.207 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:30:56.350 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:30:56.359 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:31:26.488 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:31:26.496 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:31:56.619 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:31:56.628 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:32:26.767 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:32:26.776 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:32:56.923 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:32:56.931 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:33:27.086 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:33:27.095 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:33:57.445 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:33:57.455 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:34:27.592 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:34:27.600 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:34:57.729 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:34:57.739 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:35:28.177 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:35:28.186 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:35:58.324 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:35:58.333 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:36:28.469 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:36:28.477 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:36:58.596 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:36:58.606 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:37:28.732 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:37:28.740 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:37:59.130 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:37:59.138 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:38:29.264 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:38:29.273 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:38:59.400 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:38:59.409 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:39:29.546 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:39:29.557 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:39:59.695 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:39:59.705 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:40:30.007 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:40:30.017 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:41:00.145 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:41:00.155 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:41:30.279 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:41:30.290 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:42:00.414 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:42:00.423 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:42:30.563 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:42:30.575 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:43:00.710 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:43:00.719 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:43:30.850 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:43:30.859 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:44:01.000 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:44:01.009 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:44:31.128 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:44:31.137 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:45:01.278 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:45:01.291 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:45:31.421 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:45:31.433 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:46:01.565 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:46:01.576 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:46:31.714 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:46:31.723 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:47:01.845 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:47:01.853 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:47:32.036 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:47:32.044 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:48:02.173 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:48:02.181 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:48:32.335 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:48:32.343 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:49:02.460 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:49:02.469 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:49:32.599 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:49:32.606 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:50:02.737 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:50:02.746 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:50:32.877 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:50:32.887 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:51:03.018 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:51:03.027 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:51:33.162 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:51:33.170 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:52:03.302 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:52:03.311 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:52:33.513 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:52:33.524 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:53:03.663 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:53:03.672 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:53:03.793 INFO:tasks.ceph.osd.1.smithi057.stderr:2024-03-27T16:53:03.791+0000 7f8202600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 449463) UID: 0 2024-03-27T16:53:03.794 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-03-27T16:53:03.792+0000 7f622b800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 449463) UID: 0 2024-03-27T16:53:03.794 INFO:tasks.ceph.osd.3.smithi057.stderr:2024-03-27T16:53:03.792+0000 7f009f600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 449463) UID: 0 2024-03-27T16:53:03.794 INFO:tasks.ceph.osd.2.smithi057.stderr:2024-03-27T16:53:03.792+0000 7f1380800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 449463) UID: 0 2024-03-27T16:55:54.058 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:55:54.067 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:56:24.190 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:56:24.200 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:56:54.346 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:56:54.355 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:57:24.495 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:57:24.504 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:57:54.631 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:57:54.641 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:58:24.778 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:58:24.788 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:58:54.916 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:58:54.924 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:59:25.054 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:59:25.060 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:59:55.374 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T16:59:55.383 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:00:25.534 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:00:25.543 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:00:56.116 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:00:56.125 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:01:26.262 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:01:26.268 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:01:56.391 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:01:56.400 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:02:26.524 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:02:26.533 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:02:56.656 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:02:56.664 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:03:27.184 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:03:27.193 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:03:57.326 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:03:57.335 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:04:27.468 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:04:27.473 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:04:57.650 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:04:57.662 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:05:27.804 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:05:27.813 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:05:57.935 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:05:57.943 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:06:28.081 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:06:28.090 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:06:58.220 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:06:58.229 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:07:28.368 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:07:28.376 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:07:58.516 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:07:58.524 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:08:28.654 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:08:28.659 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:08:58.819 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:08:58.827 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:09:28.957 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:09:28.965 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:09:59.105 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:09:59.114 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:10:29.244 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:10:29.255 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:10:59.540 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:10:59.549 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:11:29.684 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:11:29.693 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:11:59.828 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:11:59.837 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:12:29.971 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:12:29.980 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:13:00.119 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:13:00.128 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:13:30.265 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:13:30.274 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:14:00.474 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:14:00.483 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:14:30.620 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:14:30.630 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:15:00.768 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:15:00.780 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:15:30.916 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:15:30.922 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:16:01.079 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:16:01.089 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:16:31.217 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:16:31.229 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:17:01.352 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:17:01.363 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:17:31.494 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:17:31.504 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:18:01.643 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:18:01.652 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:18:31.774 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:18:31.783 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:19:01.945 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:19:01.956 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:19:32.101 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:19:32.110 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:20:02.232 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:20:02.241 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:20:32.377 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:20:32.388 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:21:02.518 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:21:02.526 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:21:33.244 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:21:33.254 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:22:03.405 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:22:03.414 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:22:33.561 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:22:33.570 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:23:03.718 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:23:03.727 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:23:33.856 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:23:33.866 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:24:03.995 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:24:04.003 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:24:34.140 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:24:34.148 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:25:04.285 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:25:04.294 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:25:34.417 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:25:34.427 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:26:05.094 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:26:05.103 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:26:35.231 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:26:35.240 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:27:05.372 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:27:05.381 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:27:35.506 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:27:35.514 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:28:05.848 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:28:05.858 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:28:35.994 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:28:36.006 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:29:06.132 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:29:06.141 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:29:36.271 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:29:36.279 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:30:06.411 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:30:06.420 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:30:36.558 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:30:36.568 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:31:06.740 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:31:06.750 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:31:36.870 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:31:36.879 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:32:07.011 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:32:07.022 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:32:37.156 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:32:37.165 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:33:07.291 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:33:07.298 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:33:37.419 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:33:37.429 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:34:07.588 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:34:07.596 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:34:37.759 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:34:37.769 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:35:07.906 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:35:07.915 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:35:38.043 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:35:38.050 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:36:08.184 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:36:08.193 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:36:38.322 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:36:38.332 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:37:08.470 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:37:08.479 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:37:38.769 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:37:38.778 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:38:08.909 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:38:08.915 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:38:39.039 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:38:39.049 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:39:09.190 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:39:09.198 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:39:39.500 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:39:39.510 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:40:09.639 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:40:09.647 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:40:39.780 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:40:39.792 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:41:09.929 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:41:09.937 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:41:40.059 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:41:40.070 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:42:10.200 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:42:10.212 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:42:40.414 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:42:40.423 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:43:10.553 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:43:10.562 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:43:40.711 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:43:40.720 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:44:10.849 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:44:10.858 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:44:40.985 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:44:40.997 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:45:11.136 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:45:11.146 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:45:41.356 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:45:41.368 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:46:11.606 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:46:11.615 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:46:41.754 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:46:41.761 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:47:11.879 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:47:11.888 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:47:42.011 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:47:42.021 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:48:12.151 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:48:12.159 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:48:42.288 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:48:42.297 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:49:12.435 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:49:12.444 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:49:42.581 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:49:42.590 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:50:12.747 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:50:12.756 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:50:42.885 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:50:42.893 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:51:13.042 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:51:13.051 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:51:43.196 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:51:43.205 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:52:13.333 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:52:13.343 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:52:43.470 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:52:43.479 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:53:13.629 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:53:13.639 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:53:43.785 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:53:43.799 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:54:13.940 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:54:13.948 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:54:44.070 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:54:44.079 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:55:14.225 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:55:14.234 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:55:44.375 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:55:44.383 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:56:14.530 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:56:14.539 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:56:44.694 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:56:44.703 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:57:14.831 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:57:14.839 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:57:44.970 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:57:44.981 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:58:15.117 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:58:15.125 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:58:45.259 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:58:45.267 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:59:15.402 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:59:15.410 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:59:45.533 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T17:59:45.543 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T18:00:15.870 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T18:00:15.879 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T18:00:46.019 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T18:00:46.028 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T18:01:16.157 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T18:01:16.167 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T18:01:32.795 INFO:teuthology.orchestra.run.smithi057.stdout:generic/538 6163s 2024-03-27T18:01:32.813 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/538 2024-03-27T18:01:32.813 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:01:32.824 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:01:32.868 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:01:32.868 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/539) 2024-03-27T18:01:33.668 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:01:33.679 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:01:33.679 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:01:39.724 INFO:teuthology.orchestra.run.smithi057.stdout:generic/539 6s 2024-03-27T18:01:39.739 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/539 2024-03-27T18:01:39.740 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:01:39.747 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:01:39.779 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:01:39.779 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/540) 2024-03-27T18:01:40.583 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:01:40.596 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:01:40.596 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:01:41.043 INFO:teuthology.orchestra.run.smithi057.stdout:generic/540 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T18:01:41.054 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/540 2024-03-27T18:01:41.054 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/540 2024-03-27T18:01:41.054 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:01:41.065 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:01:41.099 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:01:41.100 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/541) 2024-03-27T18:01:41.663 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:01:41.674 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:01:41.674 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:01:42.076 INFO:teuthology.orchestra.run.smithi057.stdout:generic/541 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T18:01:42.089 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/541 2024-03-27T18:01:42.090 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/541 2024-03-27T18:01:42.090 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:01:42.099 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:01:42.128 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:01:42.128 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/542) 2024-03-27T18:01:42.650 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:01:42.662 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:01:42.662 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:01:43.091 INFO:teuthology.orchestra.run.smithi057.stdout:generic/542 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T18:01:43.101 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/542 2024-03-27T18:01:43.102 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/542 2024-03-27T18:01:43.102 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:01:43.110 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:01:43.138 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:01:43.138 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/543) 2024-03-27T18:01:43.665 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:01:43.677 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:01:43.677 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:01:44.151 INFO:teuthology.orchestra.run.smithi057.stdout:generic/543 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T18:01:44.162 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/543 2024-03-27T18:01:44.162 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/543 2024-03-27T18:01:44.163 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:01:44.171 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:01:44.205 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:01:44.205 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/544) 2024-03-27T18:01:44.743 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:01:44.757 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:01:44.757 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:01:45.224 INFO:teuthology.orchestra.run.smithi057.stdout:generic/544 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T18:01:45.238 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/544 2024-03-27T18:01:45.239 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/544 2024-03-27T18:01:45.239 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:01:45.252 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:01:45.285 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:01:45.286 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/545) 2024-03-27T18:01:45.817 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:01:45.828 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:01:45.828 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:01:46.390 INFO:teuthology.orchestra.run.smithi057.stdout:generic/545 [not run] file system doesn't support chattr +i 2024-03-27T18:01:46.401 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/545 2024-03-27T18:01:46.401 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/545 2024-03-27T18:01:46.401 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:01:46.410 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:01:46.440 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:01:46.440 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/546) 2024-03-27T18:01:46.689 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T18:01:46.694 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T18:01:46.964 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:01:46.976 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:01:46.977 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:01:47.508 INFO:teuthology.orchestra.run.smithi057.stdout:generic/546 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T18:01:47.520 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/546 2024-03-27T18:01:47.520 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/546 2024-03-27T18:01:47.520 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:01:47.529 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:01:47.557 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:01:47.557 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/547) 2024-03-27T18:01:48.079 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:01:48.090 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:01:48.090 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:01:48.515 INFO:teuthology.orchestra.run.smithi057.stdout:generic/547 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T18:01:48.527 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/547 2024-03-27T18:01:48.527 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/547 2024-03-27T18:01:48.527 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:01:48.536 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:01:48.560 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:01:48.560 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/548) 2024-03-27T18:01:49.066 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:01:49.079 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:01:49.079 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:01:49.540 INFO:teuthology.orchestra.run.smithi057.stdout:generic/548 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T18:01:49.554 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/548 2024-03-27T18:01:49.554 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/548 2024-03-27T18:01:49.554 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:01:49.565 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:01:49.599 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:01:49.599 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/549) 2024-03-27T18:01:50.136 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:01:50.151 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:01:50.151 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:01:50.667 INFO:teuthology.orchestra.run.smithi057.stdout:generic/549 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T18:01:50.682 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/549 2024-03-27T18:01:50.682 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/549 2024-03-27T18:01:50.682 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:01:50.694 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:01:50.725 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:01:50.725 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/550) 2024-03-27T18:01:51.297 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:01:51.309 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:01:51.309 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:01:51.906 INFO:teuthology.orchestra.run.smithi057.stdout:generic/550 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T18:01:51.919 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/550 2024-03-27T18:01:51.919 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/550 2024-03-27T18:01:51.919 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:01:51.929 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:01:51.961 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:01:51.961 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/551) 2024-03-27T18:01:52.503 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:01:52.516 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:01:52.516 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:01:52.957 INFO:teuthology.orchestra.run.smithi057.stdout:generic/551 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T18:01:52.969 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/551 2024-03-27T18:01:52.969 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/551 2024-03-27T18:01:52.969 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:01:52.978 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:01:53.011 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:01:53.011 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/552) 2024-03-27T18:01:53.542 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:01:53.554 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:01:53.554 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:01:54.027 INFO:teuthology.orchestra.run.smithi057.stdout:generic/552 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T18:01:54.041 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/552 2024-03-27T18:01:54.042 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/552 2024-03-27T18:01:54.042 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:01:54.054 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:01:54.088 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:01:54.089 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/553) 2024-03-27T18:01:54.631 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:01:54.643 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:01:54.643 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:01:55.601 INFO:teuthology.orchestra.run.smithi057.stdout:generic/553 [not run] xfs_io chattr +i failed (old kernel/wrong fs/bad args?) 2024-03-27T18:01:55.613 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/553 2024-03-27T18:01:55.613 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/553 2024-03-27T18:01:55.613 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:01:55.622 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:01:55.668 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:01:55.669 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/554) 2024-03-27T18:01:56.419 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:01:56.431 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:01:56.431 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:01:56.821 INFO:teuthology.orchestra.run.smithi057.stdout:generic/554 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T18:01:56.831 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/554 2024-03-27T18:01:56.832 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/554 2024-03-27T18:01:56.832 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:01:56.840 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:01:56.867 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:01:56.867 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/555) 2024-03-27T18:01:57.387 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:01:57.402 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:01:57.402 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:01:58.011 INFO:teuthology.orchestra.run.smithi057.stdout:generic/555 [not run] xfs_io chattr +ia failed (old kernel/wrong fs/bad args?) 2024-03-27T18:01:58.022 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/555 2024-03-27T18:01:58.023 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/555 2024-03-27T18:01:58.023 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:01:58.033 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:01:58.071 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:01:58.072 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/556) 2024-03-27T18:01:58.856 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:01:58.868 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:01:58.868 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:01:59.285 INFO:teuthology.orchestra.run.smithi057.stdout:generic/556 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T18:01:59.297 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/556 2024-03-27T18:01:59.297 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/556 2024-03-27T18:01:59.297 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:01:59.306 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:01:59.337 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:01:59.337 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/557) 2024-03-27T18:01:59.882 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:01:59.897 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:01:59.897 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:02:00.313 INFO:teuthology.orchestra.run.smithi057.stdout:generic/557 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T18:02:00.324 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/557 2024-03-27T18:02:00.324 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/557 2024-03-27T18:02:00.324 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:02:00.332 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:02:00.360 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:02:00.360 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/558) 2024-03-27T18:02:00.883 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:02:00.895 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:02:00.895 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:02:01.296 INFO:teuthology.orchestra.run.smithi057.stdout:generic/558 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T18:02:01.307 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/558 2024-03-27T18:02:01.307 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/558 2024-03-27T18:02:01.308 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:02:01.317 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:02:01.350 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:02:01.350 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/559) 2024-03-27T18:02:01.865 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:02:01.877 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:02:01.877 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:02:02.284 INFO:teuthology.orchestra.run.smithi057.stdout:generic/559 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T18:02:02.296 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/559 2024-03-27T18:02:02.297 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/559 2024-03-27T18:02:02.297 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:02:02.306 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:02:02.339 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:02:02.339 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/560) 2024-03-27T18:02:02.896 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:02:02.908 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:02:02.909 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:02:03.317 INFO:teuthology.orchestra.run.smithi057.stdout:generic/560 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T18:02:03.329 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/560 2024-03-27T18:02:03.330 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/560 2024-03-27T18:02:03.330 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:02:03.338 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:02:03.364 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:02:03.364 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/561) 2024-03-27T18:02:03.928 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:02:03.939 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:02:03.940 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:02:04.324 INFO:teuthology.orchestra.run.smithi057.stdout:generic/561 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T18:02:04.335 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/561 2024-03-27T18:02:04.335 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/561 2024-03-27T18:02:04.335 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:02:04.345 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:02:04.372 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:02:04.372 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/562) 2024-03-27T18:02:04.930 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:02:04.945 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:02:04.945 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:02:05.392 INFO:teuthology.orchestra.run.smithi057.stdout:generic/562 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T18:02:05.403 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/562 2024-03-27T18:02:05.403 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/562 2024-03-27T18:02:05.403 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:02:05.411 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:02:05.441 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:02:05.441 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/563) 2024-03-27T18:02:06.030 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:02:06.043 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:02:06.044 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:02:06.482 INFO:teuthology.orchestra.run.smithi057.stdout:generic/563 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T18:02:06.495 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/563 2024-03-27T18:02:06.495 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/563 2024-03-27T18:02:06.495 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:02:06.506 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:02:06.540 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:02:06.540 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/564) 2024-03-27T18:02:07.077 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:02:07.089 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:02:07.089 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:02:08.170 INFO:teuthology.orchestra.run.smithi057.stdout:generic/564 1s 2024-03-27T18:02:08.188 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/564 2024-03-27T18:02:08.188 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:02:08.197 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:02:08.236 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:02:08.237 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/565) 2024-03-27T18:02:09.039 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:02:09.053 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:02:09.053 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:02:09.442 INFO:teuthology.orchestra.run.smithi057.stdout:generic/565 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T18:02:09.452 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/565 2024-03-27T18:02:09.452 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/565 2024-03-27T18:02:09.452 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:02:09.460 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:02:09.483 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:02:09.484 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/566) 2024-03-27T18:02:10.028 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:02:10.042 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:02:10.042 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:02:10.482 INFO:teuthology.orchestra.run.smithi057.stdout:generic/566 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T18:02:10.494 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/566 2024-03-27T18:02:10.494 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/566 2024-03-27T18:02:10.494 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:02:10.503 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:02:10.534 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:02:10.534 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/567) 2024-03-27T18:02:11.111 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:02:11.123 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:02:11.124 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:02:11.519 INFO:teuthology.orchestra.run.smithi057.stdout:generic/567 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T18:02:11.528 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/567 2024-03-27T18:02:11.529 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/567 2024-03-27T18:02:11.529 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:02:11.536 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:02:11.566 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:02:11.566 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/568) 2024-03-27T18:02:12.131 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:02:12.145 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:02:12.145 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:02:12.876 INFO:teuthology.orchestra.run.smithi057.stdout:generic/568 0s 2024-03-27T18:02:12.902 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/568 2024-03-27T18:02:12.902 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:02:12.923 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:02:12.965 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:02:12.965 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/569) 2024-03-27T18:02:13.617 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:02:13.628 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:02:13.628 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:02:14.183 INFO:teuthology.orchestra.run.smithi057.stdout:generic/569 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T18:02:14.196 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/569 2024-03-27T18:02:14.197 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/569 2024-03-27T18:02:14.197 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:02:14.206 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:02:14.237 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:02:14.238 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/570) 2024-03-27T18:02:14.789 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:02:14.801 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:02:14.801 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:02:15.207 INFO:teuthology.orchestra.run.smithi057.stdout:generic/570 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T18:02:15.219 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/570 2024-03-27T18:02:15.219 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/570 2024-03-27T18:02:15.219 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:02:15.229 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:02:15.262 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:02:15.262 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/571) 2024-03-27T18:02:15.817 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:02:15.831 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:02:15.831 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:02:16.819 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T18:02:16.827 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T18:02:22.529 INFO:teuthology.orchestra.run.smithi057.stdout:generic/571 7s 2024-03-27T18:02:22.542 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/571 2024-03-27T18:02:22.542 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:02:22.550 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:02:22.581 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:02:22.581 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/572) 2024-03-27T18:02:23.332 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:02:23.344 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:02:23.344 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:02:23.685 INFO:teuthology.orchestra.run.smithi057.stdout:generic/572 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T18:02:23.697 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/572 2024-03-27T18:02:23.697 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/572 2024-03-27T18:02:23.697 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:02:23.706 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:02:23.729 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:02:23.729 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/573) 2024-03-27T18:02:24.268 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:02:24.281 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:02:24.281 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:02:24.720 INFO:teuthology.orchestra.run.smithi057.stdout:generic/573 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T18:02:24.733 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/573 2024-03-27T18:02:24.733 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/573 2024-03-27T18:02:24.733 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:02:24.743 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:02:24.777 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:02:24.777 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/574) 2024-03-27T18:02:25.342 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:02:25.355 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:02:25.355 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:02:25.808 INFO:teuthology.orchestra.run.smithi057.stdout:generic/574 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T18:02:25.818 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/574 2024-03-27T18:02:25.819 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/574 2024-03-27T18:02:25.819 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:02:25.829 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:02:25.859 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:02:25.859 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/575) 2024-03-27T18:02:26.361 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:02:26.374 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:02:26.374 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:02:26.778 INFO:teuthology.orchestra.run.smithi057.stdout:generic/575 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T18:02:26.792 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/575 2024-03-27T18:02:26.792 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/575 2024-03-27T18:02:26.793 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:02:26.804 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:02:26.836 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:02:26.836 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/576) 2024-03-27T18:02:27.375 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:02:27.387 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:02:27.387 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:02:27.881 INFO:teuthology.orchestra.run.smithi057.stdout:generic/576 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T18:02:27.893 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/576 2024-03-27T18:02:27.893 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/576 2024-03-27T18:02:27.893 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:02:27.903 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:02:27.935 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:02:27.935 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/577) 2024-03-27T18:02:28.490 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:02:28.501 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:02:28.501 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:02:28.945 INFO:teuthology.orchestra.run.smithi057.stdout:generic/577 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T18:02:28.956 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/577 2024-03-27T18:02:28.956 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/577 2024-03-27T18:02:28.956 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:02:28.965 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:02:28.995 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:02:28.995 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/578) 2024-03-27T18:02:29.544 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:02:29.558 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:02:29.558 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:02:30.051 INFO:teuthology.orchestra.run.smithi057.stdout:generic/578 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-03-27T18:02:30.062 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/578 2024-03-27T18:02:30.062 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/578 2024-03-27T18:02:30.062 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:02:30.070 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:02:30.105 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:02:30.105 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/579) 2024-03-27T18:02:30.645 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:02:30.656 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:02:30.656 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:02:31.128 INFO:teuthology.orchestra.run.smithi057.stdout:generic/579 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T18:02:31.142 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/579 2024-03-27T18:02:31.143 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/579 2024-03-27T18:02:31.143 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:02:31.156 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:02:31.189 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:02:31.190 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/580) 2024-03-27T18:02:31.779 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:02:31.790 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:02:31.791 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:02:32.331 INFO:teuthology.orchestra.run.smithi057.stdout:generic/580 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T18:02:32.345 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/580 2024-03-27T18:02:32.346 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/580 2024-03-27T18:02:32.346 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:02:32.356 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:02:32.390 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:02:32.390 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/581) 2024-03-27T18:02:32.975 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:02:32.987 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:02:32.987 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:02:34.299 INFO:teuthology.orchestra.run.smithi057.stdout:generic/581 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T18:02:34.310 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/581 2024-03-27T18:02:34.311 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/581 2024-03-27T18:02:34.311 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:02:34.320 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:02:34.350 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:02:34.350 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/582) 2024-03-27T18:02:34.883 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:02:34.895 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:02:34.896 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:02:35.462 INFO:teuthology.orchestra.run.smithi057.stdout:generic/582 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T18:02:35.475 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/582 2024-03-27T18:02:35.476 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/582 2024-03-27T18:02:35.476 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:02:35.488 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:02:35.520 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:02:35.520 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/583) 2024-03-27T18:02:36.043 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:02:36.056 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:02:36.056 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:02:36.580 INFO:teuthology.orchestra.run.smithi057.stdout:generic/583 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T18:02:36.595 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/583 2024-03-27T18:02:36.595 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/583 2024-03-27T18:02:36.595 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:02:36.606 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:02:36.642 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:02:36.643 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/584) 2024-03-27T18:02:37.173 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:02:37.184 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:02:37.184 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:02:37.677 INFO:teuthology.orchestra.run.smithi057.stdout:generic/584 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T18:02:37.689 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/584 2024-03-27T18:02:37.689 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/584 2024-03-27T18:02:37.689 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:02:37.699 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:02:37.731 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:02:37.731 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/585) 2024-03-27T18:02:38.294 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:02:38.306 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:02:38.306 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:02:38.745 INFO:teuthology.orchestra.run.smithi057.stdout:generic/585 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T18:02:38.756 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/585 2024-03-27T18:02:38.756 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/585 2024-03-27T18:02:38.757 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:02:38.766 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:02:38.798 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:02:38.798 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/586) 2024-03-27T18:02:39.312 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:02:39.323 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:02:39.323 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:02:47.017 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T18:02:47.027 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T18:03:17.161 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T18:03:17.171 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T18:03:21.516 INFO:teuthology.orchestra.run.smithi057.stdout:generic/586 42s 2024-03-27T18:03:21.542 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/586 2024-03-27T18:03:21.542 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:03:21.552 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:03:21.600 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:03:21.601 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/587) 2024-03-27T18:03:22.575 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:03:22.588 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:03:22.589 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:03:23.739 INFO:teuthology.orchestra.run.smithi057.stdout:generic/587 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2024-03-27T18:03:23.755 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/587 2024-03-27T18:03:23.755 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/587 2024-03-27T18:03:23.755 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:03:23.767 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:03:23.800 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:03:23.801 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/588) 2024-03-27T18:03:24.355 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:03:24.367 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:03:24.367 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:03:24.881 INFO:teuthology.orchestra.run.smithi057.stdout:generic/588 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T18:03:24.893 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/588 2024-03-27T18:03:24.893 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/588 2024-03-27T18:03:24.893 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:03:24.903 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:03:24.940 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:03:24.940 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/589) 2024-03-27T18:03:25.494 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:03:25.509 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:03:25.510 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:03:26.151 INFO:teuthology.orchestra.run.smithi057.stdout:generic/589 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T18:03:26.165 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/589 2024-03-27T18:03:26.165 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/589 2024-03-27T18:03:26.165 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:03:26.177 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:03:26.207 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:03:26.207 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/590) 2024-03-27T18:03:26.725 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:03:26.736 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:03:26.736 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:03:27.130 INFO:teuthology.orchestra.run.smithi057.stdout:generic/590 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T18:03:27.142 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/590 2024-03-27T18:03:27.142 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/590 2024-03-27T18:03:27.142 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:03:27.153 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:03:27.183 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:03:27.183 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/591) 2024-03-27T18:03:27.743 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:03:27.757 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:03:27.757 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:03:28.553 INFO:teuthology.orchestra.run.smithi057.stdout:generic/591 1s 2024-03-27T18:03:28.568 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/591 2024-03-27T18:03:28.568 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:03:28.575 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:03:28.607 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:03:28.608 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/592) 2024-03-27T18:03:29.362 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:03:29.373 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:03:29.373 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:03:29.824 INFO:teuthology.orchestra.run.smithi057.stdout:generic/592 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T18:03:29.836 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/592 2024-03-27T18:03:29.836 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/592 2024-03-27T18:03:29.836 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:03:29.844 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:03:29.874 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:03:29.875 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/593) 2024-03-27T18:03:30.386 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:03:30.397 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:03:30.397 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:03:30.848 INFO:teuthology.orchestra.run.smithi057.stdout:generic/593 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T18:03:30.862 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/593 2024-03-27T18:03:30.862 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/593 2024-03-27T18:03:30.862 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:03:30.873 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:03:30.903 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:03:30.903 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/594) 2024-03-27T18:03:31.424 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:03:31.435 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:03:31.435 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:03:31.853 INFO:teuthology.orchestra.run.smithi057.stdout:generic/594 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T18:03:31.864 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/594 2024-03-27T18:03:31.865 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/594 2024-03-27T18:03:31.865 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:03:31.873 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:03:31.906 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:03:31.906 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/595) 2024-03-27T18:03:32.454 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:03:32.466 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:03:32.466 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:03:32.988 INFO:teuthology.orchestra.run.smithi057.stdout:generic/595 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T18:03:33.001 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/595 2024-03-27T18:03:33.001 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/595 2024-03-27T18:03:33.001 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:03:33.012 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:03:33.041 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:03:33.041 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/596) 2024-03-27T18:03:33.630 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:03:33.641 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:03:33.642 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:03:34.203 INFO:teuthology.orchestra.run.smithi057.stdout:generic/596 [not run] file system doesn't support chattr +S 2024-03-27T18:03:34.214 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/596 2024-03-27T18:03:34.214 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/596 2024-03-27T18:03:34.214 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:03:34.224 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:03:34.250 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:03:34.250 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/597) 2024-03-27T18:03:34.797 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:03:34.809 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:03:34.810 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:03:36.697 INFO:teuthology.orchestra.run.smithi057.stdout:generic/597 - output mismatch (see /tmp/tmp.446sL8UEHrxfstests-dev/results//generic/597.out.bad) 2024-03-27T18:03:36.703 INFO:teuthology.orchestra.run.smithi057.stdout: --- tests/generic/597.out 2024-03-27 10:01:36.031467186 +0000 2024-03-27T18:03:36.703 INFO:teuthology.orchestra.run.smithi057.stdout: +++ /tmp/tmp.446sL8UEHrxfstests-dev/results//generic/597.out.bad 2024-03-27 18:03:36.694979641 +0000 2024-03-27T18:03:36.703 INFO:teuthology.orchestra.run.smithi057.stdout: @@ -4,11 +4,11 @@ 2024-03-27T18:03:36.703 INFO:teuthology.orchestra.run.smithi057.stdout: fs.protected_symlinks = 0 2024-03-27T18:03:36.703 INFO:teuthology.orchestra.run.smithi057.stdout: successfully followed symlink 2024-03-27T18:03:36.704 INFO:teuthology.orchestra.run.smithi057.stdout: fs.protected_symlinks = 1 2024-03-27T18:03:36.704 INFO:teuthology.orchestra.run.smithi057.stdout: -Permission denied 2024-03-27T18:03:36.704 INFO:teuthology.orchestra.run.smithi057.stdout: +successfully followed symlink 2024-03-27T18:03:36.704 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:03:36.704 INFO:teuthology.orchestra.run.smithi057.stdout: == Test hardlink create protection when 2024-03-27T18:03:36.704 INFO:teuthology.orchestra.run.smithi057.stdout: == process != target owner and process cannot read target 2024-03-27T18:03:36.704 INFO:teuthology.orchestra.run.smithi057.stdout: fs.protected_hardlinks = 0 2024-03-27T18:03:36.704 INFO:teuthology.orchestra.run.smithi057.stdout: -successfully created hardlink 2024-03-27T18:03:36.704 INFO:teuthology.orchestra.run.smithi057.stdout: +Permission denied 2024-03-27T18:03:36.704 INFO:teuthology.orchestra.run.smithi057.stdout: fs.protected_hardlinks = 1 2024-03-27T18:03:36.704 INFO:teuthology.orchestra.run.smithi057.stdout: -ln: failed to create hard link 'TEST_DIR/597/sticky_dir/hardlink' => 'TEST_DIR/597/target': Operation not permitted 2024-03-27T18:03:36.704 INFO:teuthology.orchestra.run.smithi057.stdout: +Permission denied 2024-03-27T18:03:36.711 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/597 2024-03-27T18:03:36.711 INFO:teuthology.orchestra.run.smithi057.stdout:Failures: generic/597 2024-03-27T18:03:36.711 INFO:teuthology.orchestra.run.smithi057.stdout:Failed 1 of 1 tests 2024-03-27T18:03:36.719 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:03:36.753 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-27T18:03:36.754 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-03-27T18:03:36.754 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-03-27T18:03:36.754 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/598) 2024-03-27T18:03:37.506 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:03:37.517 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:03:37.518 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:03:39.217 INFO:teuthology.orchestra.run.smithi057.stdout:generic/598 - output mismatch (see /tmp/tmp.446sL8UEHrxfstests-dev/results//generic/598.out.bad) 2024-03-27T18:03:39.224 INFO:teuthology.orchestra.run.smithi057.stdout: --- tests/generic/598.out 2024-03-27 10:01:36.031467186 +0000 2024-03-27T18:03:39.224 INFO:teuthology.orchestra.run.smithi057.stdout: +++ /tmp/tmp.446sL8UEHrxfstests-dev/results//generic/598.out.bad 2024-03-27 18:03:39.213940302 +0000 2024-03-27T18:03:39.224 INFO:teuthology.orchestra.run.smithi057.stdout: @@ -5,13 +5,10 @@ 2024-03-27T18:03:39.224 INFO:teuthology.orchestra.run.smithi057.stdout: = only group writable dir 2024-03-27T18:03:39.224 INFO:teuthology.orchestra.run.smithi057.stdout: fs.protected_regular = 1 2024-03-27T18:03:39.224 INFO:teuthology.orchestra.run.smithi057.stdout: = group & world writable dir 2024-03-27T18:03:39.224 INFO:teuthology.orchestra.run.smithi057.stdout: -Permission denied 2024-03-27T18:03:39.224 INFO:teuthology.orchestra.run.smithi057.stdout: = only group writable dir 2024-03-27T18:03:39.224 INFO:teuthology.orchestra.run.smithi057.stdout: fs.protected_regular = 2 2024-03-27T18:03:39.225 INFO:teuthology.orchestra.run.smithi057.stdout: = group & world writable dir 2024-03-27T18:03:39.225 INFO:teuthology.orchestra.run.smithi057.stdout: -Permission denied 2024-03-27T18:03:39.225 INFO:teuthology.orchestra.run.smithi057.stdout: = only group writable dir 2024-03-27T18:03:39.225 INFO:teuthology.orchestra.run.smithi057.stdout: -Permission denied 2024-03-27T18:03:39.225 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:03:39.225 INFO:teuthology.orchestra.run.smithi057.stdout: == Test fifo open when owned by another and fifo owner != dir owner 2024-03-27T18:03:39.225 INFO:teuthology.orchestra.run.smithi057.stdout: fs.protected_fifos = 0 2024-03-27T18:03:39.225 INFO:teuthology.orchestra.run.smithi057.stdout: @@ -19,10 +16,7 @@ 2024-03-27T18:03:39.225 INFO:teuthology.orchestra.run.smithi057.stdout: = only group writable dir 2024-03-27T18:03:39.225 INFO:teuthology.orchestra.run.smithi057.stdout: fs.protected_fifos = 1 2024-03-27T18:03:39.225 INFO:teuthology.orchestra.run.smithi057.stdout: = group & world writable dir 2024-03-27T18:03:39.225 INFO:teuthology.orchestra.run.smithi057.stdout: -Permission denied 2024-03-27T18:03:39.225 INFO:teuthology.orchestra.run.smithi057.stdout: = only group writable dir 2024-03-27T18:03:39.225 INFO:teuthology.orchestra.run.smithi057.stdout: fs.protected_fifos = 2 2024-03-27T18:03:39.225 INFO:teuthology.orchestra.run.smithi057.stdout: = group & world writable dir 2024-03-27T18:03:39.226 INFO:teuthology.orchestra.run.smithi057.stdout: -Permission denied 2024-03-27T18:03:39.226 INFO:teuthology.orchestra.run.smithi057.stdout: = only group writable dir 2024-03-27T18:03:39.226 INFO:teuthology.orchestra.run.smithi057.stdout: -Permission denied 2024-03-27T18:03:39.230 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/598 2024-03-27T18:03:39.231 INFO:teuthology.orchestra.run.smithi057.stdout:Failures: generic/598 2024-03-27T18:03:39.231 INFO:teuthology.orchestra.run.smithi057.stdout:Failed 1 of 1 tests 2024-03-27T18:03:39.239 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:03:39.265 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-27T18:03:39.265 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-03-27T18:03:39.265 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-03-27T18:03:39.266 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/599) 2024-03-27T18:03:40.023 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:03:40.035 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:03:40.035 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:03:40.390 INFO:teuthology.orchestra.run.smithi057.stdout:generic/599 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T18:03:40.402 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/599 2024-03-27T18:03:40.402 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/599 2024-03-27T18:03:40.402 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:03:40.411 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:03:40.437 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:03:40.437 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/600) 2024-03-27T18:03:40.941 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:03:40.954 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:03:40.954 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:03:41.357 INFO:teuthology.orchestra.run.smithi057.stdout:generic/600 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T18:03:41.371 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/600 2024-03-27T18:03:41.371 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/600 2024-03-27T18:03:41.372 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:03:41.383 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:03:41.418 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:03:41.419 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/601) 2024-03-27T18:03:42.000 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:03:42.012 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:03:42.012 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:03:42.404 INFO:teuthology.orchestra.run.smithi057.stdout:generic/601 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T18:03:42.414 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/601 2024-03-27T18:03:42.414 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/601 2024-03-27T18:03:42.414 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:03:42.421 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:03:42.449 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:03:42.449 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/602) 2024-03-27T18:03:42.977 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:03:42.992 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:03:42.992 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:03:43.553 INFO:teuthology.orchestra.run.smithi057.stdout:generic/602 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T18:03:43.565 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/602 2024-03-27T18:03:43.566 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/602 2024-03-27T18:03:43.566 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:03:43.576 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:03:43.604 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:03:43.605 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/603) 2024-03-27T18:03:44.141 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:03:44.154 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:03:44.154 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:03:44.601 INFO:teuthology.orchestra.run.smithi057.stdout:generic/603 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T18:03:44.614 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/603 2024-03-27T18:03:44.615 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/603 2024-03-27T18:03:44.615 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:03:44.623 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:03:44.654 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:03:44.654 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/604) 2024-03-27T18:03:45.270 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:03:45.283 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:03:45.283 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:03:45.719 INFO:teuthology.orchestra.run.smithi057.stdout:generic/604 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T18:03:45.731 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/604 2024-03-27T18:03:45.731 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/604 2024-03-27T18:03:45.731 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:03:45.739 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:03:45.770 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:03:45.771 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/605) 2024-03-27T18:03:46.319 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:03:46.330 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:03:46.330 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:03:46.724 INFO:teuthology.orchestra.run.smithi057.stdout:generic/605 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T18:03:46.734 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/605 2024-03-27T18:03:46.734 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/605 2024-03-27T18:03:46.734 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:03:46.743 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:03:46.768 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:03:46.769 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/606) 2024-03-27T18:03:47.278 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:03:47.293 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:03:47.293 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:03:47.318 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T18:03:47.323 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T18:03:47.667 INFO:teuthology.orchestra.run.smithi057.stdout:generic/606 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T18:03:47.680 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/606 2024-03-27T18:03:47.680 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/606 2024-03-27T18:03:47.680 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:03:47.691 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:03:47.719 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:03:47.719 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/607) 2024-03-27T18:03:48.264 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:03:48.275 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:03:48.275 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:03:48.724 INFO:teuthology.orchestra.run.smithi057.stdout:generic/607 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T18:03:48.736 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/607 2024-03-27T18:03:48.736 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/607 2024-03-27T18:03:48.736 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:03:48.745 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:03:48.769 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:03:48.769 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/608) 2024-03-27T18:03:49.296 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:03:49.307 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:03:49.307 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:03:49.670 INFO:teuthology.orchestra.run.smithi057.stdout:generic/608 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T18:03:49.680 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/608 2024-03-27T18:03:49.680 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/608 2024-03-27T18:03:49.681 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:03:49.687 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:03:49.716 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:03:49.716 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/609) 2024-03-27T18:03:50.262 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:03:50.275 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:03:50.275 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:03:51.343 INFO:teuthology.orchestra.run.smithi057.stdout:generic/609 1s 2024-03-27T18:03:51.363 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/609 2024-03-27T18:03:51.363 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:03:51.371 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:03:51.417 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:03:51.417 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/610) 2024-03-27T18:03:52.176 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:03:52.187 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:03:52.187 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:03:52.596 INFO:teuthology.orchestra.run.smithi057.stdout:generic/610 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T18:03:52.610 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/610 2024-03-27T18:03:52.611 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/610 2024-03-27T18:03:52.611 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:03:52.623 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:03:52.658 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:03:52.658 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/611) 2024-03-27T18:03:53.194 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:03:53.208 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:03:53.208 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:03:53.739 INFO:teuthology.orchestra.run.smithi057.stdout:generic/611 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T18:03:53.752 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/611 2024-03-27T18:03:53.752 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/611 2024-03-27T18:03:53.753 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:03:53.764 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:03:53.797 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:03:53.797 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/612) 2024-03-27T18:03:54.370 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:03:54.382 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:03:54.382 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:03:54.933 INFO:teuthology.orchestra.run.smithi057.stdout:generic/612 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-03-27T18:03:54.946 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/612 2024-03-27T18:03:54.946 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/612 2024-03-27T18:03:54.946 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:03:54.957 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:03:55.011 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:03:55.012 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/613) 2024-03-27T18:03:55.766 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:03:55.778 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:03:55.778 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:03:56.285 INFO:teuthology.orchestra.run.smithi057.stdout:generic/613 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T18:03:56.296 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/613 2024-03-27T18:03:56.296 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/613 2024-03-27T18:03:56.296 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:03:56.305 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:03:56.336 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:03:56.337 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/614) 2024-03-27T18:03:56.872 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:03:56.886 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:03:56.886 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:03:57.369 INFO:teuthology.orchestra.run.smithi057.stdout:generic/614 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T18:03:57.383 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/614 2024-03-27T18:03:57.383 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/614 2024-03-27T18:03:57.384 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:03:57.395 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:03:57.429 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:03:57.429 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/615) 2024-03-27T18:03:57.989 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:03:58.000 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:03:58.000 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:03:58.380 INFO:teuthology.orchestra.run.smithi057.stdout:generic/615 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T18:03:58.396 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/615 2024-03-27T18:03:58.396 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/615 2024-03-27T18:03:58.396 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:03:58.408 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:03:58.444 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:03:58.444 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/616) 2024-03-27T18:03:59.005 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:03:59.017 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:03:59.017 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:03:59.455 INFO:teuthology.orchestra.run.smithi057.stdout:generic/616 [not run] kernel does not support IO_URING 2024-03-27T18:03:59.466 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/616 2024-03-27T18:03:59.467 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/616 2024-03-27T18:03:59.467 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:03:59.477 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:03:59.510 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:03:59.510 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/617) 2024-03-27T18:04:00.018 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:04:00.030 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:04:00.030 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:04:00.568 INFO:teuthology.orchestra.run.smithi057.stdout:generic/617 [not run] kernel does not support IO_URING 2024-03-27T18:04:00.582 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/617 2024-03-27T18:04:00.582 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/617 2024-03-27T18:04:00.582 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:04:00.594 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:04:00.628 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:04:00.629 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/618) 2024-03-27T18:04:01.151 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:04:01.163 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:04:01.163 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:04:01.546 INFO:teuthology.orchestra.run.smithi057.stdout:generic/618 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T18:04:01.558 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/618 2024-03-27T18:04:01.558 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/618 2024-03-27T18:04:01.558 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:04:01.567 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:04:01.599 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:04:01.599 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/619) 2024-03-27T18:04:02.129 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:04:02.140 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:04:02.140 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:04:02.521 INFO:teuthology.orchestra.run.smithi057.stdout:generic/619 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T18:04:02.533 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/619 2024-03-27T18:04:02.533 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/619 2024-03-27T18:04:02.533 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:04:02.542 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:04:02.570 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:04:02.570 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/620) 2024-03-27T18:04:03.128 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:04:03.139 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:04:03.139 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:04:03.664 INFO:teuthology.orchestra.run.smithi057.stdout:generic/620 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T18:04:03.675 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/620 2024-03-27T18:04:03.675 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/620 2024-03-27T18:04:03.675 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:04:03.687 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:04:03.715 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:04:03.715 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/621) 2024-03-27T18:04:04.258 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:04:04.272 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:04:04.272 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:04:04.768 INFO:teuthology.orchestra.run.smithi057.stdout:generic/621 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T18:04:04.782 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/621 2024-03-27T18:04:04.782 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/621 2024-03-27T18:04:04.782 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:04:04.788 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:04:04.819 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:04:04.820 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/622) 2024-03-27T18:04:05.398 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:04:05.408 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:04:05.409 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:04:05.817 INFO:teuthology.orchestra.run.smithi057.stdout:generic/622 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T18:04:05.828 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/622 2024-03-27T18:04:05.828 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/622 2024-03-27T18:04:05.828 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:04:05.837 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:04:05.864 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:04:05.864 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/623) 2024-03-27T18:04:06.418 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:04:06.427 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:04:06.427 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:04:06.868 INFO:teuthology.orchestra.run.smithi057.stdout:generic/623 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T18:04:06.879 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/623 2024-03-27T18:04:06.879 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/623 2024-03-27T18:04:06.879 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:04:06.887 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:04:06.917 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:04:06.917 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/624) 2024-03-27T18:04:07.492 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:04:07.505 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:04:07.505 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:04:07.926 INFO:teuthology.orchestra.run.smithi057.stdout:generic/624 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T18:04:07.940 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/624 2024-03-27T18:04:07.940 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/624 2024-03-27T18:04:07.940 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:04:07.951 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:04:07.980 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:04:07.980 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/625) 2024-03-27T18:04:08.560 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:04:08.573 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:04:08.573 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:04:09.014 INFO:teuthology.orchestra.run.smithi057.stdout:generic/625 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T18:04:09.026 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/625 2024-03-27T18:04:09.026 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/625 2024-03-27T18:04:09.026 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:04:09.035 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:04:09.062 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:04:09.062 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/626) 2024-03-27T18:04:09.571 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:04:09.582 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:04:09.582 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:04:09.988 INFO:teuthology.orchestra.run.smithi057.stdout:generic/626 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T18:04:09.999 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/626 2024-03-27T18:04:09.999 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/626 2024-03-27T18:04:09.999 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:04:10.007 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:04:10.037 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:04:10.037 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/627) 2024-03-27T18:04:10.588 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:04:10.601 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:04:10.602 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:04:11.020 INFO:teuthology.orchestra.run.smithi057.stdout:generic/627 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T18:04:11.031 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/627 2024-03-27T18:04:11.031 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/627 2024-03-27T18:04:11.031 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:04:11.039 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:04:11.067 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:04:11.068 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/628) 2024-03-27T18:04:11.653 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:04:11.665 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:04:11.666 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:04:12.109 INFO:teuthology.orchestra.run.smithi057.stdout:generic/628 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T18:04:12.121 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/628 2024-03-27T18:04:12.122 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/628 2024-03-27T18:04:12.122 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:04:12.132 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:04:12.165 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:04:12.165 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/629) 2024-03-27T18:04:12.752 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:04:12.767 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:04:12.768 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:04:13.294 INFO:teuthology.orchestra.run.smithi057.stdout:generic/629 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T18:04:13.308 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/629 2024-03-27T18:04:13.308 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/629 2024-03-27T18:04:13.309 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:04:13.320 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:04:13.350 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:04:13.350 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/630) 2024-03-27T18:04:13.903 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:04:13.916 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:04:13.916 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:04:14.316 INFO:teuthology.orchestra.run.smithi057.stdout:generic/630 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T18:04:14.329 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/630 2024-03-27T18:04:14.329 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/630 2024-03-27T18:04:14.330 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:04:14.341 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:04:14.373 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:04:14.374 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/631) 2024-03-27T18:04:14.887 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:04:14.899 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:04:14.899 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:04:15.333 INFO:teuthology.orchestra.run.smithi057.stdout:generic/631 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T18:04:15.346 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/631 2024-03-27T18:04:15.346 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/631 2024-03-27T18:04:15.346 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:04:15.355 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:04:15.387 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:04:15.387 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/632) 2024-03-27T18:04:15.968 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:04:15.979 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:04:15.980 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:04:17.584 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T18:04:17.593 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T18:04:35.663 INFO:teuthology.orchestra.run.smithi057.stdout:generic/632 19s 2024-03-27T18:04:35.682 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/632 2024-03-27T18:04:35.682 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:04:35.692 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:04:35.725 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:04:35.726 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/633) 2024-03-27T18:04:36.266 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:04:36.282 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:04:36.282 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:04:37.142 INFO:teuthology.orchestra.run.smithi057.stdout:generic/633 [failed, exit status 1]- output mismatch (see /tmp/tmp.446sL8UEHrxfstests-dev/results//generic/633.out.bad) 2024-03-27T18:04:37.168 INFO:teuthology.orchestra.run.smithi057.stdout: --- tests/generic/633.out 2024-03-27 10:01:36.041467020 +0000 2024-03-27T18:04:37.168 INFO:teuthology.orchestra.run.smithi057.stdout: +++ /tmp/tmp.446sL8UEHrxfstests-dev/results//generic/633.out.bad 2024-03-27 18:04:37.131035808 +0000 2024-03-27T18:04:37.168 INFO:teuthology.orchestra.run.smithi057.stdout: @@ -1,2 +1,5 @@ 2024-03-27T18:04:37.168 INFO:teuthology.orchestra.run.smithi057.stdout: QA output created by 633 2024-03-27T18:04:37.168 INFO:teuthology.orchestra.run.smithi057.stdout: Silence is golden 2024-03-27T18:04:37.168 INFO:teuthology.orchestra.run.smithi057.stdout: +vfstest.c: 1164: protected_symlinks - Success - failure: openat 2024-03-27T18:04:37.168 INFO:teuthology.orchestra.run.smithi057.stdout: +vfstest.c: 1171: protected_symlinks - Success - failure: wait_for_pid 2024-03-27T18:04:37.168 INFO:teuthology.orchestra.run.smithi057.stdout: +vfstest.c: 2418: run_test - Success - failure: following protected symlinks on regular mounts 2024-03-27T18:04:37.181 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/633 2024-03-27T18:04:37.181 INFO:teuthology.orchestra.run.smithi057.stdout:Failures: generic/633 2024-03-27T18:04:37.181 INFO:teuthology.orchestra.run.smithi057.stdout:Failed 1 of 1 tests 2024-03-27T18:04:37.198 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:04:37.250 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-27T18:04:37.250 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-03-27T18:04:37.250 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-03-27T18:04:37.250 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/634) 2024-03-27T18:04:37.893 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:04:37.905 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:04:37.905 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:04:38.281 INFO:teuthology.orchestra.run.smithi057.stdout:generic/634 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T18:04:38.292 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/634 2024-03-27T18:04:38.292 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/634 2024-03-27T18:04:38.292 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:04:38.301 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:04:38.327 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:04:38.328 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/635) 2024-03-27T18:04:38.805 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:04:38.819 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:04:38.819 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:04:39.234 INFO:teuthology.orchestra.run.smithi057.stdout:generic/635 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T18:04:39.244 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/635 2024-03-27T18:04:39.245 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/635 2024-03-27T18:04:39.245 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:04:39.253 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:04:39.284 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:04:39.284 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/636) 2024-03-27T18:04:39.856 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:04:39.871 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:04:39.871 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:04:40.265 INFO:teuthology.orchestra.run.smithi057.stdout:generic/636 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T18:04:40.276 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/636 2024-03-27T18:04:40.277 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/636 2024-03-27T18:04:40.277 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:04:40.287 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:04:40.319 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:04:40.319 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/637) 2024-03-27T18:04:40.873 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:04:40.886 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:04:40.887 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:04:43.832 INFO:teuthology.orchestra.run.smithi057.stdout:generic/637 3s 2024-03-27T18:04:43.853 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/637 2024-03-27T18:04:43.853 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:04:43.862 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:04:43.896 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:04:43.896 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/638) 2024-03-27T18:04:44.690 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:04:44.701 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:04:44.701 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:04:45.819 INFO:teuthology.orchestra.run.smithi057.stdout:generic/638 1s 2024-03-27T18:04:45.837 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/638 2024-03-27T18:04:45.837 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:04:45.846 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:04:45.876 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:04:45.876 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/639) 2024-03-27T18:04:46.388 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:04:46.401 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:04:46.401 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:04:47.392 INFO:teuthology.orchestra.run.smithi057.stdout:generic/639 1s 2024-03-27T18:04:47.410 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/639 2024-03-27T18:04:47.410 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:04:47.417 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:04:47.445 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:04:47.446 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/640) 2024-03-27T18:04:47.736 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T18:04:47.741 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T18:04:47.995 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:04:48.007 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:04:48.007 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:04:48.578 INFO:teuthology.orchestra.run.smithi057.stdout:generic/640 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T18:04:48.593 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/640 2024-03-27T18:04:48.593 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/640 2024-03-27T18:04:48.593 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:04:48.606 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:04:48.641 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:04:48.641 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/641) 2024-03-27T18:04:49.203 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:04:49.214 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:04:49.214 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:04:49.596 INFO:teuthology.orchestra.run.smithi057.stdout:generic/641 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T18:04:49.608 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/641 2024-03-27T18:04:49.608 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/641 2024-03-27T18:04:49.608 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:04:49.617 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:04:49.645 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:04:49.646 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/642) 2024-03-27T18:04:50.180 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:04:50.193 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:04:50.193 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:04:50.644 INFO:teuthology.orchestra.run.smithi057.stdout:generic/642 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T18:04:50.659 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/642 2024-03-27T18:04:50.659 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/642 2024-03-27T18:04:50.660 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:04:50.672 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:04:50.704 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:04:50.704 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/643) 2024-03-27T18:04:51.259 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:04:51.273 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:04:51.273 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:04:51.695 INFO:teuthology.orchestra.run.smithi057.stdout:generic/643 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T18:04:51.706 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/643 2024-03-27T18:04:51.706 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/643 2024-03-27T18:04:51.706 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:04:51.714 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:04:51.744 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:04:51.744 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/644) 2024-03-27T18:04:52.304 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:04:52.317 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:04:52.317 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:04:52.707 INFO:teuthology.orchestra.run.smithi057.stdout:generic/644 [not run] vfstest not support by ceph-fuse 2024-03-27T18:04:52.720 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/644 2024-03-27T18:04:52.720 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/644 2024-03-27T18:04:52.720 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:04:52.729 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:04:52.759 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:04:52.759 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/645) 2024-03-27T18:04:53.293 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:04:53.306 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:04:53.306 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:04:53.718 INFO:teuthology.orchestra.run.smithi057.stdout:generic/645 [not run] vfstest not support by ceph-fuse 2024-03-27T18:04:53.729 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/645 2024-03-27T18:04:53.729 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/645 2024-03-27T18:04:53.729 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:04:53.737 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:04:53.767 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:04:53.767 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/646) 2024-03-27T18:04:54.324 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:04:54.336 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:04:54.336 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:04:54.743 INFO:teuthology.orchestra.run.smithi057.stdout:generic/646 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T18:04:54.752 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/646 2024-03-27T18:04:54.752 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/646 2024-03-27T18:04:54.752 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:04:54.760 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:04:54.784 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:04:54.785 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/647) 2024-03-27T18:04:55.316 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:04:55.328 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:04:55.328 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:04:56.157 INFO:teuthology.orchestra.run.smithi057.stdout:generic/647 1s 2024-03-27T18:04:56.174 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/647 2024-03-27T18:04:56.174 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:04:56.183 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:04:56.229 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:04:56.230 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/648) 2024-03-27T18:04:56.994 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:04:57.004 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:04:57.004 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:04:57.485 INFO:teuthology.orchestra.run.smithi057.stdout:generic/648 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T18:04:57.499 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/648 2024-03-27T18:04:57.499 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/648 2024-03-27T18:04:57.500 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:04:57.511 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:04:57.543 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:04:57.543 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/649) 2024-03-27T18:04:58.109 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:04:58.120 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:04:58.120 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:04:58.686 INFO:teuthology.orchestra.run.smithi057.stdout:generic/649 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-03-27T18:04:58.700 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/649 2024-03-27T18:04:58.701 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/649 2024-03-27T18:04:58.701 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T18:04:58.711 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:04:58.763 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T18:04:58.763 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/650) 2024-03-27T18:04:59.525 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T18:04:59.537 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T18:04:59.537 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T18:05:17.902 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T18:05:17.909 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T18:05:18.403 INFO:tasks.ceph.osd.1.smithi057.stderr:2024-03-27T18:05:18.403+0000 7f8202600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 505974) UID: 0 2024-03-27T18:05:18.404 INFO:tasks.ceph.osd.2.smithi057.stderr:2024-03-27T18:05:18.401+0000 7f1380800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 505974) UID: 0 2024-03-27T18:05:18.410 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-03-27T18:05:18.403+0000 7f622b800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 505974) UID: 0 2024-03-27T18:05:18.410 INFO:tasks.ceph.osd.3.smithi057.stderr:2024-03-27T18:05:18.405+0000 7f009f600640 -1 Fail to open '/proc/505974/cmdline' error = (2) No such file or directory 2024-03-27T18:05:18.410 INFO:tasks.ceph.osd.3.smithi057.stderr:2024-03-27T18:05:18.405+0000 7f009f600640 -1 received signal: Hangup from (PID: 505974) UID: 0 2024-03-27T18:11:06.554 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T18:11:06.563 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T18:11:36.730 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T18:11:36.739 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T18:11:36.833 INFO:tasks.ceph.osd.6.smithi118.stderr:2024-03-27T18:11:36.833+0000 7efe94a00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 58294) UID: 0 2024-03-27T18:11:36.834 INFO:tasks.ceph.osd.7.smithi118.stderr:2024-03-27T18:11:36.833+0000 7fdba0200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 58294) UID: 0 2024-03-27T18:11:36.834 INFO:tasks.ceph.osd.4.smithi118.stderr:2024-03-27T18:11:36.833+0000 7f3737600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 58294) UID: 0 2024-03-27T18:11:36.835 INFO:tasks.ceph.osd.5.smithi118.stderr:2024-03-27T18:11:36.833+0000 7fa84c200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 58294) UID: 0 2024-03-27T18:15:08.253 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T18:15:08.269 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T18:15:08.491 INFO:tasks.ceph.mds.c.smithi057.stderr:2024-03-27T18:15:08.490+0000 7f1f8ba00640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 507821) UID: 0 2024-03-27T18:15:08.495 INFO:tasks.ceph.mds.a.smithi057.stderr:2024-03-27T18:15:08.495+0000 7f0ffc400640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 507821) UID: 0 2024-03-27T18:20:57.020 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T18:20:57.031 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T18:20:57.130 INFO:tasks.ceph.osd.6.smithi118.stderr:2024-03-27T18:20:57.129+0000 7efe94a00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 58356) UID: 0 2024-03-27T18:20:57.130 INFO:tasks.ceph.osd.7.smithi118.stderr:2024-03-27T18:20:57.129+0000 7fdba0200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 58356) UID: 0 2024-03-27T18:20:57.131 INFO:tasks.ceph.osd.4.smithi118.stderr:2024-03-27T18:20:57.129+0000 7f3737600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 58356) UID: 0 2024-03-27T18:20:57.131 INFO:tasks.ceph.osd.5.smithi118.stderr:2024-03-27T18:20:57.129+0000 7fa84c200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 58356) UID: 0 2024-03-27T18:24:48.220 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T18:24:48.227 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T18:24:48.322 INFO:tasks.ceph.osd.4.smithi118.stderr:2024-03-27T18:24:48.321+0000 7f3737600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 58393) UID: 0 2024-03-27T18:24:48.323 INFO:tasks.ceph.osd.6.smithi118.stderr:2024-03-27T18:24:48.321+0000 7efe94a00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 58393) UID: 0 2024-03-27T18:24:48.323 INFO:tasks.ceph.osd.5.smithi118.stderr:2024-03-27T18:24:48.321+0000 7fa84c200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 58393) UID: 0 2024-03-27T18:24:48.323 INFO:tasks.ceph.osd.7.smithi118.stderr:2024-03-27T18:24:48.321+0000 7fdba0200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 58393) UID: 0 2024-03-27T18:28:29.460 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T18:28:29.470 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T18:28:29.634 INFO:tasks.ceph.osd.1.smithi057.stderr:2024-03-27T18:28:29.628+0000 7f8202600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 510270) UID: 0 2024-03-27T18:28:29.634 INFO:tasks.ceph.osd.3.smithi057.stderr:2024-03-27T18:28:29.632+0000 7f009f600640 -1 Fail to open '/proc/510270/cmdline' error = (2) No such file or directory 2024-03-27T18:28:29.635 INFO:tasks.ceph.osd.3.smithi057.stderr:2024-03-27T18:28:29.632+0000 7f009f600640 -1 received signal: Hangup from (PID: 510270) UID: 0 2024-03-27T18:28:29.639 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-03-27T18:28:29.636+0000 7f622b800640 -1 Fail to open '/proc/510270/cmdline' error = (2) No such file or directory 2024-03-27T18:28:29.639 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-03-27T18:28:29.637+0000 7f622b800640 -1 received signal: Hangup from (PID: 510270) UID: 0 2024-03-27T18:28:29.654 INFO:tasks.ceph.osd.2.smithi057.stderr:2024-03-27T18:28:29.653+0000 7f1380800640 -1 Fail to open '/proc/510270/cmdline' error = (2) No such file or directory 2024-03-27T18:28:29.655 INFO:tasks.ceph.osd.2.smithi057.stderr:2024-03-27T18:28:29.653+0000 7f1380800640 -1 received signal: Hangup from (PID: 510270) UID: 0 2024-03-27T18:34:33.315 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T18:34:33.325 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T18:34:33.422 INFO:tasks.ceph.osd.6.smithi118.stderr:2024-03-27T18:34:33.422+0000 7efe94a00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 58447) UID: 0 2024-03-27T18:34:33.422 INFO:tasks.ceph.osd.7.smithi118.stderr:2024-03-27T18:34:33.422+0000 7fdba0200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 58447) UID: 0 2024-03-27T18:34:33.423 INFO:tasks.ceph.osd.4.smithi118.stderr:2024-03-27T18:34:33.422+0000 7f3737600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 58447) UID: 0 2024-03-27T18:34:33.423 INFO:tasks.ceph.osd.5.smithi118.stderr:2024-03-27T18:34:33.422+0000 7fa84c200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 58447) UID: 0 2024-03-27T18:38:29.898 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T18:38:29.905 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T18:39:00.064 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T18:39:00.076 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T18:39:30.319 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T18:39:30.330 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T18:40:00.610 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T18:40:00.624 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T18:40:00.827 INFO:tasks.ceph.mds.c.smithi057.stderr:2024-03-27T18:40:00.826+0000 7f1f8ba00640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 512459) UID: 0 2024-03-27T18:40:00.827 INFO:tasks.ceph.mds.a.smithi057.stderr:2024-03-27T18:40:00.826+0000 7f0ffc400640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 512459) UID: 0 2024-03-27T18:44:46.491 INFO:tasks.ceph.osd.1.smithi057.stderr:2024-03-27T18:44:46.489+0000 7f8202600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 513409) UID: 0 2024-03-27T18:44:46.492 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-03-27T18:44:46.490+0000 7f622b800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 513409) UID: 0 2024-03-27T18:44:46.492 INFO:tasks.ceph.osd.3.smithi057.stderr:2024-03-27T18:44:46.490+0000 7f009f600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 513409) UID: 0 2024-03-27T18:44:46.492 INFO:tasks.ceph.osd.2.smithi057.stderr:2024-03-27T18:44:46.490+0000 7f1380800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 513409) UID: 0 2024-03-27T18:56:30.155 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T18:56:30.163 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T18:56:30.297 INFO:tasks.ceph.osd.5.smithi118.stderr:2024-03-27T18:56:30.294+0000 7fa84c200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 58587) UID: 0 2024-03-27T18:56:30.309 INFO:tasks.ceph.osd.6.smithi118.stderr:2024-03-27T18:56:30.294+0000 7efe94a00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 58587) UID: 0 2024-03-27T18:56:30.310 INFO:tasks.ceph.osd.4.smithi118.stderr:2024-03-27T18:56:30.294+0000 7f3737600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 58587) UID: 0 2024-03-27T18:56:30.313 INFO:tasks.ceph.osd.7.smithi118.stderr:2024-03-27T18:56:30.298+0000 7fdba0200640 -1 Fail to open '/proc/58587/cmdline' error = (2) No such file or directory 2024-03-27T18:56:30.314 INFO:tasks.ceph.osd.7.smithi118.stderr:2024-03-27T18:56:30.298+0000 7fdba0200640 -1 received signal: Hangup from (PID: 58587) UID: 0 2024-03-27T19:00:12.264 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T19:00:12.270 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T19:00:42.459 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T19:00:42.467 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T19:01:12.627 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T19:01:12.638 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T19:01:42.813 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T19:01:42.818 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T19:02:12.992 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T19:02:12.999 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T19:02:43.113 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T19:02:43.120 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T19:03:13.343 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T19:03:13.351 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T19:03:43.614 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T19:03:43.626 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T19:04:13.829 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T19:04:13.846 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T19:04:14.200 INFO:tasks.ceph.mds.c.smithi057.stderr:2024-03-27T19:04:14.199+0000 7f1f8ba00640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 517131) UID: 0 2024-03-27T19:04:14.205 INFO:tasks.ceph.mds.a.smithi057.stderr:2024-03-27T19:04:14.201+0000 7f0ffc400640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 517131) UID: 0 2024-03-27T19:08:58.075 INFO:tasks.ceph.osd.2.smithi057.stderr:2024-03-27T19:08:58.073+0000 7f1380800640 -1 Fail to open '/proc/517902/cmdline' error = (2) No such file or directory 2024-03-27T19:08:58.076 INFO:tasks.ceph.osd.2.smithi057.stderr:2024-03-27T19:08:58.073+0000 7f1380800640 -1 received signal: Hangup from (PID: 517902) UID: 0 2024-03-27T19:08:58.076 INFO:tasks.ceph.osd.3.smithi057.stderr:2024-03-27T19:08:58.073+0000 7f009f600640 -1 Fail to open '/proc/517902/cmdline' error = (2) No such file or directory 2024-03-27T19:08:58.076 INFO:tasks.ceph.osd.3.smithi057.stderr:2024-03-27T19:08:58.073+0000 7f009f600640 -1 received signal: Hangup from (PID: 517902) UID: 0 2024-03-27T19:08:58.077 INFO:tasks.ceph.osd.1.smithi057.stderr:2024-03-27T19:08:58.072+0000 7f8202600640 -1 received signal: Hangup from (PID: 517902) UID: 0 2024-03-27T19:08:58.091 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-03-27T19:08:58.072+0000 7f622b800640 -1 received signal: Hangup from (PID: 517902) UID: 0 2024-03-27T19:14:52.435 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T19:14:52.442 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T19:14:52.540 INFO:tasks.ceph.osd.7.smithi118.stderr:2024-03-27T19:14:52.540+0000 7fdba0200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 58808) UID: 0 2024-03-27T19:14:52.541 INFO:tasks.ceph.osd.6.smithi118.stderr:2024-03-27T19:14:52.540+0000 7efe94a00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 58808) UID: 0 2024-03-27T19:14:52.541 INFO:tasks.ceph.osd.5.smithi118.stderr:2024-03-27T19:14:52.540+0000 7fa84c200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 58808) UID: 0 2024-03-27T19:14:52.541 INFO:tasks.ceph.osd.4.smithi118.stderr:2024-03-27T19:14:52.540+0000 7f3737600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 58808) UID: 0 2024-03-27T19:15:43.213 INFO:teuthology.orchestra.run.smithi057.stdout:generic/650 4240s 2024-03-27T19:15:44.642 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/650 2024-03-27T19:15:44.642 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T19:15:44.653 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:15:44.683 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T19:15:44.683 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/651) 2024-03-27T19:15:45.374 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T19:15:45.390 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T19:15:45.390 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:15:45.856 INFO:teuthology.orchestra.run.smithi057.stdout:generic/651 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T19:15:45.868 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/651 2024-03-27T19:15:45.868 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/651 2024-03-27T19:15:45.869 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T19:15:45.877 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:15:45.909 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T19:15:45.909 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/652) 2024-03-27T19:15:46.643 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T19:15:46.661 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T19:15:46.662 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:15:47.160 INFO:teuthology.orchestra.run.smithi057.stdout:generic/652 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T19:15:47.175 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/652 2024-03-27T19:15:47.175 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/652 2024-03-27T19:15:47.175 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T19:15:47.189 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:15:47.234 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T19:15:47.235 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/653) 2024-03-27T19:15:47.960 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T19:15:47.978 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T19:15:47.978 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:15:48.470 INFO:teuthology.orchestra.run.smithi057.stdout:generic/653 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T19:15:48.482 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/653 2024-03-27T19:15:48.482 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/653 2024-03-27T19:15:48.482 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T19:15:48.491 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:15:48.525 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T19:15:48.525 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/654) 2024-03-27T19:15:49.201 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T19:15:49.211 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T19:15:49.212 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:15:49.668 INFO:teuthology.orchestra.run.smithi057.stdout:generic/654 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T19:15:49.682 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/654 2024-03-27T19:15:49.683 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/654 2024-03-27T19:15:49.683 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T19:15:49.693 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:15:49.726 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T19:15:49.727 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/655) 2024-03-27T19:15:50.390 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T19:15:50.404 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T19:15:50.405 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:15:50.811 INFO:teuthology.orchestra.run.smithi057.stdout:generic/655 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T19:15:50.826 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/655 2024-03-27T19:15:50.826 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/655 2024-03-27T19:15:50.826 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T19:15:50.838 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:15:50.873 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T19:15:50.874 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/656) 2024-03-27T19:15:51.538 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T19:15:51.555 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T19:15:51.555 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:15:52.033 INFO:teuthology.orchestra.run.smithi057.stdout:generic/656 [not run] vfstest not support by ceph-fuse 2024-03-27T19:15:52.045 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/656 2024-03-27T19:15:52.045 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/656 2024-03-27T19:15:52.045 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T19:15:52.053 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:15:52.084 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T19:15:52.084 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/657) 2024-03-27T19:15:52.719 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T19:15:52.732 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T19:15:52.732 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:15:53.171 INFO:teuthology.orchestra.run.smithi057.stdout:generic/657 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T19:15:53.186 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/657 2024-03-27T19:15:53.186 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/657 2024-03-27T19:15:53.186 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T19:15:53.197 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:15:53.225 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T19:15:53.226 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/658) 2024-03-27T19:15:53.885 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T19:15:53.904 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T19:15:53.905 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:15:54.351 INFO:teuthology.orchestra.run.smithi057.stdout:generic/658 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T19:15:54.364 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/658 2024-03-27T19:15:54.364 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/658 2024-03-27T19:15:54.364 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T19:15:54.376 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:15:54.418 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T19:15:54.419 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/659) 2024-03-27T19:15:55.098 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T19:15:55.114 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T19:15:55.114 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:15:55.556 INFO:teuthology.orchestra.run.smithi057.stdout:generic/659 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T19:15:55.566 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/659 2024-03-27T19:15:55.566 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/659 2024-03-27T19:15:55.566 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T19:15:55.577 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:15:55.621 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T19:15:55.621 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/660) 2024-03-27T19:15:56.297 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T19:15:56.313 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T19:15:56.313 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:15:56.758 INFO:teuthology.orchestra.run.smithi057.stdout:generic/660 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T19:15:56.778 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/660 2024-03-27T19:15:56.778 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/660 2024-03-27T19:15:56.778 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T19:15:56.788 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:15:56.815 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T19:15:56.815 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/661) 2024-03-27T19:15:57.515 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T19:15:57.528 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T19:15:57.528 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:15:57.983 INFO:teuthology.orchestra.run.smithi057.stdout:generic/661 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T19:15:57.995 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/661 2024-03-27T19:15:57.995 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/661 2024-03-27T19:15:57.996 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T19:15:58.006 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:15:58.045 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T19:15:58.045 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/662) 2024-03-27T19:15:58.729 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T19:15:58.746 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T19:15:58.747 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:15:59.163 INFO:teuthology.orchestra.run.smithi057.stdout:generic/662 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T19:15:59.173 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/662 2024-03-27T19:15:59.173 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/662 2024-03-27T19:15:59.173 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T19:15:59.181 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:15:59.213 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T19:15:59.213 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/663) 2024-03-27T19:15:59.839 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T19:15:59.859 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T19:15:59.859 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:16:00.287 INFO:teuthology.orchestra.run.smithi057.stdout:generic/663 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T19:16:00.298 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/663 2024-03-27T19:16:00.298 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/663 2024-03-27T19:16:00.299 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T19:16:00.307 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:16:00.341 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T19:16:00.341 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/664) 2024-03-27T19:16:00.998 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T19:16:01.012 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T19:16:01.013 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:16:01.460 INFO:teuthology.orchestra.run.smithi057.stdout:generic/664 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T19:16:01.473 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/664 2024-03-27T19:16:01.473 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/664 2024-03-27T19:16:01.473 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T19:16:01.483 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:16:01.516 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T19:16:01.517 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/665) 2024-03-27T19:16:02.179 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T19:16:02.195 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T19:16:02.195 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:16:02.649 INFO:teuthology.orchestra.run.smithi057.stdout:generic/665 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T19:16:02.663 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/665 2024-03-27T19:16:02.664 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/665 2024-03-27T19:16:02.664 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T19:16:02.674 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:16:02.704 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T19:16:02.704 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/666) 2024-03-27T19:16:03.311 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T19:16:03.328 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T19:16:03.328 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:16:03.723 INFO:teuthology.orchestra.run.smithi057.stdout:generic/666 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T19:16:03.736 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/666 2024-03-27T19:16:03.736 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/666 2024-03-27T19:16:03.736 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T19:16:03.746 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:16:03.771 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T19:16:03.771 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/667) 2024-03-27T19:16:04.398 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T19:16:04.413 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T19:16:04.413 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:16:04.869 INFO:teuthology.orchestra.run.smithi057.stdout:generic/667 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T19:16:04.882 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/667 2024-03-27T19:16:04.882 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/667 2024-03-27T19:16:04.882 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T19:16:04.893 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:16:04.933 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T19:16:04.934 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/668) 2024-03-27T19:16:05.588 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T19:16:05.605 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T19:16:05.605 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:16:06.024 INFO:teuthology.orchestra.run.smithi057.stdout:generic/668 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T19:16:06.036 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/668 2024-03-27T19:16:06.036 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/668 2024-03-27T19:16:06.036 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T19:16:06.044 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:16:06.073 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T19:16:06.073 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/669) 2024-03-27T19:16:06.726 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T19:16:06.738 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T19:16:06.738 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:16:07.181 INFO:teuthology.orchestra.run.smithi057.stdout:generic/669 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T19:16:07.193 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/669 2024-03-27T19:16:07.194 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/669 2024-03-27T19:16:07.194 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T19:16:07.201 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:16:07.229 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T19:16:07.230 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/670) 2024-03-27T19:16:07.901 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T19:16:07.917 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T19:16:07.917 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:16:08.359 INFO:teuthology.orchestra.run.smithi057.stdout:generic/670 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T19:16:08.370 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/670 2024-03-27T19:16:08.370 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/670 2024-03-27T19:16:08.370 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T19:16:08.380 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:16:08.418 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T19:16:08.419 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/671) 2024-03-27T19:16:09.092 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T19:16:09.109 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T19:16:09.109 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:16:09.547 INFO:teuthology.orchestra.run.smithi057.stdout:generic/671 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T19:16:09.558 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/671 2024-03-27T19:16:09.558 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/671 2024-03-27T19:16:09.558 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T19:16:09.568 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:16:09.600 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T19:16:09.600 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/672) 2024-03-27T19:16:10.260 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T19:16:10.276 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T19:16:10.276 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:16:11.138 INFO:teuthology.orchestra.run.smithi057.stdout:generic/672 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T19:16:11.151 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/672 2024-03-27T19:16:11.151 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/672 2024-03-27T19:16:11.151 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T19:16:11.161 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:16:11.194 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T19:16:11.195 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/673) 2024-03-27T19:16:11.826 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T19:16:11.841 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T19:16:11.842 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:16:13.627 INFO:teuthology.orchestra.run.smithi057.stdout:generic/673 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T19:16:13.640 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/673 2024-03-27T19:16:13.640 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/673 2024-03-27T19:16:13.640 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T19:16:13.650 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:16:13.685 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T19:16:13.686 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/674) 2024-03-27T19:16:14.317 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T19:16:14.334 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T19:16:14.334 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:16:14.854 INFO:teuthology.orchestra.run.smithi057.stdout:generic/674 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T19:16:14.869 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/674 2024-03-27T19:16:14.869 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/674 2024-03-27T19:16:14.869 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T19:16:14.878 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:16:14.920 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T19:16:14.921 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/675) 2024-03-27T19:16:15.581 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T19:16:15.592 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T19:16:15.593 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:16:16.141 INFO:teuthology.orchestra.run.smithi057.stdout:generic/675 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T19:16:16.157 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/675 2024-03-27T19:16:16.157 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/675 2024-03-27T19:16:16.158 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T19:16:16.169 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:16:16.200 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T19:16:16.200 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/676) 2024-03-27T19:16:16.870 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T19:16:16.884 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T19:16:16.884 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:18:39.448 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T19:18:39.455 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T19:18:39.609 INFO:tasks.ceph.mds.c.smithi057.stderr:2024-03-27T19:18:39.609+0000 7f1f8ba00640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 529578) UID: 0 2024-03-27T19:18:39.609 INFO:tasks.ceph.mds.a.smithi057.stderr:2024-03-27T19:18:39.609+0000 7f0ffc400640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 529578) UID: 0 2024-03-27T19:25:53.730 INFO:tasks.ceph.osd.2.smithi057.stderr:2024-03-27T19:25:53.726+0000 7f1380800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 529595) UID: 0 2024-03-27T19:25:53.730 INFO:tasks.ceph.osd.3.smithi057.stderr:2024-03-27T19:25:53.726+0000 7f009f600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 529595) UID: 0 2024-03-27T19:25:53.731 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-03-27T19:25:53.727+0000 7f622b800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 529595) UID: 0 2024-03-27T19:25:53.731 INFO:tasks.ceph.osd.1.smithi057.stderr:2024-03-27T19:25:53.726+0000 7f8202600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 529595) UID: 0 2024-03-27T19:34:35.951 DEBUG:teuthology.orchestra.run.smithi057:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T19:34:35.960 DEBUG:teuthology.orchestra.run.smithi118:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-27T19:34:36.357 INFO:tasks.ceph.osd.4.smithi118.stderr:2024-03-27T19:34:36.356+0000 7f3737600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 58862) UID: 0 2024-03-27T19:34:36.358 INFO:tasks.ceph.osd.5.smithi118.stderr:2024-03-27T19:34:36.357+0000 7fa84c200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 58862) UID: 0 2024-03-27T19:34:36.358 INFO:tasks.ceph.osd.6.smithi118.stderr:2024-03-27T19:34:36.356+0000 7efe94a00640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 58862) UID: 0 2024-03-27T19:34:36.359 INFO:tasks.ceph.osd.7.smithi118.stderr:2024-03-27T19:34:36.357+0000 7fdba0200640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 58862) UID: 0 2024-03-27T19:34:36.383 INFO:tasks.ceph.mds.c.smithi057.stderr:2024-03-27T19:34:36.382+0000 7f1f8ba00640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 529621) UID: 0 2024-03-27T19:34:36.385 INFO:tasks.ceph.mds.a.smithi057.stderr:2024-03-27T19:34:36.383+0000 7f0ffc400640 -1 Fail to open '/proc/529621/cmdline' error = (2) No such file or directory 2024-03-27T19:34:36.385 INFO:tasks.ceph.mds.a.smithi057.stderr:2024-03-27T19:34:36.384+0000 7f0ffc400640 -1 received signal: Hangup from (PID: 529621) UID: 0 2024-03-27T19:45:18.047 INFO:teuthology.orchestra.run.smithi057.stdout:generic/676 1741s 2024-03-27T19:45:18.159 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/676 2024-03-27T19:45:18.159 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T19:45:18.170 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:45:18.205 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T19:45:18.206 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/677) 2024-03-27T19:45:19.400 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T19:45:19.418 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T19:45:19.418 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:45:20.117 INFO:teuthology.orchestra.run.smithi057.stdout:generic/677 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T19:45:20.131 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/677 2024-03-27T19:45:20.132 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/677 2024-03-27T19:45:20.132 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T19:45:20.142 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:45:20.178 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T19:45:20.178 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/678) 2024-03-27T19:45:20.867 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T19:45:20.884 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T19:45:20.884 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:45:22.676 INFO:teuthology.orchestra.run.smithi057.stdout:generic/678 [not run] kernel does not support IO_URING 2024-03-27T19:45:22.689 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/678 2024-03-27T19:45:22.689 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/678 2024-03-27T19:45:22.689 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T19:45:22.698 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:45:22.735 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T19:45:22.735 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/679) 2024-03-27T19:45:23.492 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T19:45:23.506 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T19:45:23.506 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:45:24.164 INFO:teuthology.orchestra.run.smithi057.stdout:generic/679 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T19:45:24.181 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/679 2024-03-27T19:45:24.181 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/679 2024-03-27T19:45:24.181 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T19:45:24.193 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:45:24.227 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T19:45:24.227 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/680) 2024-03-27T19:45:24.960 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T19:45:24.975 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T19:45:24.975 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:45:27.185 INFO:teuthology.orchestra.run.smithi057.stdout:generic/680 2s 2024-03-27T19:45:27.210 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/680 2024-03-27T19:45:27.211 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T19:45:27.220 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:45:27.265 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T19:45:27.265 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/681) 2024-03-27T19:45:28.335 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T19:45:28.350 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T19:45:28.350 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:45:28.896 INFO:teuthology.orchestra.run.smithi057.stdout:generic/681 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2024-03-27T19:45:28.911 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/681 2024-03-27T19:45:28.911 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/681 2024-03-27T19:45:28.911 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T19:45:28.925 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:45:28.970 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T19:45:28.971 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/682) 2024-03-27T19:45:29.679 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T19:45:29.696 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T19:45:29.696 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:45:30.157 INFO:teuthology.orchestra.run.smithi057.stdout:generic/682 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2024-03-27T19:45:30.173 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/682 2024-03-27T19:45:30.173 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/682 2024-03-27T19:45:30.174 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T19:45:30.185 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:45:30.223 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T19:45:30.223 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/683) 2024-03-27T19:45:30.976 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T19:45:30.996 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T19:45:30.996 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:45:31.692 INFO:teuthology.orchestra.run.smithi057.stdout:generic/683 [not run] /tmp/tmp.HFg5N66vC0test: file alloc unit 4194304 larger than op length 65536 2024-03-27T19:45:31.708 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/683 2024-03-27T19:45:31.708 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/683 2024-03-27T19:45:31.708 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T19:45:31.719 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:45:31.756 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T19:45:31.756 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/684) 2024-03-27T19:45:32.514 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T19:45:32.533 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T19:45:32.533 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:45:36.559 INFO:teuthology.orchestra.run.smithi057.stdout:generic/684 [not run] /tmp/tmp.HFg5N66vC0test: file alloc unit 4194304 larger than op length 65536 2024-03-27T19:45:36.574 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/684 2024-03-27T19:45:36.575 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/684 2024-03-27T19:45:36.575 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T19:45:36.580 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:45:36.617 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T19:45:36.617 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/685) 2024-03-27T19:45:37.387 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T19:45:37.408 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T19:45:37.408 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:45:41.096 INFO:teuthology.orchestra.run.smithi057.stdout:generic/685 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-03-27T19:45:41.108 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/685 2024-03-27T19:45:41.108 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/685 2024-03-27T19:45:41.108 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T19:45:41.119 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:45:41.158 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T19:45:41.158 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/686) 2024-03-27T19:45:41.854 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T19:45:41.869 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T19:45:41.869 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:45:45.189 INFO:teuthology.orchestra.run.smithi057.stdout:generic/686 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2024-03-27T19:45:45.202 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/686 2024-03-27T19:45:45.202 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/686 2024-03-27T19:45:45.202 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T19:45:45.213 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:45:45.246 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T19:45:45.246 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/687) 2024-03-27T19:45:45.982 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T19:45:45.996 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T19:45:45.997 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:45:49.307 INFO:teuthology.orchestra.run.smithi057.stdout:generic/687 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2024-03-27T19:45:49.319 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/687 2024-03-27T19:45:49.319 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/687 2024-03-27T19:45:49.319 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T19:45:49.333 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:45:49.377 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T19:45:49.377 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/688) 2024-03-27T19:45:50.057 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T19:45:50.076 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T19:45:50.076 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:45:50.850 INFO:teuthology.orchestra.run.smithi057.stdout:generic/688 [not run] /tmp/tmp.HFg5N66vC0test: file alloc unit 4194304 larger than op length 65536 2024-03-27T19:45:50.866 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/688 2024-03-27T19:45:50.867 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/688 2024-03-27T19:45:50.867 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T19:45:50.876 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:45:50.909 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T19:45:50.909 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/689) 2024-03-27T19:45:51.603 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T19:45:51.620 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T19:45:51.621 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:45:52.238 INFO:teuthology.orchestra.run.smithi057.stdout:generic/689 [not run] vfstest not support by ceph-fuse 2024-03-27T19:45:52.252 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/689 2024-03-27T19:45:52.253 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/689 2024-03-27T19:45:52.253 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T19:45:52.262 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:45:52.296 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T19:45:52.297 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/690) 2024-03-27T19:45:53.036 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T19:45:53.053 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T19:45:53.053 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:45:53.687 INFO:teuthology.orchestra.run.smithi057.stdout:generic/690 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T19:45:53.701 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/690 2024-03-27T19:45:53.701 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/690 2024-03-27T19:45:53.701 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T19:45:53.710 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:45:53.754 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T19:45:53.754 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/691) 2024-03-27T19:45:54.542 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T19:45:54.555 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T19:45:54.556 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:45:55.014 INFO:teuthology.orchestra.run.smithi057.stdout:generic/691 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T19:45:55.025 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/691 2024-03-27T19:45:55.025 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/691 2024-03-27T19:45:55.025 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T19:45:55.036 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:45:55.072 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T19:45:55.072 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/692) 2024-03-27T19:45:55.731 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T19:45:55.745 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T19:45:55.746 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:45:56.544 INFO:teuthology.orchestra.run.smithi057.stdout:generic/692 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T19:45:56.557 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/692 2024-03-27T19:45:56.558 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/692 2024-03-27T19:45:56.558 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T19:45:56.566 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:45:56.605 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T19:45:56.605 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/693) 2024-03-27T19:45:57.327 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T19:45:57.343 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T19:45:57.343 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:45:58.064 INFO:teuthology.orchestra.run.smithi057.stdout:generic/693 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T19:45:58.080 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/693 2024-03-27T19:45:58.080 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/693 2024-03-27T19:45:58.081 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T19:45:58.089 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:45:58.120 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T19:45:58.121 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/694) 2024-03-27T19:45:58.834 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T19:45:58.851 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T19:45:58.851 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:46:00.297 INFO:teuthology.orchestra.run.smithi057.stdout:generic/694 2s 2024-03-27T19:46:00.329 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/694 2024-03-27T19:46:00.329 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T19:46:00.339 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:46:00.370 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T19:46:00.371 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/695) 2024-03-27T19:46:01.112 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T19:46:01.128 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T19:46:01.128 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:46:02.009 INFO:teuthology.orchestra.run.smithi057.stdout:generic/695 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T19:46:02.021 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/695 2024-03-27T19:46:02.021 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/695 2024-03-27T19:46:02.021 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T19:46:02.032 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:46:02.078 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T19:46:02.078 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/696) 2024-03-27T19:46:02.864 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T19:46:02.884 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T19:46:02.884 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:46:03.362 INFO:teuthology.orchestra.run.smithi057.stdout:generic/696 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T19:46:03.376 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/696 2024-03-27T19:46:03.377 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/696 2024-03-27T19:46:03.377 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T19:46:03.387 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:46:03.420 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T19:46:03.420 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/697) 2024-03-27T19:46:04.147 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T19:46:04.168 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T19:46:04.168 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:46:05.130 INFO:teuthology.orchestra.run.smithi057.stdout:generic/697 [not run] ACLs not supported by this filesystem type: ceph-fuse 2024-03-27T19:46:05.144 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/697 2024-03-27T19:46:05.144 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/697 2024-03-27T19:46:05.144 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T19:46:05.154 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:46:05.199 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T19:46:05.199 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/698) 2024-03-27T19:46:05.955 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T19:46:05.975 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T19:46:05.975 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:46:06.552 INFO:teuthology.orchestra.run.smithi057.stdout:generic/698 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T19:46:06.565 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/698 2024-03-27T19:46:06.565 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/698 2024-03-27T19:46:06.565 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T19:46:06.572 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:46:06.613 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T19:46:06.613 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/699) 2024-03-27T19:46:07.362 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T19:46:07.378 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T19:46:07.378 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:46:08.635 INFO:teuthology.orchestra.run.smithi057.stdout:generic/699 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T19:46:08.651 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/699 2024-03-27T19:46:08.651 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/699 2024-03-27T19:46:08.651 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T19:46:08.664 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:46:08.701 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T19:46:08.701 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/700) 2024-03-27T19:46:09.442 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T19:46:09.460 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T19:46:09.460 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:46:09.985 INFO:teuthology.orchestra.run.smithi057.stdout:generic/700 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T19:46:10.001 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/700 2024-03-27T19:46:10.001 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/700 2024-03-27T19:46:10.001 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T19:46:10.012 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:46:10.053 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T19:46:10.054 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/701) 2024-03-27T19:46:10.780 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T19:46:10.797 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T19:46:10.798 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:46:11.891 INFO:teuthology.orchestra.run.smithi057.stdout:generic/701 1s 2024-03-27T19:46:11.921 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/701 2024-03-27T19:46:11.921 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T19:46:11.930 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:46:11.970 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T19:46:11.970 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/702) 2024-03-27T19:46:12.899 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T19:46:12.917 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T19:46:12.918 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:46:13.477 INFO:teuthology.orchestra.run.smithi057.stdout:generic/702 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T19:46:13.491 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/702 2024-03-27T19:46:13.491 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/702 2024-03-27T19:46:13.491 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T19:46:13.502 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:46:13.561 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T19:46:13.562 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/703) 2024-03-27T19:46:14.303 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T19:46:14.318 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T19:46:14.318 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:46:15.031 INFO:teuthology.orchestra.run.smithi057.stdout:generic/703 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T19:46:15.042 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/703 2024-03-27T19:46:15.042 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/703 2024-03-27T19:46:15.042 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T19:46:15.055 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:46:15.091 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T19:46:15.091 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/704) 2024-03-27T19:46:15.875 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T19:46:15.894 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T19:46:15.894 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:46:16.602 INFO:teuthology.orchestra.run.smithi057.stdout:generic/704 [not run] require ceph-fuse to be valid block disk 2024-03-27T19:46:16.614 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/704 2024-03-27T19:46:16.615 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/704 2024-03-27T19:46:16.615 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T19:46:16.626 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:46:16.665 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T19:46:16.666 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/705) 2024-03-27T19:46:17.441 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T19:46:17.458 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T19:46:17.459 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:46:17.950 INFO:teuthology.orchestra.run.smithi057.stdout:generic/705 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T19:46:17.967 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/705 2024-03-27T19:46:17.967 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/705 2024-03-27T19:46:17.968 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T19:46:17.977 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:46:18.017 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T19:46:18.017 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/706) 2024-03-27T19:46:18.780 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T19:46:18.796 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T19:46:18.796 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:46:22.138 INFO:teuthology.orchestra.run.smithi057.stdout:generic/706 4s 2024-03-27T19:46:22.165 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/706 2024-03-27T19:46:22.165 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T19:46:22.174 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:46:22.215 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T19:46:22.215 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/707) 2024-03-27T19:46:23.172 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T19:46:23.192 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T19:46:23.192 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:46:24.016 INFO:teuthology.orchestra.run.smithi057.stdout:generic/707 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T19:46:24.028 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/707 2024-03-27T19:46:24.028 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/707 2024-03-27T19:46:24.028 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T19:46:24.039 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:46:24.073 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T19:46:24.073 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/708) 2024-03-27T19:46:24.728 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T19:46:24.746 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T19:46:24.746 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:46:26.004 INFO:teuthology.orchestra.run.smithi057.stdout:generic/708 1s 2024-03-27T19:46:26.028 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/708 2024-03-27T19:46:26.028 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T19:46:26.038 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:46:26.073 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T19:46:26.073 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/709) 2024-03-27T19:46:27.066 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T19:46:27.083 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T19:46:27.083 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:46:27.828 INFO:teuthology.orchestra.run.smithi057.stdout:generic/709 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2024-03-27T19:46:27.845 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/709 2024-03-27T19:46:27.845 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/709 2024-03-27T19:46:27.845 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T19:46:27.858 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:46:27.903 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T19:46:27.903 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/710) 2024-03-27T19:46:28.878 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T19:46:28.897 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T19:46:28.897 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:46:29.613 INFO:teuthology.orchestra.run.smithi057.stdout:generic/710 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2024-03-27T19:46:29.629 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/710 2024-03-27T19:46:29.629 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/710 2024-03-27T19:46:29.629 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T19:46:29.647 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:46:29.681 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T19:46:29.681 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/711) 2024-03-27T19:46:30.749 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T19:46:30.767 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T19:46:30.767 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:46:31.520 INFO:teuthology.orchestra.run.smithi057.stdout:generic/711 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2024-03-27T19:46:31.537 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/711 2024-03-27T19:46:31.539 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/711 2024-03-27T19:46:31.539 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T19:46:31.552 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:46:31.599 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T19:46:31.599 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/712) 2024-03-27T19:46:32.577 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T19:46:32.598 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T19:46:32.598 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:46:33.334 INFO:teuthology.orchestra.run.smithi057.stdout:generic/712 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2024-03-27T19:46:33.346 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/712 2024-03-27T19:46:33.346 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/712 2024-03-27T19:46:33.347 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T19:46:33.356 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:46:33.394 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T19:46:33.394 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/713) 2024-03-27T19:46:34.325 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T19:46:34.344 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T19:46:34.347 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:46:35.142 INFO:teuthology.orchestra.run.smithi057.stdout:generic/713 [not run] xfs_io swapext -v exchrange -s 64k -l 64k not supported on ceph-fuse 2024-03-27T19:46:35.156 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/713 2024-03-27T19:46:35.156 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/713 2024-03-27T19:46:35.156 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T19:46:35.173 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:46:35.210 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T19:46:35.211 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/714) 2024-03-27T19:46:36.185 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T19:46:36.206 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T19:46:36.206 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:46:36.843 INFO:teuthology.orchestra.run.smithi057.stdout:generic/714 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2024-03-27T19:46:36.857 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/714 2024-03-27T19:46:36.857 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/714 2024-03-27T19:46:36.857 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T19:46:36.866 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:46:36.906 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T19:46:36.906 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/715) 2024-03-27T19:46:37.884 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T19:46:37.905 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T19:46:37.905 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:46:38.726 INFO:teuthology.orchestra.run.smithi057.stdout:generic/715 [not run] xfs_io swapext -v exchrange -s 64k -l 64k not supported on ceph-fuse 2024-03-27T19:46:38.739 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/715 2024-03-27T19:46:38.739 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/715 2024-03-27T19:46:38.740 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T19:46:38.750 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:46:38.816 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T19:46:38.816 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/716) 2024-03-27T19:46:39.808 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T19:46:39.828 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T19:46:39.829 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:46:40.946 INFO:teuthology.orchestra.run.smithi057.stdout:generic/716 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2024-03-27T19:46:40.962 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/716 2024-03-27T19:46:40.962 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/716 2024-03-27T19:46:40.962 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T19:46:40.969 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:46:41.006 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T19:46:41.006 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/717) 2024-03-27T19:46:42.020 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T19:46:42.041 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T19:46:42.041 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:46:42.642 INFO:teuthology.orchestra.run.smithi057.stdout:generic/717 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2024-03-27T19:46:42.658 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/717 2024-03-27T19:46:42.658 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/717 2024-03-27T19:46:42.658 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T19:46:42.665 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:46:42.702 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T19:46:42.702 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/718) 2024-03-27T19:46:43.720 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T19:46:43.745 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T19:46:43.745 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:46:44.363 INFO:teuthology.orchestra.run.smithi057.stdout:generic/718 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2024-03-27T19:46:44.374 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/718 2024-03-27T19:46:44.374 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/718 2024-03-27T19:46:44.374 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T19:46:44.384 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:46:44.431 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T19:46:44.432 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/719) 2024-03-27T19:46:45.402 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T19:46:45.421 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T19:46:45.421 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:46:46.203 INFO:teuthology.orchestra.run.smithi057.stdout:generic/719 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2024-03-27T19:46:46.219 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/719 2024-03-27T19:46:46.219 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/719 2024-03-27T19:46:46.219 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T19:46:46.231 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:46:46.269 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T19:46:46.269 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/720) 2024-03-27T19:46:47.274 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T19:46:47.316 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T19:46:47.316 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:46:48.368 INFO:teuthology.orchestra.run.smithi057.stdout:generic/720 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2024-03-27T19:46:48.383 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/720 2024-03-27T19:46:48.384 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/720 2024-03-27T19:46:48.384 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T19:46:48.394 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:46:48.434 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T19:46:48.435 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/721) 2024-03-27T19:46:49.419 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T19:46:49.436 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T19:46:49.436 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:46:50.074 INFO:teuthology.orchestra.run.smithi057.stdout:generic/721 [not run] xfs_io startupdate support is missing 2024-03-27T19:46:50.095 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/721 2024-03-27T19:46:50.095 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/721 2024-03-27T19:46:50.096 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T19:46:50.108 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:46:50.148 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T19:46:50.149 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/722) 2024-03-27T19:46:50.875 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T19:46:50.892 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T19:46:50.892 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:46:51.576 INFO:teuthology.orchestra.run.smithi057.stdout:generic/722 [not run] xfs_io swapext -v exchrange -a not supported on ceph-fuse 2024-03-27T19:46:51.589 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/722 2024-03-27T19:46:51.589 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/722 2024-03-27T19:46:51.589 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T19:46:51.598 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:46:51.639 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T19:46:51.639 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/723) 2024-03-27T19:46:52.613 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T19:46:52.630 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T19:46:52.630 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:46:53.787 INFO:teuthology.orchestra.run.smithi057.stdout:generic/723 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2024-03-27T19:46:53.798 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/723 2024-03-27T19:46:53.798 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/723 2024-03-27T19:46:53.798 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T19:46:53.810 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:46:53.849 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T19:46:53.851 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/724) 2024-03-27T19:46:54.862 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T19:46:54.884 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T19:46:54.884 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:46:55.522 INFO:teuthology.orchestra.run.smithi057.stdout:generic/724 [not run] xfs_io swapext -v exchrange -a not supported on ceph-fuse 2024-03-27T19:46:55.534 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/724 2024-03-27T19:46:55.534 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/724 2024-03-27T19:46:55.535 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T19:46:55.545 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:46:55.585 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T19:46:55.586 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/725) 2024-03-27T19:46:56.585 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T19:46:56.609 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T19:46:56.609 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:46:57.229 INFO:teuthology.orchestra.run.smithi057.stdout:generic/725 [not run] xfs_io swapext -v exchrange -a not supported on ceph-fuse 2024-03-27T19:46:57.246 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/725 2024-03-27T19:46:57.246 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/725 2024-03-27T19:46:57.247 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T19:46:57.256 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:46:57.296 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T19:46:57.296 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/726) 2024-03-27T19:46:58.288 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T19:46:58.305 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T19:46:58.305 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:47:00.234 INFO:teuthology.orchestra.run.smithi057.stdout:generic/726 [not run] xfs_io swapext -v exchrange -a not supported on ceph-fuse 2024-03-27T19:47:00.252 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/726 2024-03-27T19:47:00.252 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/726 2024-03-27T19:47:00.252 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T19:47:00.263 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:47:00.311 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T19:47:00.312 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/727) 2024-03-27T19:47:01.324 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T19:47:01.349 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T19:47:01.349 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:47:02.104 INFO:teuthology.orchestra.run.smithi057.stdout:generic/727 [not run] xfs_io swapext -v exchrange -a not supported on ceph-fuse 2024-03-27T19:47:02.119 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/727 2024-03-27T19:47:02.120 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/727 2024-03-27T19:47:02.120 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T19:47:02.131 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:47:02.174 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T19:47:02.174 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/728) 2024-03-27T19:47:03.180 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T19:47:03.200 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T19:47:03.200 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:47:07.984 INFO:teuthology.orchestra.run.smithi057.stdout:generic/728 4s 2024-03-27T19:47:08.009 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/728 2024-03-27T19:47:08.009 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T19:47:08.021 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:47:08.068 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T19:47:08.068 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/729) 2024-03-27T19:47:08.849 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T19:47:08.874 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T19:47:08.875 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:47:10.152 INFO:teuthology.orchestra.run.smithi057.stdout:generic/729 2s 2024-03-27T19:47:10.174 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/729 2024-03-27T19:47:10.174 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T19:47:10.186 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:47:10.228 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T19:47:10.228 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/730) 2024-03-27T19:47:11.181 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T19:47:11.197 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T19:47:11.197 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:47:11.769 INFO:teuthology.orchestra.run.smithi057.stdout:generic/730 [not run] require ceph-fuse to be valid block disk 2024-03-27T19:47:11.783 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/730 2024-03-27T19:47:11.783 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/730 2024-03-27T19:47:11.784 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T19:47:11.797 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:47:11.832 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T19:47:11.833 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/731) 2024-03-27T19:47:12.624 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T19:47:12.654 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T19:47:12.654 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:47:13.254 INFO:teuthology.orchestra.run.smithi057.stdout:generic/731 [not run] require ceph-fuse to be valid block disk 2024-03-27T19:47:13.268 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/731 2024-03-27T19:47:13.268 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/731 2024-03-27T19:47:13.268 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T19:47:13.278 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:47:13.312 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T19:47:13.312 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/732) 2024-03-27T19:47:14.009 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T19:47:14.023 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T19:47:14.023 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:47:14.543 INFO:teuthology.orchestra.run.smithi057.stdout:generic/732 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T19:47:14.557 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/732 2024-03-27T19:47:14.558 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/732 2024-03-27T19:47:14.558 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T19:47:14.571 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:47:14.612 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T19:47:14.612 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/733) 2024-03-27T19:47:15.322 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T19:47:15.338 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T19:47:15.338 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:47:15.837 INFO:teuthology.orchestra.run.smithi057.stdout:generic/733 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T19:47:15.847 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/733 2024-03-27T19:47:15.847 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/733 2024-03-27T19:47:15.848 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T19:47:15.859 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:47:15.898 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T19:47:15.898 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/734) 2024-03-27T19:47:16.670 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T19:47:16.685 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T19:47:16.685 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:47:17.334 INFO:teuthology.orchestra.run.smithi057.stdout:generic/734 [not run] Reflink not supported by test filesystem type: ceph-fuse 2024-03-27T19:47:17.349 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/734 2024-03-27T19:47:17.349 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/734 2024-03-27T19:47:17.349 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T19:47:17.359 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:47:17.418 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T19:47:17.418 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/735) 2024-03-27T19:47:18.357 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T19:47:18.375 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T19:47:18.376 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:47:21.729 INFO:teuthology.orchestra.run.smithi057.stdout:generic/735 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2024-03-27T19:47:21.743 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/735 2024-03-27T19:47:21.743 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/735 2024-03-27T19:47:21.743 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T19:47:21.754 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:47:21.791 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T19:47:21.792 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/736) 2024-03-27T19:47:22.758 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T19:47:22.780 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T19:47:22.780 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:47:46.032 INFO:tasks.ceph.osd.0.smithi057.stderr:2024-03-27T19:47:46.030+0000 7f622b800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 556307) UID: 0 2024-03-27T19:47:46.033 INFO:tasks.ceph.osd.1.smithi057.stderr:2024-03-27T19:47:46.031+0000 7f8202600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 556307) UID: 0 2024-03-27T19:47:46.033 INFO:tasks.ceph.osd.3.smithi057.stderr:2024-03-27T19:47:46.031+0000 7f009f600640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 556307) UID: 0 2024-03-27T19:47:46.034 INFO:tasks.ceph.osd.2.smithi057.stderr:2024-03-27T19:47:46.032+0000 7f1380800640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 556307) UID: 0 2024-03-27T19:51:19.679 INFO:teuthology.orchestra.run.smithi057.stdout:generic/736 237s 2024-03-27T19:51:19.704 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/736 2024-03-27T19:51:19.704 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T19:51:19.717 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:51:19.765 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T19:51:19.765 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/737) 2024-03-27T19:51:20.718 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T19:51:20.739 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T19:51:20.739 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:51:21.667 INFO:teuthology.orchestra.run.smithi057.stdout:generic/737 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T19:51:21.677 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/737 2024-03-27T19:51:21.677 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/737 2024-03-27T19:51:21.677 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T19:51:21.684 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:51:21.712 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T19:51:21.712 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/738) 2024-03-27T19:51:22.444 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T19:51:22.463 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T19:51:22.463 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:51:24.523 INFO:teuthology.orchestra.run.smithi057.stdout:generic/738 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T19:51:24.536 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/738 2024-03-27T19:51:24.536 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/738 2024-03-27T19:51:24.536 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T19:51:25.034 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:51:25.067 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T19:51:25.067 DEBUG:teuthology.orchestra.run.smithi057:> (cd /tmp/tmp.446sL8UEHrxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/739) 2024-03-27T19:51:25.819 INFO:teuthology.orchestra.run.smithi057.stdout:FSTYP -- ceph-fuse 2024-03-27T19:51:25.837 INFO:teuthology.orchestra.run.smithi057.stdout:PLATFORM -- Linux/x86_64 smithi057 6.8.0-g1df0c7e8a235 #1 SMP PREEMPT_DYNAMIC Mon Mar 25 03:32:35 UTC 2024 2024-03-27T19:51:25.837 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:51:26.495 INFO:teuthology.orchestra.run.smithi057.stdout:generic/739 [not run] this test requires a valid $SCRATCH_DEV 2024-03-27T19:51:26.514 INFO:teuthology.orchestra.run.smithi057.stdout:Ran: generic/739 2024-03-27T19:51:26.514 INFO:teuthology.orchestra.run.smithi057.stdout:Not run: generic/739 2024-03-27T19:51:26.514 INFO:teuthology.orchestra.run.smithi057.stdout:Passed all 1 tests 2024-03-27T19:51:26.525 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:51:26.569 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-27T19:51:26.569 INFO:tasks.cephfs.xfstests_dev:=========================================================Total number of tests failed = 15========================================================= 2024-03-27T19:51:26.570 DEBUG:teuthology.orchestra.run.smithi057:> sudo userdel --force --remove fsgqa 2024-03-27T19:51:28.889 DEBUG:teuthology.orchestra.run.smithi057:> sudo userdel --force --remove 123456-fsgqa 2024-03-27T19:51:29.940 DEBUG:teuthology.orchestra.run.smithi057:> sudo groupdel fsgqa 2024-03-27T19:51:30.143 INFO:teuthology.orchestra.run.smithi057.stderr:groupdel: group 'fsgqa' does not exist 2024-03-27T19:51:30.149 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-03-27T19:51:30.150 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T19:51:30.150 DEBUG:teuthology.orchestra.run.smithi057:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo stat /tmp/tmp.446sL8UEHrxfstests-dev/results) 2024-03-27T19:51:30.200 INFO:teuthology.orchestra.run.smithi057.stderr:bash: line 1: cd: /home/ubuntu/cephtest/mnt.0: Permission denied 2024-03-27T19:51:30.202 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-27T19:51:30.203 INFO:tasks.cephfs.xfstests_dev:xfstests-dev repo contains not directory named "results". repo location: /tmp/tmp.446sL8UEHrxfstests-dev 2024-03-27T19:51:30.203 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm -rf /tmp/tmp.446sL8UEHrxfstests-dev 2024-03-27T19:51:35.168 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-03-27T19:51:35.168 DEBUG:teuthology.orchestra.run.smithi057:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-03-27T19:51:35.676 DEBUG:teuthology.orchestra.run.smithi118:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-03-27T19:51:35.871 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-03-27T19:51:35.872 INFO:tasks.cephfs.mount:Terminating background process 2024-03-27T19:51:35.872 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-03-27T19:51:35.872 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-27T19:51:35.970 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054203,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499604k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249800k,nr_inodes=812450,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499604k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-03-27T19:51:35.970 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi057.front.sepia.ceph.com 2024-03-27T19:51:35.970 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T19:51:35.970 DEBUG:teuthology.orchestra.run.smithi057:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-03-27T19:51:36.052 INFO:tasks.cephfs.mount:Terminating background process 2024-03-27T19:51:36.052 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-03-27T19:51:36.053 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-27T19:51:36.113 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053413,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498340k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249168k,nr_inodes=812292,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498340k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-03-27T19:51:36.113 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi118.front.sepia.ceph.com 2024-03-27T19:51:36.113 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T19:51:36.113 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-03-27T19:51:36.168 INFO:teuthology.orchestra.run.smithi118.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2024-03-27T19:51:36.168 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-27T19:51:36.169 INFO:tasks.cephfs.mount:Terminating background process 2024-03-27T19:51:36.169 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-03-27T19:51:36.169 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-27T19:51:36.232 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054203,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499604k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249800k,nr_inodes=812450,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499604k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-03-27T19:51:36.232 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi057.front.sepia.ceph.com 2024-03-27T19:51:36.232 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T19:51:36.232 DEBUG:teuthology.orchestra.run.smithi057:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-03-27T19:51:36.297 INFO:teuthology.orchestra.run.smithi057.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-03-27T19:51:36.298 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-27T19:51:36.298 INFO:tasks.cephfs.mount:Terminating background process 2024-03-27T19:51:36.299 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-03-27T19:51:36.299 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-27T19:51:36.355 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053413,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498340k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249168k,nr_inodes=812292,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498340k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-03-27T19:51:36.355 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi118.front.sepia.ceph.com 2024-03-27T19:51:36.355 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T19:51:36.355 DEBUG:teuthology.orchestra.run.smithi118:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-03-27T19:51:36.400 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-27T19:51:36.400 INFO:teuthology.orchestra.run.smithi118.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-03-27T19:51:36.401 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-27T19:51:37.823 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:37.821+0000 7f353ba00640 1 Processor -- start 2024-03-27T19:51:37.823 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:37.822+0000 7f353ba00640 1 -- start start 2024-03-27T19:51:37.826 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:37.824+0000 7f353ba00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f353415f5c0 0x7f353406d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:37.826 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:37.824+0000 7f353ba00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f353406d6f0 0x7f35340cd330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:37.826 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:37.824+0000 7f353ba00640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f353415eb00 con 0x7f353406b7a0 2024-03-27T19:51:37.826 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:37.824+0000 7f353ba00640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f353415fa10 con 0x7f353406d6f0 2024-03-27T19:51:37.826 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:37.824+0000 7f353ba00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f353406dc70 con 0x7f353415f5c0 2024-03-27T19:51:37.826 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:37.824+0000 7f3539a00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f353406d6f0 0x7f35340cd330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:37.826 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:37.824+0000 7f3539a00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f353406d6f0 0x7f35340cd330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:45050/0 (socket says 172.21.15.57:45050) 2024-03-27T19:51:37.826 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:37.824+0000 7f3533e00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f353415f5c0 0x7f353406d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:37.826 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:37.824+0000 7f3539a00640 1 -- 172.21.15.57:0/775192081 learned_addr learned my addr 172.21.15.57:0/775192081 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T19:51:37.827 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:37.826+0000 7f3533400640 1 -- 172.21.15.57:0/775192081 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2059101112 0 0) 0x7f353415eb00 con 0x7f353406b7a0 2024-03-27T19:51:37.828 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:37.826+0000 7f3539a00640 1 -- 172.21.15.57:0/775192081 >> v2:172.21.15.118:3300/0 conn(0x7f353415f5c0 msgr2=0x7f353406d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T19:51:37.828 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:37.826+0000 7f3539a00640 1 --2- 172.21.15.57:0/775192081 >> v2:172.21.15.118:3300/0 conn(0x7f353415f5c0 0x7f353406d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:37.828 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:37.826+0000 7f3539a00640 1 -- 172.21.15.57:0/775192081 >> v1:172.21.15.57:6789/0 conn(0x7f353406b7a0 legacy=0x7f353406bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:37.828 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:37.826+0000 7f3539a00640 1 -- 172.21.15.57:0/775192081 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f353406df50 con 0x7f353406d6f0 2024-03-27T19:51:37.829 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:37.828+0000 7f3539a00640 1 --2- 172.21.15.57:0/775192081 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f353406d6f0 0x7f35340cd330 secure :-1 s=READY pgs=2192 cs=0 l=1 rev1=1 crypto rx=0x7f35340b5040 tx=0x7f352c02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cfbf8c59123fd17 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:51:37.829 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:37.828+0000 7f3533400640 1 -- 172.21.15.57:0/775192081 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f352c02ca80 con 0x7f353406d6f0 2024-03-27T19:51:37.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:37.828+0000 7f3533400640 1 -- 172.21.15.57:0/775192081 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f352c02cc20 con 0x7f353406d6f0 2024-03-27T19:51:37.830 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:37.828+0000 7f3533400640 1 -- 172.21.15.57:0/775192081 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f352c0343f0 con 0x7f353406d6f0 2024-03-27T19:51:37.832 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:37.829+0000 7f353ba00640 1 -- 172.21.15.57:0/775192081 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f353406d6f0 msgr2=0x7f35340cd330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:37.832 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:37.829+0000 7f353ba00640 1 --2- 172.21.15.57:0/775192081 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f353406d6f0 0x7f35340cd330 secure :-1 s=READY pgs=2192 cs=0 l=1 rev1=1 crypto rx=0x7f35340b5040 tx=0x7f352c02bee0 comp rx=0 tx=0).stop 2024-03-27T19:51:37.832 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:37.831+0000 7f353ba00640 1 -- 172.21.15.57:0/775192081 shutdown_connections 2024-03-27T19:51:37.832 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:37.831+0000 7f353ba00640 1 --2- 172.21.15.57:0/775192081 >> v2:172.21.15.118:3300/0 conn(0x7f353415f5c0 0x7f353406d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:37.832 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:37.831+0000 7f353ba00640 1 --2- 172.21.15.57:0/775192081 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f353406d6f0 0x7f35340cd330 unknown :-1 s=CLOSED pgs=2192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:37.832 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:37.831+0000 7f353ba00640 1 -- 172.21.15.57:0/775192081 >> 172.21.15.57:0/775192081 conn(0x7f35340b1c60 msgr2=0x7f35340b2070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T19:51:37.833 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:37.831+0000 7f353ba00640 1 -- 172.21.15.57:0/775192081 shutdown_connections 2024-03-27T19:51:37.833 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:37.831+0000 7f353ba00640 1 -- 172.21.15.57:0/775192081 wait complete. 2024-03-27T19:51:37.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:37.856+0000 7f353ba00640 1 Processor -- start 2024-03-27T19:51:37.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:37.857+0000 7f353ba00640 1 -- start start 2024-03-27T19:51:37.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:37.858+0000 7f353ba00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f353406b7a0 0x7f353415c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:37.860 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:37.858+0000 7f353ba00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f353406d6f0 0x7f3534142360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:37.860 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:37.858+0000 7f353ba00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f353415f5c0 0x7f353415a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:37.860 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:37.858+0000 7f353ba00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f35340726b0 con 0x7f353415f5c0 2024-03-27T19:51:37.860 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:37.858+0000 7f353ba00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f353415f0a0 con 0x7f353406d6f0 2024-03-27T19:51:37.860 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:37.858+0000 7f353ba00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f3534144b10 con 0x7f353406b7a0 2024-03-27T19:51:37.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:37.859+0000 7f3539a00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f353415f5c0 0x7f353415a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:37.861 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:37.859+0000 7f3539a00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f353415f5c0 0x7f353415a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:45062/0 (socket says 172.21.15.57:45062) 2024-03-27T19:51:37.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:37.859+0000 7f3539a00640 1 -- 172.21.15.57:0/2434570718 learned_addr learned my addr 172.21.15.57:0/2434570718 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T19:51:37.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:37.859+0000 7f3533e00640 1 --2- 172.21.15.57:0/2434570718 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f353406d6f0 0x7f3534142360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:37.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:37.859+0000 7f3539000640 1 --2- 172.21.15.57:0/2434570718 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f353406b7a0 0x7f353415c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:37.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:37.859+0000 7f3539a00640 1 -- 172.21.15.57:0/2434570718 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f353406b7a0 msgr2=0x7f353415c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:37.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:37.859+0000 7f3539a00640 1 --2- 172.21.15.57:0/2434570718 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f353406b7a0 0x7f353415c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:37.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:37.859+0000 7f3539a00640 1 -- 172.21.15.57:0/2434570718 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f353406d6f0 msgr2=0x7f3534142360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:37.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:37.859+0000 7f3539a00640 1 --2- 172.21.15.57:0/2434570718 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f353406d6f0 0x7f3534142360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:37.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:37.859+0000 7f3539a00640 1 -- 172.21.15.57:0/2434570718 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35341428a0 con 0x7f353415f5c0 2024-03-27T19:51:37.862 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:37.860+0000 7f3539a00640 1 --2- 172.21.15.57:0/2434570718 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f353415f5c0 0x7f353415a5c0 secure :-1 s=READY pgs=2193 cs=0 l=1 rev1=1 crypto rx=0x7f352c036040 tx=0x7f352c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:51:37.863 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:37.861+0000 7f3530c00640 1 -- 172.21.15.57:0/2434570718 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f352c043020 con 0x7f353415f5c0 2024-03-27T19:51:37.863 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:37.861+0000 7f3530c00640 1 -- 172.21.15.57:0/2434570718 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f352c03e450 con 0x7f353415f5c0 2024-03-27T19:51:37.863 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:37.861+0000 7f3530c00640 1 -- 172.21.15.57:0/2434570718 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f352c03e840 con 0x7f353415f5c0 2024-03-27T19:51:37.863 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:37.861+0000 7f353ba00640 1 -- 172.21.15.57:0/2434570718 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3534142b20 con 0x7f353415f5c0 2024-03-27T19:51:37.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:37.861+0000 7f353ba00640 1 -- 172.21.15.57:0/2434570718 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35341430e0 con 0x7f353415f5c0 2024-03-27T19:51:37.864 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:37.862+0000 7f353ba00640 1 -- 172.21.15.57:0/2434570718 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3510005290 con 0x7f353415f5c0 2024-03-27T19:51:37.868 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:37.865+0000 7f3530c00640 1 -- 172.21.15.57:0/2434570718 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f352c046020 con 0x7f353415f5c0 2024-03-27T19:51:37.868 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:37.866+0000 7f3530c00640 1 --2- 172.21.15.57:0/2434570718 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f351406c630 0x7f351406eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:37.868 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:37.867+0000 7f3530c00640 1 -- 172.21.15.57:0/2434570718 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6130+0+0 (secure 0 0 0) 0x7f352c0adc60 con 0x7f353415f5c0 2024-03-27T19:51:37.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:37.867+0000 7f3539000640 1 --2- 172.21.15.57:0/2434570718 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f351406c630 0x7f351406eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:37.872 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:37.870+0000 7f3539000640 1 --2- 172.21.15.57:0/2434570718 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f351406c630 0x7f351406eaf0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f3528000f60 tx=0x7f3528009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:51:37.876 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:37.874+0000 7f3530c00640 1 -- 172.21.15.57:0/2434570718 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f352c04d070 con 0x7f353415f5c0 2024-03-27T19:51:38.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:38.330+0000 7f353ba00640 1 -- 172.21.15.57:0/2434570718 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3510005580 con 0x7f353415f5c0 2024-03-27T19:51:38.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:38.331+0000 7f3530c00640 1 -- 172.21.15.57:0/2434570718 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5181 (secure 0 0 0) 0x7f35341428a0 con 0x7f353415f5c0 2024-03-27T19:51:38.333 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:51:38.333 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4883,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/534729135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":534729135},{"type":"v1","addr":"172.21.15.57:6835","nonce":534729135}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4886,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/1117032671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1117032671},{"type":"v1","addr":"172.21.15.118:6834","nonce":1117032671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4889,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/2149281891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":2149281891},{"type":"v1","addr":"172.21.15.118:6835","nonce":2149281891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-27T10:01:23.885660+0000","modified":"2024-03-27T10:01:27.013100+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5508},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5508":{"gid":5508,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.57:6837/385124398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":385124398},{"type":"v1","addr":"172.21.15.57:6837","nonce":385124398}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5508,"qdb_cluster":[5508]},"id":2}]} 2024-03-27T19:51:38.334 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 18 2024-03-27T19:51:38.337 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:38.336+0000 7f353ba00640 1 -- 172.21.15.57:0/2434570718 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f351406c630 msgr2=0x7f351406eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:38.337 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:38.336+0000 7f353ba00640 1 --2- 172.21.15.57:0/2434570718 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f351406c630 0x7f351406eaf0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f3528000f60 tx=0x7f3528009040 comp rx=0 tx=0).stop 2024-03-27T19:51:38.337 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:38.336+0000 7f353ba00640 1 -- 172.21.15.57:0/2434570718 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f353415f5c0 msgr2=0x7f353415a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:38.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:38.336+0000 7f353ba00640 1 --2- 172.21.15.57:0/2434570718 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f353415f5c0 0x7f353415a5c0 secure :-1 s=READY pgs=2193 cs=0 l=1 rev1=1 crypto rx=0x7f352c036040 tx=0x7f352c004a40 comp rx=0 tx=0).stop 2024-03-27T19:51:38.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:38.336+0000 7f353ba00640 1 -- 172.21.15.57:0/2434570718 shutdown_connections 2024-03-27T19:51:38.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:38.336+0000 7f353ba00640 1 --2- 172.21.15.57:0/2434570718 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f353415f5c0 0x7f353415a5c0 unknown :-1 s=CLOSED pgs=2193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:38.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:38.336+0000 7f353ba00640 1 --2- 172.21.15.57:0/2434570718 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f351406c630 0x7f351406eaf0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:38.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:38.336+0000 7f353ba00640 1 --2- 172.21.15.57:0/2434570718 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f353406d6f0 0x7f3534142360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:38.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:38.336+0000 7f353ba00640 1 --2- 172.21.15.57:0/2434570718 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f353406b7a0 0x7f353415c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:38.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:38.336+0000 7f353ba00640 1 -- 172.21.15.57:0/2434570718 >> 172.21.15.57:0/2434570718 conn(0x7f35340b1c60 msgr2=0x7f35340b3b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T19:51:38.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:38.336+0000 7f353ba00640 1 -- 172.21.15.57:0/2434570718 shutdown_connections 2024-03-27T19:51:38.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:38.336+0000 7f353ba00640 1 -- 172.21.15.57:0/2434570718 wait complete. 2024-03-27T19:51:38.378 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-27T19:51:38.655 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:38.653+0000 7fdf98400640 1 Processor -- start 2024-03-27T19:51:38.658 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:38.655+0000 7fdf98400640 1 -- start start 2024-03-27T19:51:38.659 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:38.658+0000 7fdf98400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdf900ceee0 0x7fdf900cf370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:38.659 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:38.658+0000 7fdf98400640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf9015f850 con 0x7fdf9015e4a0 2024-03-27T19:51:38.660 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:38.658+0000 7fdf98400640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf900d0a10 con 0x7fdf900d3fe0 2024-03-27T19:51:38.660 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:38.658+0000 7fdf96400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdf900ceee0 0x7fdf900cf370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:38.660 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:38.659+0000 7fdf96400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdf900ceee0 0x7fdf900cf370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.57:47908/0 (socket says 172.21.15.57:47908) 2024-03-27T19:51:38.660 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:38.659+0000 7fdf96400640 1 -- 172.21.15.57:0/548779698 learned_addr learned my addr 172.21.15.57:0/548779698 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T19:51:38.660 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:38.659+0000 7fdf98400640 1 -- 172.21.15.57:0/548779698 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fdf900d0cf0 con 0x7fdf900ceee0 2024-03-27T19:51:38.661 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:38.660+0000 7fdf8fe00640 1 -- 172.21.15.57:0/548779698 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 134507317 0 0) 0x7fdf9015f850 con 0x7fdf9015e4a0 2024-03-27T19:51:38.661 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:38.660+0000 7fdf8fe00640 1 -- 172.21.15.57:0/548779698 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdf78003520 con 0x7fdf9015e4a0 2024-03-27T19:51:38.661 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:38.660+0000 7fdf8fe00640 1 -- 172.21.15.57:0/548779698 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1571984873 0 0) 0x7fdf900d0a10 con 0x7fdf900d3fe0 2024-03-27T19:51:38.661 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:38.660+0000 7fdf8fe00640 1 -- 172.21.15.57:0/548779698 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdf9015f850 con 0x7fdf900d3fe0 2024-03-27T19:51:38.662 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:38.660+0000 7fdf96400640 1 -- 172.21.15.57:0/548779698 >> v1:172.21.15.118:6789/0 conn(0x7fdf900d3fe0 legacy=0x7fdf900d4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:38.663 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:38.660+0000 7fdf96400640 1 -- 172.21.15.57:0/548779698 >> v1:172.21.15.57:6789/0 conn(0x7fdf9015e4a0 legacy=0x7fdf900d14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:38.663 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:38.660+0000 7fdf96400640 1 -- 172.21.15.57:0/548779698 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf900cf8b0 con 0x7fdf900ceee0 2024-03-27T19:51:38.668 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:38.664+0000 7fdf96400640 1 --2- 172.21.15.57:0/548779698 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdf900ceee0 0x7fdf900cf370 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c0098a0 tx=0x7fdf7c02b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=993139fcf8e9a2d0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:51:38.668 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:38.664+0000 7fdf8fe00640 1 -- 172.21.15.57:0/548779698 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf7c034070 con 0x7fdf900ceee0 2024-03-27T19:51:38.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:38.664+0000 7fdf8fe00640 1 -- 172.21.15.57:0/548779698 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf7c030840 con 0x7fdf900ceee0 2024-03-27T19:51:38.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:38.664+0000 7fdf8fe00640 1 -- 172.21.15.57:0/548779698 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf7c030c10 con 0x7fdf900ceee0 2024-03-27T19:51:38.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:38.665+0000 7fdf98400640 1 -- 172.21.15.57:0/548779698 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdf900ceee0 msgr2=0x7fdf900cf370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:38.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:38.665+0000 7fdf98400640 1 --2- 172.21.15.57:0/548779698 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdf900ceee0 0x7fdf900cf370 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c0098a0 tx=0x7fdf7c02b980 comp rx=0 tx=0).stop 2024-03-27T19:51:38.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:38.666+0000 7fdf98400640 1 -- 172.21.15.57:0/548779698 shutdown_connections 2024-03-27T19:51:38.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:38.666+0000 7fdf98400640 1 --2- 172.21.15.57:0/548779698 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdf900ceee0 0x7fdf900cf370 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:38.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:38.666+0000 7fdf98400640 1 -- 172.21.15.57:0/548779698 >> 172.21.15.57:0/548779698 conn(0x7fdf9008db50 msgr2=0x7fdf9009d470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T19:51:38.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:38.666+0000 7fdf98400640 1 -- 172.21.15.57:0/548779698 shutdown_connections 2024-03-27T19:51:38.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:38.666+0000 7fdf98400640 1 -- 172.21.15.57:0/548779698 wait complete. 2024-03-27T19:51:38.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:38.669+0000 7fdf98400640 1 Processor -- start 2024-03-27T19:51:38.670 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:38.669+0000 7fdf98400640 1 -- start start 2024-03-27T19:51:38.672 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:38.671+0000 7fdf98400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf900ceee0 0x7fdf900b8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:38.672 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:38.671+0000 7fdf98400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdf900d3fe0 0x7fdf9015d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:38.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:38.671+0000 7fdf98400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdf9015e4a0 0x7fdf900cc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:38.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:38.671+0000 7fdf98400640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fdf900b32d0 con 0x7fdf9015e4a0 2024-03-27T19:51:38.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:38.671+0000 7fdf98400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fdf900b3150 con 0x7fdf900ceee0 2024-03-27T19:51:38.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:38.671+0000 7fdf98400640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fdf900b3450 con 0x7fdf900d3fe0 2024-03-27T19:51:38.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:38.674+0000 7fdf95000640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdf900d3fe0 0x7fdf9015d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:38.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:38.674+0000 7fdf95000640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdf900d3fe0 0x7fdf9015d520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.57:47924/0 (socket says 172.21.15.57:47924) 2024-03-27T19:51:38.675 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:38.674+0000 7fdf95000640 1 -- 172.21.15.57:0/3743829419 learned_addr learned my addr 172.21.15.57:0/3743829419 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T19:51:38.676 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:38.674+0000 7fdf96400640 1 --2- 172.21.15.57:0/3743829419 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdf9015e4a0 0x7fdf900cc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:38.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:38.675+0000 7fdf96400640 1 -- 172.21.15.57:0/3743829419 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdf900d3fe0 msgr2=0x7fdf9015d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:38.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:38.675+0000 7fdf96400640 1 --2- 172.21.15.57:0/3743829419 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdf900d3fe0 0x7fdf9015d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:38.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:38.675+0000 7fdf96400640 1 -- 172.21.15.57:0/3743829419 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf900ceee0 msgr2=0x7fdf900b8fb0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-27T19:51:38.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:38.675+0000 7fdf96400640 1 --2- 172.21.15.57:0/3743829419 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf900ceee0 0x7fdf900b8fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:38.677 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:38.675+0000 7fdf96400640 1 -- 172.21.15.57:0/3743829419 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf900c8e40 con 0x7fdf9015e4a0 2024-03-27T19:51:38.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:38.676+0000 7fdf96400640 1 --2- 172.21.15.57:0/3743829419 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdf9015e4a0 0x7fdf900cc8d0 secure :-1 s=READY pgs=2195 cs=0 l=1 rev1=1 crypto rx=0x7fdf900caee0 tx=0x7fdf7c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:51:38.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:38.677+0000 7fdf8d600640 1 -- 172.21.15.57:0/3743829419 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf7c048070 con 0x7fdf9015e4a0 2024-03-27T19:51:38.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:38.677+0000 7fdf8d600640 1 -- 172.21.15.57:0/3743829419 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf7c030640 con 0x7fdf9015e4a0 2024-03-27T19:51:38.679 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:38.677+0000 7fdf8d600640 1 -- 172.21.15.57:0/3743829419 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf7c034040 con 0x7fdf9015e4a0 2024-03-27T19:51:38.680 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:38.678+0000 7fdf98400640 1 -- 172.21.15.57:0/3743829419 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf900c9120 con 0x7fdf9015e4a0 2024-03-27T19:51:38.680 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:38.678+0000 7fdf98400640 1 -- 172.21.15.57:0/3743829419 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf900c96e0 con 0x7fdf9015e4a0 2024-03-27T19:51:38.682 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:38.680+0000 7fdf98400640 1 -- 172.21.15.57:0/3743829419 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf900c98e0 con 0x7fdf9015e4a0 2024-03-27T19:51:38.684 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:38.682+0000 7fdf8d600640 1 -- 172.21.15.57:0/3743829419 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fdf7c04b070 con 0x7fdf9015e4a0 2024-03-27T19:51:38.686 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:38.685+0000 7fdf8d600640 1 --2- 172.21.15.57:0/3743829419 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fdf7006c580 0x7fdf7006ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:38.686 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:38.685+0000 7fdf8d600640 1 -- 172.21.15.57:0/3743829419 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6130+0+0 (secure 0 0 0) 0x7fdf7c0ad560 con 0x7fdf9015e4a0 2024-03-27T19:51:38.687 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:38.686+0000 7fdf95a00640 1 --2- 172.21.15.57:0/3743829419 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fdf7006c580 0x7fdf7006ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:38.693 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:38.692+0000 7fdf95a00640 1 --2- 172.21.15.57:0/3743829419 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fdf7006c580 0x7fdf7006ea40 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fdf88001bd0 tx=0x7fdf88007c20 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:51:38.695 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:38.694+0000 7fdf8d600640 1 -- 172.21.15.57:0/3743829419 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7fdf900c98e0 con 0x7fdf9015e4a0 2024-03-27T19:51:39.035 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:39.034+0000 7fdf98400640 1 -- 172.21.15.57:0/3743829419 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdf90068620 con 0x7fdf9015e4a0 2024-03-27T19:51:39.037 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:39.036+0000 7fdf8d600640 1 -- 172.21.15.57:0/3743829419 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) ==== 74+0+16979 (secure 0 0 0) 0x7fdf7c07b460 con 0x7fdf9015e4a0 2024-03-27T19:51:39.038 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:51:39.038 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":42,"fsid":"7ac43f86-2c16-4a97-98fb-715d3cebc75c","created":"2024-03-27T09:59:04.033417+0000","modified":"2024-03-27T10:02:10.639858+0000","last_up_change":"2024-03-27T09:59:16.969624+0000","last_in_change":"2024-03-27T09:59:07.421690+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-27T09:59:17.253008+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-03-27T10:01:22.035595+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-03-27T10:01:22.866281+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"47b44362-7302-4f2a-b735-582c6c3850cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6801","nonce":2020036298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6803","nonce":2020036298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6807","nonce":2020036298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6805","nonce":2020036298}]},"public_addr":"172.21.15.57:6801/2020036298","cluster_addr":"172.21.15.57:6803/2020036298","heartbeat_back_addr":"172.21.15.57:6807/2020036298","heartbeat_front_addr":"172.21.15.57:6805/2020036298","state":["exists","up"]},{"osd":1,"uuid":"feaf96f0-9431-4188-9a09-da505b40e934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6809","nonce":3190929242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6811","nonce":3190929242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6815","nonce":3190929242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6813","nonce":3190929242}]},"public_addr":"172.21.15.57:6809/3190929242","cluster_addr":"172.21.15.57:6811/3190929242","heartbeat_back_addr":"172.21.15.57:6815/3190929242","heartbeat_front_addr":"172.21.15.57:6813/3190929242","state":["exists","up"]},{"osd":2,"uuid":"21e406e6-cfbc-4fe7-a816-e2420487c95d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6817","nonce":4065849973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6819","nonce":4065849973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6823","nonce":4065849973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6821","nonce":4065849973}]},"public_addr":"172.21.15.57:6817/4065849973","cluster_addr":"172.21.15.57:6819/4065849973","heartbeat_back_addr":"172.21.15.57:6823/4065849973","heartbeat_front_addr":"172.21.15.57:6821/4065849973","state":["exists","up"]},{"osd":3,"uuid":"a389af1d-76c4-4dfc-b215-f983f4931257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6825","nonce":158084809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6827","nonce":158084809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6831","nonce":158084809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6829","nonce":158084809}]},"public_addr":"172.21.15.57:6825/158084809","cluster_addr":"172.21.15.57:6827/158084809","heartbeat_back_addr":"172.21.15.57:6831/158084809","heartbeat_front_addr":"172.21.15.57:6829/158084809","state":["exists","up"]},{"osd":4,"uuid":"e9b05dca-557a-43ee-b43f-9ce5b7d28304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6823","nonce":108719401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6827","nonce":108719401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6831","nonce":108719401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6829","nonce":108719401}]},"public_addr":"172.21.15.118:6823/108719401","cluster_addr":"172.21.15.118:6827/108719401","heartbeat_back_addr":"172.21.15.118:6831/108719401","heartbeat_front_addr":"172.21.15.118:6829/108719401","state":["exists","up"]},{"osd":5,"uuid":"d968177d-44ff-499a-b00a-b147ed879253","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6817","nonce":2704605866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6819","nonce":2704605866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6826","nonce":2704605866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6822","nonce":2704605866}]},"public_addr":"172.21.15.118:6817/2704605866","cluster_addr":"172.21.15.118:6819/2704605866","heartbeat_back_addr":"172.21.15.118:6826/2704605866","heartbeat_front_addr":"172.21.15.118:6822/2704605866","state":["exists","up"]},{"osd":6,"uuid":"e8f98052-e6ad-4cfe-a4a9-0b17a434d54e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6801","nonce":1963659095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6803","nonce":1963659095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6807","nonce":1963659095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6805","nonce":1963659095}]},"public_addr":"172.21.15.118:6801/1963659095","cluster_addr":"172.21.15.118:6803/1963659095","heartbeat_back_addr":"172.21.15.118:6807/1963659095","heartbeat_front_addr":"172.21.15.118:6805/1963659095","state":["exists","up"]},{"osd":7,"uuid":"eccff987-8e51-4a63-845a-cf0a3196d7fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6809","nonce":1955879596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6811","nonce":1955879596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6815","nonce":1955879596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6813","nonce":1955879596}]},"public_addr":"172.21.15.118:6809/1955879596","cluster_addr":"172.21.15.118:6811/1955879596","heartbeat_back_addr":"172.21.15.118:6815/1955879596","heartbeat_front_addr":"172.21.15.118:6813/1955879596","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.721258+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.696610+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.777895+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.806769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.743259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.845687+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:13.020165+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.722294+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.26","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-27T19:51:39.042 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:39.040+0000 7fdf98400640 1 -- 172.21.15.57:0/3743829419 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fdf7006c580 msgr2=0x7fdf7006ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:39.042 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:39.040+0000 7fdf98400640 1 --2- 172.21.15.57:0/3743829419 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fdf7006c580 0x7fdf7006ea40 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fdf88001bd0 tx=0x7fdf88007c20 comp rx=0 tx=0).stop 2024-03-27T19:51:39.042 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:39.040+0000 7fdf98400640 1 -- 172.21.15.57:0/3743829419 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdf9015e4a0 msgr2=0x7fdf900cc8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:39.042 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:39.040+0000 7fdf98400640 1 --2- 172.21.15.57:0/3743829419 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdf9015e4a0 0x7fdf900cc8d0 secure :-1 s=READY pgs=2195 cs=0 l=1 rev1=1 crypto rx=0x7fdf900caee0 tx=0x7fdf7c004730 comp rx=0 tx=0).stop 2024-03-27T19:51:39.042 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:39.040+0000 7fdf98400640 1 -- 172.21.15.57:0/3743829419 shutdown_connections 2024-03-27T19:51:39.042 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:39.040+0000 7fdf98400640 1 --2- 172.21.15.57:0/3743829419 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdf9015e4a0 0x7fdf900cc8d0 unknown :-1 s=CLOSED pgs=2195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:39.042 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:39.040+0000 7fdf98400640 1 --2- 172.21.15.57:0/3743829419 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdf900d3fe0 0x7fdf9015d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:39.042 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:39.040+0000 7fdf98400640 1 --2- 172.21.15.57:0/3743829419 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fdf7006c580 0x7fdf7006ea40 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:39.042 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:39.040+0000 7fdf98400640 1 --2- 172.21.15.57:0/3743829419 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdf900ceee0 0x7fdf900b8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:39.042 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:39.040+0000 7fdf98400640 1 -- 172.21.15.57:0/3743829419 >> 172.21.15.57:0/3743829419 conn(0x7fdf9008db50 msgr2=0x7fdf900cfbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T19:51:39.042 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:39.040+0000 7fdf98400640 1 -- 172.21.15.57:0/3743829419 shutdown_connections 2024-03-27T19:51:39.042 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:39.040+0000 7fdf98400640 1 -- 172.21.15.57:0/3743829419 wait complete. 2024-03-27T19:51:39.065 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-27T09:59:17.253008+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-27T10:01:22.035595+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2024-03-27T10:01:22.866281+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-27T19:51:39.065 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-27T19:51:39.320 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:39.318+0000 7f164a400640 1 Processor -- start 2024-03-27T19:51:39.320 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:39.318+0000 7f164a400640 1 -- start start 2024-03-27T19:51:39.321 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:39.320+0000 7f164a400640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f164406e5f0 0x7f16440b4660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:39.321 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:39.320+0000 7f164a400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f16440719e0 0x7f164415e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:39.322 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:39.320+0000 7f164a400640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f164415a8a0 con 0x7f164415b640 2024-03-27T19:51:39.322 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:39.320+0000 7f164a400640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f164415b1b0 con 0x7f164406e5f0 2024-03-27T19:51:39.322 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:39.320+0000 7f164a400640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f164415ee00 con 0x7f16440719e0 2024-03-27T19:51:39.322 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:39.321+0000 7f1643400640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f164406e5f0 0x7f16440b4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:39.323 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:39.321+0000 7f1643400640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f164406e5f0 0x7f16440b4660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:45066/0 (socket says 172.21.15.57:45066) 2024-03-27T19:51:39.323 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:39.321+0000 7f1643400640 1 -- 172.21.15.57:0/3534303965 learned_addr learned my addr 172.21.15.57:0/3534303965 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T19:51:39.323 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:39.321+0000 7f1643e00640 1 --2- 172.21.15.57:0/3534303965 >> v2:172.21.15.118:3300/0 conn(0x7f16440719e0 0x7f164415e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:39.323 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:39.322+0000 7f1643400640 1 -- 172.21.15.57:0/3534303965 >> v2:172.21.15.118:3300/0 conn(0x7f16440719e0 msgr2=0x7f164415e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T19:51:39.324 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:39.322+0000 7f1643400640 1 --2- 172.21.15.57:0/3534303965 >> v2:172.21.15.118:3300/0 conn(0x7f16440719e0 0x7f164415e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:39.324 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:39.322+0000 7f1642000640 1 -- 172.21.15.57:0/3534303965 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3394872482 0 0) 0x7f164415a8a0 con 0x7f164415b640 2024-03-27T19:51:39.325 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:39.322+0000 7f1643400640 1 -- 172.21.15.57:0/3534303965 >> v1:172.21.15.118:6789/0 conn(0x7f164415b640 legacy=0x7f16440712d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:39.325 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:39.322+0000 7f1643400640 1 -- 172.21.15.57:0/3534303965 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f164406e9d0 con 0x7f164406e5f0 2024-03-27T19:51:39.325 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:39.322+0000 7f1643e00640 1 --2- 172.21.15.57:0/3534303965 >> v2:172.21.15.118:3300/0 conn(0x7f16440719e0 0x7f164415e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T19:51:39.326 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:39.324+0000 7f1643400640 1 --2- 172.21.15.57:0/3534303965 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f164406e5f0 0x7f16440b4660 secure :-1 s=READY pgs=2196 cs=0 l=1 rev1=1 crypto rx=0x7f1644072cc0 tx=0x7f163c02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=227774f0975f85ac server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:51:39.326 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:39.324+0000 7f1642000640 1 -- 172.21.15.57:0/3534303965 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f163c02ca80 con 0x7f164406e5f0 2024-03-27T19:51:39.326 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:39.324+0000 7f1642000640 1 -- 172.21.15.57:0/3534303965 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f163c02cc20 con 0x7f164406e5f0 2024-03-27T19:51:39.326 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:39.324+0000 7f1642000640 1 -- 172.21.15.57:0/3534303965 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f163c0343f0 con 0x7f164406e5f0 2024-03-27T19:51:39.327 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:39.325+0000 7f164a400640 1 -- 172.21.15.57:0/3534303965 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f164406e5f0 msgr2=0x7f16440b4660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:39.328 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:39.325+0000 7f164a400640 1 --2- 172.21.15.57:0/3534303965 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f164406e5f0 0x7f16440b4660 secure :-1 s=READY pgs=2196 cs=0 l=1 rev1=1 crypto rx=0x7f1644072cc0 tx=0x7f163c02bee0 comp rx=0 tx=0).stop 2024-03-27T19:51:39.328 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:39.326+0000 7f164a400640 1 -- 172.21.15.57:0/3534303965 shutdown_connections 2024-03-27T19:51:39.328 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:39.326+0000 7f164a400640 1 --2- 172.21.15.57:0/3534303965 >> v2:172.21.15.118:3300/0 conn(0x7f16440719e0 0x7f164415e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:39.328 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:39.326+0000 7f164a400640 1 --2- 172.21.15.57:0/3534303965 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f164406e5f0 0x7f16440b4660 unknown :-1 s=CLOSED pgs=2196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:39.328 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:39.326+0000 7f164a400640 1 -- 172.21.15.57:0/3534303965 >> 172.21.15.57:0/3534303965 conn(0x7f16440b18a0 msgr2=0x7f16440b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T19:51:39.328 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:39.326+0000 7f164a400640 1 -- 172.21.15.57:0/3534303965 shutdown_connections 2024-03-27T19:51:39.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:39.327+0000 7f164a400640 1 -- 172.21.15.57:0/3534303965 wait complete. 2024-03-27T19:51:39.329 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:39.328+0000 7f164a400640 1 Processor -- start 2024-03-27T19:51:39.330 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:39.329+0000 7f164a400640 1 -- start start 2024-03-27T19:51:39.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:39.330+0000 7f164a400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f164406e5f0 0x7f16440ae910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:39.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:39.330+0000 7f164a400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f16440719e0 0x7f16441578a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:39.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:39.330+0000 7f164a400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f164415b640 0x7f1644148fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:39.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:39.330+0000 7f164a400640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f164415ae40 con 0x7f164406e5f0 2024-03-27T19:51:39.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:39.330+0000 7f164a400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f164415ab60 con 0x7f164415b640 2024-03-27T19:51:39.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:39.330+0000 7f164a400640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f164406f2a0 con 0x7f16440719e0 2024-03-27T19:51:39.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:39.331+0000 7f1643400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f164406e5f0 0x7f16440ae910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:39.333 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:39.331+0000 7f1643400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f164406e5f0 0x7f16440ae910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:45070/0 (socket says 172.21.15.57:45070) 2024-03-27T19:51:39.333 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:39.331+0000 7f1643400640 1 -- 172.21.15.57:0/1498509362 learned_addr learned my addr 172.21.15.57:0/1498509362 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T19:51:39.333 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:39.331+0000 7f1643e00640 1 --2- 172.21.15.57:0/1498509362 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f164415b640 0x7f1644148fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:39.333 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:39.331+0000 7f1642a00640 1 --2- 172.21.15.57:0/1498509362 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f16440719e0 0x7f16441578a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:39.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:39.332+0000 7f1643400640 1 -- 172.21.15.57:0/1498509362 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f16440719e0 msgr2=0x7f16441578a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:39.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:39.332+0000 7f1643400640 1 --2- 172.21.15.57:0/1498509362 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f16440719e0 0x7f16441578a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:39.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:39.332+0000 7f1643400640 1 -- 172.21.15.57:0/1498509362 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f164415b640 msgr2=0x7f1644148fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:39.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:39.332+0000 7f1643400640 1 --2- 172.21.15.57:0/1498509362 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f164415b640 0x7f1644148fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:39.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:39.332+0000 7f1643400640 1 -- 172.21.15.57:0/1498509362 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f164415a040 con 0x7f164406e5f0 2024-03-27T19:51:39.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:39.332+0000 7f1643e00640 1 --2- 172.21.15.57:0/1498509362 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f164415b640 0x7f1644148fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T19:51:39.334 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:39.333+0000 7f1643400640 1 --2- 172.21.15.57:0/1498509362 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f164406e5f0 0x7f16440ae910 secure :-1 s=READY pgs=2197 cs=0 l=1 rev1=1 crypto rx=0x7f163c000f80 tx=0x7f163c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:51:39.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:39.333+0000 7f163b400640 1 -- 172.21.15.57:0/1498509362 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f163c043020 con 0x7f164406e5f0 2024-03-27T19:51:39.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:39.333+0000 7f163b400640 1 -- 172.21.15.57:0/1498509362 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f163c03e450 con 0x7f164406e5f0 2024-03-27T19:51:39.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:39.333+0000 7f163b400640 1 -- 172.21.15.57:0/1498509362 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f163c03e840 con 0x7f164406e5f0 2024-03-27T19:51:39.335 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:39.334+0000 7f164a400640 1 -- 172.21.15.57:0/1498509362 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f164414ae90 con 0x7f164406e5f0 2024-03-27T19:51:39.338 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:39.337+0000 7f163b400640 1 -- 172.21.15.57:0/1498509362 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f163c046020 con 0x7f164406e5f0 2024-03-27T19:51:39.339 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:39.337+0000 7f164a400640 1 -- 172.21.15.57:0/1498509362 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f164414b450 con 0x7f164406e5f0 2024-03-27T19:51:39.340 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:39.338+0000 7f163b400640 1 --2- 172.21.15.57:0/1498509362 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f162406c580 0x7f162406ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:39.341 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:39.340+0000 7f163b400640 1 -- 172.21.15.57:0/1498509362 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6130+0+0 (secure 0 0 0) 0x7f163c079690 con 0x7f164406e5f0 2024-03-27T19:51:39.341 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:39.340+0000 7f1642a00640 1 --2- 172.21.15.57:0/1498509362 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f162406c580 0x7f162406ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:39.342 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:39.341+0000 7f164a400640 1 -- 172.21.15.57:0/1498509362 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16440d0c00 con 0x7f164406e5f0 2024-03-27T19:51:39.343 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:39.342+0000 7f1642a00640 1 --2- 172.21.15.57:0/1498509362 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f162406c580 0x7f162406ea40 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f164416c710 tx=0x7f1630009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:51:39.351 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:39.349+0000 7f163b400640 1 -- 172.21.15.57:0/1498509362 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f16440d0c00 con 0x7f164406e5f0 2024-03-27T19:51:39.681 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:39.679+0000 7f164a400640 1 -- 172.21.15.57:0/1498509362 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f16440af1d0 con 0x7f164406e5f0 2024-03-27T19:51:39.696 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:39.695+0000 7f163b400640 1 -- 172.21.15.57:0/1498509362 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v42) ==== 93+0+10 (secure 0 0 0) 0x7f163c07bcf0 con 0x7f164406e5f0 2024-03-27T19:51:39.696 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 1 2024-03-27T19:51:39.699 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:39.698+0000 7f164a400640 1 -- 172.21.15.57:0/1498509362 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f162406c580 msgr2=0x7f162406ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:39.699 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:39.698+0000 7f164a400640 1 --2- 172.21.15.57:0/1498509362 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f162406c580 0x7f162406ea40 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f164416c710 tx=0x7f1630009040 comp rx=0 tx=0).stop 2024-03-27T19:51:39.700 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:39.698+0000 7f164a400640 1 -- 172.21.15.57:0/1498509362 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f164406e5f0 msgr2=0x7f16440ae910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:39.700 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:39.698+0000 7f164a400640 1 --2- 172.21.15.57:0/1498509362 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f164406e5f0 0x7f16440ae910 secure :-1 s=READY pgs=2197 cs=0 l=1 rev1=1 crypto rx=0x7f163c000f80 tx=0x7f163c004a40 comp rx=0 tx=0).stop 2024-03-27T19:51:39.700 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:39.698+0000 7f164a400640 1 -- 172.21.15.57:0/1498509362 shutdown_connections 2024-03-27T19:51:39.700 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:39.698+0000 7f164a400640 1 --2- 172.21.15.57:0/1498509362 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f162406c580 0x7f162406ea40 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:39.700 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:39.698+0000 7f164a400640 1 --2- 172.21.15.57:0/1498509362 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f164415b640 0x7f1644148fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:39.700 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:39.698+0000 7f164a400640 1 --2- 172.21.15.57:0/1498509362 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f16440719e0 0x7f16441578a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:39.700 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:39.698+0000 7f164a400640 1 --2- 172.21.15.57:0/1498509362 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f164406e5f0 0x7f16440ae910 unknown :-1 s=CLOSED pgs=2197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:39.700 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:39.698+0000 7f164a400640 1 -- 172.21.15.57:0/1498509362 >> 172.21.15.57:0/1498509362 conn(0x7f16440b18a0 msgr2=0x7f164406dbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T19:51:39.701 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:39.699+0000 7f164a400640 1 -- 172.21.15.57:0/1498509362 shutdown_connections 2024-03-27T19:51:39.701 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:39.699+0000 7f164a400640 1 -- 172.21.15.57:0/1498509362 wait complete. 2024-03-27T19:51:39.735 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-27T19:51:40.015 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.013+0000 7f2a8fc00640 1 Processor -- start 2024-03-27T19:51:40.015 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.013+0000 7f2a8fc00640 1 -- start start 2024-03-27T19:51:40.016 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.015+0000 7f2a8fc00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2a880711b0 0x7f2a88071600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:40.016 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.015+0000 7f2a8fc00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f2a8806d710 0x7f2a8806db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:40.016 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.015+0000 7f2a8fc00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a880b3fe0 con 0x7f2a88165bc0 2024-03-27T19:51:40.016 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.015+0000 7f2a8fc00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f2a88071b40 con 0x7f2a8806d710 2024-03-27T19:51:40.017 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.015+0000 7f2a8fc00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f2a8806cf30 con 0x7f2a880711b0 2024-03-27T19:51:40.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.015+0000 7f2a8d200640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f2a88165bc0 0x7f2a880b38d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.57:37466/0 (socket says 172.21.15.57:37466) 2024-03-27T19:51:40.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.016+0000 7f2a8d200640 1 -- 172.21.15.57:0/2124384064 learned_addr learned my addr 172.21.15.57:0/2124384064 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T19:51:40.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.015+0000 7f2a8dc00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f2a8806d710 0x7f2a8806db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:40.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.015+0000 7f2a87e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2a880711b0 0x7f2a88071600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:40.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.017+0000 7f2a87400640 1 -- 172.21.15.57:0/2124384064 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2230657253 0 0) 0x7f2a7c001110 con 0x7f2a88165bc0 2024-03-27T19:51:40.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.017+0000 7f2a87400640 1 -- 172.21.15.57:0/2124384064 --> v1:172.21.15.118:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2a70003520 con 0x7f2a88165bc0 2024-03-27T19:51:40.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.017+0000 7f2a8dc00640 1 -- 172.21.15.57:0/2124384064 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2a880711b0 msgr2=0x7f2a88071600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T19:51:40.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.017+0000 7f2a8dc00640 1 --2- 172.21.15.57:0/2124384064 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2a880711b0 0x7f2a88071600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:40.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.017+0000 7f2a8dc00640 1 -- 172.21.15.57:0/2124384064 >> v1:172.21.15.118:6789/0 conn(0x7f2a88165bc0 legacy=0x7f2a880b38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:40.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.017+0000 7f2a8dc00640 1 -- 172.21.15.57:0/2124384064 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a880b4820 con 0x7f2a8806d710 2024-03-27T19:51:40.022 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.018+0000 7f2a8dc00640 1 --2- 172.21.15.57:0/2124384064 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2a8806d710 0x7f2a8806db60 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f2a80009d90 tx=0x7f2a8002bd90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5dafc82c8840090f server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:51:40.022 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.019+0000 7f2a87400640 1 -- 172.21.15.57:0/2124384064 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a80039070 con 0x7f2a8806d710 2024-03-27T19:51:40.022 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.019+0000 7f2a87400640 1 -- 172.21.15.57:0/2124384064 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a8002cb40 con 0x7f2a8806d710 2024-03-27T19:51:40.022 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.019+0000 7f2a87400640 1 -- 172.21.15.57:0/2124384064 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a80034440 con 0x7f2a8806d710 2024-03-27T19:51:40.022 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.021+0000 7f2a8fc00640 1 -- 172.21.15.57:0/2124384064 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2a8806d710 msgr2=0x7f2a8806db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:40.022 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.021+0000 7f2a8fc00640 1 --2- 172.21.15.57:0/2124384064 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2a8806d710 0x7f2a8806db60 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f2a80009d90 tx=0x7f2a8002bd90 comp rx=0 tx=0).stop 2024-03-27T19:51:40.023 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.022+0000 7f2a8fc00640 1 -- 172.21.15.57:0/2124384064 shutdown_connections 2024-03-27T19:51:40.023 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.022+0000 7f2a8fc00640 1 --2- 172.21.15.57:0/2124384064 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2a8806d710 0x7f2a8806db60 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:40.023 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.022+0000 7f2a8fc00640 1 --2- 172.21.15.57:0/2124384064 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2a880711b0 0x7f2a88071600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:40.023 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.022+0000 7f2a8fc00640 1 -- 172.21.15.57:0/2124384064 >> 172.21.15.57:0/2124384064 conn(0x7f2a880b18a0 msgr2=0x7f2a880b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T19:51:40.023 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.022+0000 7f2a8fc00640 1 -- 172.21.15.57:0/2124384064 shutdown_connections 2024-03-27T19:51:40.023 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.022+0000 7f2a8fc00640 1 -- 172.21.15.57:0/2124384064 wait complete. 2024-03-27T19:51:40.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.025+0000 7f2a8fc00640 1 Processor -- start 2024-03-27T19:51:40.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.025+0000 7f2a8fc00640 1 -- start start 2024-03-27T19:51:40.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.026+0000 7f2a8fc00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2a8806d710 0x7f2a8815a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:40.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.026+0000 7f2a8fc00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2a880711b0 0x7f2a88155c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:40.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.026+0000 7f2a8fc00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2a88165bc0 0x7f2a88144dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:40.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.026+0000 7f2a8fc00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f2a8806d1f0 con 0x7f2a880711b0 2024-03-27T19:51:40.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.026+0000 7f2a8fc00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f2a880b4de0 con 0x7f2a88165bc0 2024-03-27T19:51:40.028 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.026+0000 7f2a8fc00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f2a88165fa0 con 0x7f2a8806d710 2024-03-27T19:51:40.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.027+0000 7f2a8d200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2a8806d710 0x7f2a8815a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:40.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.027+0000 7f2a8d200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2a8806d710 0x7f2a8815a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.57:47946/0 (socket says 172.21.15.57:47946) 2024-03-27T19:51:40.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.027+0000 7f2a8d200640 1 -- 172.21.15.57:0/1681723380 learned_addr learned my addr 172.21.15.57:0/1681723380 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T19:51:40.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.027+0000 7f2a8dc00640 1 --2- 172.21.15.57:0/1681723380 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2a88165bc0 0x7f2a88144dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:40.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.027+0000 7f2a87e00640 1 --2- 172.21.15.57:0/1681723380 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2a880711b0 0x7f2a88155c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:40.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.027+0000 7f2a8d200640 1 -- 172.21.15.57:0/1681723380 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2a88165bc0 msgr2=0x7f2a88144dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:40.029 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.027+0000 7f2a8d200640 1 --2- 172.21.15.57:0/1681723380 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2a88165bc0 0x7f2a88144dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:40.030 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.027+0000 7f2a8d200640 1 -- 172.21.15.57:0/1681723380 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2a880711b0 msgr2=0x7f2a88155c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:40.030 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.027+0000 7f2a8d200640 1 --2- 172.21.15.57:0/1681723380 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2a880711b0 0x7f2a88155c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:40.030 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.027+0000 7f2a8d200640 1 -- 172.21.15.57:0/1681723380 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a8815d2f0 con 0x7f2a8806d710 2024-03-27T19:51:40.030 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.028+0000 7f2a8d200640 1 --2- 172.21.15.57:0/1681723380 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2a8806d710 0x7f2a8815a140 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c00c730 tx=0x7f2a7c00cbf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:51:40.030 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.028+0000 7f2a84c00640 1 -- 172.21.15.57:0/1681723380 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a7c017070 con 0x7f2a8806d710 2024-03-27T19:51:40.031 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.029+0000 7f2a84c00640 1 -- 172.21.15.57:0/1681723380 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a7c005ab0 con 0x7f2a8806d710 2024-03-27T19:51:40.031 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.029+0000 7f2a84c00640 1 -- 172.21.15.57:0/1681723380 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a7c007e20 con 0x7f2a8806d710 2024-03-27T19:51:40.031 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.029+0000 7f2a8fc00640 1 -- 172.21.15.57:0/1681723380 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a8809c5c0 con 0x7f2a8806d710 2024-03-27T19:51:40.034 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.032+0000 7f2a84c00640 1 -- 172.21.15.57:0/1681723380 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f2a7c01a070 con 0x7f2a8806d710 2024-03-27T19:51:40.034 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.033+0000 7f2a8fc00640 1 -- 172.21.15.57:0/1681723380 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a8809cb40 con 0x7f2a8806d710 2024-03-27T19:51:40.037 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.035+0000 7f2a8fc00640 1 -- 172.21.15.57:0/1681723380 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a880757d0 con 0x7f2a8806d710 2024-03-27T19:51:40.038 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.036+0000 7f2a84c00640 1 --2- 172.21.15.57:0/1681723380 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f2a6806c5b0 0x7f2a6806ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:40.038 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.036+0000 7f2a84c00640 1 -- 172.21.15.57:0/1681723380 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(42..42 src has 1..42) ==== 6130+0+0 (secure 0 0 0) 0x7f2a7c08f060 con 0x7f2a8806d710 2024-03-27T19:51:40.038 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.037+0000 7f2a87e00640 1 --2- 172.21.15.57:0/1681723380 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f2a6806c5b0 0x7f2a6806ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:40.040 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.039+0000 7f2a87e00640 1 --2- 172.21.15.57:0/1681723380 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f2a6806c5b0 0x7f2a6806ea70 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f2a8806e620 tx=0x7f2a74008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:51:40.063 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.061+0000 7f2a84c00640 1 -- 172.21.15.57:0/1681723380 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f2a880b3fe0 con 0x7f2a8806d710 2024-03-27T19:51:40.404 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.402+0000 7f2a8fc00640 1 -- 172.21.15.57:0/1681723380 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f2a8806d430 con 0x7f2a8806d710 2024-03-27T19:51:40.427 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.425+0000 7f2a84c00640 1 -- 172.21.15.57:0/1681723380 <== mon.2 v2:172.21.15.118:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v42) ==== 104+0+11 (secure 0 0 0) 0x7f2a8806d430 con 0x7f2a8806d710 2024-03-27T19:51:40.427 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 32 2024-03-27T19:51:40.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.431+0000 7f2a8fc00640 1 -- 172.21.15.57:0/1681723380 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f2a6806c5b0 msgr2=0x7f2a6806ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:40.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.431+0000 7f2a8fc00640 1 --2- 172.21.15.57:0/1681723380 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f2a6806c5b0 0x7f2a6806ea70 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f2a8806e620 tx=0x7f2a74008040 comp rx=0 tx=0).stop 2024-03-27T19:51:40.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.431+0000 7f2a8fc00640 1 -- 172.21.15.57:0/1681723380 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2a8806d710 msgr2=0x7f2a8815a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:40.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.431+0000 7f2a8fc00640 1 --2- 172.21.15.57:0/1681723380 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2a8806d710 0x7f2a8815a140 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c00c730 tx=0x7f2a7c00cbf0 comp rx=0 tx=0).stop 2024-03-27T19:51:40.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.431+0000 7f2a8fc00640 1 -- 172.21.15.57:0/1681723380 shutdown_connections 2024-03-27T19:51:40.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.431+0000 7f2a8fc00640 1 --2- 172.21.15.57:0/1681723380 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f2a6806c5b0 0x7f2a6806ea70 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:40.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.431+0000 7f2a8fc00640 1 --2- 172.21.15.57:0/1681723380 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f2a88165bc0 0x7f2a88144dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:40.432 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.431+0000 7f2a8fc00640 1 --2- 172.21.15.57:0/1681723380 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f2a880711b0 0x7f2a88155c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:40.433 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.431+0000 7f2a8fc00640 1 --2- 172.21.15.57:0/1681723380 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2a8806d710 0x7f2a8815a140 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:40.433 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.431+0000 7f2a8fc00640 1 -- 172.21.15.57:0/1681723380 >> 172.21.15.57:0/1681723380 conn(0x7f2a880b18a0 msgr2=0x7f2a8806daf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T19:51:40.433 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.432+0000 7f2a8fc00640 1 -- 172.21.15.57:0/1681723380 shutdown_connections 2024-03-27T19:51:40.433 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.432+0000 7f2a8fc00640 1 -- 172.21.15.57:0/1681723380 wait complete. 2024-03-27T19:51:40.459 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-27T19:51:40.731 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.730+0000 7fd54ac00640 1 Processor -- start 2024-03-27T19:51:40.732 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.730+0000 7fd54ac00640 1 -- start start 2024-03-27T19:51:40.733 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.732+0000 7fd54ac00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fd54415e630 0x7fd5440d0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:40.733 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.732+0000 7fd54ac00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd5440d0fe0 0x7fd5440b92f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:40.734 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.732+0000 7fd54ac00640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5440d3190 con 0x7fd54415e250 2024-03-27T19:51:40.735 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.732+0000 7fd54ac00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7fd5440d1430 con 0x7fd54415e630 2024-03-27T19:51:40.735 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.732+0000 7fd54ac00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fd5440d2d00 con 0x7fd5440d0fe0 2024-03-27T19:51:40.735 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.733+0000 7fd543400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fd54415e630 0x7fd5440d0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:40.735 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.733+0000 7fd543400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fd54415e630 0x7fd5440d0aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.57:45162/0 (socket says 172.21.15.57:45162) 2024-03-27T19:51:40.735 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.733+0000 7fd543400640 1 -- 172.21.15.57:0/2122746031 learned_addr learned my addr 172.21.15.57:0/2122746031 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T19:51:40.735 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.733+0000 7fd548c00640 1 --2- 172.21.15.57:0/2122746031 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd5440d0fe0 0x7fd5440b92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:40.735 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.733+0000 7fd543400640 1 -- 172.21.15.57:0/2122746031 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd5440d0fe0 msgr2=0x7fd5440b92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T19:51:40.735 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.733+0000 7fd543400640 1 --2- 172.21.15.57:0/2122746031 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd5440d0fe0 0x7fd5440b92f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:40.735 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.733+0000 7fd543400640 1 -- 172.21.15.57:0/2122746031 >> v1:172.21.15.57:6789/0 conn(0x7fd54415e250 legacy=0x7fd5440cf9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T19:51:40.735 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.733+0000 7fd543400640 1 -- 172.21.15.57:0/2122746031 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5440d20f0 con 0x7fd54415e630 2024-03-27T19:51:40.739 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.735+0000 7fd543400640 1 --2- 172.21.15.57:0/2122746031 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd54415e630 0x7fd5440d0aa0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fd530009870 tx=0x7fd53002b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6def40ee356447ce server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:51:40.739 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.737+0000 7fd542a00640 1 -- 172.21.15.57:0/2122746031 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd530035020 con 0x7fd54415e630 2024-03-27T19:51:40.739 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.737+0000 7fd542a00640 1 -- 172.21.15.57:0/2122746031 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd530031640 con 0x7fd54415e630 2024-03-27T19:51:40.739 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.737+0000 7fd542a00640 1 -- 172.21.15.57:0/2122746031 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd53002d040 con 0x7fd54415e630 2024-03-27T19:51:40.740 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.739+0000 7fd54ac00640 1 -- 172.21.15.57:0/2122746031 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd54415e630 msgr2=0x7fd5440d0aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:40.740 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.739+0000 7fd54ac00640 1 --2- 172.21.15.57:0/2122746031 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd54415e630 0x7fd5440d0aa0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fd530009870 tx=0x7fd53002b8f0 comp rx=0 tx=0).stop 2024-03-27T19:51:40.744 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.743+0000 7fd54ac00640 1 -- 172.21.15.57:0/2122746031 shutdown_connections 2024-03-27T19:51:40.744 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.743+0000 7fd54ac00640 1 --2- 172.21.15.57:0/2122746031 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd5440d0fe0 0x7fd5440b92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:40.744 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.743+0000 7fd54ac00640 1 --2- 172.21.15.57:0/2122746031 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd54415e630 0x7fd5440d0aa0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:40.744 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.743+0000 7fd54ac00640 1 -- 172.21.15.57:0/2122746031 >> 172.21.15.57:0/2122746031 conn(0x7fd54409d4a0 msgr2=0x7fd5440d4160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T19:51:40.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.745+0000 7fd54ac00640 1 -- 172.21.15.57:0/2122746031 shutdown_connections 2024-03-27T19:51:40.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.745+0000 7fd54ac00640 1 -- 172.21.15.57:0/2122746031 wait complete. 2024-03-27T19:51:40.750 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.749+0000 7fd54ac00640 1 Processor -- start 2024-03-27T19:51:40.750 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.749+0000 7fd54ac00640 1 -- start start 2024-03-27T19:51:40.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.751+0000 7fd54ac00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd5440d0fe0 0x7fd544154e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:40.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.751+0000 7fd54ac00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd54415e250 0x7fd544157c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:40.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.751+0000 7fd54ac00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd54415e630 0x7fd5441581b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:40.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.751+0000 7fd54ac00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fd5440d2990 con 0x7fd5440d0fe0 2024-03-27T19:51:40.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.751+0000 7fd54ac00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fd5440d26b0 con 0x7fd54415e250 2024-03-27T19:51:40.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.751+0000 7fd54ac00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fd5440d00c0 con 0x7fd54415e630 2024-03-27T19:51:40.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.751+0000 7fd543e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd5440d0fe0 0x7fd544154e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:40.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.751+0000 7fd543e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd5440d0fe0 0x7fd544154e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:45086/0 (socket says 172.21.15.57:45086) 2024-03-27T19:51:40.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.751+0000 7fd543e00640 1 -- 172.21.15.57:0/2868704340 learned_addr learned my addr 172.21.15.57:0/2868704340 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T19:51:40.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.751+0000 7fd543400640 1 --2- 172.21.15.57:0/2868704340 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd54415e250 0x7fd544157c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:40.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.752+0000 7fd548c00640 1 --2- 172.21.15.57:0/2868704340 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd54415e630 0x7fd5441581b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:40.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.752+0000 7fd543e00640 1 -- 172.21.15.57:0/2868704340 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd54415e630 msgr2=0x7fd5441581b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:40.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.752+0000 7fd543e00640 1 --2- 172.21.15.57:0/2868704340 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd54415e630 0x7fd5441581b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:40.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.752+0000 7fd543e00640 1 -- 172.21.15.57:0/2868704340 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd54415e250 msgr2=0x7fd544157c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:40.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.752+0000 7fd543e00640 1 --2- 172.21.15.57:0/2868704340 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd54415e250 0x7fd544157c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:40.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.752+0000 7fd543e00640 1 -- 172.21.15.57:0/2868704340 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5441544d0 con 0x7fd5440d0fe0 2024-03-27T19:51:40.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.752+0000 7fd543e00640 1 --2- 172.21.15.57:0/2868704340 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd5440d0fe0 0x7fd544154e50 secure :-1 s=READY pgs=2198 cs=0 l=1 rev1=1 crypto rx=0x7fd53400c410 tx=0x7fd53400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:51:40.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.753+0000 7fd53be00640 1 -- 172.21.15.57:0/2868704340 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd534017070 con 0x7fd5440d0fe0 2024-03-27T19:51:40.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.753+0000 7fd54ac00640 1 -- 172.21.15.57:0/2868704340 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd544153950 con 0x7fd5440d0fe0 2024-03-27T19:51:40.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.753+0000 7fd53be00640 1 -- 172.21.15.57:0/2868704340 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5340035f0 con 0x7fd5440d0fe0 2024-03-27T19:51:40.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.753+0000 7fd53be00640 1 -- 172.21.15.57:0/2868704340 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd534003a20 con 0x7fd5440d0fe0 2024-03-27T19:51:40.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.753+0000 7fd54ac00640 1 -- 172.21.15.57:0/2868704340 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd544153f10 con 0x7fd5440d0fe0 2024-03-27T19:51:40.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.755+0000 7fd54ac00640 1 -- 172.21.15.57:0/2868704340 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd544068540 con 0x7fd5440d0fe0 2024-03-27T19:51:40.757 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.756+0000 7fd53be00640 1 -- 172.21.15.57:0/2868704340 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fd53401a070 con 0x7fd5440d0fe0 2024-03-27T19:51:40.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.758+0000 7fd53be00640 1 --2- 172.21.15.57:0/2868704340 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fd52406c560 0x7fd52406ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:40.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.758+0000 7fd53be00640 1 -- 172.21.15.57:0/2868704340 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6130+0+0 (secure 0 0 0) 0x7fd53408aca0 con 0x7fd5440d0fe0 2024-03-27T19:51:40.760 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.759+0000 7fd543400640 1 --2- 172.21.15.57:0/2868704340 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fd52406c560 0x7fd52406ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:40.761 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.760+0000 7fd543400640 1 --2- 172.21.15.57:0/2868704340 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fd52406c560 0x7fd52406ea20 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fd530036000 tx=0x7fd53003c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:51:40.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:40.765+0000 7fd53be00640 1 -- 172.21.15.57:0/2868704340 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7fd5340010c0 con 0x7fd5440d0fe0 2024-03-27T19:51:41.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.114+0000 7fd54ac00640 1 -- 172.21.15.57:0/2868704340 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fd5440d4870 con 0x7fd5440d0fe0 2024-03-27T19:51:41.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.115+0000 7fd53be00640 1 -- 172.21.15.57:0/2868704340 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v42) ==== 100+0+11 (secure 0 0 0) 0x7fd534058a20 con 0x7fd5440d0fe0 2024-03-27T19:51:41.116 INFO:teuthology.orchestra.run.smithi057.stdout:pg_num: 64 2024-03-27T19:51:41.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.117+0000 7fd54ac00640 1 -- 172.21.15.57:0/2868704340 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fd52406c560 msgr2=0x7fd52406ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:41.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.117+0000 7fd54ac00640 1 --2- 172.21.15.57:0/2868704340 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fd52406c560 0x7fd52406ea20 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fd530036000 tx=0x7fd53003c040 comp rx=0 tx=0).stop 2024-03-27T19:51:41.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.117+0000 7fd54ac00640 1 -- 172.21.15.57:0/2868704340 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd5440d0fe0 msgr2=0x7fd544154e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:41.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.117+0000 7fd54ac00640 1 --2- 172.21.15.57:0/2868704340 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd5440d0fe0 0x7fd544154e50 secure :-1 s=READY pgs=2198 cs=0 l=1 rev1=1 crypto rx=0x7fd53400c410 tx=0x7fd53400c8d0 comp rx=0 tx=0).stop 2024-03-27T19:51:41.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.118+0000 7fd54ac00640 1 -- 172.21.15.57:0/2868704340 shutdown_connections 2024-03-27T19:51:41.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.118+0000 7fd54ac00640 1 --2- 172.21.15.57:0/2868704340 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd54415e630 0x7fd5441581b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:41.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.118+0000 7fd54ac00640 1 --2- 172.21.15.57:0/2868704340 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fd52406c560 0x7fd52406ea20 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:41.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.118+0000 7fd54ac00640 1 --2- 172.21.15.57:0/2868704340 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd54415e250 0x7fd544157c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:41.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.118+0000 7fd54ac00640 1 --2- 172.21.15.57:0/2868704340 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd5440d0fe0 0x7fd544154e50 unknown :-1 s=CLOSED pgs=2198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:41.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.118+0000 7fd54ac00640 1 -- 172.21.15.57:0/2868704340 >> 172.21.15.57:0/2868704340 conn(0x7fd54409d4a0 msgr2=0x7fd54415d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T19:51:41.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.119+0000 7fd54ac00640 1 -- 172.21.15.57:0/2868704340 shutdown_connections 2024-03-27T19:51:41.121 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.119+0000 7fd54ac00640 1 -- 172.21.15.57:0/2868704340 wait complete. 2024-03-27T19:51:41.146 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-27T19:51:41.393 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.392+0000 7faac1800640 1 Processor -- start 2024-03-27T19:51:41.393 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.392+0000 7faac1800640 1 -- start start 2024-03-27T19:51:41.396 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.394+0000 7faac1800640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7faabc0d3db0 0x7faabc0d4210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:41.396 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.394+0000 7faac1800640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7faabc0cec10 0x7faabc0cf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:41.396 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.394+0000 7faac1800640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faabc0d4750 con 0x7faabc15e510 2024-03-27T19:51:41.396 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.394+0000 7faac1800640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7faabc15e8f0 con 0x7faabc0d3db0 2024-03-27T19:51:41.396 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.394+0000 7faac1800640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7faabc0b4110 con 0x7faabc0cec10 2024-03-27T19:51:41.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.394+0000 7faabaa00640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7faabc15e510 0x7faabc0d28a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:46180/0 (socket says 172.21.15.57:46180) 2024-03-27T19:51:41.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.394+0000 7faabaa00640 1 -- 172.21.15.57:0/2366241093 learned_addr learned my addr 172.21.15.57:0/2366241093 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T19:51:41.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.395+0000 7faaba000640 1 --2- 172.21.15.57:0/2366241093 >> v2:172.21.15.57:3300/0 conn(0x7faabc0d3db0 0x7faabc0d4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:41.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.395+0000 7faabb400640 1 --2- 172.21.15.57:0/2366241093 >> v2:172.21.15.118:3300/0 conn(0x7faabc0cec10 0x7faabc0cf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:41.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.395+0000 7faab9600640 1 -- 172.21.15.57:0/2366241093 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1955763862 0 0) 0x7faabc0d4750 con 0x7faabc15e510 2024-03-27T19:51:41.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.395+0000 7faab9600640 1 -- 172.21.15.57:0/2366241093 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faaa0003520 con 0x7faabc15e510 2024-03-27T19:51:41.398 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.396+0000 7faab9600640 1 -- 172.21.15.57:0/2366241093 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2106812388 0 0) 0x7faaa0003520 con 0x7faabc15e510 2024-03-27T19:51:41.398 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.396+0000 7faab9600640 1 -- 172.21.15.57:0/2366241093 >> v2:172.21.15.118:3300/0 conn(0x7faabc0cec10 msgr2=0x7faabc0cf0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T19:51:41.398 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.396+0000 7faab9600640 1 --2- 172.21.15.57:0/2366241093 >> v2:172.21.15.118:3300/0 conn(0x7faabc0cec10 0x7faabc0cf0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:41.398 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.396+0000 7faab9600640 1 -- 172.21.15.57:0/2366241093 >> v2:172.21.15.57:3300/0 conn(0x7faabc0d3db0 msgr2=0x7faabc0d4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T19:51:41.398 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.396+0000 7faab9600640 1 --2- 172.21.15.57:0/2366241093 >> v2:172.21.15.57:3300/0 conn(0x7faabc0d3db0 0x7faabc0d4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:41.398 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.396+0000 7faab9600640 1 -- 172.21.15.57:0/2366241093 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faabc0b43f0 con 0x7faabc15e510 2024-03-27T19:51:41.398 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.396+0000 7faab9600640 1 -- 172.21.15.57:0/2366241093 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4227751516 0 0) 0x7faaac001670 con 0x7faabc15e510 2024-03-27T19:51:41.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.396+0000 7faab9600640 1 -- 172.21.15.57:0/2366241093 >> v1:172.21.15.57:6789/0 conn(0x7faabc15e510 legacy=0x7faabc0d28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:41.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.396+0000 7faab9600640 1 --2- 172.21.15.57:0/2366241093 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faaa00039b0 0x7faaa0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:41.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.396+0000 7faab9600640 1 --2- 172.21.15.57:0/2366241093 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faaa0004800 0x7faaa0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:41.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.396+0000 7faab9600640 1 --2- 172.21.15.57:0/2366241093 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faaa00051c0 0x7faaa000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:41.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.396+0000 7faab9600640 1 -- 172.21.15.57:0/2366241093 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7faabc15e8f0 con 0x7faaa00039b0 2024-03-27T19:51:41.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.396+0000 7faab9600640 1 -- 172.21.15.57:0/2366241093 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7faabc0b4110 con 0x7faaa0004800 2024-03-27T19:51:41.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.396+0000 7faab9600640 1 -- 172.21.15.57:0/2366241093 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7faaa000c000 con 0x7faaa00051c0 2024-03-27T19:51:41.399 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.396+0000 7faabb400640 1 --2- 172.21.15.57:0/2366241093 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faaa00051c0 0x7faaa000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:41.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.397+0000 7faabaa00640 1 --2- 172.21.15.57:0/2366241093 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faaa00039b0 0x7faaa0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:41.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.398+0000 7faaba000640 1 --2- 172.21.15.57:0/2366241093 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faaa0004800 0x7faaa0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:41.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.398+0000 7faabaa00640 1 -- 172.21.15.57:0/2366241093 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faaa00051c0 msgr2=0x7faaa000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T19:51:41.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.398+0000 7faabaa00640 1 --2- 172.21.15.57:0/2366241093 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faaa00051c0 0x7faaa000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:41.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.398+0000 7faabaa00640 1 -- 172.21.15.57:0/2366241093 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faaa0004800 msgr2=0x7faaa0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T19:51:41.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.398+0000 7faabaa00640 1 --2- 172.21.15.57:0/2366241093 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faaa0004800 0x7faaa0004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:41.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.398+0000 7faabaa00640 1 -- 172.21.15.57:0/2366241093 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faabc0b43f0 con 0x7faaa00039b0 2024-03-27T19:51:41.400 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.398+0000 7faabb400640 1 -- 172.21.15.57:0/2366241093 reap_dead start 2024-03-27T19:51:41.403 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.402+0000 7faabaa00640 1 --2- 172.21.15.57:0/2366241093 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faaa00039b0 0x7faaa0003dd0 secure :-1 s=READY pgs=2200 cs=0 l=1 rev1=1 crypto rx=0x7faaac00c290 tx=0x7faaa0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a087a2dfcfa904e server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:51:41.404 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.403+0000 7faab9600640 1 -- 172.21.15.57:0/2366241093 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaac007d70 con 0x7faaa00039b0 2024-03-27T19:51:41.404 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.403+0000 7faab9600640 1 -- 172.21.15.57:0/2366241093 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faaac030070 con 0x7faaa00039b0 2024-03-27T19:51:41.404 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.403+0000 7faab9600640 1 -- 172.21.15.57:0/2366241093 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaac005d30 con 0x7faaa00039b0 2024-03-27T19:51:41.405 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.404+0000 7faac1800640 1 -- 172.21.15.57:0/2366241093 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faaa00039b0 msgr2=0x7faaa0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:41.405 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.404+0000 7faac1800640 1 --2- 172.21.15.57:0/2366241093 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faaa00039b0 0x7faaa0003dd0 secure :-1 s=READY pgs=2200 cs=0 l=1 rev1=1 crypto rx=0x7faaac00c290 tx=0x7faaa0005830 comp rx=0 tx=0).stop 2024-03-27T19:51:41.406 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.404+0000 7faac1800640 1 -- 172.21.15.57:0/2366241093 shutdown_connections 2024-03-27T19:51:41.406 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.404+0000 7faac1800640 1 --2- 172.21.15.57:0/2366241093 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faaa00039b0 0x7faaa0003dd0 unknown :-1 s=CLOSED pgs=2200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:41.406 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.404+0000 7faac1800640 1 -- 172.21.15.57:0/2366241093 >> 172.21.15.57:0/2366241093 conn(0x7faabc067c00 msgr2=0x7faabc09d440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T19:51:41.406 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.405+0000 7faac1800640 1 -- 172.21.15.57:0/2366241093 shutdown_connections 2024-03-27T19:51:41.406 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.405+0000 7faac1800640 1 -- 172.21.15.57:0/2366241093 wait complete. 2024-03-27T19:51:41.408 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.407+0000 7faac1800640 1 Processor -- start 2024-03-27T19:51:41.409 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.408+0000 7faac1800640 1 -- start start 2024-03-27T19:51:41.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.410+0000 7faac1800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faaa00039b0 0x7faabc15fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:41.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.410+0000 7faac1800640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faabc0c8640 0x7faabc0c8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:41.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.410+0000 7faac1800640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faabc0cc2d0 0x7faabc0cc750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:41.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.410+0000 7faac1800640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7faabc0b4c90 con 0x7faabc0c8640 2024-03-27T19:51:41.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.410+0000 7faac1800640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7faabc0b49b0 con 0x7faaa00039b0 2024-03-27T19:51:41.411 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.410+0000 7faac1800640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7faabc0b3d70 con 0x7faabc0cc2d0 2024-03-27T19:51:41.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.410+0000 7faabaa00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faaa00039b0 0x7faabc15fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:41.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.410+0000 7faabb400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faabc0cc2d0 0x7faabc0cc750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:41.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.410+0000 7faaba000640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faabc0c8640 0x7faabc0c8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:41.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.410+0000 7faabaa00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faaa00039b0 0x7faabc15fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.57:45204/0 (socket says 172.21.15.57:45204) 2024-03-27T19:51:41.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.410+0000 7faabb400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faabc0cc2d0 0x7faabc0cc750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.57:47968/0 (socket says 172.21.15.57:47968) 2024-03-27T19:51:41.412 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.410+0000 7faabaa00640 1 -- 172.21.15.57:0/1957086384 learned_addr learned my addr 172.21.15.57:0/1957086384 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T19:51:41.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.411+0000 7faabb400640 1 -- 172.21.15.57:0/1957086384 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faaa00039b0 msgr2=0x7faabc15fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:41.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.411+0000 7faabb400640 1 --2- 172.21.15.57:0/1957086384 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faaa00039b0 0x7faabc15fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:41.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.411+0000 7faabb400640 1 -- 172.21.15.57:0/1957086384 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faabc0c8640 msgr2=0x7faabc0c8ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:41.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.411+0000 7faabb400640 1 --2- 172.21.15.57:0/1957086384 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faabc0c8640 0x7faabc0c8ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:41.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.411+0000 7faabb400640 1 -- 172.21.15.57:0/1957086384 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faabc15ecc0 con 0x7faabc0cc2d0 2024-03-27T19:51:41.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.411+0000 7faaba000640 1 --2- 172.21.15.57:0/1957086384 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faabc0c8640 0x7faabc0c8ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T19:51:41.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.412+0000 7faabb400640 1 --2- 172.21.15.57:0/1957086384 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faabc0cc2d0 0x7faabc0cc750 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7faabc08e930 tx=0x7faab400f580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:51:41.413 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.412+0000 7faabaa00640 1 --2- 172.21.15.57:0/1957086384 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faaa00039b0 0x7faabc15fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T19:51:41.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.412+0000 7faab2a00640 1 -- 172.21.15.57:0/1957086384 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab400fde0 con 0x7faabc0cc2d0 2024-03-27T19:51:41.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.412+0000 7faab2a00640 1 -- 172.21.15.57:0/1957086384 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faab4015430 con 0x7faabc0cc2d0 2024-03-27T19:51:41.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.412+0000 7faab2a00640 1 -- 172.21.15.57:0/1957086384 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab4015800 con 0x7faabc0cc2d0 2024-03-27T19:51:41.414 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.412+0000 7faac1800640 1 -- 172.21.15.57:0/1957086384 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faabc15efa0 con 0x7faabc0cc2d0 2024-03-27T19:51:41.415 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.413+0000 7faac1800640 1 -- 172.21.15.57:0/1957086384 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7faabc15f560 con 0x7faabc0cc2d0 2024-03-27T19:51:41.415 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.414+0000 7faac1800640 1 -- 172.21.15.57:0/1957086384 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faabc068c50 con 0x7faabc0cc2d0 2024-03-27T19:51:41.417 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.416+0000 7faab2a00640 1 -- 172.21.15.57:0/1957086384 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7faab40159a0 con 0x7faabc0cc2d0 2024-03-27T19:51:41.418 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.417+0000 7faab2a00640 1 --2- 172.21.15.57:0/1957086384 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7faa9c06c530 0x7faa9c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:41.418 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.417+0000 7faab2a00640 1 -- 172.21.15.57:0/1957086384 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(42..42 src has 1..42) ==== 6130+0+0 (secure 0 0 0) 0x7faab408c220 con 0x7faabc0cc2d0 2024-03-27T19:51:41.419 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.418+0000 7faabaa00640 1 --2- 172.21.15.57:0/1957086384 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7faa9c06c530 0x7faa9c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:41.421 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.420+0000 7faabaa00640 1 --2- 172.21.15.57:0/1957086384 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7faa9c06c530 0x7faa9c06e9f0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7faaac000c00 tx=0x7faaac009030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:51:41.425 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.424+0000 7faab2a00640 1 -- 172.21.15.57:0/1957086384 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7faab4024030 con 0x7faabc0cc2d0 2024-03-27T19:51:41.868 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.867+0000 7faac1800640 1 -- 172.21.15.57:0/1957086384 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faabc0d22b0 con 0x7faabc0cc2d0 2024-03-27T19:51:41.872 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.871+0000 7faab2a00640 1 -- 172.21.15.57:0/1957086384 <== mon.2 v2:172.21.15.118:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5181 (secure 0 0 0) 0x7faab4019030 con 0x7faabc0cc2d0 2024-03-27T19:51:41.874 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:51:41.875 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4883,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/534729135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":534729135},{"type":"v1","addr":"172.21.15.57:6835","nonce":534729135}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4886,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/1117032671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1117032671},{"type":"v1","addr":"172.21.15.118:6834","nonce":1117032671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4889,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/2149281891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":2149281891},{"type":"v1","addr":"172.21.15.118:6835","nonce":2149281891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-27T10:01:23.885660+0000","modified":"2024-03-27T10:01:27.013100+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5508},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5508":{"gid":5508,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.57:6837/385124398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":385124398},{"type":"v1","addr":"172.21.15.57:6837","nonce":385124398}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5508,"qdb_cluster":[5508]},"id":2}]} 2024-03-27T19:51:41.875 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 18 2024-03-27T19:51:41.877 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.875+0000 7faac1800640 1 -- 172.21.15.57:0/1957086384 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7faa9c06c530 msgr2=0x7faa9c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:41.877 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.875+0000 7faac1800640 1 --2- 172.21.15.57:0/1957086384 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7faa9c06c530 0x7faa9c06e9f0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7faaac000c00 tx=0x7faaac009030 comp rx=0 tx=0).stop 2024-03-27T19:51:41.877 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.875+0000 7faac1800640 1 -- 172.21.15.57:0/1957086384 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faabc0cc2d0 msgr2=0x7faabc0cc750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:41.877 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.875+0000 7faac1800640 1 --2- 172.21.15.57:0/1957086384 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faabc0cc2d0 0x7faabc0cc750 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7faabc08e930 tx=0x7faab400f580 comp rx=0 tx=0).stop 2024-03-27T19:51:41.877 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.876+0000 7faac1800640 1 -- 172.21.15.57:0/1957086384 shutdown_connections 2024-03-27T19:51:41.877 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.876+0000 7faac1800640 1 --2- 172.21.15.57:0/1957086384 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7faabc0cc2d0 0x7faabc0cc750 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:41.878 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.876+0000 7faac1800640 1 --2- 172.21.15.57:0/1957086384 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7faabc0c8640 0x7faabc0c8ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:41.878 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.876+0000 7faac1800640 1 --2- 172.21.15.57:0/1957086384 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7faa9c06c530 0x7faa9c06e9f0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:41.878 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.876+0000 7faac1800640 1 --2- 172.21.15.57:0/1957086384 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7faaa00039b0 0x7faabc15fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:41.878 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.876+0000 7faac1800640 1 -- 172.21.15.57:0/1957086384 >> 172.21.15.57:0/1957086384 conn(0x7faabc067c00 msgr2=0x7faabc074990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T19:51:41.878 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.876+0000 7faac1800640 1 -- 172.21.15.57:0/1957086384 shutdown_connections 2024-03-27T19:51:41.878 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:41.876+0000 7faac1800640 1 -- 172.21.15.57:0/1957086384 wait complete. 2024-03-27T19:51:41.903 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-27T19:51:42.193 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:42.190+0000 7f643b000640 1 Processor -- start 2024-03-27T19:51:42.193 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:42.190+0000 7f643b000640 1 -- start start 2024-03-27T19:51:42.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:42.195+0000 7f643b000640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f643415a1b0 0x7f64340b30a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:42.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:42.195+0000 7f643b000640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f6434071200 0x7f643406b880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:42.196 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:42.195+0000 7f643b000640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f643406f2f0 0x7f643406bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:42.201 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:42.196+0000 7f6433e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f643415a1b0 0x7f64340b30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:42.201 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:42.196+0000 7f6433400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f6434071200 0x7f643406b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:42.201 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:42.196+0000 7f6433e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f643415a1b0 0x7f64340b30a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.57:33288/0 (socket says 172.21.15.57:33288) 2024-03-27T19:51:42.201 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:42.196+0000 7f6439000640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f643406f2f0 0x7f643406bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:42.201 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:42.196+0000 7f6439000640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f643406f2f0 0x7f643406bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37868/0 (socket says 172.21.15.57:37868) 2024-03-27T19:51:42.201 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:42.196+0000 7f6433400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f6434071200 0x7f643406b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.57:59360/0 (socket says 172.21.15.57:59360) 2024-03-27T19:51:42.201 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:42.196+0000 7f643b000640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f64340cf4a0 con 0x7f643406f2f0 2024-03-27T19:51:42.202 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:42.196+0000 7f643b000640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f64340b37d0 con 0x7f6434071200 2024-03-27T19:51:42.202 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:42.196+0000 7f643b000640 1 -- 172.21.15.57:0/983298638 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f64340b3ab0 con 0x7f643415a1b0 2024-03-27T19:51:42.202 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:42.196+0000 7f6433e00640 1 -- 172.21.15.57:0/983298638 learned_addr learned my addr 172.21.15.57:0/983298638 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T19:51:42.202 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:42.197+0000 7f6433e00640 1 -- 172.21.15.57:0/983298638 >> v2:172.21.15.118:3300/0 conn(0x7f6434071200 msgr2=0x7f643406b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T19:51:42.202 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:42.197+0000 7f6433e00640 1 --2- 172.21.15.57:0/983298638 >> v2:172.21.15.118:3300/0 conn(0x7f6434071200 0x7f643406b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:42.202 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:42.197+0000 7f6433e00640 1 -- 172.21.15.57:0/983298638 >> v2:172.21.15.57:3300/0 conn(0x7f643406f2f0 msgr2=0x7f643406bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T19:51:42.202 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:42.197+0000 7f6433e00640 1 --2- 172.21.15.57:0/983298638 >> v2:172.21.15.57:3300/0 conn(0x7f643406f2f0 0x7f643406bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:42.202 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:42.197+0000 7f6433e00640 1 -- 172.21.15.57:0/983298638 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64340b3d90 con 0x7f643415a1b0 2024-03-27T19:51:42.202 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:42.198+0000 7f6433e00640 1 --2- 172.21.15.57:0/983298638 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f643415a1b0 0x7f64340b30a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f643406c4f0 tx=0x7f6424034160 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ffcc17b8e1265eff server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:51:42.202 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:42.199+0000 7f6432a00640 1 -- 172.21.15.57:0/983298638 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64240110d0 con 0x7f643415a1b0 2024-03-27T19:51:42.202 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:42.199+0000 7f6433400640 1 --2- 172.21.15.57:0/983298638 >> v2:172.21.15.118:3300/0 conn(0x7f6434071200 0x7f643406b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T19:51:42.203 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:42.199+0000 7f6432a00640 1 -- 172.21.15.57:0/983298638 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6424011270 con 0x7f643415a1b0 2024-03-27T19:51:42.203 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:42.199+0000 7f6432a00640 1 -- 172.21.15.57:0/983298638 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64240110d0 con 0x7f643415a1b0 2024-03-27T19:51:42.203 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:42.199+0000 7f6439000640 1 --2- 172.21.15.57:0/983298638 >> v2:172.21.15.57:3300/0 conn(0x7f643406f2f0 0x7f643406bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T19:51:42.203 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:42.200+0000 7f643b000640 1 -- 172.21.15.57:0/983298638 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f643415a1b0 msgr2=0x7f64340b30a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:42.203 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:42.200+0000 7f643b000640 1 --2- 172.21.15.57:0/983298638 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f643415a1b0 0x7f64340b30a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f643406c4f0 tx=0x7f6424034160 comp rx=0 tx=0).stop 2024-03-27T19:51:42.203 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:42.201+0000 7f643b000640 1 -- 172.21.15.57:0/983298638 shutdown_connections 2024-03-27T19:51:42.204 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:42.201+0000 7f643b000640 1 --2- 172.21.15.57:0/983298638 >> v2:172.21.15.57:3300/0 conn(0x7f643406f2f0 0x7f643406bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:42.204 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:42.201+0000 7f643b000640 1 --2- 172.21.15.57:0/983298638 >> v2:172.21.15.118:3300/0 conn(0x7f6434071200 0x7f643406b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:42.204 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:42.201+0000 7f643b000640 1 --2- 172.21.15.57:0/983298638 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f643415a1b0 0x7f64340b30a0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:42.204 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:42.201+0000 7f643b000640 1 -- 172.21.15.57:0/983298638 >> 172.21.15.57:0/983298638 conn(0x7f64340b1c60 msgr2=0x7f64340b2070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T19:51:42.204 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:42.201+0000 7f643b000640 1 -- 172.21.15.57:0/983298638 shutdown_connections 2024-03-27T19:51:42.204 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:42.201+0000 7f643b000640 1 -- 172.21.15.57:0/983298638 wait complete. 2024-03-27T19:51:42.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:42.204+0000 7f643b000640 1 Processor -- start 2024-03-27T19:51:42.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:42.204+0000 7f643b000640 1 -- start start 2024-03-27T19:51:42.207 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:42.206+0000 7f643b000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f643406f2f0 0x7f64341f2f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:42.207 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:42.206+0000 7f643b000640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6434071200 0x7f6434157790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:42.208 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:42.207+0000 7f6433e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f643406f2f0 0x7f64341f2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:42.208 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:42.207+0000 7f643b000640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f643415a1b0 0x7f64341f0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:42.208 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:42.207+0000 7f643b000640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f64340b4870 con 0x7f643415a1b0 2024-03-27T19:51:42.208 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:42.207+0000 7f643b000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f64340b4350 con 0x7f643406f2f0 2024-03-27T19:51:42.208 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:42.207+0000 7f643b000640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f643415a590 con 0x7f6434071200 2024-03-27T19:51:42.208 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:42.207+0000 7f6433e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f643406f2f0 0x7f64341f2f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.57:59366/0 (socket says 172.21.15.57:59366) 2024-03-27T19:51:42.208 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:42.207+0000 7f6433e00640 1 -- 172.21.15.57:0/3487243123 learned_addr learned my addr 172.21.15.57:0/3487243123 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T19:51:42.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:42.207+0000 7f6433400640 1 --2- 172.21.15.57:0/3487243123 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6434071200 0x7f6434157790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:42.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:42.207+0000 7f6439000640 1 --2- 172.21.15.57:0/3487243123 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f643415a1b0 0x7f64341f0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:42.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:42.208+0000 7f6433e00640 1 -- 172.21.15.57:0/3487243123 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6434071200 msgr2=0x7f6434157790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:42.209 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:42.208+0000 7f6433e00640 1 --2- 172.21.15.57:0/3487243123 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6434071200 0x7f6434157790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:42.210 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:42.208+0000 7f6433e00640 1 -- 172.21.15.57:0/3487243123 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f643415a1b0 msgr2=0x7f64341f0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:42.210 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:42.208+0000 7f6433e00640 1 --2- 172.21.15.57:0/3487243123 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f643415a1b0 0x7f64341f0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:42.210 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:42.208+0000 7f6433e00640 1 -- 172.21.15.57:0/3487243123 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f643415d650 con 0x7f643406f2f0 2024-03-27T19:51:42.210 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:42.208+0000 7f6439000640 1 --2- 172.21.15.57:0/3487243123 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f643415a1b0 0x7f64341f0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T19:51:42.210 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:42.208+0000 7f6433e00640 1 --2- 172.21.15.57:0/3487243123 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f643406f2f0 0x7f64341f2f40 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f6424000c00 tx=0x7f64240046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:51:42.211 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:42.209+0000 7f642be00640 1 -- 172.21.15.57:0/3487243123 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6424003610 con 0x7f643406f2f0 2024-03-27T19:51:42.211 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:42.209+0000 7f642be00640 1 -- 172.21.15.57:0/3487243123 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64240037d0 con 0x7f643406f2f0 2024-03-27T19:51:42.211 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:42.209+0000 7f642be00640 1 -- 172.21.15.57:0/3487243123 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6424003bc0 con 0x7f643406f2f0 2024-03-27T19:51:42.211 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:42.209+0000 7f643b000640 1 -- 172.21.15.57:0/3487243123 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64341f3e50 con 0x7f643406f2f0 2024-03-27T19:51:42.211 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:42.210+0000 7f643b000640 1 -- 172.21.15.57:0/3487243123 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64341f3b70 con 0x7f643406f2f0 2024-03-27T19:51:42.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:42.211+0000 7f643b000640 1 -- 172.21.15.57:0/3487243123 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6434068620 con 0x7f643406f2f0 2024-03-27T19:51:42.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:42.212+0000 7f642be00640 1 -- 172.21.15.57:0/3487243123 <== mon.1 v2:172.21.15.118:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f642403c3f0 con 0x7f643406f2f0 2024-03-27T19:51:42.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:42.213+0000 7f642be00640 1 --2- 172.21.15.57:0/3487243123 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f641406c530 0x7f641406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:42.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:42.213+0000 7f642be00640 1 -- 172.21.15.57:0/3487243123 <== mon.1 v2:172.21.15.118:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6130+0+0 (secure 0 0 0) 0x7f64240ad860 con 0x7f643406f2f0 2024-03-27T19:51:42.215 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:42.214+0000 7f6433400640 1 --2- 172.21.15.57:0/3487243123 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f641406c530 0x7f641406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:42.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:42.215+0000 7f6433400640 1 --2- 172.21.15.57:0/3487243123 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f641406c530 0x7f641406e9f0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f64341569f0 tx=0x7f6420008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:51:42.223 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:42.222+0000 7f642be00640 1 -- 172.21.15.57:0/3487243123 <== mon.1 v2:172.21.15.118:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f642407bc40 con 0x7f643406f2f0 2024-03-27T19:51:42.547 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:42.546+0000 7f643b000640 1 -- 172.21.15.57:0/3487243123 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6434068fe0 con 0x7f643406f2f0 2024-03-27T19:51:42.799 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:42.798+0000 7f642be00640 1 -- 172.21.15.57:0/3487243123 <== mon.1 v2:172.21.15.118:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) ==== 74+0+16979 (secure 0 0 0) 0x7f642407b540 con 0x7f643406f2f0 2024-03-27T19:51:42.800 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:51:42.800 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":42,"fsid":"7ac43f86-2c16-4a97-98fb-715d3cebc75c","created":"2024-03-27T09:59:04.033417+0000","modified":"2024-03-27T10:02:10.639858+0000","last_up_change":"2024-03-27T09:59:16.969624+0000","last_in_change":"2024-03-27T09:59:07.421690+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-27T09:59:17.253008+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-03-27T10:01:22.035595+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-03-27T10:01:22.866281+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"47b44362-7302-4f2a-b735-582c6c3850cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6801","nonce":2020036298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6803","nonce":2020036298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6807","nonce":2020036298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6805","nonce":2020036298}]},"public_addr":"172.21.15.57:6801/2020036298","cluster_addr":"172.21.15.57:6803/2020036298","heartbeat_back_addr":"172.21.15.57:6807/2020036298","heartbeat_front_addr":"172.21.15.57:6805/2020036298","state":["exists","up"]},{"osd":1,"uuid":"feaf96f0-9431-4188-9a09-da505b40e934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6809","nonce":3190929242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6811","nonce":3190929242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6815","nonce":3190929242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6813","nonce":3190929242}]},"public_addr":"172.21.15.57:6809/3190929242","cluster_addr":"172.21.15.57:6811/3190929242","heartbeat_back_addr":"172.21.15.57:6815/3190929242","heartbeat_front_addr":"172.21.15.57:6813/3190929242","state":["exists","up"]},{"osd":2,"uuid":"21e406e6-cfbc-4fe7-a816-e2420487c95d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6817","nonce":4065849973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6819","nonce":4065849973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6823","nonce":4065849973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6821","nonce":4065849973}]},"public_addr":"172.21.15.57:6817/4065849973","cluster_addr":"172.21.15.57:6819/4065849973","heartbeat_back_addr":"172.21.15.57:6823/4065849973","heartbeat_front_addr":"172.21.15.57:6821/4065849973","state":["exists","up"]},{"osd":3,"uuid":"a389af1d-76c4-4dfc-b215-f983f4931257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6825","nonce":158084809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6827","nonce":158084809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6831","nonce":158084809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6829","nonce":158084809}]},"public_addr":"172.21.15.57:6825/158084809","cluster_addr":"172.21.15.57:6827/158084809","heartbeat_back_addr":"172.21.15.57:6831/158084809","heartbeat_front_addr":"172.21.15.57:6829/158084809","state":["exists","up"]},{"osd":4,"uuid":"e9b05dca-557a-43ee-b43f-9ce5b7d28304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6823","nonce":108719401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6827","nonce":108719401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6831","nonce":108719401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6829","nonce":108719401}]},"public_addr":"172.21.15.118:6823/108719401","cluster_addr":"172.21.15.118:6827/108719401","heartbeat_back_addr":"172.21.15.118:6831/108719401","heartbeat_front_addr":"172.21.15.118:6829/108719401","state":["exists","up"]},{"osd":5,"uuid":"d968177d-44ff-499a-b00a-b147ed879253","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6817","nonce":2704605866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6819","nonce":2704605866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6826","nonce":2704605866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6822","nonce":2704605866}]},"public_addr":"172.21.15.118:6817/2704605866","cluster_addr":"172.21.15.118:6819/2704605866","heartbeat_back_addr":"172.21.15.118:6826/2704605866","heartbeat_front_addr":"172.21.15.118:6822/2704605866","state":["exists","up"]},{"osd":6,"uuid":"e8f98052-e6ad-4cfe-a4a9-0b17a434d54e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6801","nonce":1963659095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6803","nonce":1963659095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6807","nonce":1963659095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6805","nonce":1963659095}]},"public_addr":"172.21.15.118:6801/1963659095","cluster_addr":"172.21.15.118:6803/1963659095","heartbeat_back_addr":"172.21.15.118:6807/1963659095","heartbeat_front_addr":"172.21.15.118:6805/1963659095","state":["exists","up"]},{"osd":7,"uuid":"eccff987-8e51-4a63-845a-cf0a3196d7fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6809","nonce":1955879596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6811","nonce":1955879596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6815","nonce":1955879596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6813","nonce":1955879596}]},"public_addr":"172.21.15.118:6809/1955879596","cluster_addr":"172.21.15.118:6811/1955879596","heartbeat_back_addr":"172.21.15.118:6815/1955879596","heartbeat_front_addr":"172.21.15.118:6813/1955879596","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.721258+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.696610+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.777895+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.806769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.743259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.845687+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:13.020165+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.722294+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.26","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-27T19:51:42.804 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:42.803+0000 7f643b000640 1 -- 172.21.15.57:0/3487243123 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f641406c530 msgr2=0x7f641406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:42.804 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:42.803+0000 7f643b000640 1 --2- 172.21.15.57:0/3487243123 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f641406c530 0x7f641406e9f0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f64341569f0 tx=0x7f6420008040 comp rx=0 tx=0).stop 2024-03-27T19:51:42.804 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:42.803+0000 7f643b000640 1 -- 172.21.15.57:0/3487243123 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f643406f2f0 msgr2=0x7f64341f2f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:42.804 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:42.803+0000 7f643b000640 1 --2- 172.21.15.57:0/3487243123 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f643406f2f0 0x7f64341f2f40 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f6424000c00 tx=0x7f64240046c0 comp rx=0 tx=0).stop 2024-03-27T19:51:42.806 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:42.805+0000 7f643b000640 1 -- 172.21.15.57:0/3487243123 shutdown_connections 2024-03-27T19:51:42.806 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:42.805+0000 7f643b000640 1 --2- 172.21.15.57:0/3487243123 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f643415a1b0 0x7f64341f0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:42.806 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:42.805+0000 7f643b000640 1 --2- 172.21.15.57:0/3487243123 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6434071200 0x7f6434157790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:42.806 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:42.805+0000 7f643b000640 1 --2- 172.21.15.57:0/3487243123 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f641406c530 0x7f641406e9f0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:42.806 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:42.805+0000 7f643b000640 1 --2- 172.21.15.57:0/3487243123 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f643406f2f0 0x7f64341f2f40 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:42.806 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:42.805+0000 7f643b000640 1 -- 172.21.15.57:0/3487243123 >> 172.21.15.57:0/3487243123 conn(0x7f64340b1c60 msgr2=0x7f64340b0e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T19:51:42.807 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:42.805+0000 7f643b000640 1 -- 172.21.15.57:0/3487243123 shutdown_connections 2024-03-27T19:51:42.807 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:42.805+0000 7f643b000640 1 -- 172.21.15.57:0/3487243123 wait complete. 2024-03-27T19:51:42.841 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-03-27T19:51:42.841 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-27T19:51:43.126 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.125+0000 7f2775200640 1 Processor -- start 2024-03-27T19:51:43.127 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.125+0000 7f2775200640 1 -- start start 2024-03-27T19:51:43.128 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.127+0000 7f2775200640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f27701626d0 0x7f27700c4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:43.129 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.127+0000 7f2775200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f27700c5420 0x7f27700cc560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:43.129 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.127+0000 7f2775200640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f27700ccaa0 0x7f2770166340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:43.129 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.127+0000 7f2775200640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f27700c5880 con 0x7f27701626d0 2024-03-27T19:51:43.129 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.127+0000 7f2775200640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f27700ccf30 con 0x7f27700ccaa0 2024-03-27T19:51:43.129 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.127+0000 7f2775200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f27700cd200 con 0x7f27700c5420 2024-03-27T19:51:43.129 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.128+0000 7f276d400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f27700c5420 0x7f27700cc560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:43.129 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.128+0000 7f276d400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f27700c5420 0x7f27700cc560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.57:33304/0 (socket says 172.21.15.57:33304) 2024-03-27T19:51:43.130 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.128+0000 7f276d400640 1 -- 172.21.15.57:0/4139128469 learned_addr learned my addr 172.21.15.57:0/4139128469 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T19:51:43.130 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.128+0000 7f276e800640 1 --2- 172.21.15.57:0/4139128469 >> v2:172.21.15.118:3300/0 conn(0x7f27700ccaa0 0x7f2770166340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:43.130 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.129+0000 7f276d400640 1 -- 172.21.15.57:0/4139128469 >> v2:172.21.15.118:3300/0 conn(0x7f27700ccaa0 msgr2=0x7f2770166340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T19:51:43.130 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.129+0000 7f276d400640 1 --2- 172.21.15.57:0/4139128469 >> v2:172.21.15.118:3300/0 conn(0x7f27700ccaa0 0x7f2770166340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:43.130 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.129+0000 7f276d400640 1 -- 172.21.15.57:0/4139128469 >> v2:172.21.15.57:3300/0 conn(0x7f27701626d0 msgr2=0x7f27700c4ee0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-27T19:51:43.131 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.130+0000 7f276de00640 1 --2- 172.21.15.57:0/4139128469 >> v2:172.21.15.57:3300/0 conn(0x7f27701626d0 0x7f27700c4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:43.131 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.130+0000 7f276d400640 1 --2- 172.21.15.57:0/4139128469 >> v2:172.21.15.57:3300/0 conn(0x7f27701626d0 0x7f27700c4ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:43.131 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.130+0000 7f276d400640 1 -- 172.21.15.57:0/4139128469 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27700cd4e0 con 0x7f27700c5420 2024-03-27T19:51:43.131 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.130+0000 7f276de00640 1 --2- 172.21.15.57:0/4139128469 >> v2:172.21.15.57:3300/0 conn(0x7f27701626d0 0x7f27700c4ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T19:51:43.137 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.132+0000 7f276d400640 1 --2- 172.21.15.57:0/4139128469 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f27700c5420 0x7f27700cc560 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f27700cc360 tx=0x7f275c02b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7128f0dc2917efe9 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:51:43.137 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.133+0000 7f276ca00640 1 -- 172.21.15.57:0/4139128469 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f275c035020 con 0x7f27700c5420 2024-03-27T19:51:43.138 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.133+0000 7f276ca00640 1 -- 172.21.15.57:0/4139128469 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f275c031870 con 0x7f27700c5420 2024-03-27T19:51:43.138 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.133+0000 7f276ca00640 1 -- 172.21.15.57:0/4139128469 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f275c031c40 con 0x7f27700c5420 2024-03-27T19:51:43.138 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.134+0000 7f2775200640 1 -- 172.21.15.57:0/4139128469 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f27700c5420 msgr2=0x7f27700cc560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:43.138 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.134+0000 7f2775200640 1 --2- 172.21.15.57:0/4139128469 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f27700c5420 0x7f27700cc560 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f27700cc360 tx=0x7f275c02b910 comp rx=0 tx=0).stop 2024-03-27T19:51:43.138 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.136+0000 7f2775200640 1 -- 172.21.15.57:0/4139128469 shutdown_connections 2024-03-27T19:51:43.138 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.136+0000 7f2775200640 1 --2- 172.21.15.57:0/4139128469 >> v2:172.21.15.118:3300/0 conn(0x7f27700ccaa0 0x7f2770166340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:43.138 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.136+0000 7f2775200640 1 --2- 172.21.15.57:0/4139128469 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f27700c5420 0x7f27700cc560 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:43.139 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.136+0000 7f2775200640 1 --2- 172.21.15.57:0/4139128469 >> v2:172.21.15.57:3300/0 conn(0x7f27701626d0 0x7f27700c4ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:43.139 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.136+0000 7f2775200640 1 -- 172.21.15.57:0/4139128469 >> 172.21.15.57:0/4139128469 conn(0x7f277009aa30 msgr2=0x7f277009ae40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T19:51:43.139 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.137+0000 7f2775200640 1 -- 172.21.15.57:0/4139128469 shutdown_connections 2024-03-27T19:51:43.139 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.137+0000 7f2775200640 1 -- 172.21.15.57:0/4139128469 wait complete. 2024-03-27T19:51:43.142 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.141+0000 7f2775200640 1 Processor -- start 2024-03-27T19:51:43.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.142+0000 7f2775200640 1 -- start start 2024-03-27T19:51:43.144 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.143+0000 7f2775200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f27700c5420 0x7f27700c7f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:43.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.143+0000 7f2775200640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f27700ccaa0 0x7f2770153ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:43.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.143+0000 7f2775200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f27701626d0 0x7f27700c8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:43.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.143+0000 7f2775200640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f27700cdd80 con 0x7f27700ccaa0 2024-03-27T19:51:43.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.143+0000 7f2775200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f27700cdaa0 con 0x7f27700c5420 2024-03-27T19:51:43.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.143+0000 7f2775200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f27700ce2a0 con 0x7f27701626d0 2024-03-27T19:51:43.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.143+0000 7f276d400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f27700ccaa0 0x7f2770153ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:43.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.143+0000 7f276d400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f27700ccaa0 0x7f2770153ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37896/0 (socket says 172.21.15.57:37896) 2024-03-27T19:51:43.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.143+0000 7f276d400640 1 -- 172.21.15.57:0/2868381991 learned_addr learned my addr 172.21.15.57:0/2868381991 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T19:51:43.147 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.144+0000 7f276e800640 1 --2- 172.21.15.57:0/2868381991 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f27701626d0 0x7f27700c8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:43.147 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.144+0000 7f276de00640 1 --2- 172.21.15.57:0/2868381991 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f27700c5420 0x7f27700c7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:43.147 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.144+0000 7f276d400640 1 -- 172.21.15.57:0/2868381991 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f27701626d0 msgr2=0x7f27700c8fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:43.147 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.144+0000 7f276d400640 1 --2- 172.21.15.57:0/2868381991 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f27701626d0 0x7f27700c8fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:43.147 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.144+0000 7f276d400640 1 -- 172.21.15.57:0/2868381991 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f27700c5420 msgr2=0x7f27700c7f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:43.147 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.144+0000 7f276d400640 1 --2- 172.21.15.57:0/2868381991 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f27700c5420 0x7f27700c7f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:43.147 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.144+0000 7f276d400640 1 -- 172.21.15.57:0/2868381991 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27700c6ef0 con 0x7f27700ccaa0 2024-03-27T19:51:43.147 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.145+0000 7f276d400640 1 --2- 172.21.15.57:0/2868381991 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f27700ccaa0 0x7f2770153ae0 secure :-1 s=READY pgs=2201 cs=0 l=1 rev1=1 crypto rx=0x7f275c009960 tx=0x7f275c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:51:43.147 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.145+0000 7f2766000640 1 -- 172.21.15.57:0/2868381991 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f275c035040 con 0x7f27700ccaa0 2024-03-27T19:51:43.147 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.145+0000 7f2775200640 1 -- 172.21.15.57:0/2868381991 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27700c71d0 con 0x7f27700ccaa0 2024-03-27T19:51:43.147 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.145+0000 7f2766000640 1 -- 172.21.15.57:0/2868381991 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f275c030d00 con 0x7f27700ccaa0 2024-03-27T19:51:43.147 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.145+0000 7f2775200640 1 -- 172.21.15.57:0/2868381991 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27700c7790 con 0x7f27700ccaa0 2024-03-27T19:51:43.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.146+0000 7f2766000640 1 -- 172.21.15.57:0/2868381991 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f275c035040 con 0x7f27700ccaa0 2024-03-27T19:51:43.153 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.149+0000 7f2766000640 1 -- 172.21.15.57:0/2868381991 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f275c038020 con 0x7f27700ccaa0 2024-03-27T19:51:43.153 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.150+0000 7f2775200640 1 -- 172.21.15.57:0/2868381991 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2770068620 con 0x7f27700ccaa0 2024-03-27T19:51:43.153 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.150+0000 7f2766000640 1 --2- 172.21.15.57:0/2868381991 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f275006c760 0x7f275006ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:43.153 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.151+0000 7f2766000640 1 -- 172.21.15.57:0/2868381991 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6130+0+0 (secure 0 0 0) 0x7f275c0ad7c0 con 0x7f27700ccaa0 2024-03-27T19:51:43.155 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.154+0000 7f276de00640 1 --2- 172.21.15.57:0/2868381991 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f275006c760 0x7f275006ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:43.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.155+0000 7f276de00640 1 --2- 172.21.15.57:0/2868381991 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f275006c760 0x7f275006ec20 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f2768007510 tx=0x7f27680074a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:51:43.161 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.160+0000 7f2766000640 1 -- 172.21.15.57:0/2868381991 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f275c07bb10 con 0x7f27700ccaa0 2024-03-27T19:51:43.556 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.555+0000 7f2775200640 1 -- 172.21.15.57:0/2868381991 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f27700cefa0 con 0x7f27700ccaa0 2024-03-27T19:51:43.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.557+0000 7f2766000640 1 -- 172.21.15.57:0/2868381991 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5181 (secure 0 0 0) 0x7f275c07b410 con 0x7f27700ccaa0 2024-03-27T19:51:43.559 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:51:43.559 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4883,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/534729135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":534729135},{"type":"v1","addr":"172.21.15.57:6835","nonce":534729135}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4886,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/1117032671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1117032671},{"type":"v1","addr":"172.21.15.118:6834","nonce":1117032671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4889,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/2149281891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":2149281891},{"type":"v1","addr":"172.21.15.118:6835","nonce":2149281891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-27T10:01:23.885660+0000","modified":"2024-03-27T10:01:27.013100+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5508},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5508":{"gid":5508,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.57:6837/385124398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":385124398},{"type":"v1","addr":"172.21.15.57:6837","nonce":385124398}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5508,"qdb_cluster":[5508]},"id":2}]} 2024-03-27T19:51:43.559 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 18 2024-03-27T19:51:43.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.561+0000 7f2775200640 1 -- 172.21.15.57:0/2868381991 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f275006c760 msgr2=0x7f275006ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:43.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.561+0000 7f2775200640 1 --2- 172.21.15.57:0/2868381991 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f275006c760 0x7f275006ec20 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f2768007510 tx=0x7f27680074a0 comp rx=0 tx=0).stop 2024-03-27T19:51:43.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.561+0000 7f2775200640 1 -- 172.21.15.57:0/2868381991 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f27700ccaa0 msgr2=0x7f2770153ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:43.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.561+0000 7f2775200640 1 --2- 172.21.15.57:0/2868381991 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f27700ccaa0 0x7f2770153ae0 secure :-1 s=READY pgs=2201 cs=0 l=1 rev1=1 crypto rx=0x7f275c009960 tx=0x7f275c0046c0 comp rx=0 tx=0).stop 2024-03-27T19:51:43.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.561+0000 7f2775200640 1 -- 172.21.15.57:0/2868381991 shutdown_connections 2024-03-27T19:51:43.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.561+0000 7f2775200640 1 --2- 172.21.15.57:0/2868381991 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f27701626d0 0x7f27700c8fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:43.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.561+0000 7f2775200640 1 --2- 172.21.15.57:0/2868381991 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f27700ccaa0 0x7f2770153ae0 secure :-1 s=CLOSED pgs=2201 cs=0 l=1 rev1=1 crypto rx=0x7f275c009960 tx=0x7f275c0046c0 comp rx=0 tx=0).stop 2024-03-27T19:51:43.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.561+0000 7f2775200640 1 --2- 172.21.15.57:0/2868381991 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f275006c760 0x7f275006ec20 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:43.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.561+0000 7f2775200640 1 --2- 172.21.15.57:0/2868381991 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f27700c5420 0x7f27700c7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:43.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.562+0000 7f2775200640 1 -- 172.21.15.57:0/2868381991 >> 172.21.15.57:0/2868381991 conn(0x7f277009aa30 msgr2=0x7f2770160680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T19:51:43.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.565+0000 7f2775200640 1 -- 172.21.15.57:0/2868381991 shutdown_connections 2024-03-27T19:51:43.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.565+0000 7f2775200640 1 -- 172.21.15.57:0/2868381991 wait complete. 2024-03-27T19:51:43.597 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-27T19:51:43.845 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.844+0000 7fa330e00640 1 Processor -- start 2024-03-27T19:51:43.846 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.844+0000 7fa330e00640 1 -- start start 2024-03-27T19:51:43.847 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.846+0000 7fa330e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa32c145820 0x7fa32c0cc950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:43.848 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.846+0000 7fa330e00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fa32c06b750 0x7fa32c06bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:43.848 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.846+0000 7fa330e00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa32c0b2b70 0x7fa32c0b2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:43.848 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.846+0000 7fa330e00640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7fa32c160b60 con 0x7fa32c0b2b70 2024-03-27T19:51:43.848 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.846+0000 7fa330e00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7fa32c06c0d0 con 0x7fa32c06b750 2024-03-27T19:51:43.848 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.846+0000 7fa330e00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fa32c0cce90 con 0x7fa32c145820 2024-03-27T19:51:43.848 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.846+0000 7fa329e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa32c145820 0x7fa32c0cc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:43.848 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.846+0000 7fa32a800640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa32c0b2b70 0x7fa32c0b2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:43.848 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.846+0000 7fa329e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa32c145820 0x7fa32c0cc950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.57:33334/0 (socket says 172.21.15.57:33334) 2024-03-27T19:51:43.848 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.846+0000 7fa32a800640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fa32c0b2b70 0x7fa32c0b2fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37902/0 (socket says 172.21.15.57:37902) 2024-03-27T19:51:43.848 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.846+0000 7fa329e00640 1 -- 172.21.15.57:0/3358918696 learned_addr learned my addr 172.21.15.57:0/3358918696 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T19:51:43.848 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.846+0000 7fa329400640 1 --2- 172.21.15.57:0/3358918696 >> v2:172.21.15.118:3300/0 conn(0x7fa32c06b750 0x7fa32c06bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:43.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.847+0000 7fa32a800640 1 -- 172.21.15.57:0/3358918696 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa32c145820 msgr2=0x7fa32c0cc950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T19:51:43.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.847+0000 7fa32a800640 1 --2- 172.21.15.57:0/3358918696 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa32c145820 0x7fa32c0cc950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:43.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.847+0000 7fa32a800640 1 -- 172.21.15.57:0/3358918696 >> v2:172.21.15.118:3300/0 conn(0x7fa32c06b750 msgr2=0x7fa32c06bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T19:51:43.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.847+0000 7fa32a800640 1 --2- 172.21.15.57:0/3358918696 >> v2:172.21.15.118:3300/0 conn(0x7fa32c06b750 0x7fa32c06bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:43.849 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.847+0000 7fa32a800640 1 -- 172.21.15.57:0/3358918696 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa32c15fc70 con 0x7fa32c0b2b70 2024-03-27T19:51:43.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.848+0000 7fa32a800640 1 --2- 172.21.15.57:0/3358918696 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa32c0b2b70 0x7fa32c0b2fe0 secure :-1 s=READY pgs=2202 cs=0 l=1 rev1=1 crypto rx=0x7fa32c073660 tx=0x7fa32402be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bb8ea1ca342ad1 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:51:43.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.848+0000 7fa328a00640 1 -- 172.21.15.57:0/3358918696 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa324039070 con 0x7fa32c0b2b70 2024-03-27T19:51:43.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.848+0000 7fa328a00640 1 -- 172.21.15.57:0/3358918696 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa32402cbd0 con 0x7fa32c0b2b70 2024-03-27T19:51:43.850 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.848+0000 7fa328a00640 1 -- 172.21.15.57:0/3358918696 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa324034440 con 0x7fa32c0b2b70 2024-03-27T19:51:43.851 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.849+0000 7fa330e00640 1 -- 172.21.15.57:0/3358918696 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa32c0b2b70 msgr2=0x7fa32c0b2fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:43.851 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.849+0000 7fa330e00640 1 --2- 172.21.15.57:0/3358918696 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa32c0b2b70 0x7fa32c0b2fe0 secure :-1 s=READY pgs=2202 cs=0 l=1 rev1=1 crypto rx=0x7fa32c073660 tx=0x7fa32402be20 comp rx=0 tx=0).stop 2024-03-27T19:51:43.851 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.849+0000 7fa330e00640 1 -- 172.21.15.57:0/3358918696 shutdown_connections 2024-03-27T19:51:43.851 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.849+0000 7fa330e00640 1 --2- 172.21.15.57:0/3358918696 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa32c0b2b70 0x7fa32c0b2fe0 unknown :-1 s=CLOSED pgs=2202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:43.851 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.849+0000 7fa330e00640 1 --2- 172.21.15.57:0/3358918696 >> v2:172.21.15.118:3300/0 conn(0x7fa32c06b750 0x7fa32c06bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:43.851 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.849+0000 7fa330e00640 1 --2- 172.21.15.57:0/3358918696 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa32c145820 0x7fa32c0cc950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:43.851 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.849+0000 7fa330e00640 1 -- 172.21.15.57:0/3358918696 >> 172.21.15.57:0/3358918696 conn(0x7fa32c0b1c60 msgr2=0x7fa32c0b2070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T19:51:43.851 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.849+0000 7fa330e00640 1 -- 172.21.15.57:0/3358918696 shutdown_connections 2024-03-27T19:51:43.851 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.849+0000 7fa330e00640 1 -- 172.21.15.57:0/3358918696 wait complete. 2024-03-27T19:51:43.852 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.851+0000 7fa330e00640 1 Processor -- start 2024-03-27T19:51:43.852 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.851+0000 7fa330e00640 1 -- start start 2024-03-27T19:51:43.853 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.852+0000 7fa330e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa32c06b750 0x7fa32c13e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:43.853 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.852+0000 7fa330e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa32c0b2b70 0x7fa32c13f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:43.853 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.852+0000 7fa330e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa32c145820 0x7fa32c13f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:43.854 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.852+0000 7fa330e00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fa32c160510 con 0x7fa32c145820 2024-03-27T19:51:43.854 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.852+0000 7fa330e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fa32c160230 con 0x7fa32c0b2b70 2024-03-27T19:51:43.854 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.852+0000 7fa330e00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fa32c1607f0 con 0x7fa32c06b750 2024-03-27T19:51:43.854 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.852+0000 7fa32a800640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa32c145820 0x7fa32c13f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:43.854 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.852+0000 7fa329e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa32c06b750 0x7fa32c13e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:43.855 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.852+0000 7fa329e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa32c06b750 0x7fa32c13e2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.57:33344/0 (socket says 172.21.15.57:33344) 2024-03-27T19:51:43.855 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.852+0000 7fa329e00640 1 -- 172.21.15.57:0/2357653487 learned_addr learned my addr 172.21.15.57:0/2357653487 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T19:51:43.855 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.853+0000 7fa32a800640 1 -- 172.21.15.57:0/2357653487 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa32c06b750 msgr2=0x7fa32c13e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:43.855 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.853+0000 7fa32a800640 1 --2- 172.21.15.57:0/2357653487 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa32c06b750 0x7fa32c13e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:43.855 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.853+0000 7fa32a800640 1 -- 172.21.15.57:0/2357653487 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa32c0b2b70 msgr2=0x7fa32c13f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:43.855 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.853+0000 7fa32a800640 1 --2- 172.21.15.57:0/2357653487 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa32c0b2b70 0x7fa32c13f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:43.855 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.853+0000 7fa32a800640 1 -- 172.21.15.57:0/2357653487 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa32c158a20 con 0x7fa32c145820 2024-03-27T19:51:43.855 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.853+0000 7fa32a800640 1 --2- 172.21.15.57:0/2357653487 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa32c145820 0x7fa32c13f910 secure :-1 s=READY pgs=2203 cs=0 l=1 rev1=1 crypto rx=0x7fa324033000 tx=0x7fa324004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:51:43.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.854+0000 7fa322000640 1 -- 172.21.15.57:0/2357653487 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa324039050 con 0x7fa32c145820 2024-03-27T19:51:43.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.854+0000 7fa322000640 1 -- 172.21.15.57:0/2357653487 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa324045070 con 0x7fa32c145820 2024-03-27T19:51:43.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.854+0000 7fa330e00640 1 -- 172.21.15.57:0/2357653487 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa32c158ca0 con 0x7fa32c145820 2024-03-27T19:51:43.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.854+0000 7fa322000640 1 -- 172.21.15.57:0/2357653487 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa324009450 con 0x7fa32c145820 2024-03-27T19:51:43.856 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.854+0000 7fa330e00640 1 -- 172.21.15.57:0/2357653487 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa32c159260 con 0x7fa32c145820 2024-03-27T19:51:43.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.856+0000 7fa330e00640 1 -- 172.21.15.57:0/2357653487 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa304005290 con 0x7fa32c145820 2024-03-27T19:51:43.857 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.856+0000 7fa322000640 1 -- 172.21.15.57:0/2357653487 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fa32403e850 con 0x7fa32c145820 2024-03-27T19:51:43.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.857+0000 7fa322000640 1 --2- 172.21.15.57:0/2357653487 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fa30c06c5b0 0x7fa30c06ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:43.858 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.857+0000 7fa322000640 1 -- 172.21.15.57:0/2357653487 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6130+0+0 (secure 0 0 0) 0x7fa3240ae670 con 0x7fa32c145820 2024-03-27T19:51:43.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.858+0000 7fa329e00640 1 --2- 172.21.15.57:0/2357653487 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fa30c06c5b0 0x7fa30c06ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:43.859 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.858+0000 7fa329e00640 1 --2- 172.21.15.57:0/2357653487 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fa30c06c5b0 0x7fa30c06ea70 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fa32c13ff90 tx=0x7fa31c009240 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:51:43.869 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:43.865+0000 7fa322000640 1 -- 172.21.15.57:0/2357653487 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7fa32c158a20 con 0x7fa32c145820 2024-03-27T19:51:44.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:44.299+0000 7fa330e00640 1 -- 172.21.15.57:0/2357653487 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa304005580 con 0x7fa32c145820 2024-03-27T19:51:44.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:44.300+0000 7fa322000640 1 -- 172.21.15.57:0/2357653487 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+5181 (secure 0 0 0) 0x7fa32407cbe0 con 0x7fa32c145820 2024-03-27T19:51:44.305 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:51:44.305 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4883,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/534729135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":534729135},{"type":"v1","addr":"172.21.15.57:6835","nonce":534729135}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4886,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/1117032671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1117032671},{"type":"v1","addr":"172.21.15.118:6834","nonce":1117032671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4889,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/2149281891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":2149281891},{"type":"v1","addr":"172.21.15.118:6835","nonce":2149281891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-27T10:01:23.885660+0000","modified":"2024-03-27T10:01:27.013100+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5508},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5508":{"gid":5508,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.57:6837/385124398","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":385124398},{"type":"v1","addr":"172.21.15.57:6837","nonce":385124398}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5508,"qdb_cluster":[5508]},"id":2}]} 2024-03-27T19:51:44.305 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 18 2024-03-27T19:51:44.308 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:44.306+0000 7fa330e00640 1 -- 172.21.15.57:0/2357653487 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fa30c06c5b0 msgr2=0x7fa30c06ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:44.308 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:44.307+0000 7fa330e00640 1 --2- 172.21.15.57:0/2357653487 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fa30c06c5b0 0x7fa30c06ea70 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fa32c13ff90 tx=0x7fa31c009240 comp rx=0 tx=0).stop 2024-03-27T19:51:44.308 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:44.307+0000 7fa330e00640 1 -- 172.21.15.57:0/2357653487 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa32c145820 msgr2=0x7fa32c13f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:44.308 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:44.307+0000 7fa330e00640 1 --2- 172.21.15.57:0/2357653487 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa32c145820 0x7fa32c13f910 secure :-1 s=READY pgs=2203 cs=0 l=1 rev1=1 crypto rx=0x7fa324033000 tx=0x7fa324004a40 comp rx=0 tx=0).stop 2024-03-27T19:51:44.308 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:44.307+0000 7fa330e00640 1 -- 172.21.15.57:0/2357653487 shutdown_connections 2024-03-27T19:51:44.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:44.307+0000 7fa330e00640 1 --2- 172.21.15.57:0/2357653487 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fa32c145820 0x7fa32c13f910 unknown :-1 s=CLOSED pgs=2203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:44.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:44.307+0000 7fa330e00640 1 --2- 172.21.15.57:0/2357653487 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fa30c06c5b0 0x7fa30c06ea70 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:44.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:44.307+0000 7fa330e00640 1 --2- 172.21.15.57:0/2357653487 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fa32c0b2b70 0x7fa32c13f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:44.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:44.307+0000 7fa330e00640 1 --2- 172.21.15.57:0/2357653487 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fa32c06b750 0x7fa32c13e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:44.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:44.307+0000 7fa330e00640 1 -- 172.21.15.57:0/2357653487 >> 172.21.15.57:0/2357653487 conn(0x7fa32c0b1c60 msgr2=0x7fa32c0af950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T19:51:44.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:44.307+0000 7fa330e00640 1 -- 172.21.15.57:0/2357653487 shutdown_connections 2024-03-27T19:51:44.309 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:44.308+0000 7fa330e00640 1 -- 172.21.15.57:0/2357653487 wait complete. 2024-03-27T19:51:44.338 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-27T19:51:44.633 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:44.631+0000 7efc7e000640 1 Processor -- start 2024-03-27T19:51:44.634 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:44.631+0000 7efc7e000640 1 -- start start 2024-03-27T19:51:44.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:44.633+0000 7efc7e000640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7efc7814c0f0 0x7efc7806dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:44.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:44.633+0000 7efc7e000640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7efc78166160 0x7efc78166570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:44.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:44.633+0000 7efc7e000640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc78166ab0 con 0x7efc78162b10 2024-03-27T19:51:44.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:44.633+0000 7efc7e000640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7efc7806e1a0 con 0x7efc78166160 2024-03-27T19:51:44.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:44.633+0000 7efc7e000640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7efc780b30d0 con 0x7efc7814c0f0 2024-03-27T19:51:44.636 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:44.635+0000 7efc76a00640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7efc78162b10 0x7efc78072fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:50238/0 (socket says 172.21.15.57:50238) 2024-03-27T19:51:44.636 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:44.635+0000 7efc77e00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7efc78166160 0x7efc78166570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:44.637 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:44.635+0000 7efc77e00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7efc78166160 0x7efc78166570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37930/0 (socket says 172.21.15.57:37930) 2024-03-27T19:51:44.637 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:44.635+0000 7efc77e00640 1 -- 172.21.15.57:0/3614812052 learned_addr learned my addr 172.21.15.57:0/3614812052 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T19:51:44.637 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:44.635+0000 7efc77400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7efc7814c0f0 0x7efc7806dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:44.637 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:44.636+0000 7efc77e00640 1 -- 172.21.15.57:0/3614812052 >> v2:172.21.15.118:3300/0 conn(0x7efc7814c0f0 msgr2=0x7efc7806dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T19:51:44.637 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:44.636+0000 7efc77e00640 1 --2- 172.21.15.57:0/3614812052 >> v2:172.21.15.118:3300/0 conn(0x7efc7814c0f0 0x7efc7806dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:44.637 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:44.636+0000 7efc77e00640 1 -- 172.21.15.57:0/3614812052 >> v1:172.21.15.57:6789/0 conn(0x7efc78162b10 legacy=0x7efc78072fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T19:51:44.637 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:44.636+0000 7efc77e00640 1 -- 172.21.15.57:0/3614812052 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc780b33b0 con 0x7efc78166160 2024-03-27T19:51:44.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:44.638+0000 7efc77e00640 1 --2- 172.21.15.57:0/3614812052 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efc78166160 0x7efc78166570 secure :-1 s=READY pgs=2205 cs=0 l=1 rev1=1 crypto rx=0x7efc78070ef0 tx=0x7efc7002bf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=437a6e04a7b1669d server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:51:44.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:44.638+0000 7efc76000640 1 -- 172.21.15.57:0/3614812052 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc7002caa0 con 0x7efc78166160 2024-03-27T19:51:44.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:44.639+0000 7efc76000640 1 -- 172.21.15.57:0/3614812052 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc7002cc40 con 0x7efc78166160 2024-03-27T19:51:44.641 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:44.639+0000 7efc76000640 1 -- 172.21.15.57:0/3614812052 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc70034610 con 0x7efc78166160 2024-03-27T19:51:44.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:44.642+0000 7efc7e000640 1 -- 172.21.15.57:0/3614812052 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efc78166160 msgr2=0x7efc78166570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:44.643 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:44.642+0000 7efc7e000640 1 --2- 172.21.15.57:0/3614812052 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efc78166160 0x7efc78166570 secure :-1 s=READY pgs=2205 cs=0 l=1 rev1=1 crypto rx=0x7efc78070ef0 tx=0x7efc7002bf00 comp rx=0 tx=0).stop 2024-03-27T19:51:44.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:44.642+0000 7efc7e000640 1 -- 172.21.15.57:0/3614812052 shutdown_connections 2024-03-27T19:51:44.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:44.642+0000 7efc7e000640 1 --2- 172.21.15.57:0/3614812052 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efc78166160 0x7efc78166570 unknown :-1 s=CLOSED pgs=2205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:44.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:44.642+0000 7efc7e000640 1 --2- 172.21.15.57:0/3614812052 >> v2:172.21.15.118:3300/0 conn(0x7efc7814c0f0 0x7efc7806dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:44.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:44.642+0000 7efc7e000640 1 -- 172.21.15.57:0/3614812052 >> 172.21.15.57:0/3614812052 conn(0x7efc780cfe60 msgr2=0x7efc780d0240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T19:51:44.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:44.643+0000 7efc7e000640 1 -- 172.21.15.57:0/3614812052 shutdown_connections 2024-03-27T19:51:44.644 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:44.643+0000 7efc7e000640 1 -- 172.21.15.57:0/3614812052 wait complete. 2024-03-27T19:51:44.647 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:44.645+0000 7efc7e000640 1 Processor -- start 2024-03-27T19:51:44.647 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:44.646+0000 7efc7e000640 1 -- start start 2024-03-27T19:51:44.648 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:44.647+0000 7efc7e000640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efc7814c0f0 0x7efc7814a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:44.648 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:44.647+0000 7efc7e000640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efc78162b10 0x7efc7813f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:44.649 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:44.648+0000 7efc77400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efc7814c0f0 0x7efc7814a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:44.649 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:44.648+0000 7efc77400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efc7814c0f0 0x7efc7814a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.57:33358/0 (socket says 172.21.15.57:33358) 2024-03-27T19:51:44.649 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:44.648+0000 7efc76a00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efc78162b10 0x7efc7813f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:44.649 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:44.648+0000 7efc77400640 1 -- 172.21.15.57:0/1963424244 learned_addr learned my addr 172.21.15.57:0/1963424244 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T19:51:44.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:44.648+0000 7efc7e000640 1 --2- 172.21.15.57:0/1963424244 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efc78166160 0x7efc780cdb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:44.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:44.648+0000 7efc7e000640 1 -- 172.21.15.57:0/1963424244 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7efc7806e600 con 0x7efc78162b10 2024-03-27T19:51:44.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:44.648+0000 7efc7e000640 1 -- 172.21.15.57:0/1963424244 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7efc7806e480 con 0x7efc78166160 2024-03-27T19:51:44.650 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:44.648+0000 7efc7e000640 1 -- 172.21.15.57:0/1963424244 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7efc780b3bb0 con 0x7efc7814c0f0 2024-03-27T19:51:44.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:44.649+0000 7efc77400640 1 -- 172.21.15.57:0/1963424244 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efc78166160 msgr2=0x7efc780cdb60 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-27T19:51:44.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:44.649+0000 7efc77400640 1 --2- 172.21.15.57:0/1963424244 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efc78166160 0x7efc780cdb60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:44.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:44.649+0000 7efc77400640 1 -- 172.21.15.57:0/1963424244 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efc78162b10 msgr2=0x7efc7813f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:44.651 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:44.649+0000 7efc77400640 1 --2- 172.21.15.57:0/1963424244 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efc78162b10 0x7efc7813f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:44.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:44.649+0000 7efc77400640 1 -- 172.21.15.57:0/1963424244 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc78164f90 con 0x7efc7814c0f0 2024-03-27T19:51:44.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:44.649+0000 7efc76a00640 1 --2- 172.21.15.57:0/1963424244 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efc78162b10 0x7efc7813f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T19:51:44.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:44.650+0000 7efc77400640 1 --2- 172.21.15.57:0/1963424244 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efc7814c0f0 0x7efc7814a780 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7efc6800e9e0 tx=0x7efc6800eea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:51:44.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:44.650+0000 7efc6f400640 1 -- 172.21.15.57:0/1963424244 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc68017070 con 0x7efc7814c0f0 2024-03-27T19:51:44.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:44.650+0000 7efc7e000640 1 -- 172.21.15.57:0/1963424244 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc78165270 con 0x7efc7814c0f0 2024-03-27T19:51:44.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:44.650+0000 7efc7e000640 1 -- 172.21.15.57:0/1963424244 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7efc78165830 con 0x7efc7814c0f0 2024-03-27T19:51:44.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:44.651+0000 7efc6f400640 1 -- 172.21.15.57:0/1963424244 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc6800c9d0 con 0x7efc7814c0f0 2024-03-27T19:51:44.652 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:44.651+0000 7efc6f400640 1 -- 172.21.15.57:0/1963424244 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc6800cda0 con 0x7efc7814c0f0 2024-03-27T19:51:44.654 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:44.653+0000 7efc7e000640 1 -- 172.21.15.57:0/1963424244 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc50005290 con 0x7efc7814c0f0 2024-03-27T19:51:44.663 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:44.662+0000 7efc6f400640 1 -- 172.21.15.57:0/1963424244 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7efc6801a070 con 0x7efc7814c0f0 2024-03-27T19:51:44.666 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:44.665+0000 7efc6f400640 1 --2- 172.21.15.57:0/1963424244 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7efc5806c530 0x7efc5806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:44.666 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:44.665+0000 7efc6f400640 1 -- 172.21.15.57:0/1963424244 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(42..42 src has 1..42) ==== 6130+0+0 (secure 0 0 0) 0x7efc6808bca0 con 0x7efc7814c0f0 2024-03-27T19:51:44.668 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:44.667+0000 7efc6f400640 1 -- 172.21.15.57:0/1963424244 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7efc68059a20 con 0x7efc7814c0f0 2024-03-27T19:51:44.671 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:44.668+0000 7efc76a00640 1 --2- 172.21.15.57:0/1963424244 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7efc5806c530 0x7efc5806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:44.674 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:44.673+0000 7efc76a00640 1 --2- 172.21.15.57:0/1963424244 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7efc5806c530 0x7efc5806e9f0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7efc78145b50 tx=0x7efc64007e60 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:51:45.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:45.051+0000 7efc7e000640 1 -- 172.21.15.57:0/1963424244 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efc50005850 con 0x7efc7814c0f0 2024-03-27T19:51:45.057 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:45.056+0000 7efc6f400640 1 -- 172.21.15.57:0/1963424244 <== mon.2 v2:172.21.15.118:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) ==== 74+0+16979 (secure 0 0 0) 0x7efc6805dd20 con 0x7efc7814c0f0 2024-03-27T19:51:45.058 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:51:45.058 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":42,"fsid":"7ac43f86-2c16-4a97-98fb-715d3cebc75c","created":"2024-03-27T09:59:04.033417+0000","modified":"2024-03-27T10:02:10.639858+0000","last_up_change":"2024-03-27T09:59:16.969624+0000","last_in_change":"2024-03-27T09:59:07.421690+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-27T09:59:17.253008+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-03-27T10:01:22.035595+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-03-27T10:01:22.866281+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"47b44362-7302-4f2a-b735-582c6c3850cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6801","nonce":2020036298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6803","nonce":2020036298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6807","nonce":2020036298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6805","nonce":2020036298}]},"public_addr":"172.21.15.57:6801/2020036298","cluster_addr":"172.21.15.57:6803/2020036298","heartbeat_back_addr":"172.21.15.57:6807/2020036298","heartbeat_front_addr":"172.21.15.57:6805/2020036298","state":["exists","up"]},{"osd":1,"uuid":"feaf96f0-9431-4188-9a09-da505b40e934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6809","nonce":3190929242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6811","nonce":3190929242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6815","nonce":3190929242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6813","nonce":3190929242}]},"public_addr":"172.21.15.57:6809/3190929242","cluster_addr":"172.21.15.57:6811/3190929242","heartbeat_back_addr":"172.21.15.57:6815/3190929242","heartbeat_front_addr":"172.21.15.57:6813/3190929242","state":["exists","up"]},{"osd":2,"uuid":"21e406e6-cfbc-4fe7-a816-e2420487c95d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6817","nonce":4065849973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6819","nonce":4065849973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6823","nonce":4065849973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6821","nonce":4065849973}]},"public_addr":"172.21.15.57:6817/4065849973","cluster_addr":"172.21.15.57:6819/4065849973","heartbeat_back_addr":"172.21.15.57:6823/4065849973","heartbeat_front_addr":"172.21.15.57:6821/4065849973","state":["exists","up"]},{"osd":3,"uuid":"a389af1d-76c4-4dfc-b215-f983f4931257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6825","nonce":158084809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6827","nonce":158084809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6831","nonce":158084809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6829","nonce":158084809}]},"public_addr":"172.21.15.57:6825/158084809","cluster_addr":"172.21.15.57:6827/158084809","heartbeat_back_addr":"172.21.15.57:6831/158084809","heartbeat_front_addr":"172.21.15.57:6829/158084809","state":["exists","up"]},{"osd":4,"uuid":"e9b05dca-557a-43ee-b43f-9ce5b7d28304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6823","nonce":108719401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6827","nonce":108719401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6831","nonce":108719401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6829","nonce":108719401}]},"public_addr":"172.21.15.118:6823/108719401","cluster_addr":"172.21.15.118:6827/108719401","heartbeat_back_addr":"172.21.15.118:6831/108719401","heartbeat_front_addr":"172.21.15.118:6829/108719401","state":["exists","up"]},{"osd":5,"uuid":"d968177d-44ff-499a-b00a-b147ed879253","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6817","nonce":2704605866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6819","nonce":2704605866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6826","nonce":2704605866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6822","nonce":2704605866}]},"public_addr":"172.21.15.118:6817/2704605866","cluster_addr":"172.21.15.118:6819/2704605866","heartbeat_back_addr":"172.21.15.118:6826/2704605866","heartbeat_front_addr":"172.21.15.118:6822/2704605866","state":["exists","up"]},{"osd":6,"uuid":"e8f98052-e6ad-4cfe-a4a9-0b17a434d54e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6801","nonce":1963659095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6803","nonce":1963659095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6807","nonce":1963659095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6805","nonce":1963659095}]},"public_addr":"172.21.15.118:6801/1963659095","cluster_addr":"172.21.15.118:6803/1963659095","heartbeat_back_addr":"172.21.15.118:6807/1963659095","heartbeat_front_addr":"172.21.15.118:6805/1963659095","state":["exists","up"]},{"osd":7,"uuid":"eccff987-8e51-4a63-845a-cf0a3196d7fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6809","nonce":1955879596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6811","nonce":1955879596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6815","nonce":1955879596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6813","nonce":1955879596}]},"public_addr":"172.21.15.118:6809/1955879596","cluster_addr":"172.21.15.118:6811/1955879596","heartbeat_back_addr":"172.21.15.118:6815/1955879596","heartbeat_front_addr":"172.21.15.118:6813/1955879596","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.721258+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.696610+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.777895+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.806769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.743259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.845687+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:13.020165+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.722294+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.26","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-27T19:51:45.062 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:45.060+0000 7efc7e000640 1 -- 172.21.15.57:0/1963424244 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7efc5806c530 msgr2=0x7efc5806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:45.062 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:45.060+0000 7efc7e000640 1 --2- 172.21.15.57:0/1963424244 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7efc5806c530 0x7efc5806e9f0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7efc78145b50 tx=0x7efc64007e60 comp rx=0 tx=0).stop 2024-03-27T19:51:45.062 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:45.060+0000 7efc7e000640 1 -- 172.21.15.57:0/1963424244 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efc7814c0f0 msgr2=0x7efc7814a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:45.062 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:45.060+0000 7efc7e000640 1 --2- 172.21.15.57:0/1963424244 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efc7814c0f0 0x7efc7814a780 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7efc6800e9e0 tx=0x7efc6800eea0 comp rx=0 tx=0).stop 2024-03-27T19:51:45.062 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:45.060+0000 7efc7e000640 1 -- 172.21.15.57:0/1963424244 shutdown_connections 2024-03-27T19:51:45.062 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:45.060+0000 7efc7e000640 1 --2- 172.21.15.57:0/1963424244 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7efc5806c530 0x7efc5806e9f0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:45.062 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:45.060+0000 7efc7e000640 1 --2- 172.21.15.57:0/1963424244 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7efc78166160 0x7efc780cdb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:45.062 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:45.060+0000 7efc7e000640 1 --2- 172.21.15.57:0/1963424244 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7efc78162b10 0x7efc7813f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:45.062 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:45.060+0000 7efc7e000640 1 --2- 172.21.15.57:0/1963424244 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7efc7814c0f0 0x7efc7814a780 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:45.062 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:45.060+0000 7efc7e000640 1 -- 172.21.15.57:0/1963424244 >> 172.21.15.57:0/1963424244 conn(0x7efc780cfe60 msgr2=0x7efc7806d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T19:51:45.063 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:45.062+0000 7efc7e000640 1 -- 172.21.15.57:0/1963424244 shutdown_connections 2024-03-27T19:51:45.063 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:45.062+0000 7efc7e000640 1 -- 172.21.15.57:0/1963424244 wait complete. 2024-03-27T19:51:45.090 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-03-27T19:51:45.374 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:45.372+0000 7f1f8da00640 1 Processor -- start 2024-03-27T19:51:45.374 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:45.373+0000 7f1f8da00640 1 -- start start 2024-03-27T19:51:45.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:45.374+0000 7f1f8da00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1f8815c120 0x7f1f880d0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:45.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:45.374+0000 7f1f8da00640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f880cfc10 con 0x7f1f880d2450 2024-03-27T19:51:45.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:45.374+0000 7f1f8da00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f880cfef0 con 0x7f1f880b2910 2024-03-27T19:51:45.375 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:45.374+0000 7f1f8da00640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f1f880d01d0 con 0x7f1f8815c120 2024-03-27T19:51:45.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:45.375+0000 7f1f86a00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1f8815c120 0x7f1f880d0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:45.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:45.375+0000 7f1f86a00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f1f8815c120 0x7f1f880d0cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37952/0 (socket says 172.21.15.57:37952) 2024-03-27T19:51:45.376 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:45.375+0000 7f1f86a00640 1 -- 172.21.15.57:0/2978315164 learned_addr learned my addr 172.21.15.57:0/2978315164 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T19:51:45.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:45.375+0000 7f1f86a00640 1 -- 172.21.15.57:0/2978315164 >> v1:172.21.15.118:6789/0 conn(0x7f1f880b2910 legacy=0x7f1f880d1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:45.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:45.375+0000 7f1f86a00640 1 -- 172.21.15.57:0/2978315164 >> v1:172.21.15.57:6789/0 conn(0x7f1f880d2450 legacy=0x7f1f880b0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:45.377 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:45.375+0000 7f1f86a00640 1 -- 172.21.15.57:0/2978315164 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f880d04b0 con 0x7f1f8815c120 2024-03-27T19:51:45.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:45.377+0000 7f1f86a00640 1 --2- 172.21.15.57:0/2978315164 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1f8815c120 0x7f1f880d0cb0 secure :-1 s=READY pgs=2207 cs=0 l=1 rev1=1 crypto rx=0x7f1f78009870 tx=0x7f1f7802b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83ee04296ef081b8 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:51:45.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:45.377+0000 7f1f85600640 1 -- 172.21.15.57:0/2978315164 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f78034070 con 0x7f1f8815c120 2024-03-27T19:51:45.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:45.377+0000 7f1f85600640 1 -- 172.21.15.57:0/2978315164 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f78030850 con 0x7f1f8815c120 2024-03-27T19:51:45.378 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:45.377+0000 7f1f85600640 1 -- 172.21.15.57:0/2978315164 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f78030c20 con 0x7f1f8815c120 2024-03-27T19:51:45.379 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:45.378+0000 7f1f8da00640 1 -- 172.21.15.57:0/2978315164 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1f8815c120 msgr2=0x7f1f880d0cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:45.379 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:45.378+0000 7f1f8da00640 1 --2- 172.21.15.57:0/2978315164 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1f8815c120 0x7f1f880d0cb0 secure :-1 s=READY pgs=2207 cs=0 l=1 rev1=1 crypto rx=0x7f1f78009870 tx=0x7f1f7802b990 comp rx=0 tx=0).stop 2024-03-27T19:51:45.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:45.378+0000 7f1f8da00640 1 -- 172.21.15.57:0/2978315164 shutdown_connections 2024-03-27T19:51:45.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:45.378+0000 7f1f8da00640 1 --2- 172.21.15.57:0/2978315164 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1f8815c120 0x7f1f880d0cb0 secure :-1 s=CLOSED pgs=2207 cs=0 l=1 rev1=1 crypto rx=0x7f1f78009870 tx=0x7f1f7802b990 comp rx=0 tx=0).stop 2024-03-27T19:51:45.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:45.378+0000 7f1f8da00640 1 -- 172.21.15.57:0/2978315164 >> 172.21.15.57:0/2978315164 conn(0x7f1f8809aa30 msgr2=0x7f1f8809ae40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T19:51:45.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:45.378+0000 7f1f8da00640 1 -- 172.21.15.57:0/2978315164 shutdown_connections 2024-03-27T19:51:45.380 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:45.378+0000 7f1f8da00640 1 -- 172.21.15.57:0/2978315164 wait complete. 2024-03-27T19:51:45.381 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:45.380+0000 7f1f8da00640 1 Processor -- start 2024-03-27T19:51:45.382 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:45.380+0000 7f1f8da00640 1 -- start start 2024-03-27T19:51:45.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:45.381+0000 7f1f8da00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1f880b2910 0x7f1f880b4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:45.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:45.382+0000 7f1f8da00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1f880d2450 0x7f1f880b6700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:45.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:45.382+0000 7f1f8da00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1f880b5040 0x7f1f880b6c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:45.383 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:45.382+0000 7f1f8da00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f1f880cebc0 con 0x7f1f880d2450 2024-03-27T19:51:45.384 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:45.382+0000 7f1f8da00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f1f880cea40 con 0x7f1f880b5040 2024-03-27T19:51:45.384 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:45.382+0000 7f1f8da00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f1f8815c500 con 0x7f1f880b2910 2024-03-27T19:51:45.384 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:45.382+0000 7f1f86000640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1f880d2450 0x7f1f880b6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:45.384 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:45.382+0000 7f1f86000640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1f880d2450 0x7f1f880b6700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37956/0 (socket says 172.21.15.57:37956) 2024-03-27T19:51:45.384 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:45.382+0000 7f1f86000640 1 -- 172.21.15.57:0/3251502238 learned_addr learned my addr 172.21.15.57:0/3251502238 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T19:51:45.384 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:45.382+0000 7f1f86a00640 1 --2- 172.21.15.57:0/3251502238 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1f880b2910 0x7f1f880b4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:45.385 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:45.383+0000 7f1f86000640 1 -- 172.21.15.57:0/3251502238 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1f880b2910 msgr2=0x7f1f880b4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:45.385 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:45.383+0000 7f1f86000640 1 --2- 172.21.15.57:0/3251502238 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1f880b2910 0x7f1f880b4b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:45.385 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:45.383+0000 7f1f86000640 1 -- 172.21.15.57:0/3251502238 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1f880b5040 msgr2=0x7f1f880b6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:45.385 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:45.383+0000 7f1f86000640 1 --2- 172.21.15.57:0/3251502238 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1f880b5040 0x7f1f880b6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:45.385 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:45.383+0000 7f1f86000640 1 -- 172.21.15.57:0/3251502238 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f8815e260 con 0x7f1f880d2450 2024-03-27T19:51:45.385 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:45.383+0000 7f1f86000640 1 --2- 172.21.15.57:0/3251502238 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1f880d2450 0x7f1f880b6700 secure :-1 s=READY pgs=2208 cs=0 l=1 rev1=1 crypto rx=0x7f1f7400c430 tx=0x7f1f7400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:51:45.385 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:45.383+0000 7f1f7ea00640 1 -- 172.21.15.57:0/3251502238 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f740052d0 con 0x7f1f880d2450 2024-03-27T19:51:45.385 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:45.383+0000 7f1f7ea00640 1 -- 172.21.15.57:0/3251502238 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f74005470 con 0x7f1f880d2450 2024-03-27T19:51:45.386 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:45.383+0000 7f1f7ea00640 1 -- 172.21.15.57:0/3251502238 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f74007260 con 0x7f1f880d2450 2024-03-27T19:51:45.386 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:45.383+0000 7f1f8da00640 1 -- 172.21.15.57:0/3251502238 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f8815e540 con 0x7f1f880d2450 2024-03-27T19:51:45.386 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:45.384+0000 7f1f8da00640 1 -- 172.21.15.57:0/3251502238 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f8815eb00 con 0x7f1f880d2450 2024-03-27T19:51:45.386 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:45.385+0000 7f1f8da00640 1 -- 172.21.15.57:0/3251502238 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f88068620 con 0x7f1f880d2450 2024-03-27T19:51:45.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:45.388+0000 7f1f7ea00640 1 -- 172.21.15.57:0/3251502238 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f1f74007400 con 0x7f1f880d2450 2024-03-27T19:51:45.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:45.390+0000 7f1f7ea00640 1 --2- 172.21.15.57:0/3251502238 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f1f6806c530 0x7f1f6806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:45.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:45.390+0000 7f1f7ea00640 1 -- 172.21.15.57:0/3251502238 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6130+0+0 (secure 0 0 0) 0x7f1f7408adc0 con 0x7f1f880d2450 2024-03-27T19:51:45.396 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:45.395+0000 7f1f86a00640 1 --2- 172.21.15.57:0/3251502238 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f1f6806c530 0x7f1f6806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:45.397 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:45.396+0000 7f1f86a00640 1 --2- 172.21.15.57:0/3251502238 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f1f6806c530 0x7f1f6806e9f0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f1f78036000 tx=0x7f1f7803b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:51:45.408 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:45.407+0000 7f1f7ea00640 1 -- 172.21.15.57:0/3251502238 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f1f74059220 con 0x7f1f880d2450 2024-03-27T19:51:45.839 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:45.838+0000 7f1f8da00640 1 -- 172.21.15.57:0/3251502238 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f1f880b0b10 con 0x7f1f880d2450 2024-03-27T19:51:45.883 INFO:tasks.ceph.mon.a.smithi057.stderr:2024-03-27T19:51:45.882+0000 7f5623400640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-27T19:51:45.888 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:45.887+0000 7f1f7ea00640 1 -- 172.21.15.57:0/3251502238 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v19) ==== 161+0+0 (secure 0 0 0) 0x7f1f74058b20 con 0x7f1f880d2450 2024-03-27T19:51:45.892 INFO:teuthology.orchestra.run.smithi057.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-03-27T19:51:45.893 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:45.892+0000 7f1f8da00640 1 -- 172.21.15.57:0/3251502238 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f1f6806c530 msgr2=0x7f1f6806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:45.893 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:45.892+0000 7f1f8da00640 1 --2- 172.21.15.57:0/3251502238 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f1f6806c530 0x7f1f6806e9f0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f1f78036000 tx=0x7f1f7803b040 comp rx=0 tx=0).stop 2024-03-27T19:51:45.893 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:45.892+0000 7f1f8da00640 1 -- 172.21.15.57:0/3251502238 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1f880d2450 msgr2=0x7f1f880b6700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:45.894 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:45.892+0000 7f1f8da00640 1 --2- 172.21.15.57:0/3251502238 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1f880d2450 0x7f1f880b6700 secure :-1 s=READY pgs=2208 cs=0 l=1 rev1=1 crypto rx=0x7f1f7400c430 tx=0x7f1f7400c8f0 comp rx=0 tx=0).stop 2024-03-27T19:51:45.894 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:45.892+0000 7f1f8da00640 1 -- 172.21.15.57:0/3251502238 shutdown_connections 2024-03-27T19:51:45.894 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:45.892+0000 7f1f8da00640 1 --2- 172.21.15.57:0/3251502238 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f1f6806c530 0x7f1f6806e9f0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:45.894 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:45.892+0000 7f1f8da00640 1 --2- 172.21.15.57:0/3251502238 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1f880b5040 0x7f1f880b6c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:45.894 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:45.892+0000 7f1f8da00640 1 --2- 172.21.15.57:0/3251502238 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1f880d2450 0x7f1f880b6700 unknown :-1 s=CLOSED pgs=2208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:45.894 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:45.892+0000 7f1f8da00640 1 --2- 172.21.15.57:0/3251502238 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1f880b2910 0x7f1f880b4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:45.894 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:45.892+0000 7f1f8da00640 1 -- 172.21.15.57:0/3251502238 >> 172.21.15.57:0/3251502238 conn(0x7f1f8809aa30 msgr2=0x7f1f880d0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T19:51:45.894 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:45.892+0000 7f1f8da00640 1 -- 172.21.15.57:0/3251502238 shutdown_connections 2024-03-27T19:51:45.896 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:45.892+0000 7f1f8da00640 1 -- 172.21.15.57:0/3251502238 wait complete. 2024-03-27T19:51:45.927 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-03-27T19:51:46.094 INFO:tasks.ceph.mds.a.smithi057.stdout:starting mds.a at 2024-03-27T19:51:46.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:46.119+0000 7fd324200640 1 Processor -- start 2024-03-27T19:51:46.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:46.119+0000 7fd324200640 1 -- start start 2024-03-27T19:51:46.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:46.120+0000 7fd324200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd31c0ccff0 0x7fd31c0cd450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:46.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:46.120+0000 7fd324200640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fd31c06b540 0x7fd31c06b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:46.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:46.120+0000 7fd324200640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd31c0b3940 con 0x7fd31c15c150 2024-03-27T19:51:46.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:46.120+0000 7fd324200640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7fd31c0cd990 con 0x7fd31c06b540 2024-03-27T19:51:46.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:46.120+0000 7fd324200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fd31c0b3c20 con 0x7fd31c0ccff0 2024-03-27T19:51:46.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:46.120+0000 7fd321800640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fd31c15c150 0x7fd31c0cfe50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:50252/0 (socket says 172.21.15.57:50252) 2024-03-27T19:51:46.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:46.120+0000 7fd321800640 1 -- 172.21.15.57:0/4294055923 learned_addr learned my addr 172.21.15.57:0/4294055923 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T19:51:46.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:46.121+0000 7fd322200640 1 --2- 172.21.15.57:0/4294055923 >> v2:172.21.15.118:3300/0 conn(0x7fd31c06b540 0x7fd31c06b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:46.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:46.121+0000 7fd31be00640 1 -- 172.21.15.57:0/4294055923 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 634103275 0 0) 0x7fd31c0b3940 con 0x7fd31c15c150 2024-03-27T19:51:46.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:46.121+0000 7fd31be00640 1 -- 172.21.15.57:0/4294055923 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd304003520 con 0x7fd31c15c150 2024-03-27T19:51:46.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:46.121+0000 7fd320e00640 1 --2- 172.21.15.57:0/4294055923 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd31c0ccff0 0x7fd31c0cd450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:46.125 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:46.121+0000 7fd31be00640 1 -- 172.21.15.57:0/4294055923 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 717818230 0 0) 0x7fd304003520 con 0x7fd31c15c150 2024-03-27T19:51:46.125 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:46.121+0000 7fd31be00640 1 -- 172.21.15.57:0/4294055923 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd31c0ccff0 msgr2=0x7fd31c0cd450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T19:51:46.125 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:46.121+0000 7fd31be00640 1 --2- 172.21.15.57:0/4294055923 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd31c0ccff0 0x7fd31c0cd450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:46.125 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:46.121+0000 7fd31be00640 1 -- 172.21.15.57:0/4294055923 >> v2:172.21.15.118:3300/0 conn(0x7fd31c06b540 msgr2=0x7fd31c06b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T19:51:46.125 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:46.121+0000 7fd31be00640 1 --2- 172.21.15.57:0/4294055923 >> v2:172.21.15.118:3300/0 conn(0x7fd31c06b540 0x7fd31c06b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:46.125 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:46.121+0000 7fd31be00640 1 -- 172.21.15.57:0/4294055923 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd31c0b3f00 con 0x7fd31c15c150 2024-03-27T19:51:46.125 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:46.121+0000 7fd31be00640 1 -- 172.21.15.57:0/4294055923 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4227751516 0 0) 0x7fd310001670 con 0x7fd31c15c150 2024-03-27T19:51:46.125 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:46.121+0000 7fd322200640 1 --2- 172.21.15.57:0/4294055923 >> v2:172.21.15.118:3300/0 conn(0x7fd31c06b540 0x7fd31c06b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T19:51:46.125 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:46.121+0000 7fd31be00640 1 -- 172.21.15.57:0/4294055923 >> v1:172.21.15.57:6789/0 conn(0x7fd31c15c150 legacy=0x7fd31c0cfe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:46.125 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:46.121+0000 7fd31be00640 1 --2- 172.21.15.57:0/4294055923 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3040039b0 0x7fd304003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:46.125 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:46.121+0000 7fd31be00640 1 --2- 172.21.15.57:0/4294055923 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd31c0ccff0 0x7fd304004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:46.126 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:46.121+0000 7fd31be00640 1 --2- 172.21.15.57:0/4294055923 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd304004d40 0x7fd3040051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:46.126 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:46.121+0000 7fd31be00640 1 -- 172.21.15.57:0/4294055923 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fd31c0b3c20 con 0x7fd3040039b0 2024-03-27T19:51:46.126 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:46.121+0000 7fd31be00640 1 -- 172.21.15.57:0/4294055923 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fd30400ba70 con 0x7fd304004d40 2024-03-27T19:51:46.126 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:46.121+0000 7fd31be00640 1 -- 172.21.15.57:0/4294055923 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fd30400bbf0 con 0x7fd31c0ccff0 2024-03-27T19:51:46.126 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:46.122+0000 7fd321800640 1 --2- 172.21.15.57:0/4294055923 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3040039b0 0x7fd304003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:46.126 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:46.122+0000 7fd320e00640 1 --2- 172.21.15.57:0/4294055923 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd31c0ccff0 0x7fd304004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:46.126 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:46.122+0000 7fd322200640 1 --2- 172.21.15.57:0/4294055923 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd304004d40 0x7fd3040051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:46.126 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:46.122+0000 7fd321800640 1 -- 172.21.15.57:0/4294055923 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd31c0ccff0 msgr2=0x7fd304004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T19:51:46.126 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:46.122+0000 7fd321800640 1 --2- 172.21.15.57:0/4294055923 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd31c0ccff0 0x7fd304004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:46.126 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:46.122+0000 7fd321800640 1 -- 172.21.15.57:0/4294055923 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd304004d40 msgr2=0x7fd3040051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T19:51:46.126 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:46.122+0000 7fd321800640 1 --2- 172.21.15.57:0/4294055923 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd304004d40 0x7fd3040051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:46.126 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:46.122+0000 7fd321800640 1 -- 172.21.15.57:0/4294055923 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd304003520 con 0x7fd3040039b0 2024-03-27T19:51:46.126 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:46.122+0000 7fd322200640 1 --2- 172.21.15.57:0/4294055923 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd304004d40 0x7fd3040051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T19:51:46.126 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:46.123+0000 7fd321800640 1 --2- 172.21.15.57:0/4294055923 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3040039b0 0x7fd304003dd0 secure :-1 s=READY pgs=2213 cs=0 l=1 rev1=1 crypto rx=0x7fd31000c2c0 tx=0x7fd304005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14225a9a664b9677 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:51:46.127 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:46.123+0000 7fd31be00640 1 -- 172.21.15.57:0/4294055923 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd310007d50 con 0x7fd3040039b0 2024-03-27T19:51:46.127 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:46.123+0000 7fd31be00640 1 -- 172.21.15.57:0/4294055923 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd310030070 con 0x7fd3040039b0 2024-03-27T19:51:46.127 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:46.123+0000 7fd31be00640 1 -- 172.21.15.57:0/4294055923 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd31002cd60 con 0x7fd3040039b0 2024-03-27T19:51:46.128 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:46.124+0000 7fd324200640 1 -- 172.21.15.57:0/4294055923 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3040039b0 msgr2=0x7fd304003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:46.128 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:46.124+0000 7fd324200640 1 --2- 172.21.15.57:0/4294055923 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd3040039b0 0x7fd304003dd0 secure :-1 s=READY pgs=2213 cs=0 l=1 rev1=1 crypto rx=0x7fd31000c2c0 tx=0x7fd304005830 comp rx=0 tx=0).stop 2024-03-27T19:51:46.128 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:46.124+0000 7fd322200640 1 -- 172.21.15.57:0/4294055923 reap_dead start 2024-03-27T19:51:46.128 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:46.124+0000 7fd324200640 1 -- 172.21.15.57:0/4294055923 shutdown_connections 2024-03-27T19:51:46.128 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:46.124+0000 7fd324200640 1 -- 172.21.15.57:0/4294055923 >> 172.21.15.57:0/4294055923 conn(0x7fd31c0d05e0 msgr2=0x7fd31c0d09f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T19:51:46.128 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:46.124+0000 7fd324200640 1 -- 172.21.15.57:0/4294055923 shutdown_connections 2024-03-27T19:51:46.128 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:46.124+0000 7fd324200640 1 -- 172.21.15.57:0/4294055923 wait complete. 2024-03-27T19:51:46.128 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:46.126+0000 7fd324200640 1 Processor -- start 2024-03-27T19:51:46.128 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:46.126+0000 7fd324200640 1 -- start start 2024-03-27T19:51:46.130 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:46.127+0000 7fd324200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd3040039b0 0x7fd31c1f4a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:46.130 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:46.127+0000 7fd324200640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd31c159d80 0x7fd31c144970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:46.130 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:46.127+0000 7fd324200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd31c15a200 0x7fd31c144eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:46.130 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:46.127+0000 7fd324200640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fd31c0cf1f0 con 0x7fd31c159d80 2024-03-27T19:51:46.130 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:46.127+0000 7fd324200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fd31c0b44c0 con 0x7fd3040039b0 2024-03-27T19:51:46.130 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:46.127+0000 7fd324200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fd31c0b49e0 con 0x7fd31c15a200 2024-03-27T19:51:46.130 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:46.127+0000 7fd320e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd31c159d80 0x7fd31c144970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:46.130 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:46.127+0000 7fd320e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd31c159d80 0x7fd31c144970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:37994/0 (socket says 172.21.15.57:37994) 2024-03-27T19:51:46.130 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:46.127+0000 7fd320e00640 1 -- 172.21.15.57:0/332091016 learned_addr learned my addr 172.21.15.57:0/332091016 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T19:51:46.131 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:46.128+0000 7fd322200640 1 --2- 172.21.15.57:0/332091016 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd31c15a200 0x7fd31c144eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:46.131 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:46.128+0000 7fd320e00640 1 -- 172.21.15.57:0/332091016 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd31c15a200 msgr2=0x7fd31c144eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:46.131 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:46.128+0000 7fd320e00640 1 --2- 172.21.15.57:0/332091016 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd31c15a200 0x7fd31c144eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:46.131 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:46.128+0000 7fd320e00640 1 -- 172.21.15.57:0/332091016 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd3040039b0 msgr2=0x7fd31c1f4a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:46.131 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:46.128+0000 7fd320e00640 1 --2- 172.21.15.57:0/332091016 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd3040039b0 0x7fd31c1f4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:46.131 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:46.128+0000 7fd320e00640 1 -- 172.21.15.57:0/332091016 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd31c1f4f90 con 0x7fd31c159d80 2024-03-27T19:51:46.131 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:46.128+0000 7fd322200640 1 --2- 172.21.15.57:0/332091016 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd31c15a200 0x7fd31c144eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T19:51:46.131 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:46.128+0000 7fd320e00640 1 --2- 172.21.15.57:0/332091016 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd31c159d80 0x7fd31c144970 secure :-1 s=READY pgs=2214 cs=0 l=1 rev1=1 crypto rx=0x7fd30800f580 tx=0x7fd30800fa40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:51:46.131 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:46.128+0000 7fd319600640 1 -- 172.21.15.57:0/332091016 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd308019020 con 0x7fd31c159d80 2024-03-27T19:51:46.131 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:46.128+0000 7fd319600640 1 -- 172.21.15.57:0/332091016 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd308014870 con 0x7fd31c159d80 2024-03-27T19:51:46.131 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:46.128+0000 7fd319600640 1 -- 172.21.15.57:0/332091016 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd308014c60 con 0x7fd31c159d80 2024-03-27T19:51:46.131 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:46.128+0000 7fd324200640 1 -- 172.21.15.57:0/332091016 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd31c15c530 con 0x7fd31c159d80 2024-03-27T19:51:46.131 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:46.129+0000 7fd324200640 1 -- 172.21.15.57:0/332091016 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd31c15cab0 con 0x7fd31c159d80 2024-03-27T19:51:46.132 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:46.130+0000 7fd324200640 1 -- 172.21.15.57:0/332091016 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd31c068540 con 0x7fd31c159d80 2024-03-27T19:51:46.132 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:46.131+0000 7fd319600640 1 -- 172.21.15.57:0/332091016 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fd30801c020 con 0x7fd31c159d80 2024-03-27T19:51:46.134 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:46.133+0000 7fd319600640 1 --2- 172.21.15.57:0/332091016 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fd2fc06c530 0x7fd2fc06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:46.134 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:46.133+0000 7fd319600640 1 -- 172.21.15.57:0/332091016 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6216+0+0 (secure 0 0 0) 0x7fd30808c120 con 0x7fd31c159d80 2024-03-27T19:51:46.134 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:46.133+0000 7fd321800640 1 --2- 172.21.15.57:0/332091016 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fd2fc06c530 0x7fd2fc06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:46.135 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:46.134+0000 7fd321800640 1 --2- 172.21.15.57:0/332091016 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fd2fc06c530 0x7fd2fc06e9f0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fd310034000 tx=0x7fd31002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:51:46.139 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:46.138+0000 7fd319600640 1 -- 172.21.15.57:0/332091016 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7fd308023020 con 0x7fd31c159d80 2024-03-27T19:51:46.374 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:46.373+0000 7fd324200640 1 -- 172.21.15.57:0/332091016 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fd31c067430 con 0x7fd31c159d80 2024-03-27T19:51:46.890 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:46.889+0000 7fd319600640 1 -- 172.21.15.57:0/332091016 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v20) ==== 104+0+0 (secure 0 0 0) 0x7fd31c1f4f90 con 0x7fd31c159d80 2024-03-27T19:51:46.893 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:46.892+0000 7fd324200640 1 -- 172.21.15.57:0/332091016 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fd2fc06c530 msgr2=0x7fd2fc06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:46.893 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:46.892+0000 7fd324200640 1 --2- 172.21.15.57:0/332091016 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fd2fc06c530 0x7fd2fc06e9f0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fd310034000 tx=0x7fd31002e000 comp rx=0 tx=0).stop 2024-03-27T19:51:46.893 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:46.892+0000 7fd324200640 1 -- 172.21.15.57:0/332091016 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd31c159d80 msgr2=0x7fd31c144970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:46.894 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:46.892+0000 7fd324200640 1 --2- 172.21.15.57:0/332091016 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd31c159d80 0x7fd31c144970 secure :-1 s=READY pgs=2214 cs=0 l=1 rev1=1 crypto rx=0x7fd30800f580 tx=0x7fd30800fa40 comp rx=0 tx=0).stop 2024-03-27T19:51:46.894 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:46.892+0000 7fd324200640 1 -- 172.21.15.57:0/332091016 shutdown_connections 2024-03-27T19:51:46.894 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:46.892+0000 7fd324200640 1 --2- 172.21.15.57:0/332091016 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fd31c15a200 0x7fd31c144eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:46.894 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:46.892+0000 7fd324200640 1 --2- 172.21.15.57:0/332091016 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fd31c159d80 0x7fd31c144970 unknown :-1 s=CLOSED pgs=2214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:46.894 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:46.892+0000 7fd324200640 1 --2- 172.21.15.57:0/332091016 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fd2fc06c530 0x7fd2fc06e9f0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:46.894 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:46.892+0000 7fd324200640 1 --2- 172.21.15.57:0/332091016 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fd3040039b0 0x7fd31c1f4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:46.894 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:46.892+0000 7fd324200640 1 -- 172.21.15.57:0/332091016 >> 172.21.15.57:0/332091016 conn(0x7fd31c0d05e0 msgr2=0x7fd31c0d09f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T19:51:46.894 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:46.892+0000 7fd324200640 1 -- 172.21.15.57:0/332091016 shutdown_connections 2024-03-27T19:51:46.894 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:46.892+0000 7fd324200640 1 -- 172.21.15.57:0/332091016 wait complete. 2024-03-27T19:51:46.913 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-03-27T19:51:47.109 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:47.107+0000 7f0b68200640 1 Processor -- start 2024-03-27T19:51:47.109 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:47.108+0000 7f0b68200640 1 -- start start 2024-03-27T19:51:47.110 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:47.109+0000 7f0b68200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0b600d2260 0x7f0b600b5500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:47.111 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:47.109+0000 7f0b68200640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f0b600d2640 0x7f0b6015e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:47.111 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:47.109+0000 7f0b68200640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b600d2fb0 con 0x7f0b600d2aa0 2024-03-27T19:51:47.111 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:47.109+0000 7f0b68200640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f0b600d3290 con 0x7f0b600d2640 2024-03-27T19:51:47.111 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:47.109+0000 7f0b68200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f0b600b5a40 con 0x7f0b600d2260 2024-03-27T19:51:47.112 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:47.110+0000 7f0b65800640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0b600d2260 0x7f0b600b5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:47.112 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:47.110+0000 7f0b64e00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f0b600d2640 0x7f0b6015e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:47.112 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:47.110+0000 7f0b66200640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f0b600d2aa0 0x7f0b600d07b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.57:48178/0 (socket says 172.21.15.57:48178) 2024-03-27T19:51:47.112 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:47.110+0000 7f0b66200640 1 -- 172.21.15.57:0/3438393091 learned_addr learned my addr 172.21.15.57:0/3438393091 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T19:51:47.112 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:47.110+0000 7f0b65800640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0b600d2260 0x7f0b600b5500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.57:33426/0 (socket says 172.21.15.57:33426) 2024-03-27T19:51:47.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:47.111+0000 7f0b65800640 1 -- 172.21.15.57:0/3438393091 >> v2:172.21.15.118:3300/0 conn(0x7f0b600d2640 msgr2=0x7f0b6015e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T19:51:47.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:47.111+0000 7f0b65800640 1 --2- 172.21.15.57:0/3438393091 >> v2:172.21.15.118:3300/0 conn(0x7f0b600d2640 0x7f0b6015e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:47.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:47.111+0000 7f0b65800640 1 -- 172.21.15.57:0/3438393091 >> v1:172.21.15.118:6789/0 conn(0x7f0b600d2aa0 legacy=0x7f0b600d07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:47.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:47.111+0000 7f0b65800640 1 -- 172.21.15.57:0/3438393091 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b600cfb10 con 0x7f0b600d2260 2024-03-27T19:51:47.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:47.111+0000 7f0b5fe00640 1 -- 172.21.15.57:0/3438393091 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2288573430 0 0) 0x7f0b600d2fb0 con 0x7f0b600d2aa0 2024-03-27T19:51:47.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:47.112+0000 7f0b65800640 1 --2- 172.21.15.57:0/3438393091 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0b600d2260 0x7f0b600b5500 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f0b540097a0 tx=0x7f0b5402b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4f7f35a31377513 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:51:47.114 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:47.113+0000 7f0b5fe00640 1 -- 172.21.15.57:0/3438393091 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b54035020 con 0x7f0b600d2260 2024-03-27T19:51:47.114 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:47.113+0000 7f0b5fe00640 1 -- 172.21.15.57:0/3438393091 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b54031810 con 0x7f0b600d2260 2024-03-27T19:51:47.114 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:47.113+0000 7f0b5fe00640 1 -- 172.21.15.57:0/3438393091 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b54031be0 con 0x7f0b600d2260 2024-03-27T19:51:47.115 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:47.114+0000 7f0b68200640 1 -- 172.21.15.57:0/3438393091 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0b600d2260 msgr2=0x7f0b600b5500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:47.115 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:47.114+0000 7f0b68200640 1 --2- 172.21.15.57:0/3438393091 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0b600d2260 0x7f0b600b5500 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f0b540097a0 tx=0x7f0b5402b8b0 comp rx=0 tx=0).stop 2024-03-27T19:51:47.115 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:47.114+0000 7f0b68200640 1 -- 172.21.15.57:0/3438393091 shutdown_connections 2024-03-27T19:51:47.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:47.114+0000 7f0b68200640 1 --2- 172.21.15.57:0/3438393091 >> v2:172.21.15.118:3300/0 conn(0x7f0b600d2640 0x7f0b6015e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:47.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:47.114+0000 7f0b68200640 1 --2- 172.21.15.57:0/3438393091 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0b600d2260 0x7f0b600b5500 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:47.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:47.114+0000 7f0b68200640 1 -- 172.21.15.57:0/3438393091 >> 172.21.15.57:0/3438393091 conn(0x7f0b600d40f0 msgr2=0x7f0b600d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T19:51:47.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:47.114+0000 7f0b68200640 1 -- 172.21.15.57:0/3438393091 shutdown_connections 2024-03-27T19:51:47.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:47.114+0000 7f0b68200640 1 -- 172.21.15.57:0/3438393091 wait complete. 2024-03-27T19:51:47.117 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:47.116+0000 7f0b68200640 1 Processor -- start 2024-03-27T19:51:47.117 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:47.116+0000 7f0b68200640 1 -- start start 2024-03-27T19:51:47.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:47.118+0000 7f0b68200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0b600d2260 0x7f0b601523d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:47.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:47.118+0000 7f0b68200640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b600d2640 0x7f0b60160600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:47.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:47.118+0000 7f0b68200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b600d2aa0 0x7f0b600c9260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:47.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:47.118+0000 7f0b68200640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f0b600d0160 con 0x7f0b600d2640 2024-03-27T19:51:47.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:47.118+0000 7f0b68200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f0b600cf8c0 con 0x7f0b600d2aa0 2024-03-27T19:51:47.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:47.118+0000 7f0b68200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f0b600b3430 con 0x7f0b600d2260 2024-03-27T19:51:47.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:47.118+0000 7f0b64e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b600d2640 0x7f0b60160600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:47.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:47.118+0000 7f0b64e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b600d2640 0x7f0b60160600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38004/0 (socket says 172.21.15.57:38004) 2024-03-27T19:51:47.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:47.118+0000 7f0b64e00640 1 -- 172.21.15.57:0/1722664099 learned_addr learned my addr 172.21.15.57:0/1722664099 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T19:51:47.121 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:47.118+0000 7f0b66200640 1 --2- 172.21.15.57:0/1722664099 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b600d2aa0 0x7f0b600c9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:47.121 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:47.118+0000 7f0b65800640 1 --2- 172.21.15.57:0/1722664099 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0b600d2260 0x7f0b601523d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:47.121 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:47.118+0000 7f0b64e00640 1 -- 172.21.15.57:0/1722664099 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0b600d2260 msgr2=0x7f0b601523d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:47.121 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:47.118+0000 7f0b64e00640 1 --2- 172.21.15.57:0/1722664099 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0b600d2260 0x7f0b601523d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:47.121 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:47.119+0000 7f0b64e00640 1 -- 172.21.15.57:0/1722664099 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b600d2aa0 msgr2=0x7f0b600c9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:47.121 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:47.119+0000 7f0b64e00640 1 --2- 172.21.15.57:0/1722664099 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b600d2aa0 0x7f0b600c9260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:47.121 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:47.119+0000 7f0b64e00640 1 -- 172.21.15.57:0/1722664099 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b60152910 con 0x7f0b600d2640 2024-03-27T19:51:47.121 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:47.119+0000 7f0b65800640 1 --2- 172.21.15.57:0/1722664099 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0b600d2260 0x7f0b601523d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T19:51:47.121 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:47.119+0000 7f0b64e00640 1 --2- 172.21.15.57:0/1722664099 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b600d2640 0x7f0b60160600 secure :-1 s=READY pgs=2215 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c00e8a0 tx=0x7f0b4c00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:51:47.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:47.119+0000 7f0b5d600640 1 -- 172.21.15.57:0/1722664099 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b4c017070 con 0x7f0b600d2640 2024-03-27T19:51:47.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:47.119+0000 7f0b5d600640 1 -- 172.21.15.57:0/1722664099 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b4c00c940 con 0x7f0b600d2640 2024-03-27T19:51:47.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:47.119+0000 7f0b5d600640 1 -- 172.21.15.57:0/1722664099 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b4c00cd30 con 0x7f0b600d2640 2024-03-27T19:51:47.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:47.119+0000 7f0b68200640 1 -- 172.21.15.57:0/1722664099 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b6015ec10 con 0x7f0b600d2640 2024-03-27T19:51:47.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:47.119+0000 7f0b68200640 1 -- 172.21.15.57:0/1722664099 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b6015f1d0 con 0x7f0b600d2640 2024-03-27T19:51:47.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:47.120+0000 7f0b68200640 1 -- 172.21.15.57:0/1722664099 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b60068620 con 0x7f0b600d2640 2024-03-27T19:51:47.124 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:47.123+0000 7f0b5d600640 1 -- 172.21.15.57:0/1722664099 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f0b4c01a070 con 0x7f0b600d2640 2024-03-27T19:51:47.125 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:47.123+0000 7f0b5d600640 1 --2- 172.21.15.57:0/1722664099 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f0b4006c530 0x7f0b4006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:47.125 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:47.123+0000 7f0b5d600640 1 -- 172.21.15.57:0/1722664099 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6216+0+0 (secure 0 0 0) 0x7f0b4c08bfa0 con 0x7f0b600d2640 2024-03-27T19:51:47.125 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:47.124+0000 7f0b65800640 1 --2- 172.21.15.57:0/1722664099 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f0b4006c530 0x7f0b4006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:47.125 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:47.124+0000 7f0b65800640 1 --2- 172.21.15.57:0/1722664099 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f0b4006c530 0x7f0b4006e9f0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f0b54036000 tx=0x7f0b54008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:51:47.154 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:47.152+0000 7f0b5d600640 1 -- 172.21.15.57:0/1722664099 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f0b4c05a3a0 con 0x7f0b600d2640 2024-03-27T19:51:47.357 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:47.356+0000 7f0b68200640 1 -- 172.21.15.57:0/1722664099 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f0b6006c700 con 0x7f0b600d2640 2024-03-27T19:51:47.899 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:47.898+0000 7f0b5d600640 1 -- 172.21.15.57:0/1722664099 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v44) ==== 181+0+0 (secure 0 0 0) 0x7f0b4c059ca0 con 0x7f0b600d2640 2024-03-27T19:51:47.899 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_metadata' removed 2024-03-27T19:51:47.902 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:47.900+0000 7f0b68200640 1 -- 172.21.15.57:0/1722664099 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f0b4006c530 msgr2=0x7f0b4006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:47.902 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:47.900+0000 7f0b68200640 1 --2- 172.21.15.57:0/1722664099 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f0b4006c530 0x7f0b4006e9f0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f0b54036000 tx=0x7f0b54008030 comp rx=0 tx=0).stop 2024-03-27T19:51:47.902 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:47.900+0000 7f0b68200640 1 -- 172.21.15.57:0/1722664099 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b600d2640 msgr2=0x7f0b60160600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:47.902 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:47.900+0000 7f0b68200640 1 --2- 172.21.15.57:0/1722664099 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b600d2640 0x7f0b60160600 secure :-1 s=READY pgs=2215 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c00e8a0 tx=0x7f0b4c00ed60 comp rx=0 tx=0).stop 2024-03-27T19:51:47.903 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:47.901+0000 7f0b68200640 1 -- 172.21.15.57:0/1722664099 shutdown_connections 2024-03-27T19:51:47.903 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:47.901+0000 7f0b68200640 1 --2- 172.21.15.57:0/1722664099 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f0b4006c530 0x7f0b4006e9f0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:47.903 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:47.901+0000 7f0b68200640 1 --2- 172.21.15.57:0/1722664099 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0b600d2aa0 0x7f0b600c9260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:47.903 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:47.901+0000 7f0b68200640 1 --2- 172.21.15.57:0/1722664099 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0b600d2640 0x7f0b60160600 unknown :-1 s=CLOSED pgs=2215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:47.903 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:47.901+0000 7f0b68200640 1 --2- 172.21.15.57:0/1722664099 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0b600d2260 0x7f0b601523d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:47.903 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:47.901+0000 7f0b68200640 1 -- 172.21.15.57:0/1722664099 >> 172.21.15.57:0/1722664099 conn(0x7f0b600d40f0 msgr2=0x7f0b600d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T19:51:47.903 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:47.901+0000 7f0b68200640 1 -- 172.21.15.57:0/1722664099 shutdown_connections 2024-03-27T19:51:47.903 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:47.901+0000 7f0b68200640 1 -- 172.21.15.57:0/1722664099 wait complete. 2024-03-27T19:51:47.922 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-03-27T19:51:48.146 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:48.145+0000 7f81e8000640 1 Processor -- start 2024-03-27T19:51:48.146 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:48.145+0000 7f81e8000640 1 -- start start 2024-03-27T19:51:48.148 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:48.147+0000 7f81e8000640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f81e00ce0c0 0x7f81e00ae530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:48.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:48.147+0000 7f81e8000640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f81e00cc730 0x7f81e00ccbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:48.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:48.147+0000 7f81e8000640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81e015f550 con 0x7f81e015e860 2024-03-27T19:51:48.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:48.147+0000 7f81e8000640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f81e0158d20 con 0x7f81e00ce0c0 2024-03-27T19:51:48.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:48.147+0000 7f81e8000640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f81e00ce4a0 con 0x7f81e00cc730 2024-03-27T19:51:48.149 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:48.148+0000 7f81e5600640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f81e00ce0c0 0x7f81e00ae530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:48.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:48.148+0000 7f81e4c00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f81e00cc730 0x7f81e00ccbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:48.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:48.148+0000 7f81e6000640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f81e015e860 0x7f81e015ec90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.57:48186/0 (socket says 172.21.15.57:48186) 2024-03-27T19:51:48.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:48.148+0000 7f81e5600640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f81e00ce0c0 0x7f81e00ae530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38016/0 (socket says 172.21.15.57:38016) 2024-03-27T19:51:48.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:48.149+0000 7f81e6000640 1 -- 172.21.15.57:0/3127240040 learned_addr learned my addr 172.21.15.57:0/3127240040 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T19:51:48.152 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:48.148+0000 7f81e4c00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f81e00cc730 0x7f81e00ccbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.57:59498/0 (socket says 172.21.15.57:59498) 2024-03-27T19:51:48.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:48.154+0000 7f81e4c00640 1 -- 172.21.15.57:0/3127240040 >> v2:172.21.15.57:3300/0 conn(0x7f81e00ce0c0 msgr2=0x7f81e00ae530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T19:51:48.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:48.154+0000 7f81e4c00640 1 --2- 172.21.15.57:0/3127240040 >> v2:172.21.15.57:3300/0 conn(0x7f81e00ce0c0 0x7f81e00ae530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:48.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:48.154+0000 7f81e4c00640 1 -- 172.21.15.57:0/3127240040 >> v1:172.21.15.118:6789/0 conn(0x7f81e015e860 legacy=0x7f81e015ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:48.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:48.154+0000 7f81e4c00640 1 -- 172.21.15.57:0/3127240040 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81e00ada50 con 0x7f81e00cc730 2024-03-27T19:51:48.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:48.151+0000 7f81dfe00640 1 -- 172.21.15.57:0/3127240040 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4193304697 0 0) 0x7f81e015f550 con 0x7f81e015e860 2024-03-27T19:51:48.158 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:48.157+0000 7f81e4c00640 1 --2- 172.21.15.57:0/3127240040 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f81e00cc730 0x7f81e00ccbe0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f81e00cc6e0 tx=0x7f81cc02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de5eaa14b8695da8 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:51:48.166 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:48.158+0000 7f81dfe00640 1 -- 172.21.15.57:0/3127240040 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81cc035020 con 0x7f81e00cc730 2024-03-27T19:51:48.166 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:48.165+0000 7f81dfe00640 1 -- 172.21.15.57:0/3127240040 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81cc031830 con 0x7f81e00cc730 2024-03-27T19:51:48.166 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:48.165+0000 7f81dfe00640 1 -- 172.21.15.57:0/3127240040 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81cc031c00 con 0x7f81e00cc730 2024-03-27T19:51:48.168 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:48.167+0000 7f81e8000640 1 -- 172.21.15.57:0/3127240040 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f81e00cc730 msgr2=0x7f81e00ccbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:48.168 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:48.167+0000 7f81e8000640 1 --2- 172.21.15.57:0/3127240040 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f81e00cc730 0x7f81e00ccbe0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f81e00cc6e0 tx=0x7f81cc02b8d0 comp rx=0 tx=0).stop 2024-03-27T19:51:48.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:48.169+0000 7f81e8000640 1 -- 172.21.15.57:0/3127240040 shutdown_connections 2024-03-27T19:51:48.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:48.169+0000 7f81e8000640 1 --2- 172.21.15.57:0/3127240040 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f81e00cc730 0x7f81e00ccbe0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:48.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:48.169+0000 7f81e8000640 1 --2- 172.21.15.57:0/3127240040 >> v2:172.21.15.57:3300/0 conn(0x7f81e00ce0c0 0x7f81e00ae530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:48.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:48.169+0000 7f81e8000640 1 -- 172.21.15.57:0/3127240040 >> 172.21.15.57:0/3127240040 conn(0x7f81e00b1870 msgr2=0x7f81e00b1c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T19:51:48.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:48.169+0000 7f81e8000640 1 -- 172.21.15.57:0/3127240040 shutdown_connections 2024-03-27T19:51:48.175 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:48.169+0000 7f81e8000640 1 -- 172.21.15.57:0/3127240040 wait complete. 2024-03-27T19:51:48.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:48.172+0000 7f81e8000640 1 Processor -- start 2024-03-27T19:51:48.177 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:48.176+0000 7f81e8000640 1 -- start start 2024-03-27T19:51:48.182 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:48.180+0000 7f81e8000640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f81e00cc730 0x7f81e0200ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:48.182 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:48.181+0000 7f81e8000640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f81e00ce0c0 0x7f81e0204d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:48.182 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:48.181+0000 7f81e8000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f81e015e860 0x7f81e01fabc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:48.182 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:48.181+0000 7f81e8000640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f81e006cef0 con 0x7f81e00cc730 2024-03-27T19:51:48.182 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:48.181+0000 7f81e8000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f81e00ae0a0 con 0x7f81e015e860 2024-03-27T19:51:48.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:48.181+0000 7f81e8000640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f81e006d070 con 0x7f81e00ce0c0 2024-03-27T19:51:48.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:48.181+0000 7f81e5600640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f81e00cc730 0x7f81e0200ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:48.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:48.181+0000 7f81e5600640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f81e00cc730 0x7f81e0200ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38032/0 (socket says 172.21.15.57:38032) 2024-03-27T19:51:48.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:48.181+0000 7f81e5600640 1 -- 172.21.15.57:0/3064317631 learned_addr learned my addr 172.21.15.57:0/3064317631 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T19:51:48.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:48.182+0000 7f81e4c00640 1 --2- 172.21.15.57:0/3064317631 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f81e00ce0c0 0x7f81e0204d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:48.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:48.182+0000 7f81e6000640 1 --2- 172.21.15.57:0/3064317631 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f81e015e860 0x7f81e01fabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:48.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:48.182+0000 7f81e5600640 1 -- 172.21.15.57:0/3064317631 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f81e00ce0c0 msgr2=0x7f81e0204d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:48.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:48.182+0000 7f81e5600640 1 --2- 172.21.15.57:0/3064317631 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f81e00ce0c0 0x7f81e0204d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:48.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:48.182+0000 7f81e5600640 1 -- 172.21.15.57:0/3064317631 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f81e015e860 msgr2=0x7f81e01fabc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:48.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:48.182+0000 7f81e5600640 1 --2- 172.21.15.57:0/3064317631 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f81e015e860 0x7f81e01fabc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:48.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:48.182+0000 7f81e5600640 1 -- 172.21.15.57:0/3064317631 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81e0201c70 con 0x7f81e00cc730 2024-03-27T19:51:48.184 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:48.183+0000 7f81e5600640 1 --2- 172.21.15.57:0/3064317631 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f81e00cc730 0x7f81e0200ca0 secure :-1 s=READY pgs=2216 cs=0 l=1 rev1=1 crypto rx=0x7f81d400e9b0 tx=0x7f81d400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:51:48.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:48.183+0000 7f81dd600640 1 -- 172.21.15.57:0/3064317631 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81d4017070 con 0x7f81e00cc730 2024-03-27T19:51:48.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:48.183+0000 7f81dd600640 1 -- 172.21.15.57:0/3064317631 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81d400c9a0 con 0x7f81e00cc730 2024-03-27T19:51:48.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:48.183+0000 7f81dd600640 1 -- 172.21.15.57:0/3064317631 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81d400cd90 con 0x7f81e00cc730 2024-03-27T19:51:48.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:48.183+0000 7f81e8000640 1 -- 172.21.15.57:0/3064317631 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81e02013d0 con 0x7f81e00cc730 2024-03-27T19:51:48.185 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:48.184+0000 7f81e8000640 1 -- 172.21.15.57:0/3064317631 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81e0201990 con 0x7f81e00cc730 2024-03-27T19:51:48.189 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:48.187+0000 7f81e8000640 1 -- 172.21.15.57:0/3064317631 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81bc005290 con 0x7f81e00cc730 2024-03-27T19:51:48.195 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:48.194+0000 7f81dd600640 1 -- 172.21.15.57:0/3064317631 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f81d401a070 con 0x7f81e00cc730 2024-03-27T19:51:48.200 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:48.199+0000 7f81dd600640 1 --2- 172.21.15.57:0/3064317631 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f81c006c580 0x7f81c006ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:48.200 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:48.199+0000 7f81dd600640 1 -- 172.21.15.57:0/3064317631 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5778+0+0 (secure 0 0 0) 0x7f81d408b5d0 con 0x7f81e00cc730 2024-03-27T19:51:48.202 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:48.200+0000 7f81e4c00640 1 --2- 172.21.15.57:0/3064317631 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f81c006c580 0x7f81c006ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:48.203 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:48.202+0000 7f81e4c00640 1 --2- 172.21.15.57:0/3064317631 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f81c006c580 0x7f81c006ea40 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f81cc036000 tx=0x7f81cc008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:51:48.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:48.205+0000 7f81dd600640 1 -- 172.21.15.57:0/3064317631 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f81d4059d10 con 0x7f81e00cc730 2024-03-27T19:51:48.525 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:48.524+0000 7f81e8000640 1 -- 172.21.15.57:0/3064317631 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f81bc005580 con 0x7f81e00cc730 2024-03-27T19:51:48.902 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:48.901+0000 7f81dd600640 1 -- 172.21.15.57:0/3064317631 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v45) ==== 169+0+0 (secure 0 0 0) 0x7f81d4059610 con 0x7f81e00cc730 2024-03-27T19:51:48.903 INFO:teuthology.orchestra.run.smithi057.stderr:pool 'cephfs_data' removed 2024-03-27T19:51:48.906 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:48.903+0000 7f81e8000640 1 -- 172.21.15.57:0/3064317631 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f81c006c580 msgr2=0x7f81c006ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:48.906 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:48.903+0000 7f81e8000640 1 --2- 172.21.15.57:0/3064317631 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f81c006c580 0x7f81c006ea40 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f81cc036000 tx=0x7f81cc008030 comp rx=0 tx=0).stop 2024-03-27T19:51:48.906 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:48.904+0000 7f81e8000640 1 -- 172.21.15.57:0/3064317631 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f81e00cc730 msgr2=0x7f81e0200ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:48.906 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:48.904+0000 7f81e8000640 1 --2- 172.21.15.57:0/3064317631 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f81e00cc730 0x7f81e0200ca0 secure :-1 s=READY pgs=2216 cs=0 l=1 rev1=1 crypto rx=0x7f81d400e9b0 tx=0x7f81d400ee70 comp rx=0 tx=0).stop 2024-03-27T19:51:48.907 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:48.904+0000 7f81e8000640 1 -- 172.21.15.57:0/3064317631 shutdown_connections 2024-03-27T19:51:48.907 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:48.904+0000 7f81e8000640 1 --2- 172.21.15.57:0/3064317631 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f81c006c580 0x7f81c006ea40 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:48.907 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:48.904+0000 7f81e8000640 1 --2- 172.21.15.57:0/3064317631 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f81e015e860 0x7f81e01fabc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:48.907 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:48.904+0000 7f81e8000640 1 --2- 172.21.15.57:0/3064317631 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f81e00ce0c0 0x7f81e0204d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:48.907 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:48.904+0000 7f81e8000640 1 --2- 172.21.15.57:0/3064317631 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f81e00cc730 0x7f81e0200ca0 unknown :-1 s=CLOSED pgs=2216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:48.907 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:48.904+0000 7f81e8000640 1 -- 172.21.15.57:0/3064317631 >> 172.21.15.57:0/3064317631 conn(0x7f81e00b1870 msgr2=0x7f81e0161430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T19:51:48.907 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:48.904+0000 7f81e8000640 1 -- 172.21.15.57:0/3064317631 shutdown_connections 2024-03-27T19:51:48.907 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:48.904+0000 7f81e8000640 1 -- 172.21.15.57:0/3064317631 wait complete. 2024-03-27T19:51:48.935 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-03-27T19:51:49.228 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.226+0000 7f417fa00640 1 Processor -- start 2024-03-27T19:51:49.228 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.227+0000 7f417fa00640 1 -- start start 2024-03-27T19:51:49.230 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.229+0000 7f417fa00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4178072680 0x7f41780711b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:49.230 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.229+0000 7f417fa00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f417815b3b0 0x7f41780716f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:49.230 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.229+0000 7f417fa00640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41780ae520 con 0x7f417815afd0 2024-03-27T19:51:49.230 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.229+0000 7f417fa00640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f4178071c30 con 0x7f4178072680 2024-03-27T19:51:49.230 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.229+0000 7f417fa00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f41780ae800 con 0x7f417815b3b0 2024-03-27T19:51:49.231 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.230+0000 7f4177e00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4178072680 0x7f41780711b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:49.231 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.230+0000 7f4177e00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f4178072680 0x7f41780711b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38044/0 (socket says 172.21.15.57:38044) 2024-03-27T19:51:49.231 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.230+0000 7f4177e00640 1 -- 172.21.15.57:0/1357540106 learned_addr learned my addr 172.21.15.57:0/1357540106 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T19:51:49.232 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.230+0000 7f417da00640 1 --2- 172.21.15.57:0/1357540106 >> v2:172.21.15.118:3300/0 conn(0x7f417815b3b0 0x7f41780716f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:49.232 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.230+0000 7f4177e00640 1 -- 172.21.15.57:0/1357540106 >> v2:172.21.15.118:3300/0 conn(0x7f417815b3b0 msgr2=0x7f41780716f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T19:51:49.232 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.231+0000 7f4177e00640 1 --2- 172.21.15.57:0/1357540106 >> v2:172.21.15.118:3300/0 conn(0x7f417815b3b0 0x7f41780716f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:49.232 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.231+0000 7f4177e00640 1 -- 172.21.15.57:0/1357540106 >> v1:172.21.15.57:6789/0 conn(0x7f417815afd0 legacy=0x7f4178071f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T19:51:49.233 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.231+0000 7f4177e00640 1 -- 172.21.15.57:0/1357540106 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41780aeae0 con 0x7f4178072680 2024-03-27T19:51:49.234 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.233+0000 7f4177e00640 1 --2- 172.21.15.57:0/1357540106 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4178072680 0x7f41780711b0 secure :-1 s=READY pgs=2218 cs=0 l=1 rev1=1 crypto rx=0x7f41780ad7c0 tx=0x7f416802ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59aa0e3af071b0a0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:51:49.235 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.233+0000 7f4177400640 1 -- 172.21.15.57:0/1357540106 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f416802f850 con 0x7f4178072680 2024-03-27T19:51:49.235 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.234+0000 7f4177400640 1 -- 172.21.15.57:0/1357540106 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f416802f9f0 con 0x7f4178072680 2024-03-27T19:51:49.236 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.234+0000 7f4177400640 1 -- 172.21.15.57:0/1357540106 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f416802fdc0 con 0x7f4178072680 2024-03-27T19:51:49.237 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.236+0000 7f417fa00640 1 -- 172.21.15.57:0/1357540106 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4178072680 msgr2=0x7f41780711b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:49.237 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.236+0000 7f417fa00640 1 --2- 172.21.15.57:0/1357540106 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4178072680 0x7f41780711b0 secure :-1 s=READY pgs=2218 cs=0 l=1 rev1=1 crypto rx=0x7f41780ad7c0 tx=0x7f416802ba30 comp rx=0 tx=0).stop 2024-03-27T19:51:49.238 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.237+0000 7f417fa00640 1 -- 172.21.15.57:0/1357540106 shutdown_connections 2024-03-27T19:51:49.238 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.237+0000 7f417fa00640 1 --2- 172.21.15.57:0/1357540106 >> v2:172.21.15.118:3300/0 conn(0x7f417815b3b0 0x7f41780716f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:49.238 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.237+0000 7f417fa00640 1 --2- 172.21.15.57:0/1357540106 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f4178072680 0x7f41780711b0 unknown :-1 s=CLOSED pgs=2218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:49.239 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.237+0000 7f417fa00640 1 -- 172.21.15.57:0/1357540106 >> 172.21.15.57:0/1357540106 conn(0x7f41780b18a0 msgr2=0x7f41780b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T19:51:49.239 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.237+0000 7f417fa00640 1 -- 172.21.15.57:0/1357540106 shutdown_connections 2024-03-27T19:51:49.239 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.237+0000 7f417fa00640 1 -- 172.21.15.57:0/1357540106 wait complete. 2024-03-27T19:51:49.240 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.239+0000 7f417fa00640 1 Processor -- start 2024-03-27T19:51:49.241 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.240+0000 7f417fa00640 1 -- start start 2024-03-27T19:51:49.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.241+0000 7f417fa00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4178072680 0x7f417814d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:49.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.241+0000 7f417fa00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f417815afd0 0x7f4178200460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:49.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.241+0000 7f417fa00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f417815b3b0 0x7f417814b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:49.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.241+0000 7f417fa00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f417806d940 con 0x7f417815b3b0 2024-03-27T19:51:49.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.241+0000 7f417fa00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f417806d7c0 con 0x7f417815afd0 2024-03-27T19:51:49.243 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.241+0000 7f417fa00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f417806dac0 con 0x7f4178072680 2024-03-27T19:51:49.244 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.242+0000 7f4177e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f417815afd0 0x7f4178200460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:49.244 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.242+0000 7f417da00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f417815b3b0 0x7f417814b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:49.244 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.242+0000 7f4177e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f417815afd0 0x7f4178200460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.57:59518/0 (socket says 172.21.15.57:59518) 2024-03-27T19:51:49.244 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.242+0000 7f4177e00640 1 -- 172.21.15.57:0/3386310219 learned_addr learned my addr 172.21.15.57:0/3386310219 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T19:51:49.244 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.242+0000 7f417d000640 1 --2- 172.21.15.57:0/3386310219 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4178072680 0x7f417814d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:49.245 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.243+0000 7f417da00640 1 -- 172.21.15.57:0/3386310219 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4178072680 msgr2=0x7f417814d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:49.245 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.243+0000 7f417da00640 1 --2- 172.21.15.57:0/3386310219 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4178072680 0x7f417814d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:49.245 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.243+0000 7f417da00640 1 -- 172.21.15.57:0/3386310219 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f417815afd0 msgr2=0x7f4178200460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:49.245 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.243+0000 7f417da00640 1 --2- 172.21.15.57:0/3386310219 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f417815afd0 0x7f4178200460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:49.245 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.243+0000 7f417da00640 1 -- 172.21.15.57:0/3386310219 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f417814c050 con 0x7f417815b3b0 2024-03-27T19:51:49.245 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.243+0000 7f417da00640 1 --2- 172.21.15.57:0/3386310219 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f417815b3b0 0x7f417814b4e0 secure :-1 s=READY pgs=2219 cs=0 l=1 rev1=1 crypto rx=0x7f4170007d20 tx=0x7f417000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:51:49.246 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.244+0000 7f4174c00640 1 -- 172.21.15.57:0/3386310219 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f417000edd0 con 0x7f417815b3b0 2024-03-27T19:51:49.246 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.244+0000 7f4174c00640 1 -- 172.21.15.57:0/3386310219 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4170003990 con 0x7f417815b3b0 2024-03-27T19:51:49.246 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.244+0000 7f4174c00640 1 -- 172.21.15.57:0/3386310219 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4170003d80 con 0x7f417815b3b0 2024-03-27T19:51:49.246 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.245+0000 7f417fa00640 1 -- 172.21.15.57:0/3386310219 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f417814c330 con 0x7f417815b3b0 2024-03-27T19:51:49.247 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.246+0000 7f417fa00640 1 -- 172.21.15.57:0/3386310219 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f417814c8f0 con 0x7f417815b3b0 2024-03-27T19:51:49.250 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.249+0000 7f417fa00640 1 -- 172.21.15.57:0/3386310219 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41780757d0 con 0x7f417815b3b0 2024-03-27T19:51:49.251 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.249+0000 7f4174c00640 1 -- 172.21.15.57:0/3386310219 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f417001b020 con 0x7f417815b3b0 2024-03-27T19:51:49.252 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.251+0000 7f4174c00640 1 --2- 172.21.15.57:0/3386310219 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f415c06c600 0x7f415c06eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:49.252 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.251+0000 7f4174c00640 1 -- 172.21.15.57:0/3386310219 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5335+0+0 (secure 0 0 0) 0x7f417008b5d0 con 0x7f417815b3b0 2024-03-27T19:51:49.253 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.252+0000 7f417d000640 1 --2- 172.21.15.57:0/3386310219 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f415c06c600 0x7f415c06eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:49.255 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.254+0000 7f417d000640 1 --2- 172.21.15.57:0/3386310219 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f415c06c600 0x7f415c06eac0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f416c000f60 tx=0x7f416c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:51:49.260 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.259+0000 7f4174c00640 1 -- 172.21.15.57:0/3386310219 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f4170059780 con 0x7f417815b3b0 2024-03-27T19:51:49.580 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.579+0000 7f417fa00640 1 -- 172.21.15.57:0/3386310219 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f4178068540 con 0x7f417815b3b0 2024-03-27T19:51:49.587 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.586+0000 7f4174c00640 1 -- 172.21.15.57:0/3386310219 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7f417005da80 con 0x7f417815b3b0 2024-03-27T19:51:49.591 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.589+0000 7f417fa00640 1 -- 172.21.15.57:0/3386310219 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f415c06c600 msgr2=0x7f415c06eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:49.591 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.590+0000 7f417fa00640 1 --2- 172.21.15.57:0/3386310219 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f415c06c600 0x7f415c06eac0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f416c000f60 tx=0x7f416c009040 comp rx=0 tx=0).stop 2024-03-27T19:51:49.591 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.590+0000 7f417fa00640 1 -- 172.21.15.57:0/3386310219 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f417815b3b0 msgr2=0x7f417814b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:49.591 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.590+0000 7f417fa00640 1 --2- 172.21.15.57:0/3386310219 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f417815b3b0 0x7f417814b4e0 secure :-1 s=READY pgs=2219 cs=0 l=1 rev1=1 crypto rx=0x7f4170007d20 tx=0x7f417000e4b0 comp rx=0 tx=0).stop 2024-03-27T19:51:49.591 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.590+0000 7f417fa00640 1 -- 172.21.15.57:0/3386310219 shutdown_connections 2024-03-27T19:51:49.591 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.590+0000 7f417fa00640 1 --2- 172.21.15.57:0/3386310219 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f417815b3b0 0x7f417814b4e0 unknown :-1 s=CLOSED pgs=2219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:49.591 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.590+0000 7f417fa00640 1 --2- 172.21.15.57:0/3386310219 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f415c06c600 0x7f415c06eac0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:49.591 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.590+0000 7f417fa00640 1 --2- 172.21.15.57:0/3386310219 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f417815afd0 0x7f4178200460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:49.591 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.590+0000 7f417fa00640 1 --2- 172.21.15.57:0/3386310219 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f4178072680 0x7f417814d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:49.591 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.590+0000 7f417fa00640 1 -- 172.21.15.57:0/3386310219 >> 172.21.15.57:0/3386310219 conn(0x7f41780b18a0 msgr2=0x7f41780b0bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T19:51:49.592 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.591+0000 7f417fa00640 1 -- 172.21.15.57:0/3386310219 shutdown_connections 2024-03-27T19:51:49.592 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.591+0000 7f417fa00640 1 -- 172.21.15.57:0/3386310219 wait complete. 2024-03-27T19:51:49.620 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2024-03-27T19:51:49.914 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.912+0000 7f09da200640 1 Processor -- start 2024-03-27T19:51:49.916 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.913+0000 7f09da200640 1 -- start start 2024-03-27T19:51:49.917 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.915+0000 7f09da200640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f09d40b3980 0x7f09d415de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:49.918 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.916+0000 7f09da200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f09d4153fa0 0x7f09d4154430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:49.918 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.917+0000 7f09da200640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09d406dd90 con 0x7f09d415ac50 2024-03-27T19:51:49.918 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.917+0000 7f09da200640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f09d415b7e0 con 0x7f09d40b3980 2024-03-27T19:51:49.918 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.917+0000 7f09da200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f09d406cf30 con 0x7f09d4153fa0 2024-03-27T19:51:49.920 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.918+0000 7f09d3400640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f09d40b3980 0x7f09d415de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:49.920 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.918+0000 7f09d3400640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f09d40b3980 0x7f09d415de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:38074/0 (socket says 172.21.15.57:38074) 2024-03-27T19:51:49.920 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.918+0000 7f09d3400640 1 -- 172.21.15.57:0/2318070654 learned_addr learned my addr 172.21.15.57:0/2318070654 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T19:51:49.921 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.919+0000 7f09d3400640 1 -- 172.21.15.57:0/2318070654 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f09d4153fa0 msgr2=0x7f09d4154430 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-27T19:51:49.921 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.919+0000 7f09d3400640 1 --2- 172.21.15.57:0/2318070654 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f09d4153fa0 0x7f09d4154430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:49.921 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.919+0000 7f09d3400640 1 -- 172.21.15.57:0/2318070654 >> v1:172.21.15.118:6789/0 conn(0x7f09d415ac50 legacy=0x7f09d415b0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-27T19:51:49.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.919+0000 7f09d3400640 1 -- 172.21.15.57:0/2318070654 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09d406d210 con 0x7f09d40b3980 2024-03-27T19:51:49.922 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.921+0000 7f09d3400640 1 --2- 172.21.15.57:0/2318070654 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09d40b3980 0x7f09d415de60 secure :-1 s=READY pgs=2220 cs=0 l=1 rev1=1 crypto rx=0x7f09cc00d150 tx=0x7f09cc02e0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65e4242932776e8 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:51:49.924 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.922+0000 7f09d2000640 1 -- 172.21.15.57:0/2318070654 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09cc034070 con 0x7f09d40b3980 2024-03-27T19:51:49.924 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.923+0000 7f09d2000640 1 -- 172.21.15.57:0/2318070654 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09cc038400 con 0x7f09d40b3980 2024-03-27T19:51:49.924 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.923+0000 7f09d2000640 1 -- 172.21.15.57:0/2318070654 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09cc0387d0 con 0x7f09d40b3980 2024-03-27T19:51:49.926 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.924+0000 7f09da200640 1 -- 172.21.15.57:0/2318070654 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09d40b3980 msgr2=0x7f09d415de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:49.926 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.924+0000 7f09da200640 1 --2- 172.21.15.57:0/2318070654 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09d40b3980 0x7f09d415de60 secure :-1 s=READY pgs=2220 cs=0 l=1 rev1=1 crypto rx=0x7f09cc00d150 tx=0x7f09cc02e0f0 comp rx=0 tx=0).stop 2024-03-27T19:51:49.926 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.924+0000 7f09da200640 1 -- 172.21.15.57:0/2318070654 shutdown_connections 2024-03-27T19:51:49.926 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.924+0000 7f09da200640 1 --2- 172.21.15.57:0/2318070654 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f09d4153fa0 0x7f09d4154430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:49.926 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.924+0000 7f09da200640 1 --2- 172.21.15.57:0/2318070654 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09d40b3980 0x7f09d415de60 unknown :-1 s=CLOSED pgs=2220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:49.926 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.924+0000 7f09da200640 1 -- 172.21.15.57:0/2318070654 >> 172.21.15.57:0/2318070654 conn(0x7f09d406b720 msgr2=0x7f09d406bb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T19:51:49.927 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.925+0000 7f09da200640 1 -- 172.21.15.57:0/2318070654 shutdown_connections 2024-03-27T19:51:49.927 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.925+0000 7f09da200640 1 -- 172.21.15.57:0/2318070654 wait complete. 2024-03-27T19:51:49.928 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.927+0000 7f09da200640 1 Processor -- start 2024-03-27T19:51:49.929 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.928+0000 7f09da200640 1 -- start start 2024-03-27T19:51:49.931 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.929+0000 7f09da200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09d4153fa0 0x7f09d415bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:49.931 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.929+0000 7f09da200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f09d415ac50 0x7f09d41fc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:49.931 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.929+0000 7f09da200640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09d40cbf20 0x7f09d40ccb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:49.931 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.929+0000 7f09da200640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f09d406dab0 con 0x7f09d40cbf20 2024-03-27T19:51:49.932 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.929+0000 7f09da200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f09d406d7d0 con 0x7f09d4153fa0 2024-03-27T19:51:49.932 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.929+0000 7f09da200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f09d415e3a0 con 0x7f09d415ac50 2024-03-27T19:51:49.932 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.930+0000 7f09d2a00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f09d415ac50 0x7f09d41fc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:49.932 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.930+0000 7f09d3e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09d40cbf20 0x7f09d40ccb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:49.932 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.930+0000 7f09d2a00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f09d415ac50 0x7f09d41fc6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.57:33478/0 (socket says 172.21.15.57:33478) 2024-03-27T19:51:49.932 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.930+0000 7f09d2a00640 1 -- 172.21.15.57:0/288533786 learned_addr learned my addr 172.21.15.57:0/288533786 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T19:51:49.932 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.930+0000 7f09d3400640 1 --2- 172.21.15.57:0/288533786 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09d4153fa0 0x7f09d415bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:49.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.931+0000 7f09d2a00640 1 -- 172.21.15.57:0/288533786 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09d4153fa0 msgr2=0x7f09d415bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:49.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.931+0000 7f09d2a00640 1 --2- 172.21.15.57:0/288533786 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09d4153fa0 0x7f09d415bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:49.933 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.931+0000 7f09d2a00640 1 -- 172.21.15.57:0/288533786 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09d40cbf20 msgr2=0x7f09d40ccb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:49.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.931+0000 7f09d2a00640 1 --2- 172.21.15.57:0/288533786 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09d40cbf20 0x7f09d40ccb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:49.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.931+0000 7f09d2a00640 1 -- 172.21.15.57:0/288533786 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09d415c2e0 con 0x7f09d415ac50 2024-03-27T19:51:49.934 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.931+0000 7f09d2a00640 1 --2- 172.21.15.57:0/288533786 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f09d415ac50 0x7f09d41fc6b0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f09c000b3e0 tx=0x7f09c000b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:51:49.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.933+0000 7f09cb400640 1 -- 172.21.15.57:0/288533786 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09c0015020 con 0x7f09d415ac50 2024-03-27T19:51:49.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.933+0000 7f09da200640 1 -- 172.21.15.57:0/288533786 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09d41fcbf0 con 0x7f09d415ac50 2024-03-27T19:51:49.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.933+0000 7f09da200640 1 -- 172.21.15.57:0/288533786 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f09d41521c0 con 0x7f09d415ac50 2024-03-27T19:51:49.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.933+0000 7f09cb400640 1 -- 172.21.15.57:0/288533786 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09c0011850 con 0x7f09d415ac50 2024-03-27T19:51:49.935 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.933+0000 7f09cb400640 1 -- 172.21.15.57:0/288533786 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09c0011c40 con 0x7f09d415ac50 2024-03-27T19:51:49.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.936+0000 7f09da200640 1 -- 172.21.15.57:0/288533786 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09ac005290 con 0x7f09d415ac50 2024-03-27T19:51:49.939 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.938+0000 7f09cb400640 1 -- 172.21.15.57:0/288533786 <== mon.2 v2:172.21.15.118:3301/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f09c0018020 con 0x7f09d415ac50 2024-03-27T19:51:49.941 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.939+0000 7f09cb400640 1 --2- 172.21.15.57:0/288533786 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f09b406c530 0x7f09b406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:49.941 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.939+0000 7f09cb400640 1 -- 172.21.15.57:0/288533786 <== mon.2 v2:172.21.15.118:3301/0 5 ==== osd_map(45..45 src has 1..45) ==== 5335+0+0 (secure 0 0 0) 0x7f09c008b360 con 0x7f09d415ac50 2024-03-27T19:51:49.942 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.940+0000 7f09d3400640 1 --2- 172.21.15.57:0/288533786 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f09b406c530 0x7f09b406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:49.942 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.941+0000 7f09d3400640 1 --2- 172.21.15.57:0/288533786 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f09b406c530 0x7f09b406e9f0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f09cc039000 tx=0x7f09cc00a040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:51:49.951 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:49.948+0000 7f09cb400640 1 -- 172.21.15.57:0/288533786 <== mon.2 v2:172.21.15.118:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f09c001f020 con 0x7f09d415ac50 2024-03-27T19:51:50.496 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:50.495+0000 7f09da200640 1 -- 172.21.15.57:0/288533786 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) -- 0x7f09ac005580 con 0x7f09d415ac50 2024-03-27T19:51:50.932 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:50.927+0000 7f09cb400640 1 -- 172.21.15.57:0/288533786 <== mon.2 v2:172.21.15.118:3301/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v17871) ==== 144+0+0 (secure 0 0 0) 0x7f09c0089e20 con 0x7f09d415ac50 2024-03-27T19:51:50.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:50.934+0000 7f09da200640 1 -- 172.21.15.57:0/288533786 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f09b406c530 msgr2=0x7f09b406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:50.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:50.934+0000 7f09da200640 1 --2- 172.21.15.57:0/288533786 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f09b406c530 0x7f09b406e9f0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f09cc039000 tx=0x7f09cc00a040 comp rx=0 tx=0).stop 2024-03-27T19:51:50.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:50.934+0000 7f09da200640 1 -- 172.21.15.57:0/288533786 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f09d415ac50 msgr2=0x7f09d41fc6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:50.937 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:50.934+0000 7f09da200640 1 --2- 172.21.15.57:0/288533786 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f09d415ac50 0x7f09d41fc6b0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f09c000b3e0 tx=0x7f09c000b8a0 comp rx=0 tx=0).stop 2024-03-27T19:51:50.938 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:50.936+0000 7f09da200640 1 -- 172.21.15.57:0/288533786 shutdown_connections 2024-03-27T19:51:50.938 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:50.937+0000 7f09da200640 1 --2- 172.21.15.57:0/288533786 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f09d40cbf20 0x7f09d40ccb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:50.938 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:50.937+0000 7f09da200640 1 --2- 172.21.15.57:0/288533786 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f09d415ac50 0x7f09d41fc6b0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:50.938 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:50.937+0000 7f09da200640 1 --2- 172.21.15.57:0/288533786 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f09b406c530 0x7f09b406e9f0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:50.938 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:50.937+0000 7f09da200640 1 --2- 172.21.15.57:0/288533786 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f09d4153fa0 0x7f09d415bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:50.938 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:50.937+0000 7f09da200640 1 -- 172.21.15.57:0/288533786 >> 172.21.15.57:0/288533786 conn(0x7f09d406b720 msgr2=0x7f09d406bb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T19:51:50.939 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:50.938+0000 7f09da200640 1 -- 172.21.15.57:0/288533786 shutdown_connections 2024-03-27T19:51:50.939 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:50.938+0000 7f09da200640 1 -- 172.21.15.57:0/288533786 wait complete. 2024-03-27T19:51:51.004 INFO:tasks.cephfs_test_runner:test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) ... FAIL 2024-03-27T19:51:51.005 INFO:tasks.cephfs_test_runner: 2024-03-27T19:51:51.005 INFO:tasks.cephfs_test_runner:====================================================================== 2024-03-27T19:51:51.005 INFO:tasks.cephfs_test_runner:FAIL: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2024-03-27T19:51:51.005 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-03-27T19:51:51.005 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-03-27T19:51:51.005 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_155268c4e432a12433aa833f174f9fe3b1016ae0/qa/tasks/cephfs/tests_from_xfstests_dev.py", line 12, in test_generic 2024-03-27T19:51:51.005 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_155268c4e432a12433aa833f174f9fe3b1016ae0/qa/tasks/cephfs/xfstests_dev.py", line 407, in run_generic_tests 2024-03-27T19:51:51.005 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_155268c4e432a12433aa833f174f9fe3b1016ae0/qa/tasks/cephfs/xfstests_dev.py", line 399, in run_testdir 2024-03-27T19:51:51.005 INFO:tasks.cephfs_test_runner:AssertionError: 15 != 0 2024-03-27T19:51:51.005 INFO:tasks.cephfs_test_runner: 2024-03-27T19:51:51.005 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-03-27T19:51:51.006 INFO:tasks.cephfs_test_runner:Ran 1 test in 35473.775s 2024-03-27T19:51:51.006 INFO:tasks.cephfs_test_runner: 2024-03-27T19:51:51.006 INFO:tasks.cephfs_test_runner:FAILED (failures=1) 2024-03-27T19:51:51.006 INFO:tasks.cephfs_test_runner: 2024-03-27T19:51:51.006 INFO:tasks.cephfs_test_runner:====================================================================== 2024-03-27T19:51:51.006 INFO:tasks.cephfs_test_runner:FAIL: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2024-03-27T19:51:51.006 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-03-27T19:51:51.006 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-03-27T19:51:51.006 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_155268c4e432a12433aa833f174f9fe3b1016ae0/qa/tasks/cephfs/tests_from_xfstests_dev.py", line 12, in test_generic 2024-03-27T19:51:51.006 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_155268c4e432a12433aa833f174f9fe3b1016ae0/qa/tasks/cephfs/xfstests_dev.py", line 407, in run_generic_tests 2024-03-27T19:51:51.006 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_155268c4e432a12433aa833f174f9fe3b1016ae0/qa/tasks/cephfs/xfstests_dev.py", line 399, in run_testdir 2024-03-27T19:51:51.006 INFO:tasks.cephfs_test_runner:AssertionError: 15 != 0 2024-03-27T19:51:51.006 INFO:tasks.cephfs_test_runner: 2024-03-27T19:51:51.007 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_155268c4e432a12433aa833f174f9fe3b1016ae0/qa/tasks/cephfs_test_runner.py", line 211, in task RuntimeError: Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2024-03-27T19:51:51.256 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=67784eaf8b9e4c4c8bfb0e689a0dbc83 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_155268c4e432a12433aa833f174f9fe3b1016ae0/qa/tasks/cephfs_test_runner.py", line 211, in task RuntimeError: Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2024-03-27T19:51:51.258 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-03-27T19:51:51.267 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-03-27T19:51:51.282 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-03-27T19:51:51.282 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-03-27T19:51:51.282 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-27T19:51:51.363 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054203,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499604k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249800k,nr_inodes=812450,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499604k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-03-27T19:51:51.363 DEBUG:teuthology.orchestra.run.smithi057:> set -ex 2024-03-27T19:51:51.363 DEBUG:teuthology.orchestra.run.smithi057:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-27T19:51:51.448 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054203,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499604k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249800k,nr_inodes=812450,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499604k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-03-27T19:51:51.448 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-03-27T19:51:51.448 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-27T19:51:51.517 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053413,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498340k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249168k,nr_inodes=812292,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498340k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-03-27T19:51:51.517 DEBUG:teuthology.orchestra.run.smithi118:> set -ex 2024-03-27T19:51:51.517 DEBUG:teuthology.orchestra.run.smithi118:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-27T19:51:51.593 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053413,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498340k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249168k,nr_inodes=812292,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498340k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-03-27T19:51:51.594 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T19:51:51.594 DEBUG:teuthology.orchestra.run.smithi057:> ip netns list 2024-03-27T19:51:51.716 INFO:teuthology.orchestra.run.smithi057.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-03-27T19:51:51.717 INFO:teuthology.orchestra.run.smithi057.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-03-27T19:51:51.718 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T19:51:51.718 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-27T19:51:51.873 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T19:51:51.874 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-27T19:51:52.006 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T19:51:52.007 DEBUG:teuthology.orchestra.run.smithi057:> sudo ip link delete ceph-brx 2024-03-27T19:51:52.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T19:51:52.192 DEBUG:teuthology.orchestra.run.smithi118:> ip netns list 2024-03-27T19:51:52.594 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-03-27T19:51:52.594 INFO:teuthology.orchestra.run.smithi118.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-03-27T19:51:52.596 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T19:51:52.596 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-27T19:51:52.674 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T19:51:52.675 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-03-27T19:51:52.748 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T19:51:52.749 DEBUG:teuthology.orchestra.run.smithi118:> sudo ip link delete ceph-brx 2024-03-27T19:51:52.862 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-03-27T19:51:52.878 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-03-27T19:51:52.878 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-27T19:51:53.151 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.150+0000 7f757e200640 1 Processor -- start 2024-03-27T19:51:53.152 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.150+0000 7f757e200640 1 -- start start 2024-03-27T19:51:53.152 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.151+0000 7f757e200640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f7578163540 0x7f75780b33c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:53.153 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.151+0000 7f757e200640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7578071970 con 0x7f75780714e0 2024-03-27T19:51:53.153 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.151+0000 7f757e200640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7578160440 con 0x7f757806cd90 2024-03-27T19:51:53.153 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.151+0000 7f757e200640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f7578071be0 con 0x7f7578163540 2024-03-27T19:51:53.153 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.152+0000 7f757ce00640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f757806cd90 0x7f757806d170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.57:49726/0 (socket says 172.21.15.57:49726) 2024-03-27T19:51:53.154 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.152+0000 7f757ce00640 1 -- 172.21.15.57:0/1955465959 learned_addr learned my addr 172.21.15.57:0/1955465959 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T19:51:53.154 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.152+0000 7f757d800640 1 --2- 172.21.15.57:0/1955465959 >> v2:172.21.15.118:3300/0 conn(0x7f7578163540 0x7f75780b33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:53.154 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.153+0000 7f7577400640 1 -- 172.21.15.57:0/1955465959 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2966975769 0 0) 0x7f7578071970 con 0x7f75780714e0 2024-03-27T19:51:53.154 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.153+0000 7f7577400640 1 -- 172.21.15.57:0/1955465959 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7560003520 con 0x7f75780714e0 2024-03-27T19:51:53.155 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.153+0000 7f757d800640 1 -- 172.21.15.57:0/1955465959 >> v1:172.21.15.118:6789/0 conn(0x7f757806cd90 legacy=0x7f757806d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:53.155 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.153+0000 7f757d800640 1 -- 172.21.15.57:0/1955465959 >> v1:172.21.15.57:6789/0 conn(0x7f75780714e0 legacy=0x7f75780b2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:53.155 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.153+0000 7f757d800640 1 -- 172.21.15.57:0/1955465959 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7578071ec0 con 0x7f7578163540 2024-03-27T19:51:53.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.155+0000 7f757d800640 1 --2- 172.21.15.57:0/1955465959 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7578163540 0x7f75780b33c0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f7570009d90 tx=0x7f757002bf40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=54553e797f9d98b9 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:51:53.156 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.155+0000 7f7577400640 1 -- 172.21.15.57:0/1955465959 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7570039070 con 0x7f7578163540 2024-03-27T19:51:53.158 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.155+0000 7f7577400640 1 -- 172.21.15.57:0/1955465959 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f757002ccf0 con 0x7f7578163540 2024-03-27T19:51:53.158 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.155+0000 7f7577400640 1 -- 172.21.15.57:0/1955465959 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7570034640 con 0x7f7578163540 2024-03-27T19:51:53.158 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.156+0000 7f757e200640 1 -- 172.21.15.57:0/1955465959 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7578163540 msgr2=0x7f75780b33c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:53.158 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.156+0000 7f757e200640 1 --2- 172.21.15.57:0/1955465959 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7578163540 0x7f75780b33c0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f7570009d90 tx=0x7f757002bf40 comp rx=0 tx=0).stop 2024-03-27T19:51:53.160 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.159+0000 7f757e200640 1 -- 172.21.15.57:0/1955465959 shutdown_connections 2024-03-27T19:51:53.160 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.159+0000 7f757e200640 1 --2- 172.21.15.57:0/1955465959 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7578163540 0x7f75780b33c0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:53.160 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.159+0000 7f757e200640 1 -- 172.21.15.57:0/1955465959 >> 172.21.15.57:0/1955465959 conn(0x7f75780b1770 msgr2=0x7f75780b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T19:51:53.160 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.159+0000 7f757e200640 1 -- 172.21.15.57:0/1955465959 shutdown_connections 2024-03-27T19:51:53.162 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.159+0000 7f757e200640 1 -- 172.21.15.57:0/1955465959 wait complete. 2024-03-27T19:51:53.163 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.162+0000 7f757e200640 1 Processor -- start 2024-03-27T19:51:53.163 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.162+0000 7f757e200640 1 -- start start 2024-03-27T19:51:53.167 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.163+0000 7f757e200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f757806cd90 0x7f7578149fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:53.168 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.163+0000 7f757e200640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f75780714e0 0x7f7578157680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:53.168 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.163+0000 7f757e200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7578163540 0x7f757815b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:53.168 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.163+0000 7f757e200640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f7578072760 con 0x7f75780714e0 2024-03-27T19:51:53.168 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.163+0000 7f757e200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f7578072480 con 0x7f757806cd90 2024-03-27T19:51:53.168 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.163+0000 7f757e200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f7578163970 con 0x7f7578163540 2024-03-27T19:51:53.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.164+0000 7f757ce00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f757806cd90 0x7f7578149fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:53.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.164+0000 7f7577e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f75780714e0 0x7f7578157680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:53.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.165+0000 7f757d800640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7578163540 0x7f757815b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:53.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.165+0000 7f757d800640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7578163540 0x7f757815b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3301/0 says I am v2:172.21.15.57:54174/0 (socket says 172.21.15.57:54174) 2024-03-27T19:51:53.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.165+0000 7f757d800640 1 -- 172.21.15.57:0/2082046720 learned_addr learned my addr 172.21.15.57:0/2082046720 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T19:51:53.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.166+0000 7f7577e00640 1 -- 172.21.15.57:0/2082046720 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7578163540 msgr2=0x7f757815b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:53.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.166+0000 7f7577e00640 1 --2- 172.21.15.57:0/2082046720 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7578163540 0x7f757815b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:53.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.166+0000 7f7577e00640 1 -- 172.21.15.57:0/2082046720 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f757806cd90 msgr2=0x7f7578149fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:53.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.166+0000 7f7577e00640 1 --2- 172.21.15.57:0/2082046720 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f757806cd90 0x7f7578149fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:53.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.166+0000 7f7577e00640 1 -- 172.21.15.57:0/2082046720 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75781568c0 con 0x7f75780714e0 2024-03-27T19:51:53.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.166+0000 7f7577e00640 1 --2- 172.21.15.57:0/2082046720 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f75780714e0 0x7f7578157680 secure :-1 s=READY pgs=2222 cs=0 l=1 rev1=1 crypto rx=0x7f756400c400 tx=0x7f756400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:51:53.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.167+0000 7f7574c00640 1 -- 172.21.15.57:0/2082046720 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7564017070 con 0x7f75780714e0 2024-03-27T19:51:53.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.167+0000 7f7574c00640 1 -- 172.21.15.57:0/2082046720 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f75640052d0 con 0x7f75780714e0 2024-03-27T19:51:53.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.167+0000 7f7574c00640 1 -- 172.21.15.57:0/2082046720 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7564003830 con 0x7f75780714e0 2024-03-27T19:51:53.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.168+0000 7f757e200640 1 -- 172.21.15.57:0/2082046720 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7578156ba0 con 0x7f75780714e0 2024-03-27T19:51:53.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.168+0000 7f757e200640 1 -- 172.21.15.57:0/2082046720 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7578157160 con 0x7f75780714e0 2024-03-27T19:51:53.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.170+0000 7f757e200640 1 -- 172.21.15.57:0/2082046720 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7578157360 con 0x7f75780714e0 2024-03-27T19:51:53.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.172+0000 7f7574c00640 1 -- 172.21.15.57:0/2082046720 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f756401a070 con 0x7f75780714e0 2024-03-27T19:51:53.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.173+0000 7f7574c00640 1 --2- 172.21.15.57:0/2082046720 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f755806c600 0x7f755806eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:53.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.173+0000 7f7574c00640 1 -- 172.21.15.57:0/2082046720 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5335+0+0 (secure 0 0 0) 0x7f756408a880 con 0x7f75780714e0 2024-03-27T19:51:53.182 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.179+0000 7f757ce00640 1 --2- 172.21.15.57:0/2082046720 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f755806c600 0x7f755806eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:53.182 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.181+0000 7f757ce00640 1 --2- 172.21.15.57:0/2082046720 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f755806c600 0x7f755806eac0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f75781fc0a0 tx=0x7f756c007e80 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:51:53.183 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.182+0000 7f7574c00640 1 -- 172.21.15.57:0/2082046720 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f7578157360 con 0x7f75780714e0 2024-03-27T19:51:53.449 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.448+0000 7f757e200640 1 -- 172.21.15.57:0/2082046720 --> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f75781fd000 con 0x7f755806c600 2024-03-27T19:51:53.465 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.464+0000 7f7574c00640 1 -- 172.21.15.57:0/2082046720 <== mgr.4103 v2:172.21.15.57:6832/485397065 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13742 (secure 0 0 0) 0x7f75781fd000 con 0x7f755806c600 2024-03-27T19:51:53.465 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:51:53.466 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-03-27T19:51:53.468 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.466+0000 7f757e200640 1 -- 172.21.15.57:0/2082046720 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f755806c600 msgr2=0x7f755806eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:53.468 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.466+0000 7f757e200640 1 --2- 172.21.15.57:0/2082046720 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f755806c600 0x7f755806eac0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f75781fc0a0 tx=0x7f756c007e80 comp rx=0 tx=0).stop 2024-03-27T19:51:53.468 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.466+0000 7f757e200640 1 -- 172.21.15.57:0/2082046720 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f75780714e0 msgr2=0x7f7578157680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:53.468 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.466+0000 7f757e200640 1 --2- 172.21.15.57:0/2082046720 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f75780714e0 0x7f7578157680 secure :-1 s=READY pgs=2222 cs=0 l=1 rev1=1 crypto rx=0x7f756400c400 tx=0x7f756400c8c0 comp rx=0 tx=0).stop 2024-03-27T19:51:53.468 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.466+0000 7f757e200640 1 -- 172.21.15.57:0/2082046720 shutdown_connections 2024-03-27T19:51:53.468 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.466+0000 7f757e200640 1 --2- 172.21.15.57:0/2082046720 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f7578163540 0x7f757815b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:53.469 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.466+0000 7f757e200640 1 --2- 172.21.15.57:0/2082046720 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f75780714e0 0x7f7578157680 unknown :-1 s=CLOSED pgs=2222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:53.469 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.466+0000 7f757e200640 1 --2- 172.21.15.57:0/2082046720 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f755806c600 0x7f755806eac0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:53.469 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.466+0000 7f757e200640 1 --2- 172.21.15.57:0/2082046720 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f757806cd90 0x7f7578149fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:53.469 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.466+0000 7f757e200640 1 -- 172.21.15.57:0/2082046720 >> 172.21.15.57:0/2082046720 conn(0x7f75780b1770 msgr2=0x7f7578162aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T19:51:53.469 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.466+0000 7f757e200640 1 -- 172.21.15.57:0/2082046720 shutdown_connections 2024-03-27T19:51:53.469 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.466+0000 7f757e200640 1 -- 172.21.15.57:0/2082046720 wait complete. 2024-03-27T19:51:53.493 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":17809,"stamp":"2024-03-27T19:51:51.810568+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":176,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":47542320,"kb_used_data":34056388,"kb_used_omap":2255,"kb_used_meta":13463088,"kb_avail":707432400,"statfs":{"total":773094113280,"available":724410777600,"internally_reserved":0,"allocated":34873741312,"data_stored":34800275657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2309698,"internal_metadata":13786202558},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,2,1,3,2],"upper_bound":32},"perf_stat":{"commit_latency_ms":84,"apply_latency_ms":84,"commit_latency_ns":84000000,"apply_latency_ns":84000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-37026813970,"num_objects":-31764,"num_object_clones":0,"num_object_copies":-63528,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-31764,"num_whiteouts":0,"num_read":-1752794,"num_read_kb":-124889683,"num_write":-7457367,"num_write_kb":-160227353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-2243,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001279"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":509,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-03-27T19:51:47.908706+0000","last_change":"2024-03-27T09:59:19.234906+0000","last_active":"2024-03-27T19:51:47.908706+0000","last_peered":"2024-03-27T19:51:47.908706+0000","last_clean":"2024-03-27T19:51:47.908706+0000","last_became_active":"2024-03-27T09:59:19.234124+0000","last_became_peered":"2024-03-27T09:59:19.234124+0000","last_unstale":"2024-03-27T19:51:47.908706+0000","last_undegraded":"2024-03-27T19:51:47.908706+0000","last_fullsized":"2024-03-27T19:51:47.908706+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:17.974760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:17.974760+0000","last_clean_scrub_stamp":"2024-03-27T09:59:17.974760+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:24:35.357325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":14,"seq":60129549210,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7025840,"kb_used_data":5330528,"kb_used_omap":163,"kb_used_meta":1695132,"kb_avail":87346000,"statfs":{"total":96636764160,"available":89442304000,"internally_reserved":0,"allocated":5458460672,"data_stored":5447062083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":167080,"internal_metadata":1735816024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129549218,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6632972,"kb_used_data":4936128,"kb_used_omap":110,"kb_used_meta":1696721,"kb_avail":87738868,"statfs":{"total":96636764160,"available":89844600832,"internally_reserved":0,"allocated":5054595072,"data_stored":5043838363,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":113329,"internal_metadata":1737442639},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129549236,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5414428,"kb_used_data":3802768,"kb_used_omap":31,"kb_used_meta":1611616,"kb_avail":88957412,"statfs":{"total":96636764160,"available":91092389888,"internally_reserved":0,"allocated":3894034432,"data_stored":3885700944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":32452,"internal_metadata":1650295100},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,0,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129549236,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5700184,"kb_used_data":3924104,"kb_used_omap":158,"kb_used_meta":1775905,"kb_avail":88671656,"statfs":{"total":96636764160,"available":90799775744,"internally_reserved":0,"allocated":4018282496,"data_stored":4009581816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":162393,"internal_metadata":1818527143},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834581960,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6828500,"kb_used_data":5138368,"kb_used_omap":71,"kb_used_meta":1669560,"kb_avail":87543340,"statfs":{"total":96636764160,"available":89644380160,"internally_reserved":0,"allocated":5261688832,"data_stored":5250690402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":73250,"internal_metadata":1709629918},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834581960,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6117328,"kb_used_data":4491716,"kb_used_omap":423,"kb_used_meta":1625176,"kb_avail":88254512,"statfs":{"total":96636764160,"available":90372620288,"internally_reserved":0,"allocated":4599517184,"data_stored":4589831124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":434104,"internal_metadata":1664180296},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834581957,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8097488,"kb_used_data":6432260,"kb_used_omap":452,"kb_used_meta":1664763,"kb_avail":86274352,"statfs":{"total":96636764160,"available":88344936448,"internally_reserved":0,"allocated":6586634240,"data_stored":6573338604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":463596,"internal_metadata":1704717588},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,2,0,2,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834581961,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1725580,"kb_used_data":516,"kb_used_omap":843,"kb_used_meta":1724212,"kb_avail":92646260,"statfs":{"total":96636764160,"available":94869770240,"internally_reserved":0,"allocated":528384,"data_stored":232321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":863494,"internal_metadata":1765593850},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-27T19:51:53.494 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-27T19:51:53.684 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.683+0000 7f495f200640 1 Processor -- start 2024-03-27T19:51:53.685 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.683+0000 7f495f200640 1 -- start start 2024-03-27T19:51:53.687 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.685+0000 7f495f200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f49600b4400 0x7f49600d1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:53.687 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.685+0000 7f495f200640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f49600b4ae0 0x7f49600d25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:53.687 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.685+0000 7f495f200640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f49600d2b00 0x7f49600d06a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:53.687 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.685+0000 7f495f200640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f49600d2f70 con 0x7f49600b4ae0 2024-03-27T19:51:53.687 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.685+0000 7f495f200640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f49600cff30 con 0x7f49600d2b00 2024-03-27T19:51:53.687 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.685+0000 7f495f200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f49600cf970 con 0x7f49600b4400 2024-03-27T19:51:53.687 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.685+0000 7f495d400640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f49600b4ae0 0x7f49600d25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:53.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.685+0000 7f495d400640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f49600b4ae0 0x7f49600d25c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55880/0 (socket says 172.21.15.57:55880) 2024-03-27T19:51:53.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.685+0000 7f495d400640 1 -- 172.21.15.57:0/936275410 learned_addr learned my addr 172.21.15.57:0/936275410 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T19:51:53.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.685+0000 7f495de00640 1 --2- 172.21.15.57:0/936275410 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f49600b4400 0x7f49600d1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:53.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.685+0000 7f495e800640 1 --2- 172.21.15.57:0/936275410 >> v2:172.21.15.118:3300/0 conn(0x7f49600d2b00 0x7f49600d06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:53.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.686+0000 7f495d400640 1 -- 172.21.15.57:0/936275410 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f49600b4400 msgr2=0x7f49600d1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T19:51:53.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.686+0000 7f495d400640 1 --2- 172.21.15.57:0/936275410 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f49600b4400 0x7f49600d1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:53.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.686+0000 7f495d400640 1 -- 172.21.15.57:0/936275410 >> v2:172.21.15.118:3300/0 conn(0x7f49600d2b00 msgr2=0x7f49600d06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T19:51:53.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.686+0000 7f495d400640 1 --2- 172.21.15.57:0/936275410 >> v2:172.21.15.118:3300/0 conn(0x7f49600d2b00 0x7f49600d06a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:53.689 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.686+0000 7f495d400640 1 -- 172.21.15.57:0/936275410 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49600cfc50 con 0x7f49600b4ae0 2024-03-27T19:51:53.690 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.687+0000 7f495d400640 1 --2- 172.21.15.57:0/936275410 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f49600b4ae0 0x7f49600d25c0 secure :-1 s=READY pgs=2223 cs=0 l=1 rev1=1 crypto rx=0x7f496008c700 tx=0x7f494c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1855c816ee2ff643 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:51:53.690 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.687+0000 7f495ca00640 1 -- 172.21.15.57:0/936275410 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f494c035020 con 0x7f49600b4ae0 2024-03-27T19:51:53.690 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.687+0000 7f495ca00640 1 -- 172.21.15.57:0/936275410 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f494c031870 con 0x7f49600b4ae0 2024-03-27T19:51:53.690 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.687+0000 7f495ca00640 1 -- 172.21.15.57:0/936275410 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f494c031c40 con 0x7f49600b4ae0 2024-03-27T19:51:53.690 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.688+0000 7f495f200640 1 -- 172.21.15.57:0/936275410 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f49600b4ae0 msgr2=0x7f49600d25c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:53.690 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.688+0000 7f495f200640 1 --2- 172.21.15.57:0/936275410 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f49600b4ae0 0x7f49600d25c0 secure :-1 s=READY pgs=2223 cs=0 l=1 rev1=1 crypto rx=0x7f496008c700 tx=0x7f494c02b910 comp rx=0 tx=0).stop 2024-03-27T19:51:53.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.688+0000 7f495f200640 1 -- 172.21.15.57:0/936275410 shutdown_connections 2024-03-27T19:51:53.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.688+0000 7f495f200640 1 --2- 172.21.15.57:0/936275410 >> v2:172.21.15.118:3300/0 conn(0x7f49600d2b00 0x7f49600d06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:53.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.688+0000 7f495f200640 1 --2- 172.21.15.57:0/936275410 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f49600b4ae0 0x7f49600d25c0 unknown :-1 s=CLOSED pgs=2223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:53.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.688+0000 7f495f200640 1 --2- 172.21.15.57:0/936275410 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f49600b4400 0x7f49600d1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:53.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.688+0000 7f495f200640 1 -- 172.21.15.57:0/936275410 >> 172.21.15.57:0/936275410 conn(0x7f49600d3fe0 msgr2=0x7f49600d43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T19:51:53.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.688+0000 7f495f200640 1 -- 172.21.15.57:0/936275410 shutdown_connections 2024-03-27T19:51:53.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.688+0000 7f495f200640 1 -- 172.21.15.57:0/936275410 wait complete. 2024-03-27T19:51:53.693 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.690+0000 7f495f200640 1 Processor -- start 2024-03-27T19:51:53.693 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.690+0000 7f495f200640 1 -- start start 2024-03-27T19:51:53.693 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.691+0000 7f495f200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f49600b4400 0x7f49600b2190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:53.693 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.691+0000 7f495f200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f49600b4ae0 0x7f49600b26d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:53.694 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.691+0000 7f495f200640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f49600d2b00 0x7f496015a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:53.694 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.691+0000 7f495f200640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f49600b52a0 con 0x7f49600d2b00 2024-03-27T19:51:53.694 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.691+0000 7f495f200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f49600cf640 con 0x7f49600b4400 2024-03-27T19:51:53.694 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.691+0000 7f495f200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f49600b47e0 con 0x7f49600b4ae0 2024-03-27T19:51:53.694 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.691+0000 7f495e800640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f49600d2b00 0x7f496015a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:53.694 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.691+0000 7f495e800640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f49600d2b00 0x7f496015a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55888/0 (socket says 172.21.15.57:55888) 2024-03-27T19:51:53.694 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.691+0000 7f495e800640 1 -- 172.21.15.57:0/676400887 learned_addr learned my addr 172.21.15.57:0/676400887 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T19:51:53.694 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.692+0000 7f495de00640 1 --2- 172.21.15.57:0/676400887 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f49600b4400 0x7f49600b2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:53.694 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.692+0000 7f495d400640 1 --2- 172.21.15.57:0/676400887 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f49600b4ae0 0x7f49600b26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:53.695 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.692+0000 7f495e800640 1 -- 172.21.15.57:0/676400887 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f49600b4ae0 msgr2=0x7f49600b26d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:53.695 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.692+0000 7f495e800640 1 --2- 172.21.15.57:0/676400887 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f49600b4ae0 0x7f49600b26d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:53.695 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.692+0000 7f495e800640 1 -- 172.21.15.57:0/676400887 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f49600b4400 msgr2=0x7f49600b2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:53.695 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.692+0000 7f495e800640 1 --2- 172.21.15.57:0/676400887 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f49600b4400 0x7f49600b2190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:53.695 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.692+0000 7f495e800640 1 -- 172.21.15.57:0/676400887 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f496015b0a0 con 0x7f49600d2b00 2024-03-27T19:51:53.695 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.692+0000 7f495e800640 1 --2- 172.21.15.57:0/676400887 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f49600d2b00 0x7f496015a350 secure :-1 s=READY pgs=2224 cs=0 l=1 rev1=1 crypto rx=0x7f4958007e70 tx=0x7f495800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:51:53.696 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.692+0000 7f4956000640 1 -- 172.21.15.57:0/676400887 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4958014620 con 0x7f49600d2b00 2024-03-27T19:51:53.696 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.692+0000 7f4956000640 1 -- 172.21.15.57:0/676400887 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4958019070 con 0x7f49600d2b00 2024-03-27T19:51:53.696 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.692+0000 7f4956000640 1 -- 172.21.15.57:0/676400887 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4958014a20 con 0x7f49600d2b00 2024-03-27T19:51:53.696 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.692+0000 7f495f200640 1 -- 172.21.15.57:0/676400887 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f496015b380 con 0x7f49600d2b00 2024-03-27T19:51:53.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.693+0000 7f495f200640 1 -- 172.21.15.57:0/676400887 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4960148a50 con 0x7f49600d2b00 2024-03-27T19:51:53.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.694+0000 7f495f200640 1 -- 172.21.15.57:0/676400887 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4960068540 con 0x7f49600d2b00 2024-03-27T19:51:53.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.695+0000 7f4956000640 1 -- 172.21.15.57:0/676400887 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f4958014bc0 con 0x7f49600d2b00 2024-03-27T19:51:53.697 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.695+0000 7f4956000640 1 --2- 172.21.15.57:0/676400887 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f494006c530 0x7f494006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:53.698 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.696+0000 7f4956000640 1 -- 172.21.15.57:0/676400887 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5335+0+0 (secure 0 0 0) 0x7f495808bf60 con 0x7f49600d2b00 2024-03-27T19:51:53.698 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.696+0000 7f495de00640 1 --2- 172.21.15.57:0/676400887 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f494006c530 0x7f494006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:53.698 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.696+0000 7f495de00640 1 --2- 172.21.15.57:0/676400887 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f494006c530 0x7f494006e9f0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f4950006fd0 tx=0x7f4950008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:51:53.705 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.704+0000 7f4956000640 1 -- 172.21.15.57:0/676400887 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f495805a650 con 0x7f49600d2b00 2024-03-27T19:51:53.897 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.896+0000 7f495f200640 1 -- 172.21.15.57:0/676400887 --> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f49600d1590 con 0x7f494006c530 2024-03-27T19:51:53.899 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.898+0000 7f4956000640 1 -- 172.21.15.57:0/676400887 <== mgr.4103 v2:172.21.15.57:6832/485397065 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13720 (secure 0 0 0) 0x7f49600d1590 con 0x7f494006c530 2024-03-27T19:51:53.899 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:51:53.900 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-03-27T19:51:53.901 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.900+0000 7f495f200640 1 -- 172.21.15.57:0/676400887 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f494006c530 msgr2=0x7f494006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:53.901 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.900+0000 7f495f200640 1 --2- 172.21.15.57:0/676400887 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f494006c530 0x7f494006e9f0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f4950006fd0 tx=0x7f4950008040 comp rx=0 tx=0).stop 2024-03-27T19:51:53.901 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.900+0000 7f495f200640 1 -- 172.21.15.57:0/676400887 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f49600d2b00 msgr2=0x7f496015a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:53.901 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.900+0000 7f495f200640 1 --2- 172.21.15.57:0/676400887 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f49600d2b00 0x7f496015a350 secure :-1 s=READY pgs=2224 cs=0 l=1 rev1=1 crypto rx=0x7f4958007e70 tx=0x7f495800e4b0 comp rx=0 tx=0).stop 2024-03-27T19:51:53.902 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.900+0000 7f495f200640 1 -- 172.21.15.57:0/676400887 shutdown_connections 2024-03-27T19:51:53.902 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.900+0000 7f495f200640 1 --2- 172.21.15.57:0/676400887 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f49600d2b00 0x7f496015a350 unknown :-1 s=CLOSED pgs=2224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:53.903 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.900+0000 7f495f200640 1 --2- 172.21.15.57:0/676400887 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f49600b4ae0 0x7f49600b26d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:53.903 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.900+0000 7f495f200640 1 --2- 172.21.15.57:0/676400887 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f494006c530 0x7f494006e9f0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:53.903 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.900+0000 7f495f200640 1 --2- 172.21.15.57:0/676400887 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f49600b4400 0x7f49600b2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:53.903 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.900+0000 7f495f200640 1 -- 172.21.15.57:0/676400887 >> 172.21.15.57:0/676400887 conn(0x7f49600d3fe0 msgr2=0x7f49600b77f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T19:51:53.903 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.901+0000 7f495f200640 1 -- 172.21.15.57:0/676400887 shutdown_connections 2024-03-27T19:51:53.903 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:53.901+0000 7f495f200640 1 -- 172.21.15.57:0/676400887 wait complete. 2024-03-27T19:51:53.919 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":17810,"stamp":"2024-03-27T19:51:53.810977+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":119,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":4,"kb":754974720,"kb_used":26225984,"kb_used_data":12666160,"kb_used_omap":2255,"kb_used_meta":13557488,"kb_avail":728748736,"statfs":{"total":773094113280,"available":746238705664,"internally_reserved":0,"allocated":12970147840,"data_stored":12940873096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2309698,"internal_metadata":13882868158},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,0,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":307,"apply_latency_ms":307,"commit_latency_ns":307000000,"apply_latency_ns":307000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-37026813970,"num_objects":-31764,"num_object_clones":0,"num_object_copies":-63528,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-31764,"num_whiteouts":0,"num_read":-1752794,"num_read_kb":-124889683,"num_write":-7457367,"num_write_kb":-160227353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-2243,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.844599"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":511,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-03-27T19:51:50.424335+0000","last_change":"2024-03-27T09:59:19.234906+0000","last_active":"2024-03-27T19:51:50.424335+0000","last_peered":"2024-03-27T19:51:50.424335+0000","last_clean":"2024-03-27T19:51:50.424335+0000","last_became_active":"2024-03-27T09:59:19.234124+0000","last_became_peered":"2024-03-27T09:59:19.234124+0000","last_unstale":"2024-03-27T19:51:50.424335+0000","last_undegraded":"2024-03-27T19:51:50.424335+0000","last_fullsized":"2024-03-27T19:51:50.424335+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:17.974760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:17.974760+0000","last_clean_scrub_stamp":"2024-03-27T09:59:17.974760+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:24:35.357325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":14,"seq":60129549211,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1713868,"kb_used_data":516,"kb_used_omap":163,"kb_used_meta":1713180,"kb_avail":92657972,"statfs":{"total":96636764160,"available":94881763328,"internally_reserved":0,"allocated":528384,"data_stored":232321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":167080,"internal_metadata":1754297176},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":79,"apply_latency_ms":79,"commit_latency_ns":79000000,"apply_latency_ns":79000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129549218,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6632972,"kb_used_data":4936128,"kb_used_omap":110,"kb_used_meta":1696721,"kb_avail":87738868,"statfs":{"total":96636764160,"available":89844600832,"internally_reserved":0,"allocated":5054595072,"data_stored":5043838363,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":113329,"internal_metadata":1737442639},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129549236,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5414428,"kb_used_data":3802768,"kb_used_omap":31,"kb_used_meta":1611616,"kb_avail":88957412,"statfs":{"total":96636764160,"available":91092389888,"internally_reserved":0,"allocated":3894034432,"data_stored":3885700944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":32452,"internal_metadata":1650295100},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,0,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129549236,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5700184,"kb_used_data":3924104,"kb_used_omap":158,"kb_used_meta":1775905,"kb_avail":88671656,"statfs":{"total":96636764160,"available":90799775744,"internally_reserved":0,"allocated":4018282496,"data_stored":4009581816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":162393,"internal_metadata":1818527143},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834581961,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1692944,"kb_used_data":1096,"kb_used_omap":71,"kb_used_meta":1691768,"kb_avail":92678896,"statfs":{"total":96636764160,"available":94903189504,"internally_reserved":0,"allocated":1122304,"data_stored":822689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":73250,"internal_metadata":1732370910},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":48,"apply_latency_ms":48,"commit_latency_ns":48000000,"apply_latency_ns":48000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834581961,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1644172,"kb_used_data":516,"kb_used_omap":423,"kb_used_meta":1643224,"kb_avail":92727668,"statfs":{"total":96636764160,"available":94953132032,"internally_reserved":0,"allocated":528384,"data_stored":232321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":434104,"internal_metadata":1682661448},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":46,"apply_latency_ms":46,"commit_latency_ns":46000000,"apply_latency_ns":46000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834581958,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1701836,"kb_used_data":516,"kb_used_omap":452,"kb_used_meta":1700859,"kb_avail":92670004,"statfs":{"total":96636764160,"available":94894084096,"internally_reserved":0,"allocated":528384,"data_stored":232321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":463596,"internal_metadata":1741679892},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":56,"apply_latency_ms":56,"commit_latency_ns":56000000,"apply_latency_ns":56000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834581961,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1725580,"kb_used_data":516,"kb_used_omap":843,"kb_used_meta":1724212,"kb_avail":92646260,"statfs":{"total":96636764160,"available":94869770240,"internally_reserved":0,"allocated":528384,"data_stored":232321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":863494,"internal_metadata":1765593850},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-27T19:51:53.920 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-03-27T19:51:53.920 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-27T19:51:54.111 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.109+0000 7f6ec9a00640 1 Processor -- start 2024-03-27T19:51:54.111 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.110+0000 7f6ec9a00640 1 -- start start 2024-03-27T19:51:54.114 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.111+0000 7f6ec9a00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f6ec40d2820 0x7f6ec40d0780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:54.114 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.111+0000 7f6ec9a00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6ec40d4b50 0x7f6ec40d0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:54.114 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.111+0000 7f6ec9a00640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ec40d2d90 con 0x7f6ec4161830 2024-03-27T19:51:54.115 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.111+0000 7f6ec9a00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f6ec40cf4e0 con 0x7f6ec40d2820 2024-03-27T19:51:54.115 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.111+0000 7f6ec9a00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f6ec40cee90 con 0x7f6ec40d4b50 2024-03-27T19:51:54.115 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.111+0000 7f6ec3e00640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f6ec4161830 0x7f6ec40cf970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:37714/0 (socket says 172.21.15.57:37714) 2024-03-27T19:51:54.115 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.111+0000 7f6ec3e00640 1 -- 172.21.15.57:0/528470929 learned_addr learned my addr 172.21.15.57:0/528470929 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T19:51:54.115 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.111+0000 7f6ebbe00640 1 --2- 172.21.15.57:0/528470929 >> v2:172.21.15.118:3300/0 conn(0x7f6ec40d2820 0x7f6ec40d0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:54.115 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.111+0000 7f6ec9000640 1 --2- 172.21.15.57:0/528470929 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6ec40d4b50 0x7f6ec40d0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:54.115 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.112+0000 7f6ec3400640 1 -- 172.21.15.57:0/528470929 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3724244595 0 0) 0x7f6ec40d2d90 con 0x7f6ec4161830 2024-03-27T19:51:54.115 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.112+0000 7f6ec3400640 1 -- 172.21.15.57:0/528470929 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ea8003520 con 0x7f6ec4161830 2024-03-27T19:51:54.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.112+0000 7f6ec3400640 1 -- 172.21.15.57:0/528470929 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1594239052 0 0) 0x7f6ea8003520 con 0x7f6ec4161830 2024-03-27T19:51:54.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.112+0000 7f6ec3400640 1 -- 172.21.15.57:0/528470929 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6ec40d4b50 msgr2=0x7f6ec40d0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T19:51:54.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.112+0000 7f6ec3400640 1 --2- 172.21.15.57:0/528470929 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6ec40d4b50 0x7f6ec40d0cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:54.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.112+0000 7f6ec3400640 1 -- 172.21.15.57:0/528470929 >> v2:172.21.15.118:3300/0 conn(0x7f6ec40d2820 msgr2=0x7f6ec40d0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T19:51:54.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.112+0000 7f6ec3400640 1 --2- 172.21.15.57:0/528470929 >> v2:172.21.15.118:3300/0 conn(0x7f6ec40d2820 0x7f6ec40d0780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:54.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.112+0000 7f6ec3400640 1 -- 172.21.15.57:0/528470929 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ec40cf170 con 0x7f6ec4161830 2024-03-27T19:51:54.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.112+0000 7f6ec3400640 1 -- 172.21.15.57:0/528470929 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4227751516 0 0) 0x7f6eb4001670 con 0x7f6ec4161830 2024-03-27T19:51:54.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.112+0000 7f6ec3400640 1 -- 172.21.15.57:0/528470929 >> v1:172.21.15.57:6789/0 conn(0x7f6ec4161830 legacy=0x7f6ec40cf970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:54.117 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.112+0000 7f6ec3400640 1 --2- 172.21.15.57:0/528470929 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ea80039b0 0x7f6ea8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:54.117 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.112+0000 7f6ec3400640 1 --2- 172.21.15.57:0/528470929 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6ec40d4b50 0x7f6ea8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:54.117 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.112+0000 7f6ec3400640 1 --2- 172.21.15.57:0/528470929 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6ea8004d40 0x7f6ea80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:54.117 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.112+0000 7f6ec3400640 1 -- 172.21.15.57:0/528470929 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f6ec40cf4e0 con 0x7f6ea8004d40 2024-03-27T19:51:54.117 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.112+0000 7f6ec3400640 1 -- 172.21.15.57:0/528470929 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f6ec40cee90 con 0x7f6ea80039b0 2024-03-27T19:51:54.117 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.112+0000 7f6ec3400640 1 -- 172.21.15.57:0/528470929 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f6ea800ba40 con 0x7f6ec40d4b50 2024-03-27T19:51:54.117 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.112+0000 7f6ec9000640 1 --2- 172.21.15.57:0/528470929 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6ea8004d40 0x7f6ea80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:54.117 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.113+0000 7f6ec3e00640 1 --2- 172.21.15.57:0/528470929 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ea80039b0 0x7f6ea8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:54.117 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.113+0000 7f6ebbe00640 1 --2- 172.21.15.57:0/528470929 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6ec40d4b50 0x7f6ea8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:54.118 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.113+0000 7f6ec9000640 1 -- 172.21.15.57:0/528470929 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6ec40d4b50 msgr2=0x7f6ea8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T19:51:54.118 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.113+0000 7f6ec9000640 1 --2- 172.21.15.57:0/528470929 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6ec40d4b50 0x7f6ea8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:54.118 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.113+0000 7f6ec9000640 1 -- 172.21.15.57:0/528470929 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ea80039b0 msgr2=0x7f6ea8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T19:51:54.118 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.113+0000 7f6ec9000640 1 --2- 172.21.15.57:0/528470929 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ea80039b0 0x7f6ea8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:54.118 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.113+0000 7f6ec9000640 1 -- 172.21.15.57:0/528470929 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ea8003520 con 0x7f6ea8004d40 2024-03-27T19:51:54.121 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.114+0000 7f6ec9000640 1 --2- 172.21.15.57:0/528470929 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6ea8004d40 0x7f6ea80051c0 secure :-1 s=READY pgs=2226 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc009fc0 tx=0x7f6ea8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2b8b4ed2dfc5805 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:51:54.121 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.114+0000 7f6ec3400640 1 -- 172.21.15.57:0/528470929 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ebc039070 con 0x7f6ea8004d40 2024-03-27T19:51:54.121 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.114+0000 7f6ec3400640 1 -- 172.21.15.57:0/528470929 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ebc02cc20 con 0x7f6ea8004d40 2024-03-27T19:51:54.121 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.114+0000 7f6ec3400640 1 -- 172.21.15.57:0/528470929 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ebc009c10 con 0x7f6ea8004d40 2024-03-27T19:51:54.121 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.115+0000 7f6ec9a00640 1 -- 172.21.15.57:0/528470929 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6ea8004d40 msgr2=0x7f6ea80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:54.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.115+0000 7f6ec9a00640 1 --2- 172.21.15.57:0/528470929 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6ea8004d40 0x7f6ea80051c0 secure :-1 s=READY pgs=2226 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc009fc0 tx=0x7f6ea8005830 comp rx=0 tx=0).stop 2024-03-27T19:51:54.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.115+0000 7f6ec9000640 1 -- 172.21.15.57:0/528470929 reap_dead start 2024-03-27T19:51:54.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.115+0000 7f6ec9a00640 1 -- 172.21.15.57:0/528470929 shutdown_connections 2024-03-27T19:51:54.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.115+0000 7f6ec9a00640 1 -- 172.21.15.57:0/528470929 >> 172.21.15.57:0/528470929 conn(0x7f6ec40d4030 msgr2=0x7f6ec40d4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T19:51:54.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.115+0000 7f6ec9a00640 1 -- 172.21.15.57:0/528470929 shutdown_connections 2024-03-27T19:51:54.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.115+0000 7f6ec9a00640 1 -- 172.21.15.57:0/528470929 wait complete. 2024-03-27T19:51:54.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.117+0000 7f6ec9a00640 1 Processor -- start 2024-03-27T19:51:54.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.117+0000 7f6ec9a00640 1 -- start start 2024-03-27T19:51:54.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.118+0000 7f6ec9a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ea8004d40 0x7f6ec4155280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:54.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.118+0000 7f6ec9a00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6ec41528d0 0x7f6ec415fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:54.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.118+0000 7f6ec9a00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6ec4160070 0x7f6ec41577b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:54.124 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.118+0000 7f6ec9a00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f6ec40ce330 con 0x7f6ec41528d0 2024-03-27T19:51:54.124 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.118+0000 7f6ec9a00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f6ec40d3070 con 0x7f6ea8004d40 2024-03-27T19:51:54.124 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.118+0000 7f6ec9a00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f6ec40ce4b0 con 0x7f6ec4160070 2024-03-27T19:51:54.124 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.118+0000 7f6ebbe00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6ec41528d0 0x7f6ec415fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:54.124 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.118+0000 7f6ebbe00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6ec41528d0 0x7f6ec415fb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55902/0 (socket says 172.21.15.57:55902) 2024-03-27T19:51:54.124 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.118+0000 7f6ebbe00640 1 -- 172.21.15.57:0/2815216981 learned_addr learned my addr 172.21.15.57:0/2815216981 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T19:51:54.124 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.118+0000 7f6ec3e00640 1 --2- 172.21.15.57:0/2815216981 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ea8004d40 0x7f6ec4155280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:54.124 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.118+0000 7f6ec9000640 1 --2- 172.21.15.57:0/2815216981 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6ec4160070 0x7f6ec41577b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:54.125 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.118+0000 7f6ebbe00640 1 -- 172.21.15.57:0/2815216981 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6ec4160070 msgr2=0x7f6ec41577b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:54.125 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.118+0000 7f6ebbe00640 1 --2- 172.21.15.57:0/2815216981 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6ec4160070 0x7f6ec41577b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:54.125 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.118+0000 7f6ebbe00640 1 -- 172.21.15.57:0/2815216981 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ea8004d40 msgr2=0x7f6ec4155280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:54.125 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.118+0000 7f6ebbe00640 1 --2- 172.21.15.57:0/2815216981 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ea8004d40 0x7f6ec4155280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:54.125 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.118+0000 7f6ebbe00640 1 -- 172.21.15.57:0/2815216981 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ec415ab20 con 0x7f6ec41528d0 2024-03-27T19:51:54.125 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.119+0000 7f6ebbe00640 1 --2- 172.21.15.57:0/2815216981 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6ec41528d0 0x7f6ec415fb30 secure :-1 s=READY pgs=2227 cs=0 l=1 rev1=1 crypto rx=0x7f6eac011700 tx=0x7f6eac011bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:51:54.125 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.119+0000 7f6ec0c00640 1 -- 172.21.15.57:0/2815216981 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eac00f9c0 con 0x7f6ec41528d0 2024-03-27T19:51:54.125 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.119+0000 7f6ec0c00640 1 -- 172.21.15.57:0/2815216981 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6eac00fb60 con 0x7f6ec41528d0 2024-03-27T19:51:54.125 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.119+0000 7f6ec0c00640 1 -- 172.21.15.57:0/2815216981 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eac015460 con 0x7f6ec41528d0 2024-03-27T19:51:54.126 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.119+0000 7f6ec9a00640 1 -- 172.21.15.57:0/2815216981 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ec415edb0 con 0x7f6ec41528d0 2024-03-27T19:51:54.126 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.119+0000 7f6ec9a00640 1 -- 172.21.15.57:0/2815216981 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ec415f050 con 0x7f6ec41528d0 2024-03-27T19:51:54.127 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.120+0000 7f6ec9a00640 1 -- 172.21.15.57:0/2815216981 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ec4068540 con 0x7f6ec41528d0 2024-03-27T19:51:54.127 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.121+0000 7f6ec0c00640 1 -- 172.21.15.57:0/2815216981 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f6eac015600 con 0x7f6ec41528d0 2024-03-27T19:51:54.127 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.123+0000 7f6ec0c00640 1 --2- 172.21.15.57:0/2815216981 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f6ea006c560 0x7f6ea006ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:54.127 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.123+0000 7f6ec0c00640 1 -- 172.21.15.57:0/2815216981 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5335+0+0 (secure 0 0 0) 0x7f6eac08bf90 con 0x7f6ec41528d0 2024-03-27T19:51:54.127 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.123+0000 7f6ec3e00640 1 --2- 172.21.15.57:0/2815216981 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f6ea006c560 0x7f6ea006ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:54.128 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.124+0000 7f6ec3e00640 1 --2- 172.21.15.57:0/2815216981 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f6ea006c560 0x7f6ea006ea20 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f6eb40057f0 tx=0x7f6eb4000f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:51:54.128 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.127+0000 7f6ec0c00640 1 -- 172.21.15.57:0/2815216981 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f6eac019030 con 0x7f6ec41528d0 2024-03-27T19:51:54.325 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.324+0000 7f6ec9a00640 1 -- 172.21.15.57:0/2815216981 --> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6ec40d46f0 con 0x7f6ea006c560 2024-03-27T19:51:54.327 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.326+0000 7f6ec0c00640 1 -- 172.21.15.57:0/2815216981 <== mgr.4103 v2:172.21.15.57:6832/485397065 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13720 (secure 0 0 0) 0x7f6ec40d46f0 con 0x7f6ea006c560 2024-03-27T19:51:54.327 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:51:54.328 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-03-27T19:51:54.330 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.328+0000 7f6ec9a00640 1 -- 172.21.15.57:0/2815216981 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f6ea006c560 msgr2=0x7f6ea006ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:54.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.328+0000 7f6ec9a00640 1 --2- 172.21.15.57:0/2815216981 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f6ea006c560 0x7f6ea006ea20 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f6eb40057f0 tx=0x7f6eb4000f90 comp rx=0 tx=0).stop 2024-03-27T19:51:54.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.328+0000 7f6ec9a00640 1 -- 172.21.15.57:0/2815216981 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6ec41528d0 msgr2=0x7f6ec415fb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:54.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.328+0000 7f6ec9a00640 1 --2- 172.21.15.57:0/2815216981 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6ec41528d0 0x7f6ec415fb30 secure :-1 s=READY pgs=2227 cs=0 l=1 rev1=1 crypto rx=0x7f6eac011700 tx=0x7f6eac011bc0 comp rx=0 tx=0).stop 2024-03-27T19:51:54.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.328+0000 7f6ec9a00640 1 -- 172.21.15.57:0/2815216981 shutdown_connections 2024-03-27T19:51:54.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.328+0000 7f6ec9a00640 1 --2- 172.21.15.57:0/2815216981 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f6ec4160070 0x7f6ec41577b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:54.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.329+0000 7f6ec9a00640 1 --2- 172.21.15.57:0/2815216981 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f6ec41528d0 0x7f6ec415fb30 unknown :-1 s=CLOSED pgs=2227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:54.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.329+0000 7f6ec9a00640 1 --2- 172.21.15.57:0/2815216981 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f6ea006c560 0x7f6ea006ea20 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:54.331 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.329+0000 7f6ec9a00640 1 --2- 172.21.15.57:0/2815216981 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f6ea8004d40 0x7f6ec4155280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:54.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.329+0000 7f6ec9a00640 1 -- 172.21.15.57:0/2815216981 >> 172.21.15.57:0/2815216981 conn(0x7f6ec40d4030 msgr2=0x7f6ec40c9880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T19:51:54.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.329+0000 7f6ec9a00640 1 -- 172.21.15.57:0/2815216981 shutdown_connections 2024-03-27T19:51:54.332 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.329+0000 7f6ec9a00640 1 -- 172.21.15.57:0/2815216981 wait complete. 2024-03-27T19:51:54.351 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":17810,"stamp":"2024-03-27T19:51:53.810977+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":119,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":4,"kb":754974720,"kb_used":26225984,"kb_used_data":12666160,"kb_used_omap":2255,"kb_used_meta":13557488,"kb_avail":728748736,"statfs":{"total":773094113280,"available":746238705664,"internally_reserved":0,"allocated":12970147840,"data_stored":12940873096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2309698,"internal_metadata":13882868158},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,0,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":307,"apply_latency_ms":307,"commit_latency_ns":307000000,"apply_latency_ns":307000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-37026813970,"num_objects":-31764,"num_object_clones":0,"num_object_copies":-63528,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-31764,"num_whiteouts":0,"num_read":-1752794,"num_read_kb":-124889683,"num_write":-7457367,"num_write_kb":-160227353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-2243,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.844599"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":511,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-03-27T19:51:50.424335+0000","last_change":"2024-03-27T09:59:19.234906+0000","last_active":"2024-03-27T19:51:50.424335+0000","last_peered":"2024-03-27T19:51:50.424335+0000","last_clean":"2024-03-27T19:51:50.424335+0000","last_became_active":"2024-03-27T09:59:19.234124+0000","last_became_peered":"2024-03-27T09:59:19.234124+0000","last_unstale":"2024-03-27T19:51:50.424335+0000","last_undegraded":"2024-03-27T19:51:50.424335+0000","last_fullsized":"2024-03-27T19:51:50.424335+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:17.974760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:17.974760+0000","last_clean_scrub_stamp":"2024-03-27T09:59:17.974760+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:24:35.357325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":14,"seq":60129549211,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1713868,"kb_used_data":516,"kb_used_omap":163,"kb_used_meta":1713180,"kb_avail":92657972,"statfs":{"total":96636764160,"available":94881763328,"internally_reserved":0,"allocated":528384,"data_stored":232321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":167080,"internal_metadata":1754297176},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":79,"apply_latency_ms":79,"commit_latency_ns":79000000,"apply_latency_ns":79000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129549218,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6632972,"kb_used_data":4936128,"kb_used_omap":110,"kb_used_meta":1696721,"kb_avail":87738868,"statfs":{"total":96636764160,"available":89844600832,"internally_reserved":0,"allocated":5054595072,"data_stored":5043838363,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":113329,"internal_metadata":1737442639},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129549236,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5414428,"kb_used_data":3802768,"kb_used_omap":31,"kb_used_meta":1611616,"kb_avail":88957412,"statfs":{"total":96636764160,"available":91092389888,"internally_reserved":0,"allocated":3894034432,"data_stored":3885700944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":32452,"internal_metadata":1650295100},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,0,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129549236,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5700184,"kb_used_data":3924104,"kb_used_omap":158,"kb_used_meta":1775905,"kb_avail":88671656,"statfs":{"total":96636764160,"available":90799775744,"internally_reserved":0,"allocated":4018282496,"data_stored":4009581816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":162393,"internal_metadata":1818527143},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834581961,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1692944,"kb_used_data":1096,"kb_used_omap":71,"kb_used_meta":1691768,"kb_avail":92678896,"statfs":{"total":96636764160,"available":94903189504,"internally_reserved":0,"allocated":1122304,"data_stored":822689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":73250,"internal_metadata":1732370910},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":48,"apply_latency_ms":48,"commit_latency_ns":48000000,"apply_latency_ns":48000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834581961,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1644172,"kb_used_data":516,"kb_used_omap":423,"kb_used_meta":1643224,"kb_avail":92727668,"statfs":{"total":96636764160,"available":94953132032,"internally_reserved":0,"allocated":528384,"data_stored":232321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":434104,"internal_metadata":1682661448},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":46,"apply_latency_ms":46,"commit_latency_ns":46000000,"apply_latency_ns":46000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834581958,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1701836,"kb_used_data":516,"kb_used_omap":452,"kb_used_meta":1700859,"kb_avail":92670004,"statfs":{"total":96636764160,"available":94894084096,"internally_reserved":0,"allocated":528384,"data_stored":232321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":463596,"internal_metadata":1741679892},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":56,"apply_latency_ms":56,"commit_latency_ns":56000000,"apply_latency_ns":56000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834581961,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1725580,"kb_used_data":516,"kb_used_omap":843,"kb_used_meta":1724212,"kb_avail":92646260,"statfs":{"total":96636764160,"available":94869770240,"internally_reserved":0,"allocated":528384,"data_stored":232321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":863494,"internal_metadata":1765593850},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-27T19:51:54.352 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-27T19:51:54.550 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.548+0000 7fb19b000640 1 Processor -- start 2024-03-27T19:51:54.550 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.549+0000 7fb19b000640 1 -- start start 2024-03-27T19:51:54.552 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.550+0000 7fb19b000640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fb194145820 0x7fb1940cc950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:54.552 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.550+0000 7fb19b000640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1940cf750 0x7fb19406bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:54.552 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.550+0000 7fb19b000640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1940cce90 con 0x7fb19406b750 2024-03-27T19:51:54.552 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.550+0000 7fb19b000640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7fb19406c100 con 0x7fb194145820 2024-03-27T19:51:54.552 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.550+0000 7fb19b000640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fb194160b60 con 0x7fb1940cf750 2024-03-27T19:51:54.552 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.550+0000 7fb18b400640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fb19406b750 0x7fb1940b2b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:37720/0 (socket says 172.21.15.57:37720) 2024-03-27T19:51:54.553 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.550+0000 7fb18b400640 1 -- 172.21.15.57:0/1187606604 learned_addr learned my addr 172.21.15.57:0/1187606604 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T19:51:54.553 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.551+0000 7fb193e00640 1 --2- 172.21.15.57:0/1187606604 >> v2:172.21.15.118:3300/0 conn(0x7fb194145820 0x7fb1940cc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:54.556 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.551+0000 7fb199000640 1 --2- 172.21.15.57:0/1187606604 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1940cf750 0x7fb19406bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:54.556 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.551+0000 7fb193400640 1 -- 172.21.15.57:0/1187606604 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2996717356 0 0) 0x7fb1940cce90 con 0x7fb19406b750 2024-03-27T19:51:54.556 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.551+0000 7fb193400640 1 -- 172.21.15.57:0/1187606604 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb178003520 con 0x7fb19406b750 2024-03-27T19:51:54.556 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.551+0000 7fb193400640 1 -- 172.21.15.57:0/1187606604 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2012235227 0 0) 0x7fb178003520 con 0x7fb19406b750 2024-03-27T19:51:54.556 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.551+0000 7fb193400640 1 -- 172.21.15.57:0/1187606604 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1940cf750 msgr2=0x7fb19406bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T19:51:54.556 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.551+0000 7fb193400640 1 --2- 172.21.15.57:0/1187606604 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1940cf750 0x7fb19406bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:54.556 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.551+0000 7fb193400640 1 -- 172.21.15.57:0/1187606604 >> v2:172.21.15.118:3300/0 conn(0x7fb194145820 msgr2=0x7fb1940cc950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T19:51:54.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.551+0000 7fb193400640 1 --2- 172.21.15.57:0/1187606604 >> v2:172.21.15.118:3300/0 conn(0x7fb194145820 0x7fb1940cc950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:54.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.551+0000 7fb193400640 1 -- 172.21.15.57:0/1187606604 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb19415fc70 con 0x7fb19406b750 2024-03-27T19:51:54.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.551+0000 7fb193400640 1 -- 172.21.15.57:0/1187606604 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4227751516 0 0) 0x7fb17c001670 con 0x7fb19406b750 2024-03-27T19:51:54.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.551+0000 7fb193400640 1 -- 172.21.15.57:0/1187606604 >> v1:172.21.15.57:6789/0 conn(0x7fb19406b750 legacy=0x7fb1940b2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:54.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.552+0000 7fb193400640 1 --2- 172.21.15.57:0/1187606604 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb1780039b0 0x7fb178003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:54.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.552+0000 7fb193400640 1 --2- 172.21.15.57:0/1187606604 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb178004800 0x7fb178004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:54.557 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.552+0000 7fb193400640 1 --2- 172.21.15.57:0/1187606604 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1940cf750 0x7fb1780051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:54.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.552+0000 7fb193400640 1 -- 172.21.15.57:0/1187606604 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fb19406c100 con 0x7fb1780039b0 2024-03-27T19:51:54.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.552+0000 7fb193400640 1 -- 172.21.15.57:0/1187606604 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fb194160b60 con 0x7fb178004800 2024-03-27T19:51:54.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.552+0000 7fb193400640 1 -- 172.21.15.57:0/1187606604 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fb17800b9c0 con 0x7fb1940cf750 2024-03-27T19:51:54.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.552+0000 7fb193e00640 1 --2- 172.21.15.57:0/1187606604 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb1780039b0 0x7fb178003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:54.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.552+0000 7fb18b400640 1 --2- 172.21.15.57:0/1187606604 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb178004800 0x7fb178004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:54.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.552+0000 7fb193e00640 1 -- 172.21.15.57:0/1187606604 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1940cf750 msgr2=0x7fb1780051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T19:51:54.558 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.552+0000 7fb193e00640 1 --2- 172.21.15.57:0/1187606604 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1940cf750 0x7fb1780051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:54.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.552+0000 7fb193e00640 1 -- 172.21.15.57:0/1187606604 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb178004800 msgr2=0x7fb178004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T19:51:54.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.552+0000 7fb193e00640 1 --2- 172.21.15.57:0/1187606604 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb178004800 0x7fb178004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:54.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.552+0000 7fb193e00640 1 -- 172.21.15.57:0/1187606604 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb178003520 con 0x7fb1780039b0 2024-03-27T19:51:54.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.553+0000 7fb193e00640 1 --2- 172.21.15.57:0/1187606604 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb1780039b0 0x7fb178003dd0 secure :-1 s=READY pgs=2229 cs=0 l=1 rev1=1 crypto rx=0x7fb184009ac0 tx=0x7fb178005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df0b6b19511e7726 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:51:54.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.554+0000 7fb193400640 1 -- 172.21.15.57:0/1187606604 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb184039070 con 0x7fb1780039b0 2024-03-27T19:51:54.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.554+0000 7fb193400640 1 -- 172.21.15.57:0/1187606604 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb18402c710 con 0x7fb1780039b0 2024-03-27T19:51:54.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.554+0000 7fb193400640 1 -- 172.21.15.57:0/1187606604 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb184009690 con 0x7fb1780039b0 2024-03-27T19:51:54.559 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.554+0000 7fb19b000640 1 -- 172.21.15.57:0/1187606604 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb1780039b0 msgr2=0x7fb178003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:54.560 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.554+0000 7fb19b000640 1 --2- 172.21.15.57:0/1187606604 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb1780039b0 0x7fb178003dd0 secure :-1 s=READY pgs=2229 cs=0 l=1 rev1=1 crypto rx=0x7fb184009ac0 tx=0x7fb178005830 comp rx=0 tx=0).stop 2024-03-27T19:51:54.560 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.554+0000 7fb199000640 1 -- 172.21.15.57:0/1187606604 reap_dead start 2024-03-27T19:51:54.560 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.554+0000 7fb19b000640 1 -- 172.21.15.57:0/1187606604 shutdown_connections 2024-03-27T19:51:54.560 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.554+0000 7fb19b000640 1 -- 172.21.15.57:0/1187606604 >> 172.21.15.57:0/1187606604 conn(0x7fb1940b1c60 msgr2=0x7fb1940b2070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T19:51:54.560 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.554+0000 7fb19b000640 1 -- 172.21.15.57:0/1187606604 shutdown_connections 2024-03-27T19:51:54.560 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.554+0000 7fb19b000640 1 -- 172.21.15.57:0/1187606604 wait complete. 2024-03-27T19:51:54.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.556+0000 7fb19b000640 1 Processor -- start 2024-03-27T19:51:54.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.556+0000 7fb19b000640 1 -- start start 2024-03-27T19:51:54.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.557+0000 7fb19b000640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1780039b0 0x7fb19415a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:54.563 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.557+0000 7fb19b000640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb194140740 0x7fb1941585b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:54.564 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.557+0000 7fb19b000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb194158af0 0x7fb1940ce5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:54.564 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.557+0000 7fb19b000640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fb194160510 con 0x7fb194140740 2024-03-27T19:51:54.564 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.557+0000 7fb19b000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fb194160230 con 0x7fb194158af0 2024-03-27T19:51:54.564 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.557+0000 7fb19b000640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fb1941607f0 con 0x7fb1780039b0 2024-03-27T19:51:54.564 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.557+0000 7fb18b400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb194140740 0x7fb1941585b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:54.564 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.557+0000 7fb18b400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb194140740 0x7fb1941585b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55916/0 (socket says 172.21.15.57:55916) 2024-03-27T19:51:54.564 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.557+0000 7fb18b400640 1 -- 172.21.15.57:0/836559282 learned_addr learned my addr 172.21.15.57:0/836559282 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T19:51:54.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.558+0000 7fb199000640 1 --2- 172.21.15.57:0/836559282 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb194158af0 0x7fb1940ce5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:54.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.558+0000 7fb193e00640 1 --2- 172.21.15.57:0/836559282 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1780039b0 0x7fb19415a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:54.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.558+0000 7fb18b400640 1 -- 172.21.15.57:0/836559282 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1780039b0 msgr2=0x7fb19415a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:54.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.558+0000 7fb18b400640 1 --2- 172.21.15.57:0/836559282 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1780039b0 0x7fb19415a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:54.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.558+0000 7fb18b400640 1 -- 172.21.15.57:0/836559282 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb194158af0 msgr2=0x7fb1940ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:54.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.558+0000 7fb18b400640 1 --2- 172.21.15.57:0/836559282 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb194158af0 0x7fb1940ce5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:54.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.558+0000 7fb18b400640 1 -- 172.21.15.57:0/836559282 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1941592b0 con 0x7fb194140740 2024-03-27T19:51:54.565 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.558+0000 7fb18b400640 1 --2- 172.21.15.57:0/836559282 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb194140740 0x7fb1941585b0 secure :-1 s=READY pgs=2230 cs=0 l=1 rev1=1 crypto rx=0x7fb17c000f60 tx=0x7fb17c00dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:51:54.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.558+0000 7fb190c00640 1 -- 172.21.15.57:0/836559282 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb17c019070 con 0x7fb194140740 2024-03-27T19:51:54.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.558+0000 7fb190c00640 1 -- 172.21.15.57:0/836559282 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb17c0074e0 con 0x7fb194140740 2024-03-27T19:51:54.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.558+0000 7fb190c00640 1 -- 172.21.15.57:0/836559282 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb17c004a00 con 0x7fb194140740 2024-03-27T19:51:54.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.558+0000 7fb19b000640 1 -- 172.21.15.57:0/836559282 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb194159590 con 0x7fb194140740 2024-03-27T19:51:54.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.559+0000 7fb19b000640 1 -- 172.21.15.57:0/836559282 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb194159b50 con 0x7fb194140740 2024-03-27T19:51:54.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.560+0000 7fb19b000640 1 -- 172.21.15.57:0/836559282 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1940b5e40 con 0x7fb194140740 2024-03-27T19:51:54.566 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.560+0000 7fb190c00640 1 -- 172.21.15.57:0/836559282 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fb17c01c070 con 0x7fb194140740 2024-03-27T19:51:54.567 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.561+0000 7fb190c00640 1 --2- 172.21.15.57:0/836559282 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fb17006c560 0x7fb17006ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:54.567 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.561+0000 7fb190c00640 1 -- 172.21.15.57:0/836559282 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5335+0+0 (secure 0 0 0) 0x7fb17c08afd0 con 0x7fb194140740 2024-03-27T19:51:54.567 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.562+0000 7fb193e00640 1 --2- 172.21.15.57:0/836559282 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fb17006c560 0x7fb17006ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:54.567 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.562+0000 7fb193e00640 1 --2- 172.21.15.57:0/836559282 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fb17006c560 0x7fb17006ea20 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fb184036000 tx=0x7fb184030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:51:54.568 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.566+0000 7fb190c00640 1 -- 172.21.15.57:0/836559282 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7fb1940b5e40 con 0x7fb194140740 2024-03-27T19:51:54.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.762+0000 7fb19b000640 1 -- 172.21.15.57:0/836559282 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb194068620 con 0x7fb194140740 2024-03-27T19:51:54.765 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.764+0000 7fb190c00640 1 -- 172.21.15.57:0/836559282 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) ==== 74+0+13279 (secure 0 0 0) 0x7fb17c007690 con 0x7fb194140740 2024-03-27T19:51:54.766 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:51:54.766 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":45,"fsid":"7ac43f86-2c16-4a97-98fb-715d3cebc75c","created":"2024-03-27T09:59:04.033417+0000","modified":"2024-03-27T19:51:48.898874+0000","last_up_change":"2024-03-27T09:59:16.969624+0000","last_in_change":"2024-03-27T09:59:07.421690+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-27T09:59:17.253008+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"47b44362-7302-4f2a-b735-582c6c3850cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6800","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6801","nonce":2020036298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6802","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6803","nonce":2020036298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6806","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6807","nonce":2020036298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6804","nonce":2020036298},{"type":"v1","addr":"172.21.15.57:6805","nonce":2020036298}]},"public_addr":"172.21.15.57:6801/2020036298","cluster_addr":"172.21.15.57:6803/2020036298","heartbeat_back_addr":"172.21.15.57:6807/2020036298","heartbeat_front_addr":"172.21.15.57:6805/2020036298","state":["exists","up"]},{"osd":1,"uuid":"feaf96f0-9431-4188-9a09-da505b40e934","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6808","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6809","nonce":3190929242}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6810","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6811","nonce":3190929242}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6814","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6815","nonce":3190929242}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6812","nonce":3190929242},{"type":"v1","addr":"172.21.15.57:6813","nonce":3190929242}]},"public_addr":"172.21.15.57:6809/3190929242","cluster_addr":"172.21.15.57:6811/3190929242","heartbeat_back_addr":"172.21.15.57:6815/3190929242","heartbeat_front_addr":"172.21.15.57:6813/3190929242","state":["exists","up"]},{"osd":2,"uuid":"21e406e6-cfbc-4fe7-a816-e2420487c95d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6816","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6817","nonce":4065849973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6818","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6819","nonce":4065849973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6822","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6823","nonce":4065849973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6820","nonce":4065849973},{"type":"v1","addr":"172.21.15.57:6821","nonce":4065849973}]},"public_addr":"172.21.15.57:6817/4065849973","cluster_addr":"172.21.15.57:6819/4065849973","heartbeat_back_addr":"172.21.15.57:6823/4065849973","heartbeat_front_addr":"172.21.15.57:6821/4065849973","state":["exists","up"]},{"osd":3,"uuid":"a389af1d-76c4-4dfc-b215-f983f4931257","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6824","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6825","nonce":158084809}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6826","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6827","nonce":158084809}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6830","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6831","nonce":158084809}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6828","nonce":158084809},{"type":"v1","addr":"172.21.15.57:6829","nonce":158084809}]},"public_addr":"172.21.15.57:6825/158084809","cluster_addr":"172.21.15.57:6827/158084809","heartbeat_back_addr":"172.21.15.57:6831/158084809","heartbeat_front_addr":"172.21.15.57:6829/158084809","state":["exists","up"]},{"osd":4,"uuid":"e9b05dca-557a-43ee-b43f-9ce5b7d28304","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6821","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6823","nonce":108719401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6825","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6827","nonce":108719401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6830","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6831","nonce":108719401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6828","nonce":108719401},{"type":"v1","addr":"172.21.15.118:6829","nonce":108719401}]},"public_addr":"172.21.15.118:6823/108719401","cluster_addr":"172.21.15.118:6827/108719401","heartbeat_back_addr":"172.21.15.118:6831/108719401","heartbeat_front_addr":"172.21.15.118:6829/108719401","state":["exists","up"]},{"osd":5,"uuid":"d968177d-44ff-499a-b00a-b147ed879253","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6816","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6817","nonce":2704605866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6818","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6819","nonce":2704605866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6824","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6826","nonce":2704605866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6820","nonce":2704605866},{"type":"v1","addr":"172.21.15.118:6822","nonce":2704605866}]},"public_addr":"172.21.15.118:6817/2704605866","cluster_addr":"172.21.15.118:6819/2704605866","heartbeat_back_addr":"172.21.15.118:6826/2704605866","heartbeat_front_addr":"172.21.15.118:6822/2704605866","state":["exists","up"]},{"osd":6,"uuid":"e8f98052-e6ad-4cfe-a4a9-0b17a434d54e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6800","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6801","nonce":1963659095}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6802","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6803","nonce":1963659095}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6806","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6807","nonce":1963659095}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6804","nonce":1963659095},{"type":"v1","addr":"172.21.15.118:6805","nonce":1963659095}]},"public_addr":"172.21.15.118:6801/1963659095","cluster_addr":"172.21.15.118:6803/1963659095","heartbeat_back_addr":"172.21.15.118:6807/1963659095","heartbeat_front_addr":"172.21.15.118:6805/1963659095","state":["exists","up"]},{"osd":7,"uuid":"eccff987-8e51-4a63-845a-cf0a3196d7fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6808","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6809","nonce":1955879596}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6810","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6811","nonce":1955879596}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6814","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6815","nonce":1955879596}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6812","nonce":1955879596},{"type":"v1","addr":"172.21.15.118:6813","nonce":1955879596}]},"public_addr":"172.21.15.118:6809/1955879596","cluster_addr":"172.21.15.118:6811/1955879596","heartbeat_back_addr":"172.21.15.118:6815/1955879596","heartbeat_front_addr":"172.21.15.118:6813/1955879596","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.721258+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.696610+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.777895+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.806769+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.743259+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.845687+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:13.020165+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T09:59:12.722294+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.57:6837/385124398":"2024-03-28T19:51:45.858172+0000","172.21.15.57:6836/385124398":"2024-03-28T19:51:45.858172+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-27T19:51:54.768 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.767+0000 7fb19b000640 1 -- 172.21.15.57:0/836559282 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fb17006c560 msgr2=0x7fb17006ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:54.769 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.767+0000 7fb19b000640 1 --2- 172.21.15.57:0/836559282 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fb17006c560 0x7fb17006ea20 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fb184036000 tx=0x7fb184030000 comp rx=0 tx=0).stop 2024-03-27T19:51:54.769 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.767+0000 7fb19b000640 1 -- 172.21.15.57:0/836559282 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb194140740 msgr2=0x7fb1941585b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:54.769 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.767+0000 7fb19b000640 1 --2- 172.21.15.57:0/836559282 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb194140740 0x7fb1941585b0 secure :-1 s=READY pgs=2230 cs=0 l=1 rev1=1 crypto rx=0x7fb17c000f60 tx=0x7fb17c00dd40 comp rx=0 tx=0).stop 2024-03-27T19:51:54.769 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.767+0000 7fb19b000640 1 -- 172.21.15.57:0/836559282 shutdown_connections 2024-03-27T19:51:54.769 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.767+0000 7fb19b000640 1 --2- 172.21.15.57:0/836559282 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fb17006c560 0x7fb17006ea20 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:54.769 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.767+0000 7fb19b000640 1 --2- 172.21.15.57:0/836559282 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fb194158af0 0x7fb1940ce5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:54.770 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.767+0000 7fb19b000640 1 --2- 172.21.15.57:0/836559282 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fb194140740 0x7fb1941585b0 unknown :-1 s=CLOSED pgs=2230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:54.770 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.767+0000 7fb19b000640 1 --2- 172.21.15.57:0/836559282 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fb1780039b0 0x7fb19415a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:54.770 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.767+0000 7fb19b000640 1 -- 172.21.15.57:0/836559282 >> 172.21.15.57:0/836559282 conn(0x7fb1940b1c60 msgr2=0x7fb19406df20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T19:51:54.770 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.767+0000 7fb19b000640 1 -- 172.21.15.57:0/836559282 shutdown_connections 2024-03-27T19:51:54.770 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:54.767+0000 7fb19b000640 1 -- 172.21.15.57:0/836559282 wait complete. 2024-03-27T19:51:55.789 INFO:tasks.ceph:Scrubbing osd.0 2024-03-27T19:51:55.790 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-03-27T19:51:56.008 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.002+0000 7f28a9c00640 1 Processor -- start 2024-03-27T19:51:56.008 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.002+0000 7f28a9c00640 1 -- start start 2024-03-27T19:51:56.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.003+0000 7f28a9c00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f28a40b5500 0x7f28a415e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:56.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.003+0000 7f28a9c00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f28a415e7d0 0x7f28a40b3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:56.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.003+0000 7f28a9c00640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28a415ec60 con 0x7f28a40d2260 2024-03-27T19:51:56.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.003+0000 7f28a9c00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f28a40d3290 con 0x7f28a40b5500 2024-03-27T19:51:56.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.003+0000 7f28a9c00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f28a40cf8c0 con 0x7f28a415e7d0 2024-03-27T19:51:56.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.004+0000 7f28a2a00640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f28a40d2260 0x7f28a40d2640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:37722/0 (socket says 172.21.15.57:37722) 2024-03-27T19:51:56.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.004+0000 7f28a2a00640 1 -- 172.21.15.57:0/1563661995 learned_addr learned my addr 172.21.15.57:0/1563661995 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T19:51:56.009 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.004+0000 7f28a2000640 1 --2- 172.21.15.57:0/1563661995 >> v2:172.21.15.118:3300/0 conn(0x7f28a40b5500 0x7f28a415e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:56.010 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.004+0000 7f28a1600640 1 -- 172.21.15.57:0/1563661995 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1175720892 0 0) 0x7f28a415ec60 con 0x7f28a40d2260 2024-03-27T19:51:56.010 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.004+0000 7f28a1600640 1 -- 172.21.15.57:0/1563661995 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2888003520 con 0x7f28a40d2260 2024-03-27T19:51:56.010 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.004+0000 7f28a3400640 1 --2- 172.21.15.57:0/1563661995 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f28a415e7d0 0x7f28a40b3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:56.010 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.005+0000 7f28a1600640 1 -- 172.21.15.57:0/1563661995 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 27347450 0 0) 0x7f2888003520 con 0x7f28a40d2260 2024-03-27T19:51:56.010 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.005+0000 7f28a1600640 1 -- 172.21.15.57:0/1563661995 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f28a415e7d0 msgr2=0x7f28a40b3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T19:51:56.010 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.005+0000 7f28a1600640 1 --2- 172.21.15.57:0/1563661995 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f28a415e7d0 0x7f28a40b3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:56.010 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.005+0000 7f28a1600640 1 -- 172.21.15.57:0/1563661995 >> v2:172.21.15.118:3300/0 conn(0x7f28a40b5500 msgr2=0x7f28a415e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T19:51:56.011 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.005+0000 7f28a1600640 1 --2- 172.21.15.57:0/1563661995 >> v2:172.21.15.118:3300/0 conn(0x7f28a40b5500 0x7f28a415e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:56.011 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.005+0000 7f28a1600640 1 -- 172.21.15.57:0/1563661995 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28a40d2fb0 con 0x7f28a40d2260 2024-03-27T19:51:56.011 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.005+0000 7f28a1600640 1 -- 172.21.15.57:0/1563661995 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4227751516 0 0) 0x7f2894001670 con 0x7f28a40d2260 2024-03-27T19:51:56.011 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.005+0000 7f28a1600640 1 -- 172.21.15.57:0/1563661995 >> v1:172.21.15.57:6789/0 conn(0x7f28a40d2260 legacy=0x7f28a40d2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:56.011 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.005+0000 7f28a1600640 1 --2- 172.21.15.57:0/1563661995 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f28880039b0 0x7f2888003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:56.011 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.005+0000 7f28a1600640 1 --2- 172.21.15.57:0/1563661995 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2888004800 0x7f2888004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:56.011 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.005+0000 7f28a1600640 1 --2- 172.21.15.57:0/1563661995 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f28880051c0 0x7f288800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:56.012 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.005+0000 7f28a1600640 1 -- 172.21.15.57:0/1563661995 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f28a40cf8c0 con 0x7f28880051c0 2024-03-27T19:51:56.012 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.005+0000 7f28a1600640 1 -- 172.21.15.57:0/1563661995 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f288800bf00 con 0x7f28880039b0 2024-03-27T19:51:56.012 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.005+0000 7f28a1600640 1 -- 172.21.15.57:0/1563661995 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f288800c0b0 con 0x7f2888004800 2024-03-27T19:51:56.012 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.005+0000 7f28a3400640 1 --2- 172.21.15.57:0/1563661995 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f28880051c0 0x7f288800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:56.012 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.006+0000 7f28a2a00640 1 --2- 172.21.15.57:0/1563661995 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f28880039b0 0x7f2888003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:56.012 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.006+0000 7f28a2000640 1 --2- 172.21.15.57:0/1563661995 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2888004800 0x7f2888004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:56.012 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.006+0000 7f28a3400640 1 -- 172.21.15.57:0/1563661995 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2888004800 msgr2=0x7f2888004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T19:51:56.012 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.006+0000 7f28a3400640 1 --2- 172.21.15.57:0/1563661995 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f2888004800 0x7f2888004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:56.013 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.006+0000 7f28a3400640 1 -- 172.21.15.57:0/1563661995 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f28880039b0 msgr2=0x7f2888003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T19:51:56.013 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.006+0000 7f28a3400640 1 --2- 172.21.15.57:0/1563661995 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f28880039b0 0x7f2888003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:56.013 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.006+0000 7f28a3400640 1 -- 172.21.15.57:0/1563661995 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2888003520 con 0x7f28880051c0 2024-03-27T19:51:56.013 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.007+0000 7f28a3400640 1 --2- 172.21.15.57:0/1563661995 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f28880051c0 0x7f288800b9c0 secure :-1 s=READY pgs=2232 cs=0 l=1 rev1=1 crypto rx=0x7f289c009e90 tx=0x7f2888005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=125917c564eb4410 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:51:56.016 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.007+0000 7f28a1600640 1 -- 172.21.15.57:0/1563661995 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f289c039070 con 0x7f28880051c0 2024-03-27T19:51:56.017 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.007+0000 7f28a1600640 1 -- 172.21.15.57:0/1563661995 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f289c02cb50 con 0x7f28880051c0 2024-03-27T19:51:56.017 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.007+0000 7f28a1600640 1 -- 172.21.15.57:0/1563661995 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f289c009ae0 con 0x7f28880051c0 2024-03-27T19:51:56.017 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.008+0000 7f28a9c00640 1 -- 172.21.15.57:0/1563661995 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f28880051c0 msgr2=0x7f288800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:56.017 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.008+0000 7f28a9c00640 1 --2- 172.21.15.57:0/1563661995 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f28880051c0 0x7f288800b9c0 secure :-1 s=READY pgs=2232 cs=0 l=1 rev1=1 crypto rx=0x7f289c009e90 tx=0x7f2888005830 comp rx=0 tx=0).stop 2024-03-27T19:51:56.017 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.008+0000 7f28a3400640 1 -- 172.21.15.57:0/1563661995 reap_dead start 2024-03-27T19:51:56.017 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.009+0000 7f28a9c00640 1 -- 172.21.15.57:0/1563661995 shutdown_connections 2024-03-27T19:51:56.017 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.009+0000 7f28a9c00640 1 -- 172.21.15.57:0/1563661995 >> 172.21.15.57:0/1563661995 conn(0x7f28a40d40f0 msgr2=0x7f28a40d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T19:51:56.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.009+0000 7f28a9c00640 1 -- 172.21.15.57:0/1563661995 shutdown_connections 2024-03-27T19:51:56.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.009+0000 7f28a9c00640 1 -- 172.21.15.57:0/1563661995 wait complete. 2024-03-27T19:51:56.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.010+0000 7f28a9c00640 1 Processor -- start 2024-03-27T19:51:56.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.011+0000 7f28a9c00640 1 -- start start 2024-03-27T19:51:56.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.011+0000 7f28a9c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f28880051c0 0x7f28a4155530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:56.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.011+0000 7f28a9c00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f28a40b2250 0x7f28a40b26d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:56.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.012+0000 7f28a9c00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f28a41f8170 0x7f28a41f85f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:56.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.012+0000 7f28a9c00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f28a40d2d50 con 0x7f28a40b2250 2024-03-27T19:51:56.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.012+0000 7f28a9c00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f28a40d0160 con 0x7f28880051c0 2024-03-27T19:51:56.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.012+0000 7f28a9c00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f28a40cfdf0 con 0x7f28a41f8170 2024-03-27T19:51:56.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.012+0000 7f28a2000640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f28a40b2250 0x7f28a40b26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:56.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.012+0000 7f28a2000640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f28a40b2250 0x7f28a40b26d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55938/0 (socket says 172.21.15.57:55938) 2024-03-27T19:51:56.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.012+0000 7f28a2000640 1 -- 172.21.15.57:0/2152791171 learned_addr learned my addr 172.21.15.57:0/2152791171 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T19:51:56.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.012+0000 7f28a2a00640 1 --2- 172.21.15.57:0/2152791171 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f28880051c0 0x7f28a4155530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:56.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.012+0000 7f28a3400640 1 --2- 172.21.15.57:0/2152791171 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f28a41f8170 0x7f28a41f85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:56.019 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.012+0000 7f28a2000640 1 -- 172.21.15.57:0/2152791171 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f28a41f8170 msgr2=0x7f28a41f85f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:56.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.012+0000 7f28a2000640 1 --2- 172.21.15.57:0/2152791171 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f28a41f8170 0x7f28a41f85f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:56.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.013+0000 7f28a2000640 1 -- 172.21.15.57:0/2152791171 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f28880051c0 msgr2=0x7f28a4155530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:56.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.013+0000 7f28a2000640 1 --2- 172.21.15.57:0/2152791171 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f28880051c0 0x7f28a4155530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:56.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.013+0000 7f28a2000640 1 -- 172.21.15.57:0/2152791171 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28a41f8ea0 con 0x7f28a40b2250 2024-03-27T19:51:56.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.013+0000 7f28a2000640 1 --2- 172.21.15.57:0/2152791171 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f28a40b2250 0x7f28a40b26d0 secure :-1 s=READY pgs=2233 cs=0 l=1 rev1=1 crypto rx=0x7f2890011730 tx=0x7f2890011bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:51:56.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.013+0000 7f289aa00640 1 -- 172.21.15.57:0/2152791171 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f289000f9c0 con 0x7f28a40b2250 2024-03-27T19:51:56.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.013+0000 7f289aa00640 1 -- 172.21.15.57:0/2152791171 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f289000fb60 con 0x7f28a40b2250 2024-03-27T19:51:56.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.013+0000 7f289aa00640 1 -- 172.21.15.57:0/2152791171 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2890015460 con 0x7f28a40b2250 2024-03-27T19:51:56.020 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.013+0000 7f28a9c00640 1 -- 172.21.15.57:0/2152791171 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28a40b6cd0 con 0x7f28a40b2250 2024-03-27T19:51:56.021 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.013+0000 7f28a9c00640 1 -- 172.21.15.57:0/2152791171 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28a40b7290 con 0x7f28a40b2250 2024-03-27T19:51:56.021 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.014+0000 7f28a9c00640 1 -- 172.21.15.57:0/2152791171 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f28a4068620 con 0x7f28a40b2250 2024-03-27T19:51:56.022 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.016+0000 7f289aa00640 1 -- 172.21.15.57:0/2152791171 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f2890015600 con 0x7f28a40b2250 2024-03-27T19:51:56.022 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.017+0000 7f289aa00640 1 --2- 172.21.15.57:0/2152791171 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f288406c560 0x7f288406ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:56.022 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.017+0000 7f289aa00640 1 -- 172.21.15.57:0/2152791171 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5335+0+0 (secure 0 0 0) 0x7f289008c070 con 0x7f28a40b2250 2024-03-27T19:51:56.022 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.017+0000 7f28a2a00640 1 --2- 172.21.15.57:0/2152791171 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f288406c560 0x7f288406ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:56.023 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.017+0000 7f289aa00640 1 --2- 172.21.15.57:0/2152791171 >> [v2:172.21.15.57:6800/2020036298,v1:172.21.15.57:6801/2020036298] conn(0x7f2884072a00 0x7f2884074e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:56.023 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.017+0000 7f289aa00640 1 -- 172.21.15.57:0/2152791171 --> [v2:172.21.15.57:6800/2020036298,v1:172.21.15.57:6801/2020036298] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2890024ec0 con 0x7f2884072a00 2024-03-27T19:51:56.023 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.017+0000 7f289aa00640 1 -- 172.21.15.57:0/2152791171 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f289008c500 con 0x7f28a40b2250 2024-03-27T19:51:56.023 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.017+0000 7f28a3400640 1 --2- 172.21.15.57:0/2152791171 >> [v2:172.21.15.57:6800/2020036298,v1:172.21.15.57:6801/2020036298] conn(0x7f2884072a00 0x7f2884074e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:56.023 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.018+0000 7f28a2a00640 1 --2- 172.21.15.57:0/2152791171 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f288406c560 0x7f288406ea20 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f2894001eb0 tx=0x7f2894009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:51:56.023 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.018+0000 7f28a3400640 1 --2- 172.21.15.57:0/2152791171 >> [v2:172.21.15.57:6800/2020036298,v1:172.21.15.57:6801/2020036298] conn(0x7f2884072a00 0x7f2884074e40 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:51:56.047 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.046+0000 7f289aa00640 1 -- 172.21.15.57:0/2152791171 <== osd.0 v2:172.21.15.57:6800/2020036298 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2890024ec0 con 0x7f2884072a00 2024-03-27T19:51:56.062 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.061+0000 7f28a9c00640 1 -- 172.21.15.57:0/2152791171 --> [v2:172.21.15.57:6800/2020036298,v1:172.21.15.57:6801/2020036298] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f28a40b76d0 con 0x7f2884072a00 2024-03-27T19:51:56.071 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.069+0000 7f289aa00640 1 -- 172.21.15.57:0/2152791171 <== osd.0 v2:172.21.15.57:6800/2020036298 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f28a40b76d0 con 0x7f2884072a00 2024-03-27T19:51:56.072 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-03-27T19:51:56.073 INFO:teuthology.orchestra.run.smithi057.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-27T19:51:56.073 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-03-27T19:51:56.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.070+0000 7f28a9c00640 1 -- 172.21.15.57:0/2152791171 >> [v2:172.21.15.57:6800/2020036298,v1:172.21.15.57:6801/2020036298] conn(0x7f2884072a00 msgr2=0x7f2884074e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:56.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.070+0000 7f28a9c00640 1 --2- 172.21.15.57:0/2152791171 >> [v2:172.21.15.57:6800/2020036298,v1:172.21.15.57:6801/2020036298] conn(0x7f2884072a00 0x7f2884074e40 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:56.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.070+0000 7f28a9c00640 1 -- 172.21.15.57:0/2152791171 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f288406c560 msgr2=0x7f288406ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:56.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.070+0000 7f28a9c00640 1 --2- 172.21.15.57:0/2152791171 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f288406c560 0x7f288406ea20 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f2894001eb0 tx=0x7f2894009040 comp rx=0 tx=0).stop 2024-03-27T19:51:56.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.070+0000 7f28a9c00640 1 -- 172.21.15.57:0/2152791171 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f28a40b2250 msgr2=0x7f28a40b26d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:56.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.070+0000 7f28a9c00640 1 --2- 172.21.15.57:0/2152791171 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f28a40b2250 0x7f28a40b26d0 secure :-1 s=READY pgs=2233 cs=0 l=1 rev1=1 crypto rx=0x7f2890011730 tx=0x7f2890011bf0 comp rx=0 tx=0).stop 2024-03-27T19:51:56.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.070+0000 7f28a3400640 1 -- 172.21.15.57:0/2152791171 reap_dead start 2024-03-27T19:51:56.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.070+0000 7f28a9c00640 1 -- 172.21.15.57:0/2152791171 shutdown_connections 2024-03-27T19:51:56.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.070+0000 7f28a9c00640 1 -- 172.21.15.57:0/2152791171 >> 172.21.15.57:0/2152791171 conn(0x7f28a40d40f0 msgr2=0x7f28a40b4710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T19:51:56.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.070+0000 7f28a9c00640 1 -- 172.21.15.57:0/2152791171 shutdown_connections 2024-03-27T19:51:56.078 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.071+0000 7f28a9c00640 1 -- 172.21.15.57:0/2152791171 wait complete. 2024-03-27T19:51:56.091 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-03-27T19:51:56.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.285+0000 7effcf200640 1 Processor -- start 2024-03-27T19:51:56.287 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.286+0000 7effcf200640 1 -- start start 2024-03-27T19:51:56.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.287+0000 7effcf200640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7effd0067280 0x7effd00cd620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:56.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.287+0000 7effcf200640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effd015e790 con 0x7effd006bc50 2024-03-27T19:51:56.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.287+0000 7effcf200640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effd00b0320 con 0x7effd015e3b0 2024-03-27T19:51:56.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.287+0000 7effcf200640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7effd00afd80 con 0x7effd0067280 2024-03-27T19:51:56.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.287+0000 7effcd400640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7effd006bc50 0x7effd00b5060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:37734/0 (socket says 172.21.15.57:37734) 2024-03-27T19:51:56.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.287+0000 7effcd400640 1 -- 172.21.15.57:0/2647602090 learned_addr learned my addr 172.21.15.57:0/2647602090 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T19:51:56.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.288+0000 7effce800640 1 --2- 172.21.15.57:0/2647602090 >> v2:172.21.15.118:3300/0 conn(0x7effd0067280 0x7effd00cd620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:56.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.288+0000 7effcca00640 1 -- 172.21.15.57:0/2647602090 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4220819719 0 0) 0x7effd015e790 con 0x7effd006bc50 2024-03-27T19:51:56.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.288+0000 7effcca00640 1 -- 172.21.15.57:0/2647602090 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7effb4003520 con 0x7effd006bc50 2024-03-27T19:51:56.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.288+0000 7effcca00640 1 -- 172.21.15.57:0/2647602090 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1662256891 0 0) 0x7effb4003520 con 0x7effd006bc50 2024-03-27T19:51:56.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.288+0000 7effcca00640 1 -- 172.21.15.57:0/2647602090 >> v2:172.21.15.118:3300/0 conn(0x7effd0067280 msgr2=0x7effd00cd620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T19:51:56.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.288+0000 7effcca00640 1 --2- 172.21.15.57:0/2647602090 >> v2:172.21.15.118:3300/0 conn(0x7effd0067280 0x7effd00cd620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:56.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.288+0000 7effcca00640 1 -- 172.21.15.57:0/2647602090 >> v1:172.21.15.118:6789/0 conn(0x7effd015e3b0 legacy=0x7effd006b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:56.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.288+0000 7effcca00640 1 -- 172.21.15.57:0/2647602090 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effd00b0600 con 0x7effd006bc50 2024-03-27T19:51:56.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.288+0000 7effcca00640 1 -- 172.21.15.57:0/2647602090 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4227751516 0 0) 0x7effbc001670 con 0x7effd006bc50 2024-03-27T19:51:56.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.288+0000 7effcca00640 1 -- 172.21.15.57:0/2647602090 >> v1:172.21.15.57:6789/0 conn(0x7effd006bc50 legacy=0x7effd00b5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:56.293 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.288+0000 7effcca00640 1 --2- 172.21.15.57:0/2647602090 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7effb4003a00 0x7effb4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:56.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.288+0000 7effcca00640 1 --2- 172.21.15.57:0/2647602090 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7effb4004800 0x7effb4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:56.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.288+0000 7effcca00640 1 --2- 172.21.15.57:0/2647602090 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7effb40051c0 0x7effb400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:56.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.288+0000 7effcca00640 1 -- 172.21.15.57:0/2647602090 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7effb400c070 con 0x7effb40051c0 2024-03-27T19:51:56.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.288+0000 7effcca00640 1 -- 172.21.15.57:0/2647602090 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7effb400c220 con 0x7effb4003a00 2024-03-27T19:51:56.294 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.288+0000 7effcca00640 1 -- 172.21.15.57:0/2647602090 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7effb400c420 con 0x7effb4004800 2024-03-27T19:51:56.295 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.289+0000 7effce800640 1 --2- 172.21.15.57:0/2647602090 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7effb40051c0 0x7effb400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:56.295 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.289+0000 7effcde00640 1 --2- 172.21.15.57:0/2647602090 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7effb4003a00 0x7effb4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:56.295 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.289+0000 7effce800640 1 -- 172.21.15.57:0/2647602090 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7effb4004800 msgr2=0x7effb4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T19:51:56.295 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.289+0000 7effce800640 1 --2- 172.21.15.57:0/2647602090 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7effb4004800 0x7effb4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:56.295 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.289+0000 7effce800640 1 -- 172.21.15.57:0/2647602090 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7effb4003a00 msgr2=0x7effb4003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T19:51:56.295 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.289+0000 7effce800640 1 --2- 172.21.15.57:0/2647602090 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7effb4003a00 0x7effb4003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:56.295 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.289+0000 7effce800640 1 -- 172.21.15.57:0/2647602090 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effb4003520 con 0x7effb40051c0 2024-03-27T19:51:56.295 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.290+0000 7effce800640 1 -- 172.21.15.57:0/2647602090 reap_dead start 2024-03-27T19:51:56.295 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.290+0000 7effce800640 1 --2- 172.21.15.57:0/2647602090 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7effb40051c0 0x7effb400b9c0 secure :-1 s=READY pgs=2235 cs=0 l=1 rev1=1 crypto rx=0x7effc8009fc0 tx=0x7effb4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b968a603a536d488 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:51:56.296 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.290+0000 7effcca00640 1 -- 172.21.15.57:0/2647602090 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effc8009c10 con 0x7effb40051c0 2024-03-27T19:51:56.296 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.290+0000 7effcca00640 1 -- 172.21.15.57:0/2647602090 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effc802cca0 con 0x7effb40051c0 2024-03-27T19:51:56.296 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.290+0000 7effcca00640 1 -- 172.21.15.57:0/2647602090 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effc8003bd0 con 0x7effb40051c0 2024-03-27T19:51:56.296 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.291+0000 7effcf200640 1 -- 172.21.15.57:0/2647602090 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7effb40051c0 msgr2=0x7effb400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:56.296 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.291+0000 7effcf200640 1 --2- 172.21.15.57:0/2647602090 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7effb40051c0 0x7effb400b9c0 secure :-1 s=READY pgs=2235 cs=0 l=1 rev1=1 crypto rx=0x7effc8009fc0 tx=0x7effb4005830 comp rx=0 tx=0).stop 2024-03-27T19:51:56.296 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.291+0000 7effcf200640 1 -- 172.21.15.57:0/2647602090 shutdown_connections 2024-03-27T19:51:56.296 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.291+0000 7effcf200640 1 --2- 172.21.15.57:0/2647602090 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7effb40051c0 0x7effb400b9c0 unknown :-1 s=CLOSED pgs=2235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:56.296 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.291+0000 7effcf200640 1 -- 172.21.15.57:0/2647602090 >> 172.21.15.57:0/2647602090 conn(0x7effd00b1ec0 msgr2=0x7effd00b22a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T19:51:56.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.291+0000 7effcf200640 1 -- 172.21.15.57:0/2647602090 shutdown_connections 2024-03-27T19:51:56.297 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.291+0000 7effcf200640 1 -- 172.21.15.57:0/2647602090 wait complete. 2024-03-27T19:51:56.299 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.293+0000 7effcf200640 1 Processor -- start 2024-03-27T19:51:56.299 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.293+0000 7effcf200640 1 -- start start 2024-03-27T19:51:56.299 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.294+0000 7effcf200640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7effb40051c0 0x7effd015c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:56.299 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.294+0000 7effcf200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7effd01e77d0 0x7effd00c6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:56.299 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.294+0000 7effcf200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7effd01e7c50 0x7effd00c65b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:56.299 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.294+0000 7effcf200640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7effd00b0f30 con 0x7effb40051c0 2024-03-27T19:51:56.299 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.294+0000 7effcf200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7effd00b0bc0 con 0x7effd01e7c50 2024-03-27T19:51:56.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.294+0000 7effcf200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7effd00b13c0 con 0x7effd01e77d0 2024-03-27T19:51:56.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.294+0000 7effcde00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7effb40051c0 0x7effd015c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:56.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.294+0000 7effcde00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7effb40051c0 0x7effd015c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55968/0 (socket says 172.21.15.57:55968) 2024-03-27T19:51:56.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.294+0000 7effcde00640 1 -- 172.21.15.57:0/4181225438 learned_addr learned my addr 172.21.15.57:0/4181225438 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T19:51:56.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.294+0000 7effcde00640 1 -- 172.21.15.57:0/4181225438 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7effd01e77d0 msgr2=0x7effd00c6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:56.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.294+0000 7effcde00640 1 --2- 172.21.15.57:0/4181225438 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7effd01e77d0 0x7effd00c6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:56.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.294+0000 7effcde00640 1 -- 172.21.15.57:0/4181225438 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7effd01e7c50 msgr2=0x7effd00c65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:56.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.294+0000 7effcde00640 1 --2- 172.21.15.57:0/4181225438 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7effd01e7c50 0x7effd00c65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:56.300 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.294+0000 7effcde00640 1 -- 172.21.15.57:0/4181225438 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effd01f3e10 con 0x7effb40051c0 2024-03-27T19:51:56.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.295+0000 7effcde00640 1 --2- 172.21.15.57:0/4181225438 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7effb40051c0 0x7effd015c1e0 secure :-1 s=READY pgs=2236 cs=0 l=1 rev1=1 crypto rx=0x7effc000e500 tx=0x7effc000e9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:51:56.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.295+0000 7effc6000640 1 -- 172.21.15.57:0/4181225438 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effc00052e0 con 0x7effb40051c0 2024-03-27T19:51:56.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.295+0000 7effc6000640 1 -- 172.21.15.57:0/4181225438 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effc0018070 con 0x7effb40051c0 2024-03-27T19:51:56.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.295+0000 7effc6000640 1 -- 172.21.15.57:0/4181225438 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effc0003810 con 0x7effb40051c0 2024-03-27T19:51:56.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.295+0000 7effcf200640 1 -- 172.21.15.57:0/4181225438 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effd01f40f0 con 0x7effb40051c0 2024-03-27T19:51:56.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.295+0000 7effcf200640 1 -- 172.21.15.57:0/4181225438 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effd01f46b0 con 0x7effb40051c0 2024-03-27T19:51:56.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.297+0000 7effcf200640 1 -- 172.21.15.57:0/4181225438 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effd0068c50 con 0x7effb40051c0 2024-03-27T19:51:56.301 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.297+0000 7effc6000640 1 -- 172.21.15.57:0/4181225438 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7effc00039b0 con 0x7effb40051c0 2024-03-27T19:51:56.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.298+0000 7effc6000640 1 --2- 172.21.15.57:0/4181225438 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7effb006c560 0x7effb006ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:56.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.298+0000 7effc6000640 1 -- 172.21.15.57:0/4181225438 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5335+0+0 (secure 0 0 0) 0x7effc008b280 con 0x7effb40051c0 2024-03-27T19:51:56.302 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.298+0000 7effcd400640 1 --2- 172.21.15.57:0/4181225438 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7effb006c560 0x7effb006ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:56.303 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.299+0000 7effcd400640 1 --2- 172.21.15.57:0/4181225438 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7effb006c560 0x7effb006ea20 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7effbc000fd0 tx=0x7effbc001540 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:51:56.304 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.303+0000 7effc6000640 1 -- 172.21.15.57:0/4181225438 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7effc0059980 con 0x7effb40051c0 2024-03-27T19:51:56.536 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.535+0000 7effcf200640 1 -- 172.21.15.57:0/4181225438 --> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7effd0067b10 con 0x7effb006c560 2024-03-27T19:51:56.537 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.536+0000 7effc6000640 1 -- 172.21.15.57:0/4181225438 <== mgr.4103 v2:172.21.15.57:6832/485397065 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7effd0067b10 con 0x7effb006c560 2024-03-27T19:51:56.537 INFO:teuthology.orchestra.run.smithi057.stderr:instructed osd(s) 0 to deep-scrub 2024-03-27T19:51:56.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.538+0000 7effcf200640 1 -- 172.21.15.57:0/4181225438 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7effb006c560 msgr2=0x7effb006ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:56.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.538+0000 7effcf200640 1 --2- 172.21.15.57:0/4181225438 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7effb006c560 0x7effb006ea20 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7effbc000fd0 tx=0x7effbc001540 comp rx=0 tx=0).stop 2024-03-27T19:51:56.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.538+0000 7effcf200640 1 -- 172.21.15.57:0/4181225438 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7effb40051c0 msgr2=0x7effd015c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:56.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.538+0000 7effcf200640 1 --2- 172.21.15.57:0/4181225438 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7effb40051c0 0x7effd015c1e0 secure :-1 s=READY pgs=2236 cs=0 l=1 rev1=1 crypto rx=0x7effc000e500 tx=0x7effc000e9c0 comp rx=0 tx=0).stop 2024-03-27T19:51:56.540 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.539+0000 7effcf200640 1 -- 172.21.15.57:0/4181225438 shutdown_connections 2024-03-27T19:51:56.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.539+0000 7effcf200640 1 --2- 172.21.15.57:0/4181225438 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7effb006c560 0x7effb006ea20 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:56.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.539+0000 7effcf200640 1 --2- 172.21.15.57:0/4181225438 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7effd01e7c50 0x7effd00c65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:56.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.539+0000 7effcf200640 1 --2- 172.21.15.57:0/4181225438 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7effd01e77d0 0x7effd00c6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:56.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.539+0000 7effcf200640 1 --2- 172.21.15.57:0/4181225438 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7effb40051c0 0x7effd015c1e0 unknown :-1 s=CLOSED pgs=2236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:56.541 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.539+0000 7effcf200640 1 -- 172.21.15.57:0/4181225438 >> 172.21.15.57:0/4181225438 conn(0x7effd00b1ec0 msgr2=0x7effd00b5010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T19:51:56.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.539+0000 7effcf200640 1 -- 172.21.15.57:0/4181225438 shutdown_connections 2024-03-27T19:51:56.542 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.539+0000 7effcf200640 1 -- 172.21.15.57:0/4181225438 wait complete. 2024-03-27T19:51:56.559 INFO:tasks.ceph:Scrubbing osd.1 2024-03-27T19:51:56.560 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-03-27T19:51:56.760 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.759+0000 7f29e7200640 1 Processor -- start 2024-03-27T19:51:56.761 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.759+0000 7f29e7200640 1 -- start start 2024-03-27T19:51:56.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.761+0000 7f29e7200640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f29e81459d0 0x7f29e80ce420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:56.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.761+0000 7f29e7200640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29e80cea90 con 0x7f29e806dff0 2024-03-27T19:51:56.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.761+0000 7f29e7200640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29e80ced70 con 0x7f29e80cc890 2024-03-27T19:51:56.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.761+0000 7f29e7200640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f29e80cf050 con 0x7f29e81459d0 2024-03-27T19:51:56.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.762+0000 7f29e5e00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f29e81459d0 0x7f29e80ce420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:56.763 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.762+0000 7f29e6800640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f29e806dff0 0x7f29e8165bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:37740/0 (socket says 172.21.15.57:37740) 2024-03-27T19:51:56.764 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.762+0000 7f29e6800640 1 -- 172.21.15.57:0/3958186058 learned_addr learned my addr 172.21.15.57:0/3958186058 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T19:51:56.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.762+0000 7f29e5e00640 1 -- 172.21.15.57:0/3958186058 >> v1:172.21.15.118:6789/0 conn(0x7f29e80cc890 legacy=0x7f29e815c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T19:51:56.766 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.762+0000 7f29e5e00640 1 -- 172.21.15.57:0/3958186058 >> v1:172.21.15.57:6789/0 conn(0x7f29e806dff0 legacy=0x7f29e8165bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:56.767 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.762+0000 7f29e5e00640 1 -- 172.21.15.57:0/3958186058 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29e80cf330 con 0x7f29e81459d0 2024-03-27T19:51:56.767 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.762+0000 7f29e4a00640 1 -- 172.21.15.57:0/3958186058 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 91088836 0 0) 0x7f29e80cea90 con 0x7f29e806dff0 2024-03-27T19:51:56.767 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.763+0000 7f29e5e00640 1 --2- 172.21.15.57:0/3958186058 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29e81459d0 0x7f29e80ce420 secure :-1 s=READY pgs=2238 cs=0 l=1 rev1=1 crypto rx=0x7f29d80097a0 tx=0x7f29d802b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1fd7d74ca7b73c server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:51:56.767 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.764+0000 7f29e4a00640 1 -- 172.21.15.57:0/3958186058 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29d8038070 con 0x7f29e81459d0 2024-03-27T19:51:56.767 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.764+0000 7f29e4a00640 1 -- 172.21.15.57:0/3958186058 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29d8031700 con 0x7f29e81459d0 2024-03-27T19:51:56.767 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.764+0000 7f29e4a00640 1 -- 172.21.15.57:0/3958186058 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29d8031ad0 con 0x7f29e81459d0 2024-03-27T19:51:56.767 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.764+0000 7f29e7200640 1 -- 172.21.15.57:0/3958186058 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29e81459d0 msgr2=0x7f29e80ce420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:56.767 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.764+0000 7f29e7200640 1 --2- 172.21.15.57:0/3958186058 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29e81459d0 0x7f29e80ce420 secure :-1 s=READY pgs=2238 cs=0 l=1 rev1=1 crypto rx=0x7f29d80097a0 tx=0x7f29d802b7a0 comp rx=0 tx=0).stop 2024-03-27T19:51:56.767 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.764+0000 7f29e7200640 1 -- 172.21.15.57:0/3958186058 shutdown_connections 2024-03-27T19:51:56.768 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.764+0000 7f29e7200640 1 --2- 172.21.15.57:0/3958186058 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29e81459d0 0x7f29e80ce420 unknown :-1 s=CLOSED pgs=2238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:56.768 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.764+0000 7f29e7200640 1 -- 172.21.15.57:0/3958186058 >> 172.21.15.57:0/3958186058 conn(0x7f29e806b540 msgr2=0x7f29e806b950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T19:51:56.768 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.764+0000 7f29e7200640 1 -- 172.21.15.57:0/3958186058 shutdown_connections 2024-03-27T19:51:56.768 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.765+0000 7f29e7200640 1 -- 172.21.15.57:0/3958186058 wait complete. 2024-03-27T19:51:56.768 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.767+0000 7f29e7200640 1 Processor -- start 2024-03-27T19:51:56.769 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.767+0000 7f29e7200640 1 -- start start 2024-03-27T19:51:56.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.769+0000 7f29e7200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f29e806dff0 0x7f29e813d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:56.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.769+0000 7f29e7200640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29e80cc890 0x7f29e81419a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:56.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.769+0000 7f29e7200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f29e81459d0 0x7f29e8071640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:56.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.769+0000 7f29e7200640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f29e815ce50 con 0x7f29e80cc890 2024-03-27T19:51:56.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.769+0000 7f29e7200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f29e815ccd0 con 0x7f29e806dff0 2024-03-27T19:51:56.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.769+0000 7f29e7200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f29e815cfd0 con 0x7f29e81459d0 2024-03-27T19:51:56.771 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.769+0000 7f29e5400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29e80cc890 0x7f29e81419a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:56.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.769+0000 7f29e5400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29e80cc890 0x7f29e81419a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55976/0 (socket says 172.21.15.57:55976) 2024-03-27T19:51:56.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.769+0000 7f29e5400640 1 -- 172.21.15.57:0/3523069744 learned_addr learned my addr 172.21.15.57:0/3523069744 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T19:51:56.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.769+0000 7f29e5400640 1 -- 172.21.15.57:0/3523069744 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f29e81459d0 msgr2=0x7f29e8071640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:56.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.769+0000 7f29e5400640 1 --2- 172.21.15.57:0/3523069744 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f29e81459d0 0x7f29e8071640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:56.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.769+0000 7f29e5400640 1 -- 172.21.15.57:0/3523069744 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f29e806dff0 msgr2=0x7f29e813d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:56.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.769+0000 7f29e5400640 1 --2- 172.21.15.57:0/3523069744 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f29e806dff0 0x7f29e813d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:56.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.769+0000 7f29e5400640 1 -- 172.21.15.57:0/3523069744 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29e80b38b0 con 0x7f29e80cc890 2024-03-27T19:51:56.772 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.770+0000 7f29e5400640 1 --2- 172.21.15.57:0/3523069744 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29e80cc890 0x7f29e81419a0 secure :-1 s=READY pgs=2239 cs=0 l=1 rev1=1 crypto rx=0x7f29d400b420 tx=0x7f29d400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:51:56.774 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.770+0000 7f29de000640 1 -- 172.21.15.57:0/3523069744 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29d4011830 con 0x7f29e80cc890 2024-03-27T19:51:56.774 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.770+0000 7f29de000640 1 -- 172.21.15.57:0/3523069744 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29d4016070 con 0x7f29e80cc890 2024-03-27T19:51:56.774 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.770+0000 7f29de000640 1 -- 172.21.15.57:0/3523069744 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29d4011c10 con 0x7f29e80cc890 2024-03-27T19:51:56.774 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.770+0000 7f29e7200640 1 -- 172.21.15.57:0/3523069744 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29e80b3b90 con 0x7f29e80cc890 2024-03-27T19:51:56.774 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.770+0000 7f29e7200640 1 -- 172.21.15.57:0/3523069744 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29e80b4150 con 0x7f29e80cc890 2024-03-27T19:51:56.774 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.771+0000 7f29e7200640 1 -- 172.21.15.57:0/3523069744 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f29e80b2680 con 0x7f29e80cc890 2024-03-27T19:51:56.774 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.772+0000 7f29de000640 1 -- 172.21.15.57:0/3523069744 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f29d401b460 con 0x7f29e80cc890 2024-03-27T19:51:56.775 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.774+0000 7f29de000640 1 --2- 172.21.15.57:0/3523069744 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f29c806c530 0x7f29c806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:56.776 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.774+0000 7f29de000640 1 -- 172.21.15.57:0/3523069744 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5335+0+0 (secure 0 0 0) 0x7f29d408b0a0 con 0x7f29e80cc890 2024-03-27T19:51:56.776 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.774+0000 7f29e5e00640 1 --2- 172.21.15.57:0/3523069744 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f29c806c530 0x7f29c806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:56.776 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.774+0000 7f29de000640 1 --2- 172.21.15.57:0/3523069744 >> [v2:172.21.15.57:6808/3190929242,v1:172.21.15.57:6809/3190929242] conn(0x7f29c80729d0 0x7f29c8074e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:56.776 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.774+0000 7f29de000640 1 -- 172.21.15.57:0/3523069744 --> [v2:172.21.15.57:6808/3190929242,v1:172.21.15.57:6809/3190929242] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f29c80754e0 con 0x7f29c80729d0 2024-03-27T19:51:56.776 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.774+0000 7f29de000640 1 -- 172.21.15.57:0/3523069744 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f29d4092050 con 0x7f29e80cc890 2024-03-27T19:51:56.776 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.774+0000 7f29e6800640 1 --2- 172.21.15.57:0/3523069744 >> [v2:172.21.15.57:6808/3190929242,v1:172.21.15.57:6809/3190929242] conn(0x7f29c80729d0 0x7f29c8074e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:56.777 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.775+0000 7f29e5e00640 1 --2- 172.21.15.57:0/3523069744 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f29c806c530 0x7f29c806e9f0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f29d8035000 tx=0x7f29d8030000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:51:56.777 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.775+0000 7f29e6800640 1 --2- 172.21.15.57:0/3523069744 >> [v2:172.21.15.57:6808/3190929242,v1:172.21.15.57:6809/3190929242] conn(0x7f29c80729d0 0x7f29c8074e10 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:51:56.778 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.776+0000 7f29de000640 1 -- 172.21.15.57:0/3523069744 <== osd.1 v2:172.21.15.57:6808/3190929242 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f29c80754e0 con 0x7f29c80729d0 2024-03-27T19:51:56.792 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.790+0000 7f29e7200640 1 -- 172.21.15.57:0/3523069744 --> [v2:172.21.15.57:6808/3190929242,v1:172.21.15.57:6809/3190929242] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f29e8068540 con 0x7f29c80729d0 2024-03-27T19:51:56.792 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.790+0000 7f29de000640 1 -- 172.21.15.57:0/3523069744 <== osd.1 v2:172.21.15.57:6808/3190929242 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f29e8068540 con 0x7f29c80729d0 2024-03-27T19:51:56.792 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-03-27T19:51:56.792 INFO:teuthology.orchestra.run.smithi057.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-27T19:51:56.793 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-03-27T19:51:56.794 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.791+0000 7f29e7200640 1 -- 172.21.15.57:0/3523069744 >> [v2:172.21.15.57:6808/3190929242,v1:172.21.15.57:6809/3190929242] conn(0x7f29c80729d0 msgr2=0x7f29c8074e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:56.794 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.791+0000 7f29e7200640 1 --2- 172.21.15.57:0/3523069744 >> [v2:172.21.15.57:6808/3190929242,v1:172.21.15.57:6809/3190929242] conn(0x7f29c80729d0 0x7f29c8074e10 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:56.794 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.791+0000 7f29e7200640 1 -- 172.21.15.57:0/3523069744 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f29c806c530 msgr2=0x7f29c806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:56.794 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.791+0000 7f29e7200640 1 --2- 172.21.15.57:0/3523069744 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f29c806c530 0x7f29c806e9f0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f29d8035000 tx=0x7f29d8030000 comp rx=0 tx=0).stop 2024-03-27T19:51:56.794 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.791+0000 7f29e7200640 1 -- 172.21.15.57:0/3523069744 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29e80cc890 msgr2=0x7f29e81419a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:56.794 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.791+0000 7f29e7200640 1 --2- 172.21.15.57:0/3523069744 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f29e80cc890 0x7f29e81419a0 secure :-1 s=READY pgs=2239 cs=0 l=1 rev1=1 crypto rx=0x7f29d400b420 tx=0x7f29d400b8e0 comp rx=0 tx=0).stop 2024-03-27T19:51:56.794 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.791+0000 7f29e6800640 1 -- 172.21.15.57:0/3523069744 reap_dead start 2024-03-27T19:51:56.794 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.791+0000 7f29e7200640 1 -- 172.21.15.57:0/3523069744 shutdown_connections 2024-03-27T19:51:56.795 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.791+0000 7f29e7200640 1 -- 172.21.15.57:0/3523069744 >> 172.21.15.57:0/3523069744 conn(0x7f29e806b540 msgr2=0x7f29e80aea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T19:51:56.795 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.791+0000 7f29e7200640 1 -- 172.21.15.57:0/3523069744 shutdown_connections 2024-03-27T19:51:56.795 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.791+0000 7f29e7200640 1 -- 172.21.15.57:0/3523069744 wait complete. 2024-03-27T19:51:56.809 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-03-27T19:51:57.000 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.999+0000 7fcb33e00640 1 Processor -- start 2024-03-27T19:51:57.001 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:56.999+0000 7fcb33e00640 1 -- start start 2024-03-27T19:51:57.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.000+0000 7fcb33e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcb3415c0e0 0x7fcb340d2860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:57.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.000+0000 7fcb33e00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fcb340cf220 0x7fcb3406f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:57.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.001+0000 7fcb33e00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb340d04c0 con 0x7fcb340ce6d0 2024-03-27T19:51:57.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.001+0000 7fcb33e00640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7fcb3406f2a0 con 0x7fcb340cf220 2024-03-27T19:51:57.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.001+0000 7fcb33e00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fcb340d07a0 con 0x7fcb3415c0e0 2024-03-27T19:51:57.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.001+0000 7fcb33400640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fcb340cf220 0x7fcb3406f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:57.003 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.001+0000 7fcb33400640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fcb340cf220 0x7fcb3406f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55978/0 (socket says 172.21.15.57:55978) 2024-03-27T19:51:57.004 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.001+0000 7fcb33400640 1 -- 172.21.15.57:0/3568348738 learned_addr learned my addr 172.21.15.57:0/3568348738 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T19:51:57.004 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.001+0000 7fcb32a00640 1 --2- 172.21.15.57:0/3568348738 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcb3415c0e0 0x7fcb340d2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:57.004 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.001+0000 7fcb33400640 1 -- 172.21.15.57:0/3568348738 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcb3415c0e0 msgr2=0x7fcb340d2860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T19:51:57.004 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.001+0000 7fcb33400640 1 --2- 172.21.15.57:0/3568348738 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcb3415c0e0 0x7fcb340d2860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:57.004 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.001+0000 7fcb33400640 1 -- 172.21.15.57:0/3568348738 >> v1:172.21.15.118:6789/0 conn(0x7fcb340ce6d0 legacy=0x7fcb340ceb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T19:51:57.004 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.001+0000 7fcb33400640 1 -- 172.21.15.57:0/3568348738 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb340d0a80 con 0x7fcb340cf220 2024-03-27T19:51:57.005 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.002+0000 7fcb33400640 1 --2- 172.21.15.57:0/3568348738 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb340cf220 0x7fcb3406f730 secure :-1 s=READY pgs=2240 cs=0 l=1 rev1=1 crypto rx=0x7fcb2c009e50 tx=0x7fcb2c02bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea470c4913d6aa8c server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:51:57.005 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.003+0000 7fcb31600640 1 -- 172.21.15.57:0/3568348738 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb2c02cb00 con 0x7fcb340cf220 2024-03-27T19:51:57.006 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.003+0000 7fcb31600640 1 -- 172.21.15.57:0/3568348738 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb2c02cca0 con 0x7fcb340cf220 2024-03-27T19:51:57.006 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.003+0000 7fcb31600640 1 -- 172.21.15.57:0/3568348738 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb2c034610 con 0x7fcb340cf220 2024-03-27T19:51:57.006 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.003+0000 7fcb33e00640 1 -- 172.21.15.57:0/3568348738 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb340cf220 msgr2=0x7fcb3406f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:57.006 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.003+0000 7fcb33e00640 1 --2- 172.21.15.57:0/3568348738 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb340cf220 0x7fcb3406f730 secure :-1 s=READY pgs=2240 cs=0 l=1 rev1=1 crypto rx=0x7fcb2c009e50 tx=0x7fcb2c02bf60 comp rx=0 tx=0).stop 2024-03-27T19:51:57.007 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.003+0000 7fcb33e00640 1 -- 172.21.15.57:0/3568348738 shutdown_connections 2024-03-27T19:51:57.007 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.003+0000 7fcb33e00640 1 --2- 172.21.15.57:0/3568348738 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb340cf220 0x7fcb3406f730 unknown :-1 s=CLOSED pgs=2240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:57.007 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.003+0000 7fcb33e00640 1 --2- 172.21.15.57:0/3568348738 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcb3415c0e0 0x7fcb340d2860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:57.007 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.003+0000 7fcb33e00640 1 -- 172.21.15.57:0/3568348738 >> 172.21.15.57:0/3568348738 conn(0x7fcb340d1d40 msgr2=0x7fcb340d2150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T19:51:57.007 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.003+0000 7fcb33e00640 1 -- 172.21.15.57:0/3568348738 shutdown_connections 2024-03-27T19:51:57.007 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.003+0000 7fcb33e00640 1 -- 172.21.15.57:0/3568348738 wait complete. 2024-03-27T19:51:57.010 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.005+0000 7fcb33e00640 1 Processor -- start 2024-03-27T19:51:57.010 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.005+0000 7fcb33e00640 1 -- start start 2024-03-27T19:51:57.010 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.006+0000 7fcb33e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb340ce6d0 0x7fcb340b6f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:57.011 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.006+0000 7fcb33e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcb340cf220 0x7fcb341548c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:57.011 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.006+0000 7fcb33e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcb3415c0e0 0x7fcb3406dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:57.011 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.006+0000 7fcb33e00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fcb3415c640 con 0x7fcb340ce6d0 2024-03-27T19:51:57.011 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.006+0000 7fcb33e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fcb3415c4c0 con 0x7fcb340cf220 2024-03-27T19:51:57.011 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.006+0000 7fcb33e00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fcb3406fc70 con 0x7fcb3415c0e0 2024-03-27T19:51:57.011 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.006+0000 7fcb32a00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb340ce6d0 0x7fcb340b6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:57.012 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.006+0000 7fcb32a00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb340ce6d0 0x7fcb340b6f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55990/0 (socket says 172.21.15.57:55990) 2024-03-27T19:51:57.012 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.006+0000 7fcb32a00640 1 -- 172.21.15.57:0/433632676 learned_addr learned my addr 172.21.15.57:0/433632676 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T19:51:57.012 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.007+0000 7fcb32000640 1 --2- 172.21.15.57:0/433632676 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcb340cf220 0x7fcb341548c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:57.012 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.007+0000 7fcb32a00640 1 -- 172.21.15.57:0/433632676 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcb3415c0e0 msgr2=0x7fcb3406dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:57.012 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.007+0000 7fcb33400640 1 --2- 172.21.15.57:0/433632676 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcb3415c0e0 0x7fcb3406dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:57.013 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.007+0000 7fcb32a00640 1 --2- 172.21.15.57:0/433632676 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcb3415c0e0 0x7fcb3406dd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:57.013 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.007+0000 7fcb32a00640 1 -- 172.21.15.57:0/433632676 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcb340cf220 msgr2=0x7fcb341548c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:57.013 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.007+0000 7fcb32a00640 1 --2- 172.21.15.57:0/433632676 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcb340cf220 0x7fcb341548c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:57.013 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.007+0000 7fcb32a00640 1 -- 172.21.15.57:0/433632676 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb340b7490 con 0x7fcb340ce6d0 2024-03-27T19:51:57.013 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.007+0000 7fcb32a00640 1 --2- 172.21.15.57:0/433632676 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb340ce6d0 0x7fcb340b6f50 secure :-1 s=READY pgs=2241 cs=0 l=1 rev1=1 crypto rx=0x7fcb2400c7f0 tx=0x7fcb2400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:51:57.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.007+0000 7fcb2aa00640 1 -- 172.21.15.57:0/433632676 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb24015070 con 0x7fcb340ce6d0 2024-03-27T19:51:57.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.007+0000 7fcb2aa00640 1 -- 172.21.15.57:0/433632676 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb24004220 con 0x7fcb340ce6d0 2024-03-27T19:51:57.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.007+0000 7fcb2aa00640 1 -- 172.21.15.57:0/433632676 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb24007620 con 0x7fcb340ce6d0 2024-03-27T19:51:57.014 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.007+0000 7fcb33e00640 1 -- 172.21.15.57:0/433632676 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb340b5eb0 con 0x7fcb340ce6d0 2024-03-27T19:51:57.015 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.008+0000 7fcb33e00640 1 -- 172.21.15.57:0/433632676 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb340b6470 con 0x7fcb340ce6d0 2024-03-27T19:51:57.015 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.009+0000 7fcb33e00640 1 -- 172.21.15.57:0/433632676 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb34068540 con 0x7fcb340ce6d0 2024-03-27T19:51:57.016 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.010+0000 7fcb2aa00640 1 -- 172.21.15.57:0/433632676 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fcb240079d0 con 0x7fcb340ce6d0 2024-03-27T19:51:57.016 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.011+0000 7fcb2aa00640 1 --2- 172.21.15.57:0/433632676 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fcb1406c560 0x7fcb1406ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:57.016 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.011+0000 7fcb2aa00640 1 -- 172.21.15.57:0/433632676 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5335+0+0 (secure 0 0 0) 0x7fcb2408b5d0 con 0x7fcb340ce6d0 2024-03-27T19:51:57.017 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.012+0000 7fcb32000640 1 --2- 172.21.15.57:0/433632676 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fcb1406c560 0x7fcb1406ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:57.017 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.012+0000 7fcb32000640 1 --2- 172.21.15.57:0/433632676 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fcb1406c560 0x7fcb1406ea20 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fcb3406cc10 tx=0x7fcb20009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:51:57.018 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.017+0000 7fcb2aa00640 1 -- 172.21.15.57:0/433632676 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7fcb24059cc0 con 0x7fcb340ce6d0 2024-03-27T19:51:57.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.212+0000 7fcb33e00640 1 -- 172.21.15.57:0/433632676 --> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7fcb34075270 con 0x7fcb1406c560 2024-03-27T19:51:57.214 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.212+0000 7fcb2aa00640 1 -- 172.21.15.57:0/433632676 <== mgr.4103 v2:172.21.15.57:6832/485397065 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fcb34075270 con 0x7fcb1406c560 2024-03-27T19:51:57.214 INFO:teuthology.orchestra.run.smithi057.stderr:instructed osd(s) 1 to deep-scrub 2024-03-27T19:51:57.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.214+0000 7fcb33e00640 1 -- 172.21.15.57:0/433632676 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fcb1406c560 msgr2=0x7fcb1406ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:57.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.214+0000 7fcb33e00640 1 --2- 172.21.15.57:0/433632676 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fcb1406c560 0x7fcb1406ea20 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fcb3406cc10 tx=0x7fcb20009040 comp rx=0 tx=0).stop 2024-03-27T19:51:57.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.214+0000 7fcb33e00640 1 -- 172.21.15.57:0/433632676 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb340ce6d0 msgr2=0x7fcb340b6f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:57.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.214+0000 7fcb33e00640 1 --2- 172.21.15.57:0/433632676 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb340ce6d0 0x7fcb340b6f50 secure :-1 s=READY pgs=2241 cs=0 l=1 rev1=1 crypto rx=0x7fcb2400c7f0 tx=0x7fcb2400ccb0 comp rx=0 tx=0).stop 2024-03-27T19:51:57.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.215+0000 7fcb33e00640 1 -- 172.21.15.57:0/433632676 shutdown_connections 2024-03-27T19:51:57.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.215+0000 7fcb33e00640 1 --2- 172.21.15.57:0/433632676 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcb3415c0e0 0x7fcb3406dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:57.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.215+0000 7fcb33e00640 1 --2- 172.21.15.57:0/433632676 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fcb1406c560 0x7fcb1406ea20 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:57.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.215+0000 7fcb33e00640 1 --2- 172.21.15.57:0/433632676 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcb340cf220 0x7fcb341548c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:57.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.215+0000 7fcb33e00640 1 --2- 172.21.15.57:0/433632676 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb340ce6d0 0x7fcb340b6f50 unknown :-1 s=CLOSED pgs=2241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:57.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.215+0000 7fcb33e00640 1 -- 172.21.15.57:0/433632676 >> 172.21.15.57:0/433632676 conn(0x7fcb340d1d40 msgr2=0x7fcb3415c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T19:51:57.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.215+0000 7fcb33e00640 1 -- 172.21.15.57:0/433632676 shutdown_connections 2024-03-27T19:51:57.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.215+0000 7fcb33e00640 1 -- 172.21.15.57:0/433632676 wait complete. 2024-03-27T19:51:57.235 INFO:tasks.ceph:Scrubbing osd.2 2024-03-27T19:51:57.235 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-03-27T19:51:57.444 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.443+0000 7f59ed400640 1 Processor -- start 2024-03-27T19:51:57.445 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.443+0000 7f59ed400640 1 -- start start 2024-03-27T19:51:57.446 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.445+0000 7f59ed400640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f59e815e040 0x7f59e80cf810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:57.446 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.445+0000 7f59ed400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f59e80cfd50 0x7f59e80d0940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:57.447 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.445+0000 7f59ed400640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59e80d2fa0 con 0x7f59e815e420 2024-03-27T19:51:57.447 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.445+0000 7f59ed400640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f59e80d2b10 con 0x7f59e815e040 2024-03-27T19:51:57.447 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.445+0000 7f59ed400640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f59e80d1f00 con 0x7f59e80cfd50 2024-03-27T19:51:57.447 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.445+0000 7f59e7e00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f59e815e040 0x7f59e80cf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:57.447 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.445+0000 7f59e7e00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f59e815e040 0x7f59e80cf810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55992/0 (socket says 172.21.15.57:55992) 2024-03-27T19:51:57.447 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.445+0000 7f59e7e00640 1 -- 172.21.15.57:0/1916565373 learned_addr learned my addr 172.21.15.57:0/1916565373 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T19:51:57.448 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.446+0000 7f59e7400640 1 --2- 172.21.15.57:0/1916565373 >> v2:172.21.15.118:3300/0 conn(0x7f59e80cfd50 0x7f59e80d0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:57.448 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.446+0000 7f59e7e00640 1 -- 172.21.15.57:0/1916565373 >> v2:172.21.15.118:3300/0 conn(0x7f59e80cfd50 msgr2=0x7f59e80d0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T19:51:57.448 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.446+0000 7f59e7e00640 1 --2- 172.21.15.57:0/1916565373 >> v2:172.21.15.118:3300/0 conn(0x7f59e80cfd50 0x7f59e80d0940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:57.449 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.446+0000 7f59e7e00640 1 -- 172.21.15.57:0/1916565373 >> v1:172.21.15.118:6789/0 conn(0x7f59e815e420 legacy=0x7f59e80b4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T19:51:57.449 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.446+0000 7f59e7e00640 1 -- 172.21.15.57:0/1916565373 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59e80d21e0 con 0x7f59e815e040 2024-03-27T19:51:57.449 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.447+0000 7f59e7e00640 1 --2- 172.21.15.57:0/1916565373 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59e815e040 0x7f59e80cf810 secure :-1 s=READY pgs=2242 cs=0 l=1 rev1=1 crypto rx=0x7f59d8009870 tx=0x7f59d802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c07373c2b5c0685 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:51:57.449 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.447+0000 7f59e6a00640 1 -- 172.21.15.57:0/1916565373 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59d8035020 con 0x7f59e815e040 2024-03-27T19:51:57.449 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.447+0000 7f59e6a00640 1 -- 172.21.15.57:0/1916565373 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59d8031870 con 0x7f59e815e040 2024-03-27T19:51:57.449 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.447+0000 7f59e6a00640 1 -- 172.21.15.57:0/1916565373 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59d8031c40 con 0x7f59e815e040 2024-03-27T19:51:57.450 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.448+0000 7f59ed400640 1 -- 172.21.15.57:0/1916565373 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59e815e040 msgr2=0x7f59e80cf810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:57.450 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.448+0000 7f59ed400640 1 --2- 172.21.15.57:0/1916565373 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59e815e040 0x7f59e80cf810 secure :-1 s=READY pgs=2242 cs=0 l=1 rev1=1 crypto rx=0x7f59d8009870 tx=0x7f59d802b910 comp rx=0 tx=0).stop 2024-03-27T19:51:57.450 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.448+0000 7f59ed400640 1 -- 172.21.15.57:0/1916565373 shutdown_connections 2024-03-27T19:51:57.450 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.448+0000 7f59ed400640 1 --2- 172.21.15.57:0/1916565373 >> v2:172.21.15.118:3300/0 conn(0x7f59e80cfd50 0x7f59e80d0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:57.451 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.448+0000 7f59ed400640 1 --2- 172.21.15.57:0/1916565373 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59e815e040 0x7f59e80cf810 unknown :-1 s=CLOSED pgs=2242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:57.451 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.448+0000 7f59ed400640 1 -- 172.21.15.57:0/1916565373 >> 172.21.15.57:0/1916565373 conn(0x7f59e809d2c0 msgr2=0x7f59e80d3f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T19:51:57.451 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.448+0000 7f59ed400640 1 -- 172.21.15.57:0/1916565373 shutdown_connections 2024-03-27T19:51:57.451 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.448+0000 7f59ed400640 1 -- 172.21.15.57:0/1916565373 wait complete. 2024-03-27T19:51:57.454 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.450+0000 7f59ed400640 1 Processor -- start 2024-03-27T19:51:57.454 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.450+0000 7f59ed400640 1 -- start start 2024-03-27T19:51:57.454 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.451+0000 7f59ed400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f59e80cfd50 0x7f59e8150ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:57.455 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.451+0000 7f59ed400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59e815e040 0x7f59e80a1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:57.455 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.451+0000 7f59ed400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f59e815e420 0x7f59e809eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:57.455 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.451+0000 7f59ed400640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f59e80d1b20 con 0x7f59e815e040 2024-03-27T19:51:57.455 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.451+0000 7f59ed400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f59e80d27a0 con 0x7f59e815e420 2024-03-27T19:51:57.455 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.451+0000 7f59ed400640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f59e80d1ca0 con 0x7f59e80cfd50 2024-03-27T19:51:57.455 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.451+0000 7f59e7400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59e815e040 0x7f59e80a1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:57.455 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.451+0000 7f59e7400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59e815e040 0x7f59e80a1670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:55994/0 (socket says 172.21.15.57:55994) 2024-03-27T19:51:57.455 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.451+0000 7f59e7400640 1 -- 172.21.15.57:0/3521609272 learned_addr learned my addr 172.21.15.57:0/3521609272 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T19:51:57.456 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.451+0000 7f59e7e00640 1 --2- 172.21.15.57:0/3521609272 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f59e80cfd50 0x7f59e8150ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:57.456 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.451+0000 7f59eca00640 1 --2- 172.21.15.57:0/3521609272 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f59e815e420 0x7f59e809eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:57.456 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.451+0000 7f59e7400640 1 -- 172.21.15.57:0/3521609272 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f59e80cfd50 msgr2=0x7f59e8150ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:57.456 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.451+0000 7f59e7400640 1 --2- 172.21.15.57:0/3521609272 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f59e80cfd50 0x7f59e8150ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:57.456 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.451+0000 7f59e7400640 1 -- 172.21.15.57:0/3521609272 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f59e815e420 msgr2=0x7f59e809eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:57.456 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.451+0000 7f59e7400640 1 --2- 172.21.15.57:0/3521609272 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f59e815e420 0x7f59e809eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:57.456 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.451+0000 7f59e7400640 1 -- 172.21.15.57:0/3521609272 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59e8151400 con 0x7f59e815e040 2024-03-27T19:51:57.456 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.451+0000 7f59e7e00640 1 --2- 172.21.15.57:0/3521609272 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f59e80cfd50 0x7f59e8150ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T19:51:57.456 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.451+0000 7f59eca00640 1 --2- 172.21.15.57:0/3521609272 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f59e815e420 0x7f59e809eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T19:51:57.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.452+0000 7f59e7400640 1 --2- 172.21.15.57:0/3521609272 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59e815e040 0x7f59e80a1670 secure :-1 s=READY pgs=2243 cs=0 l=1 rev1=1 crypto rx=0x7f59d400d800 tx=0x7f59d400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:51:57.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.452+0000 7f59dfe00640 1 -- 172.21.15.57:0/3521609272 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59d400b6c0 con 0x7f59e815e040 2024-03-27T19:51:57.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.452+0000 7f59dfe00640 1 -- 172.21.15.57:0/3521609272 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59d4019070 con 0x7f59e815e040 2024-03-27T19:51:57.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.452+0000 7f59dfe00640 1 -- 172.21.15.57:0/3521609272 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59d400ba80 con 0x7f59e815e040 2024-03-27T19:51:57.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.452+0000 7f59ed400640 1 -- 172.21.15.57:0/3521609272 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59e809dfa0 con 0x7f59e815e040 2024-03-27T19:51:57.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.452+0000 7f59ed400640 1 -- 172.21.15.57:0/3521609272 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59e81e6a60 con 0x7f59e815e040 2024-03-27T19:51:57.459 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.453+0000 7f59ed400640 1 -- 172.21.15.57:0/3521609272 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f59e8068540 con 0x7f59e815e040 2024-03-27T19:51:57.459 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.454+0000 7f59dfe00640 1 -- 172.21.15.57:0/3521609272 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f59d400bc20 con 0x7f59e815e040 2024-03-27T19:51:57.459 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.455+0000 7f59dfe00640 1 --2- 172.21.15.57:0/3521609272 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f59c806c530 0x7f59c806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:57.459 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.455+0000 7f59dfe00640 1 -- 172.21.15.57:0/3521609272 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5335+0+0 (secure 0 0 0) 0x7f59d408ba70 con 0x7f59e815e040 2024-03-27T19:51:57.459 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.455+0000 7f59dfe00640 1 --2- 172.21.15.57:0/3521609272 >> [v2:172.21.15.57:6816/4065849973,v1:172.21.15.57:6817/4065849973] conn(0x7f59c80729d0 0x7f59c8074e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:57.459 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.455+0000 7f59dfe00640 1 -- 172.21.15.57:0/3521609272 --> [v2:172.21.15.57:6816/4065849973,v1:172.21.15.57:6817/4065849973] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f59c80754e0 con 0x7f59c80729d0 2024-03-27T19:51:57.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.455+0000 7f59dfe00640 1 -- 172.21.15.57:0/3521609272 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f59d40902a0 con 0x7f59e815e040 2024-03-27T19:51:57.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.455+0000 7f59e7e00640 1 --2- 172.21.15.57:0/3521609272 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f59c806c530 0x7f59c806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:57.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.456+0000 7f59eca00640 1 --2- 172.21.15.57:0/3521609272 >> [v2:172.21.15.57:6816/4065849973,v1:172.21.15.57:6817/4065849973] conn(0x7f59c80729d0 0x7f59c8074e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:57.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.456+0000 7f59e7e00640 1 --2- 172.21.15.57:0/3521609272 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f59c806c530 0x7f59c806e9f0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f59d8036000 tx=0x7f59d8008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:51:57.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.456+0000 7f59eca00640 1 --2- 172.21.15.57:0/3521609272 >> [v2:172.21.15.57:6816/4065849973,v1:172.21.15.57:6817/4065849973] conn(0x7f59c80729d0 0x7f59c8074e10 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:51:57.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.457+0000 7f59dfe00640 1 -- 172.21.15.57:0/3521609272 <== osd.2 v2:172.21.15.57:6816/4065849973 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f59c80754e0 con 0x7f59c80729d0 2024-03-27T19:51:57.473 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.472+0000 7f59ed400640 1 -- 172.21.15.57:0/3521609272 --> [v2:172.21.15.57:6816/4065849973,v1:172.21.15.57:6817/4065849973] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f59e80d4660 con 0x7f59c80729d0 2024-03-27T19:51:57.474 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.472+0000 7f59dfe00640 1 -- 172.21.15.57:0/3521609272 <== osd.2 v2:172.21.15.57:6816/4065849973 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f59e80d4660 con 0x7f59c80729d0 2024-03-27T19:51:57.474 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-03-27T19:51:57.474 INFO:teuthology.orchestra.run.smithi057.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-27T19:51:57.474 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-03-27T19:51:57.475 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.473+0000 7f59ed400640 1 -- 172.21.15.57:0/3521609272 >> [v2:172.21.15.57:6816/4065849973,v1:172.21.15.57:6817/4065849973] conn(0x7f59c80729d0 msgr2=0x7f59c8074e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:57.476 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.473+0000 7f59ed400640 1 --2- 172.21.15.57:0/3521609272 >> [v2:172.21.15.57:6816/4065849973,v1:172.21.15.57:6817/4065849973] conn(0x7f59c80729d0 0x7f59c8074e10 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:57.476 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.473+0000 7f59ed400640 1 -- 172.21.15.57:0/3521609272 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f59c806c530 msgr2=0x7f59c806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:57.476 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.473+0000 7f59ed400640 1 --2- 172.21.15.57:0/3521609272 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f59c806c530 0x7f59c806e9f0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f59d8036000 tx=0x7f59d8008030 comp rx=0 tx=0).stop 2024-03-27T19:51:57.476 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.473+0000 7f59ed400640 1 -- 172.21.15.57:0/3521609272 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59e815e040 msgr2=0x7f59e80a1670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:57.476 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.473+0000 7f59ed400640 1 --2- 172.21.15.57:0/3521609272 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f59e815e040 0x7f59e80a1670 secure :-1 s=READY pgs=2243 cs=0 l=1 rev1=1 crypto rx=0x7f59d400d800 tx=0x7f59d400dcc0 comp rx=0 tx=0).stop 2024-03-27T19:51:57.476 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.473+0000 7f59eca00640 1 -- 172.21.15.57:0/3521609272 reap_dead start 2024-03-27T19:51:57.476 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.473+0000 7f59ed400640 1 -- 172.21.15.57:0/3521609272 shutdown_connections 2024-03-27T19:51:57.476 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.473+0000 7f59ed400640 1 -- 172.21.15.57:0/3521609272 >> 172.21.15.57:0/3521609272 conn(0x7f59e809d2c0 msgr2=0x7f59e80b9100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T19:51:57.477 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.474+0000 7f59ed400640 1 -- 172.21.15.57:0/3521609272 shutdown_connections 2024-03-27T19:51:57.477 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.474+0000 7f59ed400640 1 -- 172.21.15.57:0/3521609272 wait complete. 2024-03-27T19:51:57.493 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-03-27T19:51:57.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.676+0000 7fded7200640 1 Processor -- start 2024-03-27T19:51:57.678 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.677+0000 7fded7200640 1 -- start start 2024-03-27T19:51:57.680 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.678+0000 7fded7200640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7fded80d2820 0x7fded80d0780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:57.680 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.678+0000 7fded7200640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fded80d2d90 con 0x7fded80d4b50 2024-03-27T19:51:57.680 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.678+0000 7fded7200640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fded80cee90 con 0x7fded8161830 2024-03-27T19:51:57.680 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.678+0000 7fded7200640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7fded80cf4e0 con 0x7fded80d2820 2024-03-27T19:51:57.680 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.678+0000 7fded6800640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fded80d4b50 0x7fded80c7b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:37752/0 (socket says 172.21.15.57:37752) 2024-03-27T19:51:57.680 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.678+0000 7fded6800640 1 -- 172.21.15.57:0/4233349247 learned_addr learned my addr 172.21.15.57:0/4233349247 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T19:51:57.680 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.679+0000 7fded5400640 1 --2- 172.21.15.57:0/4233349247 >> v2:172.21.15.118:3300/0 conn(0x7fded80d2820 0x7fded80d0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:57.682 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.679+0000 7fded4a00640 1 -- 172.21.15.57:0/4233349247 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1642094843 0 0) 0x7fded80d2d90 con 0x7fded80d4b50 2024-03-27T19:51:57.682 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.679+0000 7fded4a00640 1 -- 172.21.15.57:0/4233349247 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdeb8003520 con 0x7fded80d4b50 2024-03-27T19:51:57.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.679+0000 7fded4a00640 1 -- 172.21.15.57:0/4233349247 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1236157985 0 0) 0x7fdeb8003520 con 0x7fded80d4b50 2024-03-27T19:51:57.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.679+0000 7fded4a00640 1 -- 172.21.15.57:0/4233349247 >> v2:172.21.15.118:3300/0 conn(0x7fded80d2820 msgr2=0x7fded80d0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T19:51:57.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.679+0000 7fded4a00640 1 --2- 172.21.15.57:0/4233349247 >> v2:172.21.15.118:3300/0 conn(0x7fded80d2820 0x7fded80d0780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:57.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.679+0000 7fded4a00640 1 -- 172.21.15.57:0/4233349247 >> v1:172.21.15.118:6789/0 conn(0x7fded8161830 legacy=0x7fded80cf970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:57.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.679+0000 7fded4a00640 1 -- 172.21.15.57:0/4233349247 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fded80cf170 con 0x7fded80d4b50 2024-03-27T19:51:57.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.679+0000 7fded4a00640 1 -- 172.21.15.57:0/4233349247 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4227751516 0 0) 0x7fded0001670 con 0x7fded80d4b50 2024-03-27T19:51:57.683 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.679+0000 7fded4a00640 1 -- 172.21.15.57:0/4233349247 >> v1:172.21.15.57:6789/0 conn(0x7fded80d4b50 legacy=0x7fded80c7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:57.684 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.679+0000 7fded4a00640 1 --2- 172.21.15.57:0/4233349247 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdeb8003a00 0x7fdeb8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:57.684 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.680+0000 7fded4a00640 1 --2- 172.21.15.57:0/4233349247 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdeb8004800 0x7fdeb8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:57.684 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.680+0000 7fded4a00640 1 --2- 172.21.15.57:0/4233349247 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdeb8005210 0x7fdeb800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:57.684 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.680+0000 7fded4a00640 1 -- 172.21.15.57:0/4233349247 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fded80cf4e0 con 0x7fdeb8004800 2024-03-27T19:51:57.684 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.680+0000 7fded4a00640 1 -- 172.21.15.57:0/4233349247 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fdeb800c160 con 0x7fdeb8003a00 2024-03-27T19:51:57.684 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.680+0000 7fded4a00640 1 -- 172.21.15.57:0/4233349247 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fdeb800c360 con 0x7fdeb8005210 2024-03-27T19:51:57.684 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.680+0000 7fded5400640 1 --2- 172.21.15.57:0/4233349247 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdeb8004800 0x7fdeb8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:57.685 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.680+0000 7fded5400640 1 -- 172.21.15.57:0/4233349247 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdeb8005210 msgr2=0x7fdeb800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T19:51:57.685 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.680+0000 7fded5400640 1 --2- 172.21.15.57:0/4233349247 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fdeb8005210 0x7fdeb800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:57.685 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.680+0000 7fded5e00640 1 --2- 172.21.15.57:0/4233349247 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdeb8003a00 0x7fdeb8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:57.685 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.680+0000 7fded5400640 1 -- 172.21.15.57:0/4233349247 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdeb8003a00 msgr2=0x7fdeb8003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T19:51:57.685 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.680+0000 7fded5400640 1 --2- 172.21.15.57:0/4233349247 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fdeb8003a00 0x7fdeb8003e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:57.685 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.680+0000 7fded6800640 1 -- 172.21.15.57:0/4233349247 reap_dead start 2024-03-27T19:51:57.685 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.680+0000 7fded5400640 1 -- 172.21.15.57:0/4233349247 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdeb8003520 con 0x7fdeb8004800 2024-03-27T19:51:57.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.681+0000 7fded5400640 1 --2- 172.21.15.57:0/4233349247 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdeb8004800 0x7fdeb8004c80 secure :-1 s=READY pgs=2245 cs=0 l=1 rev1=1 crypto rx=0x7fdec0009f90 tx=0x7fdeb8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da1512e0d2c4083a server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:51:57.688 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.682+0000 7fded4a00640 1 -- 172.21.15.57:0/4233349247 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdec0039070 con 0x7fdeb8004800 2024-03-27T19:51:57.689 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.682+0000 7fded4a00640 1 -- 172.21.15.57:0/4233349247 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdec002cbd0 con 0x7fdeb8004800 2024-03-27T19:51:57.689 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.682+0000 7fded4a00640 1 -- 172.21.15.57:0/4233349247 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdec0009c10 con 0x7fdeb8004800 2024-03-27T19:51:57.689 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.682+0000 7fded7200640 1 -- 172.21.15.57:0/4233349247 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdeb8004800 msgr2=0x7fdeb8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:57.689 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.683+0000 7fded7200640 1 --2- 172.21.15.57:0/4233349247 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdeb8004800 0x7fdeb8004c80 secure :-1 s=READY pgs=2245 cs=0 l=1 rev1=1 crypto rx=0x7fdec0009f90 tx=0x7fdeb8005830 comp rx=0 tx=0).stop 2024-03-27T19:51:57.689 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.683+0000 7fded7200640 1 -- 172.21.15.57:0/4233349247 shutdown_connections 2024-03-27T19:51:57.689 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.683+0000 7fded7200640 1 --2- 172.21.15.57:0/4233349247 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdeb8004800 0x7fdeb8004c80 unknown :-1 s=CLOSED pgs=2245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:57.689 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.683+0000 7fded7200640 1 -- 172.21.15.57:0/4233349247 >> 172.21.15.57:0/4233349247 conn(0x7fded80d4030 msgr2=0x7fded80d4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T19:51:57.690 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.683+0000 7fded7200640 1 -- 172.21.15.57:0/4233349247 shutdown_connections 2024-03-27T19:51:57.690 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.683+0000 7fded7200640 1 -- 172.21.15.57:0/4233349247 wait complete. 2024-03-27T19:51:57.690 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.684+0000 7fded7200640 1 Processor -- start 2024-03-27T19:51:57.690 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.685+0000 7fded7200640 1 -- start start 2024-03-27T19:51:57.690 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.685+0000 7fded7200640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdeb8004800 0x7fded8153190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:57.690 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.685+0000 7fded7200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fded81f7c20 0x7fded81f80a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:57.690 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.686+0000 7fded7200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fded8154af0 0x7fded8154f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:57.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.686+0000 7fded7200640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fded80ce4b0 con 0x7fdeb8004800 2024-03-27T19:51:57.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.686+0000 7fded7200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fded80ce330 con 0x7fded81f7c20 2024-03-27T19:51:57.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.686+0000 7fded7200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fded8161c10 con 0x7fded8154af0 2024-03-27T19:51:57.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.686+0000 7fded5e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdeb8004800 0x7fded8153190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:57.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.686+0000 7fded5e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdeb8004800 0x7fded8153190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56022/0 (socket says 172.21.15.57:56022) 2024-03-27T19:51:57.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.686+0000 7fded5e00640 1 -- 172.21.15.57:0/1404134654 learned_addr learned my addr 172.21.15.57:0/1404134654 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T19:51:57.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.686+0000 7fded5400640 1 --2- 172.21.15.57:0/1404134654 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fded81f7c20 0x7fded81f80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:57.691 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.686+0000 7fded6800640 1 --2- 172.21.15.57:0/1404134654 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fded8154af0 0x7fded8154f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:57.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.686+0000 7fded5e00640 1 -- 172.21.15.57:0/1404134654 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fded8154af0 msgr2=0x7fded8154f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:57.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.686+0000 7fded5e00640 1 --2- 172.21.15.57:0/1404134654 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fded8154af0 0x7fded8154f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:57.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.686+0000 7fded5e00640 1 -- 172.21.15.57:0/1404134654 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fded81f7c20 msgr2=0x7fded81f80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:57.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.686+0000 7fded5e00640 1 --2- 172.21.15.57:0/1404134654 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fded81f7c20 0x7fded81f80a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:57.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.686+0000 7fded5e00640 1 -- 172.21.15.57:0/1404134654 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fded8156f30 con 0x7fdeb8004800 2024-03-27T19:51:57.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.687+0000 7fded5e00640 1 --2- 172.21.15.57:0/1404134654 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdeb8004800 0x7fded8153190 secure :-1 s=READY pgs=2246 cs=0 l=1 rev1=1 crypto rx=0x7fdec800d480 tx=0x7fdec800d940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:51:57.692 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.687+0000 7fdece000640 1 -- 172.21.15.57:0/1404134654 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdec8005480 con 0x7fdeb8004800 2024-03-27T19:51:57.693 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.687+0000 7fdece000640 1 -- 172.21.15.57:0/1404134654 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdec8017070 con 0x7fdeb8004800 2024-03-27T19:51:57.693 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.687+0000 7fded7200640 1 -- 172.21.15.57:0/1404134654 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fded8157210 con 0x7fdeb8004800 2024-03-27T19:51:57.693 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.687+0000 7fdece000640 1 -- 172.21.15.57:0/1404134654 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdec8003810 con 0x7fdeb8004800 2024-03-27T19:51:57.693 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.687+0000 7fded7200640 1 -- 172.21.15.57:0/1404134654 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fded815e860 con 0x7fdeb8004800 2024-03-27T19:51:57.694 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.688+0000 7fded7200640 1 -- 172.21.15.57:0/1404134654 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fded8068540 con 0x7fdeb8004800 2024-03-27T19:51:57.694 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.689+0000 7fdece000640 1 -- 172.21.15.57:0/1404134654 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fdec80039b0 con 0x7fdeb8004800 2024-03-27T19:51:57.694 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.690+0000 7fdece000640 1 --2- 172.21.15.57:0/1404134654 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fdeb406c530 0x7fdeb406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:57.695 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.690+0000 7fdece000640 1 -- 172.21.15.57:0/1404134654 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5335+0+0 (secure 0 0 0) 0x7fdec808b2f0 con 0x7fdeb8004800 2024-03-27T19:51:57.695 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.690+0000 7fded5400640 1 --2- 172.21.15.57:0/1404134654 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fdeb406c530 0x7fdeb406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:57.695 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.691+0000 7fded5400640 1 --2- 172.21.15.57:0/1404134654 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fdeb406c530 0x7fdeb406e9f0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fdec0036000 tx=0x7fdec002e000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:51:57.696 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.695+0000 7fdece000640 1 -- 172.21.15.57:0/1404134654 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7fdec8059bd0 con 0x7fdeb8004800 2024-03-27T19:51:57.896 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.894+0000 7fded7200640 1 -- 172.21.15.57:0/1404134654 --> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7fded8156ce0 con 0x7fdeb406c530 2024-03-27T19:51:57.897 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.895+0000 7fdece000640 1 -- 172.21.15.57:0/1404134654 <== mgr.4103 v2:172.21.15.57:6832/485397065 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fded8156ce0 con 0x7fdeb406c530 2024-03-27T19:51:57.897 INFO:teuthology.orchestra.run.smithi057.stderr:instructed osd(s) 2 to deep-scrub 2024-03-27T19:51:57.900 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.898+0000 7fded7200640 1 -- 172.21.15.57:0/1404134654 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fdeb406c530 msgr2=0x7fdeb406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:57.900 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.898+0000 7fded7200640 1 --2- 172.21.15.57:0/1404134654 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fdeb406c530 0x7fdeb406e9f0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fdec0036000 tx=0x7fdec002e000 comp rx=0 tx=0).stop 2024-03-27T19:51:57.900 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.898+0000 7fded7200640 1 -- 172.21.15.57:0/1404134654 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdeb8004800 msgr2=0x7fded8153190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:57.900 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.898+0000 7fded7200640 1 --2- 172.21.15.57:0/1404134654 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdeb8004800 0x7fded8153190 secure :-1 s=READY pgs=2246 cs=0 l=1 rev1=1 crypto rx=0x7fdec800d480 tx=0x7fdec800d940 comp rx=0 tx=0).stop 2024-03-27T19:51:57.901 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.898+0000 7fded7200640 1 -- 172.21.15.57:0/1404134654 shutdown_connections 2024-03-27T19:51:57.901 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.898+0000 7fded7200640 1 --2- 172.21.15.57:0/1404134654 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fded8154af0 0x7fded8154f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:57.901 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.898+0000 7fded7200640 1 --2- 172.21.15.57:0/1404134654 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fdeb406c530 0x7fdeb406e9f0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:57.901 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.898+0000 7fded7200640 1 --2- 172.21.15.57:0/1404134654 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fded81f7c20 0x7fded81f80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:57.901 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.898+0000 7fded7200640 1 --2- 172.21.15.57:0/1404134654 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fdeb8004800 0x7fded8153190 unknown :-1 s=CLOSED pgs=2246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:57.901 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.899+0000 7fded7200640 1 -- 172.21.15.57:0/1404134654 >> 172.21.15.57:0/1404134654 conn(0x7fded80d4030 msgr2=0x7fded80c8200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T19:51:57.901 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.899+0000 7fded7200640 1 -- 172.21.15.57:0/1404134654 shutdown_connections 2024-03-27T19:51:57.901 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:57.899+0000 7fded7200640 1 -- 172.21.15.57:0/1404134654 wait complete. 2024-03-27T19:51:57.919 INFO:tasks.ceph:Scrubbing osd.3 2024-03-27T19:51:57.920 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-03-27T19:51:58.113 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.112+0000 7fe8cf200640 1 Processor -- start 2024-03-27T19:51:58.114 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.112+0000 7fe8cf200640 1 -- start start 2024-03-27T19:51:58.115 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.114+0000 7fe8cf200640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fe8d00d1050 0x7fe8d00b4b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:58.115 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.114+0000 7fe8cf200640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8d00d2fa0 con 0x7fe8d015e040 2024-03-27T19:51:58.115 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.114+0000 7fe8cf200640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8d00d1f00 con 0x7fe8d015e420 2024-03-27T19:51:58.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.114+0000 7fe8cf200640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7fe8d00d2b10 con 0x7fe8d00d1050 2024-03-27T19:51:58.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.114+0000 7fe8cde00640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fe8d015e040 0x7fe8d00cf810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:37768/0 (socket says 172.21.15.57:37768) 2024-03-27T19:51:58.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.114+0000 7fe8cde00640 1 -- 172.21.15.57:0/2333777952 learned_addr learned my addr 172.21.15.57:0/2333777952 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T19:51:58.116 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.114+0000 7fe8ce800640 1 --2- 172.21.15.57:0/2333777952 >> v2:172.21.15.57:3300/0 conn(0x7fe8d00d1050 0x7fe8d00b4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:58.117 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.114+0000 7fe8cca00640 1 -- 172.21.15.57:0/2333777952 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 952773865 0 0) 0x7fe8d00d2fa0 con 0x7fe8d015e040 2024-03-27T19:51:58.117 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.114+0000 7fe8cca00640 1 -- 172.21.15.57:0/2333777952 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe8b4003520 con 0x7fe8d015e040 2024-03-27T19:51:58.117 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.115+0000 7fe8ce800640 1 -- 172.21.15.57:0/2333777952 >> v1:172.21.15.118:6789/0 conn(0x7fe8d015e420 legacy=0x7fe8d00d0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T19:51:58.117 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.115+0000 7fe8ce800640 1 -- 172.21.15.57:0/2333777952 >> v1:172.21.15.57:6789/0 conn(0x7fe8d015e040 legacy=0x7fe8d00cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:58.118 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.115+0000 7fe8ce800640 1 -- 172.21.15.57:0/2333777952 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8d00d21e0 con 0x7fe8d00d1050 2024-03-27T19:51:58.118 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.116+0000 7fe8ce800640 1 --2- 172.21.15.57:0/2333777952 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe8d00d1050 0x7fe8d00b4b60 secure :-1 s=READY pgs=2248 cs=0 l=1 rev1=1 crypto rx=0x7fe8d00d2c90 tx=0x7fe8c802bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a6eb20fe91e5773 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:51:58.118 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.116+0000 7fe8cca00640 1 -- 172.21.15.57:0/2333777952 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8c8039070 con 0x7fe8d00d1050 2024-03-27T19:51:58.118 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.116+0000 7fe8cca00640 1 -- 172.21.15.57:0/2333777952 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8c802ccd0 con 0x7fe8d00d1050 2024-03-27T19:51:58.118 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.116+0000 7fe8cca00640 1 -- 172.21.15.57:0/2333777952 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8c8034660 con 0x7fe8d00d1050 2024-03-27T19:51:58.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.116+0000 7fe8cf200640 1 -- 172.21.15.57:0/2333777952 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe8d00d1050 msgr2=0x7fe8d00b4b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:58.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.116+0000 7fe8cf200640 1 --2- 172.21.15.57:0/2333777952 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe8d00d1050 0x7fe8d00b4b60 secure :-1 s=READY pgs=2248 cs=0 l=1 rev1=1 crypto rx=0x7fe8d00d2c90 tx=0x7fe8c802bf20 comp rx=0 tx=0).stop 2024-03-27T19:51:58.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.117+0000 7fe8cf200640 1 -- 172.21.15.57:0/2333777952 shutdown_connections 2024-03-27T19:51:58.119 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.117+0000 7fe8cf200640 1 --2- 172.21.15.57:0/2333777952 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe8d00d1050 0x7fe8d00b4b60 unknown :-1 s=CLOSED pgs=2248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:58.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.117+0000 7fe8cf200640 1 -- 172.21.15.57:0/2333777952 >> 172.21.15.57:0/2333777952 conn(0x7fe8d009d2c0 msgr2=0x7fe8d00d3f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T19:51:58.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.117+0000 7fe8cf200640 1 -- 172.21.15.57:0/2333777952 shutdown_connections 2024-03-27T19:51:58.120 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.117+0000 7fe8cf200640 1 -- 172.21.15.57:0/2333777952 wait complete. 2024-03-27T19:51:58.121 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.118+0000 7fe8cf200640 1 Processor -- start 2024-03-27T19:51:58.121 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.118+0000 7fe8cf200640 1 -- start start 2024-03-27T19:51:58.121 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.119+0000 7fe8cf200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe8d00d1050 0x7fe8d00c82c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:58.121 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.119+0000 7fe8cf200640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe8d015e040 0x7fe8d01f3410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:58.121 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.119+0000 7fe8cf200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe8d015e420 0x7fe8d01f4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:58.121 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.119+0000 7fe8cf200640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fe8d00cff20 con 0x7fe8d015e040 2024-03-27T19:51:58.121 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.119+0000 7fe8cf200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fe8d00d27a0 con 0x7fe8d015e420 2024-03-27T19:51:58.122 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.119+0000 7fe8cf200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fe8d00d1b20 con 0x7fe8d00d1050 2024-03-27T19:51:58.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.120+0000 7fe8cd400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe8d015e040 0x7fe8d01f3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:58.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.120+0000 7fe8ce800640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe8d015e420 0x7fe8d01f4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:58.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.120+0000 7fe8cd400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe8d015e040 0x7fe8d01f3410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56036/0 (socket says 172.21.15.57:56036) 2024-03-27T19:51:58.123 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.120+0000 7fe8cd400640 1 -- 172.21.15.57:0/2187308652 learned_addr learned my addr 172.21.15.57:0/2187308652 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T19:51:58.124 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.120+0000 7fe8cde00640 1 --2- 172.21.15.57:0/2187308652 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe8d00d1050 0x7fe8d00c82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:58.124 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.120+0000 7fe8cd400640 1 -- 172.21.15.57:0/2187308652 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe8d00d1050 msgr2=0x7fe8d00c82c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:58.124 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.120+0000 7fe8cd400640 1 --2- 172.21.15.57:0/2187308652 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe8d00d1050 0x7fe8d00c82c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:58.124 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.120+0000 7fe8cd400640 1 -- 172.21.15.57:0/2187308652 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe8d015e420 msgr2=0x7fe8d01f4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:58.124 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.120+0000 7fe8cd400640 1 --2- 172.21.15.57:0/2187308652 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe8d015e420 0x7fe8d01f4cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:58.124 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.120+0000 7fe8cd400640 1 -- 172.21.15.57:0/2187308652 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8d01f3950 con 0x7fe8d015e040 2024-03-27T19:51:58.124 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.121+0000 7fe8cd400640 1 --2- 172.21.15.57:0/2187308652 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe8d015e040 0x7fe8d01f3410 secure :-1 s=READY pgs=2249 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc00c400 tx=0x7fe8bc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:51:58.125 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.121+0000 7fe8c6000640 1 -- 172.21.15.57:0/2187308652 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8bc017070 con 0x7fe8d015e040 2024-03-27T19:51:58.125 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.121+0000 7fe8c6000640 1 -- 172.21.15.57:0/2187308652 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8bc0052d0 con 0x7fe8d015e040 2024-03-27T19:51:58.125 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.121+0000 7fe8cf200640 1 -- 172.21.15.57:0/2187308652 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8d00cc500 con 0x7fe8d015e040 2024-03-27T19:51:58.125 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.121+0000 7fe8c6000640 1 -- 172.21.15.57:0/2187308652 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8bc003830 con 0x7fe8d015e040 2024-03-27T19:51:58.125 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.121+0000 7fe8cf200640 1 -- 172.21.15.57:0/2187308652 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8d00ccac0 con 0x7fe8d015e040 2024-03-27T19:51:58.125 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.122+0000 7fe8cf200640 1 -- 172.21.15.57:0/2187308652 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe8d01f3be0 con 0x7fe8d015e040 2024-03-27T19:51:58.126 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.123+0000 7fe8c6000640 1 -- 172.21.15.57:0/2187308652 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fe8bc01a070 con 0x7fe8d015e040 2024-03-27T19:51:58.127 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.124+0000 7fe8c6000640 1 --2- 172.21.15.57:0/2187308652 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fe8b006c530 0x7fe8b006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:58.127 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.124+0000 7fe8c6000640 1 -- 172.21.15.57:0/2187308652 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5335+0+0 (secure 0 0 0) 0x7fe8bc08a8c0 con 0x7fe8d015e040 2024-03-27T19:51:58.127 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.124+0000 7fe8cde00640 1 --2- 172.21.15.57:0/2187308652 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fe8b006c530 0x7fe8b006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:58.127 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.124+0000 7fe8c6000640 1 --2- 172.21.15.57:0/2187308652 >> [v2:172.21.15.57:6824/158084809,v1:172.21.15.57:6825/158084809] conn(0x7fe8b00729d0 0x7fe8b0074e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:58.127 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.124+0000 7fe8c6000640 1 -- 172.21.15.57:0/2187308652 --> [v2:172.21.15.57:6824/158084809,v1:172.21.15.57:6825/158084809] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe8b00754e0 con 0x7fe8b00729d0 2024-03-27T19:51:58.127 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.124+0000 7fe8c6000640 1 -- 172.21.15.57:0/2187308652 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7fe8bc08f2a0 con 0x7fe8d015e040 2024-03-27T19:51:58.127 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.125+0000 7fe8ce800640 1 --2- 172.21.15.57:0/2187308652 >> [v2:172.21.15.57:6824/158084809,v1:172.21.15.57:6825/158084809] conn(0x7fe8b00729d0 0x7fe8b0074e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:58.128 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.125+0000 7fe8cde00640 1 --2- 172.21.15.57:0/2187308652 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fe8b006c530 0x7fe8b006e9f0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fe8c00011e0 tx=0x7fe8c0007d30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:51:58.128 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.125+0000 7fe8ce800640 1 --2- 172.21.15.57:0/2187308652 >> [v2:172.21.15.57:6824/158084809,v1:172.21.15.57:6825/158084809] conn(0x7fe8b00729d0 0x7fe8b0074e10 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:51:58.128 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.126+0000 7fe8c6000640 1 -- 172.21.15.57:0/2187308652 <== osd.3 v2:172.21.15.57:6824/158084809 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe8b00754e0 con 0x7fe8b00729d0 2024-03-27T19:51:58.142 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.141+0000 7fe8cf200640 1 -- 172.21.15.57:0/2187308652 --> [v2:172.21.15.57:6824/158084809,v1:172.21.15.57:6825/158084809] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fe8d00ce150 con 0x7fe8b00729d0 2024-03-27T19:51:58.143 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.141+0000 7fe8c6000640 1 -- 172.21.15.57:0/2187308652 <== osd.3 v2:172.21.15.57:6824/158084809 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fe8d00ce150 con 0x7fe8b00729d0 2024-03-27T19:51:58.143 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-03-27T19:51:58.143 INFO:teuthology.orchestra.run.smithi057.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-27T19:51:58.143 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-03-27T19:51:58.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.142+0000 7fe8cf200640 1 -- 172.21.15.57:0/2187308652 >> [v2:172.21.15.57:6824/158084809,v1:172.21.15.57:6825/158084809] conn(0x7fe8b00729d0 msgr2=0x7fe8b0074e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:58.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.142+0000 7fe8cf200640 1 --2- 172.21.15.57:0/2187308652 >> [v2:172.21.15.57:6824/158084809,v1:172.21.15.57:6825/158084809] conn(0x7fe8b00729d0 0x7fe8b0074e10 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:58.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.142+0000 7fe8cf200640 1 -- 172.21.15.57:0/2187308652 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fe8b006c530 msgr2=0x7fe8b006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:58.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.142+0000 7fe8cf200640 1 --2- 172.21.15.57:0/2187308652 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fe8b006c530 0x7fe8b006e9f0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fe8c00011e0 tx=0x7fe8c0007d30 comp rx=0 tx=0).stop 2024-03-27T19:51:58.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.142+0000 7fe8cf200640 1 -- 172.21.15.57:0/2187308652 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe8d015e040 msgr2=0x7fe8d01f3410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:58.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.142+0000 7fe8cf200640 1 --2- 172.21.15.57:0/2187308652 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe8d015e040 0x7fe8d01f3410 secure :-1 s=READY pgs=2249 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc00c400 tx=0x7fe8bc00c8c0 comp rx=0 tx=0).stop 2024-03-27T19:51:58.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.142+0000 7fe8ce800640 1 -- 172.21.15.57:0/2187308652 reap_dead start 2024-03-27T19:51:58.145 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.142+0000 7fe8cf200640 1 -- 172.21.15.57:0/2187308652 shutdown_connections 2024-03-27T19:51:58.146 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.142+0000 7fe8cf200640 1 -- 172.21.15.57:0/2187308652 >> 172.21.15.57:0/2187308652 conn(0x7fe8d009d2c0 msgr2=0x7fe8d015e880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T19:51:58.146 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.142+0000 7fe8cf200640 1 -- 172.21.15.57:0/2187308652 shutdown_connections 2024-03-27T19:51:58.146 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.143+0000 7fe8cf200640 1 -- 172.21.15.57:0/2187308652 wait complete. 2024-03-27T19:51:58.161 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-03-27T19:51:58.358 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.356+0000 7fe395000640 1 Processor -- start 2024-03-27T19:51:58.358 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.356+0000 7fe395000640 1 -- start start 2024-03-27T19:51:58.359 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.358+0000 7fe395000640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe39006bb90 0x7fe3900cee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:58.359 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.358+0000 7fe395000640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe39015fc70 con 0x7fe390145820 2024-03-27T19:51:58.360 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.358+0000 7fe395000640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe39015ff50 con 0x7fe39006b750 2024-03-27T19:51:58.360 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.358+0000 7fe395000640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fe390160b60 con 0x7fe39006bb90 2024-03-27T19:51:58.360 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.358+0000 7fe38de00640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fe390145820 0x7fe3900cc950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:37782/0 (socket says 172.21.15.57:37782) 2024-03-27T19:51:58.360 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.358+0000 7fe38de00640 1 -- 172.21.15.57:0/2508235096 learned_addr learned my addr 172.21.15.57:0/2508235096 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T19:51:58.362 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.359+0000 7fe38e800640 1 --2- 172.21.15.57:0/2508235096 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe39006bb90 0x7fe3900cee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:58.362 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.359+0000 7fe38d400640 1 -- 172.21.15.57:0/2508235096 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 783599646 0 0) 0x7fe39015fc70 con 0x7fe390145820 2024-03-27T19:51:58.362 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.359+0000 7fe38d400640 1 -- 172.21.15.57:0/2508235096 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe374003520 con 0x7fe390145820 2024-03-27T19:51:58.362 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.359+0000 7fe38d400640 1 -- 172.21.15.57:0/2508235096 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4255208898 0 0) 0x7fe374003520 con 0x7fe390145820 2024-03-27T19:51:58.362 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.359+0000 7fe38d400640 1 -- 172.21.15.57:0/2508235096 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe39006bb90 msgr2=0x7fe3900cee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T19:51:58.362 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.359+0000 7fe38d400640 1 --2- 172.21.15.57:0/2508235096 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe39006bb90 0x7fe3900cee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:58.363 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.359+0000 7fe38d400640 1 -- 172.21.15.57:0/2508235096 >> v1:172.21.15.118:6789/0 conn(0x7fe39006b750 legacy=0x7fe3900ce740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:58.363 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.359+0000 7fe38d400640 1 -- 172.21.15.57:0/2508235096 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe390160230 con 0x7fe390145820 2024-03-27T19:51:58.363 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.359+0000 7fe38d400640 1 -- 172.21.15.57:0/2508235096 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4227751516 0 0) 0x7fe380001670 con 0x7fe390145820 2024-03-27T19:51:58.363 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.359+0000 7fe38d400640 1 -- 172.21.15.57:0/2508235096 >> v1:172.21.15.57:6789/0 conn(0x7fe390145820 legacy=0x7fe3900cc950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:58.363 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.359+0000 7fe38d400640 1 --2- 172.21.15.57:0/2508235096 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe3740039e0 0x7fe374003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:58.363 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.359+0000 7fe38d400640 1 --2- 172.21.15.57:0/2508235096 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe39006bb90 0x7fe374004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:58.363 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.359+0000 7fe38d400640 1 --2- 172.21.15.57:0/2508235096 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe374004d40 0x7fe3740051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:58.363 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.359+0000 7fe38d400640 1 -- 172.21.15.57:0/2508235096 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fe390160b60 con 0x7fe374004d40 2024-03-27T19:51:58.363 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.359+0000 7fe38d400640 1 -- 172.21.15.57:0/2508235096 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fe37400baa0 con 0x7fe3740039e0 2024-03-27T19:51:58.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.359+0000 7fe38d400640 1 -- 172.21.15.57:0/2508235096 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fe37400bca0 con 0x7fe39006bb90 2024-03-27T19:51:58.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.360+0000 7fe38e800640 1 --2- 172.21.15.57:0/2508235096 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe374004d40 0x7fe3740051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:58.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.360+0000 7fe38de00640 1 --2- 172.21.15.57:0/2508235096 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe3740039e0 0x7fe374003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:58.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.360+0000 7fe387e00640 1 --2- 172.21.15.57:0/2508235096 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe39006bb90 0x7fe374004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:58.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.360+0000 7fe38e800640 1 -- 172.21.15.57:0/2508235096 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe39006bb90 msgr2=0x7fe374004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T19:51:58.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.360+0000 7fe38e800640 1 --2- 172.21.15.57:0/2508235096 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe39006bb90 0x7fe374004800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:58.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.360+0000 7fe38e800640 1 -- 172.21.15.57:0/2508235096 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe3740039e0 msgr2=0x7fe374003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T19:51:58.364 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.360+0000 7fe38e800640 1 --2- 172.21.15.57:0/2508235096 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe3740039e0 0x7fe374003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:58.365 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.360+0000 7fe38e800640 1 -- 172.21.15.57:0/2508235096 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe374003520 con 0x7fe374004d40 2024-03-27T19:51:58.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.361+0000 7fe38e800640 1 --2- 172.21.15.57:0/2508235096 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe374004d40 0x7fe3740051c0 secure :-1 s=READY pgs=2251 cs=0 l=1 rev1=1 crypto rx=0x7fe388009f90 tx=0x7fe374005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0a19bfc818cb2fb server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:51:58.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.361+0000 7fe38d400640 1 -- 172.21.15.57:0/2508235096 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe388039070 con 0x7fe374004d40 2024-03-27T19:51:58.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.362+0000 7fe38d400640 1 -- 172.21.15.57:0/2508235096 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe38802cbd0 con 0x7fe374004d40 2024-03-27T19:51:58.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.362+0000 7fe38d400640 1 -- 172.21.15.57:0/2508235096 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe388009c10 con 0x7fe374004d40 2024-03-27T19:51:58.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.362+0000 7fe395000640 1 -- 172.21.15.57:0/2508235096 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe374004d40 msgr2=0x7fe3740051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:58.368 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.362+0000 7fe395000640 1 --2- 172.21.15.57:0/2508235096 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe374004d40 0x7fe3740051c0 secure :-1 s=READY pgs=2251 cs=0 l=1 rev1=1 crypto rx=0x7fe388009f90 tx=0x7fe374005830 comp rx=0 tx=0).stop 2024-03-27T19:51:58.369 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.362+0000 7fe38e800640 1 -- 172.21.15.57:0/2508235096 reap_dead start 2024-03-27T19:51:58.369 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.362+0000 7fe395000640 1 -- 172.21.15.57:0/2508235096 shutdown_connections 2024-03-27T19:51:58.369 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.362+0000 7fe395000640 1 -- 172.21.15.57:0/2508235096 >> 172.21.15.57:0/2508235096 conn(0x7fe3900b1c60 msgr2=0x7fe3900b2070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T19:51:58.369 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.362+0000 7fe395000640 1 -- 172.21.15.57:0/2508235096 shutdown_connections 2024-03-27T19:51:58.369 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.362+0000 7fe395000640 1 -- 172.21.15.57:0/2508235096 wait complete. 2024-03-27T19:51:58.369 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.364+0000 7fe395000640 1 Processor -- start 2024-03-27T19:51:58.369 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.364+0000 7fe395000640 1 -- start start 2024-03-27T19:51:58.369 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.365+0000 7fe395000640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe374004d40 0x7fe3901404a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:58.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.365+0000 7fe395000640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe39015c810 0x7fe39015b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:58.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.365+0000 7fe395000640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe39015cc90 0x7fe39015ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:58.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.365+0000 7fe395000640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fe39006c000 con 0x7fe374004d40 2024-03-27T19:51:58.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.365+0000 7fe395000640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fe3901607f0 con 0x7fe39015c810 2024-03-27T19:51:58.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.365+0000 7fe395000640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fe390145c00 con 0x7fe39015cc90 2024-03-27T19:51:58.370 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.365+0000 7fe38de00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe374004d40 0x7fe3901404a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:58.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.365+0000 7fe38de00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe374004d40 0x7fe3901404a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56066/0 (socket says 172.21.15.57:56066) 2024-03-27T19:51:58.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.365+0000 7fe38de00640 1 -- 172.21.15.57:0/1260903908 learned_addr learned my addr 172.21.15.57:0/1260903908 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T19:51:58.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.365+0000 7fe387e00640 1 --2- 172.21.15.57:0/1260903908 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe39015c810 0x7fe39015b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:58.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.365+0000 7fe38de00640 1 -- 172.21.15.57:0/1260903908 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe39015cc90 msgr2=0x7fe39015ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:58.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.365+0000 7fe38de00640 1 --2- 172.21.15.57:0/1260903908 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe39015cc90 0x7fe39015ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:58.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.365+0000 7fe38de00640 1 -- 172.21.15.57:0/1260903908 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe39015c810 msgr2=0x7fe39015b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:58.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.365+0000 7fe38de00640 1 --2- 172.21.15.57:0/1260903908 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe39015c810 0x7fe39015b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:58.371 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.365+0000 7fe38de00640 1 -- 172.21.15.57:0/1260903908 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe39015d260 con 0x7fe374004d40 2024-03-27T19:51:58.372 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.366+0000 7fe387e00640 1 --2- 172.21.15.57:0/1260903908 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe39015c810 0x7fe39015b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T19:51:58.372 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.366+0000 7fe38de00640 1 --2- 172.21.15.57:0/1260903908 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe374004d40 0x7fe3901404a0 secure :-1 s=READY pgs=2252 cs=0 l=1 rev1=1 crypto rx=0x7fe38000e6e0 tx=0x7fe38000eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:51:58.372 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.366+0000 7fe386000640 1 -- 172.21.15.57:0/1260903908 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe38000c6c0 con 0x7fe374004d40 2024-03-27T19:51:58.372 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.366+0000 7fe386000640 1 -- 172.21.15.57:0/1260903908 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe380018070 con 0x7fe374004d40 2024-03-27T19:51:58.372 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.366+0000 7fe386000640 1 -- 172.21.15.57:0/1260903908 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe38000cac0 con 0x7fe374004d40 2024-03-27T19:51:58.372 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.366+0000 7fe395000640 1 -- 172.21.15.57:0/1260903908 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe39015d540 con 0x7fe374004d40 2024-03-27T19:51:58.372 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.366+0000 7fe395000640 1 -- 172.21.15.57:0/1260903908 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe39015db00 con 0x7fe374004d40 2024-03-27T19:51:58.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.367+0000 7fe395000640 1 -- 172.21.15.57:0/1260903908 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe390068620 con 0x7fe374004d40 2024-03-27T19:51:58.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.368+0000 7fe386000640 1 -- 172.21.15.57:0/1260903908 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fe38000cc60 con 0x7fe374004d40 2024-03-27T19:51:58.373 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.369+0000 7fe386000640 1 --2- 172.21.15.57:0/1260903908 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fe36c06c530 0x7fe36c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:58.374 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.369+0000 7fe386000640 1 -- 172.21.15.57:0/1260903908 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5335+0+0 (secure 0 0 0) 0x7fe38008b420 con 0x7fe374004d40 2024-03-27T19:51:58.374 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.369+0000 7fe387e00640 1 --2- 172.21.15.57:0/1260903908 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fe36c06c530 0x7fe36c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:58.374 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.370+0000 7fe387e00640 1 --2- 172.21.15.57:0/1260903908 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fe36c06c530 0x7fe36c06e9f0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fe3901f3430 tx=0x7fe378009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:51:58.374 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.373+0000 7fe386000640 1 -- 172.21.15.57:0/1260903908 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7fe380059bb0 con 0x7fe374004d40 2024-03-27T19:51:58.575 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.573+0000 7fe395000640 1 -- 172.21.15.57:0/1260903908 --> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7fe390141f60 con 0x7fe36c06c530 2024-03-27T19:51:58.575 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.573+0000 7fe386000640 1 -- 172.21.15.57:0/1260903908 <== mgr.4103 v2:172.21.15.57:6832/485397065 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fe390141f60 con 0x7fe36c06c530 2024-03-27T19:51:58.575 INFO:teuthology.orchestra.run.smithi057.stderr:instructed osd(s) 3 to deep-scrub 2024-03-27T19:51:58.577 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.576+0000 7fe395000640 1 -- 172.21.15.57:0/1260903908 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fe36c06c530 msgr2=0x7fe36c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:58.578 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.576+0000 7fe395000640 1 --2- 172.21.15.57:0/1260903908 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fe36c06c530 0x7fe36c06e9f0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fe3901f3430 tx=0x7fe378009040 comp rx=0 tx=0).stop 2024-03-27T19:51:58.578 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.576+0000 7fe395000640 1 -- 172.21.15.57:0/1260903908 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe374004d40 msgr2=0x7fe3901404a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:58.578 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.576+0000 7fe395000640 1 --2- 172.21.15.57:0/1260903908 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe374004d40 0x7fe3901404a0 secure :-1 s=READY pgs=2252 cs=0 l=1 rev1=1 crypto rx=0x7fe38000e6e0 tx=0x7fe38000eba0 comp rx=0 tx=0).stop 2024-03-27T19:51:58.578 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.576+0000 7fe395000640 1 -- 172.21.15.57:0/1260903908 shutdown_connections 2024-03-27T19:51:58.578 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.576+0000 7fe395000640 1 --2- 172.21.15.57:0/1260903908 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fe39015cc90 0x7fe39015ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:58.578 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.576+0000 7fe395000640 1 --2- 172.21.15.57:0/1260903908 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fe36c06c530 0x7fe36c06e9f0 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:58.578 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.576+0000 7fe395000640 1 --2- 172.21.15.57:0/1260903908 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fe39015c810 0x7fe39015b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:58.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.576+0000 7fe395000640 1 --2- 172.21.15.57:0/1260903908 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fe374004d40 0x7fe3901404a0 unknown :-1 s=CLOSED pgs=2252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:58.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.576+0000 7fe395000640 1 -- 172.21.15.57:0/1260903908 >> 172.21.15.57:0/1260903908 conn(0x7fe3900b1c60 msgr2=0x7fe390071a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T19:51:58.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.576+0000 7fe395000640 1 -- 172.21.15.57:0/1260903908 shutdown_connections 2024-03-27T19:51:58.579 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.576+0000 7fe395000640 1 -- 172.21.15.57:0/1260903908 wait complete. 2024-03-27T19:51:58.596 INFO:tasks.ceph:Scrubbing osd.4 2024-03-27T19:51:58.596 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-03-27T19:51:58.805 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.803+0000 7f1ea2c00640 1 Processor -- start 2024-03-27T19:51:58.805 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.803+0000 7f1ea2c00640 1 -- start start 2024-03-27T19:51:58.806 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.805+0000 7f1ea2c00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f1e9c0ca5a0 0x7f1e9c0cd8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:58.806 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.805+0000 7f1ea2c00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1e9c15ba10 0x7f1e9c071170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:58.806 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.805+0000 7f1ea2c00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e9c15efc0 con 0x7f1e9c072bf0 2024-03-27T19:51:58.807 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.805+0000 7f1ea2c00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f1e9c15b580 con 0x7f1e9c0ca5a0 2024-03-27T19:51:58.807 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.805+0000 7f1ea2c00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f1e9c15af30 con 0x7f1e9c15ba10 2024-03-27T19:51:58.808 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.806+0000 7f1e9be00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f1e9c0ca5a0 0x7f1e9c0cd8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:58.808 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.806+0000 7f1ea0c00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1e9c15ba10 0x7f1e9c071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:58.808 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.806+0000 7f1e9be00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f1e9c0ca5a0 0x7f1e9c0cd8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.57:57346/0 (socket says 172.21.15.57:57346) 2024-03-27T19:51:58.808 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.806+0000 7f1e9b400640 1 --1- >> v1:172.21.15.118:6789/0 conn(0x7f1e9c072bf0 0x7f1e9c0ca980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.118:6789/0 says I am v1:172.21.15.57:49804/0 (socket says 172.21.15.57:49804) 2024-03-27T19:51:58.808 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.806+0000 7f1e9be00640 1 -- 172.21.15.57:0/732580773 learned_addr learned my addr 172.21.15.57:0/732580773 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T19:51:58.808 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.807+0000 7f1ea0c00640 1 -- 172.21.15.57:0/732580773 >> v2:172.21.15.118:3300/0 conn(0x7f1e9c0ca5a0 msgr2=0x7f1e9c0cd8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T19:51:58.809 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.807+0000 7f1ea0c00640 1 --2- 172.21.15.57:0/732580773 >> v2:172.21.15.118:3300/0 conn(0x7f1e9c0ca5a0 0x7f1e9c0cd8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:58.809 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.807+0000 7f1ea0c00640 1 -- 172.21.15.57:0/732580773 >> v1:172.21.15.118:6789/0 conn(0x7f1e9c072bf0 legacy=0x7f1e9c0ca980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:58.809 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.807+0000 7f1e9aa00640 1 -- 172.21.15.57:0/732580773 <== mon.1 v1:172.21.15.118:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 75818996 0 0) 0x7f1e9c15efc0 con 0x7f1e9c072bf0 2024-03-27T19:51:58.809 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.807+0000 7f1ea0c00640 1 -- 172.21.15.57:0/732580773 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e9c15b210 con 0x7f1e9c15ba10 2024-03-27T19:51:58.810 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.809+0000 7f1ea0c00640 1 --2- 172.21.15.57:0/732580773 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1e9c15ba10 0x7f1e9c071170 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f1e9400bfa0 tx=0x7f1e9402e0a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15744551331515b8 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:51:58.810 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.809+0000 7f1e9aa00640 1 -- 172.21.15.57:0/732580773 <== mon.2 v2:172.21.15.118:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e94034070 con 0x7f1e9c15ba10 2024-03-27T19:51:58.810 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.809+0000 7f1e9aa00640 1 -- 172.21.15.57:0/732580773 <== mon.2 v2:172.21.15.118:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e9402ee50 con 0x7f1e9c15ba10 2024-03-27T19:51:58.810 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.809+0000 7f1e9aa00640 1 -- 172.21.15.57:0/732580773 <== mon.2 v2:172.21.15.118:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e94038620 con 0x7f1e9c15ba10 2024-03-27T19:51:58.811 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.810+0000 7f1ea2c00640 1 -- 172.21.15.57:0/732580773 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1e9c15ba10 msgr2=0x7f1e9c071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:58.811 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.810+0000 7f1ea2c00640 1 --2- 172.21.15.57:0/732580773 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1e9c15ba10 0x7f1e9c071170 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f1e9400bfa0 tx=0x7f1e9402e0a0 comp rx=0 tx=0).stop 2024-03-27T19:51:58.811 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.810+0000 7f1ea2c00640 1 -- 172.21.15.57:0/732580773 shutdown_connections 2024-03-27T19:51:58.812 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.810+0000 7f1ea2c00640 1 --2- 172.21.15.57:0/732580773 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1e9c15ba10 0x7f1e9c071170 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:58.812 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.810+0000 7f1ea2c00640 1 --2- 172.21.15.57:0/732580773 >> v2:172.21.15.118:3300/0 conn(0x7f1e9c0ca5a0 0x7f1e9c0cd8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:58.812 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.810+0000 7f1ea2c00640 1 -- 172.21.15.57:0/732580773 >> 172.21.15.57:0/732580773 conn(0x7f1e9c0b1870 msgr2=0x7f1e9c0b1c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T19:51:58.812 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.810+0000 7f1ea2c00640 1 -- 172.21.15.57:0/732580773 shutdown_connections 2024-03-27T19:51:58.812 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.810+0000 7f1ea2c00640 1 -- 172.21.15.57:0/732580773 wait complete. 2024-03-27T19:51:58.813 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.811+0000 7f1ea2c00640 1 Processor -- start 2024-03-27T19:51:58.813 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.812+0000 7f1ea2c00640 1 -- start start 2024-03-27T19:51:58.815 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.813+0000 7f1ea2c00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1e9c072bf0 0x7f1e9c0c3850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:58.816 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.813+0000 7f1ea2c00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1e9c0ca5a0 0x7f1e9c0c9790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:58.816 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.813+0000 7f1ea2c00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1e9c15ba10 0x7f1e9c159810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:58.816 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.813+0000 7f1ea2c00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f1e9c0cc7a0 con 0x7f1e9c0ca5a0 2024-03-27T19:51:58.816 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.813+0000 7f1ea2c00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f1e9c06e760 con 0x7f1e9c072bf0 2024-03-27T19:51:58.816 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.813+0000 7f1ea2c00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f1e9c0cc920 con 0x7f1e9c15ba10 2024-03-27T19:51:58.816 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.813+0000 7f1e9b400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1e9c0ca5a0 0x7f1e9c0c9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:58.816 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.813+0000 7f1e9b400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1e9c0ca5a0 0x7f1e9c0c9790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56072/0 (socket says 172.21.15.57:56072) 2024-03-27T19:51:58.816 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.813+0000 7f1e9b400640 1 -- 172.21.15.57:0/560377651 learned_addr learned my addr 172.21.15.57:0/560377651 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T19:51:58.817 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.813+0000 7f1e9be00640 1 --2- 172.21.15.57:0/560377651 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1e9c072bf0 0x7f1e9c0c3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:58.817 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.813+0000 7f1ea0c00640 1 --2- 172.21.15.57:0/560377651 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1e9c15ba10 0x7f1e9c159810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:58.817 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.813+0000 7f1e9b400640 1 -- 172.21.15.57:0/560377651 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1e9c15ba10 msgr2=0x7f1e9c159810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:58.817 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.814+0000 7f1e9b400640 1 --2- 172.21.15.57:0/560377651 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f1e9c15ba10 0x7f1e9c159810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:58.817 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.814+0000 7f1e9b400640 1 -- 172.21.15.57:0/560377651 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1e9c072bf0 msgr2=0x7f1e9c0c3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:58.817 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.814+0000 7f1e9b400640 1 --2- 172.21.15.57:0/560377651 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1e9c072bf0 0x7f1e9c0c3850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:58.817 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.814+0000 7f1e9b400640 1 -- 172.21.15.57:0/560377651 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e9c0c9cd0 con 0x7f1e9c0ca5a0 2024-03-27T19:51:58.817 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.814+0000 7f1e9be00640 1 --2- 172.21.15.57:0/560377651 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f1e9c072bf0 0x7f1e9c0c3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T19:51:58.817 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.814+0000 7f1e9b400640 1 --2- 172.21.15.57:0/560377651 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1e9c0ca5a0 0x7f1e9c0c9790 secure :-1 s=READY pgs=2253 cs=0 l=1 rev1=1 crypto rx=0x7f1e8800c500 tx=0x7f1e8800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:51:58.818 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.814+0000 7f1e93e00640 1 -- 172.21.15.57:0/560377651 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e88018070 con 0x7f1e9c0ca5a0 2024-03-27T19:51:58.818 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.814+0000 7f1e93e00640 1 -- 172.21.15.57:0/560377651 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e88007580 con 0x7f1e9c0ca5a0 2024-03-27T19:51:58.818 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.814+0000 7f1e93e00640 1 -- 172.21.15.57:0/560377651 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e88004a20 con 0x7f1e9c0ca5a0 2024-03-27T19:51:58.818 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.814+0000 7f1ea2c00640 1 -- 172.21.15.57:0/560377651 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e9c159d50 con 0x7f1e9c0ca5a0 2024-03-27T19:51:58.818 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.814+0000 7f1ea2c00640 1 -- 172.21.15.57:0/560377651 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e9c0c41c0 con 0x7f1e9c0ca5a0 2024-03-27T19:51:58.820 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.815+0000 7f1ea2c00640 1 -- 172.21.15.57:0/560377651 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1e9c068620 con 0x7f1e9c0ca5a0 2024-03-27T19:51:58.820 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.817+0000 7f1e93e00640 1 -- 172.21.15.57:0/560377651 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f1e88004bc0 con 0x7f1e9c0ca5a0 2024-03-27T19:51:58.820 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.817+0000 7f1e93e00640 1 --2- 172.21.15.57:0/560377651 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f1e7c06c530 0x7f1e7c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:58.820 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.818+0000 7f1e93e00640 1 -- 172.21.15.57:0/560377651 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5335+0+0 (secure 0 0 0) 0x7f1e8808a7d0 con 0x7f1e9c0ca5a0 2024-03-27T19:51:58.820 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.818+0000 7f1e9be00640 1 --2- 172.21.15.57:0/560377651 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f1e7c06c530 0x7f1e7c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:58.820 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.818+0000 7f1e93e00640 1 --2- 172.21.15.57:0/560377651 >> [v2:172.21.15.118:6821/108719401,v1:172.21.15.118:6823/108719401] conn(0x7f1e7c0729d0 0x7f1e7c074e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:58.820 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.818+0000 7f1e93e00640 1 -- 172.21.15.57:0/560377651 --> [v2:172.21.15.118:6821/108719401,v1:172.21.15.118:6823/108719401] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1e7c0754e0 con 0x7f1e7c0729d0 2024-03-27T19:51:58.821 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.818+0000 7f1e93e00640 1 -- 172.21.15.57:0/560377651 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f1e88091050 con 0x7f1e9c0ca5a0 2024-03-27T19:51:58.821 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.819+0000 7f1ea0c00640 1 --2- 172.21.15.57:0/560377651 >> [v2:172.21.15.118:6821/108719401,v1:172.21.15.118:6823/108719401] conn(0x7f1e7c0729d0 0x7f1e7c074e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:58.821 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.819+0000 7f1e9be00640 1 --2- 172.21.15.57:0/560377651 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f1e7c06c530 0x7f1e7c06e9f0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f1e8c009ac0 tx=0x7f1e8c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:51:58.821 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.820+0000 7f1ea0c00640 1 --2- 172.21.15.57:0/560377651 >> [v2:172.21.15.118:6821/108719401,v1:172.21.15.118:6823/108719401] conn(0x7f1e7c0729d0 0x7f1e7c074e10 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:51:58.823 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.822+0000 7f1e93e00640 1 -- 172.21.15.57:0/560377651 <== osd.4 v2:172.21.15.118:6821/108719401 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1e7c0754e0 con 0x7f1e7c0729d0 2024-03-27T19:51:58.837 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.836+0000 7f1ea2c00640 1 -- 172.21.15.57:0/560377651 --> [v2:172.21.15.118:6821/108719401,v1:172.21.15.118:6823/108719401] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f1e9c15a5b0 con 0x7f1e7c0729d0 2024-03-27T19:51:58.838 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.837+0000 7f1e93e00640 1 -- 172.21.15.57:0/560377651 <== osd.4 v2:172.21.15.118:6821/108719401 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f1e9c15a5b0 con 0x7f1e7c0729d0 2024-03-27T19:51:58.838 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-03-27T19:51:58.839 INFO:teuthology.orchestra.run.smithi057.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-27T19:51:58.839 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-03-27T19:51:58.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.837+0000 7f1ea2c00640 1 -- 172.21.15.57:0/560377651 >> [v2:172.21.15.118:6821/108719401,v1:172.21.15.118:6823/108719401] conn(0x7f1e7c0729d0 msgr2=0x7f1e7c074e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:58.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.837+0000 7f1ea2c00640 1 --2- 172.21.15.57:0/560377651 >> [v2:172.21.15.118:6821/108719401,v1:172.21.15.118:6823/108719401] conn(0x7f1e7c0729d0 0x7f1e7c074e10 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:58.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.837+0000 7f1ea2c00640 1 -- 172.21.15.57:0/560377651 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f1e7c06c530 msgr2=0x7f1e7c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:58.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.837+0000 7f1ea2c00640 1 --2- 172.21.15.57:0/560377651 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f1e7c06c530 0x7f1e7c06e9f0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f1e8c009ac0 tx=0x7f1e8c008040 comp rx=0 tx=0).stop 2024-03-27T19:51:58.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.837+0000 7f1ea2c00640 1 -- 172.21.15.57:0/560377651 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1e9c0ca5a0 msgr2=0x7f1e9c0c9790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:58.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.837+0000 7f1ea2c00640 1 --2- 172.21.15.57:0/560377651 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f1e9c0ca5a0 0x7f1e9c0c9790 secure :-1 s=READY pgs=2253 cs=0 l=1 rev1=1 crypto rx=0x7f1e8800c500 tx=0x7f1e8800c9c0 comp rx=0 tx=0).stop 2024-03-27T19:51:58.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.837+0000 7f1ea0c00640 1 -- 172.21.15.57:0/560377651 reap_dead start 2024-03-27T19:51:58.840 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.838+0000 7f1ea2c00640 1 -- 172.21.15.57:0/560377651 shutdown_connections 2024-03-27T19:51:58.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.838+0000 7f1ea2c00640 1 -- 172.21.15.57:0/560377651 >> 172.21.15.57:0/560377651 conn(0x7f1e9c0b1870 msgr2=0x7f1e9c0b1c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T19:51:58.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.838+0000 7f1ea2c00640 1 -- 172.21.15.57:0/560377651 shutdown_connections 2024-03-27T19:51:58.841 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:58.838+0000 7f1ea2c00640 1 -- 172.21.15.57:0/560377651 wait complete. 2024-03-27T19:51:58.854 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-03-27T19:51:59.051 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.050+0000 7f724b200640 1 Processor -- start 2024-03-27T19:51:59.052 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.050+0000 7f724b200640 1 -- start start 2024-03-27T19:51:59.053 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.052+0000 7f724b200640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f72441457d0 0x7f724406e190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:59.054 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.052+0000 7f724b200640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f7244072830 0x7f724406b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:59.054 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.052+0000 7f724b200640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7244145bb0 con 0x7f724406b540 2024-03-27T19:51:59.054 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.052+0000 7f724b200640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f72440cf8b0 con 0x7f72441457d0 2024-03-27T19:51:59.054 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.052+0000 7f724b200640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f7244072d70 con 0x7f7244072830 2024-03-27T19:51:59.054 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.052+0000 7f7249e00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f72441457d0 0x7f724406e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:59.054 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.052+0000 7f7249e00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f72441457d0 0x7f724406e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56084/0 (socket says 172.21.15.57:56084) 2024-03-27T19:51:59.054 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.052+0000 7f7249e00640 1 -- 172.21.15.57:0/4101650066 learned_addr learned my addr 172.21.15.57:0/4101650066 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T19:51:59.054 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.053+0000 7f724a800640 1 --2- 172.21.15.57:0/4101650066 >> v2:172.21.15.118:3300/0 conn(0x7f7244072830 0x7f724406b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:59.056 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.053+0000 7f7249e00640 1 -- 172.21.15.57:0/4101650066 >> v2:172.21.15.118:3300/0 conn(0x7f7244072830 msgr2=0x7f724406b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T19:51:59.056 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.053+0000 7f7249e00640 1 --2- 172.21.15.57:0/4101650066 >> v2:172.21.15.118:3300/0 conn(0x7f7244072830 0x7f724406b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:59.056 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.053+0000 7f7249e00640 1 -- 172.21.15.57:0/4101650066 >> v1:172.21.15.57:6789/0 conn(0x7f724406b540 legacy=0x7f7244072120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:59.056 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.053+0000 7f7249e00640 1 -- 172.21.15.57:0/4101650066 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7244073050 con 0x7f72441457d0 2024-03-27T19:51:59.057 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.053+0000 7f7248a00640 1 -- 172.21.15.57:0/4101650066 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1485001909 0 0) 0x7f7244145bb0 con 0x7f724406b540 2024-03-27T19:51:59.057 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.053+0000 7f724a800640 1 --2- 172.21.15.57:0/4101650066 >> v2:172.21.15.118:3300/0 conn(0x7f7244072830 0x7f724406b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T19:51:59.057 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.054+0000 7f7249e00640 1 --2- 172.21.15.57:0/4101650066 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f72441457d0 0x7f724406e190 secure :-1 s=READY pgs=2255 cs=0 l=1 rev1=1 crypto rx=0x7f724406df40 tx=0x7f723802b9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34d4f829408db1fd server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:51:59.057 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.054+0000 7f7248a00640 1 -- 172.21.15.57:0/4101650066 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7238034070 con 0x7f72441457d0 2024-03-27T19:51:59.057 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.054+0000 7f7248a00640 1 -- 172.21.15.57:0/4101650066 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7238030880 con 0x7f72441457d0 2024-03-27T19:51:59.057 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.054+0000 7f7248a00640 1 -- 172.21.15.57:0/4101650066 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7238030c50 con 0x7f72441457d0 2024-03-27T19:51:59.057 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.055+0000 7f724b200640 1 -- 172.21.15.57:0/4101650066 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f72441457d0 msgr2=0x7f724406e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:59.057 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.055+0000 7f724b200640 1 --2- 172.21.15.57:0/4101650066 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f72441457d0 0x7f724406e190 secure :-1 s=READY pgs=2255 cs=0 l=1 rev1=1 crypto rx=0x7f724406df40 tx=0x7f723802b9c0 comp rx=0 tx=0).stop 2024-03-27T19:51:59.058 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.055+0000 7f724b200640 1 -- 172.21.15.57:0/4101650066 shutdown_connections 2024-03-27T19:51:59.058 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.055+0000 7f724b200640 1 --2- 172.21.15.57:0/4101650066 >> v2:172.21.15.118:3300/0 conn(0x7f7244072830 0x7f724406b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:59.058 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.055+0000 7f724b200640 1 --2- 172.21.15.57:0/4101650066 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f72441457d0 0x7f724406e190 unknown :-1 s=CLOSED pgs=2255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:59.058 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.055+0000 7f724b200640 1 -- 172.21.15.57:0/4101650066 >> 172.21.15.57:0/4101650066 conn(0x7f72440b2880 msgr2=0x7f72440b2c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T19:51:59.058 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.055+0000 7f724b200640 1 -- 172.21.15.57:0/4101650066 shutdown_connections 2024-03-27T19:51:59.058 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.055+0000 7f724b200640 1 -- 172.21.15.57:0/4101650066 wait complete. 2024-03-27T19:51:59.060 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.056+0000 7f724b200640 1 Processor -- start 2024-03-27T19:51:59.060 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.057+0000 7f724b200640 1 -- start start 2024-03-27T19:51:59.061 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.057+0000 7f724b200640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f724406b540 0x7f72440abe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:59.061 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.057+0000 7f724b200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7244072830 0x7f72441f0b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:59.061 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.058+0000 7f724b200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f72441457d0 0x7f72441f1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:59.061 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.058+0000 7f724b200640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f72440cf2e0 con 0x7f724406b540 2024-03-27T19:51:59.061 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.058+0000 7f724b200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f72440cf160 con 0x7f7244072830 2024-03-27T19:51:59.061 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.058+0000 7f724b200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f724406e6d0 con 0x7f72441457d0 2024-03-27T19:51:59.061 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.058+0000 7f7249e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f724406b540 0x7f72440abe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:59.061 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.058+0000 7f7249e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f724406b540 0x7f72440abe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56086/0 (socket says 172.21.15.57:56086) 2024-03-27T19:51:59.062 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.058+0000 7f7249e00640 1 -- 172.21.15.57:0/2972962049 learned_addr learned my addr 172.21.15.57:0/2972962049 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T19:51:59.062 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.058+0000 7f724a800640 1 --2- 172.21.15.57:0/2972962049 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f72441457d0 0x7f72441f1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:59.062 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.058+0000 7f7249e00640 1 -- 172.21.15.57:0/2972962049 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f72441457d0 msgr2=0x7f72441f1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:59.062 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.058+0000 7f7249400640 1 --2- 172.21.15.57:0/2972962049 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7244072830 0x7f72441f0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:59.062 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.058+0000 7f7249e00640 1 --2- 172.21.15.57:0/2972962049 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f72441457d0 0x7f72441f1080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:59.062 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.058+0000 7f7249e00640 1 -- 172.21.15.57:0/2972962049 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7244072830 msgr2=0x7f72441f0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:59.062 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.058+0000 7f7249e00640 1 --2- 172.21.15.57:0/2972962049 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7244072830 0x7f72441f0b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:59.062 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.058+0000 7f7249e00640 1 -- 172.21.15.57:0/2972962049 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72440b4cc0 con 0x7f724406b540 2024-03-27T19:51:59.063 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.059+0000 7f7249e00640 1 --2- 172.21.15.57:0/2972962049 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f724406b540 0x7f72440abe90 secure :-1 s=READY pgs=2256 cs=0 l=1 rev1=1 crypto rx=0x7f72380090b0 tx=0x7f72380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:51:59.063 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.059+0000 7f723e000640 1 -- 172.21.15.57:0/2972962049 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7238034040 con 0x7f724406b540 2024-03-27T19:51:59.063 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.059+0000 7f723e000640 1 -- 172.21.15.57:0/2972962049 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f723803ad10 con 0x7f724406b540 2024-03-27T19:51:59.063 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.059+0000 7f723e000640 1 -- 172.21.15.57:0/2972962049 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7238004270 con 0x7f724406b540 2024-03-27T19:51:59.063 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.059+0000 7f724b200640 1 -- 172.21.15.57:0/2972962049 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72440b4fa0 con 0x7f724406b540 2024-03-27T19:51:59.063 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.059+0000 7f724b200640 1 -- 172.21.15.57:0/2972962049 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72440b5560 con 0x7f724406b540 2024-03-27T19:51:59.064 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.060+0000 7f724b200640 1 -- 172.21.15.57:0/2972962049 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7244068c50 con 0x7f724406b540 2024-03-27T19:51:59.064 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.062+0000 7f723e000640 1 -- 172.21.15.57:0/2972962049 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f723804b060 con 0x7f724406b540 2024-03-27T19:51:59.064 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.062+0000 7f723e000640 1 --2- 172.21.15.57:0/2972962049 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f722806c530 0x7f722806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:59.065 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.063+0000 7f723e000640 1 -- 172.21.15.57:0/2972962049 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5335+0+0 (secure 0 0 0) 0x7f72380ad6a0 con 0x7f724406b540 2024-03-27T19:51:59.065 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.063+0000 7f7249400640 1 --2- 172.21.15.57:0/2972962049 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f722806c530 0x7f722806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:59.065 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.063+0000 7f7249400640 1 --2- 172.21.15.57:0/2972962049 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f722806c530 0x7f722806e9f0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f72440b2fb0 tx=0x7f7234009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:51:59.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.067+0000 7f723e000640 1 -- 172.21.15.57:0/2972962049 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f723803f070 con 0x7f724406b540 2024-03-27T19:51:59.264 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.262+0000 7f724b200640 1 -- 172.21.15.57:0/2972962049 --> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f724406df70 con 0x7f722806c530 2024-03-27T19:51:59.265 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.263+0000 7f723e000640 1 -- 172.21.15.57:0/2972962049 <== mgr.4103 v2:172.21.15.57:6832/485397065 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f724406df70 con 0x7f722806c530 2024-03-27T19:51:59.265 INFO:teuthology.orchestra.run.smithi057.stderr:instructed osd(s) 4 to deep-scrub 2024-03-27T19:51:59.268 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.265+0000 7f724b200640 1 -- 172.21.15.57:0/2972962049 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f722806c530 msgr2=0x7f722806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:59.268 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.265+0000 7f724b200640 1 --2- 172.21.15.57:0/2972962049 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f722806c530 0x7f722806e9f0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f72440b2fb0 tx=0x7f7234009040 comp rx=0 tx=0).stop 2024-03-27T19:51:59.268 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.265+0000 7f724b200640 1 -- 172.21.15.57:0/2972962049 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f724406b540 msgr2=0x7f72440abe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:59.268 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.265+0000 7f724b200640 1 --2- 172.21.15.57:0/2972962049 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f724406b540 0x7f72440abe90 secure :-1 s=READY pgs=2256 cs=0 l=1 rev1=1 crypto rx=0x7f72380090b0 tx=0x7f72380046c0 comp rx=0 tx=0).stop 2024-03-27T19:51:59.269 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.265+0000 7f724b200640 1 -- 172.21.15.57:0/2972962049 shutdown_connections 2024-03-27T19:51:59.269 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.265+0000 7f724b200640 1 --2- 172.21.15.57:0/2972962049 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f72441457d0 0x7f72441f1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:59.269 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.265+0000 7f724b200640 1 --2- 172.21.15.57:0/2972962049 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f722806c530 0x7f722806e9f0 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:59.269 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.265+0000 7f724b200640 1 --2- 172.21.15.57:0/2972962049 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f7244072830 0x7f72441f0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:59.269 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.265+0000 7f724b200640 1 --2- 172.21.15.57:0/2972962049 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f724406b540 0x7f72440abe90 unknown :-1 s=CLOSED pgs=2256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:59.270 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.265+0000 7f724b200640 1 -- 172.21.15.57:0/2972962049 >> 172.21.15.57:0/2972962049 conn(0x7f72440b2880 msgr2=0x7f72440b1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T19:51:59.270 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.266+0000 7f724b200640 1 -- 172.21.15.57:0/2972962049 shutdown_connections 2024-03-27T19:51:59.270 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.266+0000 7f724b200640 1 -- 172.21.15.57:0/2972962049 wait complete. 2024-03-27T19:51:59.285 INFO:tasks.ceph:Scrubbing osd.5 2024-03-27T19:51:59.285 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-03-27T19:51:59.487 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.486+0000 7f3e36600640 1 Processor -- start 2024-03-27T19:51:59.488 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.486+0000 7f3e36600640 1 -- start start 2024-03-27T19:51:59.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.487+0000 7f3e36600640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f3e3015e420 0x7f3e300d0940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:59.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.487+0000 7f3e36600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3e300d0e80 0x7f3e300b4b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:59.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.487+0000 7f3e36600640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e300d2fa0 con 0x7f3e3015e040 2024-03-27T19:51:59.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.487+0000 7f3e36600640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f3e300d2b10 con 0x7f3e3015e420 2024-03-27T19:51:59.489 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.487+0000 7f3e36600640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f3e300d1f00 con 0x7f3e300d0e80 2024-03-27T19:51:59.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.488+0000 7f3e2fe00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f3e3015e420 0x7f3e300d0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:59.490 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.488+0000 7f3e35c00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3e300d0e80 0x7f3e300b4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:59.491 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.488+0000 7f3e2fe00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f3e3015e420 0x7f3e300d0940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.57:57388/0 (socket says 172.21.15.57:57388) 2024-03-27T19:51:59.491 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.488+0000 7f3e2fe00640 1 -- 172.21.15.57:0/1793366873 learned_addr learned my addr 172.21.15.57:0/1793366873 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T19:51:59.491 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.489+0000 7f3e2fe00640 1 -- 172.21.15.57:0/1793366873 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3e300d0e80 msgr2=0x7f3e300b4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T19:51:59.491 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.489+0000 7f3e2fe00640 1 --2- 172.21.15.57:0/1793366873 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3e300d0e80 0x7f3e300b4b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:59.491 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.489+0000 7f3e2fe00640 1 -- 172.21.15.57:0/1793366873 >> v1:172.21.15.118:6789/0 conn(0x7f3e3015e040 legacy=0x7f3e300cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:59.491 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.489+0000 7f3e2fe00640 1 -- 172.21.15.57:0/1793366873 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e300d21e0 con 0x7f3e3015e420 2024-03-27T19:51:59.493 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.490+0000 7f3e2fe00640 1 --2- 172.21.15.57:0/1793366873 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3e3015e420 0x7f3e300d0940 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c009870 tx=0x7f3e1c02b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d99f32fddf202723 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:51:59.493 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.491+0000 7f3e2f400640 1 -- 172.21.15.57:0/1793366873 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e1c034070 con 0x7f3e3015e420 2024-03-27T19:51:59.493 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.491+0000 7f3e2f400640 1 -- 172.21.15.57:0/1793366873 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e1c030840 con 0x7f3e3015e420 2024-03-27T19:51:59.493 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.491+0000 7f3e2f400640 1 -- 172.21.15.57:0/1793366873 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e1c030c10 con 0x7f3e3015e420 2024-03-27T19:51:59.493 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.491+0000 7f3e36600640 1 -- 172.21.15.57:0/1793366873 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3e3015e420 msgr2=0x7f3e300d0940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:59.493 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.491+0000 7f3e36600640 1 --2- 172.21.15.57:0/1793366873 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3e3015e420 0x7f3e300d0940 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c009870 tx=0x7f3e1c02b980 comp rx=0 tx=0).stop 2024-03-27T19:51:59.494 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.491+0000 7f3e36600640 1 -- 172.21.15.57:0/1793366873 shutdown_connections 2024-03-27T19:51:59.494 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.491+0000 7f3e36600640 1 --2- 172.21.15.57:0/1793366873 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3e300d0e80 0x7f3e300b4b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:59.494 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.491+0000 7f3e36600640 1 --2- 172.21.15.57:0/1793366873 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3e3015e420 0x7f3e300d0940 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:59.494 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.491+0000 7f3e36600640 1 -- 172.21.15.57:0/1793366873 >> 172.21.15.57:0/1793366873 conn(0x7f3e3009d2c0 msgr2=0x7f3e300d3f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T19:51:59.494 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.492+0000 7f3e36600640 1 -- 172.21.15.57:0/1793366873 shutdown_connections 2024-03-27T19:51:59.494 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.492+0000 7f3e36600640 1 -- 172.21.15.57:0/1793366873 wait complete. 2024-03-27T19:51:59.495 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.493+0000 7f3e36600640 1 Processor -- start 2024-03-27T19:51:59.495 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.493+0000 7f3e36600640 1 -- start start 2024-03-27T19:51:59.497 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.494+0000 7f3e36600640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3e300d0e80 0x7f3e30159dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:59.497 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.494+0000 7f3e36600640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e3015e040 0x7f3e300c78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:59.497 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.494+0000 7f3e36600640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3e3015e420 0x7f3e300c7df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:59.497 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.494+0000 7f3e36600640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f3e300cff20 con 0x7f3e3015e040 2024-03-27T19:51:59.497 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.494+0000 7f3e36600640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f3e300d27a0 con 0x7f3e300d0e80 2024-03-27T19:51:59.497 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.494+0000 7f3e36600640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f3e300d1b20 con 0x7f3e3015e420 2024-03-27T19:51:59.498 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.494+0000 7f3e2fe00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e3015e040 0x7f3e300c78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:59.498 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.494+0000 7f3e2fe00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e3015e040 0x7f3e300c78b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56102/0 (socket says 172.21.15.57:56102) 2024-03-27T19:51:59.498 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.495+0000 7f3e2fe00640 1 -- 172.21.15.57:0/662691397 learned_addr learned my addr 172.21.15.57:0/662691397 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T19:51:59.498 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.495+0000 7f3e35200640 1 --2- 172.21.15.57:0/662691397 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3e300d0e80 0x7f3e30159dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:59.498 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.495+0000 7f3e35c00640 1 --2- 172.21.15.57:0/662691397 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3e3015e420 0x7f3e300c7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:59.498 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.495+0000 7f3e2fe00640 1 -- 172.21.15.57:0/662691397 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3e3015e420 msgr2=0x7f3e300c7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:59.499 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.495+0000 7f3e2fe00640 1 --2- 172.21.15.57:0/662691397 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3e3015e420 0x7f3e300c7df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:59.499 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.495+0000 7f3e2fe00640 1 -- 172.21.15.57:0/662691397 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3e300d0e80 msgr2=0x7f3e30159dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:59.499 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.495+0000 7f3e2fe00640 1 --2- 172.21.15.57:0/662691397 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3e300d0e80 0x7f3e30159dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:59.499 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.495+0000 7f3e2fe00640 1 -- 172.21.15.57:0/662691397 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e300ca300 con 0x7f3e3015e040 2024-03-27T19:51:59.499 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.495+0000 7f3e2fe00640 1 --2- 172.21.15.57:0/662691397 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e3015e040 0x7f3e300c78b0 secure :-1 s=READY pgs=2257 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c0090b0 tx=0x7f3e1c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:51:59.499 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.496+0000 7f3e2cc00640 1 -- 172.21.15.57:0/662691397 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e1c034040 con 0x7f3e3015e040 2024-03-27T19:51:59.499 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.496+0000 7f3e2cc00640 1 -- 172.21.15.57:0/662691397 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e1c030640 con 0x7f3e3015e040 2024-03-27T19:51:59.499 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.496+0000 7f3e36600640 1 -- 172.21.15.57:0/662691397 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e300ca5e0 con 0x7f3e3015e040 2024-03-27T19:51:59.500 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.496+0000 7f3e2cc00640 1 -- 172.21.15.57:0/662691397 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e1c0423f0 con 0x7f3e3015e040 2024-03-27T19:51:59.500 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.496+0000 7f3e36600640 1 -- 172.21.15.57:0/662691397 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e300cc460 con 0x7f3e3015e040 2024-03-27T19:51:59.500 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.497+0000 7f3e36600640 1 -- 172.21.15.57:0/662691397 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3e30068540 con 0x7f3e3015e040 2024-03-27T19:51:59.500 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.499+0000 7f3e2cc00640 1 -- 172.21.15.57:0/662691397 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f3e1c037070 con 0x7f3e3015e040 2024-03-27T19:51:59.501 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.500+0000 7f3e2cc00640 1 --2- 172.21.15.57:0/662691397 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f3e1006c530 0x7f3e1006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:59.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.500+0000 7f3e2cc00640 1 -- 172.21.15.57:0/662691397 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5335+0+0 (secure 0 0 0) 0x7f3e1c0ae3a0 con 0x7f3e3015e040 2024-03-27T19:51:59.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.500+0000 7f3e2cc00640 1 --2- 172.21.15.57:0/662691397 >> [v2:172.21.15.118:6816/2704605866,v1:172.21.15.118:6817/2704605866] conn(0x7f3e100729d0 0x7f3e10074e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:59.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.500+0000 7f3e35200640 1 --2- 172.21.15.57:0/662691397 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f3e1006c530 0x7f3e1006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:59.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.500+0000 7f3e2cc00640 1 -- 172.21.15.57:0/662691397 --> [v2:172.21.15.118:6816/2704605866,v1:172.21.15.118:6817/2704605866] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3e100754e0 con 0x7f3e100729d0 2024-03-27T19:51:59.502 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.500+0000 7f3e2cc00640 1 -- 172.21.15.57:0/662691397 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f3e1c0ae750 con 0x7f3e3015e040 2024-03-27T19:51:59.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.501+0000 7f3e35200640 1 --2- 172.21.15.57:0/662691397 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f3e1006c530 0x7f3e1006e9f0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f3e24001640 tx=0x7f3e24009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:51:59.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.501+0000 7f3e35c00640 1 --2- 172.21.15.57:0/662691397 >> [v2:172.21.15.118:6816/2704605866,v1:172.21.15.118:6817/2704605866] conn(0x7f3e100729d0 0x7f3e10074e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:59.503 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.502+0000 7f3e35c00640 1 --2- 172.21.15.57:0/662691397 >> [v2:172.21.15.118:6816/2704605866,v1:172.21.15.118:6817/2704605866] conn(0x7f3e100729d0 0x7f3e10074e10 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:51:59.505 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.504+0000 7f3e2cc00640 1 -- 172.21.15.57:0/662691397 <== osd.5 v2:172.21.15.118:6816/2704605866 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3e100754e0 con 0x7f3e100729d0 2024-03-27T19:51:59.519 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.518+0000 7f3e36600640 1 -- 172.21.15.57:0/662691397 --> [v2:172.21.15.118:6816/2704605866,v1:172.21.15.118:6817/2704605866] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f3e300d4660 con 0x7f3e100729d0 2024-03-27T19:51:59.520 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.519+0000 7f3e2cc00640 1 -- 172.21.15.57:0/662691397 <== osd.5 v2:172.21.15.118:6816/2704605866 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f3e300d4660 con 0x7f3e100729d0 2024-03-27T19:51:59.521 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-03-27T19:51:59.521 INFO:teuthology.orchestra.run.smithi057.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-27T19:51:59.521 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-03-27T19:51:59.522 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.520+0000 7f3e36600640 1 -- 172.21.15.57:0/662691397 >> [v2:172.21.15.118:6816/2704605866,v1:172.21.15.118:6817/2704605866] conn(0x7f3e100729d0 msgr2=0x7f3e10074e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:59.522 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.520+0000 7f3e36600640 1 --2- 172.21.15.57:0/662691397 >> [v2:172.21.15.118:6816/2704605866,v1:172.21.15.118:6817/2704605866] conn(0x7f3e100729d0 0x7f3e10074e10 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:59.522 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.520+0000 7f3e36600640 1 -- 172.21.15.57:0/662691397 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f3e1006c530 msgr2=0x7f3e1006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:59.522 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.520+0000 7f3e36600640 1 --2- 172.21.15.57:0/662691397 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f3e1006c530 0x7f3e1006e9f0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f3e24001640 tx=0x7f3e24009040 comp rx=0 tx=0).stop 2024-03-27T19:51:59.523 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.520+0000 7f3e36600640 1 -- 172.21.15.57:0/662691397 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e3015e040 msgr2=0x7f3e300c78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:59.523 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.520+0000 7f3e36600640 1 --2- 172.21.15.57:0/662691397 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3e3015e040 0x7f3e300c78b0 secure :-1 s=READY pgs=2257 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c0090b0 tx=0x7f3e1c0046c0 comp rx=0 tx=0).stop 2024-03-27T19:51:59.523 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.520+0000 7f3e35c00640 1 -- 172.21.15.57:0/662691397 reap_dead start 2024-03-27T19:51:59.523 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.520+0000 7f3e36600640 1 -- 172.21.15.57:0/662691397 shutdown_connections 2024-03-27T19:51:59.523 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.520+0000 7f3e36600640 1 -- 172.21.15.57:0/662691397 >> 172.21.15.57:0/662691397 conn(0x7f3e3009d2c0 msgr2=0x7f3e3006c850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T19:51:59.523 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.520+0000 7f3e36600640 1 -- 172.21.15.57:0/662691397 shutdown_connections 2024-03-27T19:51:59.523 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.520+0000 7f3e36600640 1 -- 172.21.15.57:0/662691397 wait complete. 2024-03-27T19:51:59.538 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-03-27T19:51:59.742 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.740+0000 7f13c9400640 1 Processor -- start 2024-03-27T19:51:59.742 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.741+0000 7f13c9400640 1 -- start start 2024-03-27T19:51:59.743 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.742+0000 7f13c9400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f13c40d2510 0x7f13c40d28f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:59.744 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.742+0000 7f13c9400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f13c40cfcc0 0x7f13c40b4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:59.744 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.742+0000 7f13c9400640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13c40d2e30 con 0x7f13c40d4640 2024-03-27T19:51:59.744 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.742+0000 7f13c9400640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f13c40b0b00 con 0x7f13c40d2510 2024-03-27T19:51:59.744 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.742+0000 7f13c9400640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f13c40d4db0 con 0x7f13c40cfcc0 2024-03-27T19:51:59.745 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.743+0000 7f13c3e00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f13c40d2510 0x7f13c40d28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:59.745 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.743+0000 7f13c8a00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f13c40cfcc0 0x7f13c40b4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:59.745 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.743+0000 7f13c3e00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f13c40d2510 0x7f13c40d28f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.118:3300/0 says I am v2:172.21.15.57:57408/0 (socket says 172.21.15.57:57408) 2024-03-27T19:51:59.745 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.743+0000 7f13c3e00640 1 -- 172.21.15.57:0/1417786962 learned_addr learned my addr 172.21.15.57:0/1417786962 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T19:51:59.745 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.743+0000 7f13c3e00640 1 -- 172.21.15.57:0/1417786962 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f13c40cfcc0 msgr2=0x7f13c40b4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T19:51:59.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.743+0000 7f13c3e00640 1 --2- 172.21.15.57:0/1417786962 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f13c40cfcc0 0x7f13c40b4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:59.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.743+0000 7f13c3e00640 1 -- 172.21.15.57:0/1417786962 >> v1:172.21.15.118:6789/0 conn(0x7f13c40d4640 legacy=0x7f13c40ceb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:59.746 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.744+0000 7f13c3e00640 1 -- 172.21.15.57:0/1417786962 --> v2:172.21.15.118:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13c40d4ad0 con 0x7f13c40d2510 2024-03-27T19:51:59.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.745+0000 7f13c3e00640 1 --2- 172.21.15.57:0/1417786962 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f13c40d2510 0x7f13c40d28f0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f13b4009870 tx=0x7f13b402b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c16063003890a65 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:51:59.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.745+0000 7f13c2a00640 1 -- 172.21.15.57:0/1417786962 <== mon.1 v2:172.21.15.118:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b4034070 con 0x7f13c40d2510 2024-03-27T19:51:59.747 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.745+0000 7f13c2a00640 1 -- 172.21.15.57:0/1417786962 <== mon.1 v2:172.21.15.118:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13b4030840 con 0x7f13c40d2510 2024-03-27T19:51:59.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.745+0000 7f13c2a00640 1 -- 172.21.15.57:0/1417786962 <== mon.1 v2:172.21.15.118:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b4030c10 con 0x7f13c40d2510 2024-03-27T19:51:59.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.746+0000 7f13c9400640 1 -- 172.21.15.57:0/1417786962 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f13c40d2510 msgr2=0x7f13c40d28f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:59.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.746+0000 7f13c9400640 1 --2- 172.21.15.57:0/1417786962 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f13c40d2510 0x7f13c40d28f0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f13b4009870 tx=0x7f13b402b980 comp rx=0 tx=0).stop 2024-03-27T19:51:59.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.746+0000 7f13c9400640 1 -- 172.21.15.57:0/1417786962 shutdown_connections 2024-03-27T19:51:59.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.746+0000 7f13c9400640 1 --2- 172.21.15.57:0/1417786962 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f13c40cfcc0 0x7f13c40b4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:59.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.746+0000 7f13c9400640 1 --2- 172.21.15.57:0/1417786962 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f13c40d2510 0x7f13c40d28f0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:59.748 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.746+0000 7f13c9400640 1 -- 172.21.15.57:0/1417786962 >> 172.21.15.57:0/1417786962 conn(0x7f13c409d2a0 msgr2=0x7f13c40d3f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T19:51:59.749 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.746+0000 7f13c9400640 1 -- 172.21.15.57:0/1417786962 shutdown_connections 2024-03-27T19:51:59.749 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.746+0000 7f13c9400640 1 -- 172.21.15.57:0/1417786962 wait complete. 2024-03-27T19:51:59.749 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.748+0000 7f13c9400640 1 Processor -- start 2024-03-27T19:51:59.749 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.748+0000 7f13c9400640 1 -- start start 2024-03-27T19:51:59.751 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.749+0000 7f13c9400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f13c40cfcc0 0x7f13c41f40f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:59.751 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.749+0000 7f13c9400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13c40d2510 0x7f13c40b5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:59.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.749+0000 7f13c9400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f13c40b5f60 0x7f13c40c9e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:59.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.749+0000 7f13c9400640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f13c40d2260 con 0x7f13c40d2510 2024-03-27T19:51:59.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.749+0000 7f13c9400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f13c40d1f80 con 0x7f13c40b5f60 2024-03-27T19:51:59.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.749+0000 7f13c9400640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f13c4162b90 con 0x7f13c40cfcc0 2024-03-27T19:51:59.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.749+0000 7f13c3400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13c40d2510 0x7f13c40b5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:59.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.749+0000 7f13c3400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13c40d2510 0x7f13c40b5a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56108/0 (socket says 172.21.15.57:56108) 2024-03-27T19:51:59.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.749+0000 7f13c3400640 1 -- 172.21.15.57:0/3682326057 learned_addr learned my addr 172.21.15.57:0/3682326057 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T19:51:59.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.749+0000 7f13c3e00640 1 --2- 172.21.15.57:0/3682326057 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f13c40cfcc0 0x7f13c41f40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:59.752 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.749+0000 7f13c8a00640 1 --2- 172.21.15.57:0/3682326057 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f13c40b5f60 0x7f13c40c9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:59.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.749+0000 7f13c3400640 1 -- 172.21.15.57:0/3682326057 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f13c40cfcc0 msgr2=0x7f13c41f40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:59.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.749+0000 7f13c3400640 1 --2- 172.21.15.57:0/3682326057 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f13c40cfcc0 0x7f13c41f40f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:59.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.749+0000 7f13c3400640 1 -- 172.21.15.57:0/3682326057 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f13c40b5f60 msgr2=0x7f13c40c9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:59.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.749+0000 7f13c3400640 1 --2- 172.21.15.57:0/3682326057 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f13c40b5f60 0x7f13c40c9e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:59.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.749+0000 7f13c3400640 1 -- 172.21.15.57:0/3682326057 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13c414e310 con 0x7f13c40d2510 2024-03-27T19:51:59.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.749+0000 7f13c3e00640 1 --2- 172.21.15.57:0/3682326057 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f13c40cfcc0 0x7f13c41f40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T19:51:59.753 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.750+0000 7f13c3400640 1 --2- 172.21.15.57:0/3682326057 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13c40d2510 0x7f13c40b5a20 secure :-1 s=READY pgs=2258 cs=0 l=1 rev1=1 crypto rx=0x7f13b000c440 tx=0x7f13b0001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:51:59.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.750+0000 7f13bbe00640 1 -- 172.21.15.57:0/3682326057 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b00052d0 con 0x7f13c40d2510 2024-03-27T19:51:59.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.750+0000 7f13bbe00640 1 -- 172.21.15.57:0/3682326057 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13b0005470 con 0x7f13c40d2510 2024-03-27T19:51:59.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.750+0000 7f13bbe00640 1 -- 172.21.15.57:0/3682326057 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13b0007260 con 0x7f13c40d2510 2024-03-27T19:51:59.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.750+0000 7f13c9400640 1 -- 172.21.15.57:0/3682326057 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13c414e5f0 con 0x7f13c40d2510 2024-03-27T19:51:59.754 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.750+0000 7f13c9400640 1 -- 172.21.15.57:0/3682326057 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13c414ebb0 con 0x7f13c40d2510 2024-03-27T19:51:59.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.752+0000 7f13c9400640 1 -- 172.21.15.57:0/3682326057 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13c4068540 con 0x7f13c40d2510 2024-03-27T19:51:59.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.752+0000 7f13bbe00640 1 -- 172.21.15.57:0/3682326057 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f13b0007400 con 0x7f13c40d2510 2024-03-27T19:51:59.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.753+0000 7f13bbe00640 1 --2- 172.21.15.57:0/3682326057 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f13a406c530 0x7f13a406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:51:59.755 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.753+0000 7f13bbe00640 1 -- 172.21.15.57:0/3682326057 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5335+0+0 (secure 0 0 0) 0x7f13b008aad0 con 0x7f13c40d2510 2024-03-27T19:51:59.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.753+0000 7f13c3e00640 1 --2- 172.21.15.57:0/3682326057 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f13a406c530 0x7f13a406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:51:59.756 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.754+0000 7f13c3e00640 1 --2- 172.21.15.57:0/3682326057 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f13a406c530 0x7f13a406e9f0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f13b4036000 tx=0x7f13b403b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:51:59.759 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.758+0000 7f13bbe00640 1 -- 172.21.15.57:0/3682326057 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f13b0059250 con 0x7f13c40d2510 2024-03-27T19:51:59.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.969+0000 7f13c9400640 1 -- 172.21.15.57:0/3682326057 --> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f13c406cee0 con 0x7f13a406c530 2024-03-27T19:51:59.971 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.970+0000 7f13bbe00640 1 -- 172.21.15.57:0/3682326057 <== mgr.4103 v2:172.21.15.57:6832/485397065 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f13c406cee0 con 0x7f13a406c530 2024-03-27T19:51:59.971 INFO:teuthology.orchestra.run.smithi057.stderr:instructed osd(s) 5 to deep-scrub 2024-03-27T19:51:59.974 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.972+0000 7f13c9400640 1 -- 172.21.15.57:0/3682326057 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f13a406c530 msgr2=0x7f13a406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:59.974 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.972+0000 7f13c9400640 1 --2- 172.21.15.57:0/3682326057 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f13a406c530 0x7f13a406e9f0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f13b4036000 tx=0x7f13b403b040 comp rx=0 tx=0).stop 2024-03-27T19:51:59.974 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.972+0000 7f13c9400640 1 -- 172.21.15.57:0/3682326057 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13c40d2510 msgr2=0x7f13c40b5a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:51:59.974 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.972+0000 7f13c9400640 1 --2- 172.21.15.57:0/3682326057 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13c40d2510 0x7f13c40b5a20 secure :-1 s=READY pgs=2258 cs=0 l=1 rev1=1 crypto rx=0x7f13b000c440 tx=0x7f13b0001e70 comp rx=0 tx=0).stop 2024-03-27T19:51:59.974 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.972+0000 7f13c9400640 1 -- 172.21.15.57:0/3682326057 shutdown_connections 2024-03-27T19:51:59.974 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.972+0000 7f13c9400640 1 --2- 172.21.15.57:0/3682326057 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f13a406c530 0x7f13a406e9f0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:59.975 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.972+0000 7f13c9400640 1 --2- 172.21.15.57:0/3682326057 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f13c40b5f60 0x7f13c40c9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:59.975 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.972+0000 7f13c9400640 1 --2- 172.21.15.57:0/3682326057 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f13c40d2510 0x7f13c40b5a20 unknown :-1 s=CLOSED pgs=2258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:59.975 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.972+0000 7f13c9400640 1 --2- 172.21.15.57:0/3682326057 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f13c40cfcc0 0x7f13c41f40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:51:59.975 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.972+0000 7f13c9400640 1 -- 172.21.15.57:0/3682326057 >> 172.21.15.57:0/3682326057 conn(0x7f13c409d2a0 msgr2=0x7f13c406d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T19:51:59.975 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.973+0000 7f13c9400640 1 -- 172.21.15.57:0/3682326057 shutdown_connections 2024-03-27T19:51:59.975 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:51:59.973+0000 7f13c9400640 1 -- 172.21.15.57:0/3682326057 wait complete. 2024-03-27T19:51:59.992 INFO:tasks.ceph:Scrubbing osd.6 2024-03-27T19:51:59.992 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-03-27T19:52:00.200 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.199+0000 7f88ff200640 1 Processor -- start 2024-03-27T19:52:00.201 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.199+0000 7f88ff200640 1 -- start start 2024-03-27T19:52:00.202 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.201+0000 7f88ff200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f89000d1050 0x7f89000b4b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:52:00.202 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.201+0000 7f88ff200640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89000d2fa0 con 0x7f890015e040 2024-03-27T19:52:00.202 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.201+0000 7f88ff200640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89000d1f00 con 0x7f890015e420 2024-03-27T19:52:00.202 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.201+0000 7f88ff200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f89000d2b10 con 0x7f89000d1050 2024-03-27T19:52:00.204 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.201+0000 7f88fde00640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f890015e040 0x7f89000cf810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:37798/0 (socket says 172.21.15.57:37798) 2024-03-27T19:52:00.204 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.201+0000 7f88fde00640 1 -- 172.21.15.57:0/1019616644 learned_addr learned my addr 172.21.15.57:0/1019616644 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T19:52:00.204 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.201+0000 7f88fd400640 1 -- 172.21.15.57:0/1019616644 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1009088505 0 0) 0x7f89000d2fa0 con 0x7f890015e040 2024-03-27T19:52:00.205 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.201+0000 7f88fd400640 1 -- 172.21.15.57:0/1019616644 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f88e4003520 con 0x7f890015e040 2024-03-27T19:52:00.205 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.201+0000 7f88fe800640 1 --2- 172.21.15.57:0/1019616644 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f89000d1050 0x7f89000b4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:52:00.205 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.202+0000 7f88fd400640 1 -- 172.21.15.57:0/1019616644 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 722860724 0 0) 0x7f88e4003520 con 0x7f890015e040 2024-03-27T19:52:00.205 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.202+0000 7f88fd400640 1 -- 172.21.15.57:0/1019616644 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f89000d1050 msgr2=0x7f89000b4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T19:52:00.205 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.202+0000 7f88fd400640 1 --2- 172.21.15.57:0/1019616644 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f89000d1050 0x7f89000b4b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:52:00.205 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.202+0000 7f88fd400640 1 -- 172.21.15.57:0/1019616644 >> v1:172.21.15.118:6789/0 conn(0x7f890015e420 legacy=0x7f89000d0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T19:52:00.205 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.202+0000 7f88fd400640 1 -- 172.21.15.57:0/1019616644 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89000d21e0 con 0x7f890015e040 2024-03-27T19:52:00.205 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.202+0000 7f88fd400640 1 -- 172.21.15.57:0/1019616644 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4227751516 0 0) 0x7f88f0001670 con 0x7f890015e040 2024-03-27T19:52:00.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.202+0000 7f88fd400640 1 -- 172.21.15.57:0/1019616644 >> v1:172.21.15.57:6789/0 conn(0x7f890015e040 legacy=0x7f89000cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:52:00.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.202+0000 7f88fd400640 1 --2- 172.21.15.57:0/1019616644 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f89000d1050 0x7f88e40039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:52:00.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.202+0000 7f88fd400640 1 --2- 172.21.15.57:0/1019616644 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88e4004060 0x7f88e4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:52:00.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.202+0000 7f88fd400640 1 --2- 172.21.15.57:0/1019616644 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88e4004d40 0x7f88e40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:52:00.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.202+0000 7f88fd400640 1 -- 172.21.15.57:0/1019616644 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f89000d2b10 con 0x7f88e4004d40 2024-03-27T19:52:00.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.202+0000 7f88fd400640 1 -- 172.21.15.57:0/1019616644 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f88e400bc00 con 0x7f88e4004060 2024-03-27T19:52:00.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.202+0000 7f88fd400640 1 -- 172.21.15.57:0/1019616644 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f88e400be00 con 0x7f89000d1050 2024-03-27T19:52:00.206 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.202+0000 7f88fe800640 1 --2- 172.21.15.57:0/1019616644 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88e4004d40 0x7f88e40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:52:00.207 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.203+0000 7f88fde00640 1 --2- 172.21.15.57:0/1019616644 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f89000d1050 0x7f88e40039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:52:00.207 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.203+0000 7f88f7e00640 1 --2- 172.21.15.57:0/1019616644 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88e4004060 0x7f88e4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:52:00.207 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.203+0000 7f88fe800640 1 -- 172.21.15.57:0/1019616644 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f89000d1050 msgr2=0x7f88e40039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T19:52:00.207 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.203+0000 7f88fe800640 1 --2- 172.21.15.57:0/1019616644 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f89000d1050 0x7f88e40039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:52:00.207 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.203+0000 7f88fe800640 1 -- 172.21.15.57:0/1019616644 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88e4004060 msgr2=0x7f88e4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T19:52:00.207 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.203+0000 7f88fe800640 1 --2- 172.21.15.57:0/1019616644 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88e4004060 0x7f88e4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:52:00.207 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.203+0000 7f88fe800640 1 -- 172.21.15.57:0/1019616644 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88e4003520 con 0x7f88e4004d40 2024-03-27T19:52:00.210 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.204+0000 7f88fe800640 1 --2- 172.21.15.57:0/1019616644 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88e4004d40 0x7f88e40051c0 secure :-1 s=READY pgs=2260 cs=0 l=1 rev1=1 crypto rx=0x7f88f8007360 tx=0x7f88e4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=686a677121b26d03 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:52:00.210 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.204+0000 7f88fd400640 1 -- 172.21.15.57:0/1019616644 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88f8039070 con 0x7f88e4004d40 2024-03-27T19:52:00.210 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.204+0000 7f88fd400640 1 -- 172.21.15.57:0/1019616644 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88f802ccd0 con 0x7f88e4004d40 2024-03-27T19:52:00.210 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.204+0000 7f88fd400640 1 -- 172.21.15.57:0/1019616644 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88f8009be0 con 0x7f88e4004d40 2024-03-27T19:52:00.210 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.205+0000 7f88ff200640 1 -- 172.21.15.57:0/1019616644 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88e4004d40 msgr2=0x7f88e40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:52:00.210 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.205+0000 7f88ff200640 1 --2- 172.21.15.57:0/1019616644 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f88e4004d40 0x7f88e40051c0 secure :-1 s=READY pgs=2260 cs=0 l=1 rev1=1 crypto rx=0x7f88f8007360 tx=0x7f88e4005830 comp rx=0 tx=0).stop 2024-03-27T19:52:00.211 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.205+0000 7f88fe800640 1 -- 172.21.15.57:0/1019616644 reap_dead start 2024-03-27T19:52:00.211 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.205+0000 7f88ff200640 1 -- 172.21.15.57:0/1019616644 shutdown_connections 2024-03-27T19:52:00.211 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.205+0000 7f88ff200640 1 -- 172.21.15.57:0/1019616644 >> 172.21.15.57:0/1019616644 conn(0x7f890009d2c0 msgr2=0x7f89000d3f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T19:52:00.211 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.205+0000 7f88ff200640 1 -- 172.21.15.57:0/1019616644 shutdown_connections 2024-03-27T19:52:00.211 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.205+0000 7f88ff200640 1 -- 172.21.15.57:0/1019616644 wait complete. 2024-03-27T19:52:00.211 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.207+0000 7f88ff200640 1 Processor -- start 2024-03-27T19:52:00.211 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.207+0000 7f88ff200640 1 -- start start 2024-03-27T19:52:00.211 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.208+0000 7f88ff200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88e4004d40 0x7f890014e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:52:00.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.208+0000 7f88ff200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f89001e7c20 0x7f89001e80a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:52:00.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.208+0000 7f88ff200640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f89000a1450 0x7f89000a18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:52:00.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.208+0000 7f88ff200640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f89000cff20 con 0x7f89000a1450 2024-03-27T19:52:00.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.208+0000 7f88ff200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f89000d27a0 con 0x7f88e4004d40 2024-03-27T19:52:00.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.208+0000 7f88ff200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f89000d1b20 con 0x7f89001e7c20 2024-03-27T19:52:00.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.208+0000 7f88fe800640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f89000a1450 0x7f89000a18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:52:00.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.208+0000 7f88fe800640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f89000a1450 0x7f89000a18e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56132/0 (socket says 172.21.15.57:56132) 2024-03-27T19:52:00.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.208+0000 7f88fe800640 1 -- 172.21.15.57:0/3388327086 learned_addr learned my addr 172.21.15.57:0/3388327086 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T19:52:00.212 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.208+0000 7f88fde00640 1 --2- 172.21.15.57:0/3388327086 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88e4004d40 0x7f890014e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:52:00.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.208+0000 7f88f7e00640 1 --2- 172.21.15.57:0/3388327086 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f89001e7c20 0x7f89001e80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:52:00.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.209+0000 7f88fe800640 1 -- 172.21.15.57:0/3388327086 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f89001e7c20 msgr2=0x7f89001e80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:52:00.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.209+0000 7f88fe800640 1 --2- 172.21.15.57:0/3388327086 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f89001e7c20 0x7f89001e80a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:52:00.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.209+0000 7f88fe800640 1 -- 172.21.15.57:0/3388327086 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88e4004d40 msgr2=0x7f890014e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:52:00.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.209+0000 7f88fe800640 1 --2- 172.21.15.57:0/3388327086 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f88e4004d40 0x7f890014e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:52:00.213 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.209+0000 7f88fe800640 1 -- 172.21.15.57:0/3388327086 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89001e6b80 con 0x7f89000a1450 2024-03-27T19:52:00.215 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.209+0000 7f88fe800640 1 --2- 172.21.15.57:0/3388327086 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f89000a1450 0x7f89000a18e0 secure :-1 s=READY pgs=2261 cs=0 l=1 rev1=1 crypto rx=0x7f88f8002230 tx=0x7f88f8004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:52:00.215 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.209+0000 7f88f6000640 1 -- 172.21.15.57:0/3388327086 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88f8039030 con 0x7f89000a1450 2024-03-27T19:52:00.215 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.209+0000 7f88f6000640 1 -- 172.21.15.57:0/3388327086 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88f8043070 con 0x7f89000a1450 2024-03-27T19:52:00.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.209+0000 7f88f6000640 1 -- 172.21.15.57:0/3388327086 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88f8009be0 con 0x7f89000a1450 2024-03-27T19:52:00.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.209+0000 7f88ff200640 1 -- 172.21.15.57:0/3388327086 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89001e6e60 con 0x7f89000a1450 2024-03-27T19:52:00.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.210+0000 7f88ff200640 1 -- 172.21.15.57:0/3388327086 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89001e7420 con 0x7f89000a1450 2024-03-27T19:52:00.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.210+0000 7f88ff200640 1 -- 172.21.15.57:0/3388327086 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f89001e6930 con 0x7f89000a1450 2024-03-27T19:52:00.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.212+0000 7f88f6000640 1 -- 172.21.15.57:0/3388327086 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f88f803d7d0 con 0x7f89000a1450 2024-03-27T19:52:00.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.213+0000 7f88f6000640 1 --2- 172.21.15.57:0/3388327086 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f88dc06c530 0x7f88dc06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:52:00.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.213+0000 7f88f6000640 1 -- 172.21.15.57:0/3388327086 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5335+0+0 (secure 0 0 0) 0x7f88f80ad960 con 0x7f89000a1450 2024-03-27T19:52:00.216 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.213+0000 7f88fde00640 1 --2- 172.21.15.57:0/3388327086 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f88dc06c530 0x7f88dc06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:52:00.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.213+0000 7f88f6000640 1 --2- 172.21.15.57:0/3388327086 >> [v2:172.21.15.118:6800/1963659095,v1:172.21.15.118:6801/1963659095] conn(0x7f88dc0729d0 0x7f88dc074e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:52:00.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.213+0000 7f88f6000640 1 -- 172.21.15.57:0/3388327086 --> [v2:172.21.15.118:6800/1963659095,v1:172.21.15.118:6801/1963659095] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f88f802eea0 con 0x7f88dc0729d0 2024-03-27T19:52:00.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.213+0000 7f88f6000640 1 -- 172.21.15.57:0/3388327086 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f88f80b22a0 con 0x7f89000a1450 2024-03-27T19:52:00.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.214+0000 7f88fde00640 1 --2- 172.21.15.57:0/3388327086 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f88dc06c530 0x7f88dc06e9f0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f88f0001bf0 tx=0x7f88f0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:52:00.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.214+0000 7f88f7e00640 1 --2- 172.21.15.57:0/3388327086 >> [v2:172.21.15.118:6800/1963659095,v1:172.21.15.118:6801/1963659095] conn(0x7f88dc0729d0 0x7f88dc074e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:52:00.217 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.215+0000 7f88f7e00640 1 --2- 172.21.15.57:0/3388327086 >> [v2:172.21.15.118:6800/1963659095,v1:172.21.15.118:6801/1963659095] conn(0x7f88dc0729d0 0x7f88dc074e10 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:52:00.218 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.217+0000 7f88f6000640 1 -- 172.21.15.57:0/3388327086 <== osd.6 v2:172.21.15.118:6800/1963659095 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f88f802eea0 con 0x7f88dc0729d0 2024-03-27T19:52:00.234 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.233+0000 7f88ff200640 1 -- 172.21.15.57:0/3388327086 --> [v2:172.21.15.118:6800/1963659095,v1:172.21.15.118:6801/1963659095] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f8900068540 con 0x7f88dc0729d0 2024-03-27T19:52:00.235 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.234+0000 7f88f6000640 1 -- 172.21.15.57:0/3388327086 <== osd.6 v2:172.21.15.118:6800/1963659095 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f8900068540 con 0x7f88dc0729d0 2024-03-27T19:52:00.235 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-03-27T19:52:00.236 INFO:teuthology.orchestra.run.smithi057.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-27T19:52:00.236 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-03-27T19:52:00.237 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.234+0000 7f88ff200640 1 -- 172.21.15.57:0/3388327086 >> [v2:172.21.15.118:6800/1963659095,v1:172.21.15.118:6801/1963659095] conn(0x7f88dc0729d0 msgr2=0x7f88dc074e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:52:00.237 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.234+0000 7f88ff200640 1 --2- 172.21.15.57:0/3388327086 >> [v2:172.21.15.118:6800/1963659095,v1:172.21.15.118:6801/1963659095] conn(0x7f88dc0729d0 0x7f88dc074e10 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:52:00.237 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.234+0000 7f88ff200640 1 -- 172.21.15.57:0/3388327086 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f88dc06c530 msgr2=0x7f88dc06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:52:00.237 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.234+0000 7f88ff200640 1 --2- 172.21.15.57:0/3388327086 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f88dc06c530 0x7f88dc06e9f0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f88f0001bf0 tx=0x7f88f0009040 comp rx=0 tx=0).stop 2024-03-27T19:52:00.237 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.234+0000 7f88ff200640 1 -- 172.21.15.57:0/3388327086 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f89000a1450 msgr2=0x7f89000a18e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:52:00.238 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.234+0000 7f88ff200640 1 --2- 172.21.15.57:0/3388327086 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f89000a1450 0x7f89000a18e0 secure :-1 s=READY pgs=2261 cs=0 l=1 rev1=1 crypto rx=0x7f88f8002230 tx=0x7f88f8004ab0 comp rx=0 tx=0).stop 2024-03-27T19:52:00.238 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.234+0000 7f88fe800640 1 -- 172.21.15.57:0/3388327086 reap_dead start 2024-03-27T19:52:00.238 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.234+0000 7f88ff200640 1 -- 172.21.15.57:0/3388327086 shutdown_connections 2024-03-27T19:52:00.238 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.234+0000 7f88ff200640 1 -- 172.21.15.57:0/3388327086 >> 172.21.15.57:0/3388327086 conn(0x7f890009d2c0 msgr2=0x7f890006ce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T19:52:00.238 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.235+0000 7f88ff200640 1 -- 172.21.15.57:0/3388327086 shutdown_connections 2024-03-27T19:52:00.238 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.235+0000 7f88ff200640 1 -- 172.21.15.57:0/3388327086 wait complete. 2024-03-27T19:52:00.251 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-03-27T19:52:00.451 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.450+0000 7fcb85200640 1 Processor -- start 2024-03-27T19:52:00.452 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.450+0000 7fcb85200640 1 -- start start 2024-03-27T19:52:00.453 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.452+0000 7fcb85200640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fcb8015e500 0x7fcb8015e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:52:00.453 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.452+0000 7fcb85200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcb8015ee20 0x7fcb8015f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:52:00.453 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.452+0000 7fcb85200640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb800d0410 con 0x7fcb8006c650 2024-03-27T19:52:00.454 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.452+0000 7fcb85200640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7fcb800d01e0 con 0x7fcb8015e500 2024-03-27T19:52:00.454 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.452+0000 7fcb85200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fcb800d06f0 con 0x7fcb8015ee20 2024-03-27T19:52:00.454 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.452+0000 7fcb7de00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fcb8015e500 0x7fcb8015e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:52:00.454 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.452+0000 7fcb7de00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fcb8015e500 0x7fcb8015e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56148/0 (socket says 172.21.15.57:56148) 2024-03-27T19:52:00.454 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.452+0000 7fcb7de00640 1 -- 172.21.15.57:0/2936343632 learned_addr learned my addr 172.21.15.57:0/2936343632 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T19:52:00.455 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.452+0000 7fcb7d400640 1 --2- 172.21.15.57:0/2936343632 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcb8015ee20 0x7fcb8015f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:52:00.455 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.453+0000 7fcb7de00640 1 -- 172.21.15.57:0/2936343632 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcb8015ee20 msgr2=0x7fcb8015f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T19:52:00.455 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.453+0000 7fcb7de00640 1 --2- 172.21.15.57:0/2936343632 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcb8015ee20 0x7fcb8015f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:52:00.456 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.453+0000 7fcb7de00640 1 -- 172.21.15.57:0/2936343632 >> v1:172.21.15.118:6789/0 conn(0x7fcb8006c650 legacy=0x7fcb8006cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T19:52:00.456 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.453+0000 7fcb7de00640 1 -- 172.21.15.57:0/2936343632 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb800d09d0 con 0x7fcb8015e500 2024-03-27T19:52:00.456 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.454+0000 7fcb7de00640 1 --2- 172.21.15.57:0/2936343632 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb8015e500 0x7fcb8015e8e0 secure :-1 s=READY pgs=2262 cs=0 l=1 rev1=1 crypto rx=0x7fcb70009870 tx=0x7fcb7002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9bdea2dffbe9ab9 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:52:00.456 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.454+0000 7fcb7ca00640 1 -- 172.21.15.57:0/2936343632 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb70034070 con 0x7fcb8015e500 2024-03-27T19:52:00.456 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.454+0000 7fcb7ca00640 1 -- 172.21.15.57:0/2936343632 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb70030840 con 0x7fcb8015e500 2024-03-27T19:52:00.456 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.454+0000 7fcb7ca00640 1 -- 172.21.15.57:0/2936343632 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb70030c10 con 0x7fcb8015e500 2024-03-27T19:52:00.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.454+0000 7fcb85200640 1 -- 172.21.15.57:0/2936343632 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb8015e500 msgr2=0x7fcb8015e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:52:00.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.454+0000 7fcb85200640 1 --2- 172.21.15.57:0/2936343632 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb8015e500 0x7fcb8015e8e0 secure :-1 s=READY pgs=2262 cs=0 l=1 rev1=1 crypto rx=0x7fcb70009870 tx=0x7fcb7002b980 comp rx=0 tx=0).stop 2024-03-27T19:52:00.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.455+0000 7fcb85200640 1 -- 172.21.15.57:0/2936343632 shutdown_connections 2024-03-27T19:52:00.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.455+0000 7fcb85200640 1 --2- 172.21.15.57:0/2936343632 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcb8015ee20 0x7fcb8015f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:52:00.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.455+0000 7fcb85200640 1 --2- 172.21.15.57:0/2936343632 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb8015e500 0x7fcb8015e8e0 unknown :-1 s=CLOSED pgs=2262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:52:00.457 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.455+0000 7fcb85200640 1 -- 172.21.15.57:0/2936343632 >> 172.21.15.57:0/2936343632 conn(0x7fcb800d1f10 msgr2=0x7fcb800d2320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T19:52:00.458 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.455+0000 7fcb85200640 1 -- 172.21.15.57:0/2936343632 shutdown_connections 2024-03-27T19:52:00.458 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.455+0000 7fcb85200640 1 -- 172.21.15.57:0/2936343632 wait complete. 2024-03-27T19:52:00.459 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.456+0000 7fcb85200640 1 Processor -- start 2024-03-27T19:52:00.459 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.457+0000 7fcb85200640 1 -- start start 2024-03-27T19:52:00.459 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.457+0000 7fcb85200640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb8006c650 0x7fcb80147c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:52:00.459 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.457+0000 7fcb85200640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcb8015e500 0x7fcb800c5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:52:00.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.457+0000 7fcb85200640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcb8015ee20 0x7fcb8015c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:52:00.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.457+0000 7fcb85200640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fcb8015f7c0 con 0x7fcb8006c650 2024-03-27T19:52:00.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.457+0000 7fcb85200640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fcb800d0f90 con 0x7fcb8015e500 2024-03-27T19:52:00.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.457+0000 7fcb85200640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fcb800d14b0 con 0x7fcb8015ee20 2024-03-27T19:52:00.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.458+0000 7fcb7de00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb8006c650 0x7fcb80147c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:52:00.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.458+0000 7fcb7de00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb8006c650 0x7fcb80147c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56150/0 (socket says 172.21.15.57:56150) 2024-03-27T19:52:00.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.458+0000 7fcb7de00640 1 -- 172.21.15.57:0/3958793396 learned_addr learned my addr 172.21.15.57:0/3958793396 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T19:52:00.460 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.458+0000 7fcb7d400640 1 --2- 172.21.15.57:0/3958793396 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcb8015e500 0x7fcb800c5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:52:00.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.458+0000 7fcb7de00640 1 -- 172.21.15.57:0/3958793396 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcb8015ee20 msgr2=0x7fcb8015c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:52:00.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.458+0000 7fcb7de00640 1 --2- 172.21.15.57:0/3958793396 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcb8015ee20 0x7fcb8015c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:52:00.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.458+0000 7fcb7de00640 1 -- 172.21.15.57:0/3958793396 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcb8015e500 msgr2=0x7fcb800c5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:52:00.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.458+0000 7fcb7de00640 1 --2- 172.21.15.57:0/3958793396 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcb8015e500 0x7fcb800c5dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:52:00.461 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.458+0000 7fcb7de00640 1 -- 172.21.15.57:0/3958793396 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb800c8be0 con 0x7fcb8006c650 2024-03-27T19:52:00.462 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.458+0000 7fcb7de00640 1 --2- 172.21.15.57:0/3958793396 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb8006c650 0x7fcb80147c90 secure :-1 s=READY pgs=2263 cs=0 l=1 rev1=1 crypto rx=0x7fcb70000c00 tx=0x7fcb70004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:52:00.462 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.459+0000 7fcb76000640 1 -- 172.21.15.57:0/3958793396 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb70048070 con 0x7fcb8006c650 2024-03-27T19:52:00.462 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.459+0000 7fcb76000640 1 -- 172.21.15.57:0/3958793396 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb70030640 con 0x7fcb8006c650 2024-03-27T19:52:00.462 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.459+0000 7fcb76000640 1 -- 172.21.15.57:0/3958793396 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb70034040 con 0x7fcb8006c650 2024-03-27T19:52:00.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.459+0000 7fcb85200640 1 -- 172.21.15.57:0/3958793396 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb800c7b80 con 0x7fcb8006c650 2024-03-27T19:52:00.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.459+0000 7fcb85200640 1 -- 172.21.15.57:0/3958793396 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb800c8100 con 0x7fcb8006c650 2024-03-27T19:52:00.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.460+0000 7fcb85200640 1 -- 172.21.15.57:0/3958793396 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb80075740 con 0x7fcb8006c650 2024-03-27T19:52:00.463 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.461+0000 7fcb76000640 1 -- 172.21.15.57:0/3958793396 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fcb70037070 con 0x7fcb8006c650 2024-03-27T19:52:00.464 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.462+0000 7fcb76000640 1 --2- 172.21.15.57:0/3958793396 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fcb6006c530 0x7fcb6006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:52:00.464 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.462+0000 7fcb76000640 1 -- 172.21.15.57:0/3958793396 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5335+0+0 (secure 0 0 0) 0x7fcb700ad370 con 0x7fcb8006c650 2024-03-27T19:52:00.464 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.462+0000 7fcb7d400640 1 --2- 172.21.15.57:0/3958793396 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fcb6006c530 0x7fcb6006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:52:00.464 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.463+0000 7fcb7d400640 1 --2- 172.21.15.57:0/3958793396 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fcb6006c530 0x7fcb6006e9f0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c006fd0 tx=0x7fcb6c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:52:00.471 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.470+0000 7fcb76000640 1 -- 172.21.15.57:0/3958793396 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7fcb80075740 con 0x7fcb8006c650 2024-03-27T19:52:00.668 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.666+0000 7fcb85200640 1 -- 172.21.15.57:0/3958793396 --> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7fcb80068c50 con 0x7fcb6006c530 2024-03-27T19:52:00.669 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.667+0000 7fcb76000640 1 -- 172.21.15.57:0/3958793396 <== mgr.4103 v2:172.21.15.57:6832/485397065 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fcb80068c50 con 0x7fcb6006c530 2024-03-27T19:52:00.669 INFO:teuthology.orchestra.run.smithi057.stderr:instructed osd(s) 6 to deep-scrub 2024-03-27T19:52:00.672 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.670+0000 7fcb85200640 1 -- 172.21.15.57:0/3958793396 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fcb6006c530 msgr2=0x7fcb6006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:52:00.672 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.670+0000 7fcb85200640 1 --2- 172.21.15.57:0/3958793396 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fcb6006c530 0x7fcb6006e9f0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c006fd0 tx=0x7fcb6c008040 comp rx=0 tx=0).stop 2024-03-27T19:52:00.672 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.670+0000 7fcb85200640 1 -- 172.21.15.57:0/3958793396 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb8006c650 msgr2=0x7fcb80147c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:52:00.672 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.670+0000 7fcb85200640 1 --2- 172.21.15.57:0/3958793396 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb8006c650 0x7fcb80147c90 secure :-1 s=READY pgs=2263 cs=0 l=1 rev1=1 crypto rx=0x7fcb70000c00 tx=0x7fcb70004730 comp rx=0 tx=0).stop 2024-03-27T19:52:00.672 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.670+0000 7fcb85200640 1 -- 172.21.15.57:0/3958793396 shutdown_connections 2024-03-27T19:52:00.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.670+0000 7fcb85200640 1 --2- 172.21.15.57:0/3958793396 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fcb8015ee20 0x7fcb8015c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:52:00.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.670+0000 7fcb85200640 1 --2- 172.21.15.57:0/3958793396 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fcb6006c530 0x7fcb6006e9f0 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:52:00.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.670+0000 7fcb85200640 1 --2- 172.21.15.57:0/3958793396 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fcb8015e500 0x7fcb800c5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:52:00.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.670+0000 7fcb85200640 1 --2- 172.21.15.57:0/3958793396 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fcb8006c650 0x7fcb80147c90 unknown :-1 s=CLOSED pgs=2263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:52:00.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.670+0000 7fcb85200640 1 -- 172.21.15.57:0/3958793396 >> 172.21.15.57:0/3958793396 conn(0x7fcb800d1f10 msgr2=0x7fcb80074990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T19:52:00.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.670+0000 7fcb85200640 1 -- 172.21.15.57:0/3958793396 shutdown_connections 2024-03-27T19:52:00.673 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.670+0000 7fcb85200640 1 -- 172.21.15.57:0/3958793396 wait complete. 2024-03-27T19:52:00.690 INFO:tasks.ceph:Scrubbing osd.7 2024-03-27T19:52:00.690 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-03-27T19:52:00.896 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.895+0000 7f0695e00640 1 Processor -- start 2024-03-27T19:52:00.897 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.895+0000 7f0695e00640 1 -- start start 2024-03-27T19:52:00.898 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.897+0000 7f0695e00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f06900ccd90 0x7f06900cd1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:52:00.898 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.897+0000 7f0695e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0690071bf0 0x7f0690072080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:52:00.899 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.897+0000 7f0695e00640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f069006f070 con 0x7f069015c020 2024-03-27T19:52:00.899 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.897+0000 7f0695e00640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f069006f310 con 0x7f06900ccd90 2024-03-27T19:52:00.899 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.897+0000 7f0695e00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f069006f5f0 con 0x7f0690071bf0 2024-03-27T19:52:00.899 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.897+0000 7f0694a00640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f069015c020 0x7f069015c400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:37800/0 (socket says 172.21.15.57:37800) 2024-03-27T19:52:00.899 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.897+0000 7f0694a00640 1 -- 172.21.15.57:0/4025571263 learned_addr learned my addr 172.21.15.57:0/4025571263 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T19:52:00.899 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.897+0000 7f068fe00640 1 --2- 172.21.15.57:0/4025571263 >> v2:172.21.15.57:3300/0 conn(0x7f06900ccd90 0x7f06900cd1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:52:00.900 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.897+0000 7f0695400640 1 --2- 172.21.15.57:0/4025571263 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0690071bf0 0x7f0690072080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:52:00.900 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.898+0000 7f068f400640 1 -- 172.21.15.57:0/4025571263 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1890528815 0 0) 0x7f069006f070 con 0x7f069015c020 2024-03-27T19:52:00.901 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.898+0000 7f068f400640 1 -- 172.21.15.57:0/4025571263 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0678003520 con 0x7f069015c020 2024-03-27T19:52:00.901 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.898+0000 7f068fe00640 1 -- 172.21.15.57:0/4025571263 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0690071bf0 msgr2=0x7f0690072080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T19:52:00.901 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.898+0000 7f068fe00640 1 --2- 172.21.15.57:0/4025571263 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0690071bf0 0x7f0690072080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:52:00.901 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.898+0000 7f068fe00640 1 -- 172.21.15.57:0/4025571263 >> v1:172.21.15.57:6789/0 conn(0x7f069015c020 legacy=0x7f069015c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:52:00.901 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.898+0000 7f068fe00640 1 -- 172.21.15.57:0/4025571263 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06900ced60 con 0x7f06900ccd90 2024-03-27T19:52:00.901 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.899+0000 7f068fe00640 1 --2- 172.21.15.57:0/4025571263 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f06900ccd90 0x7f06900cd1f0 secure :-1 s=READY pgs=2265 cs=0 l=1 rev1=1 crypto rx=0x7f067c0097a0 tx=0x7f067c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdc3288e382d7488 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:52:00.901 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.899+0000 7f068f400640 1 -- 172.21.15.57:0/4025571263 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f067c035020 con 0x7f06900ccd90 2024-03-27T19:52:00.901 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.899+0000 7f068f400640 1 -- 172.21.15.57:0/4025571263 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f067c031830 con 0x7f06900ccd90 2024-03-27T19:52:00.902 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.899+0000 7f068f400640 1 -- 172.21.15.57:0/4025571263 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f067c031c00 con 0x7f06900ccd90 2024-03-27T19:52:00.903 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.900+0000 7f0695e00640 1 -- 172.21.15.57:0/4025571263 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f06900ccd90 msgr2=0x7f06900cd1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:52:00.903 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.900+0000 7f0695e00640 1 --2- 172.21.15.57:0/4025571263 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f06900ccd90 0x7f06900cd1f0 secure :-1 s=READY pgs=2265 cs=0 l=1 rev1=1 crypto rx=0x7f067c0097a0 tx=0x7f067c02b8d0 comp rx=0 tx=0).stop 2024-03-27T19:52:00.903 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.900+0000 7f0695e00640 1 -- 172.21.15.57:0/4025571263 shutdown_connections 2024-03-27T19:52:00.903 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.900+0000 7f0695e00640 1 --2- 172.21.15.57:0/4025571263 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0690071bf0 0x7f0690072080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:52:00.903 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.900+0000 7f0695e00640 1 --2- 172.21.15.57:0/4025571263 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f06900ccd90 0x7f06900cd1f0 unknown :-1 s=CLOSED pgs=2265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:52:00.903 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.900+0000 7f0695e00640 1 -- 172.21.15.57:0/4025571263 >> 172.21.15.57:0/4025571263 conn(0x7f06900b2260 msgr2=0x7f06900b2670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T19:52:00.904 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.900+0000 7f0695e00640 1 -- 172.21.15.57:0/4025571263 shutdown_connections 2024-03-27T19:52:00.904 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.900+0000 7f0695e00640 1 -- 172.21.15.57:0/4025571263 wait complete. 2024-03-27T19:52:00.904 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.902+0000 7f0695e00640 1 Processor -- start 2024-03-27T19:52:00.904 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.902+0000 7f0695e00640 1 -- start start 2024-03-27T19:52:00.906 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.903+0000 7f0695e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0690071bf0 0x7f069014e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:52:00.906 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.903+0000 7f0695e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f06900ccd90 0x7f06901f5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:52:00.906 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.903+0000 7f0695e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f069015c020 0x7f06901f5590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:52:00.906 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.903+0000 7f0695e00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f069006c390 con 0x7f0690071bf0 2024-03-27T19:52:00.906 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.903+0000 7f0695e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f06900cea10 con 0x7f069015c020 2024-03-27T19:52:00.906 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.903+0000 7f0695e00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f069006c510 con 0x7f06900ccd90 2024-03-27T19:52:00.906 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.903+0000 7f0694a00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0690071bf0 0x7f069014e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:52:00.907 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.903+0000 7f0694a00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0690071bf0 0x7f069014e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56168/0 (socket says 172.21.15.57:56168) 2024-03-27T19:52:00.907 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.903+0000 7f0694a00640 1 -- 172.21.15.57:0/2476777209 learned_addr learned my addr 172.21.15.57:0/2476777209 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T19:52:00.907 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.903+0000 7f068fe00640 1 --2- 172.21.15.57:0/2476777209 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f06900ccd90 0x7f06901f5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:52:00.907 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.904+0000 7f0694a00640 1 -- 172.21.15.57:0/2476777209 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f06900ccd90 msgr2=0x7f06901f5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:52:00.907 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.904+0000 7f0694a00640 1 --2- 172.21.15.57:0/2476777209 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f06900ccd90 0x7f06901f5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:52:00.907 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.904+0000 7f0694a00640 1 -- 172.21.15.57:0/2476777209 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f069015c020 msgr2=0x7f06901f5590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:52:00.907 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.904+0000 7f0694a00640 1 --2- 172.21.15.57:0/2476777209 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f069015c020 0x7f06901f5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:52:00.907 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.904+0000 7f0694a00640 1 -- 172.21.15.57:0/2476777209 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f069014eda0 con 0x7f0690071bf0 2024-03-27T19:52:00.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.904+0000 7f068fe00640 1 --2- 172.21.15.57:0/2476777209 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f06900ccd90 0x7f06901f5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T19:52:00.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.904+0000 7f0694a00640 1 --2- 172.21.15.57:0/2476777209 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0690071bf0 0x7f069014e860 secure :-1 s=READY pgs=2266 cs=0 l=1 rev1=1 crypto rx=0x7f068400c3c0 tx=0x7f068400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:52:00.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.904+0000 7f068cc00640 1 -- 172.21.15.57:0/2476777209 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0684017070 con 0x7f0690071bf0 2024-03-27T19:52:00.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.904+0000 7f068cc00640 1 -- 172.21.15.57:0/2476777209 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0684005ce0 con 0x7f0690071bf0 2024-03-27T19:52:00.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.904+0000 7f0695e00640 1 -- 172.21.15.57:0/2476777209 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06900c7de0 con 0x7f0690071bf0 2024-03-27T19:52:00.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.904+0000 7f068cc00640 1 -- 172.21.15.57:0/2476777209 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06840072f0 con 0x7f0690071bf0 2024-03-27T19:52:00.908 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.904+0000 7f0695e00640 1 -- 172.21.15.57:0/2476777209 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06900c83a0 con 0x7f0690071bf0 2024-03-27T19:52:00.909 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.905+0000 7f0695e00640 1 -- 172.21.15.57:0/2476777209 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0690068c50 con 0x7f0690071bf0 2024-03-27T19:52:00.910 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.906+0000 7f068cc00640 1 -- 172.21.15.57:0/2476777209 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f068401a070 con 0x7f0690071bf0 2024-03-27T19:52:00.910 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.907+0000 7f068cc00640 1 --2- 172.21.15.57:0/2476777209 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f067006c530 0x7f067006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:52:00.910 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.907+0000 7f068cc00640 1 -- 172.21.15.57:0/2476777209 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5335+0+0 (secure 0 0 0) 0x7f068408a910 con 0x7f0690071bf0 2024-03-27T19:52:00.910 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.907+0000 7f068fe00640 1 --2- 172.21.15.57:0/2476777209 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f067006c530 0x7f067006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:52:00.910 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.907+0000 7f068cc00640 1 --2- 172.21.15.57:0/2476777209 >> [v2:172.21.15.118:6808/1955879596,v1:172.21.15.118:6809/1955879596] conn(0x7f06700729d0 0x7f0670074e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:52:00.910 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.907+0000 7f068cc00640 1 -- 172.21.15.57:0/2476777209 --> [v2:172.21.15.118:6808/1955879596,v1:172.21.15.118:6809/1955879596] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0684013e50 con 0x7f06700729d0 2024-03-27T19:52:00.910 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.907+0000 7f068cc00640 1 -- 172.21.15.57:0/2476777209 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f068408f2a0 con 0x7f0690071bf0 2024-03-27T19:52:00.911 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.908+0000 7f068fe00640 1 --2- 172.21.15.57:0/2476777209 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f067006c530 0x7f067006e9f0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f067c036000 tx=0x7f067c008030 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:52:00.911 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.908+0000 7f0695400640 1 --2- 172.21.15.57:0/2476777209 >> [v2:172.21.15.118:6808/1955879596,v1:172.21.15.118:6809/1955879596] conn(0x7f06700729d0 0x7f0670074e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:52:00.911 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.909+0000 7f0695400640 1 --2- 172.21.15.57:0/2476777209 >> [v2:172.21.15.118:6808/1955879596,v1:172.21.15.118:6809/1955879596] conn(0x7f06700729d0 0x7f0670074e10 crc :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:52:00.912 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.911+0000 7f068cc00640 1 -- 172.21.15.57:0/2476777209 <== osd.7 v2:172.21.15.118:6808/1955879596 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0684013e50 con 0x7f06700729d0 2024-03-27T19:52:00.940 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.939+0000 7f0695e00640 1 -- 172.21.15.57:0/2476777209 --> [v2:172.21.15.118:6808/1955879596,v1:172.21.15.118:6809/1955879596] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f06900c9870 con 0x7f06700729d0 2024-03-27T19:52:00.941 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.940+0000 7f068cc00640 1 -- 172.21.15.57:0/2476777209 <== osd.7 v2:172.21.15.118:6808/1955879596 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f06900c9870 con 0x7f06700729d0 2024-03-27T19:52:00.941 INFO:teuthology.orchestra.run.smithi057.stdout:{ 2024-03-27T19:52:00.941 INFO:teuthology.orchestra.run.smithi057.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-27T19:52:00.941 INFO:teuthology.orchestra.run.smithi057.stdout:} 2024-03-27T19:52:00.943 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.940+0000 7f0695e00640 1 -- 172.21.15.57:0/2476777209 >> [v2:172.21.15.118:6808/1955879596,v1:172.21.15.118:6809/1955879596] conn(0x7f06700729d0 msgr2=0x7f0670074e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:52:00.943 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.940+0000 7f0695e00640 1 --2- 172.21.15.57:0/2476777209 >> [v2:172.21.15.118:6808/1955879596,v1:172.21.15.118:6809/1955879596] conn(0x7f06700729d0 0x7f0670074e10 crc :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:52:00.943 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.940+0000 7f0695e00640 1 -- 172.21.15.57:0/2476777209 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f067006c530 msgr2=0x7f067006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:52:00.943 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.940+0000 7f0695e00640 1 --2- 172.21.15.57:0/2476777209 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f067006c530 0x7f067006e9f0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f067c036000 tx=0x7f067c008030 comp rx=0 tx=0).stop 2024-03-27T19:52:00.943 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.940+0000 7f0695e00640 1 -- 172.21.15.57:0/2476777209 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0690071bf0 msgr2=0x7f069014e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:52:00.943 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.940+0000 7f0695e00640 1 --2- 172.21.15.57:0/2476777209 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0690071bf0 0x7f069014e860 secure :-1 s=READY pgs=2266 cs=0 l=1 rev1=1 crypto rx=0x7f068400c3c0 tx=0x7f068400c880 comp rx=0 tx=0).stop 2024-03-27T19:52:00.943 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.940+0000 7f0695400640 1 -- 172.21.15.57:0/2476777209 reap_dead start 2024-03-27T19:52:00.943 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.941+0000 7f0695e00640 1 -- 172.21.15.57:0/2476777209 shutdown_connections 2024-03-27T19:52:00.944 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.941+0000 7f0695e00640 1 -- 172.21.15.57:0/2476777209 >> 172.21.15.57:0/2476777209 conn(0x7f06900b2260 msgr2=0x7f06900c60e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T19:52:00.944 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.941+0000 7f0695e00640 1 -- 172.21.15.57:0/2476777209 shutdown_connections 2024-03-27T19:52:00.944 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:00.941+0000 7f0695e00640 1 -- 172.21.15.57:0/2476777209 wait complete. 2024-03-27T19:52:00.959 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-03-27T19:52:01.168 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.166+0000 7fbfa8a00640 1 Processor -- start 2024-03-27T19:52:01.168 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.167+0000 7fbfa8a00640 1 -- start start 2024-03-27T19:52:01.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.168+0000 7fbfa8a00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbfa4161830 0x7fbfa40cf970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:52:01.169 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.168+0000 7fbfa8a00640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbfa40d2d90 con 0x7fbfa40cfeb0 2024-03-27T19:52:01.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.168+0000 7fbfa8a00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbfa40cee90 con 0x7fbfa40d0e90 2024-03-27T19:52:01.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.168+0000 7fbfa8a00640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7fbfa40cf4e0 con 0x7fbfa4161830 2024-03-27T19:52:01.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.168+0000 7fbfa2800640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7fbfa4161830 0x7fbfa40cf970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:52:01.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.168+0000 7fbf9be00640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7fbfa40cfeb0 0x7fbfa40d0780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:37814/0 (socket says 172.21.15.57:37814) 2024-03-27T19:52:01.170 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.168+0000 7fbf9be00640 1 -- 172.21.15.57:0/830777231 learned_addr learned my addr 172.21.15.57:0/830777231 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T19:52:01.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.169+0000 7fbfa2800640 1 -- 172.21.15.57:0/830777231 >> v1:172.21.15.118:6789/0 conn(0x7fbfa40d0e90 legacy=0x7fbfa40c7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T19:52:01.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.169+0000 7fbfa2800640 1 -- 172.21.15.57:0/830777231 >> v1:172.21.15.57:6789/0 conn(0x7fbfa40cfeb0 legacy=0x7fbfa40d0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:52:01.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.169+0000 7fbfa2800640 1 -- 172.21.15.57:0/830777231 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfa40cf170 con 0x7fbfa4161830 2024-03-27T19:52:01.171 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.170+0000 7fbfa2800640 1 --2- 172.21.15.57:0/830777231 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbfa4161830 0x7fbfa40cf970 secure :-1 s=READY pgs=2268 cs=0 l=1 rev1=1 crypto rx=0x7fbf940097a0 tx=0x7fbf9402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83bf4e8f7a8276aa server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:52:01.172 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.170+0000 7fbfa1e00640 1 -- 172.21.15.57:0/830777231 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf940315a0 con 0x7fbfa4161830 2024-03-27T19:52:01.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.170+0000 7fbfa1e00640 1 -- 172.21.15.57:0/830777231 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf94037070 con 0x7fbfa4161830 2024-03-27T19:52:01.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.170+0000 7fbfa1e00640 1 -- 172.21.15.57:0/830777231 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf94031960 con 0x7fbfa4161830 2024-03-27T19:52:01.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.171+0000 7fbfa8a00640 1 -- 172.21.15.57:0/830777231 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbfa4161830 msgr2=0x7fbfa40cf970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:52:01.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.171+0000 7fbfa8a00640 1 --2- 172.21.15.57:0/830777231 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbfa4161830 0x7fbfa40cf970 secure :-1 s=READY pgs=2268 cs=0 l=1 rev1=1 crypto rx=0x7fbf940097a0 tx=0x7fbf9402b840 comp rx=0 tx=0).stop 2024-03-27T19:52:01.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.171+0000 7fbfa8a00640 1 -- 172.21.15.57:0/830777231 shutdown_connections 2024-03-27T19:52:01.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.171+0000 7fbfa8a00640 1 --2- 172.21.15.57:0/830777231 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbfa4161830 0x7fbfa40cf970 unknown :-1 s=CLOSED pgs=2268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:52:01.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.171+0000 7fbfa8a00640 1 -- 172.21.15.57:0/830777231 >> 172.21.15.57:0/830777231 conn(0x7fbfa40d4030 msgr2=0x7fbfa40d4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T19:52:01.173 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.171+0000 7fbfa8a00640 1 -- 172.21.15.57:0/830777231 shutdown_connections 2024-03-27T19:52:01.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.171+0000 7fbfa8a00640 1 -- 172.21.15.57:0/830777231 wait complete. 2024-03-27T19:52:01.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.173+0000 7fbfa8a00640 1 Processor -- start 2024-03-27T19:52:01.174 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.173+0000 7fbfa8a00640 1 -- start start 2024-03-27T19:52:01.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.174+0000 7fbfa8a00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbfa40cfeb0 0x7fbfa41f3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:52:01.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.174+0000 7fbfa8a00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbfa40d0e90 0x7fbfa4154d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:52:01.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.174+0000 7fbfa8a00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbfa4161830 0x7fbfa4146960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:52:01.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.174+0000 7fbfa8a00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7fbfa40ce4b0 con 0x7fbfa40cfeb0 2024-03-27T19:52:01.176 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.174+0000 7fbfa8a00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7fbfa40ce330 con 0x7fbfa40d0e90 2024-03-27T19:52:01.177 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.174+0000 7fbfa8a00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7fbfa4161c10 con 0x7fbfa4161830 2024-03-27T19:52:01.177 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.174+0000 7fbfa2800640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbfa40cfeb0 0x7fbfa41f3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:52:01.177 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.174+0000 7fbfa2800640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbfa40cfeb0 0x7fbfa41f3cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56196/0 (socket says 172.21.15.57:56196) 2024-03-27T19:52:01.177 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.174+0000 7fbfa2800640 1 -- 172.21.15.57:0/1572031719 learned_addr learned my addr 172.21.15.57:0/1572031719 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T19:52:01.177 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.174+0000 7fbf9be00640 1 --2- 172.21.15.57:0/1572031719 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbfa40d0e90 0x7fbfa4154d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:52:01.177 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.174+0000 7fbfa2800640 1 -- 172.21.15.57:0/1572031719 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbfa4161830 msgr2=0x7fbfa4146960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:52:01.177 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.174+0000 7fbfa2800640 1 --2- 172.21.15.57:0/1572031719 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbfa4161830 0x7fbfa4146960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:52:01.177 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.174+0000 7fbfa2800640 1 -- 172.21.15.57:0/1572031719 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbfa40d0e90 msgr2=0x7fbfa4154d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:52:01.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.175+0000 7fbfa2800640 1 --2- 172.21.15.57:0/1572031719 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbfa40d0e90 0x7fbfa4154d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:52:01.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.175+0000 7fbfa2800640 1 -- 172.21.15.57:0/1572031719 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfa4155820 con 0x7fbfa40cfeb0 2024-03-27T19:52:01.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.175+0000 7fbf9be00640 1 --2- 172.21.15.57:0/1572031719 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbfa40d0e90 0x7fbfa4154d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T19:52:01.178 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.175+0000 7fbfa2800640 1 --2- 172.21.15.57:0/1572031719 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbfa40cfeb0 0x7fbfa41f3cf0 secure :-1 s=READY pgs=2269 cs=0 l=1 rev1=1 crypto rx=0x7fbf9402b880 tx=0x7fbf940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:52:01.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.175+0000 7fbf9aa00640 1 -- 172.21.15.57:0/1572031719 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf94032840 con 0x7fbfa40cfeb0 2024-03-27T19:52:01.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.175+0000 7fbf9aa00640 1 -- 172.21.15.57:0/1572031719 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf94032a00 con 0x7fbfa40cfeb0 2024-03-27T19:52:01.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.175+0000 7fbf9aa00640 1 -- 172.21.15.57:0/1572031719 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf94032df0 con 0x7fbfa40cfeb0 2024-03-27T19:52:01.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.175+0000 7fbfa8a00640 1 -- 172.21.15.57:0/1572031719 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfa4155b00 con 0x7fbfa40cfeb0 2024-03-27T19:52:01.179 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.175+0000 7fbfa8a00640 1 -- 172.21.15.57:0/1572031719 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfa4153ba0 con 0x7fbfa40cfeb0 2024-03-27T19:52:01.180 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.176+0000 7fbfa8a00640 1 -- 172.21.15.57:0/1572031719 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfa4068540 con 0x7fbfa40cfeb0 2024-03-27T19:52:01.180 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.177+0000 7fbf9aa00640 1 -- 172.21.15.57:0/1572031719 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7fbf9403b3f0 con 0x7fbfa40cfeb0 2024-03-27T19:52:01.180 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.178+0000 7fbf9aa00640 1 --2- 172.21.15.57:0/1572031719 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fbf8006c560 0x7fbf8006ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:52:01.181 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.178+0000 7fbf9aa00640 1 -- 172.21.15.57:0/1572031719 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5335+0+0 (secure 0 0 0) 0x7fbf9402f030 con 0x7fbfa40cfeb0 2024-03-27T19:52:01.181 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.179+0000 7fbf9be00640 1 --2- 172.21.15.57:0/1572031719 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fbf8006c560 0x7fbf8006ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:52:01.181 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.179+0000 7fbf9be00640 1 --2- 172.21.15.57:0/1572031719 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fbf8006c560 0x7fbf8006ea20 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fbfa4157070 tx=0x7fbf8c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:52:01.188 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.186+0000 7fbf9aa00640 1 -- 172.21.15.57:0/1572031719 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7fbf94040070 con 0x7fbfa40cfeb0 2024-03-27T19:52:01.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.390+0000 7fbfa8a00640 1 -- 172.21.15.57:0/1572031719 --> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7fbfa408d780 con 0x7fbf8006c560 2024-03-27T19:52:01.392 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.390+0000 7fbf9aa00640 1 -- 172.21.15.57:0/1572031719 <== mgr.4103 v2:172.21.15.57:6832/485397065 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fbfa408d780 con 0x7fbf8006c560 2024-03-27T19:52:01.392 INFO:teuthology.orchestra.run.smithi057.stderr:instructed osd(s) 7 to deep-scrub 2024-03-27T19:52:01.394 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.393+0000 7fbfa8a00640 1 -- 172.21.15.57:0/1572031719 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fbf8006c560 msgr2=0x7fbf8006ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:52:01.394 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.393+0000 7fbfa8a00640 1 --2- 172.21.15.57:0/1572031719 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fbf8006c560 0x7fbf8006ea20 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7fbfa4157070 tx=0x7fbf8c009040 comp rx=0 tx=0).stop 2024-03-27T19:52:01.395 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.393+0000 7fbfa8a00640 1 -- 172.21.15.57:0/1572031719 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbfa40cfeb0 msgr2=0x7fbfa41f3cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:52:01.395 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.393+0000 7fbfa8a00640 1 --2- 172.21.15.57:0/1572031719 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbfa40cfeb0 0x7fbfa41f3cf0 secure :-1 s=READY pgs=2269 cs=0 l=1 rev1=1 crypto rx=0x7fbf9402b880 tx=0x7fbf940046c0 comp rx=0 tx=0).stop 2024-03-27T19:52:01.395 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.393+0000 7fbfa8a00640 1 -- 172.21.15.57:0/1572031719 shutdown_connections 2024-03-27T19:52:01.395 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.393+0000 7fbfa8a00640 1 --2- 172.21.15.57:0/1572031719 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7fbfa4161830 0x7fbfa4146960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:52:01.395 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.393+0000 7fbfa8a00640 1 --2- 172.21.15.57:0/1572031719 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7fbf8006c560 0x7fbf8006ea20 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:52:01.395 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.393+0000 7fbfa8a00640 1 --2- 172.21.15.57:0/1572031719 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7fbfa40d0e90 0x7fbfa4154d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:52:01.395 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.393+0000 7fbfa8a00640 1 --2- 172.21.15.57:0/1572031719 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7fbfa40cfeb0 0x7fbfa41f3cf0 unknown :-1 s=CLOSED pgs=2269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:52:01.395 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.393+0000 7fbfa8a00640 1 -- 172.21.15.57:0/1572031719 >> 172.21.15.57:0/1572031719 conn(0x7fbfa40d4030 msgr2=0x7fbfa40cd6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T19:52:01.396 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.393+0000 7fbfa8a00640 1 -- 172.21.15.57:0/1572031719 shutdown_connections 2024-03-27T19:52:01.396 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.393+0000 7fbfa8a00640 1 -- 172.21.15.57:0/1572031719 wait complete. 2024-03-27T19:52:01.414 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-27T19:52:01.615 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.614+0000 7f3562400640 1 Processor -- start 2024-03-27T19:52:01.616 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.614+0000 7f3562400640 1 -- start start 2024-03-27T19:52:01.622 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.615+0000 7f3562400640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f355c0d2820 0x7f355c0d0780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:52:01.622 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.615+0000 7f3562400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f355c0d4b50 0x7f355c0d0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:52:01.622 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.615+0000 7f3562400640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f355c0d2d90 con 0x7f355c161830 2024-03-27T19:52:01.623 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.615+0000 7f3562400640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f355c0cf4e0 con 0x7f355c0d2820 2024-03-27T19:52:01.623 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.615+0000 7f3562400640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f355c0cee90 con 0x7f355c0d4b50 2024-03-27T19:52:01.623 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.616+0000 7f3561000640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f355c161830 0x7f355c0cf970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:37818/0 (socket says 172.21.15.57:37818) 2024-03-27T19:52:01.623 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.616+0000 7f3561000640 1 -- 172.21.15.57:0/3059297594 learned_addr learned my addr 172.21.15.57:0/3059297594 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T19:52:01.624 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.616+0000 7f3561a00640 1 --2- 172.21.15.57:0/3059297594 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f355c0d4b50 0x7f355c0d0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:52:01.624 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.616+0000 7f355be00640 1 --2- 172.21.15.57:0/3059297594 >> v2:172.21.15.118:3300/0 conn(0x7f355c0d2820 0x7f355c0d0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:52:01.624 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.616+0000 7f355b400640 1 -- 172.21.15.57:0/3059297594 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1132880214 0 0) 0x7f355c0d2d90 con 0x7f355c161830 2024-03-27T19:52:01.624 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.616+0000 7f355b400640 1 -- 172.21.15.57:0/3059297594 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3544003520 con 0x7f355c161830 2024-03-27T19:52:01.624 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.617+0000 7f355b400640 1 -- 172.21.15.57:0/3059297594 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3004828123 0 0) 0x7f3544003520 con 0x7f355c161830 2024-03-27T19:52:01.624 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.617+0000 7f355b400640 1 -- 172.21.15.57:0/3059297594 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f355c0d4b50 msgr2=0x7f355c0d0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T19:52:01.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.617+0000 7f355b400640 1 --2- 172.21.15.57:0/3059297594 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f355c0d4b50 0x7f355c0d0cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:52:01.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.617+0000 7f355b400640 1 -- 172.21.15.57:0/3059297594 >> v2:172.21.15.118:3300/0 conn(0x7f355c0d2820 msgr2=0x7f355c0d0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T19:52:01.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.617+0000 7f355b400640 1 --2- 172.21.15.57:0/3059297594 >> v2:172.21.15.118:3300/0 conn(0x7f355c0d2820 0x7f355c0d0780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:52:01.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.617+0000 7f355b400640 1 -- 172.21.15.57:0/3059297594 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f355c0cf170 con 0x7f355c161830 2024-03-27T19:52:01.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.617+0000 7f355b400640 1 -- 172.21.15.57:0/3059297594 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4227751516 0 0) 0x7f3550001670 con 0x7f355c161830 2024-03-27T19:52:01.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.617+0000 7f355b400640 1 -- 172.21.15.57:0/3059297594 >> v1:172.21.15.57:6789/0 conn(0x7f355c161830 legacy=0x7f355c0cf970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:52:01.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.617+0000 7f355b400640 1 --2- 172.21.15.57:0/3059297594 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f355c0d4b50 0x7f35440039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:52:01.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.617+0000 7f355b400640 1 --2- 172.21.15.57:0/3059297594 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3544003f80 0x7f3544004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:52:01.625 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.617+0000 7f355b400640 1 --2- 172.21.15.57:0/3059297594 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3544004d40 0x7f35440051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:52:01.626 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.617+0000 7f355b400640 1 -- 172.21.15.57:0/3059297594 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f355c0cf4e0 con 0x7f3544003f80 2024-03-27T19:52:01.626 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.617+0000 7f355b400640 1 -- 172.21.15.57:0/3059297594 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f355c0cee90 con 0x7f3544004d40 2024-03-27T19:52:01.626 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.617+0000 7f355b400640 1 -- 172.21.15.57:0/3059297594 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f354400ba70 con 0x7f355c0d4b50 2024-03-27T19:52:01.626 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.617+0000 7f355be00640 1 --2- 172.21.15.57:0/3059297594 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3544003f80 0x7f3544004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:52:01.626 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.617+0000 7f355be00640 1 -- 172.21.15.57:0/3059297594 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f355c0d4b50 msgr2=0x7f35440039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T19:52:01.626 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.617+0000 7f355be00640 1 --2- 172.21.15.57:0/3059297594 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f355c0d4b50 0x7f35440039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:52:01.626 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.617+0000 7f3561a00640 1 --2- 172.21.15.57:0/3059297594 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3544004d40 0x7f35440051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:52:01.626 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.617+0000 7f355be00640 1 -- 172.21.15.57:0/3059297594 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3544004d40 msgr2=0x7f35440051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T19:52:01.627 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.617+0000 7f355be00640 1 --2- 172.21.15.57:0/3059297594 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3544004d40 0x7f35440051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:52:01.627 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.618+0000 7f355be00640 1 -- 172.21.15.57:0/3059297594 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3544003520 con 0x7f3544003f80 2024-03-27T19:52:01.627 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.618+0000 7f3561a00640 1 --2- 172.21.15.57:0/3059297594 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f3544004d40 0x7f35440051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T19:52:01.627 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.619+0000 7f355be00640 1 --2- 172.21.15.57:0/3059297594 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3544003f80 0x7f3544004800 secure :-1 s=READY pgs=2271 cs=0 l=1 rev1=1 crypto rx=0x7f3548009ac0 tx=0x7f3544005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cf4ee2894ace6be server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:52:01.627 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.619+0000 7f355b400640 1 -- 172.21.15.57:0/3059297594 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3548039070 con 0x7f3544003f80 2024-03-27T19:52:01.627 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.619+0000 7f355b400640 1 -- 172.21.15.57:0/3059297594 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f354802c710 con 0x7f3544003f80 2024-03-27T19:52:01.627 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.619+0000 7f355b400640 1 -- 172.21.15.57:0/3059297594 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3548009690 con 0x7f3544003f80 2024-03-27T19:52:01.627 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.620+0000 7f3562400640 1 -- 172.21.15.57:0/3059297594 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3544003f80 msgr2=0x7f3544004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:52:01.628 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.620+0000 7f3562400640 1 --2- 172.21.15.57:0/3059297594 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f3544003f80 0x7f3544004800 secure :-1 s=READY pgs=2271 cs=0 l=1 rev1=1 crypto rx=0x7f3548009ac0 tx=0x7f3544005830 comp rx=0 tx=0).stop 2024-03-27T19:52:01.628 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.620+0000 7f3561a00640 1 -- 172.21.15.57:0/3059297594 reap_dead start 2024-03-27T19:52:01.628 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.620+0000 7f3562400640 1 -- 172.21.15.57:0/3059297594 shutdown_connections 2024-03-27T19:52:01.628 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.620+0000 7f3562400640 1 -- 172.21.15.57:0/3059297594 >> 172.21.15.57:0/3059297594 conn(0x7f355c0d4030 msgr2=0x7f355c0d4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T19:52:01.628 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.620+0000 7f3562400640 1 -- 172.21.15.57:0/3059297594 shutdown_connections 2024-03-27T19:52:01.628 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.620+0000 7f3562400640 1 -- 172.21.15.57:0/3059297594 wait complete. 2024-03-27T19:52:01.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.621+0000 7f3562400640 1 Processor -- start 2024-03-27T19:52:01.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.622+0000 7f3562400640 1 -- start start 2024-03-27T19:52:01.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.622+0000 7f3562400640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3544003f80 0x7f355c152060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:52:01.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.622+0000 7f3562400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f355c1525a0 0x7f355c1558a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:52:01.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.622+0000 7f3562400640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f355c155de0 0x7f355c1f47f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:52:01.631 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.622+0000 7f3562400640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f355c0ce330 con 0x7f355c1525a0 2024-03-27T19:52:01.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.622+0000 7f3562400640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f355c0d3070 con 0x7f355c155de0 2024-03-27T19:52:01.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.622+0000 7f3562400640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f355c0ce4b0 con 0x7f3544003f80 2024-03-27T19:52:01.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.623+0000 7f355be00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f355c1525a0 0x7f355c1558a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:52:01.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.623+0000 7f355be00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f355c1525a0 0x7f355c1558a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:56214/0 (socket says 172.21.15.57:56214) 2024-03-27T19:52:01.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.623+0000 7f355be00640 1 -- 172.21.15.57:0/2394819651 learned_addr learned my addr 172.21.15.57:0/2394819651 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T19:52:01.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.623+0000 7f3561000640 1 --2- 172.21.15.57:0/2394819651 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3544003f80 0x7f355c152060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:52:01.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.623+0000 7f3561a00640 1 --2- 172.21.15.57:0/2394819651 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f355c155de0 0x7f355c1f47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:52:01.632 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.623+0000 7f355be00640 1 -- 172.21.15.57:0/2394819651 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3544003f80 msgr2=0x7f355c152060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:52:01.633 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.623+0000 7f355be00640 1 --2- 172.21.15.57:0/2394819651 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3544003f80 0x7f355c152060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:52:01.633 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.623+0000 7f355be00640 1 -- 172.21.15.57:0/2394819651 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f355c155de0 msgr2=0x7f355c1f47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:52:01.633 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.623+0000 7f355be00640 1 --2- 172.21.15.57:0/2394819651 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f355c155de0 0x7f355c1f47f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:52:01.633 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.623+0000 7f355be00640 1 -- 172.21.15.57:0/2394819651 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f355c156480 con 0x7f355c1525a0 2024-03-27T19:52:01.633 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.623+0000 7f3561a00640 1 --2- 172.21.15.57:0/2394819651 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f355c155de0 0x7f355c1f47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T19:52:01.633 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.624+0000 7f355be00640 1 --2- 172.21.15.57:0/2394819651 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f355c1525a0 0x7f355c1558a0 secure :-1 s=READY pgs=2272 cs=0 l=1 rev1=1 crypto rx=0x7f3548037040 tx=0x7f3548004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:52:01.633 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.624+0000 7f3558c00640 1 -- 172.21.15.57:0/2394819651 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3548039050 con 0x7f355c1525a0 2024-03-27T19:52:01.633 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.624+0000 7f3558c00640 1 -- 172.21.15.57:0/2394819651 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3548045070 con 0x7f355c1525a0 2024-03-27T19:52:01.633 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.624+0000 7f3562400640 1 -- 172.21.15.57:0/2394819651 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f355c156760 con 0x7f355c1525a0 2024-03-27T19:52:01.634 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.624+0000 7f3558c00640 1 -- 172.21.15.57:0/2394819651 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3548003a50 con 0x7f355c1525a0 2024-03-27T19:52:01.634 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.624+0000 7f3562400640 1 -- 172.21.15.57:0/2394819651 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f355c156d20 con 0x7f355c1525a0 2024-03-27T19:52:01.634 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.625+0000 7f3562400640 1 -- 172.21.15.57:0/2394819651 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f355c068540 con 0x7f355c1525a0 2024-03-27T19:52:01.634 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.626+0000 7f3558c00640 1 -- 172.21.15.57:0/2394819651 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f3548003bf0 con 0x7f355c1525a0 2024-03-27T19:52:01.634 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.627+0000 7f3558c00640 1 --2- 172.21.15.57:0/2394819651 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f353c06c560 0x7f353c06ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:52:01.634 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.627+0000 7f3558c00640 1 -- 172.21.15.57:0/2394819651 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5335+0+0 (secure 0 0 0) 0x7f35480ad1e0 con 0x7f355c1525a0 2024-03-27T19:52:01.634 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.627+0000 7f3561000640 1 --2- 172.21.15.57:0/2394819651 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f353c06c560 0x7f353c06ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:52:01.634 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.628+0000 7f3561000640 1 --2- 172.21.15.57:0/2394819651 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f353c06c560 0x7f353c06ea20 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f35500018a0 tx=0x7f3550001650 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:52:01.635 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.632+0000 7f3558c00640 1 -- 172.21.15.57:0/2394819651 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f354804e020 con 0x7f355c1525a0 2024-03-27T19:52:01.831 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.829+0000 7f3562400640 1 -- 172.21.15.57:0/2394819651 --> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f355c08d780 con 0x7f353c06c560 2024-03-27T19:52:01.832 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.830+0000 7f3558c00640 1 -- 172.21.15.57:0/2394819651 <== mgr.4103 v2:172.21.15.57:6832/485397065 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13441 (secure 0 0 0) 0x7f355c08d780 con 0x7f353c06c560 2024-03-27T19:52:01.832 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:52:01.833 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-03-27T19:52:01.834 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.833+0000 7f3562400640 1 -- 172.21.15.57:0/2394819651 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f353c06c560 msgr2=0x7f353c06ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:52:01.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.833+0000 7f3562400640 1 --2- 172.21.15.57:0/2394819651 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f353c06c560 0x7f353c06ea20 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f35500018a0 tx=0x7f3550001650 comp rx=0 tx=0).stop 2024-03-27T19:52:01.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.833+0000 7f3562400640 1 -- 172.21.15.57:0/2394819651 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f355c1525a0 msgr2=0x7f355c1558a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:52:01.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.833+0000 7f3562400640 1 --2- 172.21.15.57:0/2394819651 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f355c1525a0 0x7f355c1558a0 secure :-1 s=READY pgs=2272 cs=0 l=1 rev1=1 crypto rx=0x7f3548037040 tx=0x7f3548004730 comp rx=0 tx=0).stop 2024-03-27T19:52:01.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.833+0000 7f3562400640 1 -- 172.21.15.57:0/2394819651 shutdown_connections 2024-03-27T19:52:01.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.833+0000 7f3562400640 1 --2- 172.21.15.57:0/2394819651 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f353c06c560 0x7f353c06ea20 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:52:01.835 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.833+0000 7f3562400640 1 --2- 172.21.15.57:0/2394819651 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f355c155de0 0x7f355c1f47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:52:01.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.833+0000 7f3562400640 1 --2- 172.21.15.57:0/2394819651 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f355c1525a0 0x7f355c1558a0 unknown :-1 s=CLOSED pgs=2272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:52:01.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.833+0000 7f3562400640 1 --2- 172.21.15.57:0/2394819651 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f3544003f80 0x7f355c152060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:52:01.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.833+0000 7f3562400640 1 -- 172.21.15.57:0/2394819651 >> 172.21.15.57:0/2394819651 conn(0x7f355c0d4030 msgr2=0x7f355c0d02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T19:52:01.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.833+0000 7f3562400640 1 -- 172.21.15.57:0/2394819651 shutdown_connections 2024-03-27T19:52:01.836 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:01.833+0000 7f3562400640 1 -- 172.21.15.57:0/2394819651 wait complete. 2024-03-27T19:52:01.850 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":17814,"stamp":"2024-03-27T19:52:01.813170+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":13573484,"kb_used_data":5288,"kb_used_omap":2255,"kb_used_meta":13565872,"kb_avail":741401236,"statfs":{"total":773094113280,"available":759194865664,"internally_reserved":0,"allocated":5414912,"data_stored":3039304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2309698,"internal_metadata":13891453374},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002980"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":511,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-03-27T19:51:50.424335+0000","last_change":"2024-03-27T09:59:19.234906+0000","last_active":"2024-03-27T19:51:50.424335+0000","last_peered":"2024-03-27T19:51:50.424335+0000","last_clean":"2024-03-27T19:51:50.424335+0000","last_became_active":"2024-03-27T09:59:19.234124+0000","last_became_peered":"2024-03-27T09:59:19.234124+0000","last_unstale":"2024-03-27T19:51:50.424335+0000","last_undegraded":"2024-03-27T19:51:50.424335+0000","last_fullsized":"2024-03-27T19:51:50.424335+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T09:59:17.974760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T09:59:17.974760+0000","last_clean_scrub_stamp":"2024-03-27T09:59:17.974760+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:24:35.357325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":14,"seq":60129549212,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1713868,"kb_used_data":516,"kb_used_omap":163,"kb_used_meta":1713180,"kb_avail":92657972,"statfs":{"total":96636764160,"available":94881763328,"internally_reserved":0,"allocated":528384,"data_stored":232321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":167080,"internal_metadata":1754297176},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129549220,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1715404,"kb_used_data":516,"kb_used_omap":110,"kb_used_meta":1714769,"kb_avail":92656436,"statfs":{"total":96636764160,"available":94880190464,"internally_reserved":0,"allocated":528384,"data_stored":232321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":113329,"internal_metadata":1755923791},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129549238,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1634380,"kb_used_data":516,"kb_used_omap":31,"kb_used_meta":1633824,"kb_avail":92737460,"statfs":{"total":96636764160,"available":94963159040,"internally_reserved":0,"allocated":528384,"data_stored":232321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":32452,"internal_metadata":1673036092},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129549238,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1745300,"kb_used_data":1096,"kb_used_omap":158,"kb_used_meta":1744033,"kb_avail":92626540,"statfs":{"total":96636764160,"available":94849576960,"internally_reserved":0,"allocated":1122304,"data_stored":822689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":162393,"internal_metadata":1785890215},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834581962,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1692944,"kb_used_data":1096,"kb_used_omap":71,"kb_used_meta":1691768,"kb_avail":92678896,"statfs":{"total":96636764160,"available":94903189504,"internally_reserved":0,"allocated":1122304,"data_stored":822689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":73250,"internal_metadata":1732370910},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834581962,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1644172,"kb_used_data":516,"kb_used_omap":423,"kb_used_meta":1643224,"kb_avail":92727668,"statfs":{"total":96636764160,"available":94953132032,"internally_reserved":0,"allocated":528384,"data_stored":232321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":434104,"internal_metadata":1682661448},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834581959,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1701836,"kb_used_data":516,"kb_used_omap":452,"kb_used_meta":1700859,"kb_avail":92670004,"statfs":{"total":96636764160,"available":94894084096,"internally_reserved":0,"allocated":528384,"data_stored":232321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":463596,"internal_metadata":1741679892},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834581963,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1725580,"kb_used_data":516,"kb_used_omap":843,"kb_used_meta":1724212,"kb_avail":92646260,"statfs":{"total":96636764160,"available":94869770240,"internally_reserved":0,"allocated":528384,"data_stored":232321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":863494,"internal_metadata":1765593850},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-27T19:52:01.853 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-03-27T09:59:17.974760+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=27, tm_hour=9, tm_min=59, tm_sec=17, tm_wday=2, tm_yday=87, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=27, tm_hour=19, tm_min=51, tm_sec=54, tm_wday=2, tm_yday=87, tm_isdst=0) 2024-03-27T19:52:01.853 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-03-27T19:52:21.854 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-27T19:52:22.069 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.069+0000 7f0373e00640 1 Processor -- start 2024-03-27T19:52:22.070 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.069+0000 7f0373e00640 1 -- start start 2024-03-27T19:52:22.071 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.071+0000 7f0373e00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f03740d2820 0x7f03740d0780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:52:22.071 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.071+0000 7f0373e00640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03740d2d90 con 0x7f0374161830 2024-03-27T19:52:22.071 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.071+0000 7f0373e00640 1 -- --> v1:172.21.15.118:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03740cee90 con 0x7f03740d4b50 2024-03-27T19:52:22.072 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.071+0000 7f0373e00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f03740cf4e0 con 0x7f03740d2820 2024-03-27T19:52:22.072 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.071+0000 7f0372a00640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f0374161830 0x7f03740cf970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:45500/0 (socket says 172.21.15.57:45500) 2024-03-27T19:52:22.072 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.071+0000 7f0372a00640 1 -- 172.21.15.57:0/1478922658 learned_addr learned my addr 172.21.15.57:0/1478922658 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T19:52:22.074 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.072+0000 7f036a000640 1 --2- 172.21.15.57:0/1478922658 >> v2:172.21.15.118:3300/0 conn(0x7f03740d2820 0x7f03740d0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:52:22.074 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.072+0000 7f0372000640 1 -- 172.21.15.57:0/1478922658 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2056638675 0 0) 0x7f03740d2d90 con 0x7f0374161830 2024-03-27T19:52:22.074 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.072+0000 7f0372000640 1 -- 172.21.15.57:0/1478922658 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0358003520 con 0x7f0374161830 2024-03-27T19:52:22.074 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.072+0000 7f0372000640 1 -- 172.21.15.57:0/1478922658 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3992020138 0 0) 0x7f0358003520 con 0x7f0374161830 2024-03-27T19:52:22.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.072+0000 7f0372000640 1 -- 172.21.15.57:0/1478922658 >> v2:172.21.15.118:3300/0 conn(0x7f03740d2820 msgr2=0x7f03740d0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T19:52:22.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.072+0000 7f0372000640 1 --2- 172.21.15.57:0/1478922658 >> v2:172.21.15.118:3300/0 conn(0x7f03740d2820 0x7f03740d0780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:52:22.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.072+0000 7f0372000640 1 -- 172.21.15.57:0/1478922658 >> v1:172.21.15.118:6789/0 conn(0x7f03740d4b50 legacy=0x7f03740c7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T19:52:22.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.072+0000 7f0372000640 1 -- 172.21.15.57:0/1478922658 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03740cf170 con 0x7f0374161830 2024-03-27T19:52:22.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.072+0000 7f0372000640 1 -- 172.21.15.57:0/1478922658 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4227751516 0 0) 0x7f03640019f0 con 0x7f0374161830 2024-03-27T19:52:22.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.072+0000 7f0372000640 1 -- 172.21.15.57:0/1478922658 >> v1:172.21.15.57:6789/0 conn(0x7f0374161830 legacy=0x7f03740cf970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:52:22.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.072+0000 7f0372000640 1 --2- 172.21.15.57:0/1478922658 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0358003a00 0x7f0358003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:52:22.075 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.072+0000 7f0372000640 1 --2- 172.21.15.57:0/1478922658 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0358004800 0x7f0358004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:52:22.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.072+0000 7f0372000640 1 --2- 172.21.15.57:0/1478922658 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0358005290 0x7f035800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:52:22.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.072+0000 7f0372000640 1 -- 172.21.15.57:0/1478922658 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f03740cf4e0 con 0x7f0358005290 2024-03-27T19:52:22.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.072+0000 7f0372000640 1 -- 172.21.15.57:0/1478922658 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f035800c1e0 con 0x7f0358004800 2024-03-27T19:52:22.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.072+0000 7f0372000640 1 -- 172.21.15.57:0/1478922658 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f035800c3e0 con 0x7f0358003a00 2024-03-27T19:52:22.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.072+0000 7f0373400640 1 --2- 172.21.15.57:0/1478922658 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0358005290 0x7f035800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:52:22.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.073+0000 7f036a000640 1 --2- 172.21.15.57:0/1478922658 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0358004800 0x7f0358004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:52:22.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.073+0000 7f0372a00640 1 --2- 172.21.15.57:0/1478922658 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0358003a00 0x7f0358003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:52:22.076 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.073+0000 7f0373400640 1 -- 172.21.15.57:0/1478922658 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0358003a00 msgr2=0x7f0358003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T19:52:22.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.073+0000 7f0373400640 1 --2- 172.21.15.57:0/1478922658 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0358003a00 0x7f0358003e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:52:22.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.073+0000 7f0373400640 1 -- 172.21.15.57:0/1478922658 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0358004800 msgr2=0x7f0358004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T19:52:22.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.073+0000 7f0373400640 1 --2- 172.21.15.57:0/1478922658 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f0358004800 0x7f0358004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:52:22.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.073+0000 7f0373400640 1 -- 172.21.15.57:0/1478922658 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0358003520 con 0x7f0358005290 2024-03-27T19:52:22.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.074+0000 7f0373400640 1 -- 172.21.15.57:0/1478922658 reap_dead start 2024-03-27T19:52:22.077 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.074+0000 7f0373400640 1 --2- 172.21.15.57:0/1478922658 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0358005290 0x7f035800b9c0 secure :-1 s=READY pgs=2274 cs=0 l=1 rev1=1 crypto rx=0x7f036c003db0 tx=0x7f0358005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48415f4856a8b386 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:52:22.080 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.074+0000 7f0372000640 1 -- 172.21.15.57:0/1478922658 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f036c003980 con 0x7f0358005290 2024-03-27T19:52:22.080 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.074+0000 7f0372000640 1 -- 172.21.15.57:0/1478922658 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f036c007240 con 0x7f0358005290 2024-03-27T19:52:22.080 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.074+0000 7f0372000640 1 -- 172.21.15.57:0/1478922658 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f036c007630 con 0x7f0358005290 2024-03-27T19:52:22.080 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.075+0000 7f0373e00640 1 -- 172.21.15.57:0/1478922658 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0358005290 msgr2=0x7f035800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:52:22.080 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.075+0000 7f0373e00640 1 --2- 172.21.15.57:0/1478922658 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0358005290 0x7f035800b9c0 secure :-1 s=READY pgs=2274 cs=0 l=1 rev1=1 crypto rx=0x7f036c003db0 tx=0x7f0358005830 comp rx=0 tx=0).stop 2024-03-27T19:52:22.080 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.075+0000 7f0373e00640 1 -- 172.21.15.57:0/1478922658 shutdown_connections 2024-03-27T19:52:22.081 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.075+0000 7f0373e00640 1 --2- 172.21.15.57:0/1478922658 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0358005290 0x7f035800b9c0 unknown :-1 s=CLOSED pgs=2274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:52:22.081 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.075+0000 7f0373e00640 1 -- 172.21.15.57:0/1478922658 >> 172.21.15.57:0/1478922658 conn(0x7f03740d4030 msgr2=0x7f03740d4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T19:52:22.081 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.075+0000 7f0373e00640 1 -- 172.21.15.57:0/1478922658 shutdown_connections 2024-03-27T19:52:22.081 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.075+0000 7f0373e00640 1 -- 172.21.15.57:0/1478922658 wait complete. 2024-03-27T19:52:22.081 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.077+0000 7f0373e00640 1 Processor -- start 2024-03-27T19:52:22.081 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.077+0000 7f0373e00640 1 -- start start 2024-03-27T19:52:22.081 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.078+0000 7f0373e00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0358005290 0x7f0374153650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:52:22.081 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.078+0000 7f0373e00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03741566c0 0x7f0374159420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:52:22.082 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.078+0000 7f0373e00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0374156b40 0x7f0374159960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:52:22.082 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.078+0000 7f0373e00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f03740ce4b0 con 0x7f0374156b40 2024-03-27T19:52:22.082 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.078+0000 7f0373e00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f03740ce330 con 0x7f03741566c0 2024-03-27T19:52:22.082 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.078+0000 7f0373e00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f0374161c10 con 0x7f0358005290 2024-03-27T19:52:22.082 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.078+0000 7f0373400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0374156b40 0x7f0374159960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:52:22.082 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.078+0000 7f0373400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0374156b40 0x7f0374159960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33982/0 (socket says 172.21.15.57:33982) 2024-03-27T19:52:22.082 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.078+0000 7f0373400640 1 -- 172.21.15.57:0/1841282094 learned_addr learned my addr 172.21.15.57:0/1841282094 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T19:52:22.082 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.079+0000 7f0372a00640 1 --2- 172.21.15.57:0/1841282094 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0358005290 0x7f0374153650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:52:22.083 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.079+0000 7f036a000640 1 --2- 172.21.15.57:0/1841282094 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03741566c0 0x7f0374159420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:52:22.083 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.079+0000 7f0373400640 1 -- 172.21.15.57:0/1841282094 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0358005290 msgr2=0x7f0374153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:52:22.083 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.079+0000 7f0373400640 1 --2- 172.21.15.57:0/1841282094 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0358005290 0x7f0374153650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:52:22.083 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.079+0000 7f0373400640 1 -- 172.21.15.57:0/1841282094 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03741566c0 msgr2=0x7f0374159420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:52:22.083 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.079+0000 7f0373400640 1 --2- 172.21.15.57:0/1841282094 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03741566c0 0x7f0374159420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:52:22.083 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.079+0000 7f0373400640 1 -- 172.21.15.57:0/1841282094 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0374157770 con 0x7f0374156b40 2024-03-27T19:52:22.083 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.079+0000 7f036a000640 1 --2- 172.21.15.57:0/1841282094 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03741566c0 0x7f0374159420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T19:52:22.083 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.079+0000 7f0373400640 1 --2- 172.21.15.57:0/1841282094 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0374156b40 0x7f0374159960 secure :-1 s=READY pgs=2275 cs=0 l=1 rev1=1 crypto rx=0x7f036c000c00 tx=0x7f036c0036f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:52:22.083 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.079+0000 7f036b400640 1 -- 172.21.15.57:0/1841282094 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f036c03e470 con 0x7f0374156b40 2024-03-27T19:52:22.084 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.079+0000 7f036b400640 1 -- 172.21.15.57:0/1841282094 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f036c044070 con 0x7f0374156b40 2024-03-27T19:52:22.084 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.079+0000 7f036b400640 1 -- 172.21.15.57:0/1841282094 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f036c03e850 con 0x7f0374156b40 2024-03-27T19:52:22.084 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.079+0000 7f0373e00640 1 -- 172.21.15.57:0/1841282094 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0374157a50 con 0x7f0374156b40 2024-03-27T19:52:22.084 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.080+0000 7f0373e00640 1 -- 172.21.15.57:0/1841282094 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0374158010 con 0x7f0374156b40 2024-03-27T19:52:22.085 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.081+0000 7f0373e00640 1 -- 172.21.15.57:0/1841282094 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0374068540 con 0x7f0374156b40 2024-03-27T19:52:22.085 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.081+0000 7f036b400640 1 -- 172.21.15.57:0/1841282094 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f036c03e9f0 con 0x7f0374156b40 2024-03-27T19:52:22.085 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.082+0000 7f036b400640 1 --2- 172.21.15.57:0/1841282094 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f035006c530 0x7f035006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:52:22.085 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.082+0000 7f036b400640 1 -- 172.21.15.57:0/1841282094 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5335+0+0 (secure 0 0 0) 0x7f036c0ad370 con 0x7f0374156b40 2024-03-27T19:52:22.085 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.083+0000 7f0372a00640 1 --2- 172.21.15.57:0/1841282094 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f035006c530 0x7f035006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:52:22.085 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.083+0000 7f0372a00640 1 --2- 172.21.15.57:0/1841282094 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f035006c530 0x7f035006e9f0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f03740c88c0 tx=0x7f0364009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:52:22.088 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.087+0000 7f036b400640 1 -- 172.21.15.57:0/1841282094 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f036c07bb80 con 0x7f0374156b40 2024-03-27T19:52:22.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.284+0000 7f0373e00640 1 -- 172.21.15.57:0/1841282094 --> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0374157520 con 0x7f035006c530 2024-03-27T19:52:22.285 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.285+0000 7f036b400640 1 -- 172.21.15.57:0/1841282094 <== mgr.4103 v2:172.21.15.57:6832/485397065 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13449 (secure 0 0 0) 0x7f0374157520 con 0x7f035006c530 2024-03-27T19:52:22.286 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:52:22.286 INFO:teuthology.orchestra.run.smithi057.stderr:dumped all 2024-03-27T19:52:22.288 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.288+0000 7f0373e00640 1 -- 172.21.15.57:0/1841282094 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f035006c530 msgr2=0x7f035006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:52:22.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.288+0000 7f0373e00640 1 --2- 172.21.15.57:0/1841282094 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f035006c530 0x7f035006e9f0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f03740c88c0 tx=0x7f0364009040 comp rx=0 tx=0).stop 2024-03-27T19:52:22.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.288+0000 7f0373e00640 1 -- 172.21.15.57:0/1841282094 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0374156b40 msgr2=0x7f0374159960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:52:22.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.288+0000 7f0373e00640 1 --2- 172.21.15.57:0/1841282094 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0374156b40 0x7f0374159960 secure :-1 s=READY pgs=2275 cs=0 l=1 rev1=1 crypto rx=0x7f036c000c00 tx=0x7f036c0036f0 comp rx=0 tx=0).stop 2024-03-27T19:52:22.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.288+0000 7f0373e00640 1 -- 172.21.15.57:0/1841282094 shutdown_connections 2024-03-27T19:52:22.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.288+0000 7f0373e00640 1 --2- 172.21.15.57:0/1841282094 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f0374156b40 0x7f0374159960 unknown :-1 s=CLOSED pgs=2275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:52:22.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.288+0000 7f0373e00640 1 --2- 172.21.15.57:0/1841282094 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f035006c530 0x7f035006e9f0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:52:22.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.288+0000 7f0373e00640 1 --2- 172.21.15.57:0/1841282094 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f03741566c0 0x7f0374159420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:52:22.289 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.288+0000 7f0373e00640 1 --2- 172.21.15.57:0/1841282094 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f0358005290 0x7f0374153650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:52:22.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.288+0000 7f0373e00640 1 -- 172.21.15.57:0/1841282094 >> 172.21.15.57:0/1841282094 conn(0x7f03740d4030 msgr2=0x7f03740cd280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T19:52:22.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.288+0000 7f0373e00640 1 -- 172.21.15.57:0/1841282094 shutdown_connections 2024-03-27T19:52:22.290 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.288+0000 7f0373e00640 1 -- 172.21.15.57:0/1841282094 wait complete. 2024-03-27T19:52:22.306 INFO:teuthology.orchestra.run.smithi057.stdout:{"pg_ready":true,"pg_map":{"version":17824,"stamp":"2024-03-27T19:52:21.819024+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":13573480,"kb_used_data":5288,"kb_used_omap":2255,"kb_used_meta":13565872,"kb_avail":741401240,"statfs":{"total":773094113280,"available":759194869760,"internally_reserved":0,"allocated":5414912,"data_stored":3039304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2309698,"internal_metadata":13891453374},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003649"},"pg_stats":[{"pgid":"1.0","version":"45'119","reported_seq":522,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-03-27T19:52:02.100051+0000","last_change":"2024-03-27T19:52:02.100106+0000","last_active":"2024-03-27T19:52:02.100051+0000","last_peered":"2024-03-27T19:52:02.100051+0000","last_clean":"2024-03-27T19:52:02.100051+0000","last_became_active":"2024-03-27T09:59:19.234124+0000","last_became_peered":"2024-03-27T09:59:19.234124+0000","last_unstale":"2024-03-27T19:52:02.100051+0000","last_undegraded":"2024-03-27T19:52:02.100051+0000","last_fullsized":"2024-03-27T19:52:02.100051+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"45'119","last_scrub_stamp":"2024-03-27T19:52:02.099947+0000","last_deep_scrub":"45'119","last_deep_scrub_stamp":"2024-03-27T19:52:02.099947+0000","last_clean_scrub_stamp":"2024-03-27T19:52:02.099947+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-29T05:45:05.585030+0000","scrub_duration":247,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":14,"seq":60129549216,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1713868,"kb_used_data":516,"kb_used_omap":163,"kb_used_meta":1713180,"kb_avail":92657972,"statfs":{"total":96636764160,"available":94881763328,"internally_reserved":0,"allocated":528384,"data_stored":232321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":167080,"internal_metadata":1754297176},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129549224,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1715404,"kb_used_data":516,"kb_used_omap":110,"kb_used_meta":1714769,"kb_avail":92656436,"statfs":{"total":96636764160,"available":94880190464,"internally_reserved":0,"allocated":528384,"data_stored":232321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":113329,"internal_metadata":1755923791},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129549242,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1634380,"kb_used_data":516,"kb_used_omap":31,"kb_used_meta":1633824,"kb_avail":92737460,"statfs":{"total":96636764160,"available":94963159040,"internally_reserved":0,"allocated":528384,"data_stored":232321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":32452,"internal_metadata":1673036092},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129549242,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1745296,"kb_used_data":1096,"kb_used_omap":158,"kb_used_meta":1744033,"kb_avail":92626544,"statfs":{"total":96636764160,"available":94849581056,"internally_reserved":0,"allocated":1122304,"data_stored":822689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":162393,"internal_metadata":1785890215},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834581966,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1692944,"kb_used_data":1096,"kb_used_omap":71,"kb_used_meta":1691768,"kb_avail":92678896,"statfs":{"total":96636764160,"available":94903189504,"internally_reserved":0,"allocated":1122304,"data_stored":822689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":73250,"internal_metadata":1732370910},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834581966,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1644172,"kb_used_data":516,"kb_used_omap":423,"kb_used_meta":1643224,"kb_avail":92727668,"statfs":{"total":96636764160,"available":94953132032,"internally_reserved":0,"allocated":528384,"data_stored":232321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":434104,"internal_metadata":1682661448},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834581963,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1701836,"kb_used_data":516,"kb_used_omap":452,"kb_used_meta":1700859,"kb_avail":92670004,"statfs":{"total":96636764160,"available":94894084096,"internally_reserved":0,"allocated":528384,"data_stored":232321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":463596,"internal_metadata":1741679892},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834581967,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1725580,"kb_used_data":516,"kb_used_omap":843,"kb_used_meta":1724212,"kb_avail":92646260,"statfs":{"total":96636764160,"available":94869770240,"internally_reserved":0,"allocated":528384,"data_stored":232321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":863494,"internal_metadata":1765593850},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-27T19:52:22.307 DEBUG:teuthology.orchestra.run.smithi057:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-03-27T19:52:22.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.508+0000 7f696aa00640 1 Processor -- start 2024-03-27T19:52:22.509 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.509+0000 7f696aa00640 1 -- start start 2024-03-27T19:52:22.510 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.510+0000 7f696aa00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f696415e2f0 0x7f69640d4a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:52:22.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.510+0000 7f696aa00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f69640d0f90 0x7f69640c7d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:52:22.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.510+0000 7f696aa00640 1 -- --> v1:172.21.15.57:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69640d0640 con 0x7f696415e6d0 2024-03-27T19:52:22.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.510+0000 7f696aa00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f69640cf7e0 con 0x7f69640d0f90 2024-03-27T19:52:22.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.510+0000 7f696aa00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f69640cfac0 con 0x7f696415e2f0 2024-03-27T19:52:22.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.510+0000 7f6968c00640 1 --1- >> v1:172.21.15.57:6789/0 conn(0x7f696415e6d0 0x7f69640d0880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.57:6789/0 says I am v1:172.21.15.57:45516/0 (socket says 172.21.15.57:45516) 2024-03-27T19:52:22.511 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.510+0000 7f6968c00640 1 -- 172.21.15.57:0/3674854143 learned_addr learned my addr 172.21.15.57:0/3674854143 (peer_addr_for_me v1:172.21.15.57:0/0) 2024-03-27T19:52:22.513 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.511+0000 7f6969600640 1 --2- 172.21.15.57:0/3674854143 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f696415e2f0 0x7f69640d4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:52:22.514 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.511+0000 7f696a000640 1 --2- 172.21.15.57:0/3674854143 >> v2:172.21.15.118:3300/0 conn(0x7f69640d0f90 0x7f69640c7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:52:22.514 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.511+0000 7f6963e00640 1 -- 172.21.15.57:0/3674854143 <== mon.0 v1:172.21.15.57:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3823821774 0 0) 0x7f69640d0640 con 0x7f696415e6d0 2024-03-27T19:52:22.514 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.511+0000 7f6963e00640 1 -- 172.21.15.57:0/3674854143 --> v1:172.21.15.57:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f694c003520 con 0x7f696415e6d0 2024-03-27T19:52:22.514 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.511+0000 7f6963e00640 1 -- 172.21.15.57:0/3674854143 <== mon.0 v1:172.21.15.57:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1094617104 0 0) 0x7f694c003520 con 0x7f696415e6d0 2024-03-27T19:52:22.514 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.511+0000 7f6963e00640 1 -- 172.21.15.57:0/3674854143 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f696415e2f0 msgr2=0x7f69640d4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T19:52:22.514 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.511+0000 7f6963e00640 1 --2- 172.21.15.57:0/3674854143 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f696415e2f0 0x7f69640d4a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:52:22.514 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.511+0000 7f6963e00640 1 -- 172.21.15.57:0/3674854143 >> v2:172.21.15.118:3300/0 conn(0x7f69640d0f90 msgr2=0x7f69640c7d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T19:52:22.514 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.511+0000 7f6963e00640 1 --2- 172.21.15.57:0/3674854143 >> v2:172.21.15.118:3300/0 conn(0x7f69640d0f90 0x7f69640c7d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:52:22.515 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.511+0000 7f6963e00640 1 -- 172.21.15.57:0/3674854143 --> v1:172.21.15.57:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69640cfda0 con 0x7f696415e6d0 2024-03-27T19:52:22.515 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.511+0000 7f6963e00640 1 -- 172.21.15.57:0/3674854143 <== mon.0 v1:172.21.15.57:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 4227751516 0 0) 0x7f6950001670 con 0x7f696415e6d0 2024-03-27T19:52:22.515 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.511+0000 7f6963e00640 1 -- 172.21.15.57:0/3674854143 >> v1:172.21.15.57:6789/0 conn(0x7f696415e6d0 legacy=0x7f69640d0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:52:22.515 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.512+0000 7f6963e00640 1 --2- 172.21.15.57:0/3674854143 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f696415e2f0 0x7f694c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:52:22.515 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.512+0000 7f6963e00640 1 --2- 172.21.15.57:0/3674854143 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f694c003f30 0x7f694c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:52:22.515 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.512+0000 7f6963e00640 1 --2- 172.21.15.57:0/3674854143 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f694c004d40 0x7f694c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:52:22.515 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.512+0000 7f6963e00640 1 -- 172.21.15.57:0/3674854143 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f69640cf7e0 con 0x7f694c004d40 2024-03-27T19:52:22.515 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.512+0000 7f6963e00640 1 -- 172.21.15.57:0/3674854143 --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f69640cfac0 con 0x7f694c003f30 2024-03-27T19:52:22.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.512+0000 7f6963e00640 1 -- 172.21.15.57:0/3674854143 --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f694c00b9c0 con 0x7f696415e2f0 2024-03-27T19:52:22.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.512+0000 7f696a000640 1 --2- 172.21.15.57:0/3674854143 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f694c004d40 0x7f694c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:52:22.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.512+0000 7f6968c00640 1 --2- 172.21.15.57:0/3674854143 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f694c003f30 0x7f694c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:52:22.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.512+0000 7f6969600640 1 --2- 172.21.15.57:0/3674854143 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f696415e2f0 0x7f694c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:52:22.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.512+0000 7f696a000640 1 -- 172.21.15.57:0/3674854143 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f696415e2f0 msgr2=0x7f694c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T19:52:22.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.512+0000 7f696a000640 1 --2- 172.21.15.57:0/3674854143 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f696415e2f0 0x7f694c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:52:22.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.512+0000 7f696a000640 1 -- 172.21.15.57:0/3674854143 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f694c003f30 msgr2=0x7f694c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T19:52:22.516 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.512+0000 7f696a000640 1 --2- 172.21.15.57:0/3674854143 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f694c003f30 0x7f694c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:52:22.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.512+0000 7f696a000640 1 -- 172.21.15.57:0/3674854143 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f694c003520 con 0x7f694c004d40 2024-03-27T19:52:22.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.512+0000 7f6969600640 1 --2- 172.21.15.57:0/3674854143 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f696415e2f0 0x7f694c0039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T19:52:22.517 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.513+0000 7f696a000640 1 --2- 172.21.15.57:0/3674854143 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f694c004d40 0x7f694c0051c0 secure :-1 s=READY pgs=2277 cs=0 l=1 rev1=1 crypto rx=0x7f695c009f90 tx=0x7f694c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fbdefcbbe9ed24f server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:52:22.520 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.514+0000 7f6963e00640 1 -- 172.21.15.57:0/3674854143 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f695c039070 con 0x7f694c004d40 2024-03-27T19:52:22.520 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.514+0000 7f6963e00640 1 -- 172.21.15.57:0/3674854143 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f695c02cc10 con 0x7f694c004d40 2024-03-27T19:52:22.520 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.514+0000 7f6963e00640 1 -- 172.21.15.57:0/3674854143 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f695c009c10 con 0x7f694c004d40 2024-03-27T19:52:22.520 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.514+0000 7f696aa00640 1 -- 172.21.15.57:0/3674854143 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f694c004d40 msgr2=0x7f694c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:52:22.520 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.514+0000 7f696aa00640 1 --2- 172.21.15.57:0/3674854143 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f694c004d40 0x7f694c0051c0 secure :-1 s=READY pgs=2277 cs=0 l=1 rev1=1 crypto rx=0x7f695c009f90 tx=0x7f694c005830 comp rx=0 tx=0).stop 2024-03-27T19:52:22.520 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.514+0000 7f696a000640 1 -- 172.21.15.57:0/3674854143 reap_dead start 2024-03-27T19:52:22.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.514+0000 7f696aa00640 1 -- 172.21.15.57:0/3674854143 shutdown_connections 2024-03-27T19:52:22.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.514+0000 7f696aa00640 1 -- 172.21.15.57:0/3674854143 >> 172.21.15.57:0/3674854143 conn(0x7f69640d3ee0 msgr2=0x7f69640d42f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T19:52:22.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.514+0000 7f696aa00640 1 -- 172.21.15.57:0/3674854143 shutdown_connections 2024-03-27T19:52:22.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.515+0000 7f696aa00640 1 -- 172.21.15.57:0/3674854143 wait complete. 2024-03-27T19:52:22.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.516+0000 7f696aa00640 1 Processor -- start 2024-03-27T19:52:22.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.516+0000 7f696aa00640 1 -- start start 2024-03-27T19:52:22.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.517+0000 7f696aa00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f694c004d40 0x7f69641f3470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:52:22.521 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.517+0000 7f696aa00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f696409ea40 0x7f69640cd030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:52:22.522 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.517+0000 7f696aa00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f69640cd570 0x7f69640a1150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:52:22.522 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.517+0000 7f696aa00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f69640d2dd0 con 0x7f694c004d40 2024-03-27T19:52:22.522 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.517+0000 7f696aa00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f69640d0360 con 0x7f69640cd570 2024-03-27T19:52:22.522 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.517+0000 7f696aa00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f69640d2f50 con 0x7f696409ea40 2024-03-27T19:52:22.522 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.517+0000 7f6969600640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f694c004d40 0x7f69641f3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:52:22.522 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.518+0000 7f6969600640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f694c004d40 0x7f69641f3470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33992/0 (socket says 172.21.15.57:33992) 2024-03-27T19:52:22.522 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.518+0000 7f6969600640 1 -- 172.21.15.57:0/129864673 learned_addr learned my addr 172.21.15.57:0/129864673 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T19:52:22.522 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.518+0000 7f6968c00640 1 --2- 172.21.15.57:0/129864673 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f696409ea40 0x7f69640cd030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:52:22.523 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.518+0000 7f696a000640 1 --2- 172.21.15.57:0/129864673 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f69640cd570 0x7f69640a1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:52:22.523 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.518+0000 7f6969600640 1 -- 172.21.15.57:0/129864673 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f696409ea40 msgr2=0x7f69640cd030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:52:22.523 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.518+0000 7f6969600640 1 --2- 172.21.15.57:0/129864673 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f696409ea40 0x7f69640cd030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:52:22.523 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.518+0000 7f6969600640 1 -- 172.21.15.57:0/129864673 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f69640cd570 msgr2=0x7f69640a1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:52:22.523 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.518+0000 7f6969600640 1 --2- 172.21.15.57:0/129864673 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f69640cd570 0x7f69640a1150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:52:22.523 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.518+0000 7f6969600640 1 -- 172.21.15.57:0/129864673 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69640cda10 con 0x7f694c004d40 2024-03-27T19:52:22.523 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.518+0000 7f696a000640 1 --2- 172.21.15.57:0/129864673 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f69640cd570 0x7f69640a1150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T19:52:22.523 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.518+0000 7f6969600640 1 --2- 172.21.15.57:0/129864673 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f694c004d40 0x7f69641f3470 secure :-1 s=READY pgs=2278 cs=0 l=1 rev1=1 crypto rx=0x7f69580108b0 tx=0x7f6958010d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:52:22.523 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.519+0000 7f6961600640 1 -- 172.21.15.57:0/129864673 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f695800f040 con 0x7f694c004d40 2024-03-27T19:52:22.524 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.519+0000 7f6961600640 1 -- 172.21.15.57:0/129864673 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f695800eb00 con 0x7f694c004d40 2024-03-27T19:52:22.524 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.519+0000 7f6961600640 1 -- 172.21.15.57:0/129864673 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f695801c400 con 0x7f694c004d40 2024-03-27T19:52:22.524 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.519+0000 7f696aa00640 1 -- 172.21.15.57:0/129864673 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f696409dc80 con 0x7f694c004d40 2024-03-27T19:52:22.524 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.519+0000 7f696aa00640 1 -- 172.21.15.57:0/129864673 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f696409e240 con 0x7f694c004d40 2024-03-27T19:52:22.525 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.520+0000 7f696aa00640 1 -- 172.21.15.57:0/129864673 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69640b9d70 con 0x7f694c004d40 2024-03-27T19:52:22.525 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.522+0000 7f6961600640 1 -- 172.21.15.57:0/129864673 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f695801c5a0 con 0x7f694c004d40 2024-03-27T19:52:22.525 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.522+0000 7f6961600640 1 --2- 172.21.15.57:0/129864673 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f694406c530 0x7f694406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:52:22.525 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.523+0000 7f6961600640 1 -- 172.21.15.57:0/129864673 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5335+0+0 (secure 0 0 0) 0x7f695808bcc0 con 0x7f694c004d40 2024-03-27T19:52:22.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.523+0000 7f6968c00640 1 --2- 172.21.15.57:0/129864673 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f694406c530 0x7f694406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:52:22.526 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.524+0000 7f6968c00640 1 --2- 172.21.15.57:0/129864673 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f694406c530 0x7f694406e9f0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f6950000fb0 tx=0x7f6950009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:52:22.527 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.527+0000 7f6961600640 1 -- 172.21.15.57:0/129864673 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f69640b9d70 con 0x7f694c004d40 2024-03-27T19:52:22.730 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.730+0000 7f696aa00640 1 -- 172.21.15.57:0/129864673 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f6964068540 con 0x7f694c004d40 2024-03-27T19:52:22.735 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.735+0000 7f6961600640 1 -- 172.21.15.57:0/129864673 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v12)=0 v12) ==== 123+0+0 (secure 0 0 0) 0x7f6958092080 con 0x7f694c004d40 2024-03-27T19:52:22.736 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.736+0000 7f6961600640 1 -- 172.21.15.57:0/129864673 <== mon.0 v2:172.21.15.57:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f695805a3b0 con 0x7f694c004d40 2024-03-27T19:52:22.739 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.738+0000 7f696aa00640 1 -- 172.21.15.57:0/129864673 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f694406c530 msgr2=0x7f694406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:52:22.739 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.738+0000 7f696aa00640 1 --2- 172.21.15.57:0/129864673 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f694406c530 0x7f694406e9f0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f6950000fb0 tx=0x7f6950009040 comp rx=0 tx=0).stop 2024-03-27T19:52:22.739 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.738+0000 7f696aa00640 1 -- 172.21.15.57:0/129864673 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f694c004d40 msgr2=0x7f69641f3470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:52:22.739 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.738+0000 7f696aa00640 1 --2- 172.21.15.57:0/129864673 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f694c004d40 0x7f69641f3470 secure :-1 s=READY pgs=2278 cs=0 l=1 rev1=1 crypto rx=0x7f69580108b0 tx=0x7f6958010d70 comp rx=0 tx=0).stop 2024-03-27T19:52:22.739 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.738+0000 7f696aa00640 1 -- 172.21.15.57:0/129864673 shutdown_connections 2024-03-27T19:52:22.739 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.738+0000 7f696aa00640 1 --2- 172.21.15.57:0/129864673 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f694406c530 0x7f694406e9f0 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:52:22.740 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.738+0000 7f696aa00640 1 --2- 172.21.15.57:0/129864673 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f69640cd570 0x7f69640a1150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:52:22.740 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.738+0000 7f696aa00640 1 --2- 172.21.15.57:0/129864673 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f696409ea40 0x7f69640cd030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:52:22.740 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.738+0000 7f696aa00640 1 --2- 172.21.15.57:0/129864673 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f694c004d40 0x7f69641f3470 unknown :-1 s=CLOSED pgs=2278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:52:22.740 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.738+0000 7f696aa00640 1 -- 172.21.15.57:0/129864673 >> 172.21.15.57:0/129864673 conn(0x7f69640d3ee0 msgr2=0x7f696406be90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T19:52:22.740 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.738+0000 7f696aa00640 1 -- 172.21.15.57:0/129864673 shutdown_connections 2024-03-27T19:52:22.740 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.739+0000 7f696aa00640 1 -- 172.21.15.57:0/129864673 wait complete. 2024-03-27T19:52:22.760 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-03-27T19:52:22.760 DEBUG:teuthology.orchestra.run.smithi057:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-27T19:52:22.966 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.965+0000 7f15bfe00640 1 Processor -- start 2024-03-27T19:52:22.966 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.966+0000 7f15bfe00640 1 -- start start 2024-03-27T19:52:22.968 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.967+0000 7f15bfe00640 1 --2- >> v2:172.21.15.118:3300/0 conn(0x7f15c0161830 0x7f15c00cf970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:52:22.968 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.967+0000 7f15bfe00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f15c00cfeb0 0x7f15c00d0780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:52:22.968 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.967+0000 7f15bfe00640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f15c00d2820 0x7f15c00d0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:52:22.969 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.967+0000 7f15bfe00640 1 -- --> v2:172.21.15.57:3300/0 -- mon_getmap magic: 0 -- 0x7f15c00cf4e0 con 0x7f15c00d2820 2024-03-27T19:52:22.969 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.967+0000 7f15bfe00640 1 -- --> v2:172.21.15.118:3300/0 -- mon_getmap magic: 0 -- 0x7f15c00d2d90 con 0x7f15c0161830 2024-03-27T19:52:22.969 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.967+0000 7f15bfe00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f15c00cee90 con 0x7f15c00cfeb0 2024-03-27T19:52:22.969 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.968+0000 7f15bf400640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f15c00d2820 0x7f15c00d0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:52:22.969 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.968+0000 7f15bf400640 1 --2- >> v2:172.21.15.57:3300/0 conn(0x7f15c00d2820 0x7f15c00d0cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:33998/0 (socket says 172.21.15.57:33998) 2024-03-27T19:52:22.969 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.968+0000 7f15bf400640 1 -- 172.21.15.57:0/4051981813 learned_addr learned my addr 172.21.15.57:0/4051981813 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T19:52:22.969 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.968+0000 7f15bea00640 1 --2- 172.21.15.57:0/4051981813 >> v2:172.21.15.118:3300/0 conn(0x7f15c0161830 0x7f15c00cf970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:52:22.969 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.968+0000 7f15b7e00640 1 --2- 172.21.15.57:0/4051981813 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f15c00cfeb0 0x7f15c00d0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:52:22.969 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.968+0000 7f15bf400640 1 -- 172.21.15.57:0/4051981813 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f15c00cfeb0 msgr2=0x7f15c00d0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T19:52:22.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.968+0000 7f15bf400640 1 --2- 172.21.15.57:0/4051981813 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f15c00cfeb0 0x7f15c00d0780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:52:22.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.968+0000 7f15bf400640 1 -- 172.21.15.57:0/4051981813 >> v2:172.21.15.118:3300/0 conn(0x7f15c0161830 msgr2=0x7f15c00cf970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T19:52:22.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.968+0000 7f15bf400640 1 --2- 172.21.15.57:0/4051981813 >> v2:172.21.15.118:3300/0 conn(0x7f15c0161830 0x7f15c00cf970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:52:22.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.968+0000 7f15bf400640 1 -- 172.21.15.57:0/4051981813 --> v2:172.21.15.57:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15c00cf170 con 0x7f15c00d2820 2024-03-27T19:52:22.970 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.968+0000 7f15b7e00640 1 --2- 172.21.15.57:0/4051981813 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f15c00cfeb0 0x7f15c00d0780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T19:52:22.971 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.969+0000 7f15bf400640 1 --2- 172.21.15.57:0/4051981813 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15c00d2820 0x7f15c00d0cc0 secure :-1 s=READY pgs=2279 cs=0 l=1 rev1=1 crypto rx=0x7f15c008c2c0 tx=0x7f15b802be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9138cc5a0b00c8d server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:52:22.971 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.970+0000 7f15be000640 1 -- 172.21.15.57:0/4051981813 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15b802c9e0 con 0x7f15c00d2820 2024-03-27T19:52:22.971 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.970+0000 7f15be000640 1 -- 172.21.15.57:0/4051981813 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f15b802cb80 con 0x7f15c00d2820 2024-03-27T19:52:22.972 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.970+0000 7f15be000640 1 -- 172.21.15.57:0/4051981813 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15b80343f0 con 0x7f15c00d2820 2024-03-27T19:52:22.972 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.970+0000 7f15bfe00640 1 -- 172.21.15.57:0/4051981813 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15c00d2820 msgr2=0x7f15c00d0cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:52:22.972 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.970+0000 7f15bfe00640 1 --2- 172.21.15.57:0/4051981813 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15c00d2820 0x7f15c00d0cc0 secure :-1 s=READY pgs=2279 cs=0 l=1 rev1=1 crypto rx=0x7f15c008c2c0 tx=0x7f15b802be40 comp rx=0 tx=0).stop 2024-03-27T19:52:22.972 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.970+0000 7f15bfe00640 1 -- 172.21.15.57:0/4051981813 shutdown_connections 2024-03-27T19:52:22.972 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.970+0000 7f15bfe00640 1 --2- 172.21.15.57:0/4051981813 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15c00d2820 0x7f15c00d0cc0 unknown :-1 s=CLOSED pgs=2279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:52:22.972 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.970+0000 7f15bfe00640 1 --2- 172.21.15.57:0/4051981813 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f15c00cfeb0 0x7f15c00d0780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:52:22.972 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.970+0000 7f15bfe00640 1 --2- 172.21.15.57:0/4051981813 >> v2:172.21.15.118:3300/0 conn(0x7f15c0161830 0x7f15c00cf970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:52:22.972 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.970+0000 7f15bfe00640 1 -- 172.21.15.57:0/4051981813 >> 172.21.15.57:0/4051981813 conn(0x7f15c00d4030 msgr2=0x7f15c00d4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T19:52:22.972 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.971+0000 7f15bfe00640 1 -- 172.21.15.57:0/4051981813 shutdown_connections 2024-03-27T19:52:22.973 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.971+0000 7f15bfe00640 1 -- 172.21.15.57:0/4051981813 wait complete. 2024-03-27T19:52:22.974 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.972+0000 7f15bfe00640 1 Processor -- start 2024-03-27T19:52:22.974 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.972+0000 7f15bfe00640 1 -- start start 2024-03-27T19:52:22.974 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.973+0000 7f15bfe00640 1 --2- >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f15c00cfeb0 0x7f15c01f4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:52:22.974 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.973+0000 7f15bfe00640 1 --2- >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f15c00d2820 0x7f15c01f69c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:52:22.974 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.973+0000 7f15bfe00640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15c0161830 0x7f15c0158eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:52:22.974 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.973+0000 7f15bfe00640 1 -- --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_getmap magic: 0 -- 0x7f15c00ce4b0 con 0x7f15c0161830 2024-03-27T19:52:22.975 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.973+0000 7f15bfe00640 1 -- --> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] -- mon_getmap magic: 0 -- 0x7f15c00ce330 con 0x7f15c00d2820 2024-03-27T19:52:22.975 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.973+0000 7f15bfe00640 1 -- --> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] -- mon_getmap magic: 0 -- 0x7f15c0161c10 con 0x7f15c00cfeb0 2024-03-27T19:52:22.975 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.974+0000 7f15bf400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15c0161830 0x7f15c0158eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:52:22.975 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.974+0000 7f15bf400640 1 --2- >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15c0161830 0x7f15c0158eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.57:3300/0 says I am v2:172.21.15.57:34014/0 (socket says 172.21.15.57:34014) 2024-03-27T19:52:22.975 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.974+0000 7f15bf400640 1 -- 172.21.15.57:0/2305246194 learned_addr learned my addr 172.21.15.57:0/2305246194 (peer_addr_for_me v2:172.21.15.57:0/0) 2024-03-27T19:52:22.976 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.974+0000 7f15b7e00640 1 --2- 172.21.15.57:0/2305246194 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f15c00d2820 0x7f15c01f69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:52:22.977 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.974+0000 7f15bea00640 1 --2- 172.21.15.57:0/2305246194 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f15c00cfeb0 0x7f15c01f4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:52:22.977 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.974+0000 7f15bf400640 1 -- 172.21.15.57:0/2305246194 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f15c00cfeb0 msgr2=0x7f15c01f4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:52:22.977 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.974+0000 7f15bf400640 1 --2- 172.21.15.57:0/2305246194 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f15c00cfeb0 0x7f15c01f4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:52:22.977 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.974+0000 7f15bf400640 1 -- 172.21.15.57:0/2305246194 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f15c00d2820 msgr2=0x7f15c01f69c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:52:22.977 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.974+0000 7f15bf400640 1 --2- 172.21.15.57:0/2305246194 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f15c00d2820 0x7f15c01f69c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:52:22.977 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.974+0000 7f15bf400640 1 -- 172.21.15.57:0/2305246194 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15c0154260 con 0x7f15c0161830 2024-03-27T19:52:22.977 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.974+0000 7f15bea00640 1 --2- 172.21.15.57:0/2305246194 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f15c00cfeb0 0x7f15c01f4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T19:52:22.977 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.975+0000 7f15bf400640 1 --2- 172.21.15.57:0/2305246194 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15c0161830 0x7f15c0158eb0 secure :-1 s=READY pgs=2280 cs=0 l=1 rev1=1 crypto rx=0x7f15b8036040 tx=0x7f15b8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:52:22.978 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.975+0000 7f15b6a00640 1 -- 172.21.15.57:0/2305246194 <== mon.0 v2:172.21.15.57:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15b8043020 con 0x7f15c0161830 2024-03-27T19:52:22.978 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.975+0000 7f15b6a00640 1 -- 172.21.15.57:0/2305246194 <== mon.0 v2:172.21.15.57:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f15b803e450 con 0x7f15c0161830 2024-03-27T19:52:22.978 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.975+0000 7f15bfe00640 1 -- 172.21.15.57:0/2305246194 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15c0154540 con 0x7f15c0161830 2024-03-27T19:52:22.978 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.975+0000 7f15b6a00640 1 -- 172.21.15.57:0/2305246194 <== mon.0 v2:172.21.15.57:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15b8009510 con 0x7f15c0161830 2024-03-27T19:52:22.978 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.975+0000 7f15bfe00640 1 -- 172.21.15.57:0/2305246194 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15c0154b00 con 0x7f15c0161830 2024-03-27T19:52:22.978 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.976+0000 7f15bfe00640 1 -- 172.21.15.57:0/2305246194 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15c00cd5c0 con 0x7f15c0161830 2024-03-27T19:52:22.979 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.977+0000 7f15b6a00640 1 -- 172.21.15.57:0/2305246194 <== mon.0 v2:172.21.15.57:3300/0 4 ==== mgrmap(e 5) ==== 90856+0+0 (secure 0 0 0) 0x7f15b8046020 con 0x7f15c0161830 2024-03-27T19:52:22.979 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.978+0000 7f15b6a00640 1 --2- 172.21.15.57:0/2305246194 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f159c06c530 0x7f159c06e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T19:52:22.979 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.978+0000 7f15b6a00640 1 -- 172.21.15.57:0/2305246194 <== mon.0 v2:172.21.15.57:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5335+0+0 (secure 0 0 0) 0x7f15b80adf40 con 0x7f15c0161830 2024-03-27T19:52:22.980 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.978+0000 7f15bea00640 1 --2- 172.21.15.57:0/2305246194 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f159c06c530 0x7f159c06e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T19:52:22.980 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.979+0000 7f15bea00640 1 --2- 172.21.15.57:0/2305246194 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f159c06c530 0x7f159c06e9f0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f15b0006fd0 tx=0x7f15b0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T19:52:22.983 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:22.982+0000 7f15b6a00640 1 -- 172.21.15.57:0/2305246194 <== mon.0 v2:172.21.15.57:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+186417 (secure 0 0 0) 0x7f15c00cd5c0 con 0x7f15c0161830 2024-03-27T19:52:23.223 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:23.222+0000 7f15bfe00640 1 -- 172.21.15.57:0/2305246194 --> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f15c0068540 con 0x7f15c0161830 2024-03-27T19:52:23.223 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:23.223+0000 7f15b6a00640 1 -- 172.21.15.57:0/2305246194 <== mon.0 v2:172.21.15.57:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+3870 (secure 0 0 0) 0x7f15b804d030 con 0x7f15c0161830 2024-03-27T19:52:23.224 INFO:teuthology.orchestra.run.smithi057.stdout: 2024-03-27T19:52:23.224 INFO:teuthology.orchestra.run.smithi057.stdout:{"epoch":20,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4883,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6835/534729135","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6834","nonce":534729135},{"type":"v1","addr":"172.21.15.57:6835","nonce":534729135}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4886,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6834/1117032671","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6832","nonce":1117032671},{"type":"v1","addr":"172.21.15.118:6834","nonce":1117032671}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4889,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.118:6835/2149281891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.118:6833","nonce":2149281891},{"type":"v1","addr":"172.21.15.118:6835","nonce":2149281891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":10419,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.57:6837/894837721","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.57:6836","nonce":894837721},{"type":"v1","addr":"172.21.15.57:6837","nonce":894837721}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[]} 2024-03-27T19:52:23.224 INFO:teuthology.orchestra.run.smithi057.stderr:dumped fsmap epoch 20 2024-03-27T19:52:23.226 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:23.226+0000 7f15bfe00640 1 -- 172.21.15.57:0/2305246194 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f159c06c530 msgr2=0x7f159c06e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:52:23.227 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:23.226+0000 7f15bfe00640 1 --2- 172.21.15.57:0/2305246194 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f159c06c530 0x7f159c06e9f0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f15b0006fd0 tx=0x7f15b0008040 comp rx=0 tx=0).stop 2024-03-27T19:52:23.227 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:23.226+0000 7f15bfe00640 1 -- 172.21.15.57:0/2305246194 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15c0161830 msgr2=0x7f15c0158eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T19:52:23.227 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:23.226+0000 7f15bfe00640 1 --2- 172.21.15.57:0/2305246194 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15c0161830 0x7f15c0158eb0 secure :-1 s=READY pgs=2280 cs=0 l=1 rev1=1 crypto rx=0x7f15b8036040 tx=0x7f15b8004a40 comp rx=0 tx=0).stop 2024-03-27T19:52:23.227 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:23.226+0000 7f15bfe00640 1 -- 172.21.15.57:0/2305246194 shutdown_connections 2024-03-27T19:52:23.227 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:23.226+0000 7f15bfe00640 1 --2- 172.21.15.57:0/2305246194 >> [v2:172.21.15.57:3300/0,v1:172.21.15.57:6789/0] conn(0x7f15c0161830 0x7f15c0158eb0 unknown :-1 s=CLOSED pgs=2280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:52:23.227 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:23.226+0000 7f15bfe00640 1 --2- 172.21.15.57:0/2305246194 >> [v2:172.21.15.57:6832/485397065,v1:172.21.15.57:6833/485397065] conn(0x7f159c06c530 0x7f159c06e9f0 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:52:23.227 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:23.226+0000 7f15bfe00640 1 --2- 172.21.15.57:0/2305246194 >> [v2:172.21.15.118:3300/0,v1:172.21.15.118:6789/0] conn(0x7f15c00d2820 0x7f15c01f69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:52:23.227 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:23.226+0000 7f15bfe00640 1 --2- 172.21.15.57:0/2305246194 >> [v2:172.21.15.118:3301/0,v1:172.21.15.118:6790/0] conn(0x7f15c00cfeb0 0x7f15c01f4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T19:52:23.227 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:23.226+0000 7f15bfe00640 1 -- 172.21.15.57:0/2305246194 >> 172.21.15.57:0/2305246194 conn(0x7f15c00d4030 msgr2=0x7f15c00cb100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T19:52:23.228 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:23.226+0000 7f15bfe00640 1 -- 172.21.15.57:0/2305246194 shutdown_connections 2024-03-27T19:52:23.228 INFO:teuthology.orchestra.run.smithi057.stderr:2024-03-27T19:52:23.226+0000 7f15bfe00640 1 -- 172.21.15.57:0/2305246194 wait complete. 2024-03-27T19:52:23.245 DEBUG:tasks.cephfs.filesystem:already dead... 2024-03-27T19:52:23.245 INFO:teuthology.misc:Shutting down mds daemons... 2024-03-27T19:52:23.245 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-03-27T19:52:23.245 INFO:teuthology.orchestra.run:waiting for 300 2024-03-27T19:52:23.264 INFO:tasks.ceph.mds.a:Stopped 2024-03-27T19:52:23.264 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-03-27T19:52:23.265 INFO:teuthology.orchestra.run:waiting for 300 2024-03-27T19:52:23.329 INFO:tasks.ceph.mds.c:Stopped 2024-03-27T19:52:23.329 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-03-27T19:52:23.329 INFO:teuthology.orchestra.run:waiting for 300 2024-03-27T19:52:23.363 INFO:tasks.ceph.mds.b:Stopped 2024-03-27T19:52:23.363 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-03-27T19:52:23.363 INFO:teuthology.orchestra.run:waiting for 300 2024-03-27T19:52:23.443 INFO:tasks.ceph.mds.d:Stopped 2024-03-27T19:52:23.443 INFO:teuthology.misc:Shutting down osd daemons... 2024-03-27T19:52:23.443 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-03-27T19:52:23.443 INFO:teuthology.orchestra.run:waiting for 300 2024-03-27T19:52:25.558 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-03-27T19:52:29.546 INFO:tasks.ceph.osd.0:Stopped 2024-03-27T19:52:29.546 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-03-27T19:52:29.546 INFO:teuthology.orchestra.run:waiting for 300 2024-03-27T19:52:31.667 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-03-27T19:52:31.667 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-03-27T19:52:35.648 INFO:tasks.ceph.osd.1:Stopped 2024-03-27T19:52:35.649 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-03-27T19:52:35.649 INFO:teuthology.orchestra.run:waiting for 300 2024-03-27T19:52:37.676 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-03-27T19:52:37.676 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-03-27T19:52:41.750 INFO:tasks.ceph.osd.2:Stopped 2024-03-27T19:52:41.751 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-03-27T19:52:41.751 INFO:teuthology.orchestra.run:waiting for 300 2024-03-27T19:52:43.583 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-03-27T19:52:43.584 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-03-27T19:52:47.853 INFO:tasks.ceph.osd.3:Stopped 2024-03-27T19:52:47.853 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-03-27T19:52:47.853 INFO:teuthology.orchestra.run:waiting for 300 2024-03-27T19:52:49.390 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2024-03-27T19:52:49.391 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-03-27T19:52:53.955 INFO:tasks.ceph.osd.4:Stopped 2024-03-27T19:52:53.955 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-03-27T19:52:53.956 INFO:teuthology.orchestra.run:waiting for 300 2024-03-27T19:52:55.096 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-03-27T19:52:55.097 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2024-03-27T19:53:00.057 INFO:tasks.ceph.osd.5:Stopped 2024-03-27T19:53:00.058 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-03-27T19:53:00.058 INFO:teuthology.orchestra.run:waiting for 300 2024-03-27T19:53:00.803 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-03-27T19:53:06.160 INFO:tasks.ceph.osd.6:Stopped 2024-03-27T19:53:06.161 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-03-27T19:53:06.161 INFO:teuthology.orchestra.run:waiting for 300 2024-03-27T19:53:06.409 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-03-27T19:53:11.914 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-03-27T19:53:11.914 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-03-27T19:53:12.263 INFO:tasks.ceph.osd.7:Stopped 2024-03-27T19:53:12.263 INFO:teuthology.misc:Shutting down mgr daemons... 2024-03-27T19:53:12.264 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-03-27T19:53:12.264 INFO:teuthology.orchestra.run:waiting for 300 2024-03-27T19:53:17.318 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~0s 2024-03-27T19:53:17.318 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-03-27T19:53:18.365 INFO:tasks.ceph.mgr.y:Stopped 2024-03-27T19:53:18.366 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-03-27T19:53:18.366 INFO:teuthology.orchestra.run:waiting for 300 2024-03-27T19:53:22.621 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~0s 2024-03-27T19:53:22.622 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y has been restored 2024-03-27T19:53:24.468 INFO:tasks.ceph.mgr.x:Stopped 2024-03-27T19:53:24.468 INFO:teuthology.misc:Shutting down mon daemons... 2024-03-27T19:53:24.469 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-03-27T19:53:24.469 INFO:teuthology.orchestra.run:waiting for 300 2024-03-27T19:53:24.567 INFO:tasks.ceph.mon.a:Stopped 2024-03-27T19:53:24.567 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-03-27T19:53:24.567 INFO:teuthology.orchestra.run:waiting for 300 2024-03-27T19:53:24.630 INFO:tasks.ceph.mon.b:Stopped 2024-03-27T19:53:24.630 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-03-27T19:53:24.630 INFO:teuthology.orchestra.run:waiting for 300 2024-03-27T19:53:24.721 INFO:tasks.ceph.mon.c:Stopped 2024-03-27T19:53:24.722 INFO:tasks.ceph:Checking cluster log for badness... 2024-03-27T19:53:24.722 DEBUG:teuthology.orchestra.run.smithi057:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | head -n 1 2024-03-27T19:53:25.220 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi057.front.sepia.ceph.com 2024-03-27T19:53:25.220 DEBUG:teuthology.orchestra.run.smithi057:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-03-27T19:53:26.391 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi057.front.sepia.ceph.com 2024-03-27T19:53:26.392 DEBUG:teuthology.orchestra.run.smithi057:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-03-27T19:53:26.833 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi057.front.sepia.ceph.com 2024-03-27T19:53:26.834 DEBUG:teuthology.orchestra.run.smithi057:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-03-27T19:53:27.195 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi057.front.sepia.ceph.com 2024-03-27T19:53:27.195 DEBUG:teuthology.orchestra.run.smithi057:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-03-27T19:53:27.584 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi118.front.sepia.ceph.com 2024-03-27T19:53:27.584 DEBUG:teuthology.orchestra.run.smithi118:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-03-27T19:53:27.622 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x has been restored 2024-03-27T19:53:28.084 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi118.front.sepia.ceph.com 2024-03-27T19:53:28.085 DEBUG:teuthology.orchestra.run.smithi118:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-03-27T19:53:28.677 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi118.front.sepia.ceph.com 2024-03-27T19:53:28.677 DEBUG:teuthology.orchestra.run.smithi118:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-03-27T19:53:29.137 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi118.front.sepia.ceph.com 2024-03-27T19:53:29.137 DEBUG:teuthology.orchestra.run.smithi118:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-03-27T19:53:29.587 INFO:tasks.ceph:Archiving mon data... 2024-03-27T19:53:29.589 DEBUG:teuthology.misc:Transferring archived files from smithi057:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/rishabh-2024-03-27_05:27:11-fs-wip-rishabh-testing-20240326.131558-testing-default-smithi/7625753/data/mon.a.tgz 2024-03-27T19:53:29.589 DEBUG:teuthology.orchestra.run.smithi057:> mktemp 2024-03-27T19:53:29.666 INFO:teuthology.orchestra.run.smithi057.stdout:/tmp/tmp.2QelvVEcIb 2024-03-27T19:53:29.667 DEBUG:teuthology.orchestra.run.smithi057:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.2QelvVEcIb 2024-03-27T19:53:29.979 DEBUG:teuthology.orchestra.run.smithi057:> sudo chmod 0666 /tmp/tmp.2QelvVEcIb 2024-03-27T19:53:30.210 DEBUG:teuthology.orchestra.remote:smithi057:/tmp/tmp.2QelvVEcIb is 613KB 2024-03-27T19:53:30.321 DEBUG:teuthology.orchestra.run.smithi057:> rm -fr /tmp/tmp.2QelvVEcIb 2024-03-27T19:53:30.371 DEBUG:teuthology.misc:Transferring archived files from smithi118:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/rishabh-2024-03-27_05:27:11-fs-wip-rishabh-testing-20240326.131558-testing-default-smithi/7625753/data/mon.b.tgz 2024-03-27T19:53:30.371 DEBUG:teuthology.orchestra.run.smithi118:> mktemp 2024-03-27T19:53:30.428 INFO:teuthology.orchestra.run.smithi118.stdout:/tmp/tmp.2FG3t8GWxW 2024-03-27T19:53:30.428 DEBUG:teuthology.orchestra.run.smithi118:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.2FG3t8GWxW 2024-03-27T19:53:30.637 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 0666 /tmp/tmp.2FG3t8GWxW 2024-03-27T19:53:30.805 DEBUG:teuthology.orchestra.remote:smithi118:/tmp/tmp.2FG3t8GWxW is 621KB 2024-03-27T19:53:30.918 DEBUG:teuthology.orchestra.run.smithi118:> rm -fr /tmp/tmp.2FG3t8GWxW 2024-03-27T19:53:30.975 DEBUG:teuthology.misc:Transferring archived files from smithi118:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/rishabh-2024-03-27_05:27:11-fs-wip-rishabh-testing-20240326.131558-testing-default-smithi/7625753/data/mon.c.tgz 2024-03-27T19:53:30.975 DEBUG:teuthology.orchestra.run.smithi118:> mktemp 2024-03-27T19:53:31.023 INFO:teuthology.orchestra.run.smithi118.stdout:/tmp/tmp.TZQGqfJ3pN 2024-03-27T19:53:31.024 DEBUG:teuthology.orchestra.run.smithi118:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.TZQGqfJ3pN 2024-03-27T19:53:31.221 DEBUG:teuthology.orchestra.run.smithi118:> sudo chmod 0666 /tmp/tmp.TZQGqfJ3pN 2024-03-27T19:53:31.363 DEBUG:teuthology.orchestra.remote:smithi118:/tmp/tmp.TZQGqfJ3pN is 621KB 2024-03-27T19:53:31.476 DEBUG:teuthology.orchestra.run.smithi118:> rm -fr /tmp/tmp.TZQGqfJ3pN 2024-03-27T19:53:31.530 INFO:tasks.ceph:Cleaning ceph cluster... 2024-03-27T19:53:31.531 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-03-27T19:53:31.538 DEBUG:teuthology.orchestra.run.smithi118:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-03-27T19:53:31.757 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-03-27T19:53:31.813 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-03-27T19:53:31.814 INFO:tasks.ceph:Archiving crash dumps... 2024-03-27T19:53:31.816 DEBUG:teuthology.misc:Transferring archived files from smithi057:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-03-27_05:27:11-fs-wip-rishabh-testing-20240326.131558-testing-default-smithi/7625753/remote/smithi057/crash 2024-03-27T19:53:31.817 DEBUG:teuthology.orchestra.run.smithi057:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-03-27T19:53:31.914 DEBUG:teuthology.misc:Transferring archived files from smithi118:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-03-27_05:27:11-fs-wip-rishabh-testing-20240326.131558-testing-default-smithi/7625753/remote/smithi118/crash 2024-03-27T19:53:31.915 DEBUG:teuthology.orchestra.run.smithi118:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-03-27T19:53:32.010 INFO:tasks.ceph:Shutting down logrotate 2024-03-27T19:55:08.331 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-03-27T19:55:08.443 DEBUG:teuthology.orchestra.run.smithi118:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-03-27T19:55:08.623 INFO:tasks.ceph:Compressing logs... 2024-03-27T19:55:08.624 DEBUG:teuthology.orchestra.run.smithi057:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-27T19:55:08.631 DEBUG:teuthology.orchestra.run.smithi118:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-27T19:55:08.736 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-03-27T19:55:08.737 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37371.log 2024-03-27T19:55:08.738 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.41915.log 2024-03-27T19:55:08.739 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.37371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37331.log 2024-03-27T19:55:08.740 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.1.41915.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-03-27T19:55:08.741 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.37331.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-03-27T19:55:08.742 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37171.log 2024-03-27T19:55:08.743 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-03-27T19:55:08.744 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.37171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37131.log 2024-03-27T19:55:08.745 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37211.log 2024-03-27T19:55:08.746 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.37131.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-03-27T19:55:08.747 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.37211.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-03-27T19:55:08.747 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-03-27T19:55:08.748 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37411.log 2024-03-27T19:55:08.749 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-03-27T19:55:08.750 INFO:teuthology.orchestra.run.smithi118.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37371.log.gz 2024-03-27T19:55:08.750 INFO:teuthology.orchestra.run.smithi118.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37291.log 2024-03-27T19:55:08.751 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.37411.log: /var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-03-27T19:55:08.752 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.37291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.42371.log 2024-03-27T19:55:08.753 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-03-27T19:55:08.753 INFO:teuthology.orchestra.run.smithi118.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.1.41915.log.gz 2024-03-27T19:55:08.753 INFO:teuthology.orchestra.run.smithi118.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.37411.log.gz 2024-03-27T19:55:08.754 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.3.42371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37251.log 2024-03-27T19:55:08.755 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-03-27T19:55:08.757 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201655.log 2024-03-27T19:55:08.759 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.363294.log 2024-03-27T19:55:08.761 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.201655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168797.log 2024-03-27T19:55:08.762 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.463279.log 2024-03-27T19:55:08.764 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.345405.log 2024-03-27T19:55:08.764 INFO:teuthology.orchestra.run.smithi118.stderr:/var/log/ceph/ceph-client.admin.37251.log: /var/log/ceph/ceph-mon.c.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37131.log.gz 2024-03-27T19:55:08.766 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.503475.log 2024-03-27T19:55:08.767 INFO:teuthology.orchestra.run.smithi118.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37171.log.gz 2024-03-27T19:55:08.767 INFO:teuthology.orchestra.run.smithi118.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37211.log.gz 2024-03-27T19:55:08.768 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.465849.log 2024-03-27T19:55:08.768 INFO:teuthology.orchestra.run.smithi118.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37251.log.gz 2024-03-27T19:55:08.769 INFO:teuthology.orchestra.run.smithi118.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.37291.log.gz 2024-03-27T19:55:08.769 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51075.log 2024-03-27T19:55:08.771 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.237872.log 2024-03-27T19:55:08.771 INFO:teuthology.orchestra.run.smithi118.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37331.log.gz 2024-03-27T19:55:08.772 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.492078.log 2024-03-27T19:55:08.774 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.370025.log 2024-03-27T19:55:08.776 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.367720.log 2024-03-27T19:55:08.776 INFO:teuthology.orchestra.run.smithi118.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.3.42371.log.gz 2024-03-27T19:55:08.777 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.441484.log 2024-03-27T19:55:08.779 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51300.log 2024-03-27T19:55:08.781 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156033.log 2024-03-27T19:55:08.782 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232731.log 2024-03-27T19:55:08.784 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158614.log 2024-03-27T19:55:08.785 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.286018.log 2024-03-27T19:55:08.787 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.168797.log: /var/log/ceph/ceph-client.admin.363294.log: /var/log/ceph/ceph-client.admin.463279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.209297.log 2024-03-27T19:55:08.787 INFO:teuthology.orchestra.run.smithi118.stderr: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-03-27T19:55:08.789 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.258683.log 2024-03-27T19:55:08.790 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.211552.log 2024-03-27T19:55:08.792 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190724.log 2024-03-27T19:55:08.793 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.551574.log 2024-03-27T19:55:08.795 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189817.log 2024-03-27T19:55:08.797 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.277710.log 2024-03-27T19:55:08.797 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.406525.log 2024-03-27T19:55:08.799 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.479878.log 2024-03-27T19:55:08.800 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.237881.log 2024-03-27T19:55:08.801 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.399667.log 2024-03-27T19:55:08.802 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.503475.log: /var/log/ceph/ceph-client.admin.345405.log: /var/log/ceph/ceph-client.admin.465849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.415381.log 2024-03-27T19:55:08.804 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.492078.log: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.201655.log.gz/var/log/ceph/ceph-client.admin.441484.log: 2024-03-27T19:55:08.804 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.424366.log 2024-03-27T19:55:08.806 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.51075.log: /var/log/ceph/ceph-client.admin.399667.log: /var/log/ceph/ceph-client.admin.370025.log: /var/log/ceph/ceph-client.admin.367720.log: /var/log/ceph/ceph-client.admin.156033.log: /var/log/ceph/ceph-client.admin.51300.log: /var/log/ceph/ceph-client.admin.158614.log: /var/log/ceph/ceph-client.admin.211552.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.363294.log.gz 2024-03-27T19:55:08.806 INFO:teuthology.orchestra.run.smithi057.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.463279.log.gz/var/log/ceph/ceph-client.admin.190724.log: 2024-03-27T19:55:08.806 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.551574.log: /var/log/ceph/ceph-client.admin.277710.log: /var/log/ceph/ceph-client.admin.189817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.343710.log 2024-03-27T19:55:08.807 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.479878.log: /var/log/ceph/ceph-client.admin.232731.log: /var/log/ceph/ceph-client.admin.237872.log: /var/log/ceph/ceph-client.admin.415381.log: /var/log/ceph/ceph-client.admin.209297.log: /var/log/ceph/ceph-client.admin.424366.log: /var/log/ceph/ceph-client.admin.258683.log: /var/log/ceph/ceph-client.admin.286018.log: /var/log/ceph/ceph-client.admin.406525.log: /var/log/ceph/ceph-client.admin.237881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42750.log 2024-03-27T19:55:08.807 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.535234.log 2024-03-27T19:55:08.808 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.343710.log: /var/log/ceph/ceph-client.admin.42750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.398309.log 2024-03-27T19:55:08.809 INFO:teuthology.orchestra.run.smithi057.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.551574.log.gz 2024-03-27T19:55:08.809 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.535234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.214498.log 2024-03-27T19:55:08.809 INFO:teuthology.orchestra.run.smithi057.stderr: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.535234.log.gz 2024-03-27T19:55:08.810 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.398309.log: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.406525.log.gz 2024-03-27T19:55:08.810 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.481758.log 2024-03-27T19:55:08.811 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.214498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52824.log 2024-03-27T19:55:08.812 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.481758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.249571.log 2024-03-27T19:55:08.813 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.52824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160860.log 2024-03-27T19:55:08.814 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.249571.log: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.399667.log.gz 2024-03-27T19:55:08.814 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.457484.log 2024-03-27T19:55:08.815 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.160860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.400205.log 2024-03-27T19:55:08.816 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.457484.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-03-27T19:55:08.816 INFO:teuthology.orchestra.run.smithi057.stderr: 78.5% -- replaced with /var/log/ceph/ceph-client.admin.258683.log.gz 2024-03-27T19:55:08.816 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.400205.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50403.log 2024-03-27T19:55:08.817 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.414087.log 2024-03-27T19:55:08.818 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.50403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.476166.log 2024-03-27T19:55:08.819 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.414087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49451.log 2024-03-27T19:55:08.820 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.476166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.525865.log 2024-03-27T19:55:08.821 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.49451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48210.log 2024-03-27T19:55:08.821 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.525865.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.370025.log.gz 2024-03-27T19:55:08.822 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.528868.log 2024-03-27T19:55:08.823 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.48210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157763.log 2024-03-27T19:55:08.823 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.528868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.542687.log 2024-03-27T19:55:08.824 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.157763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.499841.log 2024-03-27T19:55:08.825 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.542687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49188.log 2024-03-27T19:55:08.826 INFO:teuthology.orchestra.run.smithi057.stderr: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.542687.log.gz 2024-03-27T19:55:08.826 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.499841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.328666.log 2024-03-27T19:55:08.827 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.49188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.459652.log 2024-03-27T19:55:08.828 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.328666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.335164.log 2024-03-27T19:55:08.829 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.459652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.481281.log 2024-03-27T19:55:08.830 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.335164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.423512.log 2024-03-27T19:55:08.830 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.481281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156465.log 2024-03-27T19:55:08.831 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.423512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.288584.log 2024-03-27T19:55:08.832 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.156465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.327402.log 2024-03-27T19:55:08.833 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.288584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49020.log 2024-03-27T19:55:08.834 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.327402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166925.log 2024-03-27T19:55:08.835 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.49020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.505647.log 2024-03-27T19:55:08.836 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.166925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.285508.log 2024-03-27T19:55:08.837 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.505647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187444.log 2024-03-27T19:55:08.837 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.285508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.405808.log 2024-03-27T19:55:08.838 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.187444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.340341.log 2024-03-27T19:55:08.839 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.405808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.425651.log 2024-03-27T19:55:08.840 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.340341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.366773.log 2024-03-27T19:55:08.841 INFO:teuthology.orchestra.run.smithi057.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.157763.log.gz 2024-03-27T19:55:08.841 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.425651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253748.log 2024-03-27T19:55:08.842 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.366773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.346755.log 2024-03-27T19:55:08.843 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.253748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.361087.log 2024-03-27T19:55:08.844 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.346755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.465007.log 2024-03-27T19:55:08.844 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.361087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.229287.log 2024-03-27T19:55:08.845 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.465007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143997.log 2024-03-27T19:55:08.846 INFO:teuthology.orchestra.run.smithi057.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.158614.log.gz 2024-03-27T19:55:08.846 INFO:teuthology.orchestra.run.smithi057.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.288584.log.gz 2024-03-27T19:55:08.846 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.229287.log: /var/log/ceph/ceph-client.admin.473770.log 2024-03-27T19:55:08.847 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.143997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137661.log 2024-03-27T19:55:08.848 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.473770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192044.log 2024-03-27T19:55:08.849 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.137661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.204324.log 2024-03-27T19:55:08.850 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.192044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113865.log 2024-03-27T19:55:08.850 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.204324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.336006.log 2024-03-27T19:55:08.851 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.113865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184442.log 2024-03-27T19:55:08.852 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.336006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44330.log 2024-03-27T19:55:08.852 INFO:teuthology.orchestra.run.smithi057.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.367720.log.gz 2024-03-27T19:55:08.853 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.184442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42876.log 2024-03-27T19:55:08.854 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.44330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.476644.log 2024-03-27T19:55:08.855 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.42876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130758.log 2024-03-27T19:55:08.855 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.476644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.256545.log 2024-03-27T19:55:08.856 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.130758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53303.log 2024-03-27T19:55:08.857 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.256545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.220940.log 2024-03-27T19:55:08.858 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.53303.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42750.log.gz 2024-03-27T19:55:08.858 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154694.log 2024-03-27T19:55:08.859 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.220940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.525022.log 2024-03-27T19:55:08.860 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.154694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.497646.log 2024-03-27T19:55:08.860 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.525022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.439782.log 2024-03-27T19:55:08.861 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.497646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.536962.log 2024-03-27T19:55:08.862 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.439782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.442359.log 2024-03-27T19:55:08.863 INFO:teuthology.orchestra.run.smithi057.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.441484.log.gz 2024-03-27T19:55:08.863 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.536962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.459200.log 2024-03-27T19:55:08.864 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.442359.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.536962.log.gz 2024-03-27T19:55:08.864 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.332065.log 2024-03-27T19:55:08.865 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.459200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131209.log 2024-03-27T19:55:08.866 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.332065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.543570.log 2024-03-27T19:55:08.866 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.131209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.210197.log 2024-03-27T19:55:08.867 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.543570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.545803.log 2024-03-27T19:55:08.868 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.210197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.355208.log 2024-03-27T19:55:08.869 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.545803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.527552.log 2024-03-27T19:55:08.870 INFO:teuthology.orchestra.run.smithi057.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.545803.log.gz 2024-03-27T19:55:08.870 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.355208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.480365.log 2024-03-27T19:55:08.871 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.527552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.492927.log 2024-03-27T19:55:08.872 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.480365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.519537.log 2024-03-27T19:55:08.873 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.492927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.549364.log 2024-03-27T19:55:08.874 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.519537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.217872.log 2024-03-27T19:55:08.875 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.549364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.343277.log 2024-03-27T19:55:08.876 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.217872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114805.log 2024-03-27T19:55:08.876 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.343277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.532042.log 2024-03-27T19:55:08.877 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.114805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.338193.log 2024-03-27T19:55:08.878 INFO:teuthology.orchestra.run.smithi057.stderr: 94.0% -- replaced with /var/log/ceph/ceph-client.admin.549364.log.gz 2024-03-27T19:55:08.879 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.532042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.479001.log 2024-03-27T19:55:08.879 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.338193.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.528868.log.gz 2024-03-27T19:55:08.880 INFO:teuthology.orchestra.run.smithi057.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.532042.log.gz 2024-03-27T19:55:08.880 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.360666.log 2024-03-27T19:55:08.881 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.252899.log 2024-03-27T19:55:08.882 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.479001.log: /var/log/ceph/ceph-client.admin.360666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.369490.log 2024-03-27T19:55:08.882 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.252899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.442770.log 2024-03-27T19:55:08.883 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.369490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.370016.log 2024-03-27T19:55:08.884 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.343710.log.gz 2024-03-27T19:55:08.884 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.442770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.367244.log 2024-03-27T19:55:08.885 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.370016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.524179.log 2024-03-27T19:55:08.886 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.367244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.341604.log 2024-03-27T19:55:08.887 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.524179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43452.log 2024-03-27T19:55:08.887 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.476166.log.gz 2024-03-27T19:55:08.888 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.341604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48756.log 2024-03-27T19:55:08.889 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.43452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.488592.log 2024-03-27T19:55:08.890 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.48756.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.499841.log.gz 2024-03-27T19:55:08.890 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.413670.log 2024-03-27T19:55:08.891 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.488592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48588.log 2024-03-27T19:55:08.891 INFO:teuthology.orchestra.run.smithi057.stderr: 96.1% -- replaced with /var/log/ceph/ceph-client.admin.543570.log.gz 2024-03-27T19:55:08.892 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.413670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.409281.log 2024-03-27T19:55:08.893 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.48588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.214928.log 2024-03-27T19:55:08.893 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.409281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201211.log 2024-03-27T19:55:08.894 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.214928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.233319.log 2024-03-27T19:55:08.895 INFO:teuthology.orchestra.run.smithi057.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.414087.log.gz 2024-03-27T19:55:08.895 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.201211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.263028.log 2024-03-27T19:55:08.896 INFO:teuthology.orchestra.run.smithi057.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.415381.log.gz 2024-03-27T19:55:08.896 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.226095.log 2024-03-27T19:55:08.897 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.233319.log: /var/log/ceph/ceph-client.admin.263028.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50067.log 2024-03-27T19:55:08.898 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.226095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193869.log 2024-03-27T19:55:08.898 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.50067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.399173.log 2024-03-27T19:55:08.899 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.193869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.324855.log 2024-03-27T19:55:08.900 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.399173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.461054.log 2024-03-27T19:55:08.900 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.457484.log.gz 2024-03-27T19:55:08.901 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.324855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.344559.log 2024-03-27T19:55:08.901 INFO:teuthology.orchestra.run.smithi057.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.459652.log.gz 2024-03-27T19:55:08.902 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.461054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.458317.log 2024-03-27T19:55:08.903 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.344559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.332476.log 2024-03-27T19:55:08.903 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.458317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.225230.log 2024-03-27T19:55:08.904 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.332476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.235628.log 2024-03-27T19:55:08.905 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.225230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51208.log 2024-03-27T19:55:08.906 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.235628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.409290.log 2024-03-27T19:55:08.907 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.51208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151557.log 2024-03-27T19:55:08.907 INFO:teuthology.orchestra.run.smithi057.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48210.log.gz 2024-03-27T19:55:08.908 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.409290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191595.log 2024-03-27T19:55:08.908 INFO:teuthology.orchestra.run.smithi057.stderr: 87.9%/var/log/ceph/ceph-client.admin.151557.log: -- replaced with /var/log/ceph/ceph-client.admin.48756.log.gz 2024-03-27T19:55:08.909 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51159.log 2024-03-27T19:55:08.909 INFO:teuthology.orchestra.run.smithi057.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49020.log.gz 2024-03-27T19:55:08.910 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.191595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.339921.log 2024-03-27T19:55:08.911 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.51159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52868.log 2024-03-27T19:55:08.911 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.339921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46485.log 2024-03-27T19:55:08.912 INFO:teuthology.orchestra.run.smithi057.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.400205.log.gz 2024-03-27T19:55:08.913 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.52868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.398760.log 2024-03-27T19:55:08.913 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.46485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.554277.log 2024-03-27T19:55:08.914 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.398760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.289009.log 2024-03-27T19:55:08.915 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.554277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.542275.log 2024-03-27T19:55:08.915 INFO:teuthology.orchestra.run.smithi057.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.554277.log.gz 2024-03-27T19:55:08.916 INFO:teuthology.orchestra.run.smithi057.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49188.log.gz 2024-03-27T19:55:08.916 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.289009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.457905.log 2024-03-27T19:55:08.916 INFO:teuthology.orchestra.run.smithi057.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49451.log.gz 2024-03-27T19:55:08.917 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.542275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.559296.log 2024-03-27T19:55:08.918 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.457905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156024.log 2024-03-27T19:55:08.918 INFO:teuthology.orchestra.run.smithi057.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.542275.log.gz 2024-03-27T19:55:08.918 INFO:teuthology.orchestra.run.smithi057.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52824.log.gz 2024-03-27T19:55:08.918 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.559296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53093.log 2024-03-27T19:55:08.919 INFO:teuthology.orchestra.run.smithi057.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.559296.log.gz 2024-03-27T19:55:08.919 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.156024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.514552.log 2024-03-27T19:55:08.920 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.53093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.430766.log 2024-03-27T19:55:08.921 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.514552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.357121.log 2024-03-27T19:55:08.921 INFO:teuthology.orchestra.run.smithi057.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53303.log.gz 2024-03-27T19:55:08.921 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.430766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147579.log 2024-03-27T19:55:08.922 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.357121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.552508.log 2024-03-27T19:55:08.923 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.147579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.417544.log 2024-03-27T19:55:08.924 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.552508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.329088.log 2024-03-27T19:55:08.925 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.417544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.543140.log 2024-03-27T19:55:08.925 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.329088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.339501.log 2024-03-27T19:55:08.926 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.543140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.540499.log 2024-03-27T19:55:08.926 INFO:teuthology.orchestra.run.smithi057.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.543140.log.gz 2024-03-27T19:55:08.927 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.339501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130326.log 2024-03-27T19:55:08.928 INFO:teuthology.orchestra.run.smithi057.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.552508.log.gz 2024-03-27T19:55:08.928 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.540499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.424808.log 2024-03-27T19:55:08.928 INFO:teuthology.orchestra.run.smithi057.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.540499.log.gz 2024-03-27T19:55:08.929 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.130326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.255937.log 2024-03-27T19:55:08.930 INFO:teuthology.orchestra.run.smithi057.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.492078.log.gz 2024-03-27T19:55:08.930 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.424808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.267284.log 2024-03-27T19:55:08.931 INFO:teuthology.orchestra.run.smithi057.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.492927.log.gz 2024-03-27T19:55:08.931 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.255937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.229725.log 2024-03-27T19:55:08.932 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.267284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.482786.log 2024-03-27T19:55:08.933 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.229725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.373393.log 2024-03-27T19:55:08.933 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.482786.log: 89.1% 88.1% 88.6% 89.3% -- replaced with /var/log/ceph/ceph-client.admin.51300.log.gz -- replaced with /var/log/ceph/ceph-client.admin.50403.log.gz -- replaced with /var/log/ceph/ceph-client.admin.51159.log.gz -- replaced with /var/log/ceph/ceph-client.admin.51075.log.gz 87.5% 2024-03-27T19:55:08.934 INFO:teuthology.orchestra.run.smithi057.stderr: 2024-03-27T19:55:08.934 INFO:teuthology.orchestra.run.smithi057.stderr: 2024-03-27T19:55:08.934 INFO:teuthology.orchestra.run.smithi057.stderr: 2024-03-27T19:55:08.934 INFO:teuthology.orchestra.run.smithi057.stderr: -- replaced with /var/log/ceph/ceph-client.admin.51208.log.gz 2024-03-27T19:55:08.935 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.410583.log 2024-03-27T19:55:08.935 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.373393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45907.log 2024-03-27T19:55:08.936 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.410583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.233310.log 2024-03-27T19:55:08.936 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.365848.log 2024-03-27T19:55:08.937 INFO:teuthology.orchestra.run.smithi057.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.137661.log.gz 2024-03-27T19:55:08.937 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.233310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.486861.log 2024-03-27T19:55:08.938 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.365848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.521648.log 2024-03-27T19:55:08.939 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.486861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197729.log 2024-03-27T19:55:08.940 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.521648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.261333.log 2024-03-27T19:55:08.940 INFO:teuthology.orchestra.run.smithi057.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.143997.log.gz 2024-03-27T19:55:08.941 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.197729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.214919.log 2024-03-27T19:55:08.942 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.261333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.361545.log 2024-03-27T19:55:08.942 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.214919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46569.log 2024-03-27T19:55:08.943 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.361545.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.423512.log.gz 2024-03-27T19:55:08.943 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.350977.log 2024-03-27T19:55:08.944 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.46569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.270882.log 2024-03-27T19:55:08.945 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.350977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.404902.log 2024-03-27T19:55:08.945 INFO:teuthology.orchestra.run.smithi057.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.473770.log.gz 2024-03-27T19:55:08.945 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.270882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129904.log 2024-03-27T19:55:08.946 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.404902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191604.log 2024-03-27T19:55:08.947 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.129904.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.425651.log.gz 2024-03-27T19:55:08.948 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.458747.log 2024-03-27T19:55:08.948 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.191604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.356622.log 2024-03-27T19:55:08.949 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.458747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.238726.log 2024-03-27T19:55:08.950 INFO:teuthology.orchestra.run.smithi057.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.329088.log.gz 2024-03-27T19:55:08.950 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.356622.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.327402.log.gz 2024-03-27T19:55:08.950 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.486408.log 2024-03-27T19:55:08.951 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.238726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.371376.log 2024-03-27T19:55:08.952 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.486408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.361997.log 2024-03-27T19:55:08.952 INFO:teuthology.orchestra.run.smithi057.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.204324.log.gz 2024-03-27T19:55:08.953 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.371376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.283709.log 2024-03-27T19:55:08.953 INFO:teuthology.orchestra.run.smithi057.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.217872.log.gz 2024-03-27T19:55:08.954 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45568.log 2024-03-27T19:55:08.954 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.361997.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.277710.log.gz 2024-03-27T19:55:08.955 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.283709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53387.log 2024-03-27T19:55:08.960 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.558833.log 2024-03-27T19:55:08.960 INFO:teuthology.orchestra.run.smithi057.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.166925.log.gz 2024-03-27T19:55:08.960 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.53387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245605.log 2024-03-27T19:55:08.960 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.558833.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.191595.log.gz 2024-03-27T19:55:08.960 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.522070.log 2024-03-27T19:55:08.960 INFO:teuthology.orchestra.run.smithi057.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.476644.log.gz 2024-03-27T19:55:08.961 INFO:teuthology.orchestra.run.smithi057.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.558833.log.gz 2024-03-27T19:55:08.961 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.245605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115305.log 2024-03-27T19:55:08.961 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.522070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73542.log 2024-03-27T19:55:08.961 INFO:teuthology.orchestra.run.smithi057.stderr: 85.8%/var/log/ceph/ceph-client.admin.115305.log: -- replaced with /var/log/ceph/ceph-client.admin.187444.log.gz 2024-03-27T19:55:08.962 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.223976.log 2024-03-27T19:55:08.962 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.73542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.355660.log 2024-03-27T19:55:08.962 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.223976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.480850.log 2024-03-27T19:55:08.963 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.355660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.518433.log 2024-03-27T19:55:08.963 INFO:teuthology.orchestra.run.smithi057.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.190724.log.gz 2024-03-27T19:55:08.964 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.480850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.264732.log 2024-03-27T19:55:08.964 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.518433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.428627.log 2024-03-27T19:55:08.965 INFO:teuthology.orchestra.run.smithi057.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.237872.log.gz 2024-03-27T19:55:08.965 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.264732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158623.log 2024-03-27T19:55:08.966 INFO:teuthology.orchestra.run.smithi057.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.237881.log.gz 2024-03-27T19:55:08.966 INFO:teuthology.orchestra.run.smithi057.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.256545.log.gz 2024-03-27T19:55:08.967 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.428627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.228847.log 2024-03-27T19:55:08.967 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.158623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.558143.log 2024-03-27T19:55:08.968 INFO:teuthology.orchestra.run.smithi057.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.229287.log.gz 2024-03-27T19:55:08.968 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.228847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45232.log 2024-03-27T19:55:08.969 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.558143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.206124.log 2024-03-27T19:55:08.969 INFO:teuthology.orchestra.run.smithi057.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.558143.log.gz 2024-03-27T19:55:08.970 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.402338.log 2024-03-27T19:55:08.971 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.206124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145320.log 2024-03-27T19:55:08.971 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.402338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.485564.log 2024-03-27T19:55:08.972 INFO:teuthology.orchestra.run.smithi057.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.285508.log.gz 2024-03-27T19:55:08.972 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.145320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.233788.log 2024-03-27T19:55:08.973 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.485564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51384.log 2024-03-27T19:55:08.973 INFO:teuthology.orchestra.run.smithi057.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.328666.log.gz 2024-03-27T19:55:08.974 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.233788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.403631.log 2024-03-27T19:55:08.975 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.51384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.226684.log 2024-03-27T19:55:08.975 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.403631.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.338193.log.gz 2024-03-27T19:55:08.976 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44104.log 2024-03-27T19:55:08.976 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.226684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.420111.log 2024-03-27T19:55:08.977 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.44104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.477704.log 2024-03-27T19:55:08.978 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.420111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.465437.log 2024-03-27T19:55:08.979 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.477704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.264293.log 2024-03-27T19:55:08.979 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.465437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129895.log 2024-03-27T19:55:08.980 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.264293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45909.log 2024-03-27T19:55:08.981 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.129895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.411691.log 2024-03-27T19:55:08.982 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44414.log 2024-03-27T19:55:08.982 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.411691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.535674.log 2024-03-27T19:55:08.983 INFO:teuthology.orchestra.run.smithi057.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.209297.log.gz 2024-03-27T19:55:08.983 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.44414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.417965.log 2024-03-27T19:55:08.984 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.535674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.481767.log 2024-03-27T19:55:08.985 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.417965.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.535674.log.gz 2024-03-27T19:55:08.985 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.240869.log 2024-03-27T19:55:08.985 INFO:teuthology.orchestra.run.smithi057.stderr: 83.0% -- replaced with /var/log/ceph/ceph-client.admin.289009.log.gz 2024-03-27T19:55:08.986 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.436258.log 2024-03-27T19:55:08.987 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.481767.log: /var/log/ceph/ceph-client.admin.240869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155597.log 2024-03-27T19:55:08.987 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.436258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148006.log 2024-03-27T19:55:08.988 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.155597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.343700.log 2024-03-27T19:55:08.990 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.148006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.337351.log 2024-03-27T19:55:08.990 INFO:teuthology.orchestra.run.smithi057.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.424808.log.gz 2024-03-27T19:55:08.991 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.343700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.337781.log 2024-03-27T19:55:08.992 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.337351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.215770.log 2024-03-27T19:55:08.992 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.337781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.441475.log 2024-03-27T19:55:08.992 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.215770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.521227.log 2024-03-27T19:55:08.993 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.441475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.262611.log 2024-03-27T19:55:08.994 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.521227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234690.log 2024-03-27T19:55:08.994 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.262611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46695.log 2024-03-27T19:55:08.995 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.234690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.219592.log 2024-03-27T19:55:08.996 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.46695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.357606.log 2024-03-27T19:55:08.997 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.219592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199451.log 2024-03-27T19:55:08.998 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.357606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.285517.log 2024-03-27T19:55:08.998 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.199451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197720.log 2024-03-27T19:55:08.999 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.285517.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.340341.log.gz 2024-03-27T19:55:08.999 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.362435.log 2024-03-27T19:55:09.000 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.197720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.326560.log 2024-03-27T19:55:09.001 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.362435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50519.log 2024-03-27T19:55:09.002 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.326560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.558791.log 2024-03-27T19:55:09.003 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.50519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.553421.log 2024-03-27T19:55:09.003 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.558791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.423086.log 2024-03-27T19:55:09.003 INFO:teuthology.orchestra.run.smithi057.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.558791.log.gz 2024-03-27T19:55:09.004 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.559128.log 2024-03-27T19:55:09.005 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.553421.log: /var/log/ceph/ceph-client.admin.423086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.466271.log 2024-03-27T19:55:09.006 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.559128.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.553421.log.gz 2024-03-27T19:55:09.006 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117197.log 2024-03-27T19:55:09.006 INFO:teuthology.orchestra.run.smithi057.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.559128.log.gz 2024-03-27T19:55:09.006 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.466271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.277719.log 2024-03-27T19:55:09.007 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.117197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.462388.log 2024-03-27T19:55:09.008 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.277719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45562.log 2024-03-27T19:55:09.009 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.462388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50025.log 2024-03-27T19:55:09.009 INFO:teuthology.orchestra.run.smithi057.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.253748.log.gz 2024-03-27T19:55:09.009 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.403212.log 2024-03-27T19:55:09.010 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.50025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.283718.log 2024-03-27T19:55:09.011 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.403212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.368157.log 2024-03-27T19:55:09.012 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.283718.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.346253.log 2024-03-27T19:55:09.012 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.368157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.535243.log 2024-03-27T19:55:09.013 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.346253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198141.log 2024-03-27T19:55:09.014 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.535243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36902.log 2024-03-27T19:55:09.015 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.198141.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.535243.log.gz 2024-03-27T19:55:09.015 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.503052.log 2024-03-27T19:55:09.016 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.36902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.549789.log 2024-03-27T19:55:09.016 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.503052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.326125.log 2024-03-27T19:55:09.017 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.549789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52963.log 2024-03-27T19:55:09.017 INFO:teuthology.orchestra.run.smithi057.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.549789.log.gz 2024-03-27T19:55:09.018 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.326125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.372905.log 2024-03-27T19:55:09.019 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.52963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.366764.log 2024-03-27T19:55:09.020 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.372905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.559506.log 2024-03-27T19:55:09.021 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.366764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.543561.log 2024-03-27T19:55:09.022 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.559506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140185.log 2024-03-27T19:55:09.022 INFO:teuthology.orchestra.run.smithi057.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.559506.log.gz 2024-03-27T19:55:09.023 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.543561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.369059.log 2024-03-27T19:55:09.023 INFO:teuthology.orchestra.run.smithi057.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.214498.log.gz 2024-03-27T19:55:09.023 INFO:teuthology.orchestra.run.smithi057.stderr: 78.2% -- replaced with /var/log/ceph/ceph-client.admin.543561.log.gz 2024-03-27T19:55:09.023 INFO:teuthology.orchestra.run.smithi057.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.214919.log.gz 2024-03-27T19:55:09.024 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.140185.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.214928.log.gz 2024-03-27T19:55:09.024 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.521236.log 2024-03-27T19:55:09.025 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166083.log 2024-03-27T19:55:09.025 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.369059.log: /var/log/ceph/ceph-client.admin.521236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45565.log 2024-03-27T19:55:09.026 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.166083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.423077.log 2024-03-27T19:55:09.027 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.246912.log 2024-03-27T19:55:09.027 INFO:teuthology.orchestra.run.smithi057.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.324855.log.gz 2024-03-27T19:55:09.028 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.423077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130767.log 2024-03-27T19:55:09.028 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.246912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.268131.log 2024-03-27T19:55:09.029 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.130767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.208397.log 2024-03-27T19:55:09.030 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.268131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.215340.log 2024-03-27T19:55:09.031 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.208397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.411700.log 2024-03-27T19:55:09.032 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.215340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.547588.log 2024-03-27T19:55:09.033 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.411700.log: gzip -5 --verbose 90.0% -- /var/log/ceph/ceph-client.admin.274698.log -- replaced with /var/log/ceph/ceph-client.admin.457905.log.gz 2024-03-27T19:55:09.033 INFO:teuthology.orchestra.run.smithi057.stderr: 2024-03-27T19:55:09.033 INFO:teuthology.orchestra.run.smithi057.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.522070.log.gz 2024-03-27T19:55:09.033 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.547588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52304.log 2024-03-27T19:55:09.034 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.274698.log: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.525865.log.gz 2024-03-27T19:55:09.035 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.251999.log 2024-03-27T19:55:09.035 INFO:teuthology.orchestra.run.smithi057.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44330.log.gz 2024-03-27T19:55:09.035 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.465428.log 2024-03-27T19:55:09.036 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.52304.log: /var/log/ceph/ceph-client.admin.251999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.273417.log 2024-03-27T19:55:09.037 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.465428.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.547588.log.gz 2024-03-27T19:55:09.037 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136801.log 2024-03-27T19:55:09.038 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.273417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.266849.log 2024-03-27T19:55:09.039 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.136801.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.115305.log.gz 2024-03-27T19:55:09.039 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.405378.log 2024-03-27T19:55:09.039 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.266849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.242605.log 2024-03-27T19:55:09.040 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.405378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122483.log 2024-03-27T19:55:09.041 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.242605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.431613.log 2024-03-27T19:55:09.041 INFO:teuthology.orchestra.run.smithi057.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42876.log.gz 2024-03-27T19:55:09.042 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.122483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.335576.log 2024-03-27T19:55:09.043 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45574.log 2024-03-27T19:55:09.043 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.431613.log: /var/log/ceph/ceph-client.admin.335576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.258692.log 2024-03-27T19:55:09.044 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.528859.log 2024-03-27T19:55:09.045 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.258692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.408361.log 2024-03-27T19:55:09.046 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.528859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.241711.log 2024-03-27T19:55:09.047 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.408361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.524600.log 2024-03-27T19:55:09.048 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.241711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.483818.log 2024-03-27T19:55:09.048 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.524600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.499429.log 2024-03-27T19:55:09.049 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.365014.log 2024-03-27T19:55:09.050 INFO:teuthology.orchestra.run.smithi057.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.344559.log.gz 2024-03-27T19:55:09.050 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.483818.log: /var/log/ceph/ceph-client.admin.499429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.248261.log 2024-03-27T19:55:09.051 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.365014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.262602.log 2024-03-27T19:55:09.052 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.248261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.227114.log 2024-03-27T19:55:09.053 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.262602.log: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.423077.log.gz 2024-03-27T19:55:09.053 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198150.log 2024-03-27T19:55:09.053 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.227114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253326.log 2024-03-27T19:55:09.054 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.198150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44456.log 2024-03-27T19:55:09.055 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.253326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.520381.log 2024-03-27T19:55:09.056 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.44456.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.527552.log.gz 2024-03-27T19:55:09.056 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135962.log 2024-03-27T19:55:09.057 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.520381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.241720.log 2024-03-27T19:55:09.057 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.135962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.460077.log 2024-03-27T19:55:09.058 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.241720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.272566.log 2024-03-27T19:55:09.059 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.460077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44762.log 2024-03-27T19:55:09.060 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.272566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52782.log 2024-03-27T19:55:09.061 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.44762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.269207.log 2024-03-27T19:55:09.061 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.52782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.546691.log 2024-03-27T19:55:09.062 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.269207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124647.log 2024-03-27T19:55:09.063 INFO:teuthology.orchestra.run.smithi057.stderr: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.140185.log.gz 2024-03-27T19:55:09.063 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.546691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.339912.log 2024-03-27T19:55:09.063 INFO:teuthology.orchestra.run.smithi057.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.546691.log.gz 2024-03-27T19:55:09.064 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.124647.log: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.114805.log.gz 2024-03-27T19:55:09.064 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.504309.log 2024-03-27T19:55:09.065 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.339912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146258.log 2024-03-27T19:55:09.066 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.504309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.288593.log 2024-03-27T19:55:09.067 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.146258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243882.log 2024-03-27T19:55:09.068 INFO:teuthology.orchestra.run.smithi057.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.497646.log.gz 2024-03-27T19:55:09.068 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.288593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128199.log 2024-03-27T19:55:09.068 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.243882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.279036.log 2024-03-27T19:55:09.069 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.128199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.354356.log 2024-03-27T19:55:09.070 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.279036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.263872.log 2024-03-27T19:55:09.070 INFO:teuthology.orchestra.run.smithi057.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45907.log.gz 2024-03-27T19:55:09.071 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.354356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128666.log 2024-03-27T19:55:09.072 INFO:teuthology.orchestra.run.smithi057.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46485.log.gz 2024-03-27T19:55:09.072 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.263872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.260481.log 2024-03-27T19:55:09.073 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.128666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.274270.log 2024-03-27T19:55:09.073 INFO:teuthology.orchestra.run.smithi057.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.283709.log.gz 2024-03-27T19:55:09.073 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.260481.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.283718.log.gz 2024-03-27T19:55:09.074 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.460567.log 2024-03-27T19:55:09.074 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.274270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.529300.log 2024-03-27T19:55:09.075 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.460567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.423929.log 2024-03-27T19:55:09.076 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.529300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133343.log 2024-03-27T19:55:09.076 INFO:teuthology.orchestra.run.smithi057.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.131209.log.gz 2024-03-27T19:55:09.077 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.423929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132499.log 2024-03-27T19:55:09.078 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.133343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.255018.log 2024-03-27T19:55:09.078 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.132499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194821.log 2024-03-27T19:55:09.079 INFO:teuthology.orchestra.run.smithi057.stderr: 79.3% -- replaced with /var/log/ceph/ceph-client.admin.521648.log.gz 2024-03-27T19:55:09.079 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.255018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167346.log 2024-03-27T19:55:09.080 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.194821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132508.log 2024-03-27T19:55:09.081 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.167346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190733.log 2024-03-27T19:55:09.082 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.132508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.325286.log 2024-03-27T19:55:09.082 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.148006.log.gz 2024-03-27T19:55:09.083 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.190733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.475183.log 2024-03-27T19:55:09.083 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.325286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200778.log 2024-03-27T19:55:09.084 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.475183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142307.log 2024-03-27T19:55:09.085 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.200778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.493846.log 2024-03-27T19:55:09.085 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.142307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222706.log 2024-03-27T19:55:09.086 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.493846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.478572.log 2024-03-27T19:55:09.087 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.222706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165110.log 2024-03-27T19:55:09.088 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.478572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.456163.log 2024-03-27T19:55:09.089 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.165110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193372.log 2024-03-27T19:55:09.090 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.456163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.559631.log 2024-03-27T19:55:09.090 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.193372.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.540086.log 2024-03-27T19:55:09.092 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.559631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48100.log 2024-03-27T19:55:09.092 INFO:teuthology.orchestra.run.smithi057.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.559631.log.gz 2024-03-27T19:55:09.092 INFO:teuthology.orchestra.run.smithi057.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.339912.log.gz 2024-03-27T19:55:09.093 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.413661.log 2024-03-27T19:55:09.093 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.540086.log: /var/log/ceph/ceph-client.admin.48100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.444716.log 2024-03-27T19:55:09.094 INFO:teuthology.orchestra.run.smithi057.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.540086.log.gz 2024-03-27T19:55:09.094 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.413661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.559464.log 2024-03-27T19:55:09.095 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.444716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234239.log 2024-03-27T19:55:09.095 INFO:teuthology.orchestra.run.smithi057.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.241711.log.gz 2024-03-27T19:55:09.096 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.559464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.526287.log 2024-03-27T19:55:09.096 INFO:teuthology.orchestra.run.smithi057.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.559464.log.gz 2024-03-27T19:55:09.096 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.234239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165563.log 2024-03-27T19:55:09.097 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.526287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50361.log 2024-03-27T19:55:09.098 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.165563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.431187.log 2024-03-27T19:55:09.098 INFO:teuthology.orchestra.run.smithi057.stderr: 78.4% -- replaced with /var/log/ceph/ceph-client.admin.233788.log.gz 2024-03-27T19:55:09.099 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.50361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123390.log 2024-03-27T19:55:09.099 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.431187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.548032.log 2024-03-27T19:55:09.100 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.123390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.349720.log 2024-03-27T19:55:09.101 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.548032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.278590.log 2024-03-27T19:55:09.101 INFO:teuthology.orchestra.run.smithi057.stderr: 77.3% -- replaced with /var/log/ceph/ceph-client.admin.272566.log.gz 2024-03-27T19:55:09.102 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.349720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116744.log 2024-03-27T19:55:09.103 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.278590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.555130.log 2024-03-27T19:55:09.104 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.116744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.426942.log 2024-03-27T19:55:09.104 INFO:teuthology.orchestra.run.smithi057.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.548032.log.gz 2024-03-27T19:55:09.105 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.555130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.460086.log 2024-03-27T19:55:09.105 INFO:teuthology.orchestra.run.smithi057.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.555130.log.gz 2024-03-27T19:55:09.106 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.426942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.213665.log 2024-03-27T19:55:09.106 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.460086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.441049.log 2024-03-27T19:55:09.107 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.213665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.502631.log 2024-03-27T19:55:09.108 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.441049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165119.log 2024-03-27T19:55:09.109 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.502631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52427.log 2024-03-27T19:55:09.110 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.165119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.465016.log 2024-03-27T19:55:09.111 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.52427.log: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.361997.log.gz 2024-03-27T19:55:09.112 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.394765.log 2024-03-27T19:55:09.112 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.360666.log.gz 2024-03-27T19:55:09.112 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.465016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186143.log 2024-03-27T19:55:09.113 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.394765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.484240.log 2024-03-27T19:55:09.114 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.186143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51930.log 2024-03-27T19:55:09.115 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.484240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51762.log 2024-03-27T19:55:09.116 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.51930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.466701.log 2024-03-27T19:55:09.117 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.51762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243873.log 2024-03-27T19:55:09.117 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.466701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.396102.log 2024-03-27T19:55:09.118 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.243873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.363284.log 2024-03-27T19:55:09.119 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.396102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48504.log 2024-03-27T19:55:09.120 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.363284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.226693.log 2024-03-27T19:55:09.121 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.48504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.531610.log 2024-03-27T19:55:09.122 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.226693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.286476.log 2024-03-27T19:55:09.123 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.531610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.512049.log 2024-03-27T19:55:09.123 INFO:teuthology.orchestra.run.smithi057.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.531610.log.gz 2024-03-27T19:55:09.123 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.286476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.526296.log 2024-03-27T19:55:09.124 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50787.log 2024-03-27T19:55:09.125 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.512049.log: /var/log/ceph/ceph-client.admin.526296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.363706.log 2024-03-27T19:55:09.126 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.50787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.263881.log 2024-03-27T19:55:09.126 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.363706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.497655.log 2024-03-27T19:55:09.128 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.263881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.220482.log 2024-03-27T19:55:09.128 INFO:teuthology.orchestra.run.smithi057.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.519537.log.gz 2024-03-27T19:55:09.128 INFO:teuthology.orchestra.run.smithi057.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.369059.log.gz 2024-03-27T19:55:09.129 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.497655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134194.log 2024-03-27T19:55:09.129 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.220482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.425238.log 2024-03-27T19:55:09.130 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.134194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49719.log 2024-03-27T19:55:09.131 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.425238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.272154.log 2024-03-27T19:55:09.132 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.49719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.486417.log 2024-03-27T19:55:09.133 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.272154.log: 78.2% -- replaced with /var/log/ceph/ceph-client.admin.242605.log.gz 2024-03-27T19:55:09.133 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.424357.log 2024-03-27T19:55:09.133 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.486417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.493422.log 2024-03-27T19:55:09.134 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.424357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.250010.log 2024-03-27T19:55:09.135 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.493422.log: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.260481.log.gz 2024-03-27T19:55:09.135 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150669.log 2024-03-27T19:55:09.136 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.250010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.348437.log 2024-03-27T19:55:09.137 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.150669.log: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.262602.log.gz 2024-03-27T19:55:09.137 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193878.log 2024-03-27T19:55:09.138 INFO:teuthology.orchestra.run.smithi057.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.262611.log.gz 2024-03-27T19:55:09.138 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.348437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.445984.log 2024-03-27T19:55:09.139 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.193878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.370882.log 2024-03-27T19:55:09.139 INFO:teuthology.orchestra.run.smithi057.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.264732.log.gz 2024-03-27T19:55:09.140 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.445984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.369481.log 2024-03-27T19:55:09.140 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.370882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166934.log 2024-03-27T19:55:09.141 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.369481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45861.log 2024-03-27T19:55:09.142 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.166934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.411431.log 2024-03-27T19:55:09.142 INFO:teuthology.orchestra.run.smithi057.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.228847.log.gz 2024-03-27T19:55:09.143 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197299.log 2024-03-27T19:55:09.144 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.411431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42964.log 2024-03-27T19:55:09.144 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.464164.log 2024-03-27T19:55:09.145 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.197299.log: /var/log/ceph/ceph-client.admin.42964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147158.log 2024-03-27T19:55:09.146 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.464164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135081.log 2024-03-27T19:55:09.147 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.147158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.555590.log 2024-03-27T19:55:09.147 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.135081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.356146.log 2024-03-27T19:55:09.148 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.555590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.230149.log 2024-03-27T19:55:09.149 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.356146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.542696.log 2024-03-27T19:55:09.150 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.230149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.559002.log 2024-03-27T19:55:09.151 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.239190.log 2024-03-27T19:55:09.152 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.542696.log: /var/log/ceph/ceph-client.admin.559002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189374.log 2024-03-27T19:55:09.152 INFO:teuthology.orchestra.run.smithi057.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.274698.log.gz 2024-03-27T19:55:09.152 INFO:teuthology.orchestra.run.smithi057.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.559002.log.gz 2024-03-27T19:55:09.153 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.239190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.536524.log 2024-03-27T19:55:09.154 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.189374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.416699.log 2024-03-27T19:55:09.155 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.536524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.239181.log 2024-03-27T19:55:09.155 INFO:teuthology.orchestra.run.smithi057.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.536524.log.gz 2024-03-27T19:55:09.156 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.416699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.242184.log 2024-03-27T19:55:09.157 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.239181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50729.log 2024-03-27T19:55:09.157 INFO:teuthology.orchestra.run.smithi057.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.465007.log.gz 2024-03-27T19:55:09.158 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.242184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.270461.log 2024-03-27T19:55:09.158 INFO:teuthology.orchestra.run.smithi057.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.465849.log.gz 2024-03-27T19:55:09.158 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.465016.log.gz 2024-03-27T19:55:09.159 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.50729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.467672.log 2024-03-27T19:55:09.160 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.270461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159461.log 2024-03-27T19:55:09.161 INFO:teuthology.orchestra.run.smithi057.stderr: 92.9%/var/log/ceph/ceph-client.admin.467672.log: -- replaced with /var/log/ceph/ceph-client.admin.156465.log.gz 2024-03-27T19:55:09.161 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.270470.log 2024-03-27T19:55:09.162 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.159461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.457054.log 2024-03-27T19:55:09.163 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.270470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155175.log 2024-03-27T19:55:09.164 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.457054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.268601.log 2024-03-27T19:55:09.165 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.155175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.220491.log 2024-03-27T19:55:09.166 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.335164.log.gz 2024-03-27T19:55:09.166 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.336006.log.gz 2024-03-27T19:55:09.167 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.427779.log 2024-03-27T19:55:09.167 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.268601.log: /var/log/ceph/ceph-client.admin.220491.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.408777.log 2024-03-27T19:55:09.168 INFO:teuthology.orchestra.run.smithi057.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.356622.log.gz 2024-03-27T19:55:09.169 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.427779.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.355660.log.gz 2024-03-27T19:55:09.169 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.429048.log 2024-03-27T19:55:09.169 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45567.log 2024-03-27T19:55:09.170 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.408777.log: /var/log/ceph/ceph-client.admin.429048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.225651.log 2024-03-27T19:55:09.171 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49146.log 2024-03-27T19:55:09.172 INFO:teuthology.orchestra.run.smithi057.stderr: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.399173.log.gz 2024-03-27T19:55:09.173 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.408352.log 2024-03-27T19:55:09.173 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.225651.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.398760.log.gz 2024-03-27T19:55:09.174 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.49146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.371879.log 2024-03-27T19:55:09.174 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.408352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.256554.log 2024-03-27T19:55:09.176 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.371879.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.430766.log.gz 2024-03-27T19:55:09.176 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.223556.log 2024-03-27T19:55:09.176 INFO:teuthology.orchestra.run.smithi057.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44456.log.gz 2024-03-27T19:55:09.177 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.256554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.228856.log 2024-03-27T19:55:09.177 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.223556.log: 94.3% -- replaced with /var/log/ceph/ceph-client.admin.542696.log.gz 2024-03-27T19:55:09.178 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.272575.log 2024-03-27T19:55:09.179 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.228856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.443190.log 2024-03-27T19:55:09.180 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.272575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.472010.log 2024-03-27T19:55:09.180 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.443190.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.479878.log.gz 2024-03-27T19:55:09.181 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.335155.log 2024-03-27T19:55:09.182 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.472010.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.481758.log.gz 2024-03-27T19:55:09.182 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.30875.log 2024-03-27T19:55:09.183 INFO:teuthology.orchestra.run.smithi057.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.481281.log.gz 2024-03-27T19:55:09.183 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.335155.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.483818.log.gz 2024-03-27T19:55:09.184 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167355.log 2024-03-27T19:55:09.184 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph.tmp-client.admin.30875.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.30875.log.gz 2024-03-27T19:55:09.184 INFO:teuthology.orchestra.run.smithi057.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.486408.log.gz 2024-03-27T19:55:09.184 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.491225.log 2024-03-27T19:55:09.185 INFO:teuthology.orchestra.run.smithi057.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.50729.log.gz 2024-03-27T19:55:09.185 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.167355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.425660.log 2024-03-27T19:55:09.186 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.491225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.558498.log 2024-03-27T19:55:09.187 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.425660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186152.log 2024-03-27T19:55:09.188 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.558498.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.558498.log.gz 2024-03-27T19:55:09.188 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.525874.log 2024-03-27T19:55:09.189 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.186152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.408786.log 2024-03-27T19:55:09.190 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.525874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53177.log 2024-03-27T19:55:09.191 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.408786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.483388.log 2024-03-27T19:55:09.192 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.53177.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.503475.log.gz 2024-03-27T19:55:09.192 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243036.log 2024-03-27T19:55:09.193 INFO:teuthology.orchestra.run.smithi057.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.154694.log.gz 2024-03-27T19:55:09.193 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.483388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.491234.log 2024-03-27T19:55:09.194 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.243036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.213235.log 2024-03-27T19:55:09.195 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.491234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.490385.log 2024-03-27T19:55:09.196 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.213235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202555.log 2024-03-27T19:55:09.197 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.490385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.539651.log 2024-03-27T19:55:09.198 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.202555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.333764.log 2024-03-27T19:55:09.199 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.539651.log: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.234239.log.gz 2024-03-27T19:55:09.200 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.495522.log 2024-03-27T19:55:09.200 INFO:teuthology.orchestra.run.smithi057.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.539651.log.gz 2024-03-27T19:55:09.200 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.333764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53345.log 2024-03-27T19:55:09.201 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.495522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.212402.log 2024-03-27T19:55:09.203 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.53345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.360657.log 2024-03-27T19:55:09.204 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.503043.log 2024-03-27T19:55:09.205 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.212402.log: /var/log/ceph/ceph-client.admin.360657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.444299.log 2024-03-27T19:55:09.206 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.503043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199030.log 2024-03-27T19:55:09.207 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133773.log 2024-03-27T19:55:09.208 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.444299.log: /var/log/ceph/ceph-client.admin.199030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.477065.log 2024-03-27T19:55:09.208 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.133773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167918.log 2024-03-27T19:55:09.210 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.477065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.492508.log 2024-03-27T19:55:09.210 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.167918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.265997.log 2024-03-27T19:55:09.211 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.492508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.557349.log 2024-03-27T19:55:09.212 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.265997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42792.log 2024-03-27T19:55:09.213 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.557349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186994.log 2024-03-27T19:55:09.213 INFO:teuthology.orchestra.run.smithi057.stderr: 80.1% -- replaced with /var/log/ceph/ceph-client.admin.557349.log.gz 2024-03-27T19:55:09.214 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.42792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.528434.log 2024-03-27T19:55:09.215 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.166934.log.gz 2024-03-27T19:55:09.215 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.186994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222254.log 2024-03-27T19:55:09.216 INFO:teuthology.orchestra.run.smithi057.stderr: 83.8% -- replaced with /var/log/ceph/ceph-client.admin.242184.log.gz 2024-03-27T19:55:09.216 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.528434.log: gzip 81.5% -- replaced with /var/log/ceph/ceph-client.admin.243873.log.gz -5 2024-03-27T19:55:09.217 INFO:teuthology.orchestra.run.smithi057.stderr: --verbose -- /var/log/ceph/ceph-client.admin.232247.log 2024-03-27T19:55:09.217 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.222254.log: 83.4% -- replaced with /var/log/ceph/ceph-client.admin.165563.log.gz 2024-03-27T19:55:09.217 INFO:teuthology.orchestra.run.smithi057.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.165110.log.gz 2024-03-27T19:55:09.218 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.254588.log 2024-03-27T19:55:09.218 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.232247.log: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.186994.log.gz 2024-03-27T19:55:09.219 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.402791.log 2024-03-27T19:55:09.220 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.254588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.414939.log 2024-03-27T19:55:09.221 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.402791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.250019.log 2024-03-27T19:55:09.222 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.414939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.339068.log 2024-03-27T19:55:09.222 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.213665.log.gz 2024-03-27T19:55:09.223 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.250019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.348859.log 2024-03-27T19:55:09.224 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.339068.log: 77.5% -- replaced with /var/log/ceph/ceph-client.admin.239181.log.gz 2024-03-27T19:55:09.224 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.541415.log 2024-03-27T19:55:09.225 INFO:teuthology.orchestra.run.smithi057.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.239190.log.gz 2024-03-27T19:55:09.225 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.348859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.364583.log 2024-03-27T19:55:09.226 INFO:teuthology.orchestra.run.smithi057.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.225651.log.gz 2024-03-27T19:55:09.226 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.541415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192919.log 2024-03-27T19:55:09.227 INFO:teuthology.orchestra.run.smithi057.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.263881.log.gz 2024-03-27T19:55:09.227 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.364583.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.541415.log.gz 2024-03-27T19:55:09.228 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.218295.log 2024-03-27T19:55:09.228 INFO:teuthology.orchestra.run.smithi057.stderr: 79.6% -- replaced with /var/log/ceph/ceph-client.admin.254588.log.gz 2024-03-27T19:55:09.229 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.272154.log.gz 2024-03-27T19:55:09.229 INFO:teuthology.orchestra.run.smithi057.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.335155.log.gz 2024-03-27T19:55:09.229 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.192919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.459643.log 2024-03-27T19:55:09.230 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.218295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.416233.log 2024-03-27T19:55:09.231 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.459643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185291.log 2024-03-27T19:55:09.232 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.416233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.284572.log 2024-03-27T19:55:09.232 INFO:teuthology.orchestra.run.smithi057.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.155175.log.gz 2024-03-27T19:55:09.233 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.185291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183146.log 2024-03-27T19:55:09.234 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.284572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116735.log 2024-03-27T19:55:09.234 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.183146.log: 77.3% -- replaced with /var/log/ceph/ceph-client.admin.130758.log.gz 2024-03-27T19:55:09.235 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.418853.log 2024-03-27T19:55:09.236 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.116735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244728.log 2024-03-27T19:55:09.237 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.418853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.350141.log 2024-03-27T19:55:09.238 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.486861.log.gz 2024-03-27T19:55:09.238 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.244728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52656.log 2024-03-27T19:55:09.239 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.350141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.534768.log 2024-03-27T19:55:09.240 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.493422.log.gz 2024-03-27T19:55:09.240 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.52656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138083.log 2024-03-27T19:55:09.241 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.534768.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.339921.log.gz 2024-03-27T19:55:09.241 INFO:teuthology.orchestra.run.smithi057.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.534768.log.gz 2024-03-27T19:55:09.242 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.338623.log 2024-03-27T19:55:09.242 INFO:teuthology.orchestra.run.smithi057.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.371879.log.gz 2024-03-27T19:55:09.242 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.138083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146267.log 2024-03-27T19:55:09.243 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.338623.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50361.log.gz 2024-03-27T19:55:09.244 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244296.log 2024-03-27T19:55:09.245 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.146267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.558414.log 2024-03-27T19:55:09.246 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.244296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.532922.log 2024-03-27T19:55:09.246 INFO:teuthology.orchestra.run.smithi057.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.529300.log.gz 2024-03-27T19:55:09.247 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.558414.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.558414.log.gz 2024-03-27T19:55:09.247 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.461971.log 2024-03-27T19:55:09.248 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.532922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136810.log 2024-03-27T19:55:09.249 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.461971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45906.log 2024-03-27T19:55:09.250 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.136810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.342445.log 2024-03-27T19:55:09.251 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158192.log 2024-03-27T19:55:09.253 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.342445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.474184.log 2024-03-27T19:55:09.254 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.158192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.274707.log 2024-03-27T19:55:09.255 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.474184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.358512.log 2024-03-27T19:55:09.256 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.274707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.373883.log 2024-03-27T19:55:09.256 INFO:teuthology.orchestra.run.smithi057.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.361087.log.gz 2024-03-27T19:55:09.257 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.358512.log: 79.9% -- replaced with /var/log/ceph/ceph-client.admin.132499.log.gz 2024-03-27T19:55:09.257 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138918.log 2024-03-27T19:55:09.257 INFO:teuthology.orchestra.run.smithi057.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.132508.log.gz 2024-03-27T19:55:09.259 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.373883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247839.log 2024-03-27T19:55:09.259 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.138918.log: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.442770.log.gz 2024-03-27T19:55:09.260 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.523757.log 2024-03-27T19:55:09.261 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.247839.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.461063.log 2024-03-27T19:55:09.262 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.523757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149705.log 2024-03-27T19:55:09.263 INFO:teuthology.orchestra.run.smithi057.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51930.log.gz 2024-03-27T19:55:09.263 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.461063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.216612.log 2024-03-27T19:55:09.263 INFO:teuthology.orchestra.run.smithi057.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52304.log.gz 2024-03-27T19:55:09.264 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.149705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150239.log 2024-03-27T19:55:09.265 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.216612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.420962.log 2024-03-27T19:55:09.266 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.150239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.515805.log 2024-03-27T19:55:09.268 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.420962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.482192.log 2024-03-27T19:55:09.268 INFO:teuthology.orchestra.run.smithi057.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.364583.log.gz 2024-03-27T19:55:09.268 INFO:teuthology.orchestra.run.smithi057.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.211552.log.gz 2024-03-27T19:55:09.269 INFO:teuthology.orchestra.run.smithi057.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.443190.log.gz 2024-03-27T19:55:09.269 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.515805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.498580.log 2024-03-27T19:55:09.270 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.482192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.543149.log 2024-03-27T19:55:09.271 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.498580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52512.log 2024-03-27T19:55:09.272 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.543149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.240447.log 2024-03-27T19:55:09.273 INFO:teuthology.orchestra.run.smithi057.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.249571.log.gz 2024-03-27T19:55:09.273 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.52512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.407876.log 2024-03-27T19:55:09.273 INFO:teuthology.orchestra.run.smithi057.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.543149.log.gz 2024-03-27T19:55:09.274 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.240447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.276412.log 2024-03-27T19:55:09.275 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.407876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.327823.log 2024-03-27T19:55:09.276 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.276412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73876.log 2024-03-27T19:55:09.277 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.327823.log: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.248261.log.gz 2024-03-27T19:55:09.277 INFO:teuthology.orchestra.run.smithi057.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.459643.log.gz 2024-03-27T19:55:09.278 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.204774.log 2024-03-27T19:55:09.278 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.73876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.331635.log 2024-03-27T19:55:09.280 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.204774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50871.log 2024-03-27T19:55:09.281 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.331635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.338202.log 2024-03-27T19:55:09.281 INFO:teuthology.orchestra.run.smithi057.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.525874.log.gz 2024-03-27T19:55:09.281 INFO:teuthology.orchestra.run.smithi057.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.243036.log.gz 2024-03-27T19:55:09.282 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.50871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.463732.log 2024-03-27T19:55:09.283 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.338202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.472431.log 2024-03-27T19:55:09.284 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.463732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.401047.log 2024-03-27T19:55:09.285 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.472431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.526718.log 2024-03-27T19:55:09.285 INFO:teuthology.orchestra.run.smithi057.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52656.log.gz 2024-03-27T19:55:09.286 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.464164.log.gz 2024-03-27T19:55:09.286 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.401047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130335.log 2024-03-27T19:55:09.287 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.526718.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.323576.log 2024-03-27T19:55:09.288 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.130335.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.491225.log.gz 2024-03-27T19:55:09.288 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.477074.log 2024-03-27T19:55:09.290 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.323576.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.50871.log.gz 2024-03-27T19:55:09.290 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.551565.log 2024-03-27T19:55:09.291 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.477074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.504769.log 2024-03-27T19:55:09.291 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.551565.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.551565.log.gz 2024-03-27T19:55:09.292 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.490797.log 2024-03-27T19:55:09.293 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.504769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.246046.log 2024-03-27T19:55:09.293 INFO:teuthology.orchestra.run.smithi057.stderr: 78.5% -- replaced with /var/log/ceph/ceph-client.admin.461054.log.gz 2024-03-27T19:55:09.294 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.490797.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.461063.log.gz 2024-03-27T19:55:09.294 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149292.log 2024-03-27T19:55:09.295 INFO:teuthology.orchestra.run.smithi057.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.53345.log.gz 2024-03-27T19:55:09.295 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.461971.log.gz 2024-03-27T19:55:09.296 INFO:teuthology.orchestra.run.smithi057.stderr: 77.9% -- replaced with /var/log/ceph/ceph-client.admin.149705.log.gz 2024-03-27T19:55:09.296 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.246046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.330792.log 2024-03-27T19:55:09.296 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.149292.log: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.514552.log.gz 2024-03-27T19:55:09.297 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45575.log 2024-03-27T19:55:09.298 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.330792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.340762.log 2024-03-27T19:55:09.299 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.260064.log 2024-03-27T19:55:09.300 INFO:teuthology.orchestra.run.smithi057.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.158192.log.gz 2024-03-27T19:55:09.300 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.340762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.524609.log 2024-03-27T19:55:09.301 INFO:teuthology.orchestra.run.smithi057.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.150239.log.gz 2024-03-27T19:55:09.301 INFO:teuthology.orchestra.run.smithi057.stderr: 77.9% -- replaced with /var/log/ceph/ceph-client.admin.138918.log.gz 2024-03-27T19:55:09.302 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.260064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.502622.log 2024-03-27T19:55:09.302 INFO:teuthology.orchestra.run.smithi057.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.138083.log.gz 2024-03-27T19:55:09.303 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.524609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46359.log 2024-03-27T19:55:09.303 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.158623.log.gz 2024-03-27T19:55:09.304 INFO:teuthology.orchestra.run.smithi057.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.124647.log.gz/var/log/ceph/ceph-client.admin.502622.log: 2024-03-27T19:55:09.304 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139350.log 2024-03-27T19:55:09.305 INFO:teuthology.orchestra.run.smithi057.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.136810.log.gz 2024-03-27T19:55:09.305 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.46359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.227956.log 2024-03-27T19:55:09.306 INFO:teuthology.orchestra.run.smithi057.stderr: 78.1% -- replaced with /var/log/ceph/ceph-client.admin.414939.log.gz 2024-03-27T19:55:09.307 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.139350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.370446.log 2024-03-27T19:55:09.307 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.327823.log.gz 2024-03-27T19:55:09.307 INFO:teuthology.orchestra.run.smithi057.stderr: 78.1% -- replaced with /var/log/ceph/ceph-client.admin.145320.log.gz 2024-03-27T19:55:09.308 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.227956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.219166.log 2024-03-27T19:55:09.309 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.370446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.246055.log 2024-03-27T19:55:09.310 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.219166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45014.log 2024-03-27T19:55:09.311 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.246055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.472907.log 2024-03-27T19:55:09.312 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.207472.log 2024-03-27T19:55:09.313 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.472907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.525444.log 2024-03-27T19:55:09.314 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.207472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.264723.log 2024-03-27T19:55:09.315 INFO:teuthology.orchestra.run.smithi057.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48100.log.gz 2024-03-27T19:55:09.315 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.525444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.206573.log 2024-03-27T19:55:09.317 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.264723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45237.log 2024-03-27T19:55:09.318 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.206573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.456642.log 2024-03-27T19:55:09.319 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.344981.log 2024-03-27T19:55:09.319 INFO:teuthology.orchestra.run.smithi057.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.256554.log.gz 2024-03-27T19:55:09.320 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.456642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.275970.log 2024-03-27T19:55:09.321 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.344981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.206133.log 2024-03-27T19:55:09.322 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.275970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.275961.log 2024-03-27T19:55:09.323 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.206133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.429923.log 2024-03-27T19:55:09.324 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.275961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52014.log 2024-03-27T19:55:09.325 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.429923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199442.log 2024-03-27T19:55:09.326 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.52014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.239612.log 2024-03-27T19:55:09.328 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.199442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.503889.log 2024-03-27T19:55:09.329 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.239612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.425229.log 2024-03-27T19:55:09.329 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.503889.log: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.424366.log.gz 2024-03-27T19:55:09.330 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122492.log 2024-03-27T19:55:09.331 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.425229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.223127.log 2024-03-27T19:55:09.332 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.122492.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-03-27T19:55:09.333 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.223127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.255928.log 2024-03-27T19:55:09.334 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph.audit.log: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.348859.log.gz 2024-03-27T19:55:09.334 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.411846.log 2024-03-27T19:55:09.335 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.255928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.500400.log 2024-03-27T19:55:09.336 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.411846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.363715.log 2024-03-27T19:55:09.337 INFO:teuthology.orchestra.run.smithi057.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.218295.log.gz 2024-03-27T19:55:09.337 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.500400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43048.log 2024-03-27T19:55:09.338 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.363715.log: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.232247.log.gz 2024-03-27T19:55:09.339 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.522492.log 2024-03-27T19:55:09.340 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.43048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.490376.log 2024-03-27T19:55:09.341 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.522492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51258.log 2024-03-27T19:55:09.342 INFO:teuthology.orchestra.run.smithi057.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.197720.log.gz 2024-03-27T19:55:09.342 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.490376.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.198141.log.gz 2024-03-27T19:55:09.343 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.481272.log 2024-03-27T19:55:09.343 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.197729.log.gz 2024-03-27T19:55:09.343 INFO:teuthology.orchestra.run.smithi057.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.199030.log.gz 2024-03-27T19:55:09.344 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.51258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45236.log 2024-03-27T19:55:09.345 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.481272.log: 84.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.409713.log 2024-03-27T19:55:09.345 INFO:teuthology.orchestra.run.smithi057.stderr: -- replaced with /var/log/ceph/ceph-client.admin.222254.log.gz 2024-03-27T19:55:09.345 INFO:teuthology.orchestra.run.smithi057.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.490797.log.gz 2024-03-27T19:55:09.346 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141882.log 2024-03-27T19:55:09.347 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.409713.log: gzip -5 85.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.166083.log.gz /var/log/ceph/ceph-client.admin.49761.log 2024-03-27T19:55:09.347 INFO:teuthology.orchestra.run.smithi057.stderr: 2024-03-27T19:55:09.348 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.141882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.257427.log 2024-03-27T19:55:09.349 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.49761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.503898.log 2024-03-27T19:55:09.350 INFO:teuthology.orchestra.run.smithi057.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.343700.log.gz 2024-03-27T19:55:09.351 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.257427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168348.log 2024-03-27T19:55:09.351 INFO:teuthology.orchestra.run.smithi057.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.331635.log.gz 2024-03-27T19:55:09.351 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.503898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.335585.log 2024-03-27T19:55:09.353 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.168348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138497.log 2024-03-27T19:55:09.354 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.335585.log: 78.6% -- replaced with /var/log/ceph/ceph-client.admin.525444.log.gz 2024-03-27T19:55:09.354 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.228368.log 2024-03-27T19:55:09.355 INFO:teuthology.orchestra.run.smithi057.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.524609.log.gz 2024-03-27T19:55:09.355 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.138497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.431196.log 2024-03-27T19:55:09.356 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.228368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.473328.log 2024-03-27T19:55:09.357 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.431196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.405387.log 2024-03-27T19:55:09.358 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.473328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.493413.log 2024-03-27T19:55:09.359 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.405387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.513344.log 2024-03-27T19:55:09.361 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.493413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.285028.log 2024-03-27T19:55:09.361 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.513344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.271733.log 2024-03-27T19:55:09.362 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.285028.log: gzip 88.2% -5 -- replaced with /var/log/ceph/ceph-client.admin.52427.log.gz --verbose 2024-03-27T19:55:09.363 INFO:teuthology.orchestra.run.smithi057.stderr: -- /var/log/ceph/ceph-client.admin.43134.log 2024-03-27T19:55:09.366 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.271733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.517051.log 2024-03-27T19:55:09.366 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.43134.log: 96.5% -- replaced with /var/log/ceph/ceph-client.admin.555590.log.gz 2024-03-27T19:55:09.366 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.491656.log 2024-03-27T19:55:09.367 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.517051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50645.log 2024-03-27T19:55:09.367 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.491656.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.251999.log.gz 2024-03-27T19:55:09.367 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.467663.log 2024-03-27T19:55:09.368 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.50645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.495531.log 2024-03-27T19:55:09.369 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.558749.log/var/log/ceph/ceph-client.admin.467663.log: 2024-03-27T19:55:09.370 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.495531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.401912.log 2024-03-27T19:55:09.371 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.558749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49577.log 2024-03-27T19:55:09.372 INFO:teuthology.orchestra.run.smithi057.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.558749.log.gz 2024-03-27T19:55:09.372 INFO:teuthology.orchestra.run.smithi057.stderr: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.417544.log.gz 2024-03-27T19:55:09.372 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.401912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122914.log 2024-03-27T19:55:09.372 INFO:teuthology.orchestra.run.smithi057.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.335585.log.gz 2024-03-27T19:55:09.373 INFO:teuthology.orchestra.run.smithi057.stderr:gzip/var/log/ceph/ceph-client.admin.49577.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.329097.log 2024-03-27T19:55:09.374 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.122914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48672.log 2024-03-27T19:55:09.376 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.329097.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.192044.log.gz 2024-03-27T19:55:09.376 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.215761.log 2024-03-27T19:55:09.376 INFO:teuthology.orchestra.run.smithi057.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.192919.log.gz 2024-03-27T19:55:09.377 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.48672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.495950.log 2024-03-27T19:55:09.378 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.215761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197308.log 2024-03-27T19:55:09.379 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.495950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.420120.log 2024-03-27T19:55:09.380 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.197308.log: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.323576.log.gz 2024-03-27T19:55:09.380 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.417118.log 2024-03-27T19:55:09.382 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.420120.log: gzip -5 --verbose -- 77.8% -- replaced with /var/log/ceph/ceph-client.admin.481272.log.gz 2024-03-27T19:55:09.382 INFO:teuthology.orchestra.run.smithi057.stderr: /var/log/ceph/ceph-client.admin.211543.log 81.7% -- replaced with /var/log/ceph/ceph-client.admin.482192.log.gz 2024-03-27T19:55:09.382 INFO:teuthology.orchestra.run.smithi057.stderr: 2024-03-27T19:55:09.382 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.417118.log: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.480365.log.gz 2024-03-27T19:55:09.383 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46149.log 2024-03-27T19:55:09.383 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.211543.log: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.515805.log.gz 2024-03-27T19:55:09.384 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.559086.log 2024-03-27T19:55:09.385 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.46149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.376280.log 2024-03-27T19:55:09.385 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.559086.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.559086.log.gz 2024-03-27T19:55:09.386 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244719.log 2024-03-27T19:55:09.387 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.376280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.333755.log 2024-03-27T19:55:09.388 INFO:teuthology.orchestra.run.smithi057.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52512.log.gz 2024-03-27T19:55:09.388 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.244719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141037.log 2024-03-27T19:55:09.389 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.333755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.493837.log 2024-03-27T19:55:09.390 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.141037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.211968.log 2024-03-27T19:55:09.391 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.493837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139341.log 2024-03-27T19:55:09.392 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.211968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.359346.log 2024-03-27T19:55:09.394 INFO:teuthology.orchestra.run.smithi057.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.363715.log.gz 2024-03-27T19:55:09.394 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.139341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.349711.log 2024-03-27T19:55:09.395 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.359346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.488180.log 2024-03-27T19:55:09.396 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.349711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.287321.log 2024-03-27T19:55:09.397 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45910.log 2024-03-27T19:55:09.398 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.488180.log: /var/log/ceph/ceph-client.admin.287321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131630.log 2024-03-27T19:55:09.399 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.440202.log 2024-03-27T19:55:09.400 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.131630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.510841.log 2024-03-27T19:55:09.401 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.440202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147570.log 2024-03-27T19:55:09.402 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.510841.log: 90.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.288593.log.gz 2024-03-27T19:55:09.402 INFO:teuthology.orchestra.run.smithi057.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.470258.log 2024-03-27T19:55:09.403 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.147570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.501363.log 2024-03-27T19:55:09.404 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.470258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.221833.log 2024-03-27T19:55:09.405 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.501363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134185.log 2024-03-27T19:55:09.407 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.221833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.548920.log 2024-03-27T19:55:09.408 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.134185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117695.log 2024-03-27T19:55:09.408 INFO:teuthology.orchestra.run.smithi057.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.252899.log.gz 2024-03-27T19:55:09.409 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.548920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.259629.log 2024-03-27T19:55:09.410 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.117695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.365436.log 2024-03-27T19:55:09.411 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.259629.log: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.548920.log.gz 2024-03-27T19:55:09.412 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.559254.log 2024-03-27T19:55:09.412 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.365436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.407885.log 2024-03-27T19:55:09.414 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.559254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.366288.log 2024-03-27T19:55:09.414 INFO:teuthology.orchestra.run.smithi057.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.559254.log.gz 2024-03-27T19:55:09.414 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.407885.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.350141.log.gz 2024-03-27T19:55:09.415 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.220042.log 2024-03-27T19:55:09.416 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.366288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135072.log 2024-03-27T19:55:09.416 INFO:teuthology.orchestra.run.smithi057.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.411691.log.gz 2024-03-27T19:55:09.417 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.220042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.532455.log 2024-03-27T19:55:09.417 INFO:teuthology.orchestra.run.smithi057.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48672.log.gz 2024-03-27T19:55:09.418 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.135072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44498.log 2024-03-27T19:55:09.419 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.532455.log: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.532455.log.gz 2024-03-27T19:55:09.419 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.340332.log 2024-03-27T19:55:09.419 INFO:teuthology.orchestra.run.smithi057.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.466271.log.gz 2024-03-27T19:55:09.420 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.44498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.484653.log 2024-03-27T19:55:09.421 INFO:teuthology.orchestra.run.smithi057.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.467672.log.gz 2024-03-27T19:55:09.421 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.340332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.213656.log 2024-03-27T19:55:09.422 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.484653.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.500400.log.gz 2024-03-27T19:55:09.423 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43218.log 2024-03-27T19:55:09.423 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.359767.log 2024-03-27T19:55:09.424 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.213656.log: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.502622.log.gz 2024-03-27T19:55:09.424 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.43218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.230992.log 2024-03-27T19:55:09.425 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.359767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.373892.log 2024-03-27T19:55:09.427 INFO:teuthology.orchestra.run.smithi057.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.504769.log.gz 2024-03-27T19:55:09.427 INFO:teuthology.orchestra.run.smithi057.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45575.log.gz 2024-03-27T19:55:09.427 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.230992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.489964.log 2024-03-27T19:55:09.428 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.373892.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46359.log.gz 2024-03-27T19:55:09.428 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.558456.log 2024-03-27T19:55:09.429 INFO:teuthology.orchestra.run.smithi057.stderr: 83.9% -- replaced with /var/log/ceph/ceph-client.admin.521227.log.gz 2024-03-27T19:55:09.429 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.489964.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49577.log.gz 2024-03-27T19:55:09.430 INFO:teuthology.orchestra.run.smithi057.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49761.log.gz 2024-03-27T19:55:09.430 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.355651.log 2024-03-27T19:55:09.430 INFO:teuthology.orchestra.run.smithi057.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.138497.log.gz 2024-03-27T19:55:09.432 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.488180.log.gz 2024-03-27T19:55:09.432 INFO:teuthology.orchestra.run.smithi057.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.139341.log.gz/var/log/ceph/ceph-client.admin.558456.log: 2024-03-27T19:55:09.432 INFO:teuthology.orchestra.run.smithi057.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.149292.log.gz 2024-03-27T19:55:09.432 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.499420.log 2024-03-27T19:55:09.432 INFO:teuthology.orchestra.run.smithi057.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.558456.log.gz 2024-03-27T19:55:09.432 INFO:teuthology.orchestra.run.smithi057.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.139350.log.gz 2024-03-27T19:55:09.432 INFO:teuthology.orchestra.run.smithi057.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.141882.log.gz 2024-03-27T19:55:09.432 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.355651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146690.log 2024-03-27T19:55:09.433 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.499420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.395667.log 2024-03-27T19:55:09.434 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.146690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195329.log 2024-03-27T19:55:09.435 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.395667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.479423.log 2024-03-27T19:55:09.436 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.195329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.484662.log 2024-03-27T19:55:09.437 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.479423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.557975.log 2024-03-27T19:55:09.439 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.484662.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.268601.log.gz 2024-03-27T19:55:09.439 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51972.log 2024-03-27T19:55:09.440 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.557975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.485985.log 2024-03-27T19:55:09.440 INFO:teuthology.orchestra.run.smithi057.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.557975.log.gz 2024-03-27T19:55:09.441 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.51972.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.345405.log.gz 2024-03-27T19:55:09.441 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.507297.log 2024-03-27T19:55:09.442 INFO:teuthology.orchestra.run.smithi057.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.346253.log.gz 2024-03-27T19:55:09.443 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.485985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.422652.log 2024-03-27T19:55:09.443 INFO:teuthology.orchestra.run.smithi057.stderr: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.350977.log.gz 2024-03-27T19:55:09.443 INFO:teuthology.orchestra.run.smithi057.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.346755.log.gz 2024-03-27T19:55:09.444 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.507297.log: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.354356.log.gz 2024-03-27T19:55:09.444 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.345840.log 2024-03-27T19:55:09.444 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.422652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.233797.log 2024-03-27T19:55:09.445 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.345840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.271312.log 2024-03-27T19:55:09.446 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.358512.log.gz 2024-03-27T19:55:09.446 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.197308.log.gz 2024-03-27T19:55:09.447 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.233797.log: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.199442.log.gz 2024-03-27T19:55:09.447 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.342856.log 2024-03-27T19:55:09.448 INFO:teuthology.orchestra.run.smithi057.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.244719.log.gz 2024-03-27T19:55:09.448 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.271312.log: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.213656.log.gz 2024-03-27T19:55:09.449 INFO:teuthology.orchestra.run.smithi057.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.335576.log.gz 2024-03-27T19:55:09.449 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232256.log 2024-03-27T19:55:09.449 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.342856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42920.log 2024-03-27T19:55:09.450 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132930.log 2024-03-27T19:55:09.452 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.232256.log: /var/log/ceph/ceph-client.admin.42920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.229296.log 2024-03-27T19:55:09.452 INFO:teuthology.orchestra.run.smithi057.stderr:gzip/var/log/ceph/ceph-client.admin.132930.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.472422.log 2024-03-27T19:55:09.453 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.229296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137652.log 2024-03-27T19:55:09.454 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.472422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.342436.log 2024-03-27T19:55:09.456 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.137652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45860.log 2024-03-27T19:55:09.456 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.342436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46233.log 2024-03-27T19:55:09.457 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.558917.log 2024-03-27T19:55:09.458 INFO:teuthology.orchestra.run.smithi057.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.267284.log.gz 2024-03-27T19:55:09.459 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.46233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.331218.log 2024-03-27T19:55:09.459 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.558917.log: gzip -5 --verbose -- 88.3% /var/log/ceph/ceph-client.admin.166513.log -- replaced with /var/log/ceph/ceph-client.admin.558917.log.gz 2024-03-27T19:55:09.460 INFO:teuthology.orchestra.run.smithi057.stderr: 2024-03-27T19:55:09.460 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.331218.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.271312.log.gz 2024-03-27T19:55:09.461 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.210647.log 2024-03-27T19:55:09.462 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.166513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50687.log 2024-03-27T19:55:09.462 INFO:teuthology.orchestra.run.smithi057.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.211968.log.gz 2024-03-27T19:55:09.462 INFO:teuthology.orchestra.run.smithi057.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.211543.log.gz 2024-03-27T19:55:09.463 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.210647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.552961.log 2024-03-27T19:55:09.464 INFO:teuthology.orchestra.run.smithi057.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.183146.log.gz 2024-03-27T19:55:09.464 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.50687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.489470.log 2024-03-27T19:55:09.465 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.552961.log: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.215340.log.gz 2024-03-27T19:55:09.465 INFO:teuthology.orchestra.run.smithi057.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.552961.log.gz 2024-03-27T19:55:09.465 INFO:teuthology.orchestra.run.smithi057.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.215761.log.gz 2024-03-27T19:55:09.465 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.416242.log 2024-03-27T19:55:09.466 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.489470.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.489964.log.gz 2024-03-27T19:55:09.467 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.207022.log 2024-03-27T19:55:09.467 INFO:teuthology.orchestra.run.smithi057.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.206573.log.gz 2024-03-27T19:55:09.468 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.416242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48799.log 2024-03-27T19:55:09.469 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.207022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.529832.log 2024-03-27T19:55:09.470 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.48799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.326551.log 2024-03-27T19:55:09.471 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.529832.log: 79.4% -- replaced with /var/log/ceph/ceph-client.admin.510841.log.gz 2024-03-27T19:55:09.471 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.510850.log 2024-03-27T19:55:09.472 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.326551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.323155.log 2024-03-27T19:55:09.472 INFO:teuthology.orchestra.run.smithi057.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.529832.log.gz 2024-03-27T19:55:09.473 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.510850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.512058.log 2024-03-27T19:55:09.475 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.323155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243459.log 2024-03-27T19:55:09.475 INFO:teuthology.orchestra.run.smithi057.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.340332.log.gz 2024-03-27T19:55:09.476 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.512058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.203013.log 2024-03-27T19:55:09.477 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.243459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.373402.log 2024-03-27T19:55:09.477 INFO:teuthology.orchestra.run.smithi057.stderr: 96.5% -- replaced with /var/log/ceph/ceph-client.admin.532922.log.gz 2024-03-27T19:55:09.478 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.203013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.545812.log 2024-03-27T19:55:09.479 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.373402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.445142.log 2024-03-27T19:55:09.479 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.545812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.266432.log 2024-03-27T19:55:09.480 INFO:teuthology.orchestra.run.smithi057.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.73876.log.gz 2024-03-27T19:55:09.481 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.445142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.520803.log 2024-03-27T19:55:09.482 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.266432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.474669.log 2024-03-27T19:55:09.482 INFO:teuthology.orchestra.run.smithi057.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.545812.log.gz 2024-03-27T19:55:09.483 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.495100.log 2024-03-27T19:55:09.484 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.520803.log: /var/log/ceph/ceph-client.admin.474669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.286467.log 2024-03-27T19:55:09.485 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.495100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.457896.log 2024-03-27T19:55:09.485 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.286467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.396989.log 2024-03-27T19:55:09.486 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.457896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.439360.log 2024-03-27T19:55:09.487 INFO:teuthology.orchestra.run.smithi057.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.286467.log.gz 2024-03-27T19:55:09.487 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.396989.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.257427.log.gz 2024-03-27T19:55:09.488 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.533400.log 2024-03-27T19:55:09.489 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.439360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.550677.log 2024-03-27T19:55:09.490 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.533400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.559380.log 2024-03-27T19:55:09.491 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.550677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.483809.log 2024-03-27T19:55:09.492 INFO:teuthology.orchestra.run.smithi057.stderr: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.550677.log.gz 2024-03-27T19:55:09.492 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.559380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.203462.log 2024-03-27T19:55:09.492 INFO:teuthology.orchestra.run.smithi057.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.559380.log.gz 2024-03-27T19:55:09.493 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.483809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.205675.log 2024-03-27T19:55:09.494 INFO:teuthology.orchestra.run.smithi057.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45014.log.gz 2024-03-27T19:55:09.495 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.203462.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45236.log.gz 2024-03-27T19:55:09.495 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167660.log 2024-03-27T19:55:09.496 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.205675.log: gzip -5 --verbose -- 81.2% /var/log/ceph/ceph-client.admin.246468.log 2024-03-27T19:55:09.496 INFO:teuthology.orchestra.run.smithi057.stderr: -- replaced with /var/log/ceph/ceph-client.admin.504309.log.gz 2024-03-27T19:55:09.497 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.167660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.278581.log 2024-03-27T19:55:09.498 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.246468.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.418853.log.gz 2024-03-27T19:55:09.498 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.412070.log 2024-03-27T19:55:09.499 INFO:teuthology.orchestra.run.smithi057.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.420120.log.gz 2024-03-27T19:55:09.499 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.278581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.364592.log 2024-03-27T19:55:09.500 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.412070.log: 78.4% -- replaced with /var/log/ceph/ceph-client.admin.355651.log.gz 2024-03-27T19:55:09.501 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.346746.log 2024-03-27T19:55:09.501 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.345840.log.gz 2024-03-27T19:55:09.502 INFO:teuthology.orchestra.run.smithi057.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.395667.log.gz 2024-03-27T19:55:09.502 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.373892.log.gz 2024-03-27T19:55:09.502 INFO:teuthology.orchestra.run.smithi057.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.484653.log.gz 2024-03-27T19:55:09.503 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.364592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.254597.log 90.0% 2024-03-27T19:55:09.503 INFO:teuthology.orchestra.run.smithi057.stderr: -- replaced with /var/log/ceph/ceph-client.admin.484662.log.gz 2024-03-27T19:55:09.504 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.346746.log: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.485985.log.gz 2024-03-27T19:55:09.504 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.397466.log 2024-03-27T19:55:09.504 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.254597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50109.log 2024-03-27T19:55:09.505 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.397466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.221389.log 2024-03-27T19:55:09.506 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.50109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.496813.log 2024-03-27T19:55:09.507 INFO:teuthology.orchestra.run.smithi057.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.243882.log.gz 2024-03-27T19:55:09.507 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.221389.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.367244.log.gz 2024-03-27T19:55:09.508 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.248270.log 2024-03-27T19:55:09.509 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.496813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.261754.log 2024-03-27T19:55:09.510 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.248270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45235.log 2024-03-27T19:55:09.510 INFO:teuthology.orchestra.run.smithi057.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.274270.log.gz 2024-03-27T19:55:09.511 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.261754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148867.log 2024-03-27T19:55:09.512 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.289018.log 2024-03-27T19:55:09.513 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.148867.log: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.417118.log.gz 2024-03-27T19:55:09.513 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.467128.log 2024-03-27T19:55:09.514 INFO:teuthology.orchestra.run.smithi057.stderr: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.425229.log.gz 2024-03-27T19:55:09.514 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.289018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.540077.log 2024-03-27T19:55:09.516 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.467128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.456172.log 2024-03-27T19:55:09.516 INFO:teuthology.orchestra.run.smithi057.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.130335.log.gz 2024-03-27T19:55:09.517 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.540077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143570.log 2024-03-27T19:55:09.517 INFO:teuthology.orchestra.run.smithi057.stderr: 78.9% -- replaced with /var/log/ceph/ceph-client.admin.540077.log.gz 2024-03-27T19:55:09.518 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.456172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.252436.log 2024-03-27T19:55:09.518 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.364592.log.gz 2024-03-27T19:55:09.519 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.143570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49493.log 2024-03-27T19:55:09.520 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.252436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44062.log 2024-03-27T19:55:09.521 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.49493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.267275.log 2024-03-27T19:55:09.522 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.44062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.208388.log 2024-03-27T19:55:09.523 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.267275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.249562.log 2024-03-27T19:55:09.524 INFO:teuthology.orchestra.run.smithi057.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.457896.log.gz 2024-03-27T19:55:09.524 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.208388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.418392.log 2024-03-27T19:55:09.525 INFO:teuthology.orchestra.run.smithi057.stderr: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.134185.log.gz 2024-03-27T19:55:09.525 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.249562.log: 83.8% -- replaced with /var/log/ceph/ceph-client.admin.526287.log.gz 2024-03-27T19:55:09.526 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.404483.log 2024-03-27T19:55:09.526 INFO:teuthology.orchestra.run.smithi057.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44498.log.gz 2024-03-27T19:55:09.527 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.418392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.426507.log 2024-03-27T19:55:09.528 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.404483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.530258.log 2024-03-27T19:55:09.528 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.426507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.533858.log 2024-03-27T19:55:09.529 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.530258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.323164.log 2024-03-27T19:55:09.531 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.533858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.240456.log 2024-03-27T19:55:09.531 INFO:teuthology.orchestra.run.smithi057.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.530258.log.gz 2024-03-27T19:55:09.532 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.323164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.328240.log 2024-03-27T19:55:09.533 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.240456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.340753.log 2024-03-27T19:55:09.534 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.328240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.552036.log 2024-03-27T19:55:09.535 INFO:teuthology.orchestra.run.smithi057.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49493.log.gz 2024-03-27T19:55:09.538 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.340753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.522914.log 2024-03-27T19:55:09.538 INFO:teuthology.orchestra.run.smithi057.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.50109.log.gz 2024-03-27T19:55:09.539 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.552036.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50687.log.gz 2024-03-27T19:55:09.539 INFO:teuthology.orchestra.run.smithi057.stderr: 83.4% -- replaced with /var/log/ceph/ceph-client.admin.552036.log.gz 2024-03-27T19:55:09.539 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.422652.log.gz 2024-03-27T19:55:09.539 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192928.log 2024-03-27T19:55:09.539 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.522914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144892.log 2024-03-27T19:55:09.541 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.192928.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.423929.log.gz 2024-03-27T19:55:09.541 INFO:teuthology.orchestra.run.smithi057.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.123390.log.gz 2024-03-27T19:55:09.541 INFO:teuthology.orchestra.run.smithi057.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.456163.log.gz 2024-03-27T19:55:09.541 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.374377.log 2024-03-27T19:55:09.542 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.144892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.351845.log 2024-03-27T19:55:09.543 INFO:teuthology.orchestra.run.smithi057.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.460077.log.gz 2024-03-27T19:55:09.543 INFO:teuthology.orchestra.run.smithi057.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.460567.log.gz 2024-03-27T19:55:09.544 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.374377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.214507.log 2024-03-27T19:55:09.544 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.351845.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.148867.log.gz 2024-03-27T19:55:09.544 INFO:teuthology.orchestra.run.smithi057.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.418392.log.gz 2024-03-27T19:55:09.545 INFO:teuthology.orchestra.run.smithi057.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.328240.log.gz 2024-03-27T19:55:09.545 INFO:teuthology.orchestra.run.smithi057.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.205675.log.gz 2024-03-27T19:55:09.546 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.325277.log 2024-03-27T19:55:09.546 INFO:teuthology.orchestra.run.smithi057.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.233310.log.gz 2024-03-27T19:55:09.546 INFO:teuthology.orchestra.run.smithi057.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.229725.log.gz 2024-03-27T19:55:09.547 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.214507.log: 77.5% -- replaced with /var/log/ceph/ceph-client.admin.208388.log.gz 2024-03-27T19:55:09.547 INFO:teuthology.orchestra.run.smithi057.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.113865.log.gz 2024-03-27T19:55:09.548 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.242614.log 2024-03-27T19:55:09.548 INFO:teuthology.orchestra.run.smithi057.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.197299.log.gz 2024-03-27T19:55:09.548 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.323164.log.gz 2024-03-27T19:55:09.548 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.325277.log: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.186143.log.gz 2024-03-27T19:55:09.548 INFO:teuthology.orchestra.run.smithi057.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.246468.log.gz 2024-03-27T19:55:09.548 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.214507.log.gz 2024-03-27T19:55:09.549 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.362855.log 2024-03-27T19:55:09.549 INFO:teuthology.orchestra.run.smithi057.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.263872.log.gz 2024-03-27T19:55:09.550 INFO:teuthology.orchestra.run.smithi057.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.270461.log.gz 2024-03-27T19:55:09.550 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.242614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.478581.log 2024-03-27T19:55:09.551 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.362855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.479887.log 2024-03-27T19:55:09.552 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.478581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.530683.log 2024-03-27T19:55:09.553 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.479887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.548476.log 2024-03-27T19:55:09.554 INFO:teuthology.orchestra.run.smithi057.stderr: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.156033.log.gz 2024-03-27T19:55:09.555 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.530683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183581.log 2024-03-27T19:55:09.555 INFO:teuthology.orchestra.run.smithi057.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.530683.log.gz 2024-03-27T19:55:09.556 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.548476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.476653.log 2024-03-27T19:55:09.556 INFO:teuthology.orchestra.run.smithi057.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36902.log.gz 2024-03-27T19:55:09.557 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.183581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157335.log 2024-03-27T19:55:09.558 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.476653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53261.log 2024-03-27T19:55:09.559 INFO:teuthology.orchestra.run.smithi057.stderr:gzip/var/log/ceph/ceph-client.admin.157335.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.326981.log 2024-03-27T19:55:09.559 INFO:teuthology.orchestra.run.smithi057.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.548476.log.gz 2024-03-27T19:55:09.561 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.53261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.469836.log 2024-03-27T19:55:09.562 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.326981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140607.log 2024-03-27T19:55:09.562 INFO:teuthology.orchestra.run.smithi057.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.401912.log.gz 2024-03-27T19:55:09.563 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.469836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.398300.log 2024-03-27T19:55:09.564 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.140607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.470738.log 2024-03-27T19:55:09.565 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.398300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.416690.log 2024-03-27T19:55:09.566 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.470738.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.396102.log.gz 2024-03-27T19:55:09.566 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46779.log 2024-03-27T19:55:09.567 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.416690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.494679.log 2024-03-27T19:55:09.569 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.46779.log: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.396989.log.gz 2024-03-27T19:55:09.569 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.501352.log 2024-03-27T19:55:09.569 INFO:teuthology.orchestra.run.smithi057.stderr: 77.8% -- replaced with /var/log/ceph/ceph-client.admin.412070.log.gz 2024-03-27T19:55:09.570 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.494679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.357112.log 2024-03-27T19:55:09.571 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.501352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202564.log 2024-03-27T19:55:09.572 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.357112.log: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.326551.log.gz 2024-03-27T19:55:09.572 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.505187.log 2024-03-27T19:55:09.573 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.466701.log.gz 2024-03-27T19:55:09.574 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.202564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.342865.log 2024-03-27T19:55:09.575 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.505187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.538804.log 2024-03-27T19:55:09.576 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.342865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48462.log 2024-03-27T19:55:09.577 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.538804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.487289.log 2024-03-27T19:55:09.578 INFO:teuthology.orchestra.run.smithi057.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.278581.log.gz 2024-03-27T19:55:09.578 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.48462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.556925.log 2024-03-27T19:55:09.579 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.487289.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.394765.log.gz 2024-03-27T19:55:09.579 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.221842.log 2024-03-27T19:55:09.580 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.556925.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.538804.log.gz 2024-03-27T19:55:09.581 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159035.log 2024-03-27T19:55:09.581 INFO:teuthology.orchestra.run.smithi057.stderr: 77.9% -- replaced with /var/log/ceph/ceph-client.admin.556925.log.gz 2024-03-27T19:55:09.581 INFO:teuthology.orchestra.run.smithi057.stderr: 77.3% -- replaced with /var/log/ceph/ceph-client.admin.499420.log.gz 2024-03-27T19:55:09.582 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.221842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.397887.log 2024-03-27T19:55:09.583 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.159035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164453.log 2024-03-27T19:55:09.584 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.397887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.544914.log 2024-03-27T19:55:09.585 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.164453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.403640.log 2024-03-27T19:55:09.587 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.544914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.546256.log 2024-03-27T19:55:09.587 INFO:teuthology.orchestra.run.smithi057.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.544914.log.gz 2024-03-27T19:55:09.588 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.403640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.217449.log 2024-03-27T19:55:09.589 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.546256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.394328.log 2024-03-27T19:55:09.591 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.217449.log: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.342436.log.gz 2024-03-27T19:55:09.591 INFO:teuthology.orchestra.run.smithi057.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.342856.log.gz 2024-03-27T19:55:09.591 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.208847.log 2024-03-27T19:55:09.592 INFO:teuthology.orchestra.run.smithi057.stderr: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.373393.log.gz 2024-03-27T19:55:09.592 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.394328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.428205.log 2024-03-27T19:55:09.592 INFO:teuthology.orchestra.run.smithi057.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.485564.log.gz 2024-03-27T19:55:09.593 INFO:teuthology.orchestra.run.smithi057.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51972.log.gz 2024-03-27T19:55:09.593 INFO:teuthology.orchestra.run.smithi057.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.546256.log.gz 2024-03-27T19:55:09.593 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.208847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.249114.log 2024-03-27T19:55:09.594 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.428205.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.555139.log 2024-03-27T19:55:09.595 INFO:teuthology.orchestra.run.smithi057.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.489470.log.gz 2024-03-27T19:55:09.596 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.249114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224397.log 2024-03-27T19:55:09.597 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.555139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43889.log 2024-03-27T19:55:09.598 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.224397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50603.log 2024-03-27T19:55:09.598 INFO:teuthology.orchestra.run.smithi057.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.267275.log.gz 2024-03-27T19:55:09.599 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.43889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.553844.log 2024-03-27T19:55:09.600 INFO:teuthology.orchestra.run.smithi057.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.363706.log.gz 2024-03-27T19:55:09.600 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.50603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121812.log 2024-03-27T19:55:09.602 INFO:teuthology.orchestra.run.smithi057.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.555139.log.gz 2024-03-27T19:55:09.602 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.553844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123812.log 2024-03-27T19:55:09.602 INFO:teuthology.orchestra.run.smithi057.stderr: 78.6% -- replaced with /var/log/ceph/ceph-client.admin.553844.log.gz 2024-03-27T19:55:09.603 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.121812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.350132.log 2024-03-27T19:55:09.603 INFO:teuthology.orchestra.run.smithi057.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.524179.log.gz 2024-03-27T19:55:09.604 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.123812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.287311.log 2024-03-27T19:55:09.605 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.350132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.500409.log 2024-03-27T19:55:09.606 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.287311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.271303.log 2024-03-27T19:55:09.608 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.500409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43344.log 2024-03-27T19:55:09.608 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.271303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.474193.log 2024-03-27T19:55:09.610 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.43344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189808.log 2024-03-27T19:55:09.611 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.474193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.468933.log 2024-03-27T19:55:09.612 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.189808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.419278.log 2024-03-27T19:55:09.613 INFO:teuthology.orchestra.run.smithi057.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.325277.log.gz 2024-03-27T19:55:09.613 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.468933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48294.log 2024-03-27T19:55:09.614 INFO:teuthology.orchestra.run.smithi057.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.325286.log.gz 2024-03-27T19:55:09.614 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.419278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148858.log 2024-03-27T19:55:09.616 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.48294.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-03-27T19:55:09.617 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.148858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.492936.log 2024-03-27T19:55:09.618 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37270.log 2024-03-27T19:55:09.619 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.492936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138074.log 2024-03-27T19:55:09.620 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.37270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144432.log 2024-03-27T19:55:09.621 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.138074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.556513.log 2024-03-27T19:55:09.623 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.144432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.499000.log 2024-03-27T19:55:09.624 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.556513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.459190.log 2024-03-27T19:55:09.625 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.499000.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.556513.log.gz 2024-03-27T19:55:09.625 INFO:teuthology.orchestra.run.smithi057.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.42964.log.gz 2024-03-27T19:55:09.626 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.500848.log 2024-03-27T19:55:09.626 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.459190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.470267.log 2024-03-27T19:55:09.627 INFO:teuthology.orchestra.run.smithi057.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.365848.log.gz 2024-03-27T19:55:09.628 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.500848.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.522914.log.gz 2024-03-27T19:55:09.629 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.470267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.411019.log 2024-03-27T19:55:09.629 INFO:teuthology.orchestra.run.smithi057.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.526296.log.gz 2024-03-27T19:55:09.630 INFO:teuthology.orchestra.run.smithi057.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48462.log.gz 2024-03-27T19:55:09.631 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234699.log 2024-03-27T19:55:09.632 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.411019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188454.log 2024-03-27T19:55:09.633 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.234699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.430345.log 2024-03-27T19:55:09.635 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.188454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.326972.log 2024-03-27T19:55:09.635 INFO:teuthology.orchestra.run.smithi057.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45861.log.gz 2024-03-27T19:55:09.635 INFO:teuthology.orchestra.run.smithi057.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49719.log.gz 2024-03-27T19:55:09.636 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.430345.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50067.log.gz 2024-03-27T19:55:09.636 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224818.log 2024-03-27T19:55:09.637 INFO:teuthology.orchestra.run.smithi057.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50603.log.gz 2024-03-27T19:55:09.637 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.326972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.235619.log 2024-03-27T19:55:09.638 INFO:teuthology.orchestra.run.smithi057.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50787.log.gz 2024-03-27T19:55:09.640 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.224818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.325704.log 2024-03-27T19:55:09.640 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.235619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187453.log 2024-03-27T19:55:09.641 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.325704.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.487289.log.gz 2024-03-27T19:55:09.642 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.326134.log 2024-03-27T19:55:09.642 INFO:teuthology.orchestra.run.smithi057.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.123812.log.gz 2024-03-27T19:55:09.642 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.187453.log: 94.0% -- replaced with /var/log/ceph/ceph-client.admin.221389.log.gz 2024-03-27T19:55:09.643 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.338614.log 2024-03-27T19:55:09.644 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.326134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.417553.log 2024-03-27T19:55:09.646 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.338614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.485573.log 2024-03-27T19:55:09.648 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.417553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45841.log 2024-03-27T19:55:09.648 INFO:teuthology.orchestra.run.smithi057.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.219592.log.gz 2024-03-27T19:55:09.648 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.223976.log.gz 2024-03-27T19:55:09.649 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.485573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.334713.log 2024-03-27T19:55:09.650 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146681.log 2024-03-27T19:55:09.652 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.334713.log: /var/log/ceph/ceph-client.admin.146681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.236152.log 2024-03-27T19:55:09.653 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.324003.log 2024-03-27T19:55:09.654 INFO:teuthology.orchestra.run.smithi057.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.51384.log.gz 2024-03-27T19:55:09.654 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.236152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.558541.log 2024-03-27T19:55:09.655 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.324003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48714.log 2024-03-27T19:55:09.657 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.558541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132087.log 2024-03-27T19:55:09.657 INFO:teuthology.orchestra.run.smithi057.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.558541.log.gz 2024-03-27T19:55:09.658 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.48714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.489014.log 2024-03-27T19:55:09.658 INFO:teuthology.orchestra.run.smithi057.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.221842.log.gz 2024-03-27T19:55:09.659 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.132087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.230140.log 2024-03-27T19:55:09.661 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.489014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136384.log 2024-03-27T19:55:09.662 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.230140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.237450.log 2024-03-27T19:55:09.662 INFO:teuthology.orchestra.run.smithi057.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.242614.log.gz 2024-03-27T19:55:09.663 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.136384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.462397.log 2024-03-27T19:55:09.664 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.237450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.410592.log 2024-03-27T19:55:09.665 INFO:teuthology.orchestra.run.smithi057.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.183581.log.gz 2024-03-27T19:55:09.665 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.462397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166092.log 2024-03-27T19:55:09.666 INFO:teuthology.orchestra.run.smithi057.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.184442.log.gz 2024-03-27T19:55:09.667 INFO:teuthology.orchestra.run.smithi057.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.188454.log.gz 2024-03-27T19:55:09.667 INFO:teuthology.orchestra.run.smithi057.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.213235.log.gz 2024-03-27T19:55:09.667 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.410592.log: 77.8% -- replaced with /var/log/ceph/ceph-client.admin.271303.log.gz 2024-03-27T19:55:09.667 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45233.log 2024-03-27T19:55:09.668 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.166092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.529823.log 2024-03-27T19:55:09.669 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.273830.log 2024-03-27T19:55:09.670 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.529823.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.529823.log.gz 2024-03-27T19:55:09.670 INFO:teuthology.orchestra.run.smithi057.stderr:gzip 90.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.413670.log.gz --verbose 2024-03-27T19:55:09.670 INFO:teuthology.orchestra.run.smithi057.stderr: -- /var/log/ceph/ceph-client.admin.266006.log 2024-03-27T19:55:09.671 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.273830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53742.log 2024-03-27T19:55:09.673 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.266006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.495959.log 2024-03-27T19:55:09.674 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.0.53742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.47954.log 2024-03-27T19:55:09.675 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.495959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.242193.log 2024-03-27T19:55:09.676 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.2.47954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.203874.log 2024-03-27T19:55:09.678 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.242193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.324864.log 2024-03-27T19:55:09.678 INFO:teuthology.orchestra.run.smithi057.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.217449.log.gz 2024-03-27T19:55:09.679 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.203874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50997.log 2024-03-27T19:55:09.680 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.324864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.537443.log 2024-03-27T19:55:09.681 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.50997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.358082.log 2024-03-27T19:55:09.683 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.537443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.356137.log 2024-03-27T19:55:09.683 INFO:teuthology.orchestra.run.smithi057.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.537443.log.gz 2024-03-27T19:55:09.684 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.358082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.365427.log 2024-03-27T19:55:09.684 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.476653.log.gz 2024-03-27T19:55:09.685 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.356137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.374835.log 2024-03-27T19:55:09.687 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.365427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.265154.log 2024-03-27T19:55:09.687 INFO:teuthology.orchestra.run.smithi057.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.362855.log.gz 2024-03-27T19:55:09.688 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.374835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.498131.log 2024-03-27T19:55:09.689 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.265154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48058.log 2024-03-27T19:55:09.690 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.498131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.469845.log 2024-03-27T19:55:09.693 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.48058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49314.log 2024-03-27T19:55:09.693 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.469845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200338.log 2024-03-27T19:55:09.694 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.49314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.538366.log 2024-03-27T19:55:09.695 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.200338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.219583.log 2024-03-27T19:55:09.697 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.538366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.231835.log 2024-03-27T19:55:09.697 INFO:teuthology.orchestra.run.smithi057.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.325704.log.gz 2024-03-27T19:55:09.697 INFO:teuthology.orchestra.run.smithi057.stderr: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.538366.log.gz 2024-03-27T19:55:09.698 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.219583.log: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.326972.log.gz 2024-03-27T19:55:09.699 INFO:teuthology.orchestra.run.smithi057.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.326134.log.gz 2024-03-27T19:55:09.699 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.370437.log 2024-03-27T19:55:09.699 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.231835.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.326981.log.gz 2024-03-27T19:55:09.699 INFO:teuthology.orchestra.run.smithi057.stderr: 78.1% -- replaced with /var/log/ceph/ceph-client.admin.369481.log.gz 2024-03-27T19:55:09.700 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.422643.log 2024-03-27T19:55:09.700 INFO:teuthology.orchestra.run.smithi057.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.500848.log.gz 2024-03-27T19:55:09.701 INFO:teuthology.orchestra.run.smithi057.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.468933.log.gz 2024-03-27T19:55:09.701 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.370437.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.235619.log.gz 2024-03-27T19:55:09.702 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50913.log 2024-03-27T19:55:09.702 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.422643.log: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.358082.log.gz 2024-03-27T19:55:09.702 INFO:teuthology.orchestra.run.smithi057.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.394328.log.gz 2024-03-27T19:55:09.703 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151120.log 2024-03-27T19:55:09.703 INFO:teuthology.orchestra.run.smithi057.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.430345.log.gz 2024-03-27T19:55:09.703 INFO:teuthology.orchestra.run.smithi057.stderr: 83.5% -- replaced with /var/log/ceph/ceph-client.admin.356137.log.gz 2024-03-27T19:55:09.704 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.50913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184433.log 2024-03-27T19:55:09.704 INFO:teuthology.orchestra.run.smithi057.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.356146.log.gz 2024-03-27T19:55:09.704 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.151120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47369.log 2024-03-27T19:55:09.706 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.184433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150248.log 2024-03-27T19:55:09.707 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.0.47369.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.546247.log 2024-03-27T19:55:09.710 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.150248.log: /var/log/ceph/ceph-client.admin.546247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.285019.log 2024-03-27T19:55:09.710 INFO:teuthology.orchestra.run.smithi057.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.546247.log.gz 2024-03-27T19:55:09.711 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.287738.log 2024-03-27T19:55:09.712 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.285019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.436249.log 2024-03-27T19:55:09.714 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.287738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48546.log 2024-03-27T19:55:09.714 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.436249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.519116.log 2024-03-27T19:55:09.716 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.48546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.473761.log 2024-03-27T19:55:09.717 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.519116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186574.log 2024-03-27T19:55:09.719 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.473761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.485149.log 2024-03-27T19:55:09.720 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.186574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.486850.log 2024-03-27T19:55:09.721 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.485149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.445562.log 2024-03-27T19:55:09.722 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.486850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.559212.log 2024-03-27T19:55:09.723 INFO:teuthology.orchestra.run.smithi057.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.499000.log.gz 2024-03-27T19:55:09.726 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.445562.log: /var/log/ceph/ceph-client.admin.559212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.397457.log 2024-03-27T19:55:09.726 INFO:teuthology.orchestra.run.smithi057.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.559212.log.gz 2024-03-27T19:55:09.726 INFO:teuthology.orchestra.run.smithi057.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.191604.log.gz 2024-03-27T19:55:09.726 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.551121.log 2024-03-27T19:55:09.727 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.397457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50277.log 2024-03-27T19:55:09.729 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.551121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.411010.log 2024-03-27T19:55:09.729 INFO:teuthology.orchestra.run.smithi057.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.551121.log.gz 2024-03-27T19:55:09.730 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.50277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.223136.log 2024-03-27T19:55:09.731 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.411010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.257848.log 2024-03-27T19:55:09.733 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.249105.log 2024-03-27T19:55:09.734 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.223136.log: /var/log/ceph/ceph-client.admin.257848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.216191.log 2024-03-27T19:55:09.735 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.249105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.532464.log 2024-03-27T19:55:09.736 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.216191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.519546.log 2024-03-27T19:55:09.737 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.532464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44146.log 2024-03-27T19:55:09.739 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.519546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.411797.log 2024-03-27T19:55:09.739 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.44146.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.532464.log.gz 2024-03-27T19:55:09.740 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.252445.log 2024-03-27T19:55:09.741 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.411797.log: 96.5% -- replaced with /var/log/ceph/ceph-client.admin.533400.log.gz 2024-03-27T19:55:09.741 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.478155.log 2024-03-27T19:55:09.742 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.132087.log.gz 2024-03-27T19:55:09.742 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.252445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143154.log 2024-03-27T19:55:09.743 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.478155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50561.log 2024-03-27T19:55:09.745 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.143154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245152.log 2024-03-27T19:55:09.745 INFO:teuthology.orchestra.run.smithi057.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48714.log.gz 2024-03-27T19:55:09.746 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.50561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.368148.log 2024-03-27T19:55:09.746 INFO:teuthology.orchestra.run.smithi057.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.233797.log.gz 2024-03-27T19:55:09.747 INFO:teuthology.orchestra.run.smithi057.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.202564.log.gz 2024-03-27T19:55:09.747 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.245152.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.45232.log.gz 2024-03-27T19:55:09.748 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192474.log 2024-03-27T19:55:09.749 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.368148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.544470.log 2024-03-27T19:55:09.750 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.192474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.460576.log 2024-03-27T19:55:09.751 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.544470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.372392.log 2024-03-27T19:55:09.752 INFO:teuthology.orchestra.run.smithi057.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.50561.log.gz 2024-03-27T19:55:09.753 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.460576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.212814.log 2024-03-27T19:55:09.753 INFO:teuthology.orchestra.run.smithi057.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.422643.log.gz 2024-03-27T19:55:09.754 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.372392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.559170.log 2024-03-27T19:55:09.755 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.212814.log: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.473761.log.gz 2024-03-27T19:55:09.755 INFO:teuthology.orchestra.run.smithi057.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.544470.log.gz 2024-03-27T19:55:09.756 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159470.log 2024-03-27T19:55:09.757 INFO:teuthology.orchestra.run.smithi057.stderr: 89.8% 89.8% -- replaced with /var/log/ceph/ceph-client.admin.150248.log.gz 2024-03-27T19:55:09.757 INFO:teuthology.orchestra.run.smithi057.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48058.log.gz 2024-03-27T19:55:09.757 INFO:teuthology.orchestra.run.smithi057.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.284572.log.gz 2024-03-27T19:55:09.757 INFO:teuthology.orchestra.run.smithi057.stderr: -- replaced with /var/log/ceph/ceph-client.admin.528434.log.gz 2024-03-27T19:55:09.758 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.559170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.276866.log 2024-03-27T19:55:09.758 INFO:teuthology.orchestra.run.smithi057.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.559170.log.gz 2024-03-27T19:55:09.758 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.159470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.358924.log 2024-03-27T19:55:09.759 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.276866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.394337.log 2024-03-27T19:55:09.761 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.358924.log: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.360657.log.gz 2024-03-27T19:55:09.761 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.501112.log 2024-03-27T19:55:09.762 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.394337.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.234690.log.gz 2024-03-27T19:55:09.762 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.260916.log 2024-03-27T19:55:09.763 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.501112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44230.log 2024-03-27T19:55:09.764 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.260916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168339.log 2024-03-27T19:55:09.765 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.44230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.461541.log 2024-03-27T19:55:09.767 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.168339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.397878.log 2024-03-27T19:55:09.768 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.461541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.497233.log 2024-03-27T19:55:09.769 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.397878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.225660.log 2024-03-27T19:55:09.770 INFO:teuthology.orchestra.run.smithi057.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51762.log.gz 2024-03-27T19:55:09.770 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.497233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.246477.log 2024-03-27T19:55:09.771 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.225660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.374368.log 2024-03-27T19:55:09.773 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.246477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222263.log 2024-03-27T19:55:09.774 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.374368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.556037.log 2024-03-27T19:55:09.775 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.222263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160406.log 2024-03-27T19:55:09.780 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.556037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.329944.log 2024-03-27T19:55:09.780 INFO:teuthology.orchestra.run.smithi057.stderr: 77.1% -- replaced with /var/log/ceph/ceph-client.admin.556037.log.gz 2024-03-27T19:55:09.780 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.160406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.255009.log 2024-03-27T19:55:09.780 INFO:teuthology.orchestra.run.smithi057.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.143154.log.gz 2024-03-27T19:55:09.781 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.329944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.329514.log 2024-03-27T19:55:09.782 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.255009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.558875.log 2024-03-27T19:55:09.782 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.329514.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.445151.log 2024-03-27T19:55:09.782 INFO:teuthology.orchestra.run.smithi057.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.185291.log.gz 2024-03-27T19:55:09.782 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.558875.log: 88.9%gzip -- replaced with /var/log/ceph/ceph-client.admin.558875.log.gz 2024-03-27T19:55:09.783 INFO:teuthology.orchestra.run.smithi057.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.204783.log 2024-03-27T19:55:09.784 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44930.log 2024-03-27T19:55:09.784 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.231835.log.gz 2024-03-27T19:55:09.785 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.445151.log: /var/log/ceph/ceph-client.admin.204783.log: 81.4% 90.0% -- replaced with /var/log/ceph/ceph-client.admin.224818.log.gz -- replaced with /var/log/ceph/ceph-client.admin.237450.log.gz 2024-03-27T19:55:09.785 INFO:teuthology.orchestra.run.smithi057.stderr: 2024-03-27T19:55:09.785 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116312.log 2024-03-27T19:55:09.786 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.44930.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.242193.log.gz 2024-03-27T19:55:09.786 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.557358.log 2024-03-27T19:55:09.787 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.116312.log: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.212814.log.gz 2024-03-27T19:55:09.788 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.401477.log 2024-03-27T19:55:09.788 INFO:teuthology.orchestra.run.smithi057.stderr: 96.5% -- replaced with /var/log/ceph/ceph-client.admin.533858.log.gz 2024-03-27T19:55:09.788 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.557358.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.219583.log.gz 2024-03-27T19:55:09.789 INFO:teuthology.orchestra.run.smithi057.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.226684.log.gz 2024-03-27T19:55:09.789 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.364163.log 2024-03-27T19:55:09.790 INFO:teuthology.orchestra.run.smithi057.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.557358.log.gz 2024-03-27T19:55:09.790 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.401477.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.272575.log.gz 2024-03-27T19:55:09.791 INFO:teuthology.orchestra.run.smithi057.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.273830.log.gz 2024-03-27T19:55:09.791 INFO:teuthology.orchestra.run.smithi057.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.332476.log.gz 2024-03-27T19:55:09.791 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.541406.log 2024-03-27T19:55:09.791 INFO:teuthology.orchestra.run.smithi057.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.477065.log.gz 2024-03-27T19:55:09.791 INFO:teuthology.orchestra.run.smithi057.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.244728.log.gz 2024-03-27T19:55:09.792 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.364163.log: 79.7% -- replaced with /var/log/ceph/ceph-client.admin.339068.log.gz 2024-03-27T19:55:09.793 INFO:teuthology.orchestra.run.smithi057.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.525022.log.gz 2024-03-27T19:55:09.793 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.231826.log 2024-03-27T19:55:09.793 INFO:teuthology.orchestra.run.smithi057.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.519546.log.gz 2024-03-27T19:55:09.794 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.541406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137236.log 2024-03-27T19:55:09.794 INFO:teuthology.orchestra.run.smithi057.stderr: 78.0% -- replaced with /var/log/ceph/ceph-client.admin.541406.log.gz 2024-03-27T19:55:09.794 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.231826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.395241.log 2024-03-27T19:55:09.796 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.137236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.344550.log 2024-03-27T19:55:09.796 INFO:teuthology.orchestra.run.smithi057.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.223136.log.gz 2024-03-27T19:55:09.797 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.395241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.492087.log 2024-03-27T19:55:09.798 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.344550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.426091.log 2024-03-27T19:55:09.799 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.492087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.361078.log 2024-03-27T19:55:09.800 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194830.log 2024-03-27T19:55:09.801 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.426091.log: /var/log/ceph/ceph-client.admin.361078.log: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.240869.log.gz 2024-03-27T19:55:09.801 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141028.log 2024-03-27T19:55:09.802 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.194830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50319.log 2024-03-27T19:55:09.803 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.276421.log 2024-03-27T19:55:09.804 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.141028.log: /var/log/ceph/ceph-client.admin.50319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46275.log 2024-03-27T19:55:09.805 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.276421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.548911.log 2024-03-27T19:55:09.807 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.46275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.348446.log 2024-03-27T19:55:09.807 INFO:teuthology.orchestra.run.smithi057.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.503043.log.gz 2024-03-27T19:55:09.807 INFO:teuthology.orchestra.run.smithi057.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.358924.log.gz 2024-03-27T19:55:09.808 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.548911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155184.log 2024-03-27T19:55:09.808 INFO:teuthology.orchestra.run.smithi057.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.548911.log.gz 2024-03-27T19:55:09.809 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.348446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159939.log 2024-03-27T19:55:09.810 INFO:teuthology.orchestra.run.smithi057.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.394337.log.gz 2024-03-27T19:55:09.810 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.155184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253317.log 2024-03-27T19:55:09.812 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.159939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47526.log 2024-03-27T19:55:09.813 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.253317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.214077.log 2024-03-27T19:55:09.813 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.47526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.445571.log 2024-03-27T19:55:09.814 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.214077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.441058.log 2024-03-27T19:55:09.815 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.445571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.350986.log 2024-03-27T19:55:09.816 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.441058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.498122.log 2024-03-27T19:55:09.816 INFO:teuthology.orchestra.run.smithi057.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.402338.log.gz 2024-03-27T19:55:09.817 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.350986.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.402791.log.gz 2024-03-27T19:55:09.818 INFO:teuthology.orchestra.run.smithi057.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.403631.log.gz 2024-03-27T19:55:09.818 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.403212.log.gz 2024-03-27T19:55:09.818 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.337360.log 2024-03-27T19:55:09.818 INFO:teuthology.orchestra.run.smithi057.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.405378.log.gz 2024-03-27T19:55:09.819 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.498122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.218726.log 2024-03-27T19:55:09.819 INFO:teuthology.orchestra.run.smithi057.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.407876.log.gz 2024-03-27T19:55:09.820 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.337360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45056.log 2024-03-27T19:55:09.820 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.218726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122047.log 2024-03-27T19:55:09.821 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.429057.log 2024-03-27T19:55:09.822 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.122047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122905.log 2024-03-27T19:55:09.824 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.429057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135539.log 2024-03-27T19:55:09.824 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.122905.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.248270.log.gz 2024-03-27T19:55:09.825 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188463.log 2024-03-27T19:55:09.825 INFO:teuthology.orchestra.run.smithi057.stderr: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.458317.log.gz 2024-03-27T19:55:09.826 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.135539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.441934.log 2024-03-27T19:55:09.827 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.188463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.402782.log 2024-03-27T19:55:09.828 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.441934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.212823.log 2024-03-27T19:55:09.829 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.402782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.347602.log 2024-03-27T19:55:09.830 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.212823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.211977.log 2024-03-27T19:55:09.831 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.347602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.365857.log 2024-03-27T19:55:09.832 INFO:teuthology.orchestra.run.smithi057.stderr:gzip/var/log/ceph/ceph-client.admin.211977.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.414522.log 2024-03-27T19:55:09.833 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.365857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.400636.log 2024-03-27T19:55:09.834 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.423938.log 2024-03-27T19:55:09.835 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.414522.log: /var/log/ceph/ceph-client.admin.400636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202105.log 2024-03-27T19:55:09.836 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.423938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.499009.log 2024-03-27T19:55:09.837 INFO:teuthology.orchestra.run.smithi057.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45906.log.gz 2024-03-27T19:55:09.838 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.202105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165572.log 2024-03-27T19:55:09.839 INFO:teuthology.orchestra.run.smithi057.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45909.log.gz 2024-03-27T19:55:09.839 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.499009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144423.log 2024-03-27T19:55:09.840 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.165572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113444.log 2024-03-27T19:55:09.841 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.144423.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46275.log.gz 2024-03-27T19:55:09.841 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.554707.log 2024-03-27T19:55:09.842 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.113444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.531104.log 2024-03-27T19:55:09.843 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.554707.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.554707.log.gz 2024-03-27T19:55:09.843 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.426933.log 2024-03-27T19:55:09.844 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.531104.log: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.531104.log.gz 2024-03-27T19:55:09.845 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.482777.log 2024-03-27T19:55:09.845 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.426933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.362426.log 2024-03-27T19:55:09.846 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.482777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.217881.log 2024-03-27T19:55:09.847 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.362426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150660.log 2024-03-27T19:55:09.848 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.217881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.498589.log 2024-03-27T19:55:09.849 INFO:teuthology.orchestra.run.smithi057.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.470738.log.gz 2024-03-27T19:55:09.850 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.150660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52056.log 2024-03-27T19:55:09.850 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.498589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124656.log 2024-03-27T19:55:09.852 INFO:teuthology.orchestra.run.smithi057.stderr: 77.8% -- replaced with /var/log/ceph/ceph-client.admin.472907.log.gz 2024-03-27T19:55:09.852 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.472010.log.gz 2024-03-27T19:55:09.852 INFO:teuthology.orchestra.run.smithi057.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.473328.log.gz 2024-03-27T19:55:09.852 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.52056.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.472431.log.gz 2024-03-27T19:55:09.852 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.359776.log 2024-03-27T19:55:09.853 INFO:teuthology.orchestra.run.smithi057.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.420111.log.gz 2024-03-27T19:55:09.853 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.124656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149714.log 2024-03-27T19:55:09.854 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.359776.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.423938.log.gz 2024-03-27T19:55:09.855 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.270891.log 2024-03-27T19:55:09.855 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.492508.log.gz 2024-03-27T19:55:09.855 INFO:teuthology.orchestra.run.smithi057.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.122905.log.gz 2024-03-27T19:55:09.856 INFO:teuthology.orchestra.run.smithi057.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.397878.log.gz 2024-03-27T19:55:09.856 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.149714.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.349720.log.gz 2024-03-27T19:55:09.856 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134611.log 2024-03-27T19:55:09.857 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.270891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128190.log 2024-03-27T19:55:09.859 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.134611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.236606.log 2024-03-27T19:55:09.859 INFO:teuthology.orchestra.run.smithi057.stderr: 77.8% -- replaced with /var/log/ceph/ceph-client.admin.505187.log.gz 2024-03-27T19:55:09.859 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.128190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52140.log 2024-03-27T19:55:09.861 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.236606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.241289.log 2024-03-27T19:55:09.862 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.52140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.257839.log 2024-03-27T19:55:09.863 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.241289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.495109.log 2024-03-27T19:55:09.866 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.257839.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.269619.log 2024-03-27T19:55:09.866 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.495109.log: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.337351.log.gz 2024-03-27T19:55:09.866 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132078.log 2024-03-27T19:55:09.867 INFO:teuthology.orchestra.run.smithi057.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.329944.log.gz 2024-03-27T19:55:09.867 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.337360.log.gz 2024-03-27T19:55:09.867 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.269619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.468512.log 2024-03-27T19:55:09.868 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.132078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129151.log 2024-03-27T19:55:09.869 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.468512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.216603.log 2024-03-27T19:55:09.869 INFO:teuthology.orchestra.run.smithi057.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.193869.log.gz 2024-03-27T19:55:09.870 INFO:teuthology.orchestra.run.smithi057.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.240447.log.gz 2024-03-27T19:55:09.870 INFO:teuthology.orchestra.run.smithi057.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.231826.log.gz 2024-03-27T19:55:09.871 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.129151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232722.log 2024-03-27T19:55:09.871 INFO:teuthology.orchestra.run.smithi057.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.326560.log.gz 2024-03-27T19:55:09.872 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.216603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.205223.log 2024-03-27T19:55:09.873 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.232722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.503466.log 2024-03-27T19:55:09.874 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.205223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51117.log 2024-03-27T19:55:09.876 INFO:teuthology.orchestra.run.smithi057.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.276412.log.gz 2024-03-27T19:55:09.876 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.503466.log: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.225230.log.gz 2024-03-27T19:55:09.876 INFO:teuthology.orchestra.run.smithi057.stderr:gzip 89.9% -- replaced with /var/log/ceph/ceph-client.admin.246055.log.gz 2024-03-27T19:55:09.876 INFO:teuthology.orchestra.run.smithi057.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.252890.log 2024-03-27T19:55:09.876 INFO:teuthology.orchestra.run.smithi057.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.263028.log.gz 2024-03-27T19:55:09.877 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.51117.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.270891.log.gz 2024-03-27T19:55:09.877 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114814.log 2024-03-27T19:55:09.878 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.252890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46653.log 2024-03-27T19:55:09.878 INFO:teuthology.orchestra.run.smithi057.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.362426.log.gz 2024-03-27T19:55:09.879 INFO:teuthology.orchestra.run.smithi057.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.253317.log.gz 2024-03-27T19:55:09.879 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.114814.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.362435.log.gz 2024-03-27T19:55:09.880 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.502210.log 2024-03-27T19:55:09.880 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.46653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.539238.log 2024-03-27T19:55:09.882 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.502210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.505196.log 2024-03-27T19:55:09.882 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.539238.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.215770.log.gz 2024-03-27T19:55:09.883 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186583.log 2024-03-27T19:55:09.883 INFO:teuthology.orchestra.run.smithi057.stderr: 78.2% -- replaced with /var/log/ceph/ceph-client.admin.490376.log.gz 2024-03-27T19:55:09.883 INFO:teuthology.orchestra.run.smithi057.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.539238.log.gz 2024-03-27T19:55:09.884 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.505196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185717.log 2024-03-27T19:55:09.885 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.186583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.347593.log 2024-03-27T19:55:09.887 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.185717.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-03-27T19:55:09.888 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.347593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49230.log 2024-03-27T19:55:09.889 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-osd.3.log: 77.8% -- replaced with /var/log/ceph/ceph-client.admin.265997.log.gz 2024-03-27T19:55:09.889 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.226086.log 2024-03-27T19:55:09.890 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.49230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247338.log 2024-03-27T19:55:09.891 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.226086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244305.log 2024-03-27T19:55:09.893 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.247338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.442779.log 2024-03-27T19:55:09.894 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.244305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.330783.log 2024-03-27T19:55:09.895 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.442779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115314.log 2024-03-27T19:55:09.896 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.330783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.231414.log 2024-03-27T19:55:09.897 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.115314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.509720.log 2024-03-27T19:55:09.897 INFO:teuthology.orchestra.run.smithi057.stderr: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.498122.log.gz 2024-03-27T19:55:09.897 INFO:teuthology.orchestra.run.smithi057.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.498580.log.gz 2024-03-27T19:55:09.898 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.231414.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.498589.log.gz 2024-03-27T19:55:09.898 INFO:teuthology.orchestra.run.smithi057.stderr: 77.4% -- replaced with /var/log/ceph/ceph-client.admin.402782.log.gz 2024-03-27T19:55:09.899 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.558017.log 2024-03-27T19:55:09.899 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.499009.log.gz 2024-03-27T19:55:09.900 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.509720.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.468512.log.gz 2024-03-27T19:55:09.900 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.544923.log 2024-03-27T19:55:09.900 INFO:teuthology.orchestra.run.smithi057.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.503466.log.gz 2024-03-27T19:55:09.901 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.558017.log: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.429923.log.gz 2024-03-27T19:55:09.901 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42488.log 2024-03-27T19:55:09.901 INFO:teuthology.orchestra.run.smithi057.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.350986.log.gz 2024-03-27T19:55:09.901 INFO:teuthology.orchestra.run.smithi057.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.558017.log.gz 2024-03-27T19:55:09.902 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.544923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.488601.log 2024-03-27T19:55:09.904 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.42488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.556934.log 2024-03-27T19:55:09.905 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.488601.log: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.544923.log.gz 2024-03-27T19:55:09.905 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49104.log 2024-03-27T19:55:09.906 INFO:teuthology.orchestra.run.smithi118.stderr: 94.2% -- replaced with /var/log/ceph/ceph.log.gz 2024-03-27T19:55:09.907 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.556934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.215349.log 2024-03-27T19:55:09.907 INFO:teuthology.orchestra.run.smithi057.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.556934.log.gz 2024-03-27T19:55:09.908 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.49104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.288159.log 2024-03-27T19:55:09.909 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.215349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143579.log 2024-03-27T19:55:09.910 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.288159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.545358.log 2024-03-27T19:55:09.911 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.143579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164462.log 2024-03-27T19:55:09.912 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.545358.log: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.545358.log.gz 2024-03-27T19:55:09.912 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.208838.log 2024-03-27T19:55:09.914 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.164462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138506.log 2024-03-27T19:55:09.915 INFO:teuthology.orchestra.run.smithi057.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44230.log.gz 2024-03-27T19:55:09.915 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.208838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.417974.log 2024-03-27T19:55:09.915 INFO:teuthology.orchestra.run.smithi057.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.366764.log.gz 2024-03-27T19:55:09.916 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.138506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200329.log 2024-03-27T19:55:09.916 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.417974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.492499.log 2024-03-27T19:55:09.917 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.200329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51804.log 2024-03-27T19:55:09.918 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.492499.log: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.134611.log.gz 2024-03-27T19:55:09.919 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.263450.log 2024-03-27T19:55:09.919 INFO:teuthology.orchestra.run.smithi057.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.273417.log.gz 2024-03-27T19:55:09.920 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.51804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141873.log 2024-03-27T19:55:09.921 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.263450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183155.log 2024-03-27T19:55:09.922 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.141873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.421384.log 2024-03-27T19:55:09.922 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.445151.log.gz 2024-03-27T19:55:09.922 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.183155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.534777.log 2024-03-27T19:55:09.923 INFO:teuthology.orchestra.run.smithi057.stderr: 77.3% -- replaced with /var/log/ceph/ceph-client.admin.522492.log.gz 2024-03-27T19:55:09.924 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.421384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.277288.log 2024-03-27T19:55:09.924 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.534777.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.245605.log.gz 2024-03-27T19:55:09.925 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.535665.log 2024-03-27T19:55:09.926 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.277288.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.534777.log.gz 2024-03-27T19:55:09.926 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147149.log 2024-03-27T19:55:09.927 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.535665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46949.log 2024-03-27T19:55:09.928 INFO:teuthology.orchestra.run.smithi057.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.535665.log.gz 2024-03-27T19:55:09.929 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.147149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160851.log 2024-03-27T19:55:09.930 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.46949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.207481.log 2024-03-27T19:55:09.931 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.160851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193381.log 2024-03-27T19:55:09.932 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.207481.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45237.log.gz 2024-03-27T19:55:09.933 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.549355.log 2024-03-27T19:55:09.933 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.193381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.407455.log 2024-03-27T19:55:09.934 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.549355.log: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.549355.log.gz 2024-03-27T19:55:09.935 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.366279.log 2024-03-27T19:55:09.936 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.407455.log: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.401047.log.gz 2024-03-27T19:55:09.936 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44846.log 2024-03-27T19:55:09.936 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.400636.log.gz 2024-03-27T19:55:09.937 INFO:teuthology.orchestra.run.smithi057.stderr: 79.6% -- replaced with /var/log/ceph/ceph-client.admin.409281.log.gz 2024-03-27T19:55:09.937 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.366279.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.401477.log.gz 2024-03-27T19:55:09.938 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.519969.log 2024-03-27T19:55:09.938 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.44846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42378.log 2024-03-27T19:55:09.940 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.519969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.207031.log 2024-03-27T19:55:09.941 INFO:teuthology.orchestra.run.smithi057.stderr:gzip/var/log/ceph/ceph-client.admin.42378.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.43260.log 2024-03-27T19:55:09.941 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.420962.log.gz 2024-03-27T19:55:09.941 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.421384.log.gz 2024-03-27T19:55:09.942 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.207031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.286009.log 2024-03-27T19:55:09.943 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.488601.log.gz 2024-03-27T19:55:09.943 INFO:teuthology.orchestra.run.smithi057.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.492499.log.gz 2024-03-27T19:55:09.944 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.43260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44636.log 2024-03-27T19:55:09.944 INFO:teuthology.orchestra.run.smithi057.stderr: 78.2% -- replaced with /var/log/ceph/ceph-client.admin.122047.log.gz 2024-03-27T19:55:09.945 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.286009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.400214.log 2024-03-27T19:55:09.945 INFO:teuthology.orchestra.run.smithi057.stderr: 78.5% -- replaced with /var/log/ceph/ceph-client.admin.128190.log.gz 2024-03-27T19:55:09.945 INFO:teuthology.orchestra.run.smithi057.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.122492.log.gz 2024-03-27T19:55:09.947 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.44636.log: 80.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.141873.log.gz 2024-03-27T19:55:09.947 INFO:teuthology.orchestra.run.smithi057.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.367235.log 2024-03-27T19:55:09.947 INFO:teuthology.orchestra.run.smithi057.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.130326.log.gz 2024-03-27T19:55:09.947 INFO:teuthology.orchestra.run.smithi057.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.138506.log.gz 2024-03-27T19:55:09.948 INFO:teuthology.orchestra.run.smithi118.stderr: 93.7% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-03-27T19:55:09.948 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.400214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.259208.log 2024-03-27T19:55:09.948 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.367235.log: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.208838.log.gz 2024-03-27T19:55:09.949 INFO:teuthology.orchestra.run.smithi057.stderr: 77.5% -- replaced with /var/log/ceph/ceph-client.admin.252890.log.gz 2024-03-27T19:55:09.949 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.207939.log 2024-03-27T19:55:09.951 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.259208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52098.log 2024-03-27T19:55:09.952 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.207939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145789.log 2024-03-27T19:55:09.953 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.52098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.351420.log 2024-03-27T19:55:09.954 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.145789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117188.log 2024-03-27T19:55:09.955 INFO:teuthology.orchestra.run.smithi057.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.205223.log.gz 2024-03-27T19:55:09.956 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.351420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.333338.log 2024-03-27T19:55:09.957 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.117188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122056.log 2024-03-27T19:55:09.957 INFO:teuthology.orchestra.run.smithi057.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.426091.log.gz 2024-03-27T19:55:09.958 INFO:teuthology.orchestra.run.smithi057.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.186583.log.gz 2024-03-27T19:55:09.959 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.333338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50445.log 2024-03-27T19:55:09.959 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.215349.log.gz 2024-03-27T19:55:09.959 INFO:teuthology.orchestra.run.smithi057.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.247338.log.gz 2024-03-27T19:55:09.960 INFO:teuthology.orchestra.run.smithi057.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.277288.log.gz 2024-03-27T19:55:09.960 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.122056.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.339501.log.gz 2024-03-27T19:55:09.960 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.488171.log 2024-03-27T19:55:09.961 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.50445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.559548.log 2024-03-27T19:55:09.962 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.488171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.332056.log 2024-03-27T19:55:09.963 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.559548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44678.log 2024-03-27T19:55:09.964 INFO:teuthology.orchestra.run.smithi057.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.559548.log.gz 2024-03-27T19:55:09.964 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.332056.log: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.255928.log.gz 2024-03-27T19:55:09.965 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.219157.log 2024-03-27T19:55:09.966 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.44678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.235141.log 2024-03-27T19:55:09.967 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.219157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157772.log 2024-03-27T19:55:09.967 INFO:teuthology.orchestra.run.smithi057.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.259208.log.gz 2024-03-27T19:55:09.968 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.468942.log 2024-03-27T19:55:09.969 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.235141.log: /var/log/ceph/ceph-client.admin.157772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.332905.log 2024-03-27T19:55:09.970 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.468942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.216182.log 2024-03-27T19:55:09.972 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.332905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.522501.log 2024-03-27T19:55:09.973 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.216182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48893.log 2024-03-27T19:55:09.974 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.522501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.266423.log 2024-03-27T19:55:09.974 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.340762.log.gz 2024-03-27T19:55:09.975 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.48893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49619.log 2024-03-27T19:55:09.976 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.266423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.522923.log 2024-03-27T19:55:09.977 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.49619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.538375.log 2024-03-27T19:55:09.978 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.522923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.395250.log 2024-03-27T19:55:09.979 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.538375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50955.log 2024-03-27T19:55:09.979 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.538375.log.gz 2024-03-27T19:55:09.980 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.395250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184011.log 2024-03-27T19:55:09.981 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.50955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.440623.log 2024-03-27T19:55:09.982 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.184011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.559673.log 2024-03-27T19:55:09.983 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.440623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.259217.log 2024-03-27T19:55:09.984 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.559673.log: gzip -5 --verbose -- 89.5% /var/log/ceph/ceph-client.admin.333329.log -- replaced with /var/log/ceph/ceph-client.admin.559673.log.gz 2024-03-27T19:55:09.984 INFO:teuthology.orchestra.run.smithi057.stderr: 2024-03-27T19:55:09.985 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.259217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.271724.log 2024-03-27T19:55:09.986 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.333329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124234.log 2024-03-27T19:55:09.987 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.271724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.419269.log 2024-03-27T19:55:09.988 INFO:teuthology.orchestra.run.smithi057.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.370437.log.gz 2024-03-27T19:55:09.988 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.124234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52912.log 2024-03-27T19:55:09.989 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.419269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.529309.log 2024-03-27T19:55:09.990 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.52912.log: 79.4% -- replaced with /var/log/ceph/ceph-client.admin.407455.log.gz 2024-03-27T19:55:09.991 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.559591.log 2024-03-27T19:55:09.992 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.529309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.411788.log 2024-03-27T19:55:09.993 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.559591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.339492.log 2024-03-27T19:55:09.994 INFO:teuthology.orchestra.run.smithi057.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.559591.log.gz 2024-03-27T19:55:09.994 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.411788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.537706.log 2024-03-27T19:55:09.995 INFO:teuthology.orchestra.run.smithi057.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.524600.log.gz 2024-03-27T19:55:09.996 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.339492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.494258.log 2024-03-27T19:55:09.997 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.537706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.396556.log 2024-03-27T19:55:09.998 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.494258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.468091.log 2024-03-27T19:55:09.999 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.396556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.267701.log 2024-03-27T19:55:10.000 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.468091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.207948.log 2024-03-27T19:55:10.002 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.267701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.470747.log 2024-03-27T19:55:10.003 INFO:teuthology.orchestra.run.smithi057.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.275961.log.gz 2024-03-27T19:55:10.003 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.207948.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.286009.log.gz 2024-03-27T19:55:10.003 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.275540.log 2024-03-27T19:55:10.004 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.470747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.524188.log 2024-03-27T19:55:10.004 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.351420.log.gz 2024-03-27T19:55:10.005 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.275540.log: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.396556.log.gz 2024-03-27T19:55:10.006 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.341604.log.gz 2024-03-27T19:55:10.006 INFO:teuthology.orchestra.run.smithi057.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.465428.log.gz 2024-03-27T19:55:10.006 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167651.log 2024-03-27T19:55:10.008 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.524188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.401921.log 2024-03-27T19:55:10.008 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.167651.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.495109.log.gz 2024-03-27T19:55:10.008 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.558959.log 2024-03-27T19:55:10.009 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.401921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.554716.log 2024-03-27T19:55:10.010 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.558959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168788.log 2024-03-27T19:55:10.011 INFO:teuthology.orchestra.run.smithi057.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.558959.log.gz 2024-03-27T19:55:10.012 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.554716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.531113.log 2024-03-27T19:55:10.012 INFO:teuthology.orchestra.run.smithi057.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.554716.log.gz 2024-03-27T19:55:10.012 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.168788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.206582.log 2024-03-27T19:55:10.014 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.531113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48936.log 2024-03-27T19:55:10.015 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.206582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.468100.log 2024-03-27T19:55:10.015 INFO:teuthology.orchestra.run.smithi057.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.144423.log.gz 2024-03-27T19:55:10.016 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.48936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.414513.log 2024-03-27T19:55:10.017 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.468100.log: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.531113.log.gz 2024-03-27T19:55:10.018 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.261763.log 2024-03-27T19:55:10.019 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.414513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.337772.log 2024-03-27T19:55:10.020 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.261763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.533391.log 2024-03-27T19:55:10.020 INFO:teuthology.orchestra.run.smithi057.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45562.log.gz 2024-03-27T19:55:10.021 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.337772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234248.log 2024-03-27T19:55:10.022 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.533391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.330365.log 2024-03-27T19:55:10.023 INFO:teuthology.orchestra.run.smithi057.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.533391.log.gz 2024-03-27T19:55:10.024 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.234248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.556504.log 2024-03-27T19:55:10.025 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.330365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.401468.log 2024-03-27T19:55:10.026 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.556504.log: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.556504.log.gz 2024-03-27T19:55:10.026 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.559044.log 2024-03-27T19:55:10.027 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.401468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45555.log 2024-03-27T19:55:10.028 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.559044.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.559044.log.gz 2024-03-27T19:55:10.029 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.411739.log 2024-03-27T19:55:10.029 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.431196.log.gz 2024-03-27T19:55:10.030 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53135.log 2024-03-27T19:55:10.031 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.411739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.441925.log 2024-03-27T19:55:10.032 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.53135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46191.log 2024-03-27T19:55:10.032 INFO:teuthology.orchestra.run.smithi057.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42378.log.gz 2024-03-27T19:55:10.033 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.441925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245596.log 2024-03-27T19:55:10.034 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.46191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.443647.log 2024-03-27T19:55:10.036 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.245596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52698.log 2024-03-27T19:55:10.037 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.443647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.444725.log 2024-03-27T19:55:10.038 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.52698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.522079.log 2024-03-27T19:55:10.039 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.444725.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.522501.log.gz 2024-03-27T19:55:10.040 INFO:teuthology.orchestra.run.smithi057.stderr:gzip 92.2% -5 -- replaced with /var/log/ceph/ceph-client.admin.130767.log.gz --verbose 2024-03-27T19:55:10.040 INFO:teuthology.orchestra.run.smithi057.stderr: -- /var/log/ceph/ceph-client.admin.114307.log 2024-03-27T19:55:10.041 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.522079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46527.log 2024-03-27T19:55:10.042 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.114307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.327393.log 2024-03-27T19:55:10.043 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.46527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191146.log 2024-03-27T19:55:10.045 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.327393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.420953.log 2024-03-27T19:55:10.046 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.191146.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45555.log.gz 2024-03-27T19:55:10.046 INFO:teuthology.orchestra.run.smithi057.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45565.log.gz 2024-03-27T19:55:10.046 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224388.log 2024-03-27T19:55:10.047 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.420953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.417127.log 2024-03-27T19:55:10.048 INFO:teuthology.orchestra.run.smithi057.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50445.log.gz 2024-03-27T19:55:10.048 INFO:teuthology.orchestra.run.smithi057.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.220491.log.gz 2024-03-27T19:55:10.048 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.224388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.402347.log 2024-03-27T19:55:10.050 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.417127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.246903.log 2024-03-27T19:55:10.050 INFO:teuthology.orchestra.run.smithi057.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.135539.log.gz 2024-03-27T19:55:10.052 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.402347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51552.log 2024-03-27T19:55:10.053 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.246903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132921.log 2024-03-27T19:55:10.053 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.51552.log: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.443647.log.gz 2024-03-27T19:55:10.054 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.354778.log 2024-03-27T19:55:10.054 INFO:teuthology.orchestra.run.smithi057.stderr: 78.2% -- replaced with /var/log/ceph/ceph-client.admin.401468.log.gz 2024-03-27T19:55:10.056 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.132921.log: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.411739.log.gz 2024-03-27T19:55:10.056 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.348024.log 2024-03-27T19:55:10.056 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.401921.log.gz 2024-03-27T19:55:10.056 INFO:teuthology.orchestra.run.smithi057.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.420953.log.gz 2024-03-27T19:55:10.057 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.354778.log: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.488171.log.gz 2024-03-27T19:55:10.057 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.525031.log 2024-03-27T19:55:10.058 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.348024.log: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.167651.log.gz 2024-03-27T19:55:10.059 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50193.log 2024-03-27T19:55:10.060 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.525031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222715.log 2024-03-27T19:55:10.061 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.50193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.443199.log 2024-03-27T19:55:10.062 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.222715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131218.log 2024-03-27T19:55:10.063 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.443199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.558227.log 2024-03-27T19:55:10.065 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.131218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.508509.log 2024-03-27T19:55:10.066 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.558227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.534311.log 2024-03-27T19:55:10.066 INFO:teuthology.orchestra.run.smithi057.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.558227.log.gz 2024-03-27T19:55:10.067 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.508509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166504.log 2024-03-27T19:55:10.068 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.442359.log.gz 2024-03-27T19:55:10.068 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.534311.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.124234.log.gz 2024-03-27T19:55:10.068 INFO:teuthology.orchestra.run.smithi057.stderr: 83.5% -- replaced with /var/log/ceph/ceph-client.admin.534311.log.gz 2024-03-27T19:55:10.069 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.264302.log 2024-03-27T19:55:10.070 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.166504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.544014.log 2024-03-27T19:55:10.071 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.264302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.269198.log 2024-03-27T19:55:10.072 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.544014.log: 77.8% -- replaced with /var/log/ceph/ceph-client.admin.544014.log.gz 2024-03-27T19:55:10.072 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50151.log 2024-03-27T19:55:10.072 INFO:teuthology.orchestra.run.smithi057.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.117695.log.gz 2024-03-27T19:55:10.073 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.269198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49887.log 2024-03-27T19:55:10.074 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.50151.log: gzip -5 --verbose -- 80.6% /var/log/ceph/ceph-client.admin.418844.log 2024-03-27T19:55:10.074 INFO:teuthology.orchestra.run.smithi057.stderr: -- replaced with /var/log/ceph/ceph-client.admin.128666.log.gz 2024-03-27T19:55:10.074 INFO:teuthology.orchestra.run.smithi057.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.146258.log.gz 2024-03-27T19:55:10.075 INFO:teuthology.orchestra.run.smithi057.stderr: 78.5% -- replaced with /var/log/ceph/ceph-client.admin.145789.log.gz 2024-03-27T19:55:10.075 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.49887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158201.log 2024-03-27T19:55:10.076 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.418844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.260055.log 2024-03-27T19:55:10.077 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.158201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.518683.log 2024-03-27T19:55:10.079 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.260055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.457475.log 2024-03-27T19:55:10.080 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.518683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.540508.log 2024-03-27T19:55:10.081 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.457475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121822.log 2024-03-27T19:55:10.082 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.540508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.539229.log 2024-03-27T19:55:10.084 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.121822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187894.log 2024-03-27T19:55:10.084 INFO:teuthology.orchestra.run.smithi057.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.339492.log.gz 2024-03-27T19:55:10.084 INFO:teuthology.orchestra.run.smithi057.stderr: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.193372.log.gz 2024-03-27T19:55:10.085 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.539229.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.417127.log.gz 2024-03-27T19:55:10.085 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144006.log 2024-03-27T19:55:10.085 INFO:teuthology.orchestra.run.smithi057.stderr: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.539229.log.gz 2024-03-27T19:55:10.086 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.187894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.342024.log 2024-03-27T19:55:10.086 INFO:teuthology.orchestra.run.smithi057.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.540508.log.gz 2024-03-27T19:55:10.087 INFO:teuthology.orchestra.run.smithi057.stderr: 78.4% -- replaced with /var/log/ceph/ceph-client.admin.187894.log.gz 2024-03-27T19:55:10.087 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.144006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.351411.log 2024-03-27T19:55:10.088 INFO:teuthology.orchestra.run.smithi057.stderr: 78.4% -- replaced with /var/log/ceph/ceph-client.admin.332056.log.gz 2024-03-27T19:55:10.089 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.342024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.268122.log 2024-03-27T19:55:10.089 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.261763.log.gz 2024-03-27T19:55:10.090 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.351411.log: 78.1% -- replaced with /var/log/ceph/ceph-client.admin.270882.log.gz 2024-03-27T19:55:10.090 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113453.log 2024-03-27T19:55:10.092 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.268122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.471159.log 2024-03-27T19:55:10.093 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.113453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112845.log 2024-03-27T19:55:10.094 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.471159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.463741.log 2024-03-27T19:55:10.095 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.112845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.429932.log 2024-03-27T19:55:10.097 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.463741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.489023.log 2024-03-27T19:55:10.098 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.429932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.411440.log 2024-03-27T19:55:10.099 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.489023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.406534.log 2024-03-27T19:55:10.100 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.411440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.518692.log 2024-03-27T19:55:10.101 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.406534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.356631.log 2024-03-27T19:55:10.102 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.518692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.419699.log 2024-03-27T19:55:10.103 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.356631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.462867.log 2024-03-27T19:55:10.104 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.419699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53005.log 2024-03-27T19:55:10.105 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.462867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.424817.log 2024-03-27T19:55:10.106 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.53005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.547144.log 2024-03-27T19:55:10.107 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.424817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.473337.log 2024-03-27T19:55:10.107 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.342024.log.gz 2024-03-27T19:55:10.108 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.547144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.428214.log 2024-03-27T19:55:10.108 INFO:teuthology.orchestra.run.smithi057.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.349711.log.gz 2024-03-27T19:55:10.109 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.473337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.467119.log 2024-03-27T19:55:10.111 INFO:teuthology.orchestra.run.smithi057.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.475183.log.gz 2024-03-27T19:55:10.111 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.428214.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.275540.log.gz 2024-03-27T19:55:10.111 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 92.2% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.547144.log.gz /var/log/ceph/ceph-client.admin.53051.log 2024-03-27T19:55:10.111 INFO:teuthology.orchestra.run.smithi057.stderr: 2024-03-27T19:55:10.112 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.467119.log: 89.9% 85.8% -- replaced with /var/log/ceph/ceph-client.admin.524188.log.gz 2024-03-27T19:55:10.112 INFO:teuthology.orchestra.run.smithi057.stderr: -- replaced with /var/log/ceph/ceph-client.admin.404902.log.gz 2024-03-27T19:55:10.113 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.410171.log 2024-03-27T19:55:10.114 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.53051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.439369.log 2024-03-27T19:55:10.115 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.410171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.329523.log 2024-03-27T19:55:10.116 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.499429.log.gz 2024-03-27T19:55:10.116 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.439369.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.258260.log 2024-03-27T19:55:10.117 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.348024.log.gz 2024-03-27T19:55:10.117 INFO:teuthology.orchestra.run.smithi057.stderr: 89.9%/var/log/ceph/ceph-client.admin.329523.log: -- replaced with /var/log/ceph/ceph-client.admin.424817.log.gz 2024-03-27T19:55:10.118 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.203004.log 2024-03-27T19:55:10.118 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.463741.log.gz 2024-03-27T19:55:10.119 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.258260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.515814.log 2024-03-27T19:55:10.120 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.203004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51468.log 2024-03-27T19:55:10.122 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.515814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.286898.log 2024-03-27T19:55:10.123 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.51468.log: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.493837.log.gz 2024-03-27T19:55:10.123 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44888.log 2024-03-27T19:55:10.124 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.286898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51342.log 2024-03-27T19:55:10.124 INFO:teuthology.orchestra.run.smithi057.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.495950.log.gz 2024-03-27T19:55:10.125 INFO:teuthology.orchestra.run.smithi057.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.495531.log.gz 2024-03-27T19:55:10.126 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.44888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.344138.log 2024-03-27T19:55:10.126 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.496813.log.gz 2024-03-27T19:55:10.126 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0%/var/log/ceph/ceph-client.admin.51342.log: -- replaced with /var/log/ceph/ceph-client.admin.330365.log.gz 2024-03-27T19:55:10.127 INFO:teuthology.orchestra.run.smithi057.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.351411.log.gz 2024-03-27T19:55:10.127 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43302.log 2024-03-27T19:55:10.127 INFO:teuthology.orchestra.run.smithi057.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.354778.log.gz 2024-03-27T19:55:10.128 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.344138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49845.log 2024-03-27T19:55:10.129 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.43302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.396565.log 2024-03-27T19:55:10.131 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.49845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.464581.log 2024-03-27T19:55:10.132 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.333338.log.gz 2024-03-27T19:55:10.132 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.396565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.257005.log 2024-03-27T19:55:10.133 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.464581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.475679.log 2024-03-27T19:55:10.135 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.257005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.496386.log 2024-03-27T19:55:10.136 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.475679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.227526.log 2024-03-27T19:55:10.137 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.496386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.528425.log 2024-03-27T19:55:10.139 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.227526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.400627.log 2024-03-27T19:55:10.140 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.528425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.354365.log 2024-03-27T19:55:10.141 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.400627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.558185.log 2024-03-27T19:55:10.142 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.354365.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-03-27T19:55:10.143 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.428214.log.gz 2024-03-27T19:55:10.144 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.558185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.558353.log 2024-03-27T19:55:10.144 INFO:teuthology.orchestra.run.smithi057.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.558185.log.gz 2024-03-27T19:55:10.145 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.336930.log 2024-03-27T19:55:10.146 INFO:teuthology.orchestra.run.smithi057.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52056.log.gz 2024-03-27T19:55:10.146 INFO:teuthology.orchestra.run.smithi057.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.52098.log.gz 2024-03-27T19:55:10.147 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.558353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128675.log 2024-03-27T19:55:10.147 INFO:teuthology.orchestra.run.smithi057.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.558353.log.gz 2024-03-27T19:55:10.148 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.463288.log 2024-03-27T19:55:10.149 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.336930.log: /var/log/ceph/ceph-client.admin.128675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.345831.log 2024-03-27T19:55:10.151 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.463288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.421806.log 2024-03-27T19:55:10.151 INFO:teuthology.orchestra.run.smithi057.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.132921.log.gz 2024-03-27T19:55:10.152 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.345831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151548.log 2024-03-27T19:55:10.153 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.421806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.558706.log 2024-03-27T19:55:10.154 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.151548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.466280.log 2024-03-27T19:55:10.155 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.558706.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.479423.log.gz 2024-03-27T19:55:10.156 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.527974.log 2024-03-27T19:55:10.156 INFO:teuthology.orchestra.run.smithi057.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.558706.log.gz 2024-03-27T19:55:10.156 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.478581.log.gz 2024-03-27T19:55:10.157 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.466280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.263459.log 2024-03-27T19:55:10.158 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.527974.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.522079.log.gz 2024-03-27T19:55:10.158 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.484231.log 2024-03-27T19:55:10.159 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.263459.log: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.486850.log.gz 2024-03-27T19:55:10.160 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.342015.log 2024-03-27T19:55:10.161 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.484231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.284135.log 2024-03-27T19:55:10.162 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.342015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52224.log 2024-03-27T19:55:10.163 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.284135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.519107.log 2024-03-27T19:55:10.165 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.52224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.332896.log 2024-03-27T19:55:10.166 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.519107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45571.log 2024-03-27T19:55:10.167 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.332896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.336417.log 2024-03-27T19:55:10.168 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45571.log: /var/log/ceph/ceph-client.admin.336417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48336.log 2024-03-27T19:55:10.169 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.354787.log 2024-03-27T19:55:10.170 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.48336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48378.log 2024-03-27T19:55:10.171 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.354787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49803.log 2024-03-27T19:55:10.172 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.48378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.430775.log 2024-03-27T19:55:10.174 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.49803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118194.log 2024-03-27T19:55:10.175 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.430775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.461962.log 2024-03-27T19:55:10.176 INFO:teuthology.orchestra.run.smithi057.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45235.log.gz 2024-03-27T19:55:10.176 INFO:teuthology.orchestra.run.smithi057.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45910.log.gz 2024-03-27T19:55:10.176 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.118194.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46233.log.gz 2024-03-27T19:55:10.176 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.444064.log 2024-03-27T19:55:10.177 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.461962.log: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.517051.log.gz 2024-03-27T19:55:10.178 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.472916.log 2024-03-27T19:55:10.179 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.444064.log: 87.5% 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49887.log.gz 89.2% -- replaced with /var/log/ceph/ceph-client.admin.49803.log.gz 2024-03-27T19:55:10.179 INFO:teuthology.orchestra.run.smithi057.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49845.log.gz 2024-03-27T19:55:10.179 INFO:teuthology.orchestra.run.smithi057.stderr: 2024-03-27T19:55:10.179 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140616.log 2024-03-27T19:55:10.180 INFO:teuthology.orchestra.run.smithi057.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52782.log.gz 2024-03-27T19:55:10.180 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.472916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45234.log 2024-03-27T19:55:10.181 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.140616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192465.log 2024-03-27T19:55:10.183 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.514562.log 2024-03-27T19:55:10.184 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.192465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.284144.log 2024-03-27T19:55:10.185 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.514562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201202.log 2024-03-27T19:55:10.186 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.284144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.480374.log 2024-03-27T19:55:10.187 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.201202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.429469.log 2024-03-27T19:55:10.189 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.480374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.270049.log 2024-03-27T19:55:10.190 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.429469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.255493.log 2024-03-27T19:55:10.191 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.270049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.444055.log 2024-03-27T19:55:10.192 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.255493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.347180.log 2024-03-27T19:55:10.193 INFO:teuthology.orchestra.run.smithi057.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.418844.log.gz 2024-03-27T19:55:10.193 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.444055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48978.log 2024-03-27T19:55:10.194 INFO:teuthology.orchestra.run.smithi057.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.488592.log.gz 2024-03-27T19:55:10.195 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.347180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.368620.log 2024-03-27T19:55:10.195 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.48978.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.144006.log.gz 2024-03-27T19:55:10.196 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.429478.log 2024-03-27T19:55:10.197 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.368620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43386.log 2024-03-27T19:55:10.198 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.429478.log: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.269198.log.gz 2024-03-27T19:55:10.198 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.288168.log 2024-03-27T19:55:10.199 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.43386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.414096.log 2024-03-27T19:55:10.201 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.288168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.227535.log 2024-03-27T19:55:10.202 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.414096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.237037.log 2024-03-27T19:55:10.203 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.227535.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.142307.log.gz 2024-03-27T19:55:10.203 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.262176.log 2024-03-27T19:55:10.204 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.237037.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.229296.log.gz 2024-03-27T19:55:10.204 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.544461.log 2024-03-27T19:55:10.205 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.410171.log.gz 2024-03-27T19:55:10.205 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.262176.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.329523.log.gz 2024-03-27T19:55:10.206 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.536533.log 2024-03-27T19:55:10.206 INFO:teuthology.orchestra.run.smithi057.stderr: 78.4% -- replaced with /var/log/ceph/ceph-client.admin.207022.log.gz 2024-03-27T19:55:10.207 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.544461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.406955.log 2024-03-27T19:55:10.207 INFO:teuthology.orchestra.run.smithi057.stderr: 77.2% -- replaced with /var/log/ceph/ceph-client.admin.544461.log.gz 2024-03-27T19:55:10.208 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.536533.log: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.194821.log.gz 2024-03-27T19:55:10.208 INFO:teuthology.orchestra.run.smithi057.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.258260.log.gz 2024-03-27T19:55:10.208 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187003.log 2024-03-27T19:55:10.209 INFO:teuthology.orchestra.run.smithi057.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.536533.log.gz 2024-03-27T19:55:10.209 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.406955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48252.log 2024-03-27T19:55:10.211 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.187003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.236615.log 2024-03-27T19:55:10.212 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.48252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.404061.log 2024-03-27T19:55:10.212 INFO:teuthology.orchestra.run.smithi057.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.259629.log.gz 2024-03-27T19:55:10.212 INFO:teuthology.orchestra.run.smithi057.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.261754.log.gz 2024-03-27T19:55:10.213 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.236615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.477695.log 2024-03-27T19:55:10.213 INFO:teuthology.orchestra.run.smithi057.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.262176.log.gz 2024-03-27T19:55:10.214 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.404061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184020.log 2024-03-27T19:55:10.215 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.477695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.256996.log 2024-03-27T19:55:10.216 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.184020.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.263459.log.gz 2024-03-27T19:55:10.217 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194296.log 2024-03-27T19:55:10.218 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.256996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.537939.log 2024-03-27T19:55:10.219 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.194296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53453.log 2024-03-27T19:55:10.220 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.537939.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.537939.log.gz 2024-03-27T19:55:10.220 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52614.log 2024-03-27T19:55:10.221 INFO:teuthology.orchestra.run.smithi057.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.404061.log.gz 2024-03-27T19:55:10.221 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.53453.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.444725.log.gz 2024-03-27T19:55:10.222 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.472001.log 2024-03-27T19:55:10.223 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.52614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.396998.log 2024-03-27T19:55:10.223 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.286476.log.gz 2024-03-27T19:55:10.224 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.472001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.440211.log 2024-03-27T19:55:10.225 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.396998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.483397.log 2024-03-27T19:55:10.227 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.440211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.468521.log 2024-03-27T19:55:10.227 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.466280.log.gz 2024-03-27T19:55:10.227 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.483397.log: 78.2% -- replaced with /var/log/ceph/ceph-client.admin.345831.log.gz 2024-03-27T19:55:10.228 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.559338.log 2024-03-27T19:55:10.229 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.347180.log.gz 2024-03-27T19:55:10.229 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.468521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156456.log 2024-03-27T19:55:10.231 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.559338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167927.log 2024-03-27T19:55:10.231 INFO:teuthology.orchestra.run.smithi057.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.559338.log.gz 2024-03-27T19:55:10.232 INFO:teuthology.orchestra.run.smithi057.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.354365.log.gz 2024-03-27T19:55:10.232 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.156456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.539660.log 2024-03-27T19:55:10.233 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.167927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49062.log 2024-03-27T19:55:10.235 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.539660.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.364163.log.gz 2024-03-27T19:55:10.235 INFO:teuthology.orchestra.run.smithi057.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.539660.log.gz 2024-03-27T19:55:10.235 INFO:teuthology.orchestra.run.smithi057.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.366279.log.gz 2024-03-27T19:55:10.236 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48849.log 2024-03-27T19:55:10.236 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.365014.log.gz 2024-03-27T19:55:10.237 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.49062.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.368148.log.gz 2024-03-27T19:55:10.237 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.230983.log 2024-03-27T19:55:10.237 INFO:teuthology.orchestra.run.smithi057.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.472001.log.gz 2024-03-27T19:55:10.238 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.48849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.275549.log 2024-03-27T19:55:10.238 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.472916.log.gz 2024-03-27T19:55:10.239 INFO:teuthology.orchestra.run.smithi057.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.477695.log.gz 2024-03-27T19:55:10.240 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.230983.log: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.483809.log.gz 2024-03-27T19:55:10.240 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.349297.log 2024-03-27T19:55:10.240 INFO:teuthology.orchestra.run.smithi057.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.483397.log.gz 2024-03-27T19:55:10.240 INFO:teuthology.orchestra.run.smithi057.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51552.log.gz 2024-03-27T19:55:10.240 INFO:teuthology.orchestra.run.smithi057.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52224.log.gz 2024-03-27T19:55:10.241 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.275549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.549798.log 2024-03-27T19:55:10.242 INFO:teuthology.orchestra.run.smithi057.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.444055.log.gz 2024-03-27T19:55:10.242 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.349297.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.239612.log.gz 2024-03-27T19:55:10.242 INFO:teuthology.orchestra.run.smithi057.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.444064.log.gz 2024-03-27T19:55:10.243 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247848.log 2024-03-27T19:55:10.244 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.549798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.220033.log 2024-03-27T19:55:10.245 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.247848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.536109.log 2024-03-27T19:55:10.246 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.220033.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.222715.log.gz 2024-03-27T19:55:10.247 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224809.log 2024-03-27T19:55:10.247 INFO:teuthology.orchestra.run.smithi057.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.549798.log.gz 2024-03-27T19:55:10.248 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.536109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.398751.log 2024-03-27T19:55:10.248 INFO:teuthology.orchestra.run.smithi057.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.166513.log.gz 2024-03-27T19:55:10.249 INFO:teuthology.orchestra.run.smithi057.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.536109.log.gz 2024-03-27T19:55:10.249 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.224809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.221380.log 2024-03-27T19:55:10.249 INFO:teuthology.orchestra.run.smithi057.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.461962.log.gz 2024-03-27T19:55:10.250 INFO:teuthology.orchestra.run.smithi057.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48252.log.gz 2024-03-27T19:55:10.250 INFO:teuthology.orchestra.run.smithi057.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48849.log.gz 2024-03-27T19:55:10.251 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.398751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.550686.log 2024-03-27T19:55:10.252 INFO:teuthology.orchestra.run.smithi057.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48978.log.gz 2024-03-27T19:55:10.252 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.344138.log.gz 2024-03-27T19:55:10.252 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.221380.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49062.log.gz 2024-03-27T19:55:10.252 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.204333.log 2024-03-27T19:55:10.253 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.550686.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.51342.log.gz 2024-03-27T19:55:10.254 INFO:teuthology.orchestra.run.smithi057.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45234.log.gz 2024-03-27T19:55:10.254 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135953.log 2024-03-27T19:55:10.255 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.204333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.267710.log 2024-03-27T19:55:10.256 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.135953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192053.log 2024-03-27T19:55:10.257 INFO:teuthology.orchestra.run.smithi057.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.550686.log.gz 2024-03-27T19:55:10.258 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.267710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.546700.log 2024-03-27T19:55:10.259 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.192053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.427788.log 2024-03-27T19:55:10.260 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.546700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129142.log 2024-03-27T19:55:10.261 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.427788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.273408.log 2024-03-27T19:55:10.263 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.129142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194305.log 2024-03-27T19:55:10.264 INFO:teuthology.orchestra.run.smithi057.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.546700.log.gz 2024-03-27T19:55:10.264 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.273408.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.459200.log.gz 2024-03-27T19:55:10.264 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.415807.log 2024-03-27T19:55:10.266 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.194305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.458326.log 2024-03-27T19:55:10.267 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.415807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.525453.log 2024-03-27T19:55:10.267 INFO:teuthology.orchestra.run.smithi057.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43260.log.gz 2024-03-27T19:55:10.267 INFO:teuthology.orchestra.run.smithi057.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43302.log.gz 2024-03-27T19:55:10.268 INFO:teuthology.orchestra.run.smithi057.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43452.log.gz 2024-03-27T19:55:10.269 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.458326.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44636.log.gz 2024-03-27T19:55:10.269 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.403203.log 2024-03-27T19:55:10.269 INFO:teuthology.orchestra.run.smithi057.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44678.log.gz 2024-03-27T19:55:10.269 INFO:teuthology.orchestra.run.smithi057.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.44888.log.gz 2024-03-27T19:55:10.270 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.525453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52470.log 2024-03-27T19:55:10.270 INFO:teuthology.orchestra.run.smithi057.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45568.log.gz 2024-03-27T19:55:10.270 INFO:teuthology.orchestra.run.smithi057.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.52614.log.gz 2024-03-27T19:55:10.271 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.403203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.555581.log 2024-03-27T19:55:10.272 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.52470.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46779.log.gz 2024-03-27T19:55:10.272 INFO:teuthology.orchestra.run.smithi057.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.156456.log.gz 2024-03-27T19:55:10.273 INFO:teuthology.orchestra.run.smithi057.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.129142.log.gz 2024-03-27T19:55:10.273 INFO:teuthology.orchestra.run.smithi057.stderr: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.135953.log.gz 2024-03-27T19:55:10.273 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44372.log 2024-03-27T19:55:10.274 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.555581.log: 76.9% -- replaced with /var/log/ceph/ceph-client.admin.555581.log.gz 2024-03-27T19:55:10.274 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.550233.log 2024-03-27T19:55:10.276 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.44372.log: 80.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.554286.log 2024-03-27T19:55:10.276 INFO:teuthology.orchestra.run.smithi057.stderr: -- replaced with /var/log/ceph/ceph-client.admin.252436.log.gz 2024-03-27T19:55:10.276 INFO:teuthology.orchestra.run.smithi057.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.230983.log.gz 2024-03-27T19:55:10.277 INFO:teuthology.orchestra.run.smithi057.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.206124.log.gz 2024-03-27T19:55:10.277 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.550233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141450.log 2024-03-27T19:55:10.277 INFO:teuthology.orchestra.run.smithi057.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.550233.log.gz 2024-03-27T19:55:10.278 INFO:teuthology.orchestra.run.smithi057.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.194296.log.gz 2024-03-27T19:55:10.278 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.554286.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.192053.log.gz 2024-03-27T19:55:10.279 INFO:teuthology.orchestra.run.smithi057.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.189374.log.gz 2024-03-27T19:55:10.279 INFO:teuthology.orchestra.run.smithi057.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.240456.log.gz 2024-03-27T19:55:10.279 INFO:teuthology.orchestra.run.smithi057.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.221380.log.gz 2024-03-27T19:55:10.280 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.554286.log.gz 2024-03-27T19:55:10.280 INFO:teuthology.orchestra.run.smithi057.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.416690.log.gz 2024-03-27T19:55:10.280 INFO:teuthology.orchestra.run.smithi057.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.203462.log.gz 2024-03-27T19:55:10.280 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.237028.log 2024-03-27T19:55:10.280 INFO:teuthology.orchestra.run.smithi057.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.224809.log.gz 2024-03-27T19:55:10.281 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.141450.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.224397.log.gz 2024-03-27T19:55:10.281 INFO:teuthology.orchestra.run.smithi057.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.343277.log.gz 2024-03-27T19:55:10.282 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.334199.log 2024-03-27T19:55:10.282 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.275549.log.gz 2024-03-27T19:55:10.282 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.349297.log.gz 2024-03-27T19:55:10.283 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.237028.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123381.log 2024-03-27T19:55:10.284 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.334199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.485140.log 2024-03-27T19:55:10.284 INFO:teuthology.orchestra.run.smithi057.stderr: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.249562.log.gz 2024-03-27T19:55:10.285 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.123381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.279045.log 2024-03-27T19:55:10.286 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.485140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.332485.log 2024-03-27T19:55:10.288 INFO:teuthology.orchestra.run.smithi057.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.415807.log.gz 2024-03-27T19:55:10.288 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.279045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.513353.log 2024-03-27T19:55:10.289 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.332485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.508518.log 2024-03-27T19:55:10.290 INFO:teuthology.orchestra.run.smithi057.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.426507.log.gz 2024-03-27T19:55:10.290 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.513353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.344129.log 2024-03-27T19:55:10.291 INFO:teuthology.orchestra.run.smithi057.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.403203.log.gz 2024-03-27T19:55:10.292 INFO:teuthology.orchestra.run.smithi057.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.408352.log.gz 2024-03-27T19:55:10.292 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.508518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.227105.log 2024-03-27T19:55:10.293 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.344129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.420532.log 2024-03-27T19:55:10.294 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.227105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113874.log 2024-03-27T19:55:10.295 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.420532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.230571.log 2024-03-27T19:55:10.296 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.113874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.341184.log 2024-03-27T19:55:10.296 INFO:teuthology.orchestra.run.smithi057.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.53453.log.gz 2024-03-27T19:55:10.297 INFO:teuthology.orchestra.run.smithi057.stderr: 83.4% -- replaced with /var/log/ceph/ceph-client.admin.469836.log.gz 2024-03-27T19:55:10.297 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.230571.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.468521.log.gz 2024-03-27T19:55:10.298 INFO:teuthology.orchestra.run.smithi057.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.346746.log.gz 2024-03-27T19:55:10.298 INFO:teuthology.orchestra.run.smithi057.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.398751.log.gz 2024-03-27T19:55:10.298 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.440632.log 2024-03-27T19:55:10.299 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.341184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.545367.log 2024-03-27T19:55:10.300 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.440632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.479432.log 2024-03-27T19:55:10.302 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.545367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144901.log 2024-03-27T19:55:10.303 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.479432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.210638.log 2024-03-27T19:55:10.304 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.144901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52740.log 2024-03-27T19:55:10.305 INFO:teuthology.orchestra.run.smithi057.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.545367.log.gz 2024-03-27T19:55:10.306 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.210638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.415390.log 2024-03-27T19:55:10.307 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.52740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141459.log 2024-03-27T19:55:10.308 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.415390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191155.log 2024-03-27T19:55:10.309 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.141459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44188.log 2024-03-27T19:55:10.310 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.191155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.422232.log 2024-03-27T19:55:10.311 INFO:teuthology.orchestra.run.smithi057.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.408777.log.gz 2024-03-27T19:55:10.311 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.44188.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.480850.log.gz 2024-03-27T19:55:10.312 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154703.log 2024-03-27T19:55:10.312 INFO:teuthology.orchestra.run.smithi057.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.479887.log.gz 2024-03-27T19:55:10.313 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.422232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198571.log 2024-03-27T19:55:10.314 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.154703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.504318.log 2024-03-27T19:55:10.316 INFO:teuthology.orchestra.run.smithi057.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.439782.log.gz 2024-03-27T19:55:10.316 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.198571.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.440623.log.gz 2024-03-27T19:55:10.316 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46611.log 2024-03-27T19:55:10.316 INFO:teuthology.orchestra.run.smithi057.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.441925.log.gz 2024-03-27T19:55:10.316 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.439369.log.gz 2024-03-27T19:55:10.317 INFO:teuthology.orchestra.run.smithi118.stderr: 94.2% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-03-27T19:55:10.317 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.504318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187903.log 2024-03-27T19:55:10.318 INFO:teuthology.orchestra.run.smithi057.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51468.log.gz 2024-03-27T19:55:10.318 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.46611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.238295.log 2024-03-27T19:55:10.319 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.187903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.399182.log 2024-03-27T19:55:10.321 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.238295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.530249.log 2024-03-27T19:55:10.321 INFO:teuthology.orchestra.run.smithi057.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52470.log.gz 2024-03-27T19:55:10.322 INFO:teuthology.orchestra.run.smithi057.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.141450.log.gz 2024-03-27T19:55:10.322 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.399182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145798.log 2024-03-27T19:55:10.322 INFO:teuthology.orchestra.run.smithi057.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.141459.log.gz 2024-03-27T19:55:10.323 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.530249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.248691.log 2024-03-27T19:55:10.323 INFO:teuthology.orchestra.run.smithi057.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.530249.log.gz 2024-03-27T19:55:10.324 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.145798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.339077.log 2024-03-27T19:55:10.325 INFO:teuthology.orchestra.run.smithi057.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.363284.log.gz 2024-03-27T19:55:10.325 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.248691.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.444299.log.gz 2024-03-27T19:55:10.326 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.540993.log 2024-03-27T19:55:10.327 INFO:teuthology.orchestra.run.smithi057.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.444716.log.gz 2024-03-27T19:55:10.327 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.339077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.444290.log 2024-03-27T19:55:10.328 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.540993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157344.log 2024-03-27T19:55:10.329 INFO:teuthology.orchestra.run.smithi057.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.540993.log.gz 2024-03-27T19:55:10.329 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.458326.log.gz 2024-03-27T19:55:10.329 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.444290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.401056.log 2024-03-27T19:55:10.331 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.157344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.328675.log 2024-03-27T19:55:10.332 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.401056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.411749.log 2024-03-27T19:55:10.333 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.328675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.494267.log 2024-03-27T19:55:10.335 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.411749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184869.log 2024-03-27T19:55:10.336 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.494267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.471589.log 2024-03-27T19:55:10.337 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.184869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.210188.log 2024-03-27T19:55:10.338 INFO:teuthology.orchestra.run.smithi057.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44372.log.gz 2024-03-27T19:55:10.338 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.471589.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48504.log.gz 2024-03-27T19:55:10.339 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.501789.log 2024-03-27T19:55:10.339 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.210188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142730.log 2024-03-27T19:55:10.341 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.501789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.268610.log 2024-03-27T19:55:10.342 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.142730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51678.log 2024-03-27T19:55:10.343 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.268610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.487712.log 2024-03-27T19:55:10.344 INFO:teuthology.orchestra.run.smithi057.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.247848.log.gz 2024-03-27T19:55:10.344 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.51678.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-03-27T19:55:10.346 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.487712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37158.log 2024-03-27T19:55:10.347 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.345414.log 2024-03-27T19:55:10.347 INFO:teuthology.orchestra.run.smithi057.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.236615.log.gz 2024-03-27T19:55:10.348 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.37158.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.237037.log.gz 2024-03-27T19:55:10.348 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.558059.log 2024-03-27T19:55:10.350 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.345414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.520390.log 2024-03-27T19:55:10.351 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.558059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.519960.log 2024-03-27T19:55:10.351 INFO:teuthology.orchestra.run.smithi057.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.558059.log.gz 2024-03-27T19:55:10.352 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.520390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.343286.log 2024-03-27T19:55:10.354 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.519960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.229716.log 2024-03-27T19:55:10.355 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.343286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155606.log 2024-03-27T19:55:10.356 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.229716.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.167927.log.gz 2024-03-27T19:55:10.357 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45238.log 2024-03-27T19:55:10.357 INFO:teuthology.orchestra.run.smithi057.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.420532.log.gz 2024-03-27T19:55:10.358 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.155606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115872.log 2024-03-27T19:55:10.359 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.558269.log 2024-03-27T19:55:10.360 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.115872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.364154.log 2024-03-27T19:55:10.361 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.558269.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.558269.log.gz 2024-03-27T19:55:10.361 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139772.log 2024-03-27T19:55:10.362 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.364154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.235150.log 2024-03-27T19:55:10.363 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.139772.log: gzip -5 --verbose -- 81.3% /var/log/ceph/ceph-client.admin.135530.log -- replaced with /var/log/ceph/ceph-client.admin.495522.log.gz 2024-03-27T19:55:10.363 INFO:teuthology.orchestra.run.smithi057.stderr: 2024-03-27T19:55:10.363 INFO:teuthology.orchestra.run.smithi057.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46611.log.gz 2024-03-27T19:55:10.364 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.235150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184878.log 2024-03-27T19:55:10.365 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.135530.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.495959.log.gz 2024-03-27T19:55:10.366 INFO:teuthology.orchestra.run.smithi057.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.123381.log.gz 2024-03-27T19:55:10.366 INFO:teuthology.orchestra.run.smithi057.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.146681.log.gz 2024-03-27T19:55:10.366 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.214086.log 2024-03-27T19:55:10.367 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.184878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.324440.log 2024-03-27T19:55:10.368 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.214086.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.113874.log.gz 2024-03-27T19:55:10.369 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.396093.log 2024-03-27T19:55:10.369 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.339077.log.gz 2024-03-27T19:55:10.370 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.324440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.365005.log 2024-03-27T19:55:10.371 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.396093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.409704.log 2024-03-27T19:55:10.372 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.474193.log.gz 2024-03-27T19:55:10.373 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.365005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.358091.log 2024-03-27T19:55:10.375 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.409704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.465858.log 2024-03-27T19:55:10.376 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.358091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.254166.log 2024-03-27T19:55:10.376 INFO:teuthology.orchestra.run.smithi057.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.155606.log.gz 2024-03-27T19:55:10.376 INFO:teuthology.orchestra.run.smithi057.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.229716.log.gz 2024-03-27T19:55:10.377 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.465858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.265571.log 2024-03-27T19:55:10.379 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.254166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.464590.log 2024-03-27T19:55:10.379 INFO:teuthology.orchestra.run.smithi057.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.210188.log.gz 2024-03-27T19:55:10.379 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.430775.log.gz 2024-03-27T19:55:10.380 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.265571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.557891.log 2024-03-27T19:55:10.381 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.464590.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44104.log.gz 2024-03-27T19:55:10.381 INFO:teuthology.orchestra.run.smithi057.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44188.log.gz 2024-03-27T19:55:10.381 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52572.log 2024-03-27T19:55:10.382 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.557891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.500857.log 2024-03-27T19:55:10.383 INFO:teuthology.orchestra.run.smithi057.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.557891.log.gz 2024-03-27T19:55:10.383 INFO:teuthology.orchestra.run.smithi057.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48588.log.gz 2024-03-27T19:55:10.383 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.52572.log: 78.9% -- replaced with /var/log/ceph/ceph-client.admin.237028.log.gz 2024-03-27T19:55:10.384 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183572.log 2024-03-27T19:55:10.384 INFO:teuthology.orchestra.run.smithi057.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.264293.log.gz 2024-03-27T19:55:10.385 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.500857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145329.log 2024-03-27T19:55:10.386 INFO:teuthology.orchestra.run.smithi057.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.464590.log.gz 2024-03-27T19:55:10.387 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.183572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.260490.log 2024-03-27T19:55:10.387 INFO:teuthology.orchestra.run.smithi057.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.490385.log.gz 2024-03-27T19:55:10.388 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.145329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.553853.log 2024-03-27T19:55:10.390 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.260490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.218717.log 2024-03-27T19:55:10.391 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.553853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.411836.log 2024-03-27T19:55:10.392 INFO:teuthology.orchestra.run.smithi057.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.553853.log.gz 2024-03-27T19:55:10.392 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.218717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.428636.log 2024-03-27T19:55:10.394 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.411836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190266.log 2024-03-27T19:55:10.395 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.428636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.443934.log 2024-03-27T19:55:10.397 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.190266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.445993.log 2024-03-27T19:55:10.397 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.411019.log.gz 2024-03-27T19:55:10.398 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.443934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.372896.log 2024-03-27T19:55:10.399 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.445993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.274279.log 2024-03-27T19:55:10.401 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.372896.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.422232.log.gz 2024-03-27T19:55:10.401 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.331209.log 2024-03-27T19:55:10.402 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.274279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44804.log 2024-03-27T19:55:10.403 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.331209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51594.log 2024-03-27T19:55:10.405 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.44804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.548467.log 2024-03-27T19:55:10.406 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.51594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45239.log 2024-03-27T19:55:10.407 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.548467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.395676.log 2024-03-27T19:55:10.408 INFO:teuthology.orchestra.run.smithi057.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.548467.log.gz 2024-03-27T19:55:10.408 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.523345.log 2024-03-27T19:55:10.409 INFO:teuthology.orchestra.run.smithi057.stderr: 93.9% -- replaced with /var/log/ceph/ceph-client.admin.361545.log.gz 2024-03-27T19:55:10.410 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.395676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112836.log 2024-03-27T19:55:10.411 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.523345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.255484.log 2024-03-27T19:55:10.413 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.112836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243450.log 2024-03-27T19:55:10.414 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.255484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.217458.log 2024-03-27T19:55:10.415 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.243450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.421797.log 2024-03-27T19:55:10.415 INFO:teuthology.orchestra.run.smithi057.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.370882.log.gz 2024-03-27T19:55:10.416 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.184878.log.gz 2024-03-27T19:55:10.416 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.217458.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.403640.log.gz 2024-03-27T19:55:10.417 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.238717.log 2024-03-27T19:55:10.418 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.421797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43006.log 2024-03-27T19:55:10.419 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.238717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.407464.log 2024-03-27T19:55:10.420 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.43006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.548023.log 2024-03-27T19:55:10.422 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.407464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137227.log 2024-03-27T19:55:10.422 INFO:teuthology.orchestra.run.smithi057.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.265571.log.gz 2024-03-27T19:55:10.423 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.548023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.369068.log 2024-03-27T19:55:10.423 INFO:teuthology.orchestra.run.smithi057.stderr: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.548023.log.gz 2024-03-27T19:55:10.424 INFO:teuthology.orchestra.run.smithi057.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.266432.log.gz 2024-03-27T19:55:10.424 INFO:teuthology.orchestra.run.smithi057.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.268122.log.gz 2024-03-27T19:55:10.425 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.137227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164027.log 2024-03-27T19:55:10.425 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.501789.log.gz 2024-03-27T19:55:10.425 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.345414.log.gz 2024-03-27T19:55:10.426 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.369068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.489955.log 2024-03-27T19:55:10.427 INFO:teuthology.orchestra.run.smithi057.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.374835.log.gz 2024-03-27T19:55:10.427 INFO:teuthology.orchestra.run.smithi057.stderr: 77.5% -- replaced with /var/log/ceph/ceph-client.admin.396093.log.gz 2024-03-27T19:55:10.427 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.358091.log.gz 2024-03-27T19:55:10.427 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.164027.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.471589.log.gz 2024-03-27T19:55:10.428 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.395676.log.gz 2024-03-27T19:55:10.428 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.360223.log 2024-03-27T19:55:10.428 INFO:teuthology.orchestra.run.smithi057.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.479001.log.gz 2024-03-27T19:55:10.429 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.489955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.349288.log 2024-03-27T19:55:10.431 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.360223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.469398.log 2024-03-27T19:55:10.432 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.349288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46317.log 2024-03-27T19:55:10.433 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.469398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.275119.log 2024-03-27T19:55:10.435 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.46317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.361536.log 2024-03-27T19:55:10.436 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.275119.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-03-27T19:55:10.436 INFO:teuthology.orchestra.run.smithi057.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.444290.log.gz 2024-03-27T19:55:10.437 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.361536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.209748.log 2024-03-27T19:55:10.438 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.525453.log.gz 2024-03-27T19:55:10.439 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.238304.log 2024-03-27T19:55:10.441 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.209748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.355199.log 2024-03-27T19:55:10.442 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.238304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195338.log 2024-03-27T19:55:10.443 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.355199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148433.log 2024-03-27T19:55:10.444 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.195338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.329935.log 2024-03-27T19:55:10.445 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.148433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.367729.log 2024-03-27T19:55:10.446 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.329935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46821.log 2024-03-27T19:55:10.448 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.367729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.331644.log 2024-03-27T19:55:10.449 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.46821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.491665.log 2024-03-27T19:55:10.450 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.331644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.458738.log 2024-03-27T19:55:10.451 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.491665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.534320.log 2024-03-27T19:55:10.452 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.458738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.341175.log 2024-03-27T19:55:10.454 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.534320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49965.log 2024-03-27T19:55:10.455 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.341175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.324431.log 2024-03-27T19:55:10.456 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.49965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.547579.log 2024-03-27T19:55:10.458 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.324431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44272.log 2024-03-27T19:55:10.459 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.547579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.394756.log 2024-03-27T19:55:10.459 INFO:teuthology.orchestra.run.smithi057.stderr: 77.3% -- replaced with /var/log/ceph/ceph-client.admin.547579.log.gz 2024-03-27T19:55:10.460 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.44272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.348868.log 2024-03-27T19:55:10.462 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.394756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.273839.log 2024-03-27T19:55:10.462 INFO:teuthology.orchestra.run.smithi057.stderr: 83.0% -- replaced with /var/log/ceph/ceph-client.admin.421797.log.gz 2024-03-27T19:55:10.463 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.348868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43092.log 2024-03-27T19:55:10.465 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.273839.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-03-27T19:55:10.466 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.43092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.284581.log 2024-03-27T19:55:10.467 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124225.log 2024-03-27T19:55:10.468 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.284581.log: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.137227.log.gz 2024-03-27T19:55:10.469 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.418401.log 2024-03-27T19:55:10.469 INFO:teuthology.orchestra.run.smithi057.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.135530.log.gz 2024-03-27T19:55:10.471 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.124225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.553412.log 2024-03-27T19:55:10.472 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.418401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.480859.log 2024-03-27T19:55:10.473 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.553412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.209288.log 2024-03-27T19:55:10.473 INFO:teuthology.orchestra.run.smithi057.stderr: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.553412.log.gz 2024-03-27T19:55:10.476 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.480859.log: /var/log/ceph/ceph-client.admin.209288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43176.log 2024-03-27T19:55:10.477 INFO:teuthology.orchestra.run.smithi057.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.417965.log.gz 2024-03-27T19:55:10.477 INFO:teuthology.orchestra.run.smithi057.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.238726.log.gz 2024-03-27T19:55:10.477 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.410162.log 2024-03-27T19:55:10.478 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.43176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151129.log 2024-03-27T19:55:10.480 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.410162.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.230140.log.gz 2024-03-27T19:55:10.480 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.551130.log 2024-03-27T19:55:10.482 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.151129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.523766.log 2024-03-27T19:55:10.483 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.551130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.350553.log 2024-03-27T19:55:10.485 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.523766.log: /var/log/ceph/ceph-client.admin.350553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.557933.log 2024-03-27T19:55:10.486 INFO:teuthology.orchestra.run.smithi057.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.551130.log.gz 2024-03-27T19:55:10.487 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.496804.log 2024-03-27T19:55:10.488 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.557933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123803.log 2024-03-27T19:55:10.488 INFO:teuthology.orchestra.run.smithi057.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.557933.log.gz 2024-03-27T19:55:10.489 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.496804.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.159461.log.gz 2024-03-27T19:55:10.489 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49409.log 2024-03-27T19:55:10.491 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.123803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.431622.log 2024-03-27T19:55:10.494 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.49409.log: /var/log/ceph/ceph-client.admin.431622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.217026.log 2024-03-27T19:55:10.494 INFO:teuthology.orchestra.run.smithi057.stderr: 89.1% -- replaced with /var/log/ceph/ceph.log.gz 2024-03-27T19:55:10.494 INFO:teuthology.orchestra.run.smithi057.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.500857.log.gz 2024-03-27T19:55:10.495 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.211088.log 2024-03-27T19:55:10.496 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.217026.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-03-27T19:55:10.497 INFO:teuthology.orchestra.run.smithi057.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.209288.log.gz 2024-03-27T19:55:10.498 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.211088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.404052.log 2024-03-27T19:55:10.499 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51720.log 2024-03-27T19:55:10.500 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.404052.log: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.164027.log.gz 2024-03-27T19:55:10.501 INFO:teuthology.orchestra.run.smithi057.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.202555.log.gz 2024-03-27T19:55:10.501 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198562.log 2024-03-27T19:55:10.502 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.51720.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.211088.log.gz 2024-03-27T19:55:10.502 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.217458.log.gz 2024-03-27T19:55:10.502 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.521657.log 2024-03-27T19:55:10.504 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.198562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51846.log 2024-03-27T19:55:10.504 INFO:teuthology.orchestra.run.smithi057.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.218717.log.gz 2024-03-27T19:55:10.505 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.521657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200787.log 2024-03-27T19:55:10.506 INFO:teuthology.orchestra.run.smithi057.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.167918.log.gz 2024-03-27T19:55:10.506 INFO:teuthology.orchestra.run.smithi057.stderr: 78.6% -- replaced with /var/log/ceph/ceph-client.admin.168339.log.gz 2024-03-27T19:55:10.506 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.51846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52385.log 2024-03-27T19:55:10.508 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.266006.log.gz 2024-03-27T19:55:10.508 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.200787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.371367.log 2024-03-27T19:55:10.509 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.52385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133352.log 2024-03-27T19:55:10.510 INFO:teuthology.orchestra.run.smithi057.stderr: 77.4% -- replaced with /var/log/ceph/ceph-client.admin.349288.log.gz 2024-03-27T19:55:10.510 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.228856.log.gz 2024-03-27T19:55:10.510 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.371367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.487280.log 2024-03-27T19:55:10.511 INFO:teuthology.orchestra.run.smithi057.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.489014.log.gz 2024-03-27T19:55:10.511 INFO:teuthology.orchestra.run.smithi057.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.489955.log.gz 2024-03-27T19:55:10.512 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.133352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.240033.log 2024-03-27T19:55:10.513 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.487280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.542266.log 2024-03-27T19:55:10.515 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.240033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159044.log 2024-03-27T19:55:10.516 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.542266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185300.log 2024-03-27T19:55:10.517 INFO:teuthology.orchestra.run.smithi057.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.542266.log.gz 2024-03-27T19:55:10.518 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.159044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185726.log 2024-03-27T19:55:10.519 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.185300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.487703.log 2024-03-27T19:55:10.521 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.185726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.276875.log 2024-03-27T19:55:10.521 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.487703.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.214077.log.gz 2024-03-27T19:55:10.522 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.478146.log 2024-03-27T19:55:10.523 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0%/var/log/ceph/ceph-client.admin.276875.log: -- replaced with /var/log/ceph/ceph-client.admin.407464.log.gz 2024-03-27T19:55:10.523 INFO:teuthology.orchestra.run.smithi057.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.371367.log.gz 2024-03-27T19:55:10.524 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.240878.log 2024-03-27T19:55:10.524 INFO:teuthology.orchestra.run.smithi057.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.355199.log.gz 2024-03-27T19:55:10.524 INFO:teuthology.orchestra.run.smithi057.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.341175.log.gz 2024-03-27T19:55:10.525 INFO:teuthology.orchestra.run.smithi057.stderr: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.394756.log.gz 2024-03-27T19:55:10.525 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.478146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49535.log 2024-03-27T19:55:10.527 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.240878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51888.log 2024-03-27T19:55:10.528 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.49535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.442350.log 2024-03-27T19:55:10.530 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.51888.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51678.log.gz 2024-03-27T19:55:10.530 INFO:teuthology.orchestra.run.smithi057.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51720.log.gz 2024-03-27T19:55:10.530 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.485149.log.gz 2024-03-27T19:55:10.530 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.251990.log 2024-03-27T19:55:10.531 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.442350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53219.log 2024-03-27T19:55:10.532 INFO:teuthology.orchestra.run.smithi057.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.51888.log.gz 2024-03-27T19:55:10.533 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.251990.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51846.log.gz 2024-03-27T19:55:10.533 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52182.log 2024-03-27T19:55:10.534 INFO:teuthology.orchestra.run.smithi057.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52572.log.gz 2024-03-27T19:55:10.534 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.53219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134620.log 2024-03-27T19:55:10.536 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.52182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44972.log 2024-03-27T19:55:10.537 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.134620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.341595.log 2024-03-27T19:55:10.538 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.44972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148424.log 2024-03-27T19:55:10.540 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.341595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45911.log 2024-03-27T19:55:10.541 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.148424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49272.log 2024-03-27T19:55:10.543 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.45911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48420.log 2024-03-27T19:55:10.544 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.49272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243027.log 2024-03-27T19:55:10.545 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.48420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.227947.log 2024-03-27T19:55:10.546 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.243027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46401.log 2024-03-27T19:55:10.548 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.227947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.262185.log 2024-03-27T19:55:10.549 INFO:teuthology.orchestra.run.smithi057.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.340753.log.gz 2024-03-27T19:55:10.549 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.46401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50235.log 2024-03-27T19:55:10.549 INFO:teuthology.orchestra.run.smithi057.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.442350.log.gz 2024-03-27T19:55:10.550 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.262185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.532033.log 2024-03-27T19:55:10.551 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.50235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.501780.log 2024-03-27T19:55:10.553 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.532033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42707.log 2024-03-27T19:55:10.553 INFO:teuthology.orchestra.run.smithi057.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.532033.log.gz 2024-03-27T19:55:10.554 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.520390.log.gz 2024-03-27T19:55:10.554 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.501780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.526709.log 2024-03-27T19:55:10.556 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.42707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.218304.log 2024-03-27T19:55:10.557 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.526709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.336939.log 2024-03-27T19:55:10.559 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.218304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.348015.log 2024-03-27T19:55:10.559 INFO:teuthology.orchestra.run.smithi057.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.462388.log.gz 2024-03-27T19:55:10.560 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.336939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.278132.log 2024-03-27T19:55:10.561 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.348015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.327814.log 2024-03-27T19:55:10.562 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.278132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.527140.log 2024-03-27T19:55:10.564 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.327814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.362864.log 2024-03-27T19:55:10.565 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.527140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.372383.log 2024-03-27T19:55:10.566 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.362864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.350562.log 2024-03-27T19:55:10.568 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.372383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149283.log 2024-03-27T19:55:10.569 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.350562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48630.log 2024-03-27T19:55:10.570 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.149283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.323585.log 2024-03-27T19:55:10.573 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.48630.log: /var/log/ceph/ceph-client.admin.323585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.248682.log 2024-03-27T19:55:10.574 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.336426.log 2024-03-27T19:55:10.575 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.248682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.475192.log 2024-03-27T19:55:10.576 INFO:teuthology.orchestra.run.smithi057.stderr: 84.2% 82.2% -- replaced with /var/log/ceph/ceph-client.admin.427779.log.gz 2024-03-27T19:55:10.577 INFO:teuthology.orchestra.run.smithi057.stderr: -- replaced with /var/log/ceph/ceph-client.admin.429048.log.gz 2024-03-27T19:55:10.577 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.336426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.471580.log 2024-03-27T19:55:10.578 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.475192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.265145.log 2024-03-27T19:55:10.579 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.471580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.374844.log 2024-03-27T19:55:10.581 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.265145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.558101.log 2024-03-27T19:55:10.582 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.374844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46107.log 2024-03-27T19:55:10.584 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.558101.log: 89.2% 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43176.log.gz -- replaced with /var/log/ceph/ceph-client.admin.558101.log.gz 2024-03-27T19:55:10.584 INFO:teuthology.orchestra.run.smithi057.stderr: 2024-03-27T19:55:10.584 INFO:teuthology.orchestra.run.smithi057.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46401.log.gz 2024-03-27T19:55:10.584 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.507288.log 2024-03-27T19:55:10.585 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.46107.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46695.log.gz 2024-03-27T19:55:10.585 INFO:teuthology.orchestra.run.smithi057.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49272.log.gz 2024-03-27T19:55:10.586 INFO:teuthology.orchestra.run.smithi057.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.47369.log.gz 2024-03-27T19:55:10.587 INFO:teuthology.orchestra.run.smithi057.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49535.log.gz 2024-03-27T19:55:10.587 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.357597.log 2024-03-27T19:55:10.588 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.507288.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50277.log.gz 2024-03-27T19:55:10.588 INFO:teuthology.orchestra.run.smithi057.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50235.log.gz 2024-03-27T19:55:10.589 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.358933.log 2024-03-27T19:55:10.589 INFO:teuthology.orchestra.run.smithi057.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.410162.log.gz 2024-03-27T19:55:10.589 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.357597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.334704.log 2024-03-27T19:55:10.590 INFO:teuthology.orchestra.run.smithi057.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.210197.log.gz 2024-03-27T19:55:10.595 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.358933.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.411010.log.gz 2024-03-27T19:55:10.595 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136375.log 2024-03-27T19:55:10.595 INFO:teuthology.orchestra.run.smithi057.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.133352.log.gz 2024-03-27T19:55:10.595 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.334704.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.487280.log.gz 2024-03-27T19:55:10.595 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.532913.log 2024-03-27T19:55:10.596 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.136375.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.487703.log.gz 2024-03-27T19:55:10.596 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.460576.log.gz 2024-03-27T19:55:10.596 INFO:teuthology.orchestra.run.smithi057.stderr: 80.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.257418.log 2024-03-27T19:55:10.596 INFO:teuthology.orchestra.run.smithi057.stderr: -- replaced with /var/log/ceph/ceph-client.admin.496804.log.gz 2024-03-27T19:55:10.596 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.532913.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.532913.log.gz 2024-03-27T19:55:10.597 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.443943.log 2024-03-27T19:55:10.597 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.257418.log: 77.8% -- replaced with /var/log/ceph/ceph-client.admin.155597.log.gz 2024-03-27T19:55:10.597 INFO:teuthology.orchestra.run.smithi057.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.251990.log.gz 2024-03-27T19:55:10.598 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.443943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.263037.log 2024-03-27T19:55:10.599 INFO:teuthology.orchestra.run.smithi057.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.425660.log.gz 2024-03-27T19:55:10.599 INFO:teuthology.orchestra.run.smithi057.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.225660.log.gz 2024-03-27T19:55:10.600 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.474678.log 2024-03-27T19:55:10.601 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.263037.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.336939.log.gz 2024-03-27T19:55:10.601 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.338202.log.gz 2024-03-27T19:55:10.602 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.376289.log 2024-03-27T19:55:10.603 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.474678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116303.log 2024-03-27T19:55:10.604 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.376289.log: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.248682.log.gz 2024-03-27T19:55:10.605 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164036.log 2024-03-27T19:55:10.606 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.116303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.261342.log 2024-03-27T19:55:10.607 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.164036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140194.log 2024-03-27T19:55:10.608 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.261342.log: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.136375.log.gz 2024-03-27T19:55:10.609 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.527131.log 2024-03-27T19:55:10.609 INFO:teuthology.orchestra.run.smithi057.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.198562.log.gz 2024-03-27T19:55:10.610 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.140194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.368629.log 2024-03-27T19:55:10.610 INFO:teuthology.orchestra.run.smithi057.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.204774.log.gz 2024-03-27T19:55:10.612 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.527131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.405799.log 2024-03-27T19:55:10.613 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.368629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.461550.log 2024-03-27T19:55:10.615 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.405799.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.276875.log.gz 2024-03-27T19:55:10.615 INFO:teuthology.orchestra.run.smithi057.stderr:gzip 90.0% -- replaced with /var/log/ceph/ceph-client.admin.261342.log.gz 2024-03-27T19:55:10.616 INFO:teuthology.orchestra.run.smithi057.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.139763.log 2024-03-27T19:55:10.616 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.461550.log: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.264723.log.gz 2024-03-27T19:55:10.617 INFO:teuthology.orchestra.run.smithi057.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.334704.log.gz 2024-03-27T19:55:10.617 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.263037.log.gz 2024-03-27T19:55:10.617 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.262185.log.gz 2024-03-27T19:55:10.617 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143145.log 2024-03-27T19:55:10.618 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.139763.log: 77.8% -- replaced with /var/log/ceph/ceph-client.admin.523757.log.gz 2024-03-27T19:55:10.619 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.143145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46443.log 2024-03-27T19:55:10.620 INFO:teuthology.orchestra.run.smithi057.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.500409.log.gz 2024-03-27T19:55:10.621 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131639.log 2024-03-27T19:55:10.621 INFO:teuthology.orchestra.run.smithi057.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.257418.log.gz 2024-03-27T19:55:10.621 INFO:teuthology.orchestra.run.smithi057.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.287738.log.gz 2024-03-27T19:55:10.622 INFO:teuthology.orchestra.run.smithi057.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.501780.log.gz 2024-03-27T19:55:10.622 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.46443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.439791.log 2024-03-27T19:55:10.624 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.131639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.505638.log 2024-03-27T19:55:10.624 INFO:teuthology.orchestra.run.smithi057.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.491234.log.gz 2024-03-27T19:55:10.624 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.439791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.278141.log 2024-03-27T19:55:10.626 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.505638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.494688.log 2024-03-27T19:55:10.626 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.497233.log.gz 2024-03-27T19:55:10.627 INFO:teuthology.orchestra.run.smithi057.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.357597.log.gz 2024-03-27T19:55:10.627 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.278141.log: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.373883.log.gz 2024-03-27T19:55:10.628 INFO:teuthology.orchestra.run.smithi057.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.350562.log.gz 2024-03-27T19:55:10.628 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.494688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.231405.log 2024-03-27T19:55:10.629 INFO:teuthology.orchestra.run.smithi057.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.374368.log.gz 2024-03-27T19:55:10.630 INFO:teuthology.orchestra.run.smithi057.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.395241.log.gz 2024-03-27T19:55:10.631 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.479010.log 2024-03-27T19:55:10.631 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.231405.log: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.501112.log.gz 2024-03-27T19:55:10.631 INFO:teuthology.orchestra.run.smithi057.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.465437.log.gz 2024-03-27T19:55:10.632 INFO:teuthology.orchestra.run.smithi057.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.477704.log.gz 2024-03-27T19:55:10.632 INFO:teuthology.orchestra.run.smithi057.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51594.log.gz 2024-03-27T19:55:10.633 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201664.log 2024-03-27T19:55:10.634 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.479010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.499850.log 2024-03-27T19:55:10.635 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.201664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.476157.log 2024-03-27T19:55:10.636 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.499850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.272145.log 2024-03-27T19:55:10.639 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.476157.log: /var/log/ceph/ceph-client.admin.272145.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.218726.log.gz 2024-03-27T19:55:10.639 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44720.log 2024-03-27T19:55:10.640 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.203453.log 2024-03-27T19:55:10.642 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.44720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159930.log 2024-03-27T19:55:10.643 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.203453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.225239.log 2024-03-27T19:55:10.644 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.159930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.520812.log 2024-03-27T19:55:10.645 INFO:teuthology.orchestra.run.smithi057.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.190266.log.gz 2024-03-27T19:55:10.646 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.225239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.266858.log 2024-03-27T19:55:10.647 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.520812.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.362864.log.gz 2024-03-27T19:55:10.648 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.504760.log 2024-03-27T19:55:10.649 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.266858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.518424.log 2024-03-27T19:55:10.651 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.504760.log: /var/log/ceph/ceph-client.admin.518424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.527561.log 2024-03-27T19:55:10.652 INFO:teuthology.orchestra.run.smithi057.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.481767.log.gz 2024-03-27T19:55:10.652 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.287747.log 2024-03-27T19:55:10.654 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.527561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.371888.log 2024-03-27T19:55:10.655 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.287747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.404474.log 2024-03-27T19:55:10.656 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.371888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.351836.log 2024-03-27T19:55:10.658 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.404474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.456633.log 2024-03-27T19:55:10.659 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.351836.log: 78.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202114.log 2024-03-27T19:55:10.659 INFO:teuthology.orchestra.run.smithi057.stderr: -- replaced with /var/log/ceph/ceph-client.admin.141028.log.gz 2024-03-27T19:55:10.661 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.456633.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.461541.log.gz 2024-03-27T19:55:10.662 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.496377.log 2024-03-27T19:55:10.662 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.461550.log.gz 2024-03-27T19:55:10.664 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.202114.log: /var/log/ceph/ceph-client.admin.496377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.552970.log 2024-03-27T19:55:10.664 INFO:teuthology.orchestra.run.smithi057.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.445571.log.gz 2024-03-27T19:55:10.665 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.269628.log 2024-03-27T19:55:10.666 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.552970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.223547.log 2024-03-27T19:55:10.667 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.269628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.443656.log 2024-03-27T19:55:10.668 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.223547.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.360223.log.gz 2024-03-27T19:55:10.669 INFO:teuthology.orchestra.run.smithi057.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.361536.log.gz 2024-03-27T19:55:10.670 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.443656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.420541.log 2024-03-27T19:55:10.670 INFO:teuthology.orchestra.run.smithi057.stderr: 78.2% -- replaced with /var/log/ceph/ceph-client.admin.361078.log.gz 2024-03-27T19:55:10.671 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.203883.log 2024-03-27T19:55:10.672 INFO:teuthology.orchestra.run.smithi057.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.183572.log.gz 2024-03-27T19:55:10.673 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.420541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117704.log 2024-03-27T19:55:10.673 INFO:teuthology.orchestra.run.smithi057.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.184433.log.gz 2024-03-27T19:55:10.674 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.203883.log: 92.8% -- replaced with /var/log/ceph/ceph-client.admin.552970.log.gz 2024-03-27T19:55:10.674 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.462858.log 2024-03-27T19:55:10.675 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.117704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.464155.log 2024-03-27T19:55:10.677 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.462858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.212393.log 2024-03-27T19:55:10.678 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.464155.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.216612.log.gz 2024-03-27T19:55:10.678 INFO:teuthology.orchestra.run.smithi057.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46107.log.gz 2024-03-27T19:55:10.679 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.406946.log 2024-03-27T19:55:10.679 INFO:teuthology.orchestra.run.smithi057.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45056.log.gz 2024-03-27T19:55:10.679 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.212393.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46443.log.gz 2024-03-27T19:55:10.680 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.334190.log 2024-03-27T19:55:10.681 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.406946.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.265154.log.gz 2024-03-27T19:55:10.681 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.552499.log 2024-03-27T19:55:10.683 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.334190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.533849.log 2024-03-27T19:55:10.684 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.552499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42834.log 2024-03-27T19:55:10.684 INFO:teuthology.orchestra.run.smithi057.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.552499.log.gz 2024-03-27T19:55:10.685 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.533849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.335997.log 2024-03-27T19:55:10.686 INFO:teuthology.orchestra.run.smithi057.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.533849.log.gz 2024-03-27T19:55:10.687 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.42834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.475670.log 2024-03-27T19:55:10.688 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.420541.log.gz 2024-03-27T19:55:10.689 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.335997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.469407.log 2024-03-27T19:55:10.689 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.494688.log.gz 2024-03-27T19:55:10.690 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.475670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133764.log 2024-03-27T19:55:10.691 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.469407.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.496377.log.gz 2024-03-27T19:55:10.691 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.344972.log 2024-03-27T19:55:10.693 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.133764.log: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.139763.log.gz 2024-03-27T19:55:10.693 INFO:teuthology.orchestra.run.smithi057.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.160851.log.gz 2024-03-27T19:55:10.693 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.517060.log 2024-03-27T19:55:10.693 INFO:teuthology.orchestra.run.smithi057.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.474678.log.gz 2024-03-27T19:55:10.694 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0%/var/log/ceph/ceph-client.admin.344972.log: -- replaced with /var/log/ceph/ceph-client.admin.155184.log.gz 85.8% 2024-03-27T19:55:10.694 INFO:teuthology.orchestra.run.smithi057.stderr: -- replaced with /var/log/ceph/ceph-client.admin.203453.log.gz 2024-03-27T19:55:10.695 INFO:teuthology.orchestra.run.smithi057.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.185717.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.399676.log 2024-03-27T19:55:10.695 INFO:teuthology.orchestra.run.smithi057.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.231405.log.gz 2024-03-27T19:55:10.695 INFO:teuthology.orchestra.run.smithi057.stderr: 2024-03-27T19:55:10.696 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.517060.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.212393.log.gz 2024-03-27T19:55:10.696 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.258269.log 2024-03-27T19:55:10.698 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.399676.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.335997.log.gz 2024-03-27T19:55:10.699 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.258269.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.225239.log.gz 2024-03-27T19:55:10.699 INFO:teuthology.orchestra.run.smithi057.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.464155.log.gz 2024-03-27T19:55:10.699 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.536100.log 2024-03-27T19:55:10.701 INFO:teuthology.orchestra.run.smithi057.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49104.log.gz 2024-03-27T19:55:10.701 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.527983.log 2024-03-27T19:55:10.701 INFO:teuthology.orchestra.run.smithi057.stderr: 96.6% -- replaced with /var/log/ceph/ceph-client.admin.534320.log.gz 2024-03-27T19:55:10.701 INFO:teuthology.orchestra.run.smithi057.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.406946.log.gz 2024-03-27T19:55:10.703 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.536100.log: 78.4% -- replaced with /var/log/ceph/ceph-client.admin.536100.log.gz 2024-03-27T19:55:10.703 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.287747.log.gz 2024-03-27T19:55:10.704 INFO:teuthology.orchestra.run.smithi057.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.347602.log.gz 2024-03-27T19:55:10.704 INFO:teuthology.orchestra.run.smithi057.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.504760.log.gz 2024-03-27T19:55:10.704 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.286889.log 2024-03-27T19:55:10.704 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.502210.log.gz 2024-03-27T19:55:10.704 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.527983.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.521657.log.gz 2024-03-27T19:55:10.705 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.427368.log 2024-03-27T19:55:10.706 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.286889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.523336.log 2024-03-27T19:55:10.708 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.427368.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.344972.log.gz 2024-03-27T19:55:10.708 INFO:teuthology.orchestra.run.smithi057.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.351836.log.gz 2024-03-27T19:55:10.709 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.509711.log 2024-03-27T19:55:10.710 INFO:teuthology.orchestra.run.smithi057.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.395250.log.gz 2024-03-27T19:55:10.710 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.466692.log 2024-03-27T19:55:10.711 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.523336.log: /var/log/ceph/ceph-client.admin.509711.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.479010.log.gz 2024-03-27T19:55:10.711 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.558311.log 2024-03-27T19:55:10.712 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.466692.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52385.log.gz 2024-03-27T19:55:10.713 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.275128.log 2024-03-27T19:55:10.715 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.558311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.537715.log 2024-03-27T19:55:10.715 INFO:teuthology.orchestra.run.smithi057.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.558311.log.gz 2024-03-27T19:55:10.715 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.275128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51426.log 2024-03-27T19:55:10.717 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.537715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.324013.log 2024-03-27T19:55:10.718 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.51426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.270040.log 2024-03-27T19:55:10.719 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.324013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156881.log 2024-03-27T19:55:10.720 INFO:teuthology.orchestra.run.smithi057.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.324003.log.gz 2024-03-27T19:55:10.721 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.270040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.241298.log 2024-03-27T19:55:10.721 INFO:teuthology.orchestra.run.smithi057.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.326125.log.gz 2024-03-27T19:55:10.722 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.156881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.277297.log 2024-03-27T19:55:10.723 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.241298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42665.log 2024-03-27T19:55:10.725 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.277297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.541841.log 2024-03-27T19:55:10.726 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.42665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.223967.log 2024-03-27T19:55:10.727 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.541841.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.348446.log.gz 2024-03-27T19:55:10.728 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.360232.log 2024-03-27T19:55:10.728 INFO:teuthology.orchestra.run.smithi057.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.541841.log.gz 2024-03-27T19:55:10.729 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.223967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.254175.log 2024-03-27T19:55:10.730 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.360232.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.140194.log.gz 2024-03-27T19:55:10.730 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.457063.log 2024-03-27T19:55:10.732 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.254175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.330356.log 2024-03-27T19:55:10.733 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.457063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.359355.log 2024-03-27T19:55:10.734 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.330356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.559422.log 2024-03-27T19:55:10.736 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.359355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.217035.log 2024-03-27T19:55:10.737 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.559422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245143.log 2024-03-27T19:55:10.737 INFO:teuthology.orchestra.run.smithi057.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.559422.log.gz 2024-03-27T19:55:10.739 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.217035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.240024.log 2024-03-27T19:55:10.740 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.245143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138927.log 2024-03-27T19:55:10.740 INFO:teuthology.orchestra.run.smithi057.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.504318.log.gz 2024-03-27T19:55:10.741 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.240024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.328249.log 2024-03-27T19:55:10.744 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.138927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.541832.log 2024-03-27T19:55:10.744 INFO:teuthology.orchestra.run.smithi057.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43134.log.gz 2024-03-27T19:55:10.744 INFO:teuthology.orchestra.run.smithi057.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.132078.log.gz 2024-03-27T19:55:10.745 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.328249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190257.log 2024-03-27T19:55:10.746 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.541832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.272996.log 2024-03-27T19:55:10.746 INFO:teuthology.orchestra.run.smithi057.stderr: 77.8% -- replaced with /var/log/ceph/ceph-client.admin.541832.log.gz 2024-03-27T19:55:10.747 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.190257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.426516.log 2024-03-27T19:55:10.748 INFO:teuthology.orchestra.run.smithi057.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.456633.log.gz 2024-03-27T19:55:10.748 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.272996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.412079.log 2024-03-27T19:55:10.750 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.426516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.236143.log 2024-03-27T19:55:10.751 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.412079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.502201.log 2024-03-27T19:55:10.753 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.236143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50829.log 2024-03-27T19:55:10.755 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.502201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142298.log 2024-03-27T19:55:10.756 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.50829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.230562.log 2024-03-27T19:55:10.757 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.142298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.272987.log 2024-03-27T19:55:10.757 INFO:teuthology.orchestra.run.smithi057.stderr: 78.1% -- replaced with /var/log/ceph/ceph-client.admin.133764.log.gz 2024-03-27T19:55:10.758 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.230562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.547135.log 2024-03-27T19:55:10.760 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.272987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51636.log 2024-03-27T19:55:10.761 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.547135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.426082.log 2024-03-27T19:55:10.761 INFO:teuthology.orchestra.run.smithi057.stderr: 79.2% -- replaced with /var/log/ceph/ceph-client.admin.547135.log.gz 2024-03-27T19:55:10.762 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.51636.log: 91.7% -- replaced with /var/log/ceph/ceph-client.admin.246477.log.gz 2024-03-27T19:55:10.762 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.259638.log 2024-03-27T19:55:10.764 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.426082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.427359.log 2024-03-27T19:55:10.765 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.259638.log: 94.1% -- replaced with /var/log/ceph/ceph-client.admin.201211.log.gz 2024-03-27T19:55:10.765 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.209739.log 2024-03-27T19:55:10.766 INFO:teuthology.orchestra.run.smithi057.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42665.log.gz 2024-03-27T19:55:10.766 INFO:teuthology.orchestra.run.smithi057.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42834.log.gz/var/log/ceph/ceph-client.admin.427359.log: 2024-03-27T19:55:10.767 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44540.log 2024-03-27T19:55:10.767 INFO:teuthology.orchestra.run.smithi057.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44846.log.gz 2024-03-27T19:55:10.768 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.209739.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46949.log.gz 2024-03-27T19:55:10.768 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.485994.log 2024-03-27T19:55:10.770 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.44540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42584.log 2024-03-27T19:55:10.772 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.485994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147997.log 2024-03-27T19:55:10.772 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.42584.log: 93.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.209748.log.gz 2024-03-27T19:55:10.773 INFO:teuthology.orchestra.run.smithi057.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.239603.log 2024-03-27T19:55:10.773 INFO:teuthology.orchestra.run.smithi057.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50025.log.gz 2024-03-27T19:55:10.773 INFO:teuthology.orchestra.run.smithi057.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51117.log.gz 2024-03-27T19:55:10.774 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.147997.log: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.493413.log.gz 2024-03-27T19:55:10.774 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.213244.log 2024-03-27T19:55:10.776 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.239603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.423503.log 2024-03-27T19:55:10.777 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.213244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.490806.log 2024-03-27T19:55:10.778 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.423503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.530692.log 2024-03-27T19:55:10.779 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.490806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.531619.log 2024-03-27T19:55:10.781 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.530692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.205232.log 2024-03-27T19:55:10.782 INFO:teuthology.orchestra.run.smithi057.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.530692.log.gz 2024-03-27T19:55:10.782 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.531619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51510.log 2024-03-27T19:55:10.783 INFO:teuthology.orchestra.run.smithi057.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.531619.log.gz 2024-03-27T19:55:10.784 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.205232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.489479.log 2024-03-27T19:55:10.785 INFO:teuthology.orchestra.run.smithi057.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.417974.log.gz 2024-03-27T19:55:10.785 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.51510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160397.log 2024-03-27T19:55:10.786 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.489479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253739.log 2024-03-27T19:55:10.787 INFO:teuthology.orchestra.run.smithi057.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.113444.log.gz 2024-03-27T19:55:10.788 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.160397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.237459.log 2024-03-27T19:55:10.790 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.253739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.537452.log 2024-03-27T19:55:10.790 INFO:teuthology.orchestra.run.smithi057.stderr: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.147997.log.gz 2024-03-27T19:55:10.791 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.237459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.430354.log 2024-03-27T19:55:10.791 INFO:teuthology.orchestra.run.smithi057.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.230562.log.gz 2024-03-27T19:55:10.791 INFO:teuthology.orchestra.run.smithi057.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.157772.log.gz 2024-03-27T19:55:10.793 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.537452.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.360232.log.gz 2024-03-27T19:55:10.793 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.328249.log.gz 2024-03-27T19:55:10.793 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247347.log 2024-03-27T19:55:10.794 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.430354.log: 81.4% 84.8% -- replaced with /var/log/ceph/ceph-client.admin.235141.log.gz -- replaced with /var/log/ceph/ceph-client.admin.207939.log.gz 2024-03-27T19:55:10.794 INFO:teuthology.orchestra.run.smithi057.stderr: 2024-03-27T19:55:10.794 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.471168.log 2024-03-27T19:55:10.795 INFO:teuthology.orchestra.run.smithi057.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.537452.log.gz 2024-03-27T19:55:10.796 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.247347.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-03-27T19:55:10.796 INFO:teuthology.orchestra.run.smithi057.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.519969.log.gz 2024-03-27T19:55:10.797 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.471168.log: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.209739.log.gz 2024-03-27T19:55:10.797 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.220931.log 2024-03-27T19:55:10.798 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.217035.log.gz 2024-03-27T19:55:10.798 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-mds.a.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.258269.log.gz 2024-03-27T19:55:10.799 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.358503.log 2024-03-27T19:55:10.799 INFO:teuthology.orchestra.run.smithi057.stderr: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.239603.log.gz 2024-03-27T19:55:10.800 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.220931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.346262.log 2024-03-27T19:55:10.802 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.358503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.260907.log 2024-03-27T19:55:10.802 INFO:teuthology.orchestra.run.smithi057.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.272987.log.gz 2024-03-27T19:55:10.803 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.346262.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.272996.log.gz 2024-03-27T19:55:10.803 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.211097.log 2024-03-27T19:55:10.804 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.260907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.538795.log 2024-03-27T19:55:10.806 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.211097.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.219166.log.gz 2024-03-27T19:55:10.806 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114298.log 2024-03-27T19:55:10.806 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.275128.log.gz 2024-03-27T19:55:10.807 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.538795.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.324013.log.gz 2024-03-27T19:55:10.807 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199021.log 2024-03-27T19:55:10.807 INFO:teuthology.orchestra.run.smithi057.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.538795.log.gz 2024-03-27T19:55:10.808 INFO:teuthology.orchestra.run.smithi057.stderr: 83.9% -- replaced with /var/log/ceph/ceph-client.admin.253739.log.gz 2024-03-27T19:55:10.809 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.114298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.362006.log 2024-03-27T19:55:10.809 INFO:teuthology.orchestra.run.smithi057.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.286889.log.gz 2024-03-27T19:55:10.809 INFO:teuthology.orchestra.run.smithi057.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.347593.log.gz 2024-03-27T19:55:10.810 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.199021.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.466692.log.gz 2024-03-27T19:55:10.810 INFO:teuthology.orchestra.run.smithi057.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.502201.log.gz 2024-03-27T19:55:10.811 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.544023.log 2024-03-27T19:55:10.811 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.362006.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.503898.log.gz 2024-03-27T19:55:10.811 INFO:teuthology.orchestra.run.smithi057.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.430354.log.gz 2024-03-27T19:55:10.812 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156890.log 2024-03-27T19:55:10.814 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.544023.log: 77.4% -- replaced with /var/log/ceph/ceph-client.admin.376280.log.gz 2024-03-27T19:55:10.814 INFO:teuthology.orchestra.run.smithi057.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.471168.log.gz 2024-03-27T19:55:10.814 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.156890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115881.log 2024-03-27T19:55:10.815 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.484240.log.gz 2024-03-27T19:55:10.815 INFO:teuthology.orchestra.run.smithi057.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.427359.log.gz 2024-03-27T19:55:10.816 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49677.log 2024-03-27T19:55:10.817 INFO:teuthology.orchestra.run.smithi057.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.427368.log.gz 2024-03-27T19:55:10.817 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.115881.log: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.544023.log.gz 2024-03-27T19:55:10.817 INFO:teuthology.orchestra.run.smithi057.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.203883.log.gz 2024-03-27T19:55:10.818 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.537949.log 2024-03-27T19:55:10.819 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.49677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.550242.log 2024-03-27T19:55:10.821 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.537949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.404911.log 2024-03-27T19:55:10.821 INFO:teuthology.orchestra.run.smithi057.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.537949.log.gz 2024-03-27T19:55:10.822 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.550242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.370891.log 2024-03-27T19:55:10.824 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.404911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.482201.log 2024-03-27T19:55:10.824 INFO:teuthology.orchestra.run.smithi057.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.192474.log.gz 2024-03-27T19:55:10.824 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.370891.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42584.log.gz 2024-03-27T19:55:10.825 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.265580.log 2024-03-27T19:55:10.825 INFO:teuthology.orchestra.run.smithi057.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.550242.log.gz 2024-03-27T19:55:10.826 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.482201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.422223.log 2024-03-27T19:55:10.828 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.265580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.540984.log 2024-03-27T19:55:10.829 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.422223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.414948.log 2024-03-27T19:55:10.831 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.540984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.497224.log 2024-03-27T19:55:10.831 INFO:teuthology.orchestra.run.smithi057.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.540984.log.gz 2024-03-27T19:55:10.832 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.414948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.501103.log 2024-03-27T19:55:10.833 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.497224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142721.log 2024-03-27T19:55:10.836 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.501103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.419690.log 2024-03-27T19:55:10.836 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.142721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.228377.log 2024-03-27T19:55:10.837 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.419690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.552045.log 2024-03-27T19:55:10.839 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.228377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.415816.log 2024-03-27T19:55:10.841 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.552045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.556046.log 2024-03-27T19:55:10.841 INFO:teuthology.orchestra.run.smithi057.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.409713.log.gz 2024-03-27T19:55:10.843 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.415816.log: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.365857.log.gz 2024-03-27T19:55:10.843 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.556046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46737.log 2024-03-27T19:55:10.843 INFO:teuthology.orchestra.run.smithi057.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44540.log.gz 2024-03-27T19:55:10.844 INFO:teuthology.orchestra.run.smithi057.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.552045.log.gz 2024-03-27T19:55:10.844 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118185.log 2024-03-27T19:55:10.845 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.46737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.347171.log 2024-03-27T19:55:10.847 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.118185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.421375.log 2024-03-27T19:55:10.848 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.347171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189383.log 2024-03-27T19:55:10.850 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.421375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.205684.log 2024-03-27T19:55:10.850 INFO:teuthology.orchestra.run.smithi057.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43048.log.gz 2024-03-27T19:55:10.851 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.189383.log: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.246912.log.gz 2024-03-27T19:55:10.852 INFO:teuthology.orchestra.run.smithi057.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.469407.log.gz 2024-03-27T19:55:10.852 INFO:teuthology.orchestra.run.smithi057.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52698.log.gz 2024-03-27T19:55:10.853 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.205684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.536953.log 2024-03-27T19:55:10.855 INFO:teuthology.orchestra.run.smithi057.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.325713.log 2024-03-27T19:55:10.855 INFO:teuthology.orchestra.run.smithi057.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.409290.log.gz 2024-03-27T19:55:10.856 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.536953.log: 79.4% -- replaced with /var/log/ceph/ceph-client.admin.536953.log.gz 2024-03-27T19:55:10.856 INFO:teuthology.orchestra.run.smithi057.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.207948.log.gz 2024-03-27T19:55:10.859 INFO:teuthology.orchestra.run.smithi057.stderr:/var/log/ceph/ceph-client.admin.325713.log: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.419269.log.gz 2024-03-27T19:55:10.859 INFO:teuthology.orchestra.run.smithi057.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.136801.log.gz 2024-03-27T19:55:10.860 INFO:teuthology.orchestra.run.smithi057.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.118185.log.gz 2024-03-27T19:55:10.863 INFO:teuthology.orchestra.run.smithi057.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.114298.log.gz 2024-03-27T19:55:10.868 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.414948.log.gz 2024-03-27T19:55:10.877 INFO:teuthology.orchestra.run.smithi057.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.131218.log.gz 2024-03-27T19:55:10.880 INFO:teuthology.orchestra.run.smithi057.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.527131.log.gz 2024-03-27T19:55:10.882 INFO:teuthology.orchestra.run.smithi057.stderr: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.220931.log.gz 2024-03-27T19:55:10.882 INFO:teuthology.orchestra.run.smithi057.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.221833.log.gz 2024-03-27T19:55:10.889 INFO:teuthology.orchestra.run.smithi057.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.265580.log.gz 2024-03-27T19:55:10.889 INFO:teuthology.orchestra.run.smithi057.stderr: 77.5% -- replaced with /var/log/ceph/ceph-client.admin.279036.log.gz 2024-03-27T19:55:10.893 INFO:teuthology.orchestra.run.smithi057.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.325713.log.gz 2024-03-27T19:55:10.895 INFO:teuthology.orchestra.run.smithi057.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.362006.log.gz 2024-03-27T19:55:10.898 INFO:teuthology.orchestra.run.smithi057.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.228368.log.gz 2024-03-27T19:55:10.901 INFO:teuthology.orchestra.run.smithi057.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.160397.log.gz 2024-03-27T19:55:10.902 INFO:teuthology.orchestra.run.smithi057.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.288159.log.gz 2024-03-27T19:55:10.902 INFO:teuthology.orchestra.run.smithi057.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.472422.log.gz 2024-03-27T19:55:10.915 INFO:teuthology.orchestra.run.smithi057.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.216182.log.gz 2024-03-27T19:55:10.915 INFO:teuthology.orchestra.run.smithi057.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52014.log.gz 2024-03-27T19:55:10.918 INFO:teuthology.orchestra.run.smithi057.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.205232.log.gz 2024-03-27T19:55:10.925 INFO:teuthology.orchestra.run.smithi057.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.189817.log.gz 2024-03-27T19:55:10.927 INFO:teuthology.orchestra.run.smithi057.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.211977.log.gz 2024-03-27T19:55:10.928 INFO:teuthology.orchestra.run.smithi057.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.285028.log.gz 2024-03-27T19:55:10.931 INFO:teuthology.orchestra.run.smithi057.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.333755.log.gz 2024-03-27T19:55:10.932 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.442779.log.gz 2024-03-27T19:55:10.932 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.365436.log.gz 2024-03-27T19:55:10.952 INFO:teuthology.orchestra.run.smithi057.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.527983.log.gz 2024-03-27T19:55:10.953 INFO:teuthology.orchestra.run.smithi057.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.457475.log.gz 2024-03-27T19:55:10.954 INFO:teuthology.orchestra.run.smithi057.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.223547.log.gz 2024-03-27T19:55:10.956 INFO:teuthology.orchestra.run.smithi057.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.211097.log.gz 2024-03-27T19:55:10.958 INFO:teuthology.orchestra.run.smithi057.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48893.log.gz 2024-03-27T19:55:10.958 INFO:teuthology.orchestra.run.smithi057.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.253326.log.gz 2024-03-27T19:55:10.965 INFO:teuthology.orchestra.run.smithi057.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45860.log.gz 2024-03-27T19:55:10.966 INFO:teuthology.orchestra.run.smithi057.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46149.log.gz 2024-03-27T19:55:10.969 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.465858.log.gz 2024-03-27T19:55:10.970 INFO:teuthology.orchestra.run.smithi057.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49619.log.gz 2024-03-27T19:55:10.971 INFO:teuthology.orchestra.run.smithi057.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.521236.log.gz 2024-03-27T19:55:10.973 INFO:teuthology.orchestra.run.smithi057.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.494258.log.gz 2024-03-27T19:55:10.974 INFO:teuthology.orchestra.run.smithi057.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.135072.log.gz 2024-03-27T19:55:10.974 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.419699.log.gz 2024-03-27T19:55:10.974 INFO:teuthology.orchestra.run.smithi057.stderr: 79.3% -- replaced with /var/log/ceph/ceph-client.admin.131630.log.gz 2024-03-27T19:55:10.975 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.425238.log.gz 2024-03-27T19:55:10.977 INFO:teuthology.orchestra.run.smithi057.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.513344.log.gz 2024-03-27T19:55:10.978 INFO:teuthology.orchestra.run.smithi057.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.284135.log.gz 2024-03-27T19:55:10.983 INFO:teuthology.orchestra.run.smithi057.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.184011.log.gz 2024-03-27T19:55:10.992 INFO:teuthology.orchestra.run.smithi057.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.222706.log.gz 2024-03-27T19:55:10.994 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.230992.log.gz 2024-03-27T19:55:11.002 INFO:teuthology.orchestra.run.smithi057.stderr: 78.2% -- replaced with /var/log/ceph/ceph-client.admin.266423.log.gz 2024-03-27T19:55:11.002 INFO:teuthology.orchestra.run.smithi057.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.267701.log.gz 2024-03-27T19:55:11.002 INFO:teuthology.orchestra.run.smithi057.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.168788.log.gz 2024-03-27T19:55:11.004 INFO:teuthology.orchestra.run.smithi057.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.323155.log.gz 2024-03-27T19:55:11.009 INFO:teuthology.orchestra.run.smithi057.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.271724.log.gz 2024-03-27T19:55:11.023 INFO:teuthology.orchestra.run.smithi057.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.243459.log.gz 2024-03-27T19:55:11.027 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.259217.log.gz 2024-03-27T19:55:11.030 INFO:teuthology.orchestra.run.smithi057.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.191146.log.gz 2024-03-27T19:55:11.041 INFO:teuthology.orchestra.run.smithi057.stderr: 92.3% 84.3% -- replaced with /var/log/ceph/ceph-client.admin.467119.log.gz 2024-03-27T19:55:11.042 INFO:teuthology.orchestra.run.smithi057.stderr: -- replaced with /var/log/ceph/ceph-client.admin.159470.log.gz 2024-03-27T19:55:11.045 INFO:teuthology.orchestra.run.smithi057.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.468091.log.gz 2024-03-27T19:55:11.045 INFO:teuthology.orchestra.run.smithi057.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.168348.log.gz 2024-03-27T19:55:11.046 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.470747.log.gz 2024-03-27T19:55:11.046 INFO:teuthology.orchestra.run.smithi057.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.478572.log.gz 2024-03-27T19:55:11.047 INFO:teuthology.orchestra.run.smithi057.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.368629.log.gz 2024-03-27T19:55:11.048 INFO:teuthology.orchestra.run.smithi057.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51636.log.gz 2024-03-27T19:55:11.058 INFO:teuthology.orchestra.run.smithi057.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.368620.log.gz 2024-03-27T19:55:11.070 INFO:teuthology.orchestra.run.smithi057.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.431187.log.gz 2024-03-27T19:55:11.070 INFO:teuthology.orchestra.run.smithi057.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.346262.log.gz 2024-03-27T19:55:11.071 INFO:teuthology.orchestra.run.smithi057.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42920.log.gz 2024-03-27T19:55:11.076 INFO:teuthology.orchestra.run.smithi057.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.206582.log.gz 2024-03-27T19:55:11.077 INFO:teuthology.orchestra.run.smithi057.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.141037.log.gz 2024-03-27T19:55:11.079 INFO:teuthology.orchestra.run.smithi057.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.443199.log.gz 2024-03-27T19:55:11.082 INFO:teuthology.orchestra.run.smithi057.stderr: 77.5% -- replaced with /var/log/ceph/ceph-client.admin.445142.log.gz 2024-03-27T19:55:11.083 INFO:teuthology.orchestra.run.smithi057.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48378.log.gz 2024-03-27T19:55:11.083 INFO:teuthology.orchestra.run.smithi057.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.460086.log.gz 2024-03-27T19:55:11.083 INFO:teuthology.orchestra.run.smithi057.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43218.log.gz 2024-03-27T19:55:11.084 INFO:teuthology.orchestra.run.smithi057.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46191.log.gz 2024-03-27T19:55:11.088 INFO:teuthology.orchestra.run.smithi057.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.189383.log.gz 2024-03-27T19:55:11.089 INFO:teuthology.orchestra.run.smithi057.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50151.log.gz 2024-03-27T19:55:11.089 INFO:teuthology.orchestra.run.smithi057.stderr: 93.0% 80.9% -- replaced with /var/log/ceph/ceph-client.admin.193381.log.gz 2024-03-27T19:55:11.090 INFO:teuthology.orchestra.run.smithi057.stderr: -- replaced with /var/log/ceph/ceph-client.admin.537706.log.gz 2024-03-27T19:55:11.090 INFO:teuthology.orchestra.run.smithi057.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50193.log.gz 2024-03-27T19:55:11.095 INFO:teuthology.orchestra.run.smithi057.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.287321.log.gz 2024-03-27T19:55:11.095 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.493846.log.gz 2024-03-27T19:55:11.096 INFO:teuthology.orchestra.run.smithi057.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.474669.log.gz 2024-03-27T19:55:11.104 INFO:teuthology.orchestra.run.smithi057.stderr: 78.6% -- replaced with /var/log/ceph/ceph-client.admin.512049.log.gz 2024-03-27T19:55:11.105 INFO:teuthology.orchestra.run.smithi057.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.147570.log.gz 2024-03-27T19:55:11.106 INFO:teuthology.orchestra.run.smithi057.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.147158.log.gz 2024-03-27T19:55:11.109 INFO:teuthology.orchestra.run.smithi057.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.135962.log.gz 2024-03-27T19:55:11.110 INFO:teuthology.orchestra.run.smithi057.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.167346.log.gz 2024-03-27T19:55:11.113 INFO:teuthology.orchestra.run.smithi057.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46569.log.gz 2024-03-27T19:55:11.113 INFO:teuthology.orchestra.run.smithi057.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.46527.log.gz 2024-03-27T19:55:11.115 INFO:teuthology.orchestra.run.smithi057.stderr: 83.3% -- replaced with /var/log/ceph/ceph-client.admin.336930.log.gz 2024-03-27T19:55:11.116 INFO:teuthology.orchestra.run.smithi057.stderr: 78.4% -- replaced with /var/log/ceph/ceph-client.admin.189808.log.gz 2024-03-27T19:55:11.117 INFO:teuthology.orchestra.run.smithi057.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.245596.log.gz 2024-03-27T19:55:11.117 INFO:teuthology.orchestra.run.smithi057.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.190733.log.gz 2024-03-27T19:55:11.117 INFO:teuthology.orchestra.run.smithi057.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.203004.log.gz 2024-03-27T19:55:11.118 INFO:teuthology.orchestra.run.smithi057.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.224388.log.gz 2024-03-27T19:55:11.118 INFO:teuthology.orchestra.run.smithi057.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.246903.log.gz 2024-03-27T19:55:11.119 INFO:teuthology.orchestra.run.smithi057.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.261333.log.gz 2024-03-27T19:55:11.119 INFO:teuthology.orchestra.run.smithi057.stderr: 78.1% -- replaced with /var/log/ceph/ceph-client.admin.260055.log.gz 2024-03-27T19:55:11.119 INFO:teuthology.orchestra.run.smithi057.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.518692.log.gz 2024-03-27T19:55:11.120 INFO:teuthology.orchestra.run.smithi057.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.254597.log.gz 2024-03-27T19:55:11.120 INFO:teuthology.orchestra.run.smithi057.stderr: 77.4% -- replaced with /var/log/ceph/ceph-client.admin.342015.log.gz 2024-03-27T19:55:11.153 INFO:teuthology.orchestra.run.smithi057.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.402347.log.gz 2024-03-27T19:55:11.156 INFO:teuthology.orchestra.run.smithi057.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.404483.log.gz 2024-03-27T19:55:11.160 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.406534.log.gz 2024-03-27T19:55:11.162 INFO:teuthology.orchestra.run.smithi057.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.257005.log.gz 2024-03-27T19:55:11.184 INFO:teuthology.orchestra.run.smithi057.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.505638.log.gz 2024-03-27T19:55:11.186 INFO:teuthology.orchestra.run.smithi057.stderr: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.520381.log.gz 2024-03-27T19:55:11.191 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.354787.log.gz 2024-03-27T19:55:11.191 INFO:teuthology.orchestra.run.smithi057.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.428205.log.gz 2024-03-27T19:55:11.193 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.429932.log.gz 2024-03-27T19:55:11.200 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.486417.log.gz 2024-03-27T19:55:11.211 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.440211.log.gz 2024-03-27T19:55:11.224 INFO:teuthology.orchestra.run.smithi057.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.133343.log.gz 2024-03-27T19:55:11.225 INFO:teuthology.orchestra.run.smithi057.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.132930.log.gz 2024-03-27T19:55:11.233 INFO:teuthology.orchestra.run.smithi057.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.admin.285517.log.gz 2024-03-27T19:55:11.242 INFO:teuthology.orchestra.run.smithi057.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48799.log.gz 2024-03-27T19:55:11.247 INFO:teuthology.orchestra.run.smithi057.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.333329.log.gz 2024-03-27T19:55:11.248 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.332905.log.gz 2024-03-27T19:55:11.249 INFO:teuthology.orchestra.run.smithi057.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.441049.log.gz 2024-03-27T19:55:11.249 INFO:teuthology.orchestra.run.smithi057.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.440202.log.gz 2024-03-27T19:55:11.249 INFO:teuthology.orchestra.run.smithi057.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45567.log.gz 2024-03-27T19:55:11.251 INFO:teuthology.orchestra.run.smithi057.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.410583.log.gz 2024-03-27T19:55:11.251 INFO:teuthology.orchestra.run.smithi057.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.411431.log.gz 2024-03-27T19:55:11.253 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.331218.log.gz 2024-03-27T19:55:11.253 INFO:teuthology.orchestra.run.smithi057.stderr: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.140607.log.gz 2024-03-27T19:55:11.254 INFO:teuthology.orchestra.run.smithi057.stderr: 81.3% 89.8% -- replaced with /var/log/ceph/ceph-client.admin.147579.log.gz -- replaced with /var/log/ceph/ceph-client.admin.144892.log.gz 2024-03-27T19:55:11.254 INFO:teuthology.orchestra.run.smithi057.stderr: 2024-03-27T19:55:11.255 INFO:teuthology.orchestra.run.smithi057.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.496386.log.gz 2024-03-27T19:55:11.255 INFO:teuthology.orchestra.run.smithi057.stderr: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.151548.log.gz 2024-03-27T19:55:11.255 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.158201.log.gz 2024-03-27T19:55:11.257 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.113453.log.gz 2024-03-27T19:55:11.258 INFO:teuthology.orchestra.run.smithi057.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.416233.log.gz 2024-03-27T19:55:11.260 INFO:teuthology.orchestra.run.smithi057.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.227526.log.gz 2024-03-27T19:55:11.261 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.414096.log.gz 2024-03-27T19:55:11.264 INFO:teuthology.orchestra.run.smithi057.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.201202.log.gz 2024-03-27T19:55:11.265 INFO:teuthology.orchestra.run.smithi057.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.267710.log.gz 2024-03-27T19:55:11.268 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.342865.log.gz 2024-03-27T19:55:11.269 INFO:teuthology.orchestra.run.smithi057.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.527974.log.gz 2024-03-27T19:55:11.274 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.426942.log.gz 2024-03-27T19:55:11.286 INFO:teuthology.orchestra.run.smithi057.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.400627.log.gz 2024-03-27T19:55:11.289 INFO:teuthology.orchestra.run.smithi057.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44062.log.gz 2024-03-27T19:55:11.295 INFO:teuthology.orchestra.run.smithi057.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.462867.log.gz 2024-03-27T19:55:11.303 INFO:teuthology.orchestra.run.smithi057.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.admin.245152.log.gz 2024-03-27T19:55:11.307 INFO:teuthology.orchestra.run.smithi057.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.398300.log.gz 2024-03-27T19:55:11.308 INFO:teuthology.orchestra.run.smithi057.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.129904.log.gz 2024-03-27T19:55:11.309 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.428636.log.gz 2024-03-27T19:55:11.332 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.269207.log.gz 2024-03-27T19:55:11.333 INFO:teuthology.orchestra.run.smithi057.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.484231.log.gz 2024-03-27T19:55:11.335 INFO:teuthology.orchestra.run.smithi057.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.464581.log.gz 2024-03-27T19:55:11.345 INFO:teuthology.orchestra.run.smithi057.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.370016.log.gz 2024-03-27T19:55:11.368 INFO:teuthology.orchestra.run.smithi057.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.429469.log.gz 2024-03-27T19:55:11.383 INFO:teuthology.orchestra.run.smithi057.stderr: 77.5% -- replaced with /var/log/ceph/ceph-client.admin.336417.log.gz 2024-03-27T19:55:11.383 INFO:teuthology.orchestra.run.smithi057.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.356631.log.gz 2024-03-27T19:55:11.383 INFO:teuthology.orchestra.run.smithi057.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48336.log.gz 2024-03-27T19:55:11.387 INFO:teuthology.orchestra.run.smithi057.stderr: 77.5% -- replaced with /var/log/ceph/ceph-client.admin.520803.log.gz 2024-03-27T19:55:11.410 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.440632.log.gz 2024-03-27T19:55:11.416 INFO:teuthology.orchestra.run.smithi057.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.121812.log.gz 2024-03-27T19:55:11.417 INFO:teuthology.orchestra.run.smithi057.stderr: 78.1% -- replaced with /var/log/ceph/ceph-client.admin.413661.log.gz 2024-03-27T19:55:11.418 INFO:teuthology.orchestra.run.smithi057.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.144901.log.gz 2024-03-27T19:55:11.420 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.397466.log.gz 2024-03-27T19:55:11.434 INFO:teuthology.orchestra.run.smithi057.stderr: 78.2% -- replaced with /var/log/ceph/ceph-client.admin.338614.log.gz 2024-03-27T19:55:11.435 INFO:teuthology.orchestra.run.smithi057.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.275970.log.gz 2024-03-27T19:55:11.437 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.184020.log.gz 2024-03-27T19:55:11.438 INFO:teuthology.orchestra.run.smithi057.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.220482.log.gz 2024-03-27T19:55:11.440 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.223556.log.gz 2024-03-27T19:55:11.440 INFO:teuthology.orchestra.run.smithi057.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.157335.log.gz 2024-03-27T19:55:11.442 INFO:teuthology.orchestra.run.smithi057.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.257848.log.gz 2024-03-27T19:55:11.444 INFO:teuthology.orchestra.run.smithi057.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.424357.log.gz 2024-03-27T19:55:11.447 INFO:teuthology.orchestra.run.smithi057.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.73542.log.gz 2024-03-27T19:55:11.452 INFO:teuthology.orchestra.run.smithi057.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.203013.log.gz 2024-03-27T19:55:11.452 INFO:teuthology.orchestra.run.smithi057.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.343286.log.gz 2024-03-27T19:55:11.467 INFO:teuthology.orchestra.run.smithi057.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.350132.log.gz 2024-03-27T19:55:11.469 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.288168.log.gz 2024-03-27T19:55:11.480 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.469845.log.gz 2024-03-27T19:55:11.482 INFO:teuthology.orchestra.run.smithi057.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.238717.log.gz 2024-03-27T19:55:11.484 INFO:teuthology.orchestra.run.smithi057.stderr: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.250010.log.gz 2024-03-27T19:55:11.485 INFO:teuthology.orchestra.run.smithi057.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.357112.log.gz 2024-03-27T19:55:11.497 INFO:teuthology.orchestra.run.smithi057.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.489023.log.gz 2024-03-27T19:55:11.505 INFO:teuthology.orchestra.run.smithi057.stderr: 77.2% -- replaced with /var/log/ceph/ceph-client.admin.485140.log.gz 2024-03-27T19:55:11.513 INFO:teuthology.orchestra.run.smithi057.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.167355.log.gz 2024-03-27T19:55:11.514 INFO:teuthology.orchestra.run.smithi057.stderr: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.411836.log.gz 2024-03-27T19:55:11.520 INFO:teuthology.orchestra.run.smithi057.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.365427.log.gz 2024-03-27T19:55:11.526 INFO:teuthology.orchestra.run.smithi057.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.187003.log.gz 2024-03-27T19:55:11.526 INFO:teuthology.orchestra.run.smithi057.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.134194.log.gz 2024-03-27T19:55:11.542 INFO:teuthology.orchestra.run.smithi057.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.457054.log.gz 2024-03-27T19:55:11.545 INFO:teuthology.orchestra.run.smithi057.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48294.log.gz 2024-03-27T19:55:11.548 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.480374.log.gz 2024-03-27T19:55:11.550 INFO:teuthology.orchestra.run.smithi057.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43344.log.gz 2024-03-27T19:55:11.582 INFO:teuthology.orchestra.run.smithi057.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.396565.log.gz 2024-03-27T19:55:11.586 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.397887.log.gz 2024-03-27T19:55:11.604 INFO:teuthology.orchestra.run.smithi057.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.112836.log.gz 2024-03-27T19:55:11.605 INFO:teuthology.orchestra.run.smithi057.stderr: 77.2% -- replaced with /var/log/ceph/ceph-client.admin.148858.log.gz 2024-03-27T19:55:11.609 INFO:teuthology.orchestra.run.smithi057.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.344129.log.gz 2024-03-27T19:55:11.612 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.401056.log.gz 2024-03-27T19:55:11.613 INFO:teuthology.orchestra.run.smithi057.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.203874.log.gz 2024-03-27T19:55:11.616 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.492936.log.gz 2024-03-27T19:55:11.621 INFO:teuthology.orchestra.run.smithi057.stderr: 83.4% -- replaced with /var/log/ceph/ceph-client.admin.445984.log.gz 2024-03-27T19:55:11.634 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.332485.log.gz 2024-03-27T19:55:11.641 INFO:teuthology.orchestra.run.smithi057.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.243450.log.gz 2024-03-27T19:55:11.642 INFO:teuthology.orchestra.run.smithi057.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.192465.log.gz 2024-03-27T19:55:11.644 INFO:teuthology.orchestra.run.smithi057.stderr: 83.1% -- replaced with /var/log/ceph/ceph-client.admin.210638.log.gz 2024-03-27T19:55:11.647 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.214086.log.gz 2024-03-27T19:55:11.649 INFO:teuthology.orchestra.run.smithi057.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.193878.log.gz 2024-03-27T19:55:11.651 INFO:teuthology.orchestra.run.smithi057.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.247839.log.gz 2024-03-27T19:55:11.667 INFO:teuthology.orchestra.run.smithi057.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.331209.log.gz 2024-03-27T19:55:11.672 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.415390.log.gz 2024-03-27T19:55:11.682 INFO:teuthology.orchestra.run.smithi057.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.491665.log.gz 2024-03-27T19:55:11.685 INFO:teuthology.orchestra.run.smithi057.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.273408.log.gz 2024-03-27T19:55:11.690 INFO:teuthology.orchestra.run.smithi057.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.485573.log.gz 2024-03-27T19:55:11.706 INFO:teuthology.orchestra.run.smithi057.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.184869.log.gz 2024-03-27T19:55:11.710 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.230149.log.gz 2024-03-27T19:55:11.712 INFO:teuthology.orchestra.run.smithi057.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.255484.log.gz 2024-03-27T19:55:11.714 INFO:teuthology.orchestra.run.smithi057.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.459190.log.gz 2024-03-27T19:55:11.715 INFO:teuthology.orchestra.run.smithi057.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44414.log.gz 2024-03-27T19:55:11.715 INFO:teuthology.orchestra.run.smithi057.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48546.log.gz 2024-03-27T19:55:11.715 INFO:teuthology.orchestra.run.smithi057.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.278590.log.gz 2024-03-27T19:55:11.723 INFO:teuthology.orchestra.run.smithi057.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.235150.log.gz 2024-03-27T19:55:11.723 INFO:teuthology.orchestra.run.smithi057.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.284144.log.gz 2024-03-27T19:55:11.729 INFO:teuthology.orchestra.run.smithi057.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50913.log.gz 2024-03-27T19:55:11.747 INFO:teuthology.orchestra.run.smithi057.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.53387.log.gz 2024-03-27T19:55:11.747 INFO:teuthology.orchestra.run.smithi057.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.494267.log.gz 2024-03-27T19:55:11.750 INFO:teuthology.orchestra.run.smithi057.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.148424.log.gz 2024-03-27T19:55:11.753 INFO:teuthology.orchestra.run.smithi057.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.123803.log.gz 2024-03-27T19:55:11.758 INFO:teuthology.orchestra.run.smithi057.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.139772.log.gz 2024-03-27T19:55:11.758 INFO:teuthology.orchestra.run.smithi057.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.37158.log.gz 2024-03-27T19:55:11.759 INFO:teuthology.orchestra.run.smithi057.stderr: 78.1% -- replaced with /var/log/ceph/ceph-client.admin.151120.log.gz 2024-03-27T19:55:11.760 INFO:teuthology.orchestra.run.smithi057.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.348868.log.gz 2024-03-27T19:55:11.774 INFO:teuthology.orchestra.run.smithi057.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.157344.log.gz 2024-03-27T19:55:11.786 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.227956.log.gz 2024-03-27T19:55:11.787 INFO:teuthology.orchestra.run.smithi057.stderr: 83.9% -- replaced with /var/log/ceph/ceph-client.admin.238295.log.gz 2024-03-27T19:55:11.799 INFO:teuthology.orchestra.run.smithi057.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.416699.log.gz 2024-03-27T19:55:11.845 INFO:teuthology.orchestra.run.smithi057.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.332065.log.gz 2024-03-27T19:55:11.857 INFO:teuthology.orchestra.run.smithi057.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.428627.log.gz 2024-03-27T19:55:11.870 INFO:teuthology.orchestra.run.smithi057.stderr: 83.9% -- replaced with /var/log/ceph/ceph-client.admin.365005.log.gz 2024-03-27T19:55:11.897 INFO:teuthology.orchestra.run.smithi057.stderr: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.526709.log.gz 2024-03-27T19:55:11.903 INFO:teuthology.orchestra.run.smithi057.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44930.log.gz 2024-03-27T19:55:11.903 INFO:teuthology.orchestra.run.smithi057.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45239.log.gz 2024-03-27T19:55:11.906 INFO:teuthology.orchestra.run.smithi057.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49146.log.gz 2024-03-27T19:55:11.912 INFO:teuthology.orchestra.run.smithi057.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45841.log.gz 2024-03-27T19:55:11.912 INFO:teuthology.orchestra.run.smithi057.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49314.log.gz 2024-03-27T19:55:11.912 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.423086.log.gz 2024-03-27T19:55:11.913 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.492087.log.gz 2024-03-27T19:55:11.916 INFO:teuthology.orchestra.run.smithi057.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.222263.log.gz 2024-03-27T19:55:11.944 INFO:teuthology.orchestra.run.smithi057.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.284581.log.gz 2024-03-27T19:55:11.944 INFO:teuthology.orchestra.run.smithi057.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.240878.log.gz 2024-03-27T19:55:11.950 INFO:teuthology.orchestra.run.smithi057.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.238304.log.gz 2024-03-27T19:55:11.960 INFO:teuthology.orchestra.run.smithi057.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.217026.log.gz 2024-03-27T19:55:11.965 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.323585.log.gz 2024-03-27T19:55:11.967 INFO:teuthology.orchestra.run.smithi057.stderr: 78.0% -- replaced with /var/log/ceph/ceph-client.admin.255009.log.gz 2024-03-27T19:55:11.969 INFO:teuthology.orchestra.run.smithi057.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.274707.log.gz 2024-03-27T19:55:11.995 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.260490.log.gz 2024-03-27T19:55:12.017 INFO:teuthology.orchestra.run.smithi057.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.469398.log.gz 2024-03-27T19:55:12.055 INFO:teuthology.orchestra.run.smithi057.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.458738.log.gz 2024-03-27T19:55:12.057 INFO:teuthology.orchestra.run.smithi057.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.483388.log.gz 2024-03-27T19:55:12.062 INFO:teuthology.orchestra.run.smithi057.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44146.log.gz 2024-03-27T19:55:12.062 INFO:teuthology.orchestra.run.smithi057.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44272.log.gz 2024-03-27T19:55:12.063 INFO:teuthology.orchestra.run.smithi057.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48630.log.gz 2024-03-27T19:55:12.067 INFO:teuthology.orchestra.run.smithi057.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45911.log.gz 2024-03-27T19:55:12.068 INFO:teuthology.orchestra.run.smithi057.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49965.log.gz 2024-03-27T19:55:12.093 INFO:teuthology.orchestra.run.smithi057.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.136384.log.gz 2024-03-27T19:55:12.094 INFO:teuthology.orchestra.run.smithi057.stderr: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.329514.log.gz 2024-03-27T19:55:12.094 INFO:teuthology.orchestra.run.smithi057.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.143145.log.gz 2024-03-27T19:55:12.095 INFO:teuthology.orchestra.run.smithi057.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.276866.log.gz 2024-03-27T19:55:12.095 INFO:teuthology.orchestra.run.smithi057.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.266849.log.gz 2024-03-27T19:55:12.099 INFO:teuthology.orchestra.run.smithi057.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.116735.log.gz 2024-03-27T19:55:12.106 INFO:teuthology.orchestra.run.smithi057.stderr: 94.3% -- replaced with /var/log/ceph/ceph-client.admin.167660.log.gz 2024-03-27T19:55:12.125 INFO:teuthology.orchestra.run.smithi057.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43006.log.gz 2024-03-27T19:55:12.128 INFO:teuthology.orchestra.run.smithi057.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.324431.log.gz 2024-03-27T19:55:12.135 INFO:teuthology.orchestra.run.smithi057.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.278132.log.gz 2024-03-27T19:55:12.146 INFO:teuthology.orchestra.run.smithi057.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.260916.log.gz 2024-03-27T19:55:12.154 INFO:teuthology.orchestra.run.smithi057.stderr: 78.5% -- replaced with /var/log/ceph/ceph-client.admin.467663.log.gz 2024-03-27T19:55:12.184 INFO:teuthology.orchestra.run.smithi057.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.474184.log.gz 2024-03-27T19:55:12.205 INFO:teuthology.orchestra.run.smithi057.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.248691.log.gz 2024-03-27T19:55:12.217 INFO:teuthology.orchestra.run.smithi057.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.364154.log.gz 2024-03-27T19:55:12.244 INFO:teuthology.orchestra.run.smithi057.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.348015.log.gz 2024-03-27T19:55:12.245 INFO:teuthology.orchestra.run.smithi057.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.331644.log.gz 2024-03-27T19:55:12.246 INFO:teuthology.orchestra.run.smithi057.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.372383.log.gz 2024-03-27T19:55:12.259 INFO:teuthology.orchestra.run.smithi057.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.44972.log.gz 2024-03-27T19:55:12.261 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.185726.log.gz 2024-03-27T19:55:12.266 INFO:teuthology.orchestra.run.smithi057.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.526718.log.gz 2024-03-27T19:55:12.273 INFO:teuthology.orchestra.run.smithi057.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.397457.log.gz 2024-03-27T19:55:12.279 INFO:teuthology.orchestra.run.smithi057.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.445562.log.gz 2024-03-27T19:55:12.284 INFO:teuthology.orchestra.run.smithi057.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.235628.log.gz 2024-03-27T19:55:12.285 INFO:teuthology.orchestra.run.smithi057.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.370446.log.gz 2024-03-27T19:55:12.288 INFO:teuthology.orchestra.run.smithi057.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.327814.log.gz 2024-03-27T19:55:12.301 INFO:teuthology.orchestra.run.smithi057.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.212823.log.gz 2024-03-27T19:55:12.305 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.260064.log.gz 2024-03-27T19:55:12.393 INFO:teuthology.orchestra.run.smithi057.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.272145.log.gz 2024-03-27T19:55:12.397 INFO:teuthology.orchestra.run.smithi057.stderr: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.236606.log.gz 2024-03-27T19:55:12.406 INFO:teuthology.orchestra.run.smithi057.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.426933.log.gz 2024-03-27T19:55:12.479 INFO:teuthology.orchestra.run.smithi057.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.358933.log.gz 2024-03-27T19:55:12.484 INFO:teuthology.orchestra.run.smithi057.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.150660.log.gz 2024-03-27T19:55:12.491 INFO:teuthology.orchestra.run.smithi057.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.278141.log.gz 2024-03-27T19:55:12.491 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.439791.log.gz 2024-03-27T19:55:12.492 INFO:teuthology.orchestra.run.smithi057.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.374844.log.gz 2024-03-27T19:55:12.497 INFO:teuthology.orchestra.run.smithi057.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.241720.log.gz 2024-03-27T19:55:12.504 INFO:teuthology.orchestra.run.smithi057.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.334190.log.gz 2024-03-27T19:55:12.504 INFO:teuthology.orchestra.run.smithi057.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.149283.log.gz 2024-03-27T19:55:12.504 INFO:teuthology.orchestra.run.smithi057.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44720.log.gz 2024-03-27T19:55:12.507 INFO:teuthology.orchestra.run.smithi057.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.507288.log.gz 2024-03-27T19:55:12.515 INFO:teuthology.orchestra.run.smithi057.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.414522.log.gz 2024-03-27T19:55:12.530 INFO:teuthology.orchestra.run.smithi057.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.344981.log.gz 2024-03-27T19:55:12.533 INFO:teuthology.orchestra.run.smithi057.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.226086.log.gz 2024-03-27T19:55:12.535 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.359355.log.gz 2024-03-27T19:55:12.537 INFO:teuthology.orchestra.run.smithi057.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.223967.log.gz 2024-03-27T19:55:12.539 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.227114.log.gz 2024-03-27T19:55:12.541 INFO:teuthology.orchestra.run.smithi057.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.244296.log.gz 2024-03-27T19:55:12.542 INFO:teuthology.orchestra.run.smithi057.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.260907.log.gz 2024-03-27T19:55:12.545 INFO:teuthology.orchestra.run.smithi057.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.266858.log.gz 2024-03-27T19:55:12.547 INFO:teuthology.orchestra.run.smithi057.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.183155.log.gz 2024-03-27T19:55:12.557 INFO:teuthology.orchestra.run.smithi057.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.426516.log.gz 2024-03-27T19:55:12.560 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.259638.log.gz 2024-03-27T19:55:12.585 INFO:teuthology.orchestra.run.smithi057.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.330792.log.gz 2024-03-27T19:55:12.599 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.277719.log.gz 2024-03-27T19:55:12.599 INFO:teuthology.orchestra.run.smithi057.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.269628.log.gz 2024-03-27T19:55:12.604 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.217881.log.gz 2024-03-27T19:55:12.627 INFO:teuthology.orchestra.run.smithi057.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.187453.log.gz 2024-03-27T19:55:12.638 INFO:teuthology.orchestra.run.smithi057.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.201664.log.gz 2024-03-27T19:55:12.639 INFO:teuthology.orchestra.run.smithi057.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.462858.log.gz 2024-03-27T19:55:12.645 INFO:teuthology.orchestra.run.smithi057.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.431613.log.gz 2024-03-27T19:55:12.672 INFO:teuthology.orchestra.run.smithi057.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50829.log.gz 2024-03-27T19:55:12.672 INFO:teuthology.orchestra.run.smithi057.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.423503.log.gz 2024-03-27T19:55:12.684 INFO:teuthology.orchestra.run.smithi057.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.202114.log.gz 2024-03-27T19:55:12.685 INFO:teuthology.orchestra.run.smithi057.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.117188.log.gz 2024-03-27T19:55:12.690 INFO:teuthology.orchestra.run.smithi057.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.206133.log.gz 2024-03-27T19:55:12.694 INFO:teuthology.orchestra.run.smithi057.stderr: 95.0% -- replaced with /var/log/ceph/ceph-client.admin.443943.log.gz 2024-03-27T19:55:12.702 INFO:teuthology.orchestra.run.smithi057.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.371376.log.gz 2024-03-27T19:55:12.702 INFO:teuthology.orchestra.run.smithi057.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.137652.log.gz 2024-03-27T19:55:12.722 INFO:teuthology.orchestra.run.smithi057.stderr: 93.9% -- replaced with /var/log/ceph/ceph-client.admin.276421.log.gz 2024-03-27T19:55:12.726 INFO:teuthology.orchestra.run.smithi057.stderr: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.509711.log.gz 2024-03-27T19:55:12.765 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.480859.log.gz 2024-03-27T19:55:12.784 INFO:teuthology.orchestra.run.smithi057.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.202105.log.gz 2024-03-27T19:55:12.785 INFO:teuthology.orchestra.run.smithi057.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.246046.log.gz 2024-03-27T19:55:12.788 INFO:teuthology.orchestra.run.smithi057.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.231414.log.gz 2024-03-27T19:55:12.790 INFO:teuthology.orchestra.run.smithi057.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.195329.log.gz 2024-03-27T19:55:12.791 INFO:teuthology.orchestra.run.smithi057.stderr: 78.4% -- replaced with /var/log/ceph/ceph-client.admin.240024.log.gz 2024-03-27T19:55:12.797 INFO:teuthology.orchestra.run.smithi057.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.254175.log.gz 2024-03-27T19:55:12.800 INFO:teuthology.orchestra.run.smithi057.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.236143.log.gz 2024-03-27T19:55:12.810 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.271733.log.gz 2024-03-27T19:55:12.812 INFO:teuthology.orchestra.run.smithi057.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.263450.log.gz 2024-03-27T19:55:12.818 INFO:teuthology.orchestra.run.smithi057.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.207472.log.gz 2024-03-27T19:55:12.827 INFO:teuthology.orchestra.run.smithi057.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43092.log.gz 2024-03-27T19:55:12.828 INFO:teuthology.orchestra.run.smithi057.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52182.log.gz 2024-03-27T19:55:12.860 INFO:teuthology.orchestra.run.smithi057.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.358503.log.gz 2024-03-27T19:55:12.860 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.468100.log.gz 2024-03-27T19:55:12.913 INFO:teuthology.orchestra.run.smithi057.stderr: 94.6% -- replaced with /var/log/ceph/ceph-client.admin.399676.log.gz 2024-03-27T19:55:12.921 INFO:teuthology.orchestra.run.smithi057.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.478146.log.gz 2024-03-27T19:55:12.931 INFO:teuthology.orchestra.run.smithi057.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44762.log.gz 2024-03-27T19:55:12.931 INFO:teuthology.orchestra.run.smithi057.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.368157.log.gz 2024-03-27T19:55:12.932 INFO:teuthology.orchestra.run.smithi057.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49677.log.gz 2024-03-27T19:55:12.939 INFO:teuthology.orchestra.run.smithi057.stderr: 79.6% -- replaced with /var/log/ceph/ceph-client.admin.143570.log.gz 2024-03-27T19:55:12.941 INFO:teuthology.orchestra.run.smithi057.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.327393.log.gz 2024-03-27T19:55:12.941 INFO:teuthology.orchestra.run.smithi057.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.143579.log.gz 2024-03-27T19:55:12.946 INFO:teuthology.orchestra.run.smithi057.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.329097.log.gz 2024-03-27T19:55:12.947 INFO:teuthology.orchestra.run.smithi057.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.156890.log.gz 2024-03-27T19:55:12.950 INFO:teuthology.orchestra.run.smithi057.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.421806.log.gz 2024-03-27T19:55:12.953 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.489479.log.gz 2024-03-27T19:55:12.959 INFO:teuthology.orchestra.run.smithi057.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.200329.log.gz 2024-03-27T19:55:12.962 INFO:teuthology.orchestra.run.smithi057.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.190257.log.gz 2024-03-27T19:55:13.012 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.501363.log.gz 2024-03-27T19:55:13.063 INFO:teuthology.orchestra.run.smithi057.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.468942.log.gz 2024-03-27T19:55:13.066 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.457063.log.gz 2024-03-27T19:55:13.068 INFO:teuthology.orchestra.run.smithi057.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.156024.log.gz 2024-03-27T19:55:13.074 INFO:teuthology.orchestra.run.smithi057.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50645.log.gz 2024-03-27T19:55:13.076 INFO:teuthology.orchestra.run.smithi057.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50955.log.gz 2024-03-27T19:55:13.092 INFO:teuthology.orchestra.run.smithi057.stderr: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.508509.log.gz 2024-03-27T19:55:13.092 INFO:teuthology.orchestra.run.smithi057.stderr: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.159035.log.gz 2024-03-27T19:55:13.095 INFO:teuthology.orchestra.run.smithi057.stderr: 78.8% -- replaced with /var/log/ceph/ceph-client.admin.528859.log.gz 2024-03-27T19:55:13.098 INFO:teuthology.orchestra.run.smithi057.stderr: 78.2% -- replaced with /var/log/ceph/ceph-client.admin.495100.log.gz 2024-03-27T19:55:13.109 INFO:teuthology.orchestra.run.smithi057.stderr: 77.5% -- replaced with /var/log/ceph/ceph-client.admin.359346.log.gz 2024-03-27T19:55:13.111 INFO:teuthology.orchestra.run.smithi057.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.200778.log.gz 2024-03-27T19:55:13.111 INFO:teuthology.orchestra.run.smithi057.stderr: 77.3% -- replaced with /var/log/ceph/ceph-client.admin.359767.log.gz 2024-03-27T19:55:13.111 INFO:teuthology.orchestra.run.smithi057.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.241289.log.gz 2024-03-27T19:55:13.112 INFO:teuthology.orchestra.run.smithi057.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.241298.log.gz 2024-03-27T19:55:13.113 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.212402.log.gz 2024-03-27T19:55:13.113 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.264302.log.gz 2024-03-27T19:55:13.127 INFO:teuthology.orchestra.run.smithi057.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.270049.log.gz 2024-03-27T19:55:13.127 INFO:teuthology.orchestra.run.smithi057.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.476157.log.gz 2024-03-27T19:55:13.130 INFO:teuthology.orchestra.run.smithi057.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.490806.log.gz 2024-03-27T19:55:13.130 INFO:teuthology.orchestra.run.smithi057.stderr: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.491656.log.gz 2024-03-27T19:55:13.139 INFO:teuthology.orchestra.run.smithi057.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.426082.log.gz 2024-03-27T19:55:13.140 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.415816.log.gz 2024-03-27T19:55:13.206 INFO:teuthology.orchestra.run.smithi057.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.194305.log.gz 2024-03-27T19:55:13.222 INFO:teuthology.orchestra.run.smithi057.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.528425.log.gz 2024-03-27T19:55:13.232 INFO:teuthology.orchestra.run.smithi057.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.527140.log.gz 2024-03-27T19:55:13.239 INFO:teuthology.orchestra.run.smithi057.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.400214.log.gz 2024-03-27T19:55:13.242 INFO:teuthology.orchestra.run.smithi057.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.208397.log.gz 2024-03-27T19:55:13.247 INFO:teuthology.orchestra.run.smithi057.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.220042.log.gz 2024-03-27T19:55:13.248 INFO:teuthology.orchestra.run.smithi057.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.436249.log.gz 2024-03-27T19:55:13.253 INFO:teuthology.orchestra.run.smithi057.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.404911.log.gz 2024-03-27T19:55:13.257 INFO:teuthology.orchestra.run.smithi057.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42488.log.gz 2024-03-27T19:55:13.270 INFO:teuthology.orchestra.run.smithi057.stderr: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.223127.log.gz 2024-03-27T19:55:13.275 INFO:teuthology.orchestra.run.smithi057.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.350553.log.gz 2024-03-27T19:55:13.275 INFO:teuthology.orchestra.run.smithi057.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.342445.log.gz 2024-03-27T19:55:13.293 INFO:teuthology.orchestra.run.smithi057.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.43386.log.gz 2024-03-27T19:55:13.299 INFO:teuthology.orchestra.run.smithi057.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.210647.log.gz 2024-03-27T19:55:13.301 INFO:teuthology.orchestra.run.smithi057.stderr: 88.5% 88.9% -- replaced with /var/log/ceph/ceph-client.admin.52868.log.gz -- replaced with /var/log/ceph/ceph-client.admin.53177.log.gz 2024-03-27T19:55:13.301 INFO:teuthology.orchestra.run.smithi057.stderr: 2024-03-27T19:55:13.301 INFO:teuthology.orchestra.run.smithi057.stderr: 88.6% 89.2% -- replaced with /var/log/ceph/ceph-client.admin.53093.log.gz -- replaced with /var/log/ceph/ceph-client.admin.53261.log.gz 2024-03-27T19:55:13.301 INFO:teuthology.orchestra.run.smithi057.stderr: 88.6% 88.6% -- replaced with /var/log/ceph/ceph-client.admin.52912.log.gz 2024-03-27T19:55:13.301 INFO:teuthology.orchestra.run.smithi057.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.53005.log.gz 2024-03-27T19:55:13.301 INFO:teuthology.orchestra.run.smithi057.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.53051.log.gz 2024-03-27T19:55:13.301 INFO:teuthology.orchestra.run.smithi057.stderr: -- replaced with /var/log/ceph/ceph-client.admin.53135.log.gz 2024-03-27T19:55:13.301 INFO:teuthology.orchestra.run.smithi057.stderr: 2024-03-27T19:55:13.301 INFO:teuthology.orchestra.run.smithi057.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.53219.log.gz 2024-03-27T19:55:13.302 INFO:teuthology.orchestra.run.smithi057.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.52963.log.gz 2024-03-27T19:55:13.305 INFO:teuthology.orchestra.run.smithi057.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.219157.log.gz 2024-03-27T19:55:13.305 INFO:teuthology.orchestra.run.smithi057.stderr: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.220033.log.gz 2024-03-27T19:55:13.305 INFO:teuthology.orchestra.run.smithi057.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.227105.log.gz 2024-03-27T19:55:13.308 INFO:teuthology.orchestra.run.smithi057.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.227535.log.gz 2024-03-27T19:55:13.312 INFO:teuthology.orchestra.run.smithi057.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.186152.log.gz 2024-03-27T19:55:16.969 INFO:teuthology.orchestra.run.smithi057.stderr: 93.8% 85.0% -- replaced with /var/log/ceph/ceph-client.admin.429478.log.gz -- replaced with /var/log/ceph/ceph-client.admin.269619.log.gz 2024-03-27T19:55:16.969 INFO:teuthology.orchestra.run.smithi057.stderr: 2024-03-27T19:55:16.969 INFO:teuthology.orchestra.run.smithi057.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.273839.log.gz 2024-03-27T19:55:16.970 INFO:teuthology.orchestra.run.smithi057.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.419278.log.gz 2024-03-27T19:55:16.970 INFO:teuthology.orchestra.run.smithi057.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51804.log.gz 2024-03-27T19:55:16.971 INFO:teuthology.orchestra.run.smithi057.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.204333.log.gz 2024-03-27T19:55:16.971 INFO:teuthology.orchestra.run.smithi057.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51426.log.gz 2024-03-27T19:55:16.971 INFO:teuthology.orchestra.run.smithi057.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45574.log.gz 2024-03-27T19:55:16.971 INFO:teuthology.orchestra.run.smithi057.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.371888.log.gz 2024-03-27T19:55:16.971 INFO:teuthology.orchestra.run.smithi057.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.337772.log.gz 2024-03-27T19:55:16.971 INFO:teuthology.orchestra.run.smithi057.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.421375.log.gz 2024-03-27T19:55:16.972 INFO:teuthology.orchestra.run.smithi057.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.147149.log.gz 2024-03-27T19:55:16.972 INFO:teuthology.orchestra.run.smithi057.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.208847.log.gz 95.5% 2024-03-27T19:55:16.972 INFO:teuthology.orchestra.run.smithi057.stderr: -- replaced with /var/log/ceph/ceph-client.0.53742.log.gz 2024-03-27T19:55:16.972 INFO:teuthology.orchestra.run.smithi057.stderr: 83.0% -- replaced with /var/log/ceph/ceph-client.admin.519107.log.gz 2024-03-27T19:55:16.972 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% 81.4% -- replaced with /var/log/ceph/ceph-client.admin.199021.log.gz 2024-03-27T19:55:16.974 INFO:teuthology.orchestra.run.smithi057.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.275119.log.gz 2024-03-27T19:55:16.974 INFO:teuthology.orchestra.run.smithi057.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.52140.log.gz 2024-03-27T19:55:16.974 INFO:teuthology.orchestra.run.smithi057.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.463732.log.gz 2024-03-27T19:55:16.974 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.405387.log.gz 2024-03-27T19:55:16.974 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.502631.log.gz 2024-03-27T19:55:16.974 INFO:teuthology.orchestra.run.smithi057.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.240033.log.gz 2024-03-27T19:55:16.975 INFO:teuthology.orchestra.run.smithi057.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.347171.log.gz 2024-03-27T19:55:16.975 INFO:teuthology.orchestra.run.smithi057.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.357121.log.gz 2024-03-27T19:55:16.975 INFO:teuthology.orchestra.run.smithi057.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.243027.log.gz 2024-03-27T19:55:16.975 INFO:teuthology.orchestra.run.smithi057.stderr: 89.9% 92.5% -- replaced with /var/log/ceph/ceph-client.admin.43889.log.gz 2024-03-27T19:55:16.975 INFO:teuthology.orchestra.run.smithi057.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.369068.log.gz -- replaced with /var/log/ceph/ceph-client.admin.328675.log.gz 85.1% -- replaced with /var/log/ceph/ceph-client.admin.503889.log.gz 2024-03-27T19:55:16.975 INFO:teuthology.orchestra.run.smithi057.stderr: 2024-03-27T19:55:16.975 INFO:teuthology.orchestra.run.smithi057.stderr: 2024-03-27T19:55:16.975 INFO:teuthology.orchestra.run.smithi057.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45233.log.gz 2024-03-27T19:55:16.975 INFO:teuthology.orchestra.run.smithi057.stderr: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.479432.log.gz 2024-03-27T19:55:16.977 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% 90.0% -- replaced with /var/log/ceph/ceph-client.admin.417553.log.gz 2024-03-27T19:55:16.978 INFO:teuthology.orchestra.run.smithi057.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.501352.log.gz 2024-03-27T19:55:16.978 INFO:teuthology.orchestra.run.smithi057.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.207031.log.gz 2024-03-27T19:55:16.978 INFO:teuthology.orchestra.run.smithi057.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51258.log.gz 2024-03-27T19:55:16.978 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.324864.log.gz 2024-03-27T19:55:16.978 INFO:teuthology.orchestra.run.smithi057.stderr: -- replaced with /var/log/ceph/ceph-client.admin.159044.log.gz 2024-03-27T19:55:16.978 INFO:teuthology.orchestra.run.smithi057.stderr: 92.5% 80.5% -- replaced with /var/log/ceph/ceph-client.admin.164453.log.gz 2024-03-27T19:55:16.978 INFO:teuthology.orchestra.run.smithi057.stderr: 83.9% -- replaced with /var/log/ceph/ceph-client.admin.523336.log.gz 2024-03-27T19:55:16.979 INFO:teuthology.orchestra.run.smithi057.stderr: -- replaced with /var/log/ceph/ceph-client.2.47954.log.gz 2024-03-27T19:55:16.979 INFO:teuthology.orchestra.run.smithi057.stderr: 89.0% 85.1% -- replaced with /var/log/ceph/ceph-client.admin.50997.log.gz 2024-03-27T19:55:16.979 INFO:teuthology.orchestra.run.smithi057.stderr: -- replaced with /var/log/ceph/ceph-client.admin.411788.log.gz 2024-03-27T19:55:16.979 INFO:teuthology.orchestra.run.smithi057.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.527561.log.gz 2024-03-27T19:55:16.979 INFO:teuthology.orchestra.run.smithi057.stderr: -- replaced with /var/log/ceph/ceph-client.admin.485994.log.gz 88.2% -- replaced with /var/log/ceph/ceph-client.admin.51510.log.gz 2024-03-27T19:55:16.979 INFO:teuthology.orchestra.run.smithi057.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.257839.log.gz 2024-03-27T19:55:16.979 INFO:teuthology.orchestra.run.smithi057.stderr: 2024-03-27T19:55:16.979 INFO:teuthology.orchestra.run.smithi057.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.137236.log.gz 2024-03-27T19:55:16.979 INFO:teuthology.orchestra.run.smithi057.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49230.log.gz 2024-03-27T19:55:16.980 INFO:teuthology.orchestra.run.smithi057.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.216191.log.gz 2024-03-27T19:55:16.980 INFO:teuthology.orchestra.run.smithi057.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.52740.log.gz 2024-03-27T19:55:16.980 INFO:teuthology.orchestra.run.smithi057.stderr: 78.2% -- replaced with /var/log/ceph/ceph-client.admin.216603.log.gz 2024-03-27T19:55:16.980 INFO:teuthology.orchestra.run.smithi057.stderr: 77.4% -- replaced with /var/log/ceph/ceph-client.admin.285019.log.gz 2024-03-27T19:55:16.980 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.366288.log.gz 2024-03-27T19:55:16.983 INFO:teuthology.orchestra.run.smithi057.stderr: 77.4% -- replaced with /var/log/ceph/ceph-client.admin.124225.log.gz 2024-03-27T19:55:16.983 INFO:teuthology.orchestra.run.smithi057.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.422223.log.gz 2024-03-27T19:55:16.983 INFO:teuthology.orchestra.run.smithi057.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.419690.log.gz 2024-03-27T19:55:16.983 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.410592.log.gz 2024-03-27T19:55:16.983 INFO:teuthology.orchestra.run.smithi057.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.270040.log.gz 2024-03-27T19:55:16.983 INFO:teuthology.orchestra.run.smithi057.stderr: 88.1% 84.4% -- replaced with /var/log/ceph/ceph-client.admin.138074.log.gz 2024-03-27T19:55:16.984 INFO:teuthology.orchestra.run.smithi057.stderr: -- replaced with /var/log/ceph/ceph-client.admin.37270.log.gz 2024-03-27T19:55:16.984 INFO:teuthology.orchestra.run.smithi057.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.471159.log.gz 2024-03-27T19:55:16.984 INFO:teuthology.orchestra.run.smithi057.stderr: 94.3% -- replaced with /var/log/ceph/ceph-client.admin.372392.log.gz 2024-03-27T19:55:16.984 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.230571.log.gz 2024-03-27T19:55:16.984 INFO:teuthology.orchestra.run.smithi057.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.133773.log.gz 2024-03-27T19:55:16.984 INFO:teuthology.orchestra.run.smithi057.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.159930.log.gz 2024-03-27T19:55:16.984 INFO:teuthology.orchestra.run.smithi057.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.470258.log.gz 2024-03-27T19:55:16.984 INFO:teuthology.orchestra.run.smithi057.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.463288.log.gz 2024-03-27T19:55:16.984 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.429057.log.gz 2024-03-27T19:55:16.985 INFO:teuthology.orchestra.run.smithi057.stderr: 94.4% -- replaced with /var/log/ceph/ceph-client.admin.198571.log.gz 2024-03-27T19:55:16.985 INFO:teuthology.orchestra.run.smithi057.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.411440.log.gz 2024-03-27T19:55:16.985 INFO:teuthology.orchestra.run.smithi057.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.404052.log.gz 2024-03-27T19:55:16.985 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% 93.2% -- replaced with /var/log/ceph/ceph-client.admin.427788.log.gz 2024-03-27T19:55:16.985 INFO:teuthology.orchestra.run.smithi057.stderr: -- replaced with /var/log/ceph/ceph-client.admin.207481.log.gz 2024-03-27T19:55:16.985 INFO:teuthology.orchestra.run.smithi057.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.156881.log.gz 2024-03-27T19:55:16.985 INFO:teuthology.orchestra.run.smithi057.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.200787.log.gz 2024-03-27T19:55:16.985 INFO:teuthology.orchestra.run.smithi057.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50519.log.gz 2024-03-27T19:55:16.985 INFO:teuthology.orchestra.run.smithi057.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.198150.log.gz 2024-03-27T19:55:16.986 INFO:teuthology.orchestra.run.smithi057.stderr: 93.9% -- replaced with /var/log/ceph/ceph-client.admin.467128.log.gz 2024-03-27T19:55:16.986 INFO:teuthology.orchestra.run.smithi057.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.408361.log.gz 2024-03-27T19:55:16.989 INFO:teuthology.orchestra.run.smithi057.stderr: 93.9% -- replaced with /var/log/ceph/ceph-client.admin.226095.log.gz 2024-03-27T19:55:16.989 INFO:teuthology.orchestra.run.smithi057.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.370891.log.gz 2024-03-27T19:55:16.989 INFO:teuthology.orchestra.run.smithi057.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.372896.log.gz 2024-03-27T19:55:16.989 INFO:teuthology.orchestra.run.smithi057.stderr: 90.1% 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42707.log.gz 2024-03-27T19:55:16.989 INFO:teuthology.orchestra.run.smithi057.stderr: -- replaced with /var/log/ceph/ceph-client.admin.367729.log.gz 92.9% -- replaced with /var/log/ceph/ceph-client.admin.355208.log.gz 2024-03-27T19:55:16.989 INFO:teuthology.orchestra.run.smithi057.stderr: 2024-03-27T19:55:16.989 INFO:teuthology.orchestra.run.smithi057.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.367235.log.gz 2024-03-27T19:55:16.989 INFO:teuthology.orchestra.run.smithi057.stderr: 80.7% 89.9% -- replaced with /var/log/ceph/ceph-client.admin.324440.log.gz 2024-03-27T19:55:16.990 INFO:teuthology.orchestra.run.smithi057.stderr: -- replaced with /var/log/ceph/ceph-client.admin.414513.log.gz 2024-03-27T19:55:16.990 INFO:teuthology.orchestra.run.smithi057.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.439360.log.gz 2024-03-27T19:55:16.990 INFO:teuthology.orchestra.run.smithi057.stderr: 78.4% -- replaced with /var/log/ceph/ceph-client.admin.441475.log.gz 2024-03-27T19:55:16.990 INFO:teuthology.orchestra.run.smithi057.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.49409.log.gz 2024-03-27T19:55:16.990 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.475679.log.gz 2024-03-27T19:55:16.990 INFO:teuthology.orchestra.run.smithi057.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.48936.log.gz 2024-03-27T19:55:16.990 INFO:teuthology.orchestra.run.smithi057.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.404474.log.gz 2024-03-27T19:55:16.990 INFO:teuthology.orchestra.run.smithi057.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.458747.log.gz 2024-03-27T19:55:16.991 INFO:teuthology.orchestra.run.smithi057.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.138927.log.gz 2024-03-27T19:55:16.991 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.478155.log.gz 2024-03-27T19:55:16.991 INFO:teuthology.orchestra.run.smithi057.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.405799.log.gz 2024-03-27T19:55:16.991 INFO:teuthology.orchestra.run.smithi057.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.475192.log.gz 2024-03-27T19:55:16.991 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.456642.log.gz 2024-03-27T19:55:16.991 INFO:teuthology.orchestra.run.smithi057.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.475670.log.gz 2024-03-27T19:55:16.991 INFO:teuthology.orchestra.run.smithi057.stderr: 93.9% -- replaced with /var/log/ceph/ceph-client.admin.192928.log.gz 2024-03-27T19:55:16.991 INFO:teuthology.orchestra.run.smithi057.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.341184.log.gz 2024-03-27T19:55:16.991 INFO:teuthology.orchestra.run.smithi057.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.330783.log.gz 2024-03-27T19:55:16.992 INFO:teuthology.orchestra.run.smithi057.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47526.log.gz 2024-03-27T19:55:16.992 INFO:teuthology.orchestra.run.smithi057.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.372905.log.gz 2024-03-27T19:55:16.992 INFO:teuthology.orchestra.run.smithi057.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.330356.log.gz 2024-03-27T19:55:16.992 INFO:teuthology.orchestra.run.smithi057.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.46821.log.gz 2024-03-27T19:55:16.992 INFO:teuthology.orchestra.run.smithi057.stderr: 94.0% -- replaced with /var/log/ceph/ceph-client.admin.482786.log.gz 2024-03-27T19:55:16.996 INFO:teuthology.orchestra.run.smithi057.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48420.log.gz 2024-03-27T19:55:16.996 INFO:teuthology.orchestra.run.smithi057.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.411700.log.gz 2024-03-27T19:55:16.996 INFO:teuthology.orchestra.run.smithi057.stderr: 89.8% 90.0% -- replaced with /var/log/ceph/ceph-client.admin.164036.log.gz 2024-03-27T19:55:16.996 INFO:teuthology.orchestra.run.smithi057.stderr: -- replaced with /var/log/ceph/ceph-client.admin.523345.log.gz 2024-03-27T19:55:16.996 INFO:teuthology.orchestra.run.smithi057.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.525031.log.gz 2024-03-27T19:55:16.996 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.337781.log.gz 81.4% -- replaced with /var/log/ceph/ceph-client.admin.227947.log.gz 2024-03-27T19:55:16.997 INFO:teuthology.orchestra.run.smithi057.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.245143.log.gz 2024-03-27T19:55:16.997 INFO:teuthology.orchestra.run.smithi057.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.505196.log.gz 2024-03-27T19:55:16.997 INFO:teuthology.orchestra.run.smithi057.stderr: 2024-03-27T19:55:16.997 INFO:teuthology.orchestra.run.smithi057.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.116303.log.gz 2024-03-27T19:55:16.997 INFO:teuthology.orchestra.run.smithi057.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.146267.log.gz 2024-03-27T19:55:16.997 INFO:teuthology.orchestra.run.smithi057.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44804.log.gz 2024-03-27T19:55:16.997 INFO:teuthology.orchestra.run.smithi057.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.115872.log.gz 2024-03-27T19:55:16.997 INFO:teuthology.orchestra.run.smithi057.stderr: 89.9% 85.1% -- replaced with /var/log/ceph/ceph-client.admin.523766.log.gz 2024-03-27T19:55:16.998 INFO:teuthology.orchestra.run.smithi057.stderr: -- replaced with /var/log/ceph/ceph-client.admin.329935.log.gz 2024-03-27T19:55:16.998 INFO:teuthology.orchestra.run.smithi057.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.470267.log.gz 90.0% 2024-03-27T19:55:16.998 INFO:teuthology.orchestra.run.smithi057.stderr: -- replaced with /var/log/ceph/ceph-client.admin.213244.log.gz 2024-03-27T19:55:16.998 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.218304.log.gz 2024-03-27T19:55:16.998 INFO:teuthology.orchestra.run.smithi057.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.185300.log.gz 2024-03-27T19:55:16.998 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.166092.log.gz 2024-03-27T19:55:16.998 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.520812.log.gz 2024-03-27T19:55:16.998 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.277297.log.gz 2024-03-27T19:55:16.999 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.286898.log.gz 92.2% -- replaced with /var/log/ceph/ceph-client.admin.122056.log.gz 2024-03-27T19:55:16.999 INFO:teuthology.orchestra.run.smithi057.stderr: 2024-03-27T19:55:16.999 INFO:teuthology.orchestra.run.smithi057.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.129895.log.gz 2024-03-27T19:55:16.999 INFO:teuthology.orchestra.run.smithi057.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.244305.log.gz 2024-03-27T19:55:16.999 INFO:teuthology.orchestra.run.smithi057.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.522923.log.gz 2024-03-27T19:55:16.999 INFO:teuthology.orchestra.run.smithi057.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.204783.log.gz 2024-03-27T19:55:16.999 INFO:teuthology.orchestra.run.smithi057.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.159939.log.gz 2024-03-27T19:55:16.999 INFO:teuthology.orchestra.run.smithi057.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46737.log.gz 2024-03-27T19:55:16.999 INFO:teuthology.orchestra.run.smithi057.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.191155.log.gz 2024-03-27T19:55:17.000 INFO:teuthology.orchestra.run.smithi057.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.341595.log.gz 2024-03-27T19:55:17.000 INFO:teuthology.orchestra.run.smithi057.stderr: 81.4% 90.0% -- replaced with /var/log/ceph/ceph-client.admin.441058.log.gz 2024-03-27T19:55:17.000 INFO:teuthology.orchestra.run.smithi057.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.166504.log.gz 2024-03-27T19:55:17.000 INFO:teuthology.orchestra.run.smithi057.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46653.log.gz 2024-03-27T19:55:17.002 INFO:teuthology.orchestra.run.smithi057.stderr: 80.5% 80.7% -- replaced with /var/log/ceph/ceph-client.admin.122483.log.gz 2024-03-27T19:55:17.002 INFO:teuthology.orchestra.run.smithi057.stderr: -- replaced with /var/log/ceph/ceph-client.admin.249105.log.gz 2024-03-27T19:55:17.002 INFO:teuthology.orchestra.run.smithi057.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.287311.log.gz 2024-03-27T19:55:17.002 INFO:teuthology.orchestra.run.smithi057.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.487712.log.gz 2024-03-27T19:55:17.002 INFO:teuthology.orchestra.run.smithi057.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.142298.log.gz 2024-03-27T19:55:17.003 INFO:teuthology.orchestra.run.smithi057.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.142721.log.gz 2024-03-27T19:55:17.003 INFO:teuthology.orchestra.run.smithi057.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.186574.log.gz 2024-03-27T19:55:17.003 INFO:teuthology.orchestra.run.smithi057.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46317.log.gz 2024-03-27T19:55:17.003 INFO:teuthology.orchestra.run.smithi057.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.140616.log.gz 2024-03-27T19:55:17.003 INFO:teuthology.orchestra.run.smithi057.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.265145.log.gz 2024-03-27T19:55:17.003 INFO:teuthology.orchestra.run.smithi057.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.142730.log.gz 2024-03-27T19:55:17.003 INFO:teuthology.orchestra.run.smithi057.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.503052.log.gz 2024-03-27T19:55:17.003 INFO:teuthology.orchestra.run.smithi057.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.443656.log.gz 2024-03-27T19:55:17.004 INFO:teuthology.orchestra.run.smithi057.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.226693.log.gz 2024-03-27T19:55:17.004 INFO:teuthology.orchestra.run.smithi057.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.232722.log.gz 2024-03-27T19:55:17.004 INFO:teuthology.orchestra.run.smithi057.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45571.log.gz 2024-03-27T19:55:17.004 INFO:teuthology.orchestra.run.smithi057.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.237459.log.gz 2024-03-27T19:55:17.004 INFO:teuthology.orchestra.run.smithi057.stderr: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.160406.log.gz 2024-03-27T19:55:17.004 INFO:teuthology.orchestra.run.smithi057.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.348437.log.gz 2024-03-27T19:55:17.004 INFO:teuthology.orchestra.run.smithi057.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.165119.log.gz 2024-03-27T19:55:17.004 INFO:teuthology.orchestra.run.smithi057.stderr: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.134620.log.gz 2024-03-27T19:55:17.004 INFO:teuthology.orchestra.run.smithi057.stderr: 85.7% 80.2% -- replaced with /var/log/ceph/ceph-client.admin.443934.log.gz 2024-03-27T19:55:17.004 INFO:teuthology.orchestra.run.smithi057.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.409704.log.gz 2024-03-27T19:55:17.005 INFO:teuthology.orchestra.run.smithi057.stderr: -- replaced with /var/log/ceph/ceph-client.admin.482777.log.gz 85.5% 2024-03-27T19:55:17.005 INFO:teuthology.orchestra.run.smithi057.stderr: -- replaced with /var/log/ceph/ceph-client.admin.519960.log.gz 2024-03-27T19:55:17.005 INFO:teuthology.orchestra.run.smithi057.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.274279.log.gz 2024-03-27T19:55:17.005 INFO:teuthology.orchestra.run.smithi057.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.519116.log.gz 2024-03-27T19:55:17.005 INFO:teuthology.orchestra.run.smithi057.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45238.log.gz 2024-03-27T19:55:17.005 INFO:teuthology.orchestra.run.smithi057.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.332896.log.gz 2024-03-27T19:55:17.006 INFO:teuthology.orchestra.run.smithi057.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.151129.log.gz 2024-03-27T19:55:17.006 INFO:teuthology.orchestra.run.smithi057.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.501103.log.gz 2024-03-27T19:55:17.006 INFO:teuthology.orchestra.run.smithi057.stderr: 83.4% -- replaced with /var/log/ceph/ceph-client.admin.518683.log.gz 2024-03-27T19:55:17.006 INFO:teuthology.orchestra.run.smithi057.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.518424.log.gz 2024-03-27T19:55:17.006 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.270470.log.gz 2024-03-27T19:55:17.006 INFO:teuthology.orchestra.run.smithi057.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.494679.log.gz 2024-03-27T19:55:17.166 INFO:teuthology.orchestra.run.smithi057.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42792.log.gz 2024-03-27T19:55:17.493 INFO:teuthology.orchestra.run.smithi057.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.admin.473337.log.gz 2024-03-27T19:55:17.497 INFO:teuthology.orchestra.run.smithi057.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.148433.log.gz 2024-03-27T19:55:17.500 INFO:teuthology.orchestra.run.smithi057.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50319.log.gz 2024-03-27T19:55:17.508 INFO:teuthology.orchestra.run.smithi057.stderr: 94.1% -- replaced with /var/log/ceph/ceph-client.admin.374377.log.gz 2024-03-27T19:55:17.558 INFO:teuthology.orchestra.run.smithi057.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.234699.log.gz 2024-03-27T19:55:17.650 INFO:teuthology.orchestra.run.smithi057.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.497224.log.gz 2024-03-27T19:55:17.670 INFO:teuthology.orchestra.run.smithi057.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.441934.log.gz 2024-03-27T19:55:17.675 INFO:teuthology.orchestra.run.smithi057.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.200338.log.gz 2024-03-27T19:55:17.701 INFO:teuthology.orchestra.run.smithi057.stderr: 88.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-03-27T19:55:17.774 INFO:teuthology.orchestra.run.smithi057.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.256996.log.gz 2024-03-27T19:55:17.782 INFO:teuthology.orchestra.run.smithi057.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.471580.log.gz 2024-03-27T19:55:17.788 INFO:teuthology.orchestra.run.smithi057.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.357606.log.gz 2024-03-27T19:55:17.802 INFO:teuthology.orchestra.run.smithi057.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.411797.log.gz 2024-03-27T19:55:17.944 INFO:teuthology.orchestra.run.smithi057.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.336426.log.gz 2024-03-27T19:55:17.958 INFO:teuthology.orchestra.run.smithi057.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.462397.log.gz 2024-03-27T19:55:18.075 INFO:teuthology.orchestra.run.smithi057.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.344550.log.gz 2024-03-27T19:55:18.094 INFO:teuthology.orchestra.run.smithi057.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.338623.log.gz 2024-03-27T19:55:18.107 INFO:teuthology.orchestra.run.smithi057.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.254166.log.gz 2024-03-27T19:55:18.899 INFO:teuthology.orchestra.run.smithi057.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.234248.log.gz 2024-03-27T19:55:18.899 INFO:teuthology.orchestra.run.smithi057.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.537715.log.gz 2024-03-27T19:55:18.899 INFO:teuthology.orchestra.run.smithi057.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.249114.log.gz 2024-03-27T19:55:18.900 INFO:teuthology.orchestra.run.smithi057.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.498131.log.gz 2024-03-27T19:55:18.900 INFO:teuthology.orchestra.run.smithi057.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.220940.log.gz 2024-03-27T19:55:18.993 INFO:teuthology.orchestra.run.smithi118.stderr: 95.3% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-03-27T19:55:19.085 INFO:teuthology.orchestra.run.smithi057.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.205684.log.gz 2024-03-27T19:55:19.400 INFO:teuthology.orchestra.run.smithi057.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.411846.log.gz 2024-03-27T19:55:19.433 INFO:teuthology.orchestra.run.smithi057.stderr: 94.2% -- replaced with /var/log/ceph/ceph-client.admin.418401.log.gz 2024-03-27T19:55:19.723 INFO:teuthology.orchestra.run.smithi057.stderr: 94.9% -- replaced with /var/log/ceph/ceph-client.admin.556046.log.gz 2024-03-27T19:55:19.924 INFO:teuthology.orchestra.run.smithi057.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.373402.log.gz 2024-03-27T19:55:19.969 INFO:teuthology.orchestra.run.smithi057.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.482201.log.gz 2024-03-27T19:55:20.319 INFO:teuthology.orchestra.run.smithi057.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.411749.log.gz 2024-03-27T19:55:20.547 INFO:teuthology.orchestra.run.smithi057.stderr: 94.2% -- replaced with /var/log/ceph/ceph-client.admin.398309.log.gz 2024-03-27T19:55:21.545 INFO:teuthology.orchestra.run.smithi057.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.165572.log.gz 2024-03-27T19:55:21.546 INFO:teuthology.orchestra.run.smithi057.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.194830.log.gz 2024-03-27T19:55:21.547 INFO:teuthology.orchestra.run.smithi057.stderr: 95.9% -- replaced with /var/log/ceph/ceph-client.admin.228377.log.gz 2024-03-27T19:55:21.578 INFO:teuthology.orchestra.run.smithi057.stderr: 95.3% -- replaced with /var/log/ceph/ceph-client.admin.112845.log.gz 2024-03-27T19:55:21.578 INFO:teuthology.orchestra.run.smithi057.stderr: 94.0% -- replaced with /var/log/ceph/ceph-client.admin.114307.log.gz 2024-03-27T19:55:22.384 INFO:teuthology.orchestra.run.smithi057.stderr: 96.2% -- replaced with /var/log/ceph/ceph-client.admin.116744.log.gz 2024-03-27T19:55:23.173 INFO:teuthology.orchestra.run.smithi057.stderr: 95.1% -- replaced with /var/log/ceph/ceph-client.admin.412079.log.gz 2024-03-27T19:55:23.592 INFO:teuthology.orchestra.run.smithi057.stderr: 91.9% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-03-27T19:55:23.634 INFO:teuthology.orchestra.run.smithi057.stderr: 92.0% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-03-27T19:55:26.921 INFO:teuthology.orchestra.run.smithi057.stderr: 94.1% -- replaced with /var/log/ceph/ceph-client.admin.396998.log.gz 2024-03-27T19:55:27.891 INFO:teuthology.orchestra.run.smithi057.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.129151.log.gz 2024-03-27T19:55:28.105 INFO:teuthology.orchestra.run.smithi057.stderr: 94.6% -- replaced with /var/log/ceph/ceph-client.admin.131639.log.gz 2024-03-27T19:55:34.847 INFO:teuthology.orchestra.run.smithi057.stderr: 94.3% -- replaced with /var/log/ceph/ceph-client.admin.406955.log.gz 2024-03-27T19:55:35.165 INFO:teuthology.orchestra.run.smithi057.stderr: 96.8% -- replaced with /var/log/ceph/ceph-client.admin.399182.log.gz 2024-03-27T19:55:40.242 INFO:teuthology.orchestra.run.smithi057.stderr: 94.2% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-03-27T19:55:40.826 INFO:teuthology.orchestra.run.smithi057.stderr: 95.6% -- replaced with /var/log/ceph/ceph-client.admin.268131.log.gz 2024-03-27T19:55:41.482 INFO:teuthology.orchestra.run.smithi057.stderr: 94.0% -- replaced with /var/log/ceph/ceph-client.admin.255937.log.gz 2024-03-27T19:55:41.626 INFO:teuthology.orchestra.run.smithi057.stderr: 96.7% -- replaced with /var/log/ceph/ceph-client.admin.236152.log.gz 2024-03-27T19:55:42.130 INFO:teuthology.orchestra.run.smithi057.stderr: 95.7% -- replaced with /var/log/ceph/ceph-client.admin.233319.log.gz 2024-03-27T19:55:44.042 INFO:teuthology.orchestra.run.smithi057.stderr: 96.5% -- replaced with /var/log/ceph/ceph-client.admin.128675.log.gz 2024-03-27T19:55:48.745 INFO:teuthology.orchestra.run.smithi057.stderr: 96.6% -- replaced with /var/log/ceph/ceph-client.admin.150669.log.gz 2024-03-27T19:55:49.371 INFO:teuthology.orchestra.run.smithi057.stderr: 96.5% -- replaced with /var/log/ceph/ceph-client.admin.145329.log.gz 2024-03-27T19:55:49.373 INFO:teuthology.orchestra.run.smithi057.stderr: 96.5% -- replaced with /var/log/ceph/ceph-client.admin.145798.log.gz 2024-03-27T19:55:50.034 INFO:teuthology.orchestra.run.smithi057.stderr: 96.5% -- replaced with /var/log/ceph/ceph-client.admin.359776.log.gz 2024-03-27T19:55:50.954 INFO:teuthology.orchestra.run.smithi057.stderr: 96.9% -- replaced with /var/log/ceph/ceph-client.admin.117704.log.gz 2024-03-27T19:55:51.029 INFO:teuthology.orchestra.run.smithi057.stderr: 95.5% -- replaced with /var/log/ceph/ceph-client.admin.405808.log.gz 2024-03-27T19:55:51.512 INFO:teuthology.orchestra.run.smithi057.stderr: 96.5% -- replaced with /var/log/ceph/ceph-client.admin.128199.log.gz 2024-03-27T19:55:52.094 INFO:teuthology.orchestra.run.smithi057.stderr: 97.0% -- replaced with /var/log/ceph/ceph-client.admin.366773.log.gz 2024-03-27T19:55:52.110 INFO:teuthology.orchestra.run.smithi057.stderr: 96.2% -- replaced with /var/log/ceph/ceph-client.admin.456172.log.gz 2024-03-27T19:55:52.628 INFO:teuthology.orchestra.run.smithi057.stderr: 96.5% -- replaced with /var/log/ceph/ceph-client.admin.122914.log.gz 2024-03-27T19:55:53.689 INFO:teuthology.orchestra.run.smithi057.stderr: 97.3% -- replaced with /var/log/ceph/ceph-client.admin.333764.log.gz 2024-03-27T19:55:54.464 INFO:teuthology.orchestra.run.smithi057.stderr: 95.2% -- replaced with /var/log/ceph/ceph-client.admin.477074.log.gz 2024-03-27T19:55:58.182 INFO:teuthology.orchestra.run.smithi057.stderr: 97.1% -- replaced with /var/log/ceph/ceph-client.admin.115881.log.gz 2024-03-27T19:55:58.182 INFO:teuthology.orchestra.run.smithi057.stderr: 96.5% -- replaced with /var/log/ceph/ceph-client.admin.144432.log.gz 2024-03-27T19:55:58.183 INFO:teuthology.orchestra.run.smithi057.stderr: 96.6% -- replaced with /var/log/ceph/ceph-client.admin.334199.log.gz 2024-03-27T19:55:58.963 INFO:teuthology.orchestra.run.smithi057.stderr: 97.2% -- replaced with /var/log/ceph/ceph-client.admin.334713.log.gz 2024-03-27T19:55:59.416 INFO:teuthology.orchestra.run.smithi057.stderr: 96.5% -- replaced with /var/log/ceph/ceph-client.admin.146690.log.gz 2024-03-27T19:56:01.406 INFO:teuthology.orchestra.run.smithi057.stderr: 96.7% -- replaced with /var/log/ceph/ceph-client.admin.416242.log.gz 2024-03-27T19:56:01.875 INFO:teuthology.orchestra.run.smithi057.stderr: 96.9% -- replaced with /var/log/ceph/ceph-client.admin.116312.log.gz 2024-03-27T19:56:02.508 INFO:teuthology.orchestra.run.smithi057.stderr: 96.5% -- replaced with /var/log/ceph/ceph-client.admin.255493.log.gz 2024-03-27T19:56:02.549 INFO:teuthology.orchestra.run.smithi057.stderr: 96.6% -- replaced with /var/log/ceph/ceph-client.admin.255018.log.gz 2024-03-27T19:56:03.669 INFO:teuthology.orchestra.run.smithi057.stderr: 95.8% -- replaced with /var/log/ceph/ceph-client.admin.232256.log.gz 2024-03-27T19:56:05.929 INFO:teuthology.orchestra.run.smithi057.stderr: 96.7% -- replaced with /var/log/ceph/ceph-client.admin.286018.log.gz 2024-03-27T19:56:21.957 INFO:teuthology.orchestra.run.smithi057.stderr: 95.3% -- replaced with /var/log/ceph/ceph-client.admin.124656.log.gz 2024-03-27T19:56:23.634 INFO:teuthology.orchestra.run.smithi057.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.499850.log.gz 2024-03-27T19:56:24.761 INFO:teuthology.orchestra.run.smithi057.stderr: 96.6% -- replaced with /var/log/ceph/ceph-client.admin.252445.log.gz 2024-03-27T19:56:24.889 INFO:teuthology.orchestra.run.smithi057.stderr: 97.2% -- replaced with /var/log/ceph/ceph-client.admin.407885.log.gz 2024-03-27T19:56:26.633 INFO:teuthology.orchestra.run.smithi118.stderr: 91.8% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-03-27T19:56:26.740 INFO:teuthology.orchestra.run.smithi118.stderr: 91.8% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-03-27T19:56:50.428 INFO:teuthology.orchestra.run.smithi057.stderr: 96.9% -- replaced with /var/log/ceph/ceph-client.admin.497655.log.gz 2024-03-27T19:56:51.408 INFO:teuthology.orchestra.run.smithi057.stderr: 95.1% -- replaced with /var/log/ceph/ceph-client.admin.250019.log.gz 2024-03-27T19:57:02.337 INFO:teuthology.orchestra.run.smithi118.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-03-27T19:57:04.171 INFO:teuthology.orchestra.run.smithi118.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-03-27T19:57:15.730 INFO:teuthology.orchestra.run.smithi057.stderr: 96.8% -- replaced with /var/log/ceph/ceph-client.admin.135081.log.gz 2024-03-27T19:57:17.485 INFO:teuthology.orchestra.run.smithi118.stderr: 91.8% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-03-27T19:57:42.520 INFO:teuthology.orchestra.run.smithi057.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.121822.log.gz 2024-03-27T19:57:45.013 INFO:teuthology.orchestra.run.smithi057.stderr: 96.0% -- replaced with /var/log/ceph/ceph-client.admin.232731.log.gz 2024-03-27T19:57:48.219 INFO:teuthology.orchestra.run.smithi057.stderr: 94.0% -- replaced with /var/log/ceph/ceph-client.admin.258692.log.gz 2024-03-27T19:58:16.065 INFO:teuthology.orchestra.run.smithi057.stderr: 94.0% -- replaced with /var/log/ceph/ceph-client.admin.187903.log.gz 2024-03-27T19:58:19.794 INFO:teuthology.orchestra.run.smithi057.stderr: 94.1% -- replaced with /var/log/ceph/ceph-client.admin.154703.log.gz 2024-03-27T19:58:27.239 INFO:teuthology.orchestra.run.smithi057.stderr: 95.8% -- replaced with /var/log/ceph/ceph-client.admin.351845.log.gz 2024-03-27T19:58:37.726 INFO:teuthology.orchestra.run.smithi118.stderr: 91.7% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-03-27T19:58:37.731 INFO:teuthology.orchestra.run.smithi118.stderr: 2024-03-27T19:58:37.731 INFO:teuthology.orchestra.run.smithi118.stderr:real 3m29.047s 2024-03-27T19:58:37.731 INFO:teuthology.orchestra.run.smithi118.stderr:user 4m53.610s 2024-03-27T19:58:37.731 INFO:teuthology.orchestra.run.smithi118.stderr:sys 0m32.008s 2024-03-27T20:00:14.024 INFO:teuthology.orchestra.run.smithi057.stderr: 94.0% -- replaced with /var/log/ceph/ceph-client.admin.188463.log.gz 2024-03-27T20:00:56.257 INFO:teuthology.orchestra.run.smithi057.stderr: 94.1% -- replaced with /var/log/ceph/ceph-client.admin.164462.log.gz 2024-03-27T20:01:33.138 INFO:teuthology.orchestra.run.smithi057.stderr: 94.9% -- replaced with /var/log/ceph/ceph-client.admin.369490.log.gz 2024-03-27T20:01:41.687 INFO:teuthology.orchestra.run.smithi057.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-03-27T20:02:20.670 INFO:teuthology.orchestra.run.smithi057.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.149714.log.gz 2024-03-27T20:03:04.567 INFO:teuthology.orchestra.run.smithi057.stderr: 96.0% -- replaced with /var/log/ceph/ceph-client.admin.199451.log.gz 2024-03-27T20:03:32.023 INFO:teuthology.orchestra.run.smithi057.stderr: 94.9% -- replaced with /var/log/ceph/ceph-client.admin.114814.log.gz 2024-03-27T20:03:45.880 INFO:teuthology.orchestra.run.smithi057.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.168797.log.gz 2024-03-27T20:04:50.220 INFO:teuthology.orchestra.run.smithi057.stderr: 94.7% -- replaced with /var/log/ceph/ceph-client.admin.408786.log.gz 2024-03-27T20:06:14.965 INFO:teuthology.orchestra.run.smithi057.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.117197.log.gz 2024-03-27T20:09:18.979 INFO:teuthology.orchestra.run.smithi057.stderr: 96.4% -- replaced with /var/log/ceph/ceph-client.admin.268610.log.gz 2024-03-27T20:11:04.334 INFO:teuthology.orchestra.run.smithi057.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.247347.log.gz 2024-03-27T20:11:15.607 INFO:teuthology.orchestra.run.smithi057.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.115314.log.gz 2024-03-27T20:11:32.904 INFO:teuthology.orchestra.run.smithi057.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.518433.log.gz 2024-03-27T20:14:23.811 INFO:teuthology.orchestra.run.smithi057.stderr: 95.4% -- replaced with /var/log/ceph/ceph-client.admin.376289.log.gz 2024-03-27T20:14:47.921 INFO:teuthology.orchestra.run.smithi057.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.admin.118194.log.gz 2024-03-27T20:16:19.358 INFO:teuthology.orchestra.run.smithi057.stderr: 90.2% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-03-27T20:17:52.362 INFO:teuthology.orchestra.run.smithi057.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.509720.log.gz 2024-03-27T20:18:19.781 INFO:teuthology.orchestra.run.smithi057.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.507297.log.gz 2024-03-27T20:18:47.176 INFO:teuthology.orchestra.run.smithi057.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.505647.log.gz 2024-03-27T20:18:59.721 INFO:teuthology.orchestra.run.smithi057.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.508518.log.gz 2024-03-27T20:19:25.368 INFO:teuthology.orchestra.run.smithi057.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.510850.log.gz 2024-03-27T20:19:42.848 INFO:teuthology.orchestra.run.smithi057.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.512058.log.gz 2024-03-27T20:20:30.170 INFO:teuthology.orchestra.run.smithi057.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.513353.log.gz 2024-03-27T20:20:49.997 INFO:teuthology.orchestra.run.smithi057.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.514562.log.gz 2024-03-27T20:21:03.686 INFO:teuthology.orchestra.run.smithi057.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.515814.log.gz 2024-03-27T20:21:19.377 INFO:teuthology.orchestra.run.smithi057.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.517060.log.gz 2024-03-27T20:21:43.296 INFO:teuthology.orchestra.run.smithi057.stderr: 95.2% -- replaced with /var/log/ceph/ceph-client.admin.289018.log.gz 2024-03-27T20:26:14.359 INFO:teuthology.orchestra.run.smithi057.stderr: 94.5% -- replaced with /var/log/ceph/ceph-client.admin.195338.log.gz 2024-03-27T20:27:16.169 INFO:teuthology.orchestra.run.smithi057.stderr: 95.6% -- replaced with /var/log/ceph/ceph-client.admin.445993.log.gz 2024-03-27T20:28:42.483 INFO:teuthology.orchestra.run.smithi057.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.279045.log.gz 2024-03-27T20:39:02.424 INFO:teuthology.orchestra.run.smithi057.stderr: 94.0% -- replaced with /var/log/ceph/ceph-client.admin.431622.log.gz 2024-03-27T20:39:35.261 INFO:teuthology.orchestra.run.smithi057.stderr: 94.1% -- replaced with /var/log/ceph/ceph-client.admin.436258.log.gz 2024-03-27T20:44:44.642 INFO:teuthology.orchestra.run.smithi057.stderr: 91.7% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-03-27T20:48:30.535 INFO:teuthology.orchestra.run.smithi057.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.160860.log.gz 2024-03-27T20:49:37.368 INFO:teuthology.orchestra.run.smithi057.stderr: 91.6% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-03-27T21:03:40.265 INFO:teuthology.orchestra.run.smithi057.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-03-27T21:10:10.467 INFO:teuthology.orchestra.run.smithi057.stderr: 95.6% -- replaced with /var/log/ceph/ceph-client.admin.151557.log.gz 2024-03-27T21:16:41.059 INFO:teuthology.orchestra.run.smithi057.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.529309.log.gz 2024-03-27T21:16:41.065 INFO:teuthology.orchestra.run.smithi057.stderr: 2024-03-27T21:16:41.065 INFO:teuthology.orchestra.run.smithi057.stderr:real 81m32.386s 2024-03-27T21:16:41.065 INFO:teuthology.orchestra.run.smithi057.stderr:user 70m5.621s 2024-03-27T21:16:41.065 INFO:teuthology.orchestra.run.smithi057.stderr:sys 9m53.845s 2024-03-27T21:16:41.067 INFO:tasks.ceph:Archiving logs... 2024-03-27T21:16:41.067 DEBUG:teuthology.misc:Transferring archived files from smithi057:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-03-27_05:27:11-fs-wip-rishabh-testing-20240326.131558-testing-default-smithi/7625753/remote/smithi057/log 2024-03-27T21:16:41.069 DEBUG:teuthology.orchestra.run.smithi057:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-27T21:30:23.020 DEBUG:teuthology.misc:Transferring archived files from smithi118:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-03-27_05:27:11-fs-wip-rishabh-testing-20240326.131558-testing-default-smithi/7625753/remote/smithi118/log 2024-03-27T21:30:23.046 DEBUG:teuthology.orchestra.run.smithi118:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-27T21:36:52.678 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-03-27T21:36:52.689 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-03-27T21:36:52.689 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-27T21:36:52.698 DEBUG:teuthology.orchestra.run.smithi118:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-27T21:36:52.848 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-03-27T21:36:52.857 INFO:teuthology.task.clock:Checking final clock skew... 2024-03-27T21:36:52.857 DEBUG:teuthology.orchestra.run.smithi057:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-27T21:36:52.866 DEBUG:teuthology.orchestra.run.smithi118:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-27T21:36:52.914 INFO:teuthology.orchestra.run.smithi057.stderr:bash: line 1: ntpq: command not found 2024-03-27T21:36:52.921 INFO:teuthology.orchestra.run.smithi118.stderr:bash: line 1: ntpq: command not found 2024-03-27T21:36:52.941 INFO:teuthology.orchestra.run.smithi118.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-27T21:36:52.942 INFO:teuthology.orchestra.run.smithi118.stdout:=============================================================================== 2024-03-27T21:36:52.942 INFO:teuthology.orchestra.run.smithi118.stdout:^+ hv01.front.sepia.ceph.com 2 8 377 161 +411us[ +365us] +/- 79ms 2024-03-27T21:36:52.942 INFO:teuthology.orchestra.run.smithi118.stdout:^* hv02.front.sepia.ceph.com 3 6 377 25 -259us[ -285us] +/- 48ms 2024-03-27T21:36:52.942 INFO:teuthology.orchestra.run.smithi118.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 12 -66us[ -66us] +/- 65ms 2024-03-27T21:36:52.942 INFO:teuthology.orchestra.run.smithi118.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-03-27T21:36:53.025 INFO:teuthology.orchestra.run.smithi057.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-27T21:36:53.026 INFO:teuthology.orchestra.run.smithi057.stdout:=============================================================================== 2024-03-27T21:36:53.026 INFO:teuthology.orchestra.run.smithi057.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 15 +391us[ +379us] +/- 81ms 2024-03-27T21:36:53.026 INFO:teuthology.orchestra.run.smithi057.stdout:^* hv02.front.sepia.ceph.com 3 6 377 15 -222us[ -234us] +/- 49ms 2024-03-27T21:36:53.026 INFO:teuthology.orchestra.run.smithi057.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 12 -18us[ -18us] +/- 65ms 2024-03-27T21:36:53.026 INFO:teuthology.orchestra.run.smithi057.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-03-27T21:36:53.029 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-03-27T21:36:53.038 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-03-27T21:36:53.039 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-03-27T21:36:53.048 DEBUG:teuthology.orchestra.run.smithi057:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-03-27T21:36:53.466 DEBUG:teuthology.orchestra.run.smithi118:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-03-27T21:36:53.773 DEBUG:teuthology.orchestra.run.smithi057:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-03-27T21:36:53.888 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-27T21:36:53.888 DEBUG:teuthology.orchestra.run.smithi118:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-03-27T21:36:53.992 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-27T21:36:53.993 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-03-27T21:36:54.003 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-03-27T21:36:54.022 INFO:teuthology.task.internal:Duration was 42445.380661 seconds 2024-03-27T21:36:54.023 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-03-27T21:36:54.032 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-03-27T21:36:54.032 DEBUG:teuthology.orchestra.run.smithi057:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-27T21:36:54.040 DEBUG:teuthology.orchestra.run.smithi118:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-27T21:36:54.250 INFO:teuthology.orchestra.run.smithi057.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-27T21:36:54.274 INFO:teuthology.orchestra.run.smithi118.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-27T21:36:54.862 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-03-27T21:36:54.863 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi057.front.sepia.ceph.com 2024-03-27T21:36:54.863 DEBUG:teuthology.orchestra.run.smithi057:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-27T21:36:54.949 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi118.front.sepia.ceph.com 2024-03-27T21:36:54.949 DEBUG:teuthology.orchestra.run.smithi118:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-27T21:36:55.030 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-03-27T21:36:55.030 DEBUG:teuthology.orchestra.run.smithi057:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-27T21:36:55.038 DEBUG:teuthology.orchestra.run.smithi118:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-27T21:36:55.137 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-03-27T21:36:55.137 DEBUG:teuthology.orchestra.run.smithi057:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-27T21:36:55.147 DEBUG:teuthology.orchestra.run.smithi118:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-27T21:36:55.818 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-03-27T21:36:55.829 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-03-27T21:36:55.829 DEBUG:teuthology.orchestra.run.smithi057:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-27T21:36:55.932 DEBUG:teuthology.orchestra.run.smithi118:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-27T21:36:56.032 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-03-27T21:36:56.043 DEBUG:teuthology.orchestra.run.smithi057:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-27T21:36:56.051 DEBUG:teuthology.orchestra.run.smithi118:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-27T21:36:56.176 INFO:teuthology.orchestra.run.smithi118.stdout:kernel.core_pattern = core 2024-03-27T21:36:56.176 INFO:teuthology.orchestra.run.smithi057.stdout:kernel.core_pattern = core 2024-03-27T21:36:56.252 DEBUG:teuthology.orchestra.run.smithi057:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-27T21:36:56.306 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-27T21:36:56.307 DEBUG:teuthology.orchestra.run.smithi118:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-27T21:36:56.361 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-27T21:36:56.361 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-03-27T21:36:56.372 INFO:teuthology.task.internal:Transferring archived files... 2024-03-27T21:36:56.374 DEBUG:teuthology.misc:Transferring archived files from smithi057:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-03-27_05:27:11-fs-wip-rishabh-testing-20240326.131558-testing-default-smithi/7625753/remote/smithi057 2024-03-27T21:36:56.374 DEBUG:teuthology.orchestra.run.smithi057:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-27T21:36:56.498 DEBUG:teuthology.misc:Transferring archived files from smithi118:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-03-27_05:27:11-fs-wip-rishabh-testing-20240326.131558-testing-default-smithi/7625753/remote/smithi118 2024-03-27T21:36:56.498 DEBUG:teuthology.orchestra.run.smithi118:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-27T21:36:56.606 INFO:teuthology.task.internal:Removing archive directory... 2024-03-27T21:36:56.606 DEBUG:teuthology.orchestra.run.smithi057:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-27T21:36:56.614 DEBUG:teuthology.orchestra.run.smithi118:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-27T21:36:56.700 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-03-27T21:36:56.713 INFO:teuthology.task.internal:Not uploading archives. 2024-03-27T21:36:56.713 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-03-27T21:36:56.725 INFO:teuthology.task.internal:Tidying up after the test... 2024-03-27T21:36:56.725 DEBUG:teuthology.orchestra.run.smithi057:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-27T21:36:56.733 DEBUG:teuthology.orchestra.run.smithi118:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-27T21:36:56.784 INFO:teuthology.orchestra.run.smithi057.stdout: 395173 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:36 /home/ubuntu/cephtest 2024-03-27T21:36:56.789 INFO:teuthology.orchestra.run.smithi118.stdout: 524301 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 21:36 /home/ubuntu/cephtest 2024-03-27T21:36:56.792 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-03-27T21:36:56.804 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-03-27T21:36:56.828 INFO:teuthology.nuke:Checking targets against current locks 2024-03-27T21:36:56.855 DEBUG:teuthology.nuke:shortname: smithi057 2024-03-27T21:36:56.856 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-27T21:36:56.883 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi057.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-03-27_05:27:11-fs-wip-rishabh-testing-20240326.131558-testing-default-smithi/7625753', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-27 09:38:23.504182', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBG7KokvzCOi8Nbw+dh7uIJ1WZcMHNo/9cXZPtyo2o9dDBCShEhbm+6ZdkUig8qMpvw6Svrvbd75nS+iy0GC7eH4='} 2024-03-27T21:36:56.885 DEBUG:teuthology.nuke:shortname: smithi118 2024-03-27T21:36:56.885 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-27T21:36:56.914 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi118.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-03-27_05:27:11-fs-wip-rishabh-testing-20240326.131558-testing-default-smithi/7625753', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-27 09:38:23.502782', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNOxjBCdu8PZlUX2LDU4u3fdfWSbzvPjKPxXqdqEbcD9bnoPnMpSQKxUqM71fYf+lxpDh+hlkdejOhO2VG7zE2U='} 2024-03-27T21:36:56.944 INFO:teuthology.orchestra.console.smithi057:Power off 2024-03-27T21:36:56.945 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-27T21:36:56.972 DEBUG:teuthology.orchestra.console.smithi057:power off output: Chassis Power Control: Down/Off 2024-03-27T21:36:56.972 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-27T21:36:56.988 INFO:teuthology.orchestra.console.smithi118:Power off 2024-03-27T21:36:56.989 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-27T21:36:57.000 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is on 2024-03-27T21:36:57.011 DEBUG:teuthology.orchestra.console.smithi118:power off output: Chassis Power Control: Down/Off 2024-03-27T21:36:57.011 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-27T21:36:57.038 DEBUG:teuthology.orchestra.console.smithi118:check power output: Chassis Power is on 2024-03-27T21:37:01.001 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-27T21:37:01.040 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-27T21:37:01.111 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is on 2024-03-27T21:37:01.154 DEBUG:teuthology.orchestra.console.smithi118:check power output: Chassis Power is on 2024-03-27T21:37:05.115 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-27T21:37:05.156 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-27T21:37:05.226 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is on 2024-03-27T21:37:05.267 DEBUG:teuthology.orchestra.console.smithi118:check power output: Chassis Power is on 2024-03-27T21:37:09.230 DEBUG:teuthology.orchestra.console.smithi057:pexpect command: ipmitool -H smithi057.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-27T21:37:09.267 DEBUG:teuthology.orchestra.console.smithi118:pexpect command: ipmitool -H smithi118.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-27T21:37:09.341 DEBUG:teuthology.orchestra.console.smithi057:check power output: Chassis Power is off 2024-03-27T21:37:09.379 DEBUG:teuthology.orchestra.console.smithi118:check power output: Chassis Power is off 2024-03-27T21:37:09.442 INFO:teuthology.orchestra.console.smithi057:Power off completed 2024-03-27T21:37:09.480 INFO:teuthology.orchestra.console.smithi118:Power off completed 2024-03-27T21:37:09.585 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/xfstests-dev} duration: 42445.38066124916 failure_reason: 'Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev)' flavor: default mon.a-kernel-sha1: 1df0c7e8a2354c42d738e5454ba83ea7332deac2 mon.b-kernel-sha1: 1df0c7e8a2354c42d738e5454ba83ea7332deac2 owner: scheduled_rishabh@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=67784eaf8b9e4c4c8bfb0e689a0dbc83 status: fail success: false 2024-03-27T21:37:09.586 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-27T21:37:09.678 INFO:teuthology.run:FAIL